Adding documentation for learning rate schedule #3603
Merged
Conversation
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters. Learn more about bidirectional Unicode characters
ervteng reviewed Mar 10, 2020
docs/Training-ML-Agents.md Outdated
| | init_entcoef | How much the agent should explore in the beginning of training. | SAC | | ||
| | lambd | The regularization parameter. | PPO | | ||
| | learning_rate | The initial learning rate for gradient descent. | PPO, SAC | | ||
| | learning_rate_schedule | Determines how learning rate changes over time. Options: linear (default), constant | PPO, SAC | |
There was a problem hiding this comment.
The defaults are actually different for PPO and SAC - would just leave out the options as they're specified within the PPO/SAC docs
There was a problem hiding this comment.
should we provide a link to the PPO/SAC docs here?
There was a problem hiding this comment.
I think there's a link at the top of the table
There was a problem hiding this comment.
changes made. can you please approve?
ervteng approved these changes Mar 10, 2020
Sign up for free to subscribe to this conversation on GitHub. Already have an account? Sign in.
3 participants
Add this suggestion to a batch that can be applied as a single commit. This suggestion is invalid because no changes were made to the code. Suggestions cannot be applied while the pull request is closed. Suggestions cannot be applied while viewing a subset of changes. Only one suggestion per line can be applied in a batch. Add this suggestion to a batch that can be applied as a single commit. Applying suggestions on deleted lines is not supported. You must change the existing code in this line in order to create a valid suggestion. Outdated suggestions cannot be applied. This suggestion has been applied or marked resolved. Suggestions cannot be applied from pending reviews. Suggestions cannot be applied on multi-line comments. Suggestions cannot be applied while the pull request is queued to merge. Suggestion cannot be applied right now. Please check back later.
Proposed change(s)
Added a description of
learning_rate_schedulein the docsUseful links (Github issues, JIRA tickets, ML-Agents forum threads etc.)
#3328
https://jira.unity3d.com/browse/MLA-751
Types of change(s)
Checklist
Other comments