【Hackathon 6th No. 27】为 paddle.io.RandomSampler/random_split /Layer.clear_gradients 进行功能增强 #6594
Conversation
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters. Learn more about bidirectional Unicode characters
| 感谢你贡献飞桨文档，文档预览构建中，Docs-New 跑完后即可预览，预览链接：http://preview-pr-6594.paddle-docs-preview.paddlepaddle.org.cn/documentation/docs/zh/api/index_cn.html |
zhwesky2010 pushed a commit to zhwesky2010/docs that referenced this pull request Apr 8, 2024
* add backednds.cudnn.version * add celu * add torch.distributed.ReduceOp * update some docs * update some docs of PaddlePaddle#6594 * update some docs
zhwesky2010 reviewed Apr 9, 2024
| ``` | ||
| | ||
| PyTorch 相比 Paddle 支持更多其他参数，具体如下： | ||
| PyTorch 的 `Module.zero_grad` 参数与 Paddle 的 `Layer.clear_gradients` 参数用法不同，具体如下： |
| | PyTorch | PaddlePaddle | 备注 | | ||
| | ----------- | ------------ | ------------------------------------------------ | | ||
| | set_to_none | - | 是否设置为 None，Paddle 无此参数，暂无转写方式。 | | ||
| | set_to_none | set_to_zero | 设置如何清空梯度，PyTorch 默认设置为 None，Paddle 默认设置为 0，需要转写。 | |
Collaborator
There was a problem hiding this comment.
Pytoch直接写None的表现吧，None就是设为True的意思吧
两者功能刚好相反，Paddle需设置为False
写的时候尽量让用户一眼就能直观看明白双方的差异（这个的差异是两者功能刚好相反），所以你要加入一些自己的理解，而不是直接复制原参数介绍
zhwesky2010 approved these changes Apr 10, 2024
| | ||
| ```python | ||
| paddle.nn.Layer.clear_gradients() | ||
| paddle.nn.Layer.clear_gradients(set_to_zero=True) |
Collaborator
There was a problem hiding this comment.
后面再给 paddle.nn.Layer.clear_gradients 加一个别名 paddle.nn.Layer.clear_grad 吧，这样可以和 paddle.optim.Optimizer.clear_grad 完全对应上
NKNaN changed the title Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
4 participants
Add this suggestion to a batch that can be applied as a single commit. This suggestion is invalid because no changes were made to the code. Suggestions cannot be applied while the pull request is closed. Suggestions cannot be applied while viewing a subset of changes. Only one suggestion per line can be applied in a batch. Add this suggestion to a batch that can be applied as a single commit. Applying suggestions on deleted lines is not supported. You must change the existing code in this line in order to create a valid suggestion. Outdated suggestions cannot be applied. This suggestion has been applied or marked resolved. Suggestions cannot be applied from pending reviews. Suggestions cannot be applied on multi-line comments. Suggestions cannot be applied while the pull request is queued to merge. Suggestion cannot be applied right now. Please check back later.
refer to:
PaddlePaddle/Paddle#62966