Skip to content

mark fsdp1 as deprecated and point to fsdp2 #1374

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Merged
merged 6 commits into from
Jul 21, 2025
+6 −2
Merged

mark fsdp1 as deprecated and point to fsdp2 #1374

Changes from 1 commit
Commits
Show all changes
6 commits
Select commit Hold shift + click to select a range
7815968
FSDP2 example
weifengpy May 8, 2025
98dd2c2
update README
weifengpy May 8, 2025
6757e4e
fix typo in README
weifengpy May 9, 2025
d281dcd
fix README
weifengpy May 9, 2025
3635e8e
Merge branch 'pytorch:main' into main
weifengpy Jul 21, 2025
e18db8c
point to fsdp2 in fsdp1 code example
weifengpy Jul 21, 2025
File filter

Filter by extension
Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
Prev Previous commit
Next Next commit
fix README 
Summary: Test Plan: Reviewers: Subscribers: Tasks: Tags:
  • Loading branch information
@weifengpy
weifengpy committed May 9, 2025
commit d281dcdef62320876e3eb6d4ac945198bf33a19d
2 changes: 1 addition & 1 deletion distributed/FSDP2/README.md
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -4,7 +4,7 @@ To run FSDP2 on transformer model:
cd distributed/FSDP2
torchrun --nproc_per_node 2 train.py
```
* For 1st time, it creates a "checkpoints" folder and save state dicts there
* For 1st time, it creates a "checkpoints" folder and saves state dicts there
* For 2nd time, it loads from previous checkpoints

To enable explicit prefetching
Expand Down