Skip to content

silence destroy_proces_group() warning #1387

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom
Merged
merged 1 commit into from
Aug 25, 2025
Merged

silence destroy_proces_group() warning #1387

merged 1 commit into from
Aug 25, 2025
+10 −0

Conversation

@msaroufim
Copy link
Member

@msaroufim msaroufim commented Aug 25, 2025 •
edited
Loading

All these examples have warnings of the below sort

[rank0]:[W825 13:09:39.967659278 ProcessGroupNCCL.cpp:1538] Warning: WARNING: destroy_process_group() was not called before program exit, which can leak resources. For more info, please see https://pytorch.org/docs/stable/distributed.html#shutdown (function operator()) (create) ➜ tensor_parallelism git:(main) ✗ CUDA_VISIBLE_DEVICES=4,5,6,7 torchrun --nnodes=1 --nproc_per_node=4 tensor_parallel_example.py

I don't think they're "dangerous" since people seem to ignore them just fine so this is just to be nice
@netlify
Copy link

netlify bot commented Aug 25, 2025 •
edited
Loading

✅ Deploy Preview for pytorch-examples-preview canceled.

Name Link
🔨 Latest commit 6079ce6
🔍 Latest deploy log https://app.netlify.com/projects/pytorch-examples-preview/deploys/68acc4de35f8dc0008c811d7
@meta-cla meta-cla bot added the cla signed label Aug 25, 2025
@msaroufim msaroufim merged commit 77f55b9 into main Aug 25, 2025
8 checks passed
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

cla signed

2 participants

@msaroufim