Skip to content
This repository was archived by the owner on Aug 1, 2025. It is now read-only.

Conversation

@ezyang
Copy link
Contributor

@ezyang ezyang commented Aug 9, 2022

Previously it was in pytorch/pytorch but it depends on torchdynamo
code more closely, so this seems like the logical place.

Previously at pytorch/pytorch#80566

Signed-off-by: Edward Z. Yang ezyang@fb.com

Previously it was in pytorch/pytorch but it depends on torchdynamo code more closely, so this seems like the logical place. Previously at pytorch/pytorch#80566 Signed-off-by: Edward Z. Yang <ezyang@fb.com>
ezyang added 2 commits August 9, 2022 19:56
Signed-off-by: Edward Z. Yang <ezyang@fb.com>
Signed-off-by: Edward Z. Yang <ezyang@fb.com>
@ezyang ezyang merged commit 3f2decb into pytorch:main Aug 10, 2022
@ezyang ezyang deleted the cudagraphs branch August 10, 2022 03:48
@anijain2305
Copy link
Contributor

@ezyang Should we also add a aot_nvfuser_cudagraphs i.e. AOTAutograd + Ts-nvfuser with Cudagraphs

@ezyang
Copy link
Contributor Author

ezyang commented Aug 10, 2022

We have aot nvfuser, but I'm not sure how the cudagraphs integration with nvfuser works. @Chillee might know more, he said he hacked in inductor's cuda graphs support to nvfuser. Note that cuda graphs is antipattern for dynamic shapes, and also there is quite a bit of logic needed to get it right (which I think is being duped between this backend and inductors' cudagraphs support)

pytorchmergebot pushed a commit to pytorch/pytorch that referenced this pull request Aug 10, 2022
facebook-github-bot pushed a commit to pytorch/pytorch that referenced this pull request Aug 11, 2022
) Summary: These files are now in pytorch/torchdynamo#757 Pull Request resolved: #83128 Approved by: https://github.com/ezyang Test Plan: contbuild & OSS CI, see https://hud.pytorch.org/commit/pytorch/pytorch/0e8beb7d0d1c10e155d650dcf57a8468b3faa423 Reviewed By: seemethere Differential Revision: D38600199 Pulled By: msaroufim fbshipit-source-id: 04906e1907fc916a4b22158c277d5ca6cf49bfd7
Sign up for free to subscribe to this conversation on GitHub. Already have an account? Sign in.

4 participants