timm bits #804
Open
timm bits #804
Conversation
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters. Learn more about bidirectional Unicode characters
…n, val... some of it working
…ipt since torch.dist.launch doesn't work
…step closure used, metrics base impl w/ distributed reduce, many tweaks/fixes.
…d other cleanup. More to go...
…h XLA usage on TPU-VM. Add some FIXMEs and fold train_cfg into train_state by default.
… XLA (pushing into transforms), revamp of transform/preproc config, etc ongoing...
…els into bits_and_tpu
…ers more similar. Fix workers=0 compatibility. Add ImageNet22k/12k synset defs.
…1k/22k/12k indices filters to results/
…idation script fallback
Add support for different TFDS `BuilderConfig`s
Fix issue with `torchvision`'s `ImageNet`
| is this still in progress ? |
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Add this suggestion to a batch that can be applied as a single commit. This suggestion is invalid because no changes were made to the code. Suggestions cannot be applied while the pull request is closed. Suggestions cannot be applied while viewing a subset of changes. Only one suggestion per line can be applied in a batch. Add this suggestion to a batch that can be applied as a single commit. Applying suggestions on deleted lines is not supported. You must change the existing code in this line in order to create a valid suggestion. Outdated suggestions cannot be applied. This suggestion has been applied or marked resolved. Suggestions cannot be applied from pending reviews. Suggestions cannot be applied on multi-line comments. Suggestions cannot be applied while the pull request is queued to merge. Suggestion cannot be applied right now. Please check back later.
The branch associated with this PR is for development of
timm bits-- a significant update and reorganizaiton of timm's training scripts and associated modules. It works w/ TPUs (PyTorch XLA) and GPUs (PyTorch) and possibly DeepSpeed.This PR is still a long ways from being merged. Having the branch as a PR helps w/ visibility of the ongoing work.