File tree Expand file tree Collapse file tree 2 files changed +5
-3
lines changed Expand file tree Collapse file tree 2 files changed +5
-3
lines changed Original file line number Diff line number Diff line change 1212
1313## What's New  
1414
15- ## Oct 16, 2025  
15+ ## Oct 16-20 , 2025  
1616*  Add an impl of the Muon optimizer (based on https://github.com/KellerJordan/Muon ) with customizations
1717 *  extra flexibility and improved handling for conv weights and fallbacks for weight shapes not suited for orthogonalization
1818 *  small speedup for NS iterations by reducing allocs and using fused (b)add(b)mm ops
1919 *  by default uses AdamW (or NAdamW if ` nesterov=True ` ) updates if muon not suitable for parameter shape (or excluded via param group flag)
2020 *  like torch impl, select from several LR scale adjustment fns via ` adjust_lr_fn ` 
2121 *  select from several NS coefficient presets or specify your own via ` ns_coefficients ` 
22- *  First 2 steps of 'meta' device model initalization  supported
22+ *  First 2 steps of 'meta' device model initialization  supported
2323 *  Fix several ops that were breaking creation under 'meta' device context
2424 *  Add device & dtype factory kwarg support to all models and modules (anything inherting from nn.Module) in ` timm ` 
25+ *  License fields added to pretrained cfgs in code
26+ *  Release 1.0.21
2527
2628## Sept 21, 2025  
2729*  Remap DINOv3 ViT weight tags from ` lvd_1689m `  -> ` lvd1689m `  to match (same for ` sat_493m `  -> ` sat493m ` )
Original file line number Diff line number Diff line change 1- __version__  =  '1.0.21.dev0 ' 
1+ __version__  =  '1.0.21' 
                                 You can’t perform that action at this time. 
               
                  
0 commit comments