- Notifications
You must be signed in to change notification settings - Fork 648
DeepSpeed Apex Automatic Mixed Precision
afiaka87 edited this page Apr 18, 2021 · 2 revisions
git clone https://github.com/NVIDIA/apex cd apex pip install -v --disable-pip-version-check --no-cache-dir --global-option="--cpp_ext" --global-option="--cuda_ext" ./deepspeed_config = { 'train_batch_size': BATCH_SIZE, 'gradient_clipping': GRAD_CLIP_NORM, 'amp': { 'enabled': True, 'opt_level': 'O1', } }