run-on-slurm

作者: nvidia

如何在SLURM集群上启动分布式Megatron-LM训练任务。涵盖最小sbatch框架、torch.distributed.run的环境变量设置…

npx skills add https://github.com/nvidia/megatron-lm --skill run-on-slurm