run-on-slurm
oleh nvidia
How to launch distributed Megatron-LM training jobs on a SLURM cluster. Covers a minimal sbatch skeleton, environment-variable setup for torch.distributed.run,…
npx skills add https://github.com/nvidia/megatron-lm --skill run-on-slurm