Open source alternatives to mcore-run-on-slurm
No open source apps like mcore-run-on-slurm yet.
About mcore-run-on-slurm
M
mcore-run-on-slurm
How to launch distributed Megatron-LM training jobs on a SLURM cluster
How to launch distributed Megatron-LM training jobs on a SLURM cluster. Covers a minimal sbatch skeleton, environment-variable setup for torch.distributed.run,
- Price
- Free
- Made by
- nvidia
- Category
- AI Skills
- Website
- github.com/nvidia/skills/mcore-run-on-slurm