
mcore-run-on-slurm
How to launch distributed Megatron-LM training jobs on a SLURM cluster
by nvidiaFree
Description
How to launch distributed Megatron-LM training jobs on a SLURM cluster. Covers a minimal sbatch skeleton, environment-variable setup for torch.distributed.run,…
Ratings & Reviews
No ratings yet
Be the first to rate mcore-run-on-slurm.
People also visit
mcore-run-on-slurm FAQ
What is mcore-run-on-slurm?
How to launch distributed Megatron-LM training jobs on a SLURM cluster. Covers a minimal sbatch skeleton, environment-variable setup for torch.distributed.run,
Is mcore-run-on-slurm free?
Yes. mcore-run-on-slurm is free to use.
Do I need to download mcore-run-on-slurm?
No. mcore-run-on-slurm runs in your browser at skills.sh, so there's nothing to install.
Who makes mcore-run-on-slurm?
mcore-run-on-slurm is made by nvidia.
What are the best mcore-run-on-slurm alternatives?
Popular alternatives to mcore-run-on-slurm include frontend-design, artifacts-builder and canvas-design. See all mcore-run-on-slurm alternatives



