Multi-Node Slurm

Convert single-node scripts to multi-node Slurm sbatch jobs and debug common multi-node failures. Covers srun-native vs uv run torch.distributed approaches, container setup, NCCL timeouts, OOM sizing for MoE models, and interactive allocation.

Source: github.com/NVIDIA/skills/tree/HEAD/skills/nemo-mbridge-multi-node-slurm · License: Other