MoE Long-Context Training

Long-context MoE training guidance for Megatron Bridge. Covers CP sizing, selective recompute, dispatcher choices, and practical patterns from DSV3, Qwen3, and Qwen3-Next long-context experiments.

Source: github.com/NVIDIA/skills/tree/HEAD/skills/nemo-mbridge-perf-moe-long-context · License: Other