MoE VLM Training

Practical guidance for training MoE VLMs in Megatron Bridge. Compares FSDP and 3D-parallel approaches, using rounded lessons from Qwen3-VL, Qwen3-Next, and other multimodal experiments.

Source: github.com/NVIDIA/skills/tree/HEAD/skills/nemo-mbridge-perf-moe-vlm-training · License: Other