Memory Tuning

Techniques for reducing peak GPU memory in Megatron Bridge — expandable segments, PEFT + SP input re-gather, parallelism resizing, activation recompute, CPU offloading constraints, and common OOM fixes.

Source: github.com/NVIDIA/skills/tree/HEAD/skills/nemo-mbridge-perf-memory-tuning · License: Other