CPU Offloading

Validate and use CPU offloading in Megatron Bridge, including layer-level activation offloading and fractional optimizer state offloading with HybridDeviceOptimizer.

Source: github.com/NVIDIA/skills/tree/HEAD/skills/nemo-mbridge-perf-cpu-offloading · License: Other