Sequence Packing Skill

Validate and use packed sequences and long-context training in Megatron-Bridge, distinguishing offline packed SFT for LLMs from in-batch packing for VLMs, and applying the right CP constraints.

Source: github.com/NVIDIA/skills/tree/HEAD/skills/nemo-mbridge-perf-sequence-packing · License: Other