Open source alternatives to nemo-mbridge-perf-memory-tuning
No open source apps like nemo-mbridge-perf-memory-tuning yet.
About nemo-mbridge-perf-memory-tuning
N
nemo-mbridge-perf-memory-tuning
Techniques for reducing peak GPU memory in Megatron Bridge
Techniques for reducing peak GPU memory in Megatron Bridge — expandable segments, PEFT + SP input re-gather, parallelism resizing, activation recompute, CPU
- Price
- Free
- Made by
- nvidia
- Category
- AI Skills
- Website
- github.com/nvidia/skills/nemo-mbridge-perf-memory-tuning