Self-hosted alternatives to nemo-mbridge-perf-expert-parallel-overlap
No self-hosted apps like nemo-mbridge-perf-expert-parallel-overlap yet.
About nemo-mbridge-perf-expert-parallel-overlap
N
nemo-mbridge-perf-expert-parallel-overlap
Validate and use MoE expert-parallel communication overlap in Megatron-Bridge
Validate and use MoE expert-parallel communication overlap in Megatron-Bridge, including overlap_moe_expert_parallel_comm, delay_wgrad_compute, and flex
- Price
- Free
- Made by
- nvidia
- Category
- AI Skills
- Website
- github.com/nvidia/skills/nemo-mbridge-perf-expert-parallel-overlap