Mohammad Shoeybi

Shoeybi led Megatron-LM, which showed how to split enormous Transformer models across many GPUs and train them efficiently. Its parallel-training techniques became foundational infrastructure for scaling large language models at NVIDIA and across the wider AI ecosystem.