Zihang Dai

Current role not listed

Dai co-created Transformer-XL, which gave Transformers a memory extending beyond one fixed block of text, and XLNet, an influential alternative to BERT-style pretraining. The work helped language models use longer context and showed new ways to learn from unlabelled text. He later joined xAI.