Meta
SpaceXAI
Evan ShelhamerFaculty Member · Vector InstituteResearcher↗
Researcher · Academic
Jimmy Ba
University of TorontoAssociate Professor
Vector InstituteFaculty Member
CIFARCanada CIFAR AI Chair
Career & education
Current roles
Education
Work and education history is primarily focused on AI-relevant roles and may not be comprehensive.
Citation Trend
Total citations to scholarly work, including research papers, technical reports, books and theses, as recorded by Google Scholar. Each point is a dated snapshot.
citations345,331As of Nov 1, '26
citations+5,452Since last snapshot, Oct 1, '26
Selected contributions
Adam: A Method for Stochastic Optimization
With Durk KingmaAdam automatically adjusts learning rates to guide neural-network training.
Layer Normalization
With Jamie Kiros and Geoffrey HintonLayer normalization stabilizes training by rescaling signals within each example.
References
- Adam: A Method for Stochastic Optimizationarxiv.org
Kingma and Ba introduce Adam, which adapts the size of updates to individual model parameters during training.
- Attention Is All You Need — Transformer architecture and trainingarxiv.org
The original Transformer uses layer normalization in its encoder and decoder (section 3.1) and Adam for training (section 5.3), citing Ba as co-author of both methods.
Based on public sources. If accuracy is important, verify details using the links or references.
For corrections, updates, or requests to remove information, contact us.
Reviewed August 7, 2026 · Checked for accuracy and new information.
