Kristina ToutanovaResearch Scientist · Google DeepMindResearcher↗
Researcher
Google DeepMindResearch Scientist
Lee co-created BERT, helping language models understand words in context.[1] He developed neural systems that track when different names or pronouns refer to the same person or thing[2], and co-created REALM, which retrieves documents to help answer questions rather than relying only on memorized information.[3]
Google DeepMind2023-present
Google2017-2023Work and education history is primarily focused on AI-relevant roles and may not be comprehensive.
BERT learns word meaning from the text on both sides.
BERT: Pre-training of Deep Bidirectional Transformers supports the anchored contribution. Named-contribution check: personal publications and original BERT, coreference and REALM papers read. Preserves all three contributions, names REALM and explains BERT impact. Semantic parsing, entity linking and data augmentation also considered; omitted for focused bio. Personal publication list is historical; not used to infer a new current role. No supplied CV.
End-to-end Neural Coreference Resolution supports the anchored contribution. Named-contribution check: personal publications and original BERT, coreference and REALM papers read. Preserves all three contributions, names REALM and explains BERT impact. Semantic parsing, entity linking and data augmentation also considered; omitted for focused bio. Personal publication list is historical; not used to infer a new current role. No supplied CV.
REALM: Retrieval-Augmented Language Model Pre-Training supports the anchored contribution. Named-contribution check: personal publications and original BERT, coreference and REALM papers read. Preserves all three contributions, names REALM and explains BERT impact. Semantic parsing, entity linking and data augmentation also considered; omitted for focused bio. Personal publication list is historical; not used to infer a new current role. No supplied CV.
Based on public sources. If accuracy is important, verify details using the links or references.
For corrections, updates, or requests to remove information, contact us.
Reviewed August 7, 2026 · Checked for accuracy and new information.