University of Cambridge
Vladimir VapnikEmeritus Professor of Computer Science · Royal Holloway, University of LondonResearcher↗
Researcher · Academic
Chris Watkins
Royal Holloway, University of LondonProfessor of Machine Learning
Watkins invented Q-learning, which lets an agent learn through trial and error which actions will produce the best long-term reward without first modeling its environment.[1] Introduced in his 1989 Cambridge PhD and formalized with Peter Dayan, it became a foundation of modern reinforcement learning.
Career & education
Current roleRoyal Holloway, University of LondonSep 1997-presentProfessor of Machine Learning
Royal Holloway, University of LondonSep 1997-presentPreviously
AT&T1995-1996Member of Technical Staff
AT&T1995-1996Education
Work and education history is primarily focused on AI-relevant roles and may not be comprehensive.
Citation Trend
Total citations to scholarly work, including research papers, technical reports, books and theses, as recorded by Google Scholar. Each point is a dated snapshot.
citations47,929As of Nov 3, '26
Selected contributions
Q-learning
With Peter DayanA foundational method for learning which actions lead to the best long-term rewards.
References
- Q-learning — Watkins and Dayan (1992)gatsby.ucl.ac.uk
Original paper attributes Q-learning to Watkins (1989) and explains learning long-term rewards from action consequences without an environment model; jointly formalizes convergence with Peter Dayan.
Based on public sources. If accuracy is important, verify details using the links or references.
For corrections, updates, or requests to remove information, contact us.
Reviewed August 14, 2026 · Checked for accuracy and new information.