← All works
Research paper

Language Models are Unsupervised Multitask Learners

At a glance

GPT-2 showed how learning to predict text could support tasks without separate training.

In one paragraph

Introduced GPT-2, showing that learning to predict text from webpages could support tasks such as answering questions and summarizing, without separate training for each task.

Authors 6

  1. Alec Radford
  2. Jeffrey Wu
  3. Rewon Child
  4. David Luan
  5. Dario Amodei
  6. Ilya Sutskever