Language Models are Unsupervised Multitask Learners
At a glance
GPT-2 showed how learning to predict text could support tasks without separate training.
In one paragraph
Introduced GPT-2, showing that learning to predict text from webpages could support tasks such as answering questions and summarizing, without separate training for each task.