RoBERTa: A Robustly Optimized BERT Pretraining Approach
At a glance
Showed that better training choices could improve BERT without changing its core architecture.
In one paragraph
Showed that training BERT longer, with more text and better training choices, could improve language understanding without changing its core design, setting new results on question-answering and reading tests.
