XLNet: Generalized Autoregressive Pretraining for Language Understanding
At a glance
XLNet learns language context by predicting words in varied orders.
In one paragraph
Introduced XLNet, a language model trained to predict words in varied orders so it can learn context from both sides of a sentence. It improved on BERT across tasks including question answering, sentiment analysis, and document ranking without relying on artificial masked words during training.
