BERT: Pre-training of Deep Bidirectional Transformers for Language Understanding
At a glance
BERT learns word meaning from the text on both sides.
In one paragraph
BERT learns from the words on both sides of a gap in a sentence, building a richer sense of context. The same pretrained model can then be adapted to tasks such as answering questions or comparing sentences. It improved results across eleven language-understanding tests.
