Bidirectional Encoder Representations

A language model architecture that considers both left and right context simultaneously.