Researchers at Answer.AI and LightOn have released 'Modern BERT,' which incorporates many elements from recent research into large-scale language models and updates its architecture and training ...