Skip to content
Home /

Mark Thompson

Postdoctoral Fellow in astrophysics at MIT, focusing on sustainable technology solutions.

BERT Model Shift (2018)

    Jacob Devlin introduces BERT, a deeply bidirectional Transformer model pre-trained on unlabeled text using masked language modeling. This standardizes the transfer learning pipeline across natural language processing domains. Part of the 29 Structural Foundations: The… Read More »BERT Model Shift (2018)