Masked Language Modeling (MLM) is a fill-in-the-blank task, where a model is taught to use the words surround a mask token to predict what the masked word should be.

Masked Language Modeling (MLM) is a fill-in-the-blank task, where a model is taught to use the words surround a mask token to predict what the masked word should be.

advertisement