{"id":6961,"date":"2021-06-21T17:37:24","date_gmt":"2021-06-21T17:37:24","guid":{"rendered":"http:\/\/invbat.com\/blog2\/?p=6961"},"modified":"2021-06-21T17:37:24","modified_gmt":"2021-06-21T17:37:24","slug":"masked-language-modeling-mlm-is-a-fill-in-the-blank-task-where-a-model-is-taught-to-use-the-words-surround-a-mask-token-to-predict-what-the-masked-word-should-be","status":"publish","type":"post","link":"https:\/\/invbat.com\/blog2\/index.php\/2021\/06\/21\/masked-language-modeling-mlm-is-a-fill-in-the-blank-task-where-a-model-is-taught-to-use-the-words-surround-a-mask-token-to-predict-what-the-masked-word-should-be\/","title":{"rendered":"<a href=\"https:\/\/www.microsoft.com\/en-us\/research\/blog\/microsoft-deberta-surpasses-human-performance-on-the-superglue-benchmark\/\"><font color=\"blue\">  Masked Language Modeling (MLM) is a fill-in-the-blank task, where a model is taught to use the words surround a mask token to predict what the masked word should be. <\/font><\/a>"},"content":{"rendered":"\n<p><a href=\"https:\/\/www.microsoft.com\/en-us\/research\/blog\/microsoft-deberta-surpasses-human-performance-on-the-superglue-benchmark\/\"> \n\nMasked Language Modeling (MLM) is a fill-in-the-blank task, where a model is taught to use the words surround a mask token to predict what the masked word should be.\n\n<br>\n\n<\/a><\/p>\n\n\n\n<figure class=\"wp-block-image\"><a href=\"https:\/\/invbat.com\/ads1.html\"><img loading=\"lazy\" decoding=\"async\" width=\"885\" height=\"305\" src=\"https:\/\/invbat.com\/blog2\/wp-content\/uploads\/2021\/04\/Help2.png\" alt=\"\" class=\"wp-image-5005\" srcset=\"https:\/\/invbat.com\/blog2\/wp-content\/uploads\/2021\/04\/Help2.png 885w, https:\/\/invbat.com\/blog2\/wp-content\/uploads\/2021\/04\/Help2-300x103.png 300w, https:\/\/invbat.com\/blog2\/wp-content\/uploads\/2021\/04\/Help2-768x265.png 768w\" sizes=\"auto, (max-width: 709px) 85vw, (max-width: 909px) 67vw, (max-width: 1362px) 62vw, 840px\" \/><\/a><\/figure><p>advertisement<\/p>\n","protected":false},"excerpt":{"rendered":"<p>Masked Language Modeling (MLM) is a fill-in-the-blank task, where a model is taught to use the words surround a mask token to predict what the masked word should be.<\/p>\n","protected":false},"author":1,"featured_media":0,"comment_status":"closed","ping_status":"closed","sticky":false,"template":"","format":"standard","meta":{"footnotes":""},"categories":[394],"tags":[],"class_list":["post-6961","post","type-post","status-publish","format-standard","hentry","category-masked-language-modeling-mlm"],"_links":{"self":[{"href":"https:\/\/invbat.com\/blog2\/index.php\/wp-json\/wp\/v2\/posts\/6961","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/invbat.com\/blog2\/index.php\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/invbat.com\/blog2\/index.php\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/invbat.com\/blog2\/index.php\/wp-json\/wp\/v2\/users\/1"}],"replies":[{"embeddable":true,"href":"https:\/\/invbat.com\/blog2\/index.php\/wp-json\/wp\/v2\/comments?post=6961"}],"version-history":[{"count":1,"href":"https:\/\/invbat.com\/blog2\/index.php\/wp-json\/wp\/v2\/posts\/6961\/revisions"}],"predecessor-version":[{"id":6962,"href":"https:\/\/invbat.com\/blog2\/index.php\/wp-json\/wp\/v2\/posts\/6961\/revisions\/6962"}],"wp:attachment":[{"href":"https:\/\/invbat.com\/blog2\/index.php\/wp-json\/wp\/v2\/media?parent=6961"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/invbat.com\/blog2\/index.php\/wp-json\/wp\/v2\/categories?post=6961"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/invbat.com\/blog2\/index.php\/wp-json\/wp\/v2\/tags?post=6961"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}