RIP BERT: Google’s MUM is coming

On 20th May 2021 Google held its developer conference I/O and announced a new algorithm for their search engine: MUM, a Multitask Unified Model [1]. For the last two years, BERT was the underlying model for their search engine. BERT was a breathtaking release and was state-of-the-art until now, until MUM came. The algorithm BERT changed a lot in the field of NLP and was applied in thousands or eve