A Commit History of BERT and its Forks

I recently came across an interesting thread on Twitter discussing a hypothetical scenario where research papers are published on GitHub and subsequent papers are diffs over the original paper. Information overload has been a real problem in ML with so many new papers coming every month. If you could represent a paper as a code diff, many papers could be compressed down to <50 lines :) The diff wo

[misshiki]

“この投稿は、BERT論文とそれに続くいくつかの亜種のコミット履歴がどのように見えるかを示す楽しい実験です。”