The Illustrated GPT-2 (Visualizing Transformer Language Models)Jay Alammar Visualizing machine learning one concept at a time. @JayAlammar on Twitter. YouTube Channel This year, we saw a dazzling application of machine learning. The OpenAI GPT-2 exhibited impressive ability of writing coherent and passionate essays that exceed what we anticipated current language models are able to produce. The GPT-2 wasn’t a particularly novel architecture – it’s architectur
