はてなブックマーク

Accompanying blog post: GPT in 60 Lines of Numpy You've seen openai/gpt-2. You've seen karpathy/minGPT. You've even seen karpathy/nanoGPT! But have you seen picoGPT??!? picoGPT is an unnecessarily tiny and minimal implementation of GPT-2 in plain NumPy. The entire forward pass code is 40 lines of code. picoGPT features: Fast? ❌ Nah, picoGPT is megaSLOW 🐌 Training code? ❌ Error, 4️⃣0️⃣4️⃣ not foun