GPT in 60 Lines of NumPy | Jay Mody

January 30, 2023 In this post, we'll implement a GPT from scratch in just 60 lines of numpy. We'll then load the trained GPT-2 model weights released by OpenAI into our implementation and generate some text. Note: This post assumes familiarity with Python, NumPy, and some basic experience training neural networks. This implementation is missing tons of features on purpose to keep it as simple as p

[misshiki]

“たった60行のnumpyでGPTをゼロから実装します。そして、OpenAIが公開している学習済みのGPT-2モデルの重みを実装にロードし、テキストを生成してみます。”

[cartman0]

numpyでgpt2?

[htsnul]

https://news.ycombinator.com/item?id=34726115

[ang65]

deeplearing