Scaling Kubernetes to 7,500 nodes

We’ve scaled Kubernetes clusters to 7,500 nodes, producing a scalable infrastructure for large models like GPT-3, CLIP, and DALL·E, but also for rapid small-scale iterative research such as Scaling Laws for Neural Language Models. Scaling a single Kubernetes cluster to this size is rarely done and requires some special care, but the upside is a simple infrastructure that allows our machine learnin

[misshiki]

“Kubernetesを7,500ノードにスケーリングする”OpenAI

[Nyoho]

機械学習の計算でたくさんノードを立ち上げる

[ayatk]

面白そう