google/switch-c-2048 · Hugging Face

Model Card for Switch Transformers C - 2048 experts (1.6T parameters for 3.1 TB) Table of Contents TL;DR Model Details Usage Uses Bias, Risks, and Limitations Training Details Evaluation Environmental Impact Citation Model Card Authors TL;DR Switch Transformers is a Mixture of Experts (MoE) model trained on Masked Language Modeling (MLM) task. The model architecture is similar to the classic T5, b

[misshiki]

“Switch Transformers は、マスク言語モデリング (MLM) タスクでトレーニングされた Mixture of Experts (MoE) モデルです。”

[naari_3]

“switch-c-2048”