“The Switch Transformer uses a mixture-of-experts (MoE) paradigm to combine several Transformer attention blocks.”

hnishi2509 のブックマーク 2021/03/16 19:14

<blockquote class="hatena-bookmark-comment"><a class="comment-info" href="https://b.hatena.ne.jp/entry/4698678020171360610/comment/hnishi2509" data-user-id="hnishi2509" data-entry-url="https://b.hatena.ne.jp/entry/s/www.infoq.com/news/2021/02/google-trillion-parameter-ai/" data-original-href="https://www.infoq.com/news/2021/02/google-trillion-parameter-ai/" data-entry-favicon="https://cdn-ak2.favicon.st-hatena.com/64?url=https%3A%2F%2Fwww.infoq.com%2Fnews%2F2021%2F02%2Fgoogle-trillion-parameter-ai%2F" data-user-icon="/users/hnishi2509/profile.png">Google Open-Sources Trillion-Parameter AI Language Model Switch Transformer</a><br><p style="clear: left">“The Switch Transformer uses a mixture-of-experts (MoE) paradigm to combine several Transformer attention blocks.”</p><a class="datetime" href="https://b.hatena.ne.jp/hnishi2509/20210316#bookmark-4698678020171360610"><span class="datetime-body">2021/03/16 19:14</span></a></blockquote><script src="https://b.st-hatena.com/js/comment-widget.js" charset="utf-8" async></script>

このブックマークにはスターがありません。
最初のスターをつけてみよう！

Google Open-Sources Trillion-Parameter AI Language Model Switch Transformer

www.infoq.com2021/02/18

InfoQ Software Architects' Newsletter A monthly overview of things you need to know as an architect or aspiring architect. View an example

2 人がブックマーク・1 件のコメント

他のコメントを読む

＼コメントがサクサク読めるアプリです／

はてなブックマーク

Google Open-Sources Trillion-Parameter AI Language Model Switch Transformer

はてなブックマーク

公式Twitter

はてなのサービス