“The GPT family of models process text using tokens, which are common sequences of characters found in text. The models understand the statistical relationships between these tokens, and excel at producing the next token in a sequence of tokens.”

YassLab のブックマーク 2023/03/18 19:37

<blockquote class="hatena-bookmark-comment"><a class="comment-info" href="https://b.hatena.ne.jp/entry/4733839961784364612/comment/YassLab" data-user-id="YassLab" data-entry-url="https://b.hatena.ne.jp/entry/s/platform.openai.com/tokenizer" data-original-href="https://platform.openai.com/tokenizer" data-entry-favicon="https://cdn-ak2.favicon.st-hatena.com/64?url=https%3A%2F%2Fplatform.openai.com%2Ftokenizer" data-user-icon="/users/YassLab/profile.png">OpenAI API</a><ul class="comment-tag" style="list-style: none; margin: 0px;"><li style="float: left">[<a href="https://b.hatena.ne.jp/q/%E6%96%99%E9%87%91%E8%A8%88%E7%AE%97">料金計算</a>]</li><li style="float: left">[<a href="https://b.hatena.ne.jp/q/ChatGPT">ChatGPT</a>]</li><li style="float: left">[<a href="https://b.hatena.ne.jp/q/OpenAI">OpenAI</a>]</li></ul><br><p style="clear: left">“The GPT family of models process text using tokens, which are common sequences of characters found in text. The models understand the statistical relationships between these tokens, and excel at producing the next token in a sequence of tokens.”</p><a class="datetime" href="https://b.hatena.ne.jp/YassLab/20230318#bookmark-4733839961784364612"><span class="datetime-body">2023/03/18 19:37</span></a></blockquote><script src="https://b.st-hatena.com/js/comment-widget.js" charset="utf-8" async></script>

このブックマークにはスターがありません。
最初のスターをつけてみよう！