Textbooks Are All You Need

テクノロジーカテゴリーの変更を依頼記事元:

arxiv.org

10 usersがブックマークコメント

記事へのコメント1件

注目コメント
新着コメント

roogh5eeSha6 “We introduce phi-1, a new large language model for code, with significantly smaller size than competing models: phi-1 is a Transformer-based model with 1.3B parameters, trained for 4 days on 8 A100s, using a selection of ``textbook quality" data from the web (6B tokens) and synthetically generate

2023/06/26 リンク

注目コメント算出アルゴリズムの一部にLINEヤフー株式会社の「建設的コメント順位付けモデルAPI」を使用しています

規約違反を報告

いまの話題をアプリでチェック！

バナー広告なし
ミュート機能あり
ダークモード搭載

アプリをダウンロード

Textbooks Are All You Need

We introduce phi-1, a new large language model for code, with significantly smaller size than com... We introduce phi-1, a new large language model for code, with significantly smaller size than competing models: phi-1 is a Transf ormer-based model with 1.3B parameters, trained for 4 days on 8 A100s, using a selection of ``textbook quality" data from the web (6B tokens) and synthetically generated textbooks and exercises with GPT-3.5 (1B tokens). Despite this small scale, phi-1 attains pass@1 accu