Releasing 3B and 7B RedPajama-INCITE family of models including base, instruction-tuned & chat models The RedPajama project aims to create a set of leading open-source models and to rigorously understand the ingredients that yield good performance. A few weeks ago we released the RedPajama base dataset based on the LLaMA paper, which has galvanized the open-source community. The 5 terabyte datase
![Releasing 3B and 7B RedPajama-INCITE family of models including base, instruction-tuned & chat models](https://cdn-ak-scissors.b.st-hatena.com/image/square/57fc9a890f2baa628ce470c839edbc87883d965a/height=288;version=1;width=512/https%3A%2F%2Fassets-global.website-files.com%2F650c3b59079d92475f37b68f%2F653ba10b7171971dce21202b_6530043dd7f3572190e0a550_RedPajama-landscape.png)