100M Token Context Windows
100M Token Context WindowsResearch update on ultra-long context models, our partnership with Google Cloud, and new funding. There are currently two ways for AI models to learn things: training, and in-context during inference. Until now, training has dominated, because contexts are relatively short. But ultra-long context could change that. Instead of relying on fuzzy memorization, our LTM (Long-T
