はてなブックマーク - Do Language Models Need Sleep? Offline Recurrence for Improved Online Inference

はてなブックマーク - Do Language Models Need Sleep? Offline Recurrence for Improved Online Inference https://b.hatena.ne.jp/entry/s/arxiv.org/abs/2605.26099 Transformer-based large language models are increasingly used for long-horizon tasks; however, their attention mechanism scales poorly with context length. To handle this, we study a sleep-like con... comb_8107 https://b.hatena.ne.jp/comb_8107/20260603#bookmark-4787964223905550242 2026-06-02T23:44:38Z あとで読む tasukuchan https://b.hatena.ne.jp/tasukuchan/20260528#bookmark-4787964223905550242 2026-05-28T06:35:44Z