Streaming - Docs by LangChain

LangGraph implements a streaming system to surface real-time updates. Streaming is crucial for enhancing the responsiveness of applications built on LLMs. By displaying output progressively, even before a complete response is ready, streaming significantly improves user experience (UX), particularly when dealing with the latency of LLMs.

[misshiki]

LangGraph JSはstreamMode:"tools"でツール実行中の開始・進捗・終了・エラーをリアルタイム取得可能。async generatorのyieldがon_tool_eventとして配信され、進捗UI実装に使える。