LangSmith tracks cache hit rates for agents
LangSmith now reports cached LLM call hit rates for agents, including an overall stat, per-thread breakdowns, and time-series charts, helping teams see where cached calls cut cost and latency.
All AI Pulse updates tagged "LLM caching".
1 signalsLangSmith now reports cached LLM call hit rates for agents, including an overall stat, per-thread breakdowns, and time-series charts, helping teams see where cached calls cut cost and latency.