Back to AI Pulse

LangSmith tracks cache hit rates for agents

LangSmith now reports cached LLM call hit rates for agents, including an overall stat, per-thread breakdowns, and time-series charts, helping teams see where cached calls cut cost and latency.

LangSmith now tracks cache hit rates for your agents 🦜 Cached LLM calls are cheaper and faster, so it's worth knowing how often your agent actually gets a hit. 📊 View your agent's overall hit rate as a single stat 🧵 Break it down thread by thread 📈 Chart it over time with

Source
Ad SlotAI Pulse Sponsor
LangSmith tracks cache hit rates for agents | AI Pulse