Anthropic engineer: "Don’t trust your agent to never fail.
Anthropic engineer: "Don’t trust your agent to never fail. Make the first mistake recoverable and make 95% of the potential damage unreachable. We learned this after an agent confidently did the wrong thing ~200 times in 90 seconds." In this talk, he reveals h