In the era of base LLM scaling (2022-2024), I believed the LLM line of research would reach a...
In the era of base LLM scaling (2022-2024), I believed the LLM line of research would reach a capability plateau (as later seen with base LLMs). In late 2024, after the o3 test-time compute demo, I changed my views: the