Modal Shares AI-SQL Speedups Over 10x Faster Than vLLM
A new Modal blog post by Charles and Shreya covers their work speeding up AI-SQL queries — why AI-SQL, why high-throughput inference, how they beat vLLM by over 10x, and the future of inference engineering.