AI Research's Unglamorous Core: Infrastructure, Data, Ablations
A practitioner reflects that much AI work feels familiar: building efficient infrastructure, collecting ever more data, running ablation after ablation to understand models, and endlessly debugging software and hardware.