Long-context models struggle to find corpus contradictions
sewon__min says long-context LMs do well on RULER-like tasks but suffer at finding every contradiction as corpora scale, even with in-domain fine-tuning.
evaluation
All AI Pulse updates tagged "evaluation".
2 signalsBest approach for generating synthetic data
Hamel Husain advises defining the request types to test, generating combinations of details, converting them into queries, and running them through your application.