Hugging Face reposted Sergio Paniego @SergioPaniego · 6h Article MOPD: how frontier labs merg...
Hugging Face reposted Sergio Paniego @SergioPaniego · 6h Article MOPD: how frontier labs merge RL experts into one model and how to do it using TRL TRL now supports MOPD. AsyncDistillationTrainer routes each prompt to its own expert teacher, and support for th