Hugging Face reposted Sergio Paniego @SergioPaniego · 6h Article MOPD: how frontier labs merg...
Hugging Face reposted Sergio Paniego @SergioPaniego · 6h Article MOPD: how frontier labs merge RL experts into one model and how to do it using TRL TRL now supports MOPD. AsyncDistillationTrainer routes each prompt to it