Replay, Don't Resample: Off-Policy Consolidation of Long-Horizon RL Experts
Frontier post-training follows a common recipe: train one expert per domain with reinforcement learning (RL), then consolidate the experts into one model via multi-teacher on-policy distillation (MOPD
- Upvotes4