Steerable Multi-Objective Group-Relative Preference Optimization with Jointly Trained Low-Rank Adapters
Language model deployment often requires different trade-offs between competing objectives as user preferences change, yet standard post-training methods typically produce a single policy for a fixed
- Upvotes7