WPO
Collection
Models and datasets in paper "WPO: Enhancing RLHF with Weighted Preference Optimization".
•
11 items
•
Updated
•
4
Description
mistral-7b-sft-beta model finetuned by off-policy WPO. Details in WPO: Enhancing RLHF with Weighted Preference Optimization.
License
This model is licensed under the Zoom software license and is permitted for use only for noncommercial, educational, or academic research purposes.
- Downloads last month
- 11
This model does not have enough activity to be deployed to Inference API (serverless) yet. Increase its social
visibility and check back later, or deploy to Inference Endpoints (dedicated)
instead.