Update README.md

README.md

@@ -22,7 +22,7 @@ This model is trained using PPO.
 We used a 70B RM trained on our preference data mix, and then used the UltraFeedback prompts during PPO training.
 
 For more details, read the paper:
-[Unpacking DPO and PPO: Disentangling Best Practices for Learning from Preference Feedback](https://link.todo).
+[Unpacking DPO and PPO: Disentangling Best Practices for Learning from Preference Feedback](https://arxiv.org/abs/2406.09279).
 
 
 ## .Model description
@@ -83,6 +83,7 @@ If you find Tulu 2.5 is useful in your work, please cite it with:
       title={{Unpacking DPO and PPO: Disentangling Best Practices for Learning from Preference Feedback}}, 
       author={{Hamish Ivison and Yizhong Wang and Jiacheng Liu and Ellen Wu and Valentina Pyatkin and Nathan Lambert and Yejin Choi and Noah A. Smith and Hannaneh Hajishirzi}}
       year={2024},
+      eprint={2406.09279},
       archivePrefix={arXiv},
       primaryClass={cs.CL}
 }