Comment
#1
by
DRXD1000
- opened
Love it !
I just added the mt-bench-de score, just below 7.
it seems like the combination of multiple german models plus german dpo-tuning with a mistral based rejected output improves the quality of the merge a lot.