dyyyyyyyy commited on
Commit
a17fa8a
β€’
1 Parent(s): 6c4ff1e

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +60 -3
README.md CHANGED
@@ -1,3 +1,60 @@
1
- ---
2
- license: apache-2.0
3
- ---
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ ---
2
+ license: apache-2.0
3
+ datasets:
4
+ - dyyyyyyyy/ScaleQuest-Math
5
+ language:
6
+ - en
7
+ metrics:
8
+ - accuracy
9
+ library_name: transformers
10
+ pipeline_tag: text-generation
11
+ ---
12
+
13
+ <p align="center"><h2 align="center">Unleashing Reasoning Capability of LLMs via Scalable Question Synthesis from Scratch</h2></p>
14
+
15
+ # Model Card for Qwen2-Math-7B-ScaleQuest
16
+
17
+ <!-- Provide a quick summary of what the model is/does. -->
18
+
19
+ We introduce ScaleQuest, a scalable and novel data synthesis method that utilizes small-size open-source models to generate questions from scratch without the need for seed data with complex augmentation constraints.
20
+
21
+ * πŸ“‘ Project Page: [https://scalequest.github.io](https://scalequest.github.io/)
22
+ * πŸ’» Code: [https://github.com/yyDing1/ScaleQuest](https://github.com/yyDing1/ScaleQuest/)
23
+ * πŸ“– Paper: [Unleashing Reasoning Capability of LLMs via Scalable Question Synthesis from Scratch](https://arxiv.org/abs/2410.18693)
24
+ * πŸ’Ύ Models in the πŸ€— HuggingFace Hub: [ScaleQuest-Models](https://huggingface.co/collections/dyyyyyyyy/scalequest-670a7dc2623c91990f28913b)
25
+
26
+ <p align="center">
27
+ <img src="https://github.com/yyDing1/ScaleQuest/raw/main/img/results.png">
28
+ </p>
29
+
30
+ ## Datasets & Models
31
+
32
+ Math Dataset: [link](https://huggingface.co/datasets/dyyyyyyyy/ScaleQuest-Math)
33
+
34
+ We release two question generator models and four problem-solving models.
35
+
36
+ | Model | Type | MATH | Olympiad Bench | πŸ€— HuggingFace<br />Download Link |
37
+ | - | :-: | :-: | :-: | :-: |
38
+ | ScaleQuest-DeepSeekMath-7B-QGen | question generator | - | - | [link](https://huggingface.co/dyyyyyyyy/ScaleQuest-DeepSeekMath-7B-QGen)
39
+ | ScaleQuest-Qwen2-Math-7B-QGen | question generator | - | - | [link](https://huggingface.co/dyyyyyyyy/ScaleQuest-Qwen2-Math-7B-QGen)
40
+ | Mistral-7B-ScaleQuest | problem solver | 62.9 | 26.8 | [link](https://huggingface.co/dyyyyyyyy/Mistral-7B-ScaleQuest) |
41
+ | Llama3-8B-ScaleQuest | problem solver | 64.4 | 25.3 | [link](https://huggingface.co/dyyyyyyyy/Llama3-8B-ScaleQuest) |
42
+ | DeepSeekMath-7B-ScaleQuest | problem solver | 66.6 | 29.9 | [link](https://huggingface.co/dyyyyyyyy/DeepSeekMath-7B-ScaleQuest) |
43
+ | Qwen2-Math-7B-ScaleQuest | problem solver | 73.4 | 38.5 | [link](https://huggingface.co/dyyyyyyyy/Qwen2-Math-7B-ScaleQuest) |
44
+
45
+ ## Demo usage
46
+
47
+ Below is an example using `Qwen2-Math-7B-ScaleQuest`
48
+ ```python
49
+ ```
50
+
51
+ ## Citation
52
+
53
+ ```bibtex
54
+ @article{ding2024unleashing,
55
+ title={Unleashing Reasoning Capability of LLMs via Scalable Question Synthesis from Scratch},
56
+ author={Ding, Yuyang and Shi, Xinyu and Liang, Xiaobo and Li, Juntao and Zhu, Qiaoming and Zhang, Min},
57
+ journal={https://arxiv.org/abs/2410.18693},
58
+ year={2024}
59
+ }
60
+ ```