Update README.md
Browse files
README.md
CHANGED
|
@@ -152,7 +152,7 @@ Below are DeciCoder's pass@1 on MultiPL HumanEval scores
|
|
| 152 |
|
| 153 |
|Inference Tool/Hardware | A10 (tokens/sec) |A100 (tokens/sec) |
|
| 154 |
|:----------|:----------|:----------|
|
| 155 |
-
|
|
| 156 |
| Infery LLM | 3,889.3 | 11,676.8 |
|
| 157 |
|
| 158 |
- Throughput (tokens/sec) - Measured with optimal batch size per hardware - A10 on BS 128, A100 on BS 512
|
|
|
|
| 152 |
|
| 153 |
|Inference Tool/Hardware | A10 (tokens/sec) |A100 (tokens/sec) |
|
| 154 |
|:----------|:----------|:----------|
|
| 155 |
+
| PyTorch | 1,364.2 | 3,244.4 |
|
| 156 |
| Infery LLM | 3,889.3 | 11,676.8 |
|
| 157 |
|
| 158 |
- Throughput (tokens/sec) - Measured with optimal batch size per hardware - A10 on BS 128, A100 on BS 512
|