|
|
|
--- |
|
|
|
license: cc-by-nc-nd-4.0 |
|
language: |
|
- en |
|
library_name: transformers |
|
pipeline_tag: text-generation |
|
tags: |
|
- llama |
|
- mistral |
|
- llama-2 |
|
- llama |
|
- agi |
|
- probelm solving |
|
- biology |
|
- reasoning |
|
- llama3 |
|
- Dolus |
|
|
|
--- |
|
|
|
 |
|
|
|
# QuantFactory/Dolus-14b-Mini-GGUF |
|
This is quantized version of [Cognitive-Machines-Labs/Dolus-14b-Mini](https://huggingface.co/Cognitive-Machines-Labs/Dolus-14b-Mini) created using llama.cpp |
|
|
|
# Original Model Card |
|
|
|
|
|
<h1 style="font-size: 36px;">Dolus-14b-Mini</h1> |
|
|
|
<center> |
|
<img src="https://cdn.prod.website-files.com/66a60c25748608d6d03809b8/66bc5c429e88c62f64491f57_00009-2074390737-p-500.png" alt="logo" width="18%" style="min-width:20px; display:block;"> |
|
</center> |
|
|
|
**Ursidae-12b-Mini** |
|
The little sister to Ursidae-300b,Dolus 14b Mini has been developed with a focus on complex multi-step chain of thought problem solving while still being deployable on edge systems. A model focused complex multi-step chain of thought problem solving while still being deployable on edge systems. Now better at reasoning! |
|
|
|
|
|
## Main Goals: |
|
|
|
Dolus was designed to address specific issues found in other chat models: |
|
|
|
- Overcome limitations in logical reasoning found in other chat models. |
|
- Efficiently solve complex, multi-step problems. |
|
- Provide better decision-making assistance by enhancing the model's ability to reason and think critically. |
|
- Removing restrictions and allowing the model to gain a true understanding of reality, greatly increasing overall results. |
|
|
|
By focusing on these specific goals, the Ursidae-12b-Mini aims to provide a more sophisticated AI system that excels at critical thinking and problem-solving tasks requiring advanced logical reasoning skills. Its compact design makes it an efficient choice for applications where high cognitive abilities are necessary without occupying excessive computing resources. |
|
|
|
# Recommended Settings: |
|
|
|
**Defaults:** |
|
|
|
``` |
|
min_p: 0.074 |
|
top_k: 40 |
|
repetition_penalty: 1.12 |
|
temp: 1.18 |
|
context: 8192 |
|
``` |
|
|
|
|
|
**Creative:** |
|
|
|
``` |
|
min_p: 0.062 |
|
top_k: 40 |
|
repetition_penalty: 1.11 |
|
temp: 1.24 |
|
context: 8192 |
|
``` |
|
|
|
# Benchmarks: |
|
PENDING FULL EVAL |
|
|
