File size: 2,065 Bytes
85c0a1b 1f8fd7c 56014d8 85c0a1b 83d309a 85c0a1b 83d309a 394f355 83d309a 394f355 83d309a 394f355 83d309a 394f355 83d309a 394f355 83d309a 394f355 83d309a 394f355 83d309a 394f355 83d309a 394f355 83d309a 394f355 83d309a 85c0a1b 1f8fd7c |
1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20 21 22 23 24 25 26 27 28 29 30 31 32 33 34 35 36 37 38 39 40 41 42 43 44 45 46 47 48 49 50 51 52 53 54 55 56 57 58 59 60 61 62 63 64 |
---
license: mit
tags:
- generated_from_trainer
- rag
- ner
- parse
- summary
base_model: Josephgflowers/TinyLlama-Cinder-Tiny-Agent
model-index:
- name: TinyLlama-Cinder-Agent-v1
results: []
---
The goal of this Model is to build a Tinyllama model that can be used for tool usage, RAG, take system instructions, and as a general assistant.
This model is a fine-tuned version of [Josephgflowers/TinyLlama-Cinder-Tiny-Agent](https://huggingface.co/Josephgflowers/TinyLlama-Cinder-Tiny-Agent).
Special Thanks to https://nationtech.io/ for their generous sponorship in training this model.
This model is a fine-tuned version of [Josephgflowers/TinyLlama-3T-Cinder-v1.2](https://huggingface.co/Josephgflowers/TinyLlama-3T-Cinder-v1.2) on https://huggingface.co/datasets/Josephgflowers/agent_1.
## Model description
This models is trained for RAG, Summary, Function Calling and Tool usage. Trained off of Cinder. Cinder is a chatbot designed for chat about STEM topics and storytelling. More information coming.
This model usses:
<|system|>
<|user|>
<|assistant|>
<|function_list|>
<|function_call|>
<|function_response|>
<|data|>
<|summary|>
<|tag|>
See https://huggingface.co/Josephgflowers/TinyLlama-Cinder-Agent-Rag/blob/main/tinyllama_agent_cinder_txtai-rag.py
For usage example with wiki rag.
# [Open LLM Leaderboard Evaluation Results](https://huggingface.co/spaces/HuggingFaceH4/open_llm_leaderboard)
Detailed results can be found [here](https://huggingface.co/datasets/open-llm-leaderboard/details_Josephgflowers__TinyLlama-Cinder-Agent-v1)
| Metric |Value|
|---------------------------------|----:|
|Avg. |39.17|
|AI2 Reasoning Challenge (25-Shot)|34.90|
|HellaSwag (10-Shot) |53.87|
|MMLU (5-Shot) |26.89|
|TruthfulQA (0-shot) |39.08|
|Winogrande (5-shot) |59.12|
|GSM8k (5-shot) |21.15| |