Versions of the OpenAssist Dataset for chat fine-tuning different models. See https://youtu.be/71x8EMrB0Gc for a full video run through of methods.
Trelis
company
AI & ML interests
Function Calling. Quantizing. Fine-Tuning. Summarizing. Long-context Length.
Organization Card
last updated August 1st 2024
About
Trelis Research provides:
- Advanced LLM fine-tuning scripts.
- Advanced LLM inference guides.
- Advanced vision fine-tuning scripts.
- Advanced voice/transcription fine-tuning scripts.
- One click LLM API templates
- Function-calling models.
ADVANCED Fine-tuning Scripts
- retrieval (bm25, similarity, re-rankers)
- wikipedia fine-tuning and dataset creation
- ReFT fine-tuning
- multi-gpu fine-tuning
- orpo fine-tuning
- memorization fine-tuning
- mamba-fine-tune
- DPO fine-tuning
- chat-fine-tuning
- function-calling fine-tuning
- long-context fine-tuning
- quantization
- supervised-fine-tuning
- unsupervised-fine-tuning
ADVANCED Inference
- Server setup, API setup and inference guide for open source models
- Inference for function calling
- Monte Carlo Inference Methods
- Private Data Redaction
- Structured Data Extraction with LLMs
- Verified RAG citations
ADVANCED Vision Fine-tuning
- Dataset Preparation
- Fine-tuning Llava, IDEFICS2
ADVANCED Transcription and Voice Cloning
- Dataset Generation
- Fine-tuning Whisper speech-to-text on custom datasets
- Voice Cloning Fine-tuning / Text-to-Speech
One-click LLM API/Server Templates
- Check out the full list here
Function-calling Models and Datasets
- Fine-tuned models for function calling - from 1.3B to 70B in size, incl. Mixtral, Yi, Deepseek, Llama and more. Collection here
- Dataset to fine-tune models for function calling. Access here
- Scripts to fine-tune models for function calling and structured responses.
Collections
2
Models fine-tuned for function-calling
-
Trelis/Meta-Llama-3-70B-Instruct-function-calling
Text Generation • Updated • 8 • 20 -
Trelis/Meta-Llama-3-8B-Instruct-function-calling
Text Generation • Updated • 302 • 38 -
Trelis/openchat_3.5-function-calling-v3
Text Generation • Updated • 21 -
Trelis/Llama-2-7b-chat-hf-function-calling-v3
Text Generation • Updated • 290 • 38
models
158
Trelis/99-instruct-v10
Text Generation
•
Updated
•
10
Trelis/99-base-checkpoints-v10
Text Generation
•
Updated
Trelis/99-v10-base
Text Generation
•
Updated
•
11
Trelis/SmolLM-135M-layer-pruned-90M-raw
Text Generation
•
Updated
•
30
Trelis/SmolLM-135M-Instruct-layer-pruned-90M-raw
Text Generation
•
Updated
•
11
Trelis/99-instruct-v9
Text Generation
•
Updated
•
12
Trelis/99-base-checkpoints-v9
Text Generation
•
Updated
•
1
Trelis/99-v9
Text Generation
•
Updated
•
4
Trelis/99-instruct-v9-8046
Text Generation
•
Updated
•
11
Trelis/99-base-v9-8046
Updated
•
8
datasets
45
Trelis/smollm-corpus-2percent
Viewer
•
Updated
•
4.58M
Trelis/cosmopedia-v2-10percent-sample
Viewer
•
Updated
•
3.91M
•
256
Trelis/trelis_voice_text_512
Viewer
•
Updated
•
13
•
2
Trelis/trelis_voice_512
Viewer
•
Updated
•
50
•
2
•
1
Trelis/trelis_voice
Viewer
•
Updated
•
33
•
2
Trelis/touch-rugby-rules-relevance-triplets
Viewer
•
Updated
•
10.8k
•
2
Trelis/touch-rugby-triplets-short
Viewer
•
Updated
•
230
•
2
Trelis/touch-rugby-pairs-chunk-overlap
Viewer
•
Updated
•
235
•
2
Trelis/touch-rugby-pairs-clean-sentences
Viewer
•
Updated
•
200
•
2
Trelis/touch-rugby-rules-pairs
Viewer
•
Updated
•
235
•
3