Low Code Large Language Model Alignment
•
12
ben burtenshaw
burtenshaw
AI & ML interests
None yet
Articles
Organizations
Posts
1
Post
1417
SFT + Quantisation + Unsloth is a super easy way of squeezing extra performance out of an LLM at low latencies. Here are some hand y resources to bootstrap your projects.
Here's a filtered dataset from Helpsteer2 with the most correct and coherent samples: burtenshaw/helpsteer-2-plus
This is a SFT finetuned model: ttps://huggingface.co/burtenshaw/gemma-help-tiny-sft
This is the notebook I use to train the model: https://colab.research.google.com/drive/17oskw_5lil5C3jCW34rA-EXjXnGgRRZw?usp=sharing
Here's a load of Unsloth notebook on finetuning and inference: https://docs.unsloth.ai/get-started/unsloth-notebooks
Here's a filtered dataset from Helpsteer2 with the most correct and coherent samples: burtenshaw/helpsteer-2-plus
This is a SFT finetuned model: ttps://huggingface.co/burtenshaw/gemma-help-tiny-sft
This is the notebook I use to train the model: https://colab.research.google.com/drive/17oskw_5lil5C3jCW34rA-EXjXnGgRRZw?usp=sharing
Here's a load of Unsloth notebook on finetuning and inference: https://docs.unsloth.ai/get-started/unsloth-notebooks
Collections
3
A collection of models that are open source equivalents of flux-schnell and flux-dev
A work in progress collection of resources related to a project to finetune Gemma 2 2b for helpfulness with Helpsteer2.
-
nvidia/HelpSteer2
Viewer • Updated • 21.4k • 13.6k • 372 -
google/gemma-2-2b
Text Generation • Updated • 7.3M • 430 -
HelpSteer2: Open-source dataset for training top-performing reward models
Paper • 2406.08673 • Published • 16 -
HelpSteer: Multi-attribute Helpfulness Dataset for SteerLM
Paper • 2311.09528 • Published • 2
Papers
1
spaces
24
models
10
burtenshaw/code-llama-3-2-1b-commerce
Text Generation
•
Updated
burtenshaw/code-smol2-text-to-sql
Updated
•
4
burtenshaw/Qwen2.5-3B-Instruct-GGUF
Updated
•
5
burtenshaw/gemma-help-tiny-sft
Text Generation
•
Updated
•
17
•
1
burtenshaw/Qwen1.5-0.5B-dpo-mix-7k
Text Generation
•
Updated
•
5
burtenshaw/notus-merged-with-code-mistral-so-its-better-at-coding
Updated
•
3
burtenshaw/Qwen1.5-0.5B-dpo-mix-7k-GGUF
Updated
burtenshaw/Qwen1.5-0.5B-dpo-mix-7k-5000
Text Generation
•
Updated
•
14
burtenshaw/Qwen1.5-0.5B-dpo-mix-7k-3000
Text Generation
•
Updated
•
13
burtenshaw/setfit_food_annotated
Text Classification
•
Updated
•
7
datasets
20
burtenshaw/dataset-diff-test-changed
Viewer
•
Updated
•
3
•
28
burtenshaw/dataset-diff-test
Viewer
•
Updated
•
3
•
25
burtenshaw/most_used_models
Viewer
•
Updated
•
250
•
43
•
1
burtenshaw/exam_questions
Viewer
•
Updated
•
7
•
34
burtenshaw/pc-components-reviews-vectors
Viewer
•
Updated
•
200
•
44
burtenshaw/fosllms-week-1-demo
Viewer
•
Updated
•
12
•
33
burtenshaw/yahoo_answers_topics
Viewer
•
Updated
•
100
•
41
burtenshaw/image-search-queries
Viewer
•
Updated
•
199
•
38
burtenshaw/document-similarity
Viewer
•
Updated
•
20
•
35
burtenshaw/helpsteer-2-plus
Viewer
•
Updated
•
8.88k
•
44
•
2