acon96 commited on
Commit
3bcf730
1 Parent(s): ee1de8c

Upload model

Browse files
.gitattributes CHANGED
@@ -33,3 +33,9 @@ saved_model/**/* filter=lfs diff=lfs merge=lfs -text
33
  *.zip filter=lfs diff=lfs merge=lfs -text
34
  *.zst filter=lfs diff=lfs merge=lfs -text
35
  *tfevents* filter=lfs diff=lfs merge=lfs -text
 
 
 
 
 
 
 
33
  *.zip filter=lfs diff=lfs merge=lfs -text
34
  *.zst filter=lfs diff=lfs merge=lfs -text
35
  *tfevents* filter=lfs diff=lfs merge=lfs -text
36
+ Home-1B-v3.f16.gguf filter=lfs diff=lfs merge=lfs -text
37
+ Home-1B-v3.q2_k.gguf filter=lfs diff=lfs merge=lfs -text
38
+ Home-1B-v3.q3_k_m.gguf filter=lfs diff=lfs merge=lfs -text
39
+ Home-1B-v3.q4_k_m.gguf filter=lfs diff=lfs merge=lfs -text
40
+ Home-1B-v3.q5_k_m.gguf filter=lfs diff=lfs merge=lfs -text
41
+ Home-1B-v3.q8_0.gguf filter=lfs diff=lfs merge=lfs -text
Home-1B-v3.f16.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:7809ffa261ebf86935fdb7624b5447687dbb072ff79deec2684534ff71364d8f
3
+ size 2201017344
Home-1B-v3.q2_k.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:abb777896205b01ac0dfaaef0c7960765fed633c5bdba7c14dbc1c8c36fa7d44
3
+ size 432131104
Home-1B-v3.q3_k_m.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:bcae7ed653b9b023c3d38b38ae04e01d77a2d48922c06fbee26d7d82edcbb194
3
+ size 548404256
Home-1B-v3.q4_k_m.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:b9dbd47c978d43f0876a619035886546ebf808a816b701b2b40c0c72786a00d7
3
+ size 667814944
Home-1B-v3.q5_k_m.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:eb8bbbf40a7ad5ccb4be7a47b3642657b2e2a0c5130615ac4330342944f4aa24
3
+ size 782044192
Home-1B-v3.q8_0.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:9ba60a57ed1a9f543acd1ad6bea7ae4cdfa7e5e44b22d0a7a8b4a84dc0f10ed5
3
+ size 1169808416
README.md ADDED
@@ -0,0 +1,53 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ ---
2
+ datasets:
3
+ - acon96/Home-Assistant-Requests
4
+ license: apache-2.0
5
+ language:
6
+ - en
7
+ tags:
8
+ - automation
9
+ - home
10
+ - assistant
11
+ pipeline_tag: text-generation
12
+ ---
13
+ # Home 1B v3
14
+ The "Home" model is a fine tuning of the [TinyLlama-1.1B-Chat-v1.0](https://huggingface.co/TinyLlama/TinyLlama-1.1B-Chat-v1.0) model. The model is able to control devices in the user's house via a Home Assistant integragion. The fine tuning dataset a [custom curated dataset](https://github.com/acon96/home-llm) designed to teach the model function calling.
15
+
16
+ The model is quantized using Lama.cpp in order to enable running the model in super low resource environments that are common with Home Assistant installations such as Rapsberry Pis.
17
+
18
+ The model can be used as an "instruct" type model using the Zephyr prompt format. The system prompt is used to provide information about the state of the Home Assistant installation including available devices and callable services.
19
+
20
+ Example "system" prompt:
21
+ ```
22
+ You are 'Al', a helpful AI Assistant that controls the devices in a house. Complete the following task as instructed or answer the following question with the information provided only.
23
+ The current time and date is 08:12 AM on Thursday March 14, 2024
24
+ Services: light.turn_off(), light.turn_on(rgb_color,brightness), fan.turn_on(), fan.turn_off()
25
+ Devices:
26
+ light.office 'Office Light' = on;80%
27
+ fan.office 'Office fan' = off
28
+ light.kitchen 'Kitchen Light' = on;80%;red
29
+ light.bedroom 'Bedroom Light' = off
30
+ ```
31
+
32
+ Output from the model will consist of a response that should be relayed back to the user, along with an optional code block that will invoke different Home Assistant "services". The output format from the model for function calling is as follows:
33
+
34
+ `````
35
+ turning on the kitchen lights for you now
36
+ ```homeassistant
37
+ { "service": "light.turn_on", "target_device": "light.kitchen" }
38
+ ```
39
+ `````
40
+
41
+ ## Training
42
+ The model was trained as a full fine-tuning on an RTX 3090 (24GB).
43
+
44
+ ## Evaluation
45
+ This model acheives a 98.16% score for JSON function calling accuracy on the test dataset.
46
+ The v2 model acheives a 88.52% score on the same test.
47
+ The v1 model acheives a 76.78% score on the same test.
48
+
49
+ ## Datasets
50
+ Snythetic Dataset for SFT - https://github.com/acon96/home-llm
51
+
52
+ ## License
53
+ This model is a fine-tuning of the TinyLlama/TinyLlama-1.1B-Chat-v1.0 which is licensed under the Apache 2.0 License. As such this model is released under the same Apache 2.0 License.