AMKCode commited on
Commit
8a3911b
1 Parent(s): beec542

Upload README.md with huggingface_hub

Browse files
Files changed (1) hide show
  1. README.md +28 -0
README.md ADDED
@@ -0,0 +1,28 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ ---
2
+ base_model: google/gemma-2-2b-it
3
+ library_name: transformers
4
+ license: gemma
5
+ pipeline_tag: text-generation
6
+ tags:
7
+ - conversational
8
+ - mlc-ai
9
+ - MLC-Weight-Conversion
10
+ extra_gated_heading: Access Gemma on Hugging Face
11
+ extra_gated_prompt: To access Gemma on Hugging Face, you’re required to review and
12
+ agree to Google’s usage license. To do this, please ensure you’re logged in to Hugging
13
+ Face and click below. Requests are processed immediately.
14
+ extra_gated_button_content: Acknowledge license
15
+ ---
16
+
17
+ # AMKCode/gemma-2-2b-it-q4f32_1-MLC
18
+ This model was compiled using MLC-LLM with q4f32_1 quantization from [google/gemma-2-2b-it](https://huggingface.co/google/gemma-2-2b-it).
19
+ The conversion was done using the [MLC-Weight-Conversion](https://huggingface.co/spaces/mlc-ai/MLC-Weight-Conversion) space.
20
+
21
+ To run this model, please first install [MLC-LLM](https://llm.mlc.ai/docs/install/mlc_llm.html#install-mlc-packages).
22
+
23
+ To chat with the model on your terminal:
24
+ ```bash
25
+ mlc_llm chat HF://AMKCode/gemma-2-2b-it-q4f32_1-MLC
26
+ ```
27
+
28
+ For more information on how to use MLC-LLM, please visit the MLC-LLM [documentation](https://llm.mlc.ai/docs/index.html).