AI PC: Text Generation
Text generation LLMs that have been validated to run on the AI PC Intel® Core™ Ultra CPU and iGPU.
- Text Generation • Updated • 50 • 2
OpenVINO/mixtral-8x7b-instruct-v0.1-int4-ov
Text Generation • Updated • 35 • 3OpenVINO/phi-2-fp16-ov
Text Generation • Updated • 40 • 1OpenVINO/phi-2-int8-ov
Text Generation • Updated • 79OpenVINO/phi-2-int4-ov
Text Generation • Updated • 18 • 1OpenVINO/mistral-7b-instruct-v0.1-fp16-ov
Text Generation • Updated • 41OpenVINO/mistral-7b-instruct-v0.1-int8-ov
Text Generation • Updated • 81OpenVINO/mistral-7b-instruct-v0.1-int4-ov
Text Generation • Updated • 226OpenVINO/starcoder2-15b-fp16-ov
Text Generation • Updated • 9OpenVINO/starcoder2-15b-int8-ov
Text Generation • Updated • 12OpenVINO/starcoder2-15b-int4-ov
Text Generation • Updated • 14OpenVINO/neural-chat-7b-v3-3-fp16-ov
Text Generation • Updated • 6OpenVINO/neural-chat-7b-v3-3-int8-ov
Text Generation • Updated • 20OpenVINO/neural-chat-7b-v3-3-int4-ov
Text Generation • Updated • 35OpenVINO/mpt-7b-fp16-ov
Text Generation • Updated • 5OpenVINO/mpt-7b-int8-ov
Text Generation • Updated • 4OpenVINO/mpt-7b-int4-ov
Text Generation • Updated • 3OpenVINO/Phi-3-mini-128k-instruct-fp16-ov
Text Generation • Updated • 15OpenVINO/Phi-3-mini-128k-instruct-int8-ov
Text Generation • Updated • 53 • 2OpenVINO/Phi-3-mini-128k-instruct-int4-ov
Text Generation • Updated • 428 • 2OpenVINO/falcon-7b-instruct-fp16-ov
Text Generation • Updated • 2OpenVINO/falcon-7b-instruct-int8-ov
Text Generation • Updated • 4OpenVINO/falcon-7b-instruct-int4-ov
Text Generation • Updated • 6OpenVINO/open_llama_3b_v2-fp16-ov
Text Generation • Updated • 37OpenVINO/open_llama_3b_v2-int8-ov
Text Generation • Updated • 93 • 1OpenVINO/open_llama_3b_v2-int4-ov
Text Generation • Updated • 20OpenVINO/open_llama_7b_v2-fp16-ov
Text Generation • Updated • 22OpenVINO/open_llama_7b_v2-int8-ov
Text Generation • Updated • 39OpenVINO/open_llama_7b_v2-int4-ov
Text Generation • Updated • 23OpenVINO/gpt-j-6b-fp16-ov
Text Generation • Updated • 3OpenVINO/gpt-j-6b-int8-ov
Text Generation • Updated • 4OpenVINO/gpt-j-6b-int4-ov
Text Generation • Updated • 8OpenVINO/RedPajama-INCITE-7B-Chat-fp16-ov
Text Generation • Updated • 3OpenVINO/RedPajama-INCITE-7B-Chat-int8-ov
Text Generation • Updated • 4OpenVINO/RedPajama-INCITE-7B-Chat-int4-ov
Text Generation • Updated • 3OpenVINO/RedPajama-INCITE-7B-Instruct-fp16-ov
Text Generation • Updated • 4OpenVINO/RedPajama-INCITE-7B-Instruct-int8-ov
Text Generation • Updated • 3OpenVINO/RedPajama-INCITE-7B-Instruct-int4-ov
Text Generation • Updated • 4OpenVINO/dolly-v2-7b-fp16-ov
Text Generation • Updated • 4OpenVINO/dolly-v2-7b-int8-ov
Text Generation • Updated • 3OpenVINO/dolly-v2-7b-int4-ov
Text Generation • Updated • 2OpenVINO/Mistral-7B-Instruct-v0.2-fp16-ov
Text Generation • Updated • 15OpenVINO/Mistral-7B-Instruct-v0.2-int8-ov
Text Generation • Updated • 305 • 1OpenVINO/Mistral-7B-Instruct-v0.2-int4-ov
Text Generation • Updated • 98 • 1OpenVINO/Phi-3-medium-4k-instruct-fp16-ov
Text Generation • Updated • 9OpenVINO/Phi-3-medium-4k-instruct-int8-ov
Text Generation • Updated • 21OpenVINO/Phi-3-medium-4k-instruct-int4-ov
Text Generation • Updated • 125 • 3OpenVINO/pythia-1.4b-fp16-ov
Text Generation • Updated • 3OpenVINO/pythia-1.4b-int8-ov
Text Generation • Updated • 2OpenVINO/pythia-1.4b-int4-ov
Text Generation • Updated • 23OpenVINO/pythia-2.8b-fp16-ov
Text Generation • Updated • 2OpenVINO/pythia-2.8b-int8-ov
Text Generation • Updated • 2OpenVINO/pythia-2.8b-int4-ov
Text Generation • Updated • 3OpenVINO/pythia-6.9b-fp16-ov
Text Generation • Updated • 5OpenVINO/pythia-6.9b-int8-ov
Text Generation • Updated • 2OpenVINO/pythia-6.9b-int4-ov
Text Generation • Updated • 2OpenVINO/pythia-1b-fp16-ov
Text Generation • Updated • 2OpenVINO/pythia-1b-int8-ov
Text Generation • Updated • 4OpenVINO/pythia-1b-int4-ov
Text Generation • Updated • 8OpenVINO/neural-chat-7b-v1-1-fp16-ov
Text Generation • Updated • 1OpenVINO/neural-chat-7b-v1-1-int8-ov
Text Generation • Updated • 3OpenVINO/neural-chat-7b-v1-1-int4-ov
Text Generation • Updated • 16OpenVINO/persimmon-8b-chat-int4-ov
Text Generation • Updated • 2OpenVINO/persimmon-8b-chat-fp16-ov
Text Generation • Updated • 4OpenVINO/persimmon-8b-chat-int8-ov
Text Generation • Updated • 2
AhmedSSoliman/MarianCausalLM
Text Generation • Updated • 4Note This model was tested with OpenVINO version 2024.1.0, using the OVModelForCausalLM library with INT4 weight compression for the lowest memory footprint. To convert the model to OpenVINO, follow instructions at: https://huggingface.co/docs/optimum/main/en/intel/installation
AurelPx/Pegasus-7b-slerp
Text Generation • Updated • 58 • 1Note This model was tested with OpenVINO version 2024.1.0, using the OVModelForCausalLM library with INT4 weight compression for the lowest memory footprint. To convert the model to OpenVINO, follow instructions at: https://huggingface.co/docs/optimum/main/en/intel/installation
BAAI/Aquila-7B
Updated • 6.78k • 17Note This model was tested with OpenVINO version 2024.1.0, using the OVModelForCausalLM library with INT4 weight compression for the lowest memory footprint. To convert the model to OpenVINO, follow instructions at: https://huggingface.co/docs/optimum/main/en/intel/installation
BAAI/Aquila2-7B
Text Generation • Updated • 262 • 6Note This model was tested with OpenVINO version 2024.1.0, using the OVModelForCausalLM library with INT4 weight compression for the lowest memory footprint. To convert the model to OpenVINO, follow instructions at: https://huggingface.co/docs/optimum/main/en/intel/installation
BAAI/AquilaChat-7B
Updated • 2.77k • 48Note This model was tested with OpenVINO version 2024.1.0, using the OVModelForCausalLM library with INT4 weight compression for the lowest memory footprint. To convert the model to OpenVINO, follow instructions at: https://huggingface.co/docs/optimum/main/en/intel/installation
BAAI/AquilaChat2-7B
Text Generation • Updated • 10.3k • 15Note This model was tested with OpenVINO version 2024.1.0, using the OVModelForCausalLM library with INT4 weight compression for the lowest memory footprint. To convert the model to OpenVINO, follow instructions at: https://huggingface.co/docs/optimum/main/en/intel/installation
BigSalmon/GPT2Neo1.3BPoints
Text Generation • Updated • 5Note This model was tested with OpenVINO version 2024.1.0, using the OVModelForCausalLM library with INT4 weight compression for the lowest memory footprint. To convert the model to OpenVINO, follow instructions at: https://huggingface.co/docs/optimum/main/en/intel/installation
EleutherAI/pythia-1.4b
Text Generation • Updated • 34.1k • 22Note This model was tested with OpenVINO version 2024.1.0, using the OVModelForCausalLM library with INT4 weight compression for the lowest memory footprint. To convert the model to OpenVINO, follow instructions at: https://huggingface.co/docs/optimum/main/en/intel/installation
EleutherAI/pythia-12b
Text Generation • Updated • 5.68k • 131Note This model was tested with OpenVINO version 2024.1.0, using the OVModelForCausalLM library with INT4 weight compression for the lowest memory footprint. To convert the model to OpenVINO, follow instructions at: https://huggingface.co/docs/optimum/main/en/intel/installation
EleutherAI/pythia-14m
Text Generation • Updated • 151k • 16Note This model was tested with OpenVINO version 2024.1.0, using the OVModelForCausalLM library with INT4 weight compression for the lowest memory footprint. To convert the model to OpenVINO, follow instructions at: https://huggingface.co/docs/optimum/main/en/intel/installation
EleutherAI/pythia-160m
Text Generation • Updated • 211k • 25Note This model was tested with OpenVINO version 2024.1.0, using the OVModelForCausalLM library with INT4 weight compression for the lowest memory footprint. To convert the model to OpenVINO, follow instructions at: https://huggingface.co/docs/optimum/main/en/intel/installation
EleutherAI/pythia-1b
Text Generation • Updated • 31.5k • 32Note This model was tested with OpenVINO version 2024.1.0, using the OVModelForCausalLM library with INT4 weight compression for the lowest memory footprint. To convert the model to OpenVINO, follow instructions at: https://huggingface.co/docs/optimum/main/en/intel/installation
EleutherAI/pythia-2.8b
Text Generation • Updated • 25.3k • 28Note This model was tested with OpenVINO version 2024.1.0, using the OVModelForCausalLM library with INT4 weight compression for the lowest memory footprint. To convert the model to OpenVINO, follow instructions at: https://huggingface.co/docs/optimum/main/en/intel/installation
EleutherAI/pythia-410m
Text Generation • Updated • 62.7k • 21Note This model was tested with OpenVINO version 2024.1.0, using the OVModelForCausalLM library with INT4 weight compression for the lowest memory footprint. To convert the model to OpenVINO, follow instructions at: https://huggingface.co/docs/optimum/main/en/intel/installation
EleutherAI/pythia-6.9b
Text Generation • Updated • 21.4k • 43Note This model was tested with OpenVINO version 2024.1.0, using the OVModelForCausalLM library with INT4 weight compression for the lowest memory footprint. To convert the model to OpenVINO, follow instructions at: https://huggingface.co/docs/optimum/main/en/intel/installation
EleutherAI/pythia-70m
Updated • 60.8k • 55Note This model was tested with OpenVINO version 2024.1.0, using the OVModelForCausalLM library with INT4 weight compression for the lowest memory footprint. To convert the model to OpenVINO, follow instructions at: https://huggingface.co/docs/optimum/main/en/intel/installation
HuggingFaceH4/zephyr-7b-beta
Text Generation • Updated • 787k • • 1.58kNote This model was tested with OpenVINO version 2024.1.0, using the OVModelForCausalLM library with INT4 weight compression for the lowest memory footprint. To convert the model to OpenVINO, follow instructions at: https://huggingface.co/docs/optimum/main/en/intel/installation
Intel/neural-chat-7b-v1-1
Text Generation • Updated • 20 • 23Note This model was tested with OpenVINO version 2024.1.0, using the OVModelForCausalLM library with INT4 weight compression for the lowest memory footprint. To convert the model to OpenVINO, follow instructions at: https://huggingface.co/docs/optimum/main/en/intel/installation
Intel/neural-chat-7b-v3-3
Text Generation • Updated • 130k • 75Note This model was tested with OpenVINO version 2024.1.0, using the OVModelForCausalLM library with INT4 weight compression for the lowest memory footprint. To convert the model to OpenVINO, follow instructions at: https://huggingface.co/docs/optimum/main/en/intel/installation
Qwen/CodeQwen1.5-7B-Chat
Text Generation • Updated • 14.9k • 296Note This model was tested with OpenVINO version 2024.1.0, using the OVModelForCausalLM library with INT4 weight compression for the lowest memory footprint. To convert the model to OpenVINO, follow instructions at: https://huggingface.co/docs/optimum/main/en/intel/installation
Qwen/Qwen-1_8B
Text Generation • Updated • 2.33k • 60Note This model was tested with OpenVINO version 2024.1.0, using the OVModelForCausalLM library with INT4 weight compression for the lowest memory footprint. To convert the model to OpenVINO, follow instructions at: https://huggingface.co/docs/optimum/main/en/intel/installation
Qwen/Qwen-1_8B-Chat
Text Generation • Updated • 50.3k • 105Note This model was tested with OpenVINO version 2024.1.0, using the OVModelForCausalLM library with INT4 weight compression for the lowest memory footprint. To convert the model to OpenVINO, follow instructions at: https://huggingface.co/docs/optimum/main/en/intel/installation
Qwen/Qwen-7B
Text Generation • Updated • 27.3k • 361Note This model was tested with OpenVINO version 2024.1.0, using the OVModelForCausalLM library with INT4 weight compression for the lowest memory footprint. To convert the model to OpenVINO, follow instructions at: https://huggingface.co/docs/optimum/main/en/intel/installation
Qwen/Qwen-7B-Chat
Text Generation • Updated • 33k • 745Note This model was tested with OpenVINO version 2024.1.0, using the OVModelForCausalLM library with INT4 weight compression for the lowest memory footprint. To convert the model to OpenVINO, follow instructions at: https://huggingface.co/docs/optimum/main/en/intel/installation
Qwen/Qwen1.5-0.5B
Text Generation • Updated • 839k • 142Note This model was tested with OpenVINO version 2024.1.0, using the OVModelForCausalLM library with INT4 weight compression for the lowest memory footprint. To convert the model to OpenVINO, follow instructions at: https://huggingface.co/docs/optimum/main/en/intel/installation
Qwen/Qwen1.5-0.5B-Chat
Text Generation • Updated • 227k • 73Note This model was tested with OpenVINO version 2024.1.0, using the OVModelForCausalLM library with INT4 weight compression for the lowest memory footprint. To convert the model to OpenVINO, follow instructions at: https://huggingface.co/docs/optimum/main/en/intel/installation
Qwen/Qwen1.5-1.8B
Text Generation • Updated • 794k • 43Note This model was tested with OpenVINO version 2024.1.0, using the OVModelForCausalLM library with INT4 weight compression for the lowest memory footprint. To convert the model to OpenVINO, follow instructions at: https://huggingface.co/docs/optimum/main/en/intel/installation
Qwen/Qwen1.5-1.8B-Chat
Text Generation • Updated • 35k • 44Note This model was tested with OpenVINO version 2024.1.0, using the OVModelForCausalLM library with INT4 weight compression for the lowest memory footprint. To convert the model to OpenVINO, follow instructions at: https://huggingface.co/docs/optimum/main/en/intel/installation
Qwen/Qwen1.5-4B
Text Generation • Updated • 14.7k • 34Note This model was tested with OpenVINO version 2024.1.0, using the OVModelForCausalLM library with INT4 weight compression for the lowest memory footprint. To convert the model to OpenVINO, follow instructions at: https://huggingface.co/docs/optimum/main/en/intel/installation
Qwen/Qwen1.5-4B-Chat
Text Generation • Updated • 15.2k • 38Note This model was tested with OpenVINO version 2024.1.0, using the OVModelForCausalLM library with INT4 weight compression for the lowest memory footprint. To convert the model to OpenVINO, follow instructions at: https://huggingface.co/docs/optimum/main/en/intel/installation
Qwen/Qwen1.5-7B
Text Generation • Updated • 450k • 45Note This model was tested with OpenVINO version 2024.1.0, using the OVModelForCausalLM library with INT4 weight compression for the lowest memory footprint. To convert the model to OpenVINO, follow instructions at: https://huggingface.co/docs/optimum/main/en/intel/installation
Qwen/Qwen1.5-7B-Chat
Text Generation • Updated • 24.7k • 161Note This model was tested with OpenVINO version 2024.1.0, using the OVModelForCausalLM library with INT4 weight compression for the lowest memory footprint. To convert the model to OpenVINO, follow instructions at: https://huggingface.co/docs/optimum/main/en/intel/installation
Salesforce/codegen-2B-multi
Text Generation • Updated • 1.03k • 34Note This model was tested with OpenVINO version 2024.1.0, using the OVModelForCausalLM library with INT4 weight compression for the lowest memory footprint. To convert the model to OpenVINO, follow instructions at: https://huggingface.co/docs/optimum/main/en/intel/installation
Salesforce/codegen-350M-mono
Text Generation • Updated • 12.1k • 84Note This model was tested with OpenVINO version 2024.1.0, using the OVModelForCausalLM library with INT4 weight compression for the lowest memory footprint. To convert the model to OpenVINO, follow instructions at: https://huggingface.co/docs/optimum/main/en/intel/installation
Salesforce/codegen-6B-multi
Text Generation • Updated • 1.31k • 19Note This model was tested with OpenVINO version 2024.1.0, using the OVModelForCausalLM library with INT4 weight compression for the lowest memory footprint. To convert the model to OpenVINO, follow instructions at: https://huggingface.co/docs/optimum/main/en/intel/installation
Salesforce/codegen2-1B_P
Text Generation • Updated • 712 • 38Note This model was tested with OpenVINO version 2024.1.0, using the OVModelForCausalLM library with INT4 weight compression for the lowest memory footprint. To convert the model to OpenVINO, follow instructions at: https://huggingface.co/docs/optimum/main/en/intel/installation
Salesforce/codegen2-3_7B_P
Text Generation • Updated • 474 • 15Note This model was tested with OpenVINO version 2024.1.0, using the OVModelForCausalLM library with INT4 weight compression for the lowest memory footprint. To convert the model to OpenVINO, follow instructions at: https://huggingface.co/docs/optimum/main/en/intel/installation
Salesforce/codegen2-7B_P
Text Generation • Updated • 599 • 26Note This model was tested with OpenVINO version 2024.1.0, using the OVModelForCausalLM library with INT4 weight compression for the lowest memory footprint. To convert the model to OpenVINO, follow instructions at: https://huggingface.co/docs/optimum/main/en/intel/installation
WizardLMTeam/WizardMath-7B-V1.1
Text Generation • Updated • 33.9k • 75Note This model was tested with OpenVINO version 2024.1.0, using the OVModelForCausalLM library with INT4 weight compression for the lowest memory footprint. To convert the model to OpenVINO, follow instructions at: https://huggingface.co/docs/optimum/main/en/intel/installation
X-D-Lab/MindChat-Qwen2-4B
Text Generation • Updated • 27 • 4Note This model was tested with OpenVINO version 2024.1.0, using the OVModelForCausalLM library with INT4 weight compression for the lowest memory footprint. To convert the model to OpenVINO, follow instructions at: https://huggingface.co/docs/optimum/main/en/intel/installation
adept/persimmon-8b-chat
Text Generation • Updated • 959 • 42Note This model was tested with OpenVINO version 2024.1.0, using the OVModelForCausalLM library with INT4 weight compression for the lowest memory footprint. To convert the model to OpenVINO, follow instructions at: https://huggingface.co/docs/optimum/main/en/intel/installation
baichuan-inc/Baichuan2-13B-Chat
Text Generation • Updated • 81.4k • 420Note This model was tested with OpenVINO version 2024.1.0, using the OVModelForCausalLM library with INT4 weight compression for the lowest memory footprint. To convert the model to OpenVINO, follow instructions at: https://huggingface.co/docs/optimum/main/en/intel/installation
baichuan-inc/Baichuan2-7B-Base
Text Generation • Updated • 5.46k • 74Note This model was tested with OpenVINO version 2024.1.0, using the OVModelForCausalLM library with INT4 weight compression for the lowest memory footprint. To convert the model to OpenVINO, follow instructions at: https://huggingface.co/docs/optimum/main/en/intel/installation
baichuan-inc/Baichuan2-7B-Chat
Text Generation • Updated • 17.6k • 155Note This model was tested with OpenVINO version 2024.1.0, using the OVModelForCausalLM library with INT4 weight compression for the lowest memory footprint. To convert the model to OpenVINO, follow instructions at: https://huggingface.co/docs/optimum/main/en/intel/installation
bigscience/bloom-560m
Text Generation • Updated • 136k • 342Note This model was tested with OpenVINO version 2024.1.0, using the OVModelForCausalLM library with INT4 weight compression for the lowest memory footprint. To convert the model to OpenVINO, follow instructions at: https://huggingface.co/docs/optimum/main/en/intel/installation
bigscience/bloomz-1b1
Text Generation • Updated • 3.26k • 31Note This model was tested with OpenVINO version 2024.1.0, using the OVModelForCausalLM library with INT4 weight compression for the lowest memory footprint. To convert the model to OpenVINO, follow instructions at: https://huggingface.co/docs/optimum/main/en/intel/installation
bigscience/bloomz-3b
Text Generation • Updated • 8.3k • 77Note This model was tested with OpenVINO version 2024.1.0, using the OVModelForCausalLM library with INT4 weight compression for the lowest memory footprint. To convert the model to OpenVINO, follow instructions at: https://huggingface.co/docs/optimum/main/en/intel/installation
bigscience/bloomz-7b1-mt
Text Generation • Updated • 1.37k • 138Note This model was tested with OpenVINO version 2024.1.0, using the OVModelForCausalLM library with INT4 weight compression for the lowest memory footprint. To convert the model to OpenVINO, follow instructions at: https://huggingface.co/docs/optimum/main/en/intel/installation
facebook/opt-1.3b
Text Generation • Updated • 62k • 148Note This model was tested with OpenVINO version 2024.1.0, using the OVModelForCausalLM library with INT4 weight compression for the lowest memory footprint. To convert the model to OpenVINO, follow instructions at: https://huggingface.co/docs/optimum/main/en/intel/installation
facebook/opt-125m
Text Generation • Updated • 5.02M • 157Note This model was tested with OpenVINO version 2024.1.0, using the OVModelForCausalLM library with INT4 weight compression for the lowest memory footprint. To convert the model to OpenVINO, follow instructions at: https://huggingface.co/docs/optimum/main/en/intel/installation
facebook/opt-13b
Text Generation • Updated • 21k • 65Note This model was tested with OpenVINO version 2024.1.0, using the OVModelForCausalLM library with INT4 weight compression for the lowest memory footprint. To convert the model to OpenVINO, follow instructions at: https://huggingface.co/docs/optimum/main/en/intel/installation
facebook/opt-2.7b
Text Generation • Updated • 40.3k • 79Note This model was tested with OpenVINO version 2024.1.0, using the OVModelForCausalLM library with INT4 weight compression for the lowest memory footprint. To convert the model to OpenVINO, follow instructions at: https://huggingface.co/docs/optimum/main/en/intel/installation
facebook/opt-350m
Text Generation • Updated • 149k • 125Note This model was tested with OpenVINO version 2024.1.0, using the OVModelForCausalLM library with INT4 weight compression for the lowest memory footprint. To convert the model to OpenVINO, follow instructions at: https://huggingface.co/docs/optimum/main/en/intel/installation
facebook/opt-6.7b
Text Generation • Updated • 50.1k • 105Note This model was tested with OpenVINO version 2024.1.0, using the OVModelForCausalLM library with INT4 weight compression for the lowest memory footprint. To convert the model to OpenVINO, follow instructions at: https://huggingface.co/docs/optimum/main/en/intel/installation
facebook/opt-iml-1.3b
Text Generation • Updated • 440 • 29Note This model was tested with OpenVINO version 2024.1.0, using the OVModelForCausalLM library with INT4 weight compression for the lowest memory footprint. To convert the model to OpenVINO, follow instructions at: https://huggingface.co/docs/optimum/main/en/intel/installation
google/codegemma-1.1-2b
Text Generation • Updated • 179 • 17Note This model was tested with OpenVINO version 2024.1.0, using the OVModelForCausalLM library with INT4 weight compression for the lowest memory footprint. To convert the model to OpenVINO, follow instructions at: https://huggingface.co/docs/optimum/main/en/intel/installation
google/codegemma-1.1-7b-it
Text Generation • Updated • 137 • 49Note This model was tested with OpenVINO version 2024.1.0, using the OVModelForCausalLM library with INT4 weight compression for the lowest memory footprint. To convert the model to OpenVINO, follow instructions at: https://huggingface.co/docs/optimum/main/en/intel/installation
google/codegemma-2b
Text Generation • Updated • 3.17k • 68Note This model was tested with OpenVINO version 2024.1.0, using the OVModelForCausalLM library with INT4 weight compression for the lowest memory footprint. To convert the model to OpenVINO, follow instructions at: https://huggingface.co/docs/optimum/main/en/intel/installation
google/codegemma-7b
Text Generation • Updated • 19.7k • 156Note This model was tested with OpenVINO version 2024.1.0, using the OVModelForCausalLM library with INT4 weight compression for the lowest memory footprint. To convert the model to OpenVINO, follow instructions at: https://huggingface.co/docs/optimum/main/en/intel/installation
google/gemma-1.1-2b-it
Text Generation • Updated • 44.1k • 144Note This model was tested with OpenVINO version 2024.1.0, using the OVModelForCausalLM library with INT4 weight compression for the lowest memory footprint. To convert the model to OpenVINO, follow instructions at: https://huggingface.co/docs/optimum/main/en/intel/installation
google/gemma-1.1-7b-it
Text Generation • Updated • 13.3k • • 261Note This model was tested with OpenVINO version 2024.1.0, using the OVModelForCausalLM library with INT4 weight compression for the lowest memory footprint. To convert the model to OpenVINO, follow instructions at: https://huggingface.co/docs/optimum/main/en/intel/installation
google/gemma-2b
Text Generation • Updated • 419k • • 893Note This model was tested with OpenVINO version 2024.1.0, using the OVModelForCausalLM library with INT4 weight compression for the lowest memory footprint. To convert the model to OpenVINO, follow instructions at: https://huggingface.co/docs/optimum/main/en/intel/installation
google/gemma-2b-it
Text Generation • Updated • 129k • • 656Note This model was tested with OpenVINO version 2024.1.0, using the OVModelForCausalLM library with INT4 weight compression for the lowest memory footprint. To convert the model to OpenVINO, follow instructions at: https://huggingface.co/docs/optimum/main/en/intel/installation
google/gemma-7b
Text Generation • Updated • 220k • • 3.03kNote This model was tested with OpenVINO version 2024.1.0, using the OVModelForCausalLM library with INT4 weight compression for the lowest memory footprint. To convert the model to OpenVINO, follow instructions at: https://huggingface.co/docs/optimum/main/en/intel/installation
google/gemma-7b-it
Text Generation • Updated • 273k • 1.13kNote This model was tested with OpenVINO version 2024.1.0, using the OVModelForCausalLM library with INT4 weight compression for the lowest memory footprint. To convert the model to OpenVINO, follow instructions at: https://huggingface.co/docs/optimum/main/en/intel/installation
ibm-granite/granite-3b-code-base-2k
Text Generation • Updated • 5.3k • 32Note This model was tested with OpenVINO version 2024.1.0, using the OVModelForCausalLM library with INT4 weight compression for the lowest memory footprint. To convert the model to OpenVINO, follow instructions at: https://huggingface.co/docs/optimum/main/en/intel/installation
ibm-granite/granite-3b-code-instruct-2k
Text Generation • Updated • 7.91k • 30Note This model was tested with OpenVINO version 2024.1.0, using the OVModelForCausalLM library with INT4 weight compression for the lowest memory footprint. To convert the model to OpenVINO, follow instructions at: https://huggingface.co/docs/optimum/main/en/intel/installation
ibm-granite/granite-8b-code-base-4k
Text Generation • Updated • 4.27k • 29Note This model was tested with OpenVINO version 2024.1.0, using the OVModelForCausalLM library with INT4 weight compression for the lowest memory footprint. To convert the model to OpenVINO, follow instructions at: https://huggingface.co/docs/optimum/main/en/intel/installation
ibm-granite/granite-8b-code-instruct-4k
Text Generation • Updated • 4.14k • 102Note This model was tested with OpenVINO version 2024.1.0, using the OVModelForCausalLM library with INT4 weight compression for the lowest memory footprint. To convert the model to OpenVINO, follow instructions at: https://huggingface.co/docs/optimum/main/en/intel/installation
internlm/internlm2-1_8b
Text Generation • Updated • 8.73k • 28Note This model was tested with OpenVINO version 2024.1.0, using the OVModelForCausalLM library with INT4 weight compression for the lowest memory footprint. To convert the model to OpenVINO, follow instructions at: https://huggingface.co/docs/optimum/main/en/intel/installation
internlm/internlm2-7b
Text Generation • Updated • 11.8k • 40Note This model was tested with OpenVINO version 2024.1.0, using the OVModelForCausalLM library with INT4 weight compression for the lowest memory footprint. To convert the model to OpenVINO, follow instructions at: https://huggingface.co/docs/optimum/main/en/intel/installation
internlm/internlm2-chat-1_8b
Text Generation • Updated • 7.86k • 29Note This model was tested with OpenVINO version 2024.1.0, using the OVModelForCausalLM library with INT4 weight compression for the lowest memory footprint. To convert the model to OpenVINO, follow instructions at: https://huggingface.co/docs/optimum/main/en/intel/installation
internlm/internlm2-chat-7b
Text Generation • Updated • 12.5k • 82Note This model was tested with OpenVINO version 2024.1.0, using the OVModelForCausalLM library with INT4 weight compression for the lowest memory footprint. To convert the model to OpenVINO, follow instructions at: https://huggingface.co/docs/optimum/main/en/intel/installation
internlm/internlm2-chat-7b-sft
Text Generation • Updated • 7.64k • 6Note This model was tested with OpenVINO version 2024.1.0, using the OVModelForCausalLM library with INT4 weight compression for the lowest memory footprint. To convert the model to OpenVINO, follow instructions at: https://huggingface.co/docs/optimum/main/en/intel/installation
internlm/internlm2-math-7b
Text Generation • Updated • 275 • 25Note This model was tested with OpenVINO version 2024.1.0, using the OVModelForCausalLM library with INT4 weight compression for the lowest memory footprint. To convert the model to OpenVINO, follow instructions at: https://huggingface.co/docs/optimum/main/en/intel/installation
internlm/internlm2-math-base-7b
Text Generation • Updated • 578 • 2Note This model was tested with OpenVINO version 2024.1.0, using the OVModelForCausalLM library with INT4 weight compression for the lowest memory footprint. To convert the model to OpenVINO, follow instructions at: https://huggingface.co/docs/optimum/main/en/intel/installation
ise-uiuc/Magicoder-CL-7B
Text Generation • Updated • 34 • 21Note This model was tested with OpenVINO version 2024.1.0, using the OVModelForCausalLM library with INT4 weight compression for the lowest memory footprint. To convert the model to OpenVINO, follow instructions at: https://huggingface.co/docs/optimum/main/en/intel/installation
ise-uiuc/Magicoder-DS-6.7B
Text Generation • Updated • 804 • 37Note This model was tested with OpenVINO version 2024.1.0, using the OVModelForCausalLM library with INT4 weight compression for the lowest memory footprint. To convert the model to OpenVINO, follow instructions at: https://huggingface.co/docs/optimum/main/en/intel/installation
ise-uiuc/Magicoder-S-CL-7B
Text Generation • Updated • 345 • 44Note This model was tested with OpenVINO version 2024.1.0, using the OVModelForCausalLM library with INT4 weight compression for the lowest memory footprint. To convert the model to OpenVINO, follow instructions at: https://huggingface.co/docs/optimum/main/en/intel/installation
ise-uiuc/Magicoder-S-DS-6.7B
Text Generation • Updated • 6.82k • 200Note This model was tested with OpenVINO version 2024.1.0, using the OVModelForCausalLM library with INT4 weight compression for the lowest memory footprint. To convert the model to OpenVINO, follow instructions at: https://huggingface.co/docs/optimum/main/en/intel/installation
meta-llama/Llama-2-13b-chat-hf
Text Generation • Updated • 641k • 1.02kNote This model was tested with OpenVINO version 2024.1.0, using the OVModelForCausalLM library with INT4 weight compression for the lowest memory footprint. To convert the model to OpenVINO, follow instructions at: https://huggingface.co/docs/optimum/main/en/intel/installation
meta-llama/Llama-2-13b-hf
Text Generation • Updated • 65.8k • 568Note This model was tested with OpenVINO version 2024.1.0, using the OVModelForCausalLM library with INT4 weight compression for the lowest memory footprint. To convert the model to OpenVINO, follow instructions at: https://huggingface.co/docs/optimum/main/en/intel/installation
meta-llama/Llama-2-7b-chat-hf
Text Generation • Updated • 643k • 3.86kNote This model was tested with OpenVINO version 2024.1.0, using the OVModelForCausalLM library with INT4 weight compression for the lowest memory footprint. To convert the model to OpenVINO, follow instructions at: https://huggingface.co/docs/optimum/main/en/intel/installation
meta-llama/Llama-2-7b-hf
Text Generation • Updated • 891k • 1.69kNote This model was tested with OpenVINO version 2024.1.0, using the OVModelForCausalLM library with INT4 weight compression for the lowest memory footprint. To convert the model to OpenVINO, follow instructions at: https://huggingface.co/docs/optimum/main/en/intel/installation
meta-llama/Meta-Llama-3-8B
Text Generation • Updated • 1.89M • 5.69kNote This model was tested with OpenVINO version 2024.1.0, using the OVModelForCausalLM library with INT4 weight compression for the lowest memory footprint. To convert the model to OpenVINO, follow instructions at: https://huggingface.co/docs/optimum/main/en/intel/installation
meta-llama/Meta-Llama-3-8B-Instruct
Text Generation • Updated • 1.98M • • 3.45kNote This model was tested with OpenVINO version 2024.1.0, using the OVModelForCausalLM library with INT4 weight compression for the lowest memory footprint. To convert the model to OpenVINO, follow instructions at: https://huggingface.co/docs/optimum/main/en/intel/installation
meta-llama/Meta-Llama-Guard-2-8B
Text Generation • Updated • 16k • 273Note This model was tested with OpenVINO version 2024.1.0, using the OVModelForCausalLM library with INT4 weight compression for the lowest memory footprint. To convert the model to OpenVINO, follow instructions at: https://huggingface.co/docs/optimum/main/en/intel/installation
microsoft/Phi-3-medium-4k-instruct
Text Generation • Updated • 45.2k • 209Note This model was tested with OpenVINO version 2024.1.0, using the OVModelForCausalLM library with INT4 weight compression for the lowest memory footprint. To convert the model to OpenVINO, follow instructions at: https://huggingface.co/docs/optimum/main/en/intel/installation
microsoft/Phi-3-mini-128k-instruct
Text Generation • Updated • 232k • 1.58kNote This model was tested with OpenVINO version 2024.1.0, using the OVModelForCausalLM library with INT4 weight compression for the lowest memory footprint. To convert the model to OpenVINO, follow instructions at: https://huggingface.co/docs/optimum/main/en/intel/installation
microsoft/phi-2
Text Generation • Updated • 324k • 3.23kNote This model was tested with OpenVINO version 2024.1.0, using the OVModelForCausalLM library with INT4 weight compression for the lowest memory footprint. To convert the model to OpenVINO, follow instructions at: https://huggingface.co/docs/optimum/main/en/intel/installation
mistralai/Mistral-7B-Instruct-v0.2
Text Generation • Updated • 900k • 2.53kNote This model was tested with OpenVINO version 2024.1.0, using the OVModelForCausalLM library with INT4 weight compression for the lowest memory footprint. To convert the model to OpenVINO, follow instructions at: https://huggingface.co/docs/optimum/main/en/intel/installation
mistralai/Mistral-7B-Instruct-v0.3
Text Generation • Updated • 565k • • 1kNote This model was tested with OpenVINO version 2024.1.0, using the OVModelForCausalLM library with INT4 weight compression for the lowest memory footprint. To convert the model to OpenVINO, follow instructions at: https://huggingface.co/docs/optimum/main/en/intel/installation
mistralai/Mistral-7B-v0.3
Text Generation • Updated • 118k • 363Note This model was tested with OpenVINO version 2024.1.0, using the OVModelForCausalLM library with INT4 weight compression for the lowest memory footprint. To convert the model to OpenVINO, follow instructions at: https://huggingface.co/docs/optimum/main/en/intel/installation
mosaicml/mpt-7b
Text Generation • Updated • 34k • 1.16kNote This model was tested with OpenVINO version 2024.1.0, using the OVModelForCausalLM library with INT4 weight compression for the lowest memory footprint. To convert the model to OpenVINO, follow instructions at: https://huggingface.co/docs/optimum/main/en/intel/installation
mosaicml/mpt-7b-8k
Text Generation • Updated • 952 • 26Note This model was tested with OpenVINO version 2024.1.0, using the OVModelForCausalLM library with INT4 weight compression for the lowest memory footprint. To convert the model to OpenVINO, follow instructions at: https://huggingface.co/docs/optimum/main/en/intel/installation
mosaicml/mpt-7b-8k-chat
Text Generation • Updated • 1.53k • 39Note This model was tested with OpenVINO version 2024.1.0, using the OVModelForCausalLM library with INT4 weight compression for the lowest memory footprint. To convert the model to OpenVINO, follow instructions at: https://huggingface.co/docs/optimum/main/en/intel/installation
mosaicml/mpt-7b-chat
Text Generation • Updated • 3.97k • 511Note This model was tested with OpenVINO version 2024.1.0, using the OVModelForCausalLM library with INT4 weight compression for the lowest memory footprint. To convert the model to OpenVINO, follow instructions at: https://huggingface.co/docs/optimum/main/en/intel/installation
mosaicml/mpt-7b-instruct
Text Generation • Updated • 37.8k • 462Note This model was tested with OpenVINO version 2024.1.0, using the OVModelForCausalLM library with INT4 weight compression for the lowest memory footprint. To convert the model to OpenVINO, follow instructions at: https://huggingface.co/docs/optimum/main/en/intel/installation
mosaicml/mpt-7b-storywriter
Text Generation • Updated • 1.79k • 814Note This model was tested with OpenVINO version 2024.1.0, using the OVModelForCausalLM library with INT4 weight compression for the lowest memory footprint. To convert the model to OpenVINO, follow instructions at: https://huggingface.co/docs/optimum/main/en/intel/installation
openai-community/gpt2
Text Generation • Updated • 7.34M • 2.26kNote This model was tested with OpenVINO version 2024.1.0, using the OVModelForCausalLM library with INT4 weight compression for the lowest memory footprint. To convert the model to OpenVINO, follow instructions at: https://huggingface.co/docs/optimum/main/en/intel/installation
openbmb/MiniCPM-2B-sft-bf16
Text Generation • Updated • 2.13k • 116Note This model was tested with OpenVINO version 2024.1.0, using the OVModelForCausalLM library with INT4 weight compression for the lowest memory footprint. To convert the model to OpenVINO, follow instructions at: https://huggingface.co/docs/optimum/main/en/intel/installation
openchat/openchat-3.6-8b-20240522
Text Generation • Updated • 11.3k • 145Note This model was tested with OpenVINO version 2024.1.0, using the OVModelForCausalLM library with INT4 weight compression for the lowest memory footprint. To convert the model to OpenVINO, follow instructions at: https://huggingface.co/docs/optimum/main/en/intel/installation
stabilityai/stablelm-2-12b
Text Generation • Updated • 793 • 114Note This model was tested with OpenVINO version 2024.1.0, using the OVModelForCausalLM library with INT4 weight compression for the lowest memory footprint. To convert the model to OpenVINO, follow instructions at: https://huggingface.co/docs/optimum/main/en/intel/installation
stabilityai/stablelm-2-12b-chat
Text Generation • Updated • 1.37k • 86Note This model was tested with OpenVINO version 2024.1.0, using the OVModelForCausalLM library with INT4 weight compression for the lowest memory footprint. To convert the model to OpenVINO, follow instructions at: https://huggingface.co/docs/optimum/main/en/intel/installation
stabilityai/stablelm-2-1_6b
Text Generation • Updated • 13k • 180Note This model was tested with OpenVINO version 2024.1.0, using the OVModelForCausalLM library with INT4 weight compression for the lowest memory footprint. To convert the model to OpenVINO, follow instructions at: https://huggingface.co/docs/optimum/main/en/intel/installation
stabilityai/stablelm-2-1_6b-chat
Text Generation • Updated • 4.69k • 30Note This model was tested with OpenVINO version 2024.1.0, using the OVModelForCausalLM library with INT4 weight compression for the lowest memory footprint. To convert the model to OpenVINO, follow instructions at: https://huggingface.co/docs/optimum/main/en/intel/installation
stabilityai/stablelm-2-zephyr-1_6b
Text Generation • Updated • 12.6k • 179Note This model was tested with OpenVINO version 2024.1.0, using the OVModelForCausalLM library with INT4 weight compression for the lowest memory footprint. To convert the model to OpenVINO, follow instructions at: https://huggingface.co/docs/optimum/main/en/intel/installation
stabilityai/stablelm-3b-4e1t
Text Generation • Updated • 99k • 307Note This model was tested with OpenVINO version 2024.1.0, using the OVModelForCausalLM library with INT4 weight compression for the lowest memory footprint. To convert the model to OpenVINO, follow instructions at: https://huggingface.co/docs/optimum/main/en/intel/installation
stabilityai/stablelm-base-alpha-3b
Text Generation • Updated • 1.18k • 82Note This model was tested with OpenVINO version 2024.1.0, using the OVModelForCausalLM library with INT4 weight compression for the lowest memory footprint. To convert the model to OpenVINO, follow instructions at: https://huggingface.co/docs/optimum/main/en/intel/installation
stabilityai/stablelm-tuned-alpha-7b
Text Generation • Updated • 2.07k • 357Note This model was tested with OpenVINO version 2024.1.0, using the OVModelForCausalLM library with INT4 weight compression for the lowest memory footprint. To convert the model to OpenVINO, follow instructions at: https://huggingface.co/docs/optimum/main/en/intel/installation
stabilityai/stablelm-zephyr-3b
Text Generation • Updated • 9.09k • 244Note This model was tested with OpenVINO version 2024.1.0, using the OVModelForCausalLM library with INT4 weight compression for the lowest memory footprint. To convert the model to OpenVINO, follow instructions at: https://huggingface.co/docs/optimum/main/en/intel/installation
stanford-crfm/BioMedLM
Text Generation • Updated • 2.59k • 393Note This model was tested with OpenVINO version 2024.1.0, using the OVModelForCausalLM library with INT4 weight compression for the lowest memory footprint. To convert the model to OpenVINO, follow instructions at: https://huggingface.co/docs/optimum/main/en/intel/installation
tiiuae/falcon-11B
Text Generation • Updated • 16.9k • 208Note This model was tested with OpenVINO version 2024.1.0, using the OVModelForCausalLM library with INT4 weight compression for the lowest memory footprint. To convert the model to OpenVINO, follow instructions at: https://huggingface.co/docs/optimum/main/en/intel/installation
tiiuae/falcon-7b
Text Generation • Updated • 89.9k • 1.07kNote This model was tested with OpenVINO version 2024.1.0, using the OVModelForCausalLM library with INT4 weight compression for the lowest memory footprint. To convert the model to OpenVINO, follow instructions at: https://huggingface.co/docs/optimum/main/en/intel/installation
tiiuae/falcon-7b-instruct
Text Generation • Updated • 124k • • 906Note This model was tested with OpenVINO version 2024.1.0, using the OVModelForCausalLM library with INT4 weight compression for the lowest memory footprint. To convert the model to OpenVINO, follow instructions at: https://huggingface.co/docs/optimum/main/en/intel/installation
togethercomputer/Pythia-Chat-Base-7B
Text Generation • Updated • 916 • 66Note This model was tested with OpenVINO version 2024.1.0, using the OVModelForCausalLM library with INT4 weight compression for the lowest memory footprint. To convert the model to OpenVINO, follow instructions at: https://huggingface.co/docs/optimum/main/en/intel/installation
togethercomputer/RedPajama-INCITE-7B-Base
Text Generation • Updated • 1.19k • 93Note This model was tested with OpenVINO version 2024.1.0, using the OVModelForCausalLM library with INT4 weight compression for the lowest memory footprint. To convert the model to OpenVINO, follow instructions at: https://huggingface.co/docs/optimum/main/en/intel/installation
togethercomputer/RedPajama-INCITE-7B-Chat
Text Generation • Updated • 862 • 92Note This model was tested with OpenVINO version 2024.1.0, using the OVModelForCausalLM library with INT4 weight compression for the lowest memory footprint. To convert the model to OpenVINO, follow instructions at: https://huggingface.co/docs/optimum/main/en/intel/installation
togethercomputer/RedPajama-INCITE-7B-Instruct
Text Generation • Updated • 763 • 104Note This model was tested with OpenVINO version 2024.1.0, using the OVModelForCausalLM library with INT4 weight compression for the lowest memory footprint. To convert the model to OpenVINO, follow instructions at: https://huggingface.co/docs/optimum/main/en/intel/installation
togethercomputer/RedPajama-INCITE-Chat-3B-v1
Text Generation • Updated • 2.48k • 149Note This model was tested with OpenVINO version 2024.1.0, using the OVModelForCausalLM library with INT4 weight compression for the lowest memory footprint. To convert the model to OpenVINO, follow instructions at: https://huggingface.co/docs/optimum/main/en/intel/installation
xverse/XVERSE-7B-Chat
Text Generation • Updated • 33 • 8Note This model was tested with OpenVINO version 2024.1.0, using the OVModelForCausalLM library with INT4 weight compression for the lowest memory footprint. To convert the model to OpenVINO, follow instructions at: https://huggingface.co/docs/optimum/main/en/intel/installation