AI PC: Text Generation
Text generation LLMs that have been validated to run on the AI PC Intel® Core™ Ultra CPU and iGPU.
- Text Generation • Updated • 19 • 2
OpenVINO/mixtral-8x7b-instruct-v0.1-int4-ov
Text Generation • Updated • 46 • 3OpenVINO/phi-2-fp16-ov
Text Generation • Updated • 36 • 1OpenVINO/phi-2-int8-ov
Text Generation • Updated • 43OpenVINO/phi-2-int4-ov
Text Generation • Updated • 62 • 1OpenVINO/mistral-7b-instruct-v0.1-fp16-ov
Text Generation • Updated • 25OpenVINO/mistral-7b-instruct-v0.1-int8-ov
Text Generation • Updated • 778 • 1OpenVINO/mistral-7b-instruct-v0.1-int4-ov
Text Generation • Updated • 456OpenVINO/starcoder2-15b-fp16-ov
Text Generation • Updated • 19OpenVINO/starcoder2-15b-int8-ov
Text Generation • Updated • 14OpenVINO/starcoder2-15b-int4-ov
Text Generation • Updated • 26OpenVINO/neural-chat-7b-v3-3-fp16-ov
Text Generation • Updated • 39OpenVINO/neural-chat-7b-v3-3-int8-ov
Text Generation • Updated • 41OpenVINO/neural-chat-7b-v3-3-int4-ov
Text Generation • Updated • 36OpenVINO/mpt-7b-fp16-ov
Text Generation • Updated • 17OpenVINO/mpt-7b-int8-ov
Text Generation • Updated • 28OpenVINO/mpt-7b-int4-ov
Text Generation • Updated • 10OpenVINO/Phi-3-mini-128k-instruct-fp16-ov
Text Generation • Updated • 29OpenVINO/Phi-3-mini-128k-instruct-int8-ov
Text Generation • Updated • 24 • 2OpenVINO/Phi-3-mini-128k-instruct-int4-ov
Text Generation • Updated • 641 • 2OpenVINO/falcon-7b-instruct-fp16-ov
Text Generation • Updated • 13OpenVINO/falcon-7b-instruct-int8-ov
Text Generation • Updated • 19OpenVINO/falcon-7b-instruct-int4-ov
Text Generation • Updated • 21OpenVINO/open_llama_3b_v2-fp16-ov
Text Generation • Updated • 46OpenVINO/open_llama_3b_v2-int8-ov
Text Generation • Updated • 443 • 1OpenVINO/open_llama_3b_v2-int4-ov
Text Generation • Updated • 55OpenVINO/open_llama_7b_v2-fp16-ov
Text Generation • Updated • 26OpenVINO/open_llama_7b_v2-int8-ov
Text Generation • Updated • 20OpenVINO/open_llama_7b_v2-int4-ov
Text Generation • Updated • 22OpenVINO/gpt-j-6b-fp16-ov
Text Generation • Updated • 22OpenVINO/gpt-j-6b-int8-ov
Text Generation • Updated • 41OpenVINO/gpt-j-6b-int4-ov
Text Generation • Updated • 23OpenVINO/RedPajama-INCITE-7B-Chat-fp16-ov
Text Generation • Updated • 10OpenVINO/RedPajama-INCITE-7B-Chat-int8-ov
Text Generation • Updated • 16OpenVINO/RedPajama-INCITE-7B-Chat-int4-ov
Text Generation • Updated • 25OpenVINO/RedPajama-INCITE-7B-Instruct-fp16-ov
Text Generation • Updated • 21OpenVINO/RedPajama-INCITE-7B-Instruct-int8-ov
Text Generation • Updated • 16OpenVINO/RedPajama-INCITE-7B-Instruct-int4-ov
Text Generation • Updated • 22OpenVINO/dolly-v2-7b-fp16-ov
Text Generation • Updated • 17OpenVINO/dolly-v2-7b-int8-ov
Text Generation • Updated • 16OpenVINO/dolly-v2-7b-int4-ov
Text Generation • Updated • 18OpenVINO/Mistral-7B-Instruct-v0.2-fp16-ov
Text Generation • Updated • 18OpenVINO/Mistral-7B-Instruct-v0.2-int8-ov
Text Generation • Updated • 437 • 1OpenVINO/Mistral-7B-Instruct-v0.2-int4-ov
Text Generation • Updated • 547 • 1OpenVINO/Phi-3-medium-4k-instruct-fp16-ov
Text Generation • Updated • 26OpenVINO/Phi-3-medium-4k-instruct-int8-ov
Text Generation • Updated • 32OpenVINO/Phi-3-medium-4k-instruct-int4-ov
Text Generation • Updated • 430 • 3OpenVINO/pythia-1.4b-fp16-ov
Text Generation • Updated • 15OpenVINO/pythia-1.4b-int8-ov
Text Generation • Updated • 11OpenVINO/pythia-1.4b-int4-ov
Text Generation • Updated • 20OpenVINO/pythia-2.8b-fp16-ov
Text Generation • Updated • 21OpenVINO/pythia-2.8b-int8-ov
Text Generation • Updated • 12OpenVINO/pythia-2.8b-int4-ov
Text Generation • Updated • 22OpenVINO/pythia-6.9b-fp16-ov
Text Generation • Updated • 14OpenVINO/pythia-6.9b-int8-ov
Text Generation • Updated • 16OpenVINO/pythia-6.9b-int4-ov
Text Generation • Updated • 15OpenVINO/pythia-1b-fp16-ov
Text Generation • Updated • 16OpenVINO/pythia-1b-int8-ov
Text Generation • Updated • 11OpenVINO/pythia-1b-int4-ov
Text Generation • Updated • 15OpenVINO/neural-chat-7b-v1-1-fp16-ov
Text Generation • Updated • 15OpenVINO/neural-chat-7b-v1-1-int8-ov
Text Generation • Updated • 17OpenVINO/neural-chat-7b-v1-1-int4-ov
Text Generation • Updated • 52OpenVINO/persimmon-8b-chat-int4-ov
Text Generation • Updated • 25OpenVINO/persimmon-8b-chat-fp16-ov
Text Generation • Updated • 15OpenVINO/persimmon-8b-chat-int8-ov
Text Generation • Updated • 18
AhmedSSoliman/MarianCausalLM
Text Generation • Updated • 21Note This model was tested with OpenVINO version 2024.1.0, using the OVModelForCausalLM library with INT4 weight compression for the lowest memory footprint. To convert the model to OpenVINO, follow instructions at: https://huggingface.co/docs/optimum/main/en/intel/installation
AurelPx/Pegasus-7b-slerp
Text Generation • Updated • 75 • 1Note This model was tested with OpenVINO version 2024.1.0, using the OVModelForCausalLM library with INT4 weight compression for the lowest memory footprint. To convert the model to OpenVINO, follow instructions at: https://huggingface.co/docs/optimum/main/en/intel/installation
BAAI/Aquila-7B
Updated • 493 • 17Note This model was tested with OpenVINO version 2024.1.0, using the OVModelForCausalLM library with INT4 weight compression for the lowest memory footprint. To convert the model to OpenVINO, follow instructions at: https://huggingface.co/docs/optimum/main/en/intel/installation
BAAI/Aquila2-7B
Text Generation • Updated • 789 • 6Note This model was tested with OpenVINO version 2024.1.0, using the OVModelForCausalLM library with INT4 weight compression for the lowest memory footprint. To convert the model to OpenVINO, follow instructions at: https://huggingface.co/docs/optimum/main/en/intel/installation
BAAI/AquilaChat-7B
Updated • 288 • 48Note This model was tested with OpenVINO version 2024.1.0, using the OVModelForCausalLM library with INT4 weight compression for the lowest memory footprint. To convert the model to OpenVINO, follow instructions at: https://huggingface.co/docs/optimum/main/en/intel/installation
BAAI/AquilaChat2-7B
Text Generation • Updated • 812 • 15Note This model was tested with OpenVINO version 2024.1.0, using the OVModelForCausalLM library with INT4 weight compression for the lowest memory footprint. To convert the model to OpenVINO, follow instructions at: https://huggingface.co/docs/optimum/main/en/intel/installation
BigSalmon/GPT2Neo1.3BPoints
Text Generation • Updated • 22Note This model was tested with OpenVINO version 2024.1.0, using the OVModelForCausalLM library with INT4 weight compression for the lowest memory footprint. To convert the model to OpenVINO, follow instructions at: https://huggingface.co/docs/optimum/main/en/intel/installation
EleutherAI/pythia-1.4b
Text Generation • Updated • 31.4k • 22Note This model was tested with OpenVINO version 2024.1.0, using the OVModelForCausalLM library with INT4 weight compression for the lowest memory footprint. To convert the model to OpenVINO, follow instructions at: https://huggingface.co/docs/optimum/main/en/intel/installation
EleutherAI/pythia-12b
Text Generation • Updated • 80.5k • 131Note This model was tested with OpenVINO version 2024.1.0, using the OVModelForCausalLM library with INT4 weight compression for the lowest memory footprint. To convert the model to OpenVINO, follow instructions at: https://huggingface.co/docs/optimum/main/en/intel/installation
EleutherAI/pythia-14m
Text Generation • Updated • 430k • 18Note This model was tested with OpenVINO version 2024.1.0, using the OVModelForCausalLM library with INT4 weight compression for the lowest memory footprint. To convert the model to OpenVINO, follow instructions at: https://huggingface.co/docs/optimum/main/en/intel/installation
EleutherAI/pythia-160m
Text Generation • Updated • 97.3k • 25Note This model was tested with OpenVINO version 2024.1.0, using the OVModelForCausalLM library with INT4 weight compression for the lowest memory footprint. To convert the model to OpenVINO, follow instructions at: https://huggingface.co/docs/optimum/main/en/intel/installation
EleutherAI/pythia-1b
Text Generation • Updated • 31.9k • 32Note This model was tested with OpenVINO version 2024.1.0, using the OVModelForCausalLM library with INT4 weight compression for the lowest memory footprint. To convert the model to OpenVINO, follow instructions at: https://huggingface.co/docs/optimum/main/en/intel/installation
EleutherAI/pythia-2.8b
Text Generation • Updated • 23.3k • 28Note This model was tested with OpenVINO version 2024.1.0, using the OVModelForCausalLM library with INT4 weight compression for the lowest memory footprint. To convert the model to OpenVINO, follow instructions at: https://huggingface.co/docs/optimum/main/en/intel/installation
EleutherAI/pythia-410m
Text Generation • Updated • 31.5k • 20Note This model was tested with OpenVINO version 2024.1.0, using the OVModelForCausalLM library with INT4 weight compression for the lowest memory footprint. To convert the model to OpenVINO, follow instructions at: https://huggingface.co/docs/optimum/main/en/intel/installation
EleutherAI/pythia-6.9b
Text Generation • Updated • 32.2k • 46Note This model was tested with OpenVINO version 2024.1.0, using the OVModelForCausalLM library with INT4 weight compression for the lowest memory footprint. To convert the model to OpenVINO, follow instructions at: https://huggingface.co/docs/optimum/main/en/intel/installation
EleutherAI/pythia-70m
Updated • 89.5k • 55Note This model was tested with OpenVINO version 2024.1.0, using the OVModelForCausalLM library with INT4 weight compression for the lowest memory footprint. To convert the model to OpenVINO, follow instructions at: https://huggingface.co/docs/optimum/main/en/intel/installation
HuggingFaceH4/zephyr-7b-beta
Text Generation • Updated • 879k • • 1.6kNote This model was tested with OpenVINO version 2024.1.0, using the OVModelForCausalLM library with INT4 weight compression for the lowest memory footprint. To convert the model to OpenVINO, follow instructions at: https://huggingface.co/docs/optimum/main/en/intel/installation
Intel/neural-chat-7b-v1-1
Text Generation • Updated • 37 • 23Note This model was tested with OpenVINO version 2024.1.0, using the OVModelForCausalLM library with INT4 weight compression for the lowest memory footprint. To convert the model to OpenVINO, follow instructions at: https://huggingface.co/docs/optimum/main/en/intel/installation
Intel/neural-chat-7b-v3-3
Text Generation • Updated • 53.3k • 75Note This model was tested with OpenVINO version 2024.1.0, using the OVModelForCausalLM library with INT4 weight compression for the lowest memory footprint. To convert the model to OpenVINO, follow instructions at: https://huggingface.co/docs/optimum/main/en/intel/installation
Qwen/CodeQwen1.5-7B-Chat
Text Generation • Updated • 72.4k • 310Note This model was tested with OpenVINO version 2024.1.0, using the OVModelForCausalLM library with INT4 weight compression for the lowest memory footprint. To convert the model to OpenVINO, follow instructions at: https://huggingface.co/docs/optimum/main/en/intel/installation
Qwen/Qwen-1_8B
Text Generation • Updated • 3.29k • 61Note This model was tested with OpenVINO version 2024.1.0, using the OVModelForCausalLM library with INT4 weight compression for the lowest memory footprint. To convert the model to OpenVINO, follow instructions at: https://huggingface.co/docs/optimum/main/en/intel/installation
Qwen/Qwen-1_8B-Chat
Text Generation • Updated • 58.5k • 108Note This model was tested with OpenVINO version 2024.1.0, using the OVModelForCausalLM library with INT4 weight compression for the lowest memory footprint. To convert the model to OpenVINO, follow instructions at: https://huggingface.co/docs/optimum/main/en/intel/installation
Qwen/Qwen-7B
Text Generation • Updated • 23.2k • 368Note This model was tested with OpenVINO version 2024.1.0, using the OVModelForCausalLM library with INT4 weight compression for the lowest memory footprint. To convert the model to OpenVINO, follow instructions at: https://huggingface.co/docs/optimum/main/en/intel/installation
Qwen/Qwen-7B-Chat
Text Generation • Updated • 59.2k • 751Note This model was tested with OpenVINO version 2024.1.0, using the OVModelForCausalLM library with INT4 weight compression for the lowest memory footprint. To convert the model to OpenVINO, follow instructions at: https://huggingface.co/docs/optimum/main/en/intel/installation
Qwen/Qwen1.5-0.5B
Text Generation • Updated • 354k • 143Note This model was tested with OpenVINO version 2024.1.0, using the OVModelForCausalLM library with INT4 weight compression for the lowest memory footprint. To convert the model to OpenVINO, follow instructions at: https://huggingface.co/docs/optimum/main/en/intel/installation
Qwen/Qwen1.5-0.5B-Chat
Text Generation • Updated • 356k • 74Note This model was tested with OpenVINO version 2024.1.0, using the OVModelForCausalLM library with INT4 weight compression for the lowest memory footprint. To convert the model to OpenVINO, follow instructions at: https://huggingface.co/docs/optimum/main/en/intel/installation
Qwen/Qwen1.5-1.8B
Text Generation • Updated • 334k • 43Note This model was tested with OpenVINO version 2024.1.0, using the OVModelForCausalLM library with INT4 weight compression for the lowest memory footprint. To convert the model to OpenVINO, follow instructions at: https://huggingface.co/docs/optimum/main/en/intel/installation
Qwen/Qwen1.5-1.8B-Chat
Text Generation • Updated • 12.4k • 45Note This model was tested with OpenVINO version 2024.1.0, using the OVModelForCausalLM library with INT4 weight compression for the lowest memory footprint. To convert the model to OpenVINO, follow instructions at: https://huggingface.co/docs/optimum/main/en/intel/installation
Qwen/Qwen1.5-4B
Text Generation • Updated • 10.9k • 33Note This model was tested with OpenVINO version 2024.1.0, using the OVModelForCausalLM library with INT4 weight compression for the lowest memory footprint. To convert the model to OpenVINO, follow instructions at: https://huggingface.co/docs/optimum/main/en/intel/installation
Qwen/Qwen1.5-4B-Chat
Text Generation • Updated • 6.08k • 37Note This model was tested with OpenVINO version 2024.1.0, using the OVModelForCausalLM library with INT4 weight compression for the lowest memory footprint. To convert the model to OpenVINO, follow instructions at: https://huggingface.co/docs/optimum/main/en/intel/installation
Qwen/Qwen1.5-7B
Text Generation • Updated • 189k • 45Note This model was tested with OpenVINO version 2024.1.0, using the OVModelForCausalLM library with INT4 weight compression for the lowest memory footprint. To convert the model to OpenVINO, follow instructions at: https://huggingface.co/docs/optimum/main/en/intel/installation
Qwen/Qwen1.5-7B-Chat
Text Generation • Updated • 30.7k • 162Note This model was tested with OpenVINO version 2024.1.0, using the OVModelForCausalLM library with INT4 weight compression for the lowest memory footprint. To convert the model to OpenVINO, follow instructions at: https://huggingface.co/docs/optimum/main/en/intel/installation
Salesforce/codegen-2B-multi
Text Generation • Updated • 10.9k • 34Note This model was tested with OpenVINO version 2024.1.0, using the OVModelForCausalLM library with INT4 weight compression for the lowest memory footprint. To convert the model to OpenVINO, follow instructions at: https://huggingface.co/docs/optimum/main/en/intel/installation
Salesforce/codegen-350M-mono
Text Generation • Updated • 13.1k • 86Note This model was tested with OpenVINO version 2024.1.0, using the OVModelForCausalLM library with INT4 weight compression for the lowest memory footprint. To convert the model to OpenVINO, follow instructions at: https://huggingface.co/docs/optimum/main/en/intel/installation
Salesforce/codegen-6B-multi
Text Generation • Updated • 4.4k • 19Note This model was tested with OpenVINO version 2024.1.0, using the OVModelForCausalLM library with INT4 weight compression for the lowest memory footprint. To convert the model to OpenVINO, follow instructions at: https://huggingface.co/docs/optimum/main/en/intel/installation
Salesforce/codegen2-1B_P
Text Generation • Updated • 3.85k • 38Note This model was tested with OpenVINO version 2024.1.0, using the OVModelForCausalLM library with INT4 weight compression for the lowest memory footprint. To convert the model to OpenVINO, follow instructions at: https://huggingface.co/docs/optimum/main/en/intel/installation
Salesforce/codegen2-3_7B_P
Text Generation • Updated • 176 • 15Note This model was tested with OpenVINO version 2024.1.0, using the OVModelForCausalLM library with INT4 weight compression for the lowest memory footprint. To convert the model to OpenVINO, follow instructions at: https://huggingface.co/docs/optimum/main/en/intel/installation
Salesforce/codegen2-7B_P
Text Generation • Updated • 313 • 26Note This model was tested with OpenVINO version 2024.1.0, using the OVModelForCausalLM library with INT4 weight compression for the lowest memory footprint. To convert the model to OpenVINO, follow instructions at: https://huggingface.co/docs/optimum/main/en/intel/installation
WizardLMTeam/WizardMath-7B-V1.1
Text Generation • Updated • 19.8k • 75Note This model was tested with OpenVINO version 2024.1.0, using the OVModelForCausalLM library with INT4 weight compression for the lowest memory footprint. To convert the model to OpenVINO, follow instructions at: https://huggingface.co/docs/optimum/main/en/intel/installation
X-D-Lab/MindChat-Qwen2-4B
Text Generation • Updated • 19 • 4Note This model was tested with OpenVINO version 2024.1.0, using the OVModelForCausalLM library with INT4 weight compression for the lowest memory footprint. To convert the model to OpenVINO, follow instructions at: https://huggingface.co/docs/optimum/main/en/intel/installation
adept/persimmon-8b-chat
Text Generation • Updated • 1.24k • 42Note This model was tested with OpenVINO version 2024.1.0, using the OVModelForCausalLM library with INT4 weight compression for the lowest memory footprint. To convert the model to OpenVINO, follow instructions at: https://huggingface.co/docs/optimum/main/en/intel/installation
baichuan-inc/Baichuan2-13B-Chat
Text Generation • Updated • 63.6k • 421Note This model was tested with OpenVINO version 2024.1.0, using the OVModelForCausalLM library with INT4 weight compression for the lowest memory footprint. To convert the model to OpenVINO, follow instructions at: https://huggingface.co/docs/optimum/main/en/intel/installation
baichuan-inc/Baichuan2-7B-Base
Text Generation • Updated • 1.62k • 77Note This model was tested with OpenVINO version 2024.1.0, using the OVModelForCausalLM library with INT4 weight compression for the lowest memory footprint. To convert the model to OpenVINO, follow instructions at: https://huggingface.co/docs/optimum/main/en/intel/installation
baichuan-inc/Baichuan2-7B-Chat
Text Generation • Updated • 20.3k • 158Note This model was tested with OpenVINO version 2024.1.0, using the OVModelForCausalLM library with INT4 weight compression for the lowest memory footprint. To convert the model to OpenVINO, follow instructions at: https://huggingface.co/docs/optimum/main/en/intel/installation
bigscience/bloom-560m
Text Generation • Updated • 216k • 346Note This model was tested with OpenVINO version 2024.1.0, using the OVModelForCausalLM library with INT4 weight compression for the lowest memory footprint. To convert the model to OpenVINO, follow instructions at: https://huggingface.co/docs/optimum/main/en/intel/installation
bigscience/bloomz-1b1
Text Generation • Updated • 3.89k • 32Note This model was tested with OpenVINO version 2024.1.0, using the OVModelForCausalLM library with INT4 weight compression for the lowest memory footprint. To convert the model to OpenVINO, follow instructions at: https://huggingface.co/docs/optimum/main/en/intel/installation
bigscience/bloomz-3b
Text Generation • Updated • 10.6k • 77Note This model was tested with OpenVINO version 2024.1.0, using the OVModelForCausalLM library with INT4 weight compression for the lowest memory footprint. To convert the model to OpenVINO, follow instructions at: https://huggingface.co/docs/optimum/main/en/intel/installation
bigscience/bloomz-7b1-mt
Text Generation • Updated • 2.93k • 140Note This model was tested with OpenVINO version 2024.1.0, using the OVModelForCausalLM library with INT4 weight compression for the lowest memory footprint. To convert the model to OpenVINO, follow instructions at: https://huggingface.co/docs/optimum/main/en/intel/installation
facebook/opt-1.3b
Text Generation • Updated • 103k • 149Note This model was tested with OpenVINO version 2024.1.0, using the OVModelForCausalLM library with INT4 weight compression for the lowest memory footprint. To convert the model to OpenVINO, follow instructions at: https://huggingface.co/docs/optimum/main/en/intel/installation
facebook/opt-125m
Text Generation • Updated • 6.85M • 162Note This model was tested with OpenVINO version 2024.1.0, using the OVModelForCausalLM library with INT4 weight compression for the lowest memory footprint. To convert the model to OpenVINO, follow instructions at: https://huggingface.co/docs/optimum/main/en/intel/installation
facebook/opt-13b
Text Generation • Updated • 20.9k • 65Note This model was tested with OpenVINO version 2024.1.0, using the OVModelForCausalLM library with INT4 weight compression for the lowest memory footprint. To convert the model to OpenVINO, follow instructions at: https://huggingface.co/docs/optimum/main/en/intel/installation
facebook/opt-2.7b
Text Generation • Updated • 30.5k • 80Note This model was tested with OpenVINO version 2024.1.0, using the OVModelForCausalLM library with INT4 weight compression for the lowest memory footprint. To convert the model to OpenVINO, follow instructions at: https://huggingface.co/docs/optimum/main/en/intel/installation
facebook/opt-350m
Text Generation • Updated • 220k • 129Note This model was tested with OpenVINO version 2024.1.0, using the OVModelForCausalLM library with INT4 weight compression for the lowest memory footprint. To convert the model to OpenVINO, follow instructions at: https://huggingface.co/docs/optimum/main/en/intel/installation
facebook/opt-6.7b
Text Generation • Updated • 146k • 109Note This model was tested with OpenVINO version 2024.1.0, using the OVModelForCausalLM library with INT4 weight compression for the lowest memory footprint. To convert the model to OpenVINO, follow instructions at: https://huggingface.co/docs/optimum/main/en/intel/installation
facebook/opt-iml-1.3b
Text Generation • Updated • 1.02k • 29Note This model was tested with OpenVINO version 2024.1.0, using the OVModelForCausalLM library with INT4 weight compression for the lowest memory footprint. To convert the model to OpenVINO, follow instructions at: https://huggingface.co/docs/optimum/main/en/intel/installation
google/codegemma-1.1-2b
Text Generation • Updated • 61 • 17Note This model was tested with OpenVINO version 2024.1.0, using the OVModelForCausalLM library with INT4 weight compression for the lowest memory footprint. To convert the model to OpenVINO, follow instructions at: https://huggingface.co/docs/optimum/main/en/intel/installation
google/codegemma-1.1-7b-it
Text Generation • Updated • 193 • 49Note This model was tested with OpenVINO version 2024.1.0, using the OVModelForCausalLM library with INT4 weight compression for the lowest memory footprint. To convert the model to OpenVINO, follow instructions at: https://huggingface.co/docs/optimum/main/en/intel/installation
google/codegemma-2b
Text Generation • Updated • 6.22k • 72Note This model was tested with OpenVINO version 2024.1.0, using the OVModelForCausalLM library with INT4 weight compression for the lowest memory footprint. To convert the model to OpenVINO, follow instructions at: https://huggingface.co/docs/optimum/main/en/intel/installation
google/codegemma-7b
Text Generation • Updated • 4.23k • 163Note This model was tested with OpenVINO version 2024.1.0, using the OVModelForCausalLM library with INT4 weight compression for the lowest memory footprint. To convert the model to OpenVINO, follow instructions at: https://huggingface.co/docs/optimum/main/en/intel/installation
google/gemma-1.1-2b-it
Text Generation • Updated • 81.7k • 149Note This model was tested with OpenVINO version 2024.1.0, using the OVModelForCausalLM library with INT4 weight compression for the lowest memory footprint. To convert the model to OpenVINO, follow instructions at: https://huggingface.co/docs/optimum/main/en/intel/installation
google/gemma-1.1-7b-it
Text Generation • Updated • 16.4k • • 263Note This model was tested with OpenVINO version 2024.1.0, using the OVModelForCausalLM library with INT4 weight compression for the lowest memory footprint. To convert the model to OpenVINO, follow instructions at: https://huggingface.co/docs/optimum/main/en/intel/installation
google/gemma-2b
Text Generation • Updated • 525k • 905Note This model was tested with OpenVINO version 2024.1.0, using the OVModelForCausalLM library with INT4 weight compression for the lowest memory footprint. To convert the model to OpenVINO, follow instructions at: https://huggingface.co/docs/optimum/main/en/intel/installation
google/gemma-2b-it
Text Generation • Updated • 92.7k • 670Note This model was tested with OpenVINO version 2024.1.0, using the OVModelForCausalLM library with INT4 weight compression for the lowest memory footprint. To convert the model to OpenVINO, follow instructions at: https://huggingface.co/docs/optimum/main/en/intel/installation
google/gemma-7b
Text Generation • Updated • 340k • • 3.05kNote This model was tested with OpenVINO version 2024.1.0, using the OVModelForCausalLM library with INT4 weight compression for the lowest memory footprint. To convert the model to OpenVINO, follow instructions at: https://huggingface.co/docs/optimum/main/en/intel/installation
google/gemma-7b-it
Text Generation • Updated • 108k • 1.14kNote This model was tested with OpenVINO version 2024.1.0, using the OVModelForCausalLM library with INT4 weight compression for the lowest memory footprint. To convert the model to OpenVINO, follow instructions at: https://huggingface.co/docs/optimum/main/en/intel/installation
ibm-granite/granite-3b-code-base-2k
Text Generation • Updated • 60.8k • 35Note This model was tested with OpenVINO version 2024.1.0, using the OVModelForCausalLM library with INT4 weight compression for the lowest memory footprint. To convert the model to OpenVINO, follow instructions at: https://huggingface.co/docs/optimum/main/en/intel/installation
ibm-granite/granite-3b-code-instruct-2k
Text Generation • Updated • 12.3k • 31Note This model was tested with OpenVINO version 2024.1.0, using the OVModelForCausalLM library with INT4 weight compression for the lowest memory footprint. To convert the model to OpenVINO, follow instructions at: https://huggingface.co/docs/optimum/main/en/intel/installation
ibm-granite/granite-8b-code-base-4k
Text Generation • Updated • 6.54k • 29Note This model was tested with OpenVINO version 2024.1.0, using the OVModelForCausalLM library with INT4 weight compression for the lowest memory footprint. To convert the model to OpenVINO, follow instructions at: https://huggingface.co/docs/optimum/main/en/intel/installation
ibm-granite/granite-8b-code-instruct-4k
Text Generation • Updated • 8.68k • 108Note This model was tested with OpenVINO version 2024.1.0, using the OVModelForCausalLM library with INT4 weight compression for the lowest memory footprint. To convert the model to OpenVINO, follow instructions at: https://huggingface.co/docs/optimum/main/en/intel/installation
internlm/internlm2-1_8b
Text Generation • Updated • 15.8k • 28Note This model was tested with OpenVINO version 2024.1.0, using the OVModelForCausalLM library with INT4 weight compression for the lowest memory footprint. To convert the model to OpenVINO, follow instructions at: https://huggingface.co/docs/optimum/main/en/intel/installation
internlm/internlm2-7b
Text Generation • Updated • 13k • 40Note This model was tested with OpenVINO version 2024.1.0, using the OVModelForCausalLM library with INT4 weight compression for the lowest memory footprint. To convert the model to OpenVINO, follow instructions at: https://huggingface.co/docs/optimum/main/en/intel/installation
internlm/internlm2-chat-1_8b
Text Generation • Updated • 9.36k • 29Note This model was tested with OpenVINO version 2024.1.0, using the OVModelForCausalLM library with INT4 weight compression for the lowest memory footprint. To convert the model to OpenVINO, follow instructions at: https://huggingface.co/docs/optimum/main/en/intel/installation
internlm/internlm2-chat-7b
Text Generation • Updated • 14.6k • 82Note This model was tested with OpenVINO version 2024.1.0, using the OVModelForCausalLM library with INT4 weight compression for the lowest memory footprint. To convert the model to OpenVINO, follow instructions at: https://huggingface.co/docs/optimum/main/en/intel/installation
internlm/internlm2-chat-7b-sft
Text Generation • Updated • 8.53k • 6Note This model was tested with OpenVINO version 2024.1.0, using the OVModelForCausalLM library with INT4 weight compression for the lowest memory footprint. To convert the model to OpenVINO, follow instructions at: https://huggingface.co/docs/optimum/main/en/intel/installation
internlm/internlm2-math-7b
Text Generation • Updated • 258 • 27Note This model was tested with OpenVINO version 2024.1.0, using the OVModelForCausalLM library with INT4 weight compression for the lowest memory footprint. To convert the model to OpenVINO, follow instructions at: https://huggingface.co/docs/optimum/main/en/intel/installation
internlm/internlm2-math-base-7b
Text Generation • Updated • 510 • 2Note This model was tested with OpenVINO version 2024.1.0, using the OVModelForCausalLM library with INT4 weight compression for the lowest memory footprint. To convert the model to OpenVINO, follow instructions at: https://huggingface.co/docs/optimum/main/en/intel/installation
ise-uiuc/Magicoder-CL-7B
Text Generation • Updated • 92 • 21Note This model was tested with OpenVINO version 2024.1.0, using the OVModelForCausalLM library with INT4 weight compression for the lowest memory footprint. To convert the model to OpenVINO, follow instructions at: https://huggingface.co/docs/optimum/main/en/intel/installation
ise-uiuc/Magicoder-DS-6.7B
Text Generation • Updated • 713 • 37Note This model was tested with OpenVINO version 2024.1.0, using the OVModelForCausalLM library with INT4 weight compression for the lowest memory footprint. To convert the model to OpenVINO, follow instructions at: https://huggingface.co/docs/optimum/main/en/intel/installation
ise-uiuc/Magicoder-S-CL-7B
Text Generation • Updated • 1.91k • 44Note This model was tested with OpenVINO version 2024.1.0, using the OVModelForCausalLM library with INT4 weight compression for the lowest memory footprint. To convert the model to OpenVINO, follow instructions at: https://huggingface.co/docs/optimum/main/en/intel/installation
ise-uiuc/Magicoder-S-DS-6.7B
Text Generation • Updated • 3.37k • 200Note This model was tested with OpenVINO version 2024.1.0, using the OVModelForCausalLM library with INT4 weight compression for the lowest memory footprint. To convert the model to OpenVINO, follow instructions at: https://huggingface.co/docs/optimum/main/en/intel/installation
meta-llama/Llama-2-13b-chat-hf
Text Generation • Updated • 955k • 1.02kNote This model was tested with OpenVINO version 2024.1.0, using the OVModelForCausalLM library with INT4 weight compression for the lowest memory footprint. To convert the model to OpenVINO, follow instructions at: https://huggingface.co/docs/optimum/main/en/intel/installation
meta-llama/Llama-2-13b-hf
Text Generation • Updated • 209k • 572Note This model was tested with OpenVINO version 2024.1.0, using the OVModelForCausalLM library with INT4 weight compression for the lowest memory footprint. To convert the model to OpenVINO, follow instructions at: https://huggingface.co/docs/optimum/main/en/intel/installation
meta-llama/Llama-2-7b-chat-hf
Text Generation • Updated • 836k • • 3.95kNote This model was tested with OpenVINO version 2024.1.0, using the OVModelForCausalLM library with INT4 weight compression for the lowest memory footprint. To convert the model to OpenVINO, follow instructions at: https://huggingface.co/docs/optimum/main/en/intel/installation
meta-llama/Llama-2-7b-hf
Text Generation • Updated • 1.21M • 1.77kNote This model was tested with OpenVINO version 2024.1.0, using the OVModelForCausalLM library with INT4 weight compression for the lowest memory footprint. To convert the model to OpenVINO, follow instructions at: https://huggingface.co/docs/optimum/main/en/intel/installation
meta-llama/Meta-Llama-3-8B
Text Generation • Updated • 787k • 5.8kNote This model was tested with OpenVINO version 2024.1.0, using the OVModelForCausalLM library with INT4 weight compression for the lowest memory footprint. To convert the model to OpenVINO, follow instructions at: https://huggingface.co/docs/optimum/main/en/intel/installation
meta-llama/Meta-Llama-3-8B-Instruct
Text Generation • Updated • 2.04M • • 3.57kNote This model was tested with OpenVINO version 2024.1.0, using the OVModelForCausalLM library with INT4 weight compression for the lowest memory footprint. To convert the model to OpenVINO, follow instructions at: https://huggingface.co/docs/optimum/main/en/intel/installation
meta-llama/Meta-Llama-Guard-2-8B
Text Generation • Updated • 10.9k • 281Note This model was tested with OpenVINO version 2024.1.0, using the OVModelForCausalLM library with INT4 weight compression for the lowest memory footprint. To convert the model to OpenVINO, follow instructions at: https://huggingface.co/docs/optimum/main/en/intel/installation
microsoft/Phi-3-medium-4k-instruct
Text Generation • Updated • 46.1k • 211Note This model was tested with OpenVINO version 2024.1.0, using the OVModelForCausalLM library with INT4 weight compression for the lowest memory footprint. To convert the model to OpenVINO, follow instructions at: https://huggingface.co/docs/optimum/main/en/intel/installation
microsoft/Phi-3-mini-128k-instruct
Text Generation • Updated • 368k • 1.6kNote This model was tested with OpenVINO version 2024.1.0, using the OVModelForCausalLM library with INT4 weight compression for the lowest memory footprint. To convert the model to OpenVINO, follow instructions at: https://huggingface.co/docs/optimum/main/en/intel/installation
microsoft/phi-2
Text Generation • Updated • 268k • 3.24kNote This model was tested with OpenVINO version 2024.1.0, using the OVModelForCausalLM library with INT4 weight compression for the lowest memory footprint. To convert the model to OpenVINO, follow instructions at: https://huggingface.co/docs/optimum/main/en/intel/installation
mistralai/Mistral-7B-Instruct-v0.2
Text Generation • Updated • 1.05M • • 2.56kNote This model was tested with OpenVINO version 2024.1.0, using the OVModelForCausalLM library with INT4 weight compression for the lowest memory footprint. To convert the model to OpenVINO, follow instructions at: https://huggingface.co/docs/optimum/main/en/intel/installation
mistralai/Mistral-7B-Instruct-v0.3
Text Generation • Updated • 465k • • 1.1kNote This model was tested with OpenVINO version 2024.1.0, using the OVModelForCausalLM library with INT4 weight compression for the lowest memory footprint. To convert the model to OpenVINO, follow instructions at: https://huggingface.co/docs/optimum/main/en/intel/installation
mistralai/Mistral-7B-v0.3
Text Generation • Updated • 177k • 385Note This model was tested with OpenVINO version 2024.1.0, using the OVModelForCausalLM library with INT4 weight compression for the lowest memory footprint. To convert the model to OpenVINO, follow instructions at: https://huggingface.co/docs/optimum/main/en/intel/installation
mosaicml/mpt-7b
Text Generation • Updated • 41.1k • 1.16kNote This model was tested with OpenVINO version 2024.1.0, using the OVModelForCausalLM library with INT4 weight compression for the lowest memory footprint. To convert the model to OpenVINO, follow instructions at: https://huggingface.co/docs/optimum/main/en/intel/installation
mosaicml/mpt-7b-8k
Text Generation • Updated • 1.84k • 26Note This model was tested with OpenVINO version 2024.1.0, using the OVModelForCausalLM library with INT4 weight compression for the lowest memory footprint. To convert the model to OpenVINO, follow instructions at: https://huggingface.co/docs/optimum/main/en/intel/installation
mosaicml/mpt-7b-8k-chat
Text Generation • Updated • 1.36k • 40Note This model was tested with OpenVINO version 2024.1.0, using the OVModelForCausalLM library with INT4 weight compression for the lowest memory footprint. To convert the model to OpenVINO, follow instructions at: https://huggingface.co/docs/optimum/main/en/intel/installation
mosaicml/mpt-7b-chat
Text Generation • Updated • 6.58k • 512Note This model was tested with OpenVINO version 2024.1.0, using the OVModelForCausalLM library with INT4 weight compression for the lowest memory footprint. To convert the model to OpenVINO, follow instructions at: https://huggingface.co/docs/optimum/main/en/intel/installation
mosaicml/mpt-7b-instruct
Text Generation • Updated • 8.03k • 467Note This model was tested with OpenVINO version 2024.1.0, using the OVModelForCausalLM library with INT4 weight compression for the lowest memory footprint. To convert the model to OpenVINO, follow instructions at: https://huggingface.co/docs/optimum/main/en/intel/installation
mosaicml/mpt-7b-storywriter
Text Generation • Updated • 2.38k • 823Note This model was tested with OpenVINO version 2024.1.0, using the OVModelForCausalLM library with INT4 weight compression for the lowest memory footprint. To convert the model to OpenVINO, follow instructions at: https://huggingface.co/docs/optimum/main/en/intel/installation
openai-community/gpt2
Text Generation • Updated • 14.5M • • 2.34kNote This model was tested with OpenVINO version 2024.1.0, using the OVModelForCausalLM library with INT4 weight compression for the lowest memory footprint. To convert the model to OpenVINO, follow instructions at: https://huggingface.co/docs/optimum/main/en/intel/installation
openbmb/MiniCPM-2B-sft-bf16
Text Generation • Updated • 1.5k • 118Note This model was tested with OpenVINO version 2024.1.0, using the OVModelForCausalLM library with INT4 weight compression for the lowest memory footprint. To convert the model to OpenVINO, follow instructions at: https://huggingface.co/docs/optimum/main/en/intel/installation
openchat/openchat-3.6-8b-20240522
Text Generation • Updated • 15.4k • 149Note This model was tested with OpenVINO version 2024.1.0, using the OVModelForCausalLM library with INT4 weight compression for the lowest memory footprint. To convert the model to OpenVINO, follow instructions at: https://huggingface.co/docs/optimum/main/en/intel/installation
stabilityai/stablelm-2-12b
Text Generation • Updated • 1.02k • 115Note This model was tested with OpenVINO version 2024.1.0, using the OVModelForCausalLM library with INT4 weight compression for the lowest memory footprint. To convert the model to OpenVINO, follow instructions at: https://huggingface.co/docs/optimum/main/en/intel/installation
stabilityai/stablelm-2-12b-chat
Text Generation • Updated • 2.73k • 85Note This model was tested with OpenVINO version 2024.1.0, using the OVModelForCausalLM library with INT4 weight compression for the lowest memory footprint. To convert the model to OpenVINO, follow instructions at: https://huggingface.co/docs/optimum/main/en/intel/installation
stabilityai/stablelm-2-1_6b
Text Generation • Updated • 4.33k • 184Note This model was tested with OpenVINO version 2024.1.0, using the OVModelForCausalLM library with INT4 weight compression for the lowest memory footprint. To convert the model to OpenVINO, follow instructions at: https://huggingface.co/docs/optimum/main/en/intel/installation
stabilityai/stablelm-2-1_6b-chat
Text Generation • Updated • 5.63k • 31Note This model was tested with OpenVINO version 2024.1.0, using the OVModelForCausalLM library with INT4 weight compression for the lowest memory footprint. To convert the model to OpenVINO, follow instructions at: https://huggingface.co/docs/optimum/main/en/intel/installation
stabilityai/stablelm-2-zephyr-1_6b
Text Generation • Updated • 9.54k • 180Note This model was tested with OpenVINO version 2024.1.0, using the OVModelForCausalLM library with INT4 weight compression for the lowest memory footprint. To convert the model to OpenVINO, follow instructions at: https://huggingface.co/docs/optimum/main/en/intel/installation
stabilityai/stablelm-3b-4e1t
Text Generation • Updated • 16.2k • 309Note This model was tested with OpenVINO version 2024.1.0, using the OVModelForCausalLM library with INT4 weight compression for the lowest memory footprint. To convert the model to OpenVINO, follow instructions at: https://huggingface.co/docs/optimum/main/en/intel/installation
stabilityai/stablelm-base-alpha-3b
Text Generation • Updated • 2.07k • 82Note This model was tested with OpenVINO version 2024.1.0, using the OVModelForCausalLM library with INT4 weight compression for the lowest memory footprint. To convert the model to OpenVINO, follow instructions at: https://huggingface.co/docs/optimum/main/en/intel/installation
stabilityai/stablelm-tuned-alpha-7b
Text Generation • Updated • 3.23k • 357Note This model was tested with OpenVINO version 2024.1.0, using the OVModelForCausalLM library with INT4 weight compression for the lowest memory footprint. To convert the model to OpenVINO, follow instructions at: https://huggingface.co/docs/optimum/main/en/intel/installation
stabilityai/stablelm-zephyr-3b
Text Generation • Updated • 16.7k • 246Note This model was tested with OpenVINO version 2024.1.0, using the OVModelForCausalLM library with INT4 weight compression for the lowest memory footprint. To convert the model to OpenVINO, follow instructions at: https://huggingface.co/docs/optimum/main/en/intel/installation
stanford-crfm/BioMedLM
Text Generation • Updated • 1.99k • 394Note This model was tested with OpenVINO version 2024.1.0, using the OVModelForCausalLM library with INT4 weight compression for the lowest memory footprint. To convert the model to OpenVINO, follow instructions at: https://huggingface.co/docs/optimum/main/en/intel/installation
tiiuae/falcon-11B
Text Generation • Updated • 18.1k • 210Note This model was tested with OpenVINO version 2024.1.0, using the OVModelForCausalLM library with INT4 weight compression for the lowest memory footprint. To convert the model to OpenVINO, follow instructions at: https://huggingface.co/docs/optimum/main/en/intel/installation
tiiuae/falcon-7b
Text Generation • Updated • 102k • 1.08kNote This model was tested with OpenVINO version 2024.1.0, using the OVModelForCausalLM library with INT4 weight compression for the lowest memory footprint. To convert the model to OpenVINO, follow instructions at: https://huggingface.co/docs/optimum/main/en/intel/installation
tiiuae/falcon-7b-instruct
Text Generation • Updated • 166k • • 915Note This model was tested with OpenVINO version 2024.1.0, using the OVModelForCausalLM library with INT4 weight compression for the lowest memory footprint. To convert the model to OpenVINO, follow instructions at: https://huggingface.co/docs/optimum/main/en/intel/installation
togethercomputer/Pythia-Chat-Base-7B
Text Generation • Updated • 1.61k • 66Note This model was tested with OpenVINO version 2024.1.0, using the OVModelForCausalLM library with INT4 weight compression for the lowest memory footprint. To convert the model to OpenVINO, follow instructions at: https://huggingface.co/docs/optimum/main/en/intel/installation
togethercomputer/RedPajama-INCITE-7B-Base
Text Generation • Updated • 1.21k • 94Note This model was tested with OpenVINO version 2024.1.0, using the OVModelForCausalLM library with INT4 weight compression for the lowest memory footprint. To convert the model to OpenVINO, follow instructions at: https://huggingface.co/docs/optimum/main/en/intel/installation
togethercomputer/RedPajama-INCITE-7B-Chat
Text Generation • Updated • 1.71k • 92Note This model was tested with OpenVINO version 2024.1.0, using the OVModelForCausalLM library with INT4 weight compression for the lowest memory footprint. To convert the model to OpenVINO, follow instructions at: https://huggingface.co/docs/optimum/main/en/intel/installation
togethercomputer/RedPajama-INCITE-7B-Instruct
Text Generation • Updated • 1.64k • 104Note This model was tested with OpenVINO version 2024.1.0, using the OVModelForCausalLM library with INT4 weight compression for the lowest memory footprint. To convert the model to OpenVINO, follow instructions at: https://huggingface.co/docs/optimum/main/en/intel/installation
togethercomputer/RedPajama-INCITE-Chat-3B-v1
Text Generation • Updated • 3.47k • 152Note This model was tested with OpenVINO version 2024.1.0, using the OVModelForCausalLM library with INT4 weight compression for the lowest memory footprint. To convert the model to OpenVINO, follow instructions at: https://huggingface.co/docs/optimum/main/en/intel/installation
xverse/XVERSE-7B-Chat
Text Generation • Updated • 63 • 8Note This model was tested with OpenVINO version 2024.1.0, using the OVModelForCausalLM library with INT4 weight compression for the lowest memory footprint. To convert the model to OpenVINO, follow instructions at: https://huggingface.co/docs/optimum/main/en/intel/installation