FP8 KV Cache - a mohitsha Collection

Models
Datasets
Spaces
Posts
Docs
Pricing
Log In
Sign Up

mohitsha 's Collections

AMD RyzenAI Models

FP8 KV Cache

updated Jul 4

Models with FP8 KV Cache Scales

mohitsha/Llama-2-70b-chat-hf-FP8-KV

Text Generation • Updated Jun 25 • 13
mohitsha/Llama-2-7b-chat-hf-FP8-KV

Text Generation • Updated Jun 25 • 14
mohitsha/Llama-2-7b-chat-hf-FP8-KV-AMMO

Text Generation • Updated Jun 25 • 21
mohitsha/Llama-2-70b-chat-hf-FP8-KV-AMMO

Text Generation • Updated Jun 25 • 23
mohitsha/Llama-2-7b-chat-hf-FP8-FNUZ-KV-AMMO

Text Generation • Updated Jun 25 • 8

Collection guide
Browse collections

Company

© Hugging Face

TOS Privacy About Jobs

Website

Models Datasets Spaces Pricing Docs