thwin27
/

Aria-sequential_mlp-FP8-dynamic

Image-Text-to-Text

text-generation

compressed-tensors

Model card Files Files and versions Community

thwin27 commited on 8 days ago

Commit

5c82453

•

1 Parent(s): e4dcfa0

Update README.md

Files changed (1) hide show

README.md +1 -1

README.md CHANGED Viewed

@@ -7,7 +7,7 @@ pipeline_tag: image-text-to-text
 library_name: transformers
 ---
 # Aria-sequential_mlp-FP8-dynamic
-FP8-Dynamic quantization from [Aria-sequential_mlp](https://huggingface.co/rhymes-ai/Aria-sequential_mlp) made with [llm-compressor](https://github.com/vllm-project/llm-compressor), requires about 24.8 GB of VRAM.
 ### Installation
 ```

 library_name: transformers
 ---
 # Aria-sequential_mlp-FP8-dynamic
+FP8-Dynamic quantization from [Aria-sequential_mlp](https://huggingface.co/rhymes-ai/Aria-sequential_mlp) made with [llm-compressor](https://github.com/vllm-project/llm-compressor), requires about 30 GB of VRAM.
 ### Installation
 ```