dhuynh95
/

BioMedGPT-LM-7B-hf-gptq

Text Generation

text-generation-inference

Inference Endpoints

Model card Files Files and versions Community

Memory requirements

#1

by dimidd - opened Mar 19

dimidd

Mar 19

Hi, the model size is 3.9GB, but it requires ~25GB of GPU ram. Is this expected?

Upload images, audio, and videos by dragging in the text input, pasting, or clicking here.

Tap or paste here to upload images

· Sign up or log in to comment