Inquiry on Minimum Configuration and Cost for Running Gemma-7b-it-GGUF Model Efficiently
#2
by
ltkien2003
- opened
I am interested in running the Gemma-7b-it-GGUF model and would like to inquire about the minimum hardware configuration required to achieve fast and immediate responses. Additionally, could you please provide an estimate of the associated costs for operating the model under these conditions?