Take very long time to get the answers and answers never comes
#2
by
UDJA
- opened
I installed h2ogpt in a VM and It has 64GB RAM and 750GB storage and intel Xeon processor. I tried with this model. but when I asked something It takes very long time to process more than 5,6 hours and no any result. please help.
70b without GPU on FP16 isn't good idea. Use GGUF model and use zephyr 7b beta or open_chat.
pseudotensor
changed discussion status to
closed