Llamav2 7B required 24GB System RAM or 24GB GPU RAM ?

#2
by Tapendra - opened

Hello sir,
Is it possible to train the "llamav2 7b" model on a custom dataset using Google Colab Pro, which offers approximately 32 GB of system RAM and 16 GB of GPU RAM?

Tapendra changed discussion title from Llamav2 7B required 24GB System RAM or GPU RAM ? to Llamav2 7B required 24GB System RAM or 24GB GPU RAM ?

of course you can. I trained the 7b model on Tesla T4.

Sign up or log in to comment