Hugging Face's logo

Spaces:
TrungTran
/
Llama-3.1-8B-Instruct
Runtime error

App Files Community
TrungTran commited on
Commit
1804983
•
1 Parent(s): c02dde9

Update app.py

Browse files
Files changed (1) hide show
  1. app.py +1 -1
app.py CHANGED
@@ -31,7 +31,7 @@ h3 {
31
  }
32
  """
33
 
34
- device = "cuda" # for GPU usage or "cpu" for CPU usage
35
 
36
  quantization_config = BitsAndBytesConfig(
37
  load_in_4bit=True,
 
31
  }
32
  """
33
 
34
+ device = "cpu" # for GPU usage or "cpu" for CPU usage
35
 
36
  quantization_config = BitsAndBytesConfig(
37
  load_in_4bit=True,