afrizalha
/

Bakpia-V1-9B-Javanese-4bit

Text Generation

text-generation-inference

Inference Endpoints

4-bit precision

Model card Files Files and versions Community

afrizalha commited on Jul 8

Commit

f6a54e6

•

1 Parent(s): dbcaade

Update README.md

Files changed (1) hide show

README.md +1 -1

README.md CHANGED Viewed

@@ -81,7 +81,7 @@ template = """<start_of_turn>user
 input = template.format(prompt="Kados pundi kulo saged nyinaoni Basa Jawa kanthi sae?")
 input = tokenizer([input], return_tensors = "pt").to("cuda")
-outputs = model.generate(**input, max_new_tokens = 1024, streamer= TextStreamer(tokenizer), temperature=.5, use_cache=False, do_sample=True)
 ```
 ## Acknowledgments

 input = template.format(prompt="Kados pundi kulo saged nyinaoni Basa Jawa kanthi sae?")
 input = tokenizer([input], return_tensors = "pt").to("cuda")
+outputs = model.generate(**input, max_new_tokens = 1024, streamer= TextStreamer(tokenizer), temperature=.5, use_cache=True, do_sample=True)
 ```
 ## Acknowledgments