kz919
/

sliding_llama3.1_8b_no_finetune

Text Generation

text-generation-inference

Inference Endpoints

Model card Files Files and versions Community

kz919 commited on Jul 29

Commit

076212c

•

1 Parent(s): 38ef860

Update generation_config.json

Files changed (1) hide show

generation_config.json +1 -1

generation_config.json CHANGED Viewed

@@ -6,5 +6,5 @@
   "temperature": 0.6,
   "top_p": 0.9,
   "transformers_version": "4.43.3",
-  "cache_implementation": "sliding_window"
 }

   "temperature": 0.6,
   "top_p": 0.9,
   "transformers_version": "4.43.3",
+  "cache_implementation": "custom_hybrid"
 }