ibm-fms
/

granite-7b-lab-accelerator

Inference Endpoints

Model card Files Files and versions Community

JRosenkranz commited on Apr 29

Commit

9771a98

•

1 Parent(s): 126c049

Update README.md

Files changed (1) hide show

README.md +1 -3

README.md CHANGED Viewed

@@ -163,6 +163,4 @@ python fms-extras/scripts/paged_speculative_inference.py \
     --top_k_tokens_per_head=4,3,2,2,2 \
     --batch_input \
     --compile \
-```
-Sample code can be found [here](https://github.com/foundation-model-stack/fms-extras/blob/main/scripts/paged_speculative_inference.py)

     --top_k_tokens_per_head=4,3,2,2,2 \
     --batch_input \
     --compile \
+```