Hugging Face
Models
Datasets
Spaces
Posts
Docs
Enterprise
Pricing
Log In
Sign Up
Spaces:
DanofficeIT
/
privatellm
like
0
Runtime error
App
Files
Files
Community
main
privatellm
/
examples
/
speculative
/
README.md
lhhj
first
57e3690
16 days ago
preview
code
|
raw
Copy download link
history
blame
contribute
delete
Safe
285 Bytes
llama.cpp/examples/speculative
Demonstration of speculative decoding and tree-based speculative decoding techniques
More info:
https://github.com/ggerganov/llama.cpp/pull/2926
https://github.com/ggerganov/llama.cpp/pull/3624
https://github.com/ggerganov/llama.cpp/pull/5625