Support for longrope implementation in llama.cpp

#88
by ManniX-ITA - opened

@LeeStott

Could your team please also support the implementation of the new longrope in Phi-3 128K?
We can't convert and use the June 2024 updated models.

https://github.com/ggerganov/llama.cpp/issues/6849

Thanks!

Also doesn't work yet in VLLM and TGI :/

Sign up or log in to comment