Phi-3.5-mini-instruct-GGUF
Original Model
microsoft/Phi-3.5-mini-instruct
Run with Gaianet
Prompt template:
prompt template: phi-3-chat
Context size:
chat_ctx_size: 128000
Run with GaiaNet:
Quick start: https://docs.gaianet.ai/node-guide/quick-start
Customize your node: https://docs.gaianet.ai/node-guide/customize
Quantized with llama.cpp b3499
- Downloads last month
- 231
This model does not have enough activity to be deployed to Inference API (serverless) yet. Increase its social
visibility and check back later, or deploy to Inference Endpoints (dedicated)
instead.
Model tree for gaianet/Phi-3.5-mini-instruct-GGUF
Base model
microsoft/Phi-3.5-mini-instruct
Quantized
this model