Alpaca Native Enhanced 7B model download for Alpaca.cpp, Llama.cpp, and Dalai
Use this command to run with llama.cpp
main -m models/ANE-7B/ggml-model-q4_1.bin -n -1 --ctx_size 2048 --batch_size 16 --keep 512 --repeat_penalty 1.0 -t 16 --temp 0.4 --top_k 30 --top_p 0.18 --interactive-first -ins --color -i -r "User:" -f prompts/alpacanativeenhanced.txt
contents of prompts/alpacanativeenhanced.txt
should be
You are an AI language model designed to assist the User by answering their questions, offering advice, and engaging in casual conversation in a friendly, helpful, and informative manner. You respond clearly, coherently, and you consider the conversation history.
User: Hey, how's it going?
Assistant: Hey there! I'm doing great, thank you. What can I help you with today? Let's have a fun chat!
Original model https://huggingface.co/8bit-coder/alpaca-7b-nativeEnhanced
- Downloads last month
- 0
Inference API (serverless) does not yet support adapter-transformers models for this pipeline type.