Hugging Face's logo

DevQuasar
/
llama3_8b_chat_brainstorm-v2.1-GGUF

Text Generation
Transformers
GGUF
llama
Inference Endpoints
Model card Files Community
Edit model card

Brainstorm GGUF

image/png

Quantized GGUF model files for DevQuasar/llama3_8b_chat_brainstorm-v2.1

Brainstorm facilitates idea exploration through interaction with a Language Model (LLM). Rather than providing direct answers, the model engages in a dialogue with users, offering probing questions aimed at fostering deeper contemplation and consideration of various facets of their ideas. Model can summaryze the discussed ideas in Markdown format.

Usage

LMStudio

With https://lmstudio.ai/ use the brainstorm.preset.json preset

llama.cpp

./main -m llama3_8b_chat_brainstorm-v2.1.Q2_K.gguf -p "### HUMAN: I'd like to build an online marketplace\n ### ASSISTANT:" -n 400 -e -ins -r "### HUMAN:\n" -r "### ASSISTANT: "

Downloads last month
236
GGUF
Model size
8.03B params
Architecture
llama

2-bit

3-bit

4-bit

5-bit

6-bit

8-bit

Inference Examples
Text Generation
This model does not have enough activity to be deployed to Inference API (serverless) yet. Increase its social visibility and check back later, or deploy to Inference Endpoints (dedicated) instead.

Dataset used to train DevQuasar/llama3_8b_chat_brainstorm-v2.1-GGUF

Collections including DevQuasar/llama3_8b_chat_brainstorm-v2.1-GGUF