Hugging Face's logo

qnguyen3
/
vinallama-16b-chat-franken

Text Generation
Transformers
Safetensors
llama
Merge
mergekit
vilm/vinallama-7b-chat
text-generation-inference
Inference Endpoints
Model card Files Community
1
Edit model card

vinallama-chat-merge-2

This model is a merge of the following models made with LazyMergekit:

🧩 Configuration 

slices:
  - sources:
    - model: vilm/vinallama-7b-chat
      layer_range: [0, 16]
  - sources:
    - model: vilm/vinallama-7b-chat
      layer_range: [8, 16]
  - sources:
    - model: vilm/vinallama-7b-chat
      layer_range: [8, 16]      
  - sources:
    - model: vilm/vinallama-7b-chat
      layer_range: [12, 24]
  - sources:
    - model: vilm/vinallama-7b-chat
      layer_range: [12, 24]
  - sources:
    - model: vilm/vinallama-7b-chat
      layer_range: [20, 28]
  - sources:
    - model: vilm/vinallama-7b-chat
      layer_range: [20, 28]
  - sources:
    - model: vilm/vinallama-7b-chat
      layer_range: [28, 32]
merge_method: passthrough
dtype: bfloat16
Downloads last month
16
Safetensors
Model size
15.8B params
Tensor type
BF16
·
Inference Examples
Text Generation
This model does not have enough activity to be deployed to Inference API (serverless) yet. Increase its social visibility and check back later, or deploy to Inference Endpoints (dedicated) instead.

Collection including qnguyen3/vinallama-16b-chat-franken