
# Open-Assistant StableLM-7B SFT-7 Model: GPTQ 4-bit

<a href="https://colab.research.google.com/gist/pszemraj/225805c85d0097e570a2fae0eb5f8913/inference-with-stablelm-7b-sft-v7e3-autogptq-4bit-128g.ipynb">
  <img src="https://colab.research.google.com/assets/colab-badge.svg" alt="Open In Colab"/>
</a>

A GPTQ version of the [Open-Assistant StableLM-7B SFT-7 Model](https://huggingface.co/OpenAssistant/stablelm-7b-sft-v7-epoch-3) quantized via [AutoGPTQ](https://github.com/PanQiWei/AutoGPTQ)


Will update this more later - take a look at the colab for now to see an inference example, or a [stripped-down version of the notebook here](https://gist.github.com/pszemraj/fc5b03b6bb7386991163eaaa9e0dc14d)


> Note: this model uses special tokens, structured as: `<|prompter|>What's the Earth total population<|endoftext|><|assistant|>`



## Query Example 


> I want you to act as an expert linguist. I'm trying to uncover the true meaning of the corporate buzzword 'value'. For example: "I've been furiously delivering value today". What could it really mean?

The corporate buzzword "value" can have a few different meanings, but one possible explanation is that it refers to the perceived worth or significance that is attached to something or someone. In this sense, it could be used to describe the perceived benefits that are associated with a particular product, service, or experience.

For example, if someone were to say "I've been furiously delivering value today," they might be emphasizing the importance of the product or service they are using to make that statement. This could be a way of signaling to the person or company that the value they are delivering is high quality and relevant.

It's worth noting that the meaning of "value" can be subjective and context-dependent, and it can be difficult to pin down. However, in many cases, it can be used to communicate the value or significance that is being attached to something.<|endoftext|>
{"language": ["en"], "license": "cc-by-sa-4.0", "tags": ["gptq", "auto-gptq", "quantization", "sft", "openassistant"], "inference": false, "pipeline_tag": "text-generation"}
transformers gpt_neox text-generation gptq auto-gptq quantization sft openassistant en license:cc-by-sa-4.0 autotrain_compatible text-generation-inference region:us
TAGS
#transformers #gpt_neox #text-generation #gptq #auto-gptq #quantization #sft #openassistant #en #license-cc-by-sa-4.0 #autotrain_compatible #text-generation-inference #region-us 


# Open-Assistant StableLM-7B SFT-7 Model: GPTQ 4-bit

<a href="URL
  <img src="URL alt="Open In Colab"/>
</a>

A GPTQ version of the Open-Assistant StableLM-7B SFT-7 Model quantized via AutoGPTQ


Will update this more later - take a look at the colab for now to see an inference example, or a stripped-down version of the notebook here


> Note: this model uses special tokens, structured as: '<|prompter|>What's the Earth total population<|endoftext|><|assistant|>'



## Query Example 


> I want you to act as an expert linguist. I'm trying to uncover the true meaning of the corporate buzzword 'value'. For example: "I've been furiously delivering value today". What could it really mean?

The corporate buzzword "value" can have a few different meanings, but one possible explanation is that it refers to the perceived worth or significance that is attached to something or someone. In this sense, it could be used to describe the perceived benefits that are associated with a particular product, service, or experience.

For example, if someone were to say "I've been furiously delivering value today," they might be emphasizing the importance of the product or service they are using to make that statement. This could be a way of signaling to the person or company that the value they are delivering is high quality and relevant.

It's worth noting that the meaning of "value" can be subjective and context-dependent, and it can be difficult to pin down. However, in many cases, it can be used to communicate the value or significance that is being attached to something.<|endoftext|>
# Open-Assistant StableLM-7B SFT-7 Model: GPTQ 4-bit

<a href="URL
  <img src="URL alt="Open In Colab"/>
</a>

A GPTQ version of the Open-Assistant StableLM-7B SFT-7 Model quantized via AutoGPTQ


Will update this more later - take a look at the colab for now to see an inference example, or a stripped-down version of the notebook here


> Note: this model uses special tokens, structured as: '<|prompter|>What's the Earth total population<|endoftext|><|assistant|>' ## Query Example 


> I want you to act as an expert linguist. I'm trying to uncover the true meaning of the corporate buzzword 'value'. For example: "I've been furiously delivering value today". What could it really mean?

The corporate buzzword "value" can have a few different meanings, but one possible explanation is that it refers to the perceived worth or significance that is attached to something or someone. In this sense, it could be used to describe the perceived benefits that are associated with a particular product, service, or experience.

For example, if someone were to say "I've been furiously delivering value today," they might be emphasizing the importance of the product or service they are using to make that statement. This could be a way of signaling to the person or company that the value they are delivering is high quality and relevant.

It's worth noting that the meaning of "value" can be subjective and context-dependent, and it can be difficult to pin down. However, in many cases, it can be used to communicate the value or significance that is being attached to something.<|endoftext|>
TAGS
#transformers #gpt_neox #text-generation #gptq #auto-gptq #quantization #sft #openassistant #en #license-cc-by-sa-4.0 #autotrain_compatible #text-generation-inference #region-us 
 # Open-Assistant StableLM-7B SFT-7 Model: GPTQ 4-bit

<a href="URL
  <img src="URL alt="Open In Colab"/>
</a>

A GPTQ version of the Open-Assistant StableLM-7B SFT-7 Model quantized via AutoGPTQ


Will update this more later - take a look at the colab for now to see an inference example, or a stripped-down version of the notebook here


> Note: this model uses special tokens, structured as: '<|prompter|>What's the Earth total population<|endoftext|><|assistant|>' ## Query Example 


> I want you to act as an expert linguist. I'm trying to uncover the true meaning of the corporate buzzword 'value'. For example: "I've been furiously delivering value today". What could it really mean?

The corporate buzzword "value" can have a few different meanings, but one possible explanation is that it refers to the perceived worth or significance that is attached to something or someone. In this sense, it could be used to describe the perceived benefits that are associated with a particular product, service, or experience.

For example, if someone were to say "I've been furiously delivering value today," they might be emphasizing the importance of the product or service they are using to make that statement. This could be a way of signaling to the person or company that the value they are delivering is high quality and relevant.

It's worth noting that the meaning of "value" can be subjective and context-dependent, and it can be difficult to pin down. However, in many cases, it can be used to communicate the value or significance that is being attached to something.<|endoftext|>