Methame 7B 

Using https://huggingface.co/TehVenom/Metharme-7b-Merged-Safetensors/ as the base (and included here)
Quanted on a Google Colab 

Act-order and True-Sequential ||
C4: 7.8935709 ||
Wiki2: 6.309680939 ||
PTB: 46.60740662 ||

True-Sequential Groupsize 32 ||
C4: 8.104910851 ||
Wiki2: 7.025843143 ||
PTB: 48.19175339 ||

{}
transformers safetensors llama text-generation autotrain_compatible endpoints_compatible text-generation-inference region:us
TAGS
#transformers #safetensors #llama #text-generation #autotrain_compatible #endpoints_compatible #text-generation-inference #region-us 

Methame 7B 

Using URL as the base (and included here)
Quanted on a Google Colab 

Act-order and True-Sequential ||
C4: 7.8935709 ||
Wiki2: 6.309680939 ||
PTB: 46.60740662 ||

True-Sequential Groupsize 32 ||
C4: 8.104910851 ||
Wiki2: 7.025843143 ||
PTB: 48.19175339 ||

TAGS
#transformers #safetensors #llama #text-generation #autotrain_compatible #endpoints_compatible #text-generation-inference #region-us 
