
- A distilled version of a merge of starchat_beta (60%), starcoderplus(20%) and starcoder(20%), using layer removal and merging.
- The layers are merged or removed as follows. the index numbers are the layer from the original model. two or more indexes means these layers are averaged.:
   [[0], [1], [2], [3], [4],  [5], [6],  [7], [8, 9], [10], [11],  [13], [14], [15, 16], [17], [18], [19, 20], [21], [22], [23],  [24],  [27], [28], [29], [30], [31, 32], [33], [34],  [36], [37], [39]]
- TODO: finetuning still required

{"license": "bigscience-openrail-m"}
transformers pytorch gpt_bigcode text-generation license:bigscience-openrail-m autotrain_compatible endpoints_compatible text-generation-inference region:us
TAGS
#transformers #pytorch #gpt_bigcode #text-generation #license-bigscience-openrail-m #autotrain_compatible #endpoints_compatible #text-generation-inference #region-us 


- A distilled version of a merge of starchat_beta (60%), starcoderplus(20%) and starcoder(20%), using layer removal and merging.
- The layers are merged or removed as follows. the index numbers are the layer from the original model. two or more indexes means these layers are averaged.:
   [[0], [1], [2], [3], [4],  [5], [6],  [7], [8, 9], [10], [11],  [13], [14], [15, 16], [17], [18], [19, 20], [21], [22], [23],  [24],  [27], [28], [29], [30], [31, 32], [33], [34],  [36], [37], [39]]
- TODO: finetuning still required

TAGS
#transformers #pytorch #gpt_bigcode #text-generation #license-bigscience-openrail-m #autotrain_compatible #endpoints_compatible #text-generation-inference #region-us 
