Minotaur-13B with 10k+ context using Landmark Attention.

Model generated using Landmark-Attention-QLoRA

https://github.com/eugenepentland/landmark-attention-qlora


A merge of the following models:

https://huggingface.co/openaccess-ai-collective/minotaur-13b

https://huggingface.co/eugenepentland/Minotaur-13b-Landmark-QLoRA

Can be loaded in using oobooga, make sure to have the --trust-remote-code option on for it to function.
{"license": "other"}
transformers pytorch llama text-generation custom_code license:other autotrain_compatible endpoints_compatible text-generation-inference region:us
TAGS
#transformers #pytorch #llama #text-generation #custom_code #license-other #autotrain_compatible #endpoints_compatible #text-generation-inference #region-us 

Minotaur-13B with 10k+ context using Landmark Attention.

Model generated using Landmark-Attention-QLoRA

URL


A merge of the following models:

URL

URL

Can be loaded in using oobooga, make sure to have the --trust-remote-code option on for it to function.
TAGS
#transformers #pytorch #llama #text-generation #custom_code #license-other #autotrain_compatible #endpoints_compatible #text-generation-inference #region-us 
