
# LLaMA-7B + Landmark Attention

This repo hosts the weight diff between LLaMA 7B trained with landmark attention for 15000 steps on RedPajama and the original model. Please visit the [Github repository](https://github.com/epfml/landmark-attention) for further instructions on how to recover the full weights and how to use them.

Github repository: <https://github.com/epfml/landmark-attention>

{"license": "cc-by-sa-4.0"}
transformers pytorch llama text-generation license:cc-by-sa-4.0 autotrain_compatible endpoints_compatible has_space text-generation-inference region:us
TAGS
#transformers #pytorch #llama #text-generation #license-cc-by-sa-4.0 #autotrain_compatible #endpoints_compatible #has_space #text-generation-inference #region-us 


# LLaMA-7B + Landmark Attention

This repo hosts the weight diff between LLaMA 7B trained with landmark attention for 15000 steps on RedPajama and the original model. Please visit the Github repository for further instructions on how to recover the full weights and how to use them.

Github repository: <URL

# LLaMA-7B + Landmark Attention

This repo hosts the weight diff between LLaMA 7B trained with landmark attention for 15000 steps on RedPajama and the original model. Please visit the Github repository for further instructions on how to recover the full weights and how to use them.

Github repository: <URL
TAGS
#transformers #pytorch #llama #text-generation #license-cc-by-sa-4.0 #autotrain_compatible #endpoints_compatible #has_space #text-generation-inference #region-us 
 # LLaMA-7B + Landmark Attention

This repo hosts the weight diff between LLaMA 7B trained with landmark attention for 15000 steps on RedPajama and the original model. Please visit the Github repository for further instructions on how to recover the full weights and how to use them.

Github repository: <URL