note : use original open llama tokenizer
model_path = 'ruwan/open-llama-sharded-1GB-7B-alpaca-vmware'
tokenizer = LlamaTokenizer.from_pretrained("openlm-research/open_llama_7b") model = LlamaForCausalLM.from_pretrained( model_path, torch_dtype=torch.float16, device_map='auto' )
- Downloads last month
- 19
This model does not have enough activity to be deployed to Inference API (serverless) yet. Increase its social
visibility and check back later, or deploy to Inference Endpoints (dedicated)
instead.