Update README.md

README.md

@@ -3,15 +3,14 @@ library_name: transformers
 tags: []
 ---
 
-Inference
+## Inference example
 
 ```
-model_name='lamm-mit/Bioinspired-Llama-3-1-8B-128k-2-alpha'
-model_name='lamm-mit/Bioinspired-Llama-3-1-8B-128k-alpha'
+model_name='lamm-mit/BioinspiredLlama-3-1-8B-128k'
+
 model = AutoModelForCausalLM.from_pretrained(
     model_name,
     trust_remote_code=True,
-    #load_in_8bit=True, 
     device_map="auto",
     torch_dtype =torch.bfloat16,
     attn_implementation="flash_attention_2"
@@ -21,7 +20,7 @@ tokenizer = AutoTokenizer.from_pretrained(model_name)
 
 ```
 
-Function to interact with the model 
+#### Function to interact with the model 
 
 ```
 
@@ -66,7 +65,7 @@ def generate_response (text_input="Biology offers amazing",system_prompt='You ar
     
     return tokenizer.batch_decode(outputs.detach().cpu().numpy(), skip_special_tokens=True), messages        
 ```
-
+Usage: 
 ```
 res,_= generate_response (text_input = "What is collagen?", system_prompt = 'You are a materials scientist. ',
                       num_return_sequences=1,