Text Generation Models
Collection
text models lol
•
4 items
•
Updated
Dromedary is our uncensored flagship model, designed for programming tasks and communication. Dromedary is a fine-tune of LLAMA-2. Dromedary was fine-tuned on 3 public datasets and on 1 private dataset (synthetic, by our model GPT-LIO.), ranging from programming to healthcare advice.
Dromedary is a model designed to be unbiased and uncensored. However, this model was detoxified. (we dont want any bad people!!!) The model was tuned with two RTX 8000s, at 1 epoch.
from transformers import AutoModelForCausalLM, AutoTokenizer
tokenizer = AutoTokenizer.from_pretrained("intone/Dromedary-7B")
model = AutoModelForCausalLM.from_pretrained("intone/Dromedary-7B", device_map="auto", torch_dtype='auto')
messages = [
{"role": "user", "content": "Hi, how are you?"}
]
input_ids = tokenizer.apply_chat_template(conversation=messages, tokenize=True, add_generation_prompt=True, return_tensors='pt')
output_ids = model.generate(input_ids.to('cuda'))
response = tokenizer.decode(output_ids[0][input_ids.shape[1]:], skip_special_tokens=True)
print(response) # --> "Hello! How can I assist you today?"