Edit model card

Phi-2 Senator Tweets

Phi-2 finetuned on Senator Tweets.

The starting token is [start] and the ending token is [end]

Example:

from transformers import AutoTokenizer, AutoModelForCausalLM

model = AutoModelForCausalLM.from_pretrained("Realluke/phi-2-senator-tweets", torch_dtype="auto", trust_remote_code=True)
tokenizer = AutoTokenizer.from_pretrained("microsoft/phi-2", trust_remote_code=True)

inputs = tokenizer("[start]", return_tensors="pt", return_attention_mask=False)
outputs = model.generate(**inputs, max_length=200)
text = tokenizer.batch_decode(outputs)[0]

print(text)

Model Details

Model Description

  • Steps: 750
  • Finetuning Examples: 1000
  • GPU: NVIDIA Tesla T4
  • GPU Hours: 2
Downloads last month
17
Safetensors
Model size
2.78B params
Tensor type
FP16
·
Inference Examples
This model does not have enough activity to be deployed to Inference API (serverless) yet. Increase its social visibility and check back later, or deploy to Inference Endpoints (dedicated) instead.

Dataset used to train Realluke/phi-2-senator-tweets