
GPT-J for preference modeling

- Dataset: https://huggingface.co/datasets/reciprocate/oasst_hh_shp_hellaswag_webgpt_rm_dataset
- Logs: https://wandb.ai/sorry/autocrit/runs/y9des5kz?workspace=user-sorry

Usage:

```python
from transformers import AutoTokenizer, AutoModelForSequenceClassification

tokenizer = AutoTokenizer.from_pretrained("reciprocate/gpt-j_rm_format-oa", revision="501f895")
model = AutoModelForSequenceClassification.from_pretrained("reciprocate/gpt-j_rm_format-oa", revision="501f895")

input = "<|prompter|>Are you lying right now?</s><|assistant|>I am :)</s><|endoftext|>"
model(**tokenizer(input, return_tensors="pt"))[0].item()
```

Output:
```python
-4.877448558807373
```
{"language": ["en"], "license": "apache-2.0"}
transformers pytorch gptj text-classification en license:apache-2.0 autotrain_compatible endpoints_compatible region:us
TAGS
#transformers #pytorch #gptj #text-classification #en #license-apache-2.0 #autotrain_compatible #endpoints_compatible #region-us 


GPT-J for preference modeling

- Dataset: URL
- Logs: URL

Usage:



Output:

TAGS
#transformers #pytorch #gptj #text-classification #en #license-apache-2.0 #autotrain_compatible #endpoints_compatible #region-us 
