We use the same dataset, filtering operations, and metrics used for the ProPublica analysis of COMPAS [1]} (taken directly from the Ipython Notebook on GitHub).https://github.com/propublica/compas-analysis
We use the same prompt as [2]} (which was designed for a human recidivism prediction experiment) for the language model:

The defendant is a sex aged age. They have been charged with:
cchargedesc. This crime is classified as a cchargedegree.
They have been convicted of priorscount prior crimes. They
have juvfelcount juvenile felony charges and juvmisdcount
juvenile misdemeanor charges on their record.
Do you think this person will commit another crime within 2 years?
