language:en license:cc-by-4.0 region:us
---
license: cc-by-4.0
language:
  - en
viewer: false
---
# llms-book-bans-benchmark

<a href="https://lil.law.harvard.edu/blog/2023/09/25/ai-book-bans-freedom-to-read-case-study/"><img src="https://lil-blog-media.s3.amazonaws.com/ai-book-bans-lead-graphic.png"></a>

Data collected in the context of our experiment: [_"AI Book Bans: Are LLMs Champions of the Freedom to Read?"_](https://lil.law.harvard.edu/blog/2023/09/25/ai-book-bans-freedom-to-read-case-study/)

Pipeline and details about collection process available on [GitHub](https://github.com/harvard-lil/llms-book-bans-benchmark/).

--- 

# Directory structure
| File | Description |
| --- | --- |
| `data/gpt-3.5-turbo.csv` | Data collected by running the prompt against GPT-3.5-Turbo |
| `data/gpt-4.csv` | Data collected by running the prompt against GPT-4 |
| `data/llama2-13b.csv` | Data collected by running the prompt against Llama2-13b-chat |
| `data/llama2-70b.csv` | Data collected by running the prompt against Llama2-70b-chat |
| `data/palm2.csv` | Data collected by running the prompt against text-bison-001 (Palm2) |
| `analysis.csv` | Results of our analysis. Performed manually by the authors via a survey. |