license:other region:us
---
license: other
---

# Europe PubMedCentral Open Access subset

This is the open access subset of Europe PMC, as of 25/08/2023. The source xml updates weekly, so this is just a snapshot for now.

To read more about the open access subset, you can go here: https://europepmc.org/downloads/openaccess

Shortly, there should be about 5.5 million articles in theopen access subset, for each of which the whole fulltext of the article is available.

This dataset is ~975 parquet files, each of which is the fulltext of all articles in a range of PMCIDs. Older collections have fewer articles in, and are smaller.
The total dataset is ~42GB of compressed parquet. I have no clue what it will be decompressed but my guess is big.

The fulltext was extracted from the xml dumps located here: https://europepmc.org/ftp/oa/

The XML is in a standardised format: JATS. I took an implementation of a JATS parser from here: and modified it to extract only a few fields.

Each parquet will have the following:

|  pmcid | pmid | authors | title | publication_date | keywords | abstract | main_text |
|--------|------|---------|-------|------------------|----------|----------|-----------|
| str    | str  |list[str]| str   | str              |list[str] |  str     |   str     |



