task_categories:text-generation size_categories:100K<n<1M language:code license:other region:us
---
license: other
task_categories:
- text-generation
language:
- code
pretty_name: cran-packages
size_categories:
- 100K<n<1M
---

## CRAN packages dataset

R and Rmd source codes for CRAN packages. 

The dataset has been constructed using the following steps:

- Downloaded latest version from all packages on CRAN (see last updated). The source code has been downloaded from the [GitHub mirror](https://github.com/cran).
- Identified the licenses from each package from their DESCRIPTION file, and classified each of them into some license_code. See the licenses.csv file.
- Extract R and Rmd source files from all packages and joined with the package LICENSES.

Datasets are provided as parquet files containing the following columns:

```
FileSystemDataset with 1 Parquet file
package: string
path: string
content: large_string
size: double
license: string
```

Last updated: Jun 6th 2023

## Changelog

- v1: Initial version
- dev: added all CRAN files and a license field that allows filtering out per license. Also removed some unused columns.
