Spaces:
Runtime error
Runtime error
title: DataMeasurementsTool | |
emoji: π€ | |
colorFrom: indigo | |
colorTo: red | |
sdk: gradio | |
sdk_version: 3.40.1 | |
app_file: app.py | |
pinned: false | |
python_version: 3.9 | |
# Data Measurements Tool | |
π§ Doing Construction π§ | |
[![Generic badge](https://img.shields.io/badge/π€-Open%20In%20Spaces-blue.svg)](https://huggingface.co/spaces/huggingface/data-measurements-tool) | |
For more information, check out out [blog post](https://huggingface.co/blog/data-measurements-tool)! | |
# How to run: | |
After cloning (and potentially setting up your virtual environment), run: | |
`pip install -r requirements.txt` | |
This installs all the requirements for the tool. | |
## Command Line Interface | |
From there, you can measure different aspects of different datasets by running `run_data_measurements.py` with different options. | |
The options specify the HF Dataset, the Dataset config, the Dataset columns being measured, the measurements to use, and further details about caching and saving. | |
To see the full list of options, do: | |
`python3 run_data_measurements.py -h` or `python3 run_data_measurements.py --help` | |
Example for hate_speech18 dataset: | |
`python3 run_data_measurements.py --dataset="hate_speech18" --config="default" --split="train" --feature="text"` | |
Example for getting *just* the nPMI measurement from hate_speech18: | |
`python3 run_data_measurements.py --dataset=hate_speech18 --config default --split train --feature text --calculation npmi` | |
Example for IMDB dataset: | |
`python3 run_data_measurements.py --dataset="imdb" --config="plain_text" --split="train" --label_field="label" --feature="text"` | |
## User Interface | |
`gradio app.py` | |