task_categories:text-classification size_categories:1K<n<10K language:es license:apache-2.0 legal region:us
---
language:
- es
license: apache-2.0
size_categories:
- 1K<n<10K
task_categories:
- text-classification
tags:
- legal
configs:
- config_name: default
  data_files:
  - split: train
    path: "/raw_text/train.parquet"
- config_name: raw_text
  data_files:
  - split: train
    path: "/raw_text/train.parquet"
- config_name: unlabeled_sentences
  data_files:
  - split: train
    path: "/unlabeled_sentences/train.parquet"
dataset_info:
- config_name: raw_text
  features:
  - name: source_id
    dtype: int64
  - name: source_name
    dtype: string
  - name: text
    dtype: string
  - name: text_id
    dtype: int64
  - name: extension
    dtype:
      class_label:
        names:
          '0': docx
          '1': pdf
          '2': html
          '3': txt
          '4': doc
  split: train
- config_name: unlabeled_sentences
  features:
  - name: source_id
    dtype: int64
  - name: source_name
    dtype: string
  - name: text
    dtype: string
  - name: text_id
    dtype: int64
  - name: cost_type
    dtype:
      class_label:
        names:
          '0': no_cost
          '1': adm_cost
          '2': direct_cost
          '3': other_cost
  - name: affected_entity
    dtype:
      class_label:
        names:
          '0': no_affected_ent
          '1': companies
          '2': citizens
          '3': public_adm
  - name: io_categories
    sequence:
      class_label:
        names:
          '0': prestacao_info_empresarial_e_fiscal
          '1': pedidos_de_licencas_e_outros
          '2': registos_e_notificacoes
          '3': candidatura_a_subsidios_e_outros
          '4': disponibilizacao_de_manuais_e_outros
          '5': cooperacao_com_auditorias_e_outros
          '6': prestacao_info_a_consumidores
          '7': outras_ois
  - name: aa_categories
    sequence:
      class_label:
        names:
          '0': aa_1_familiarizacao_com_oi
          '1': aa_1_recolha_e_organizacao_de_info
          '2': aa_1_processamento_de_info
          '3': aa_1_tempos_de_espera
          '4': aa_1_deslocacoes
          '5': aa_1_submissao_de_info
          '6': aa_1_preservacao_de_info
          '7': aa_2_familiarizacao_com_oi
          '8': aa_2_recolha_e_organizacao_de_info
          '9': aa_2_processamento_de_info
          '10': aa_2_tempos_de_espera
          '11': aa_2_deslocacoes
          '12': aa_2_submissao_de_info
          '13': aa_2_preservacao_de_info
          '14': aa_3_familiarizacao_com_oi
          '15': aa_3_recolha_e_organizacao_de_info
          '16': aa_3_processamento_de_info
          '17': aa_3_tempos_de_espera
          '18': aa_3_deslocacoes
          '19': aa_3_submissao_de_info
          '20': aa_3_preservacao_de_info
          '21': aa_4_familiarizacao_com_oi
          '22': aa_4_recolha_e_organizacao_de_info
          '23': aa_4_processamento_de_info
          '24': aa_4_tempos_de_espera
          '25': aa_4_deslocacoes
          '26': aa_4_submissao_de_info
          '27': aa_4_preservacao_de_info
          '28': aa_5_familiarizacao_com_oi
          '29': aa_5_recolha_e_organizacao_de_info
          '30': aa_5_processamento_de_info
          '31': aa_5_tempos_de_espera
          '32': aa_5_deslocacoes
          '33': aa_5_submissao_de_info
          '34': aa_5_preservacao_de_info
          '35': aa_6_familiarizacao_com_oi
          '36': aa_6_recolha_e_organizacao_de_info
          '37': aa_6_processamento_de_info
          '38': aa_6_tempos_de_espera
          '39': aa_6_deslocacoes
          '40': aa_6_submissao_de_info
          '41': aa_6_preservacao_de_info
          '42': aa_7_familiarizacao_com_oi
          '43': aa_7_recolha_e_organizacao_de_info
          '44': aa_7_processamento_de_info
          '45': aa_7_tempos_de_espera
          '46': aa_7_deslocacoes
          '47': aa_7_submissao_de_info
          '48': aa_7_preservacao_de_info
  - name: aa_categories_unique
    sequence:
      class_label:
        names:
          '0': familiarizacao_com_oi
          '1': recolha_e_organizacao_de_info
          '2': processamento_de_info
          '3': tempos_de_espera
          '4': deslocacoes
          '5': submissao_de_info
          '6': preservacao_de_info
  splits:
  - name: train
---

# Paraguay Legislation

The Paraguay Legislation dataset is a comprehensive collection of legal documents sourced from the legislative framework of Paraguay. The dataset contains legal documents sourced from the legislative framework of Paraguay, including resolutions, decrees, laws, and other kinds of legislative texts.

This dataset has been curated as a valuable resource for Natural Language Processing (NLP) tasks. The data is designed for research focused on text classification tasks. The classification process is divided into two objectives:

 1. Binary classification: 0 - no cost and 1 - cost (legislation has costs for the society)

 2. Multi-classification: classify the document into several hierarchical categories of costs.

For more information about multi-classification definitions, please check this link: <todo: link to>.

## Subsets

The dataset contains various subsets, each representing different data quality and preparation stages. Within these subsets, you'll encounter multiple versions of the same data, with variations primarily reflecting differences in data quality, metadata columns, and preprocessing tasks applied to change the data.

The subsets are the following:

**1. Raw:** Data extracted from the sources files (URls, PDFs and Word files) without any transformation or sentence splitter. It can be helpful because you can access the raw data extracted from the seeds (PDFs and Word files) and apply other preprocessing tasks from this point to prepare the data without returning to extract texts from source files.

**2. Sentences:** Normalized data split by sentence, mainly treating issues of text extracted from PDF. This stage also adds metadata about the sentence, for example: if it is a title or not.

**3. Sentence Unlabeled:** Unlabeled corpora of Paraguay legislation. This data is prepared to be labeled by the experts. Each instance of the dataset represents a specific text passage, split by its original formatting extracted from raw text (from original documents).

**4. Sentence labeled (Ground Truth):**  The labeled data is the ground truth data used to train the models. This data is annotated  by legal experts indicating the existence of administrative costs (and other types) in the legislation. Each instance of the dataset represents a specific text passage.

This dataset has the following data splits:

* Training Set: This portion of the data is used to train and fine-tune machine learning models.

* Test Set: The test set is reserved for assessing the model's accuracy, generalization, and effectiveness. It remains unseen during training and helps gauge how well the model performs on new, unseen data.

Together, these labeled data subsets provide a crucial reference point for building and evaluating models, ensuring they can make informed predictions and classifications with high accuracy and reliability.
