autoevaluator's picture
Add verifyToken field to verify evaluation results are produced by Hugging Face's automatic model evaluator
472bcff
|
raw
history blame
8.11 kB
---
license: apache-2.0
tags:
- summarization
- t5
datasets:
- billsum
metrics:
- rouge
widget:
- text: 'The people of the State of California do enact as follows: SECTION 1. The
Legislature hereby finds and declares as follows: (a) Many areas of the state
are disproportionately impacted by drought because they are heavily dependent
or completely reliant on groundwater from basins that are in overdraft and in
which the water table declines year after year or from basins that are contaminated.
(b) There are a number of state grant and loan programs that provide financial
assistance to communities to address drinking water and wastewater needs. Unfortunately,
there is no program in place to provide similar assistance to individual homeowners
who are reliant on their own groundwater wells and who may not be able to afford
conventional private loans to undertake vital water supply, water quality, and
wastewater improvements. (c) The program created by this act is intended to bridge
that gap by providing low-interest loans, grants, or both, to individual homeowners
to undertake actions necessary to provide safer, cleaner, and more reliable drinking
water and wastewater treatment. These actions may include, but are not limited
to, digging deeper wells, improving existing wells and related equipment, addressing
drinking water contaminants in the homeowner’s water, or connecting to a local
water or wastewater system. SEC. 2. Chapter 6.6 (commencing with Section 13486)
is added to Division 7 of the Water Code, to read: CHAPTER 6.6. Water and Wastewater
Loan and Grant Program 13486. (a) The board shall establish a program in accordance
with this chapter to provide low-interest loans and grants to local agencies for
low-interest loans and grants to eligible applicants for any of the following
purposes:'
example_title: Water use
- text: 'The people of the State of California do enact as follows: SECTION 1. Section
2196 of the Elections Code is amended to read: 2196. (a) (1) Notwithstanding any
other provision of law, a person who is qualified to register to vote and who
has a valid California driver’s license or state identification card may submit
an affidavit of voter registration electronically on the Internet Web site of
the Secretary of State. (2) An affidavit submitted pursuant to this section is
effective upon receipt of the affidavit by the Secretary of State if the affidavit
is received on or before the last day to register for an election to be held in
the precinct of the person submitting the affidavit. (3) The affiant shall affirmatively
attest to the truth of the information provided in the affidavit. (4) For voter
registration purposes, the applicant shall affirmatively assent to the use of
his or her signature from his or her driver’s license or state identification
card. (5) For each electronic affidavit, the Secretary of State shall obtain an
electronic copy of the applicant’s signature from his or her driver’s license
or state identification card directly from the Department of Motor Vehicles. (6)
The Secretary of State shall require a person who submits an affidavit pursuant
to this section to submit all of the following: (A) The number from his or her
California driver’s license or state identification card. (B) His or her date
of birth. (C) The last four digits of his or her social security number. (D) Any
other information the Secretary of State deems necessary to establish the identity
of the affiant. (7) Upon submission of an affidavit pursuant to this section,
the electronic voter registration system shall provide for immediate verification
of both of the following:'
example_title: Election
model-index:
- name: t5-small-finetuned-billsum-ca_test
results:
- task:
type: text2text-generation
name: Sequence-to-sequence Language Modeling
dataset:
name: billsum
type: billsum
args: default
metrics:
- type: rouge
value: 12.6315
name: Rouge1
- task:
type: summarization
name: Summarization
dataset:
name: billsum
type: billsum
config: default
split: test
metrics:
- type: rouge
value: 12.1368
name: ROUGE-1
verified: true
verifyToken: eyJhbGciOiJFZERTQSIsInR5cCI6IkpXVCJ9.eyJoYXNoIjoiNGYyZjQ3ZDIzNWI5YTcyNmZjNWYwYWNkMzQ1NjVmNmJmMjI3MjIzNmJjODY2ODY5OWE2ODlhZDhlY2QxNmE3OSIsInZlcnNpb24iOjF9.OgYBwYP2BsMkga2iQCaEhwS577_orJZijpxjsd8i-QPOOAes4WiiAmxr5mHrsG7fjp2qXChzbx7Kik-7zpyeBA
- type: rouge
value: 4.6017
name: ROUGE-2
verified: true
verifyToken: eyJhbGciOiJFZERTQSIsInR5cCI6IkpXVCJ9.eyJoYXNoIjoiZWVkN2ZmNGQ1N2QyYzViMzE3ZTc4OWRjMjY5NWQ5OGJmZDg1YTc2NmQyYTYwZTE5MjI0YmEwMGEzMjczZGI1YSIsInZlcnNpb24iOjF9.CGrm9rdFWLMKBE6ZliCgoAIwFlRQ9RrkTTyEXWN-mgs3otZt3PMTHflliDMB2VOzaYqn0AWcb4R6KZSPjveLDg
- type: rouge
value: 10.0767
name: ROUGE-L
verified: true
verifyToken: eyJhbGciOiJFZERTQSIsInR5cCI6IkpXVCJ9.eyJoYXNoIjoiZTkzZGM0NjY4ZTEzNTExZjg3MTU3ODE2MmU3MTc2NjNkZmFhZWVkYzExZTAxOTdhMTczYjU4NzUwNmRlM2FmNCIsInZlcnNpb24iOjF9.6VT0EGxHvnO3-XHbSZ4FtZjRo3IubQm4QFa3Jxt-Wc-avAUqA_emMEhe6CkJHJLaqbalN-pzRL3wVoWO1YUXCw
- type: rouge
value: 10.6892
name: ROUGE-LSUM
verified: true
verifyToken: eyJhbGciOiJFZERTQSIsInR5cCI6IkpXVCJ9.eyJoYXNoIjoiYTM3ZDE2NzE0NWE1ODdlNGEwNGY4ZWZiOTc3OGEwZTU2MmEzODUwMjBjODE1MGZiMTJmOWY2MTYwZDIzZTQ5YSIsInZlcnNpb24iOjF9.DuebV54ulf7s9lnV_0MbbX_8rfXD5eIuwLEYUrqyqdwJwoLdljPtmr4eeJyBZnRWQuYST3X9MP-P7cxeOLVdAA
- type: loss
value: 2.897707462310791
name: loss
verified: true
verifyToken: eyJhbGciOiJFZERTQSIsInR5cCI6IkpXVCJ9.eyJoYXNoIjoiMmU3NmZjZmY3MTI3NTU1MzZiZmQxNGM5YTY2NzE5MDhhMjgyZTZjYmNiN2Q0NGQ3ZTRkYmUwOGE5YWMwOWVmNiIsInZlcnNpb24iOjF9.JOiS9YvTSoP4Ig-QUzZP-VCF0YjUMK-yLTDRuhml_iWnavkvcUFvOYrZR70nV7lufXyGFBXseUDjeFRhYd0GDw
- type: gen_len
value: 19
name: gen_len
verified: true
verifyToken: eyJhbGciOiJFZERTQSIsInR5cCI6IkpXVCJ9.eyJoYXNoIjoiNGFlNzdlMGI1NDgwYTdhYjEyZjcyMWM5MmI3MmQ5MTExZmM3YTU0YTBjMTlkYTNkMjJmMDljNjBmYzAwNzYxYyIsInZlcnNpb24iOjF9.03VYE7XRLy0dRRAD8lljnmSu7mVen-RwglqZ2fpgm8hAkoIXoSeyLbJl3sKcf28lQl1I-40ySEIwoGokfF7ABg
---
<!-- This model card has been generated automatically according to the information the Trainer had access to. You
should probably proofread and complete it, then remove this comment. -->
# t5-small-finetuned-billsum-ca_test
This model is a fine-tuned version of [t5-small](https://huggingface.co/t5-small) on the billsum dataset.
It achieves the following results on the evaluation set:
- Loss: 2.3376
- Rouge1: 12.6315
- Rouge2: 6.9839
- Rougel: 10.9983
- Rougelsum: 11.9383
- Gen Len: 19.0
## Model description
More information needed
## Intended uses & limitations
More information needed
## Training and evaluation data
More information needed
## Training procedure
### Training hyperparameters
The following hyperparameters were used during training:
- learning_rate: 2e-05
- train_batch_size: 2
- eval_batch_size: 2
- seed: 42
- optimizer: Adam with betas=(0.9,0.999) and epsilon=1e-08
- lr_scheduler_type: linear
- num_epochs: 4
- mixed_precision_training: Native AMP
### Training results
| Training Loss | Epoch | Step | Validation Loss | Rouge1 | Rouge2 | Rougel | Rougelsum | Gen Len |
|:-------------:|:-----:|:----:|:---------------:|:-------:|:------:|:-------:|:---------:|:-------:|
| No log | 1.0 | 495 | 2.4805 | 9.9389 | 4.1239 | 8.3979 | 9.1599 | 19.0 |
| 3.1564 | 2.0 | 990 | 2.3833 | 12.1026 | 6.5196 | 10.5123 | 11.4527 | 19.0 |
| 2.66 | 3.0 | 1485 | 2.3496 | 12.5389 | 6.8686 | 10.8798 | 11.8636 | 19.0 |
| 2.5671 | 4.0 | 1980 | 2.3376 | 12.6315 | 6.9839 | 10.9983 | 11.9383 | 19.0 |
### Framework versions
- Transformers 4.12.2
- Pytorch 1.9.0+cu111
- Datasets 1.14.0
- Tokenizers 0.10.3