t5-base-cnn-dm / README.md
yhavinga's picture
Add verifyToken field to verify evaluation results are produced by Hugging Face's automatic model evaluator (#3)
b47106e
|
raw
history blame
2.51 kB
metadata
language: en
license: apache-2.0
tags:
  - summarization
datasets:
  - cnn_dailymail
model-index:
  - name: flax-community/t5-base-cnn-dm
    results:
      - task:
          type: summarization
          name: Summarization
        dataset:
          name: cnn_dailymail
          type: cnn_dailymail
          config: 3.0.0
          split: test
        metrics:
          - type: rouge
            value: 24.2906
            name: ROUGE-1
            verified: true
            verifyToken: >-
              eyJhbGciOiJFZERTQSIsInR5cCI6IkpXVCJ9.eyJoYXNoIjoiMzZkZmUwOTU5ZGJhYjk4MGVjMjk2ZjEzNDUwMDYyOGIxMDc0ZTI5ZTFkZDUxNTEwNDJkZGRhZTkyNzRjZDJjOSIsInZlcnNpb24iOjF9.6fiYZdYKwgNM5KXeDtEOP2m3OGsip3792OvKnMiSVJk0Pn-CbQQwKH7oZ76YaIxyvOUtCmggiQSDXZc9UKKKCw
          - type: rouge
            value: 11.1405
            name: ROUGE-2
            verified: true
            verifyToken: >-
              eyJhbGciOiJFZERTQSIsInR5cCI6IkpXVCJ9.eyJoYXNoIjoiMDE0ZmZkMGQxYzQ2YjhiM2Y4NWE0NzY3M2I1OWYzYWE2NWI1MWNiYjBlOGRiNmJmMDJhYzU3MjkwYmM3Zjg4NyIsInZlcnNpb24iOjF9.kWdKlRb7j47d3RtAaqnQmY2-08RihES0UkyVXR32rDzpgy2hxmVcXdiaYE1sPuO6n_6Mx4xxFgxHyB9MNqBlBw
          - type: rouge
            value: 19.8442
            name: ROUGE-L
            verified: true
            verifyToken: >-
              eyJhbGciOiJFZERTQSIsInR5cCI6IkpXVCJ9.eyJoYXNoIjoiNTkwNjkwZTk0NzEyNzQyYTE0OTFlNzQxMmJjYjU2YzkxZjUzZGRiODVmOTY0ZDk2Y2JiMzUzZWRiMGJiZWY5OSIsInZlcnNpb24iOjF9.1psy2C5BTqlfaBzM7VzxKA5TZ3zBxr3YFLzx4ClODILytwszfN8FTW0RTCIDCkdqh2QgXnrdC_K1Nyk82p2DDg
          - type: rouge
            value: 22.7556
            name: ROUGE-LSUM
            verified: true
            verifyToken: >-
              eyJhbGciOiJFZERTQSIsInR5cCI6IkpXVCJ9.eyJoYXNoIjoiNjYyNTcyNGNlYjcwYjBhMjgxZjkwMjU5YWRmNTQ1NmI3YzFiZGU0MjNkYzcyMDc1N2Q2YzY3YTE4NDNjNWVlNyIsInZlcnNpb24iOjF9.K9WzEm2ookzDPvl-LEknZPHc6g8OZ_uPGf07XzeIHoAwxBjgFpZ-Q2GMiS-UUseLP1Y3F0zE8t0QyNgMyUr4BA
          - type: loss
            value: 2.1426470279693604
            name: loss
            verified: true
            verifyToken: >-
              eyJhbGciOiJFZERTQSIsInR5cCI6IkpXVCJ9.eyJoYXNoIjoiNjk1YTU1ODljNzhmYmFjYmFjMGY5NGRmNmEwNzM0NTFkYWIwZTljZTExYTY5YjcxZTFhMWY1MTU0OWU4YzQzZiIsInZlcnNpb24iOjF9.3RiDEYMR4sJb8I12FZMuRaSrwHtvutDeRqMbk3QlK7Q5JzDUP1u4ZGjHIzyuTJl-S99EEobX0Dg0xw2yUcgRCg
          - type: gen_len
            value: 18.9993
            name: gen_len
            verified: true
            verifyToken: >-
              eyJhbGciOiJFZERTQSIsInR5cCI6IkpXVCJ9.eyJoYXNoIjoiNGY5YTYxZmZiYmY4NTZjNmMzMjllNWE1M2M2ZjA0MWM1MzBhZjc0MDM5ZGFiYTAzNjFiZjg5ZjMxYzlmOGYwMyIsInZlcnNpb24iOjF9.eXiPrQ-CeB3BWzlQzkTIA1q0xYP1GtFGIK9XyIneEmh5ajN5pCATxNDvn6n09d84OEr5432SoPJfdpNCd_UyCA

Model

This model is fine-tuned from https://huggingface.co/flax-community/t5-base-openwebtext, fine-tuned on cnn_dailymail.