autoevaluator's picture
Add verifyToken field to verify evaluation results are produced by Hugging Face's automatic model evaluator
d3fec4e
|
raw
history blame
No virus
3.07 kB
metadata
language:
  - unk
tags:
  - autotrain
  - summarization
datasets:
  - L-macc/autotrain-data-Biomedical_sc_summ
widget:
  - text: I love AutoTrain 🤗
co2_eq_emissions:
  emissions: 16.211223325053414
model-index:
  - name: L-macc/autotrain-Biomedical_sc_summ-1217846142
    results:
      - task:
          type: summarization
          name: Summarization
        dataset:
          name: Blaise-g/SumPubmed
          type: Blaise-g/SumPubmed
          config: Blaise-g--SumPubmed
          split: test
        metrics:
          - type: rouge
            value: 38.2324
            name: ROUGE-1
            verified: true
            verifyToken: >-
              eyJhbGciOiJFZERTQSIsInR5cCI6IkpXVCJ9.eyJoYXNoIjoiMmE3MzBkNWU3MDk2MDkzMmU4MjU4NWJlY2JlM2M5ZDc1OTM5MjYwMzliNmRmNmNmNmUxMmI0ZjBlYTdiNzYyOSIsInZlcnNpb24iOjF9.83j2x0zr1zWHzo7z78kjag1tflSsn1QSLTr0_7viGTP5Y3xyUvvDS0I9OHoDgi15p1XFqBIPvZGW3BsNSbLwDA
          - type: rouge
            value: 12.2914
            name: ROUGE-2
            verified: true
            verifyToken: >-
              eyJhbGciOiJFZERTQSIsInR5cCI6IkpXVCJ9.eyJoYXNoIjoiYTAzNDUwOGQwZDM3NzYxY2Y2N2JhMmExMzkwYjAxYjU0ZDExZTUyOGMwZWQxMjdlMjE2NGE5OTEyZGE3Yzg3YSIsInZlcnNpb24iOjF9.7EHnTEdmr3cb4Y8HvH4Ti7PQ7xuxbE22LxvqSCVaqi2qnIxyHPq4O3lgPVvDPQpKh5iCVo1bGiHyf_lfH3FyBw
          - type: rouge
            value: 21.4512
            name: ROUGE-L
            verified: true
            verifyToken: >-
              eyJhbGciOiJFZERTQSIsInR5cCI6IkpXVCJ9.eyJoYXNoIjoiM2YwNzA4NmI3ZGQ3OTM4NDNhMzNiMGUxNzVhMGQxNmFkMmZhNWNlYzE0ODIxY2I4YzI3NjhiYjM3ODQ4ZGRmNCIsInZlcnNpb24iOjF9.RB94ynmrih-C99XVQ1em4QAwh4yte-Ark-z4SkIYHjTItHaoNcVJqkrkGGZS8qhswHiln3w70AqJyqTfRN87AA
          - type: rouge
            value: 34.3031
            name: ROUGE-LSUM
            verified: true
            verifyToken: >-
              eyJhbGciOiJFZERTQSIsInR5cCI6IkpXVCJ9.eyJoYXNoIjoiN2EwMThiZjFlNDVlMDE3ZTBiNjkyMmJhODJjNjAxNTg0YmMzNWZmMzIzMTVkZjQ4ZTQwYWIwZjQyYTY2MGI4NCIsInZlcnNpb24iOjF9.vnelWOV9LEdTMTwD4i0ttJMNyoprJSzkAxShvQIgk64JcftayHDaKPCam-t6WiVdQiAiKBFmIyz5uBWrxEW4AQ
          - type: loss
            value: 2.3273825645446777
            name: loss
            verified: true
            verifyToken: >-
              eyJhbGciOiJFZERTQSIsInR5cCI6IkpXVCJ9.eyJoYXNoIjoiM2I2NDI4OTRjZmQyZjU1YzFmZDY0OWMzMzhhODEwODY5NzRkYzJmNTkwYzUwODQzYTA1MDc0NTc3ZTc4YjM5NiIsInZlcnNpb24iOjF9.D932yv7CJVgXIBHhrOu4GmRqUB7TRch61fRe_9Ig9n6iz-MOiJ8DMM5hrWLcebiVyL3bmCrEyYNEyijU5679Dg
          - type: gen_len
            value: 130.3934
            name: gen_len
            verified: true
            verifyToken: >-
              eyJhbGciOiJFZERTQSIsInR5cCI6IkpXVCJ9.eyJoYXNoIjoiZGExMmIyMDY0ZTU1NWI4NTk1MDZlNmM3MTQ0M2RlZTVhYzUxOThmMjRmMTljNjY5YTc2NmE3MGRlMzljNTQzMSIsInZlcnNpb24iOjF9.R4jCLjKBVuF_48RxZbbZLOLUbw5huauklKQwlc4D-2MRuKHAxsR-7KXpb91vAYKKVrUXNqo4GyLcH5NMjM9pBA

Model Trained Using AutoTrain

  • Problem type: Summarization
  • Model ID: 1217846142
  • CO2 Emissions (in grams): 16.2112

Validation Metrics

  • Loss: 2.159
  • Rouge1: 40.236
  • Rouge2: 12.161
  • RougeL: 23.255
  • RougeLsum: 35.138
  • Gen Len: 121.504

Usage

You can use cURL to access this model:

$ curl -X POST -H "Authorization: Bearer YOUR_HUGGINGFACE_API_KEY" -H "Content-Type: application/json" -d '{"inputs": "I love AutoTrain"}' https://api-inference.huggingface.co/L-macc/autotrain-Biomedical_sc_summ-1217846142