--- license: apache-2.0 tags: - generated_from_trainer - summarization model-index: - name: bart-base-xsum results: - task: type: summarization name: Summarization dataset: name: xsum type: xsum config: default split: test metrics: - type: rouge value: 38.643 name: ROUGE-1 verified: true verifyToken: eyJhbGciOiJFZERTQSIsInR5cCI6IkpXVCJ9.eyJoYXNoIjoiY2E1MTczZDhmODNjNjY2NzU5ZTJlYjM0ZWQ4YmUzN2NhYTExOGYxZTU5YmU5YThjM2FiZmVhMzU5OGE2NGZhNSIsInZlcnNpb24iOjF9.jdp1DkzoLLLpNknLrIC8oxcOKt0si9iK7r3qMuh2UVzSeHr8aG3kMNjpybMw3C9hhb2ebXzUpWok2ILvRSZTBw - type: rouge value: 17.7546 name: ROUGE-2 verified: true verifyToken: eyJhbGciOiJFZERTQSIsInR5cCI6IkpXVCJ9.eyJoYXNoIjoiMDViMTgzYTQxNzFkZTg0NWY2MjgyNGQ0MmVhMDBkMjMyMTllZWM0YzE5ZjQyMmEwY2QxYTViMWMzMDQwNzdiNiIsInZlcnNpb24iOjF9.ja641EZwDrll0akyPOATo9Rqj1uaCpAftziHd0mi5ZuLqCUZsh8H0OLfjvZLNK1JwtkMi3n_P_8UYvmG1tuiAQ - type: rouge value: 32.2114 name: ROUGE-L verified: true verifyToken: eyJhbGciOiJFZERTQSIsInR5cCI6IkpXVCJ9.eyJoYXNoIjoiMWZhN2YxZTI5NGQ1MzRiYTEzZmI4YTRmYzY5NTMxYWVjZTRhODFjZTJlN2VkZWRkNzllOTE5ZTA5OTY2OGNiYiIsInZlcnNpb24iOjF9.hs2yl3ArmJuDo_N87MUWqcJ034sCjD8borR4kE_D91z0aL3NilFdpDk2iuyynE9pCn4JttetiGRLngpMvKekDw - type: rouge value: 32.2207 name: ROUGE-LSUM verified: true verifyToken: eyJhbGciOiJFZERTQSIsInR5cCI6IkpXVCJ9.eyJoYXNoIjoiNWJkMTdmYmJlMGY3ZDg0ZGU4NTk3ZDRiMTg2ODUxZjU3ODJiMGNmZGZiOGFmNDhhZmRkMTE5MTM1YTMwNDI3NiIsInZlcnNpb24iOjF9.nTXRauPJTCmm1Ed4mp4LyIaWKd0OXhK94OAZEnIpN549pMZ19ufrNTuBeXQj6vLQAsaugbrPotBXBPe-Pbp3Dg - type: loss value: 1.8224396705627441 name: loss verified: true verifyToken: eyJhbGciOiJFZERTQSIsInR5cCI6IkpXVCJ9.eyJoYXNoIjoiZDlhYTY5MzFkOGRlNGFjOGZiYzUyYmQ3ZWViNmY2ODZiYzhjNzYyYWZlN2ViZTJiZWEyMDFlYjE0YmIyODY2YyIsInZlcnNpb24iOjF9.96OPA94rxBtQpSiEEk7hBffOa30pe1TslYE9cpZiiwQb7GOCNGeUqjxWmzE0-R1_QluMN527k0dFL1G2KWQwAA - type: gen_len value: 19.7028 name: gen_len verified: true verifyToken: eyJhbGciOiJFZERTQSIsInR5cCI6IkpXVCJ9.eyJoYXNoIjoiNzU1Njc2YmYxZGM4NjA3ZTMxZmY2YjBmNjhiZmE5YzA5Y2U2NDNjZDM0MWNjZjAwYjYxZWVmNDZjMDc5MGM2YyIsInZlcnNpb24iOjF9.j7cYnDB8LQ_stl35EaHKKJhqavj9mHVroOkzuk88rV8eRWhpksKg-n1FfbXERhxKIUBrQIWszyMUlEvAV5beBQ - task: type: summarization name: Summarization dataset: name: xsum type: xsum config: default split: validation metrics: - type: rouge value: 38.7415 name: ROUGE-1 verified: true verifyToken: eyJhbGciOiJFZERTQSIsInR5cCI6IkpXVCJ9.eyJoYXNoIjoiYjdhZTc4MGUyODM3ZDBjNmVhODRlNDMzNWJmYmNlM2NmZTEwNzc3ZDYwYjllMzc4ZWE4N2FlNWQwNDhjNGZlMiIsInZlcnNpb24iOjF9.a3dZeqsFupDVZOoSrw3FRC7ysZ04930QQKNLLyJkmoSbh6p9J1IVa5Xih3RTmQbYAN2XczTSbpQS7RqpOGE3Dg - type: rouge value: 17.8295 name: ROUGE-2 verified: true verifyToken: eyJhbGciOiJFZERTQSIsInR5cCI6IkpXVCJ9.eyJoYXNoIjoiYTRmN2ZjMDM3NDgwYzVlODcwNmYwZjVlODcxMGE4ZDU5MDQ2ZDdjMjEzZWE2NmNiYzRiZGZmMzkzN2EzZThlYSIsInZlcnNpb24iOjF9.3E8u6Ia8_ri_qcNjshPFEPEyED3cK1dNJr027fdjn0_DjY7PDsnP6pmeNv4YJJSTWTX_itiX69zcdWK5m4WPCQ - type: rouge value: 32.2861 name: ROUGE-L verified: true verifyToken: eyJhbGciOiJFZERTQSIsInR5cCI6IkpXVCJ9.eyJoYXNoIjoiMzllOGNkYWI4MTdiZDc4MjgxZGUzNWZlYzkyNjlhNTQ3Y2JlMmE0NGZiNGRlMGMxNDkxZWViNjk2OTFmNmJiYyIsInZlcnNpb24iOjF9.cqrqGe65cej66-c3JjQebMx3kiM1nGOVMpN0ZbqnCRFoMdqqCIVG3ZjP-LJY3MptXRqk_sWY_O5kMximu5sgCg - type: rouge value: 32.2763 name: ROUGE-LSUM verified: true verifyToken: eyJhbGciOiJFZERTQSIsInR5cCI6IkpXVCJ9.eyJoYXNoIjoiZGNkZWQzMzcwY2YyYjE3OWM1ZmJiMTExYmViNTU2NjExZDdmMTQ4OGZkOGZiYjk1OWQ0YTY5YjU5NTI0YjQwNiIsInZlcnNpb24iOjF9.pLFILxKJ33wPSDByZz-IQv_ujRzypMeblgc3C7_3eO5egte0_hTnjl4u-m8KLGYy7mfVXFHZPpvihwlShrARDg - type: loss value: 1.8132821321487427 name: loss verified: true verifyToken: eyJhbGciOiJFZERTQSIsInR5cCI6IkpXVCJ9.eyJoYXNoIjoiZmRhM2UxMWRhNjk0NmIxODQyNjEyNmEwMzYyYTc3NGZlN2RlNWYyZjE1M2NlNDQyOTM1ZGU2MDQ1OWY1OTYyYyIsInZlcnNpb24iOjF9.ZTCMjc6AwjXjO7mHiVPCSyYX1eAPX5IDbWSckWIQpH7O9qk8Sm4WXST-q26Mtf4WOkn2u26Lf171ATBH5GyCCg - type: gen_len value: 19.7116 name: gen_len verified: true verifyToken: eyJhbGciOiJFZERTQSIsInR5cCI6IkpXVCJ9.eyJoYXNoIjoiM2JjMzcxZTI0MDQ4ZDk3YTVhYTZjYmRiYmM5MWUwNDM0MjFkOWZiYTNlMWQ1NzA3MDMyNTI5MjY4OGY5ZGYwYiIsInZlcnNpb24iOjF9.JJ41buqEz-r4GSHAAB31_gofuzjEm0fgui9ovJJbJZLTcooGHAbYMBuDAZM8ojwFEu6S2VTR0fJE60OCs278Cg --- # bart-base-xsum **Training:** The model has been trained using the script provided in the following repository https://github.com/MorenoLaQuatra/transformers-tasks-templates This model is a fine-tuned version of [facebook/bart-base](https://huggingface.co/facebook/bart-base) on [xsum](https://huggingface.co/datasets/xsum) dataset. It achieves the following results on the evaluation set: - Loss: 0.8051 - R1: 0.5643 - R2: 0.3017 - Rl: 0.5427 - Rlsum: 0.5427 ## Model description More information needed ## Intended uses & limitations More information needed ## Training and evaluation data More information needed ## Training procedure ### Training hyperparameters The following hyperparameters were used during training: - learning_rate: 5e-05 - train_batch_size: 32 - eval_batch_size: 32 - seed: 42 - optimizer: Adam with betas=(0.9,0.999) and epsilon=1e-08 - lr_scheduler_type: linear - lr_scheduler_warmup_steps: 500 - num_epochs: 10 ### Training results | Training Loss | Epoch | Step | Validation Loss | R1 | R2 | Rl | Rlsum | |:-------------:|:-----:|:-----:|:---------------:|:------:|:------:|:------:|:------:| | 0.8983 | 1.0 | 6377 | 0.8145 | 0.5443 | 0.2724 | 0.5212 | 0.5211 | | 0.8211 | 2.0 | 12754 | 0.7940 | 0.5519 | 0.2831 | 0.5295 | 0.5295 | | 0.7701 | 3.0 | 19131 | 0.7839 | 0.5569 | 0.2896 | 0.5347 | 0.5348 | | 0.7046 | 4.0 | 25508 | 0.7792 | 0.5615 | 0.2956 | 0.5394 | 0.5393 | | 0.6837 | 5.0 | 31885 | 0.7806 | 0.5631 | 0.2993 | 0.5416 | 0.5416 | | 0.6412 | 6.0 | 38262 | 0.7816 | 0.5643 | 0.301 | 0.5427 | 0.5426 | | 0.6113 | 7.0 | 44639 | 0.7881 | 0.5645 | 0.3017 | 0.5428 | 0.5428 | | 0.5855 | 8.0 | 51016 | 0.7921 | 0.5651 | 0.303 | 0.5433 | 0.5432 | | 0.5636 | 9.0 | 57393 | 0.7972 | 0.5649 | 0.3032 | 0.5433 | 0.5433 | | 0.5482 | 10.0 | 63770 | 0.7996 | 0.565 | 0.3036 | 0.5436 | 0.5435 | ### Framework versions - Transformers 4.22.1 - Pytorch 1.11.0+cu113 - Datasets 2.0.0 - Tokenizers 0.11.6