
Compound normalization model from [CompoundPiece: Evaluating and Improving Decompounding Performance of Language Models](https://arxiv.org/abs/2305.14214).

## Usage

```
from transformers import pipeline

pipe = pipeline("text2text-generation", "benjamin/compoundpiece")

pipe("Hauswirtschaftslehre", max_length=32)
# [{'generated_text': 'Haus-Wirtschaft-Lehre'}]
```

# Citation

```
@article{minixhofer2023compoundpiece,
  title={CompoundPiece: Evaluating and Improving Decompounding Performance of Language Models},
  author={Minixhofer, Benjamin and Pfeiffer, Jonas and Vuli{\'c}, Ivan},
  journal={arXiv preprint arXiv:2305.14214},
  year={2023}
}
```

# License

MIT
{"language": ["af", "az", "be", "bg", "bn", "ca", "cs", "cy", "da", "de", "el", "en", "eo", "es", "et", "eu", "fa", "fi", "fr", "fy", "ga", "gl", "gu", "he", "hi", "hu", "hy", "id", "is", "it", "ka", "kk", "ky", "la", "lt", "lv", "mg", "mk", "ml", "mt", "nl", "pa", "pl", "pt", "ro", "ru", "sk", "sq", "sv", "ta", "te", "th", "tr", "uk", "yi", "yo"], "license": "mit", "datasets": ["benjamin/compoundpiece"]}
transformers pytorch jax t5 text2text-generation af az be bg bn ca cs cy da de el en eo es et eu fa fi fr fy ga gl gu he hi hu hy id is it ka kk ky la lt lv mg mk ml mt nl pa pl pt ro ru sk sq sv ta te th tr uk yi yo dataset:benjamin/compoundpiece arxiv:2305.14214 license:mit autotrain_compatible endpoints_compatible has_space text-generation-inference region:us
TAGS
#transformers #pytorch #jax #t5 #text2text-generation #af #az #be #bg #bn #ca #cs #cy #da #de #el #en #eo #es #et #eu #fa #fi #fr #fy #ga #gl #gu #he #hi #hu #hy #id #is #it #ka #kk #ky #la #lt #lv #mg #mk #ml #mt #nl #pa #pl #pt #ro #ru #sk #sq #sv #ta #te #th #tr #uk #yi #yo #dataset-benjamin/compoundpiece #arxiv-2305.14214 #license-mit #autotrain_compatible #endpoints_compatible #has_space #text-generation-inference #region-us 


Compound normalization model from CompoundPiece: Evaluating and Improving Decompounding Performance of Language Models.

## Usage



# License

MIT
## Usage # License

MIT
TAGS
#transformers #pytorch #jax #t5 #text2text-generation #af #az #be #bg #bn #ca #cs #cy #da #de #el #en #eo #es #et #eu #fa #fi #fr #fy #ga #gl #gu #he #hi #hu #hy #id #is #it #ka #kk #ky #la #lt #lv #mg #mk #ml #mt #nl #pa #pl #pt #ro #ru #sk #sq #sv #ta #te #th #tr #uk #yi #yo #dataset-benjamin/compoundpiece #arxiv-2305.14214 #license-mit #autotrain_compatible #endpoints_compatible #has_space #text-generation-inference #region-us 
 ## Usage # License

MIT