Hugging Face's logo

lgessler
/
microbert-indonesian-m

Feature Extraction
Transformers
PyTorch
Indonesian
bert
text-embeddings-inference
Inference Endpoints
Model card Files Community
1
Edit model card

This is a MicroBERT model for Indonesian.

  • Its suffix is -m, which means that it was pretrained using supervision from masked language modeling.
  • The unlabeled Indonesian data was taken from a June 2022 dump of Indonesian Wikipedia, downsampled to 1,439,772 tokens.
  • The UD treebank UD_Indonesian-GSD, v2.10, totaling 122,021 tokens, was used for labeled data.

Please see the repository and the paper for more details.

Downloads last month
8
Inference Examples
Feature Extraction
This model does not have enough activity to be deployed to Inference API (serverless) yet. Increase its social visibility and check back later, or deploy to Inference Endpoints (dedicated) instead.