
# Model details

`minimoe-4L-384H` distilled from `bert-large-uncased` on `Wikipedia`.

repository: [https://github.com/GeneZC/MiniMoE](https://github.com/GeneZC/MiniMoE)
arXiv: [https://arxiv.org/abs/2305.12129](https://arxiv.org/abs/2305.12129)
{"license": "apache-2.0", "datasets": ["wikipedia"]}
transformers pytorch bert dataset:wikipedia arxiv:2305.12129 license:apache-2.0 endpoints_compatible region:us
TAGS
#transformers #pytorch #bert #dataset-wikipedia #arxiv-2305.12129 #license-apache-2.0 #endpoints_compatible #region-us 


# Model details

'minimoe-4L-384H' distilled from 'bert-large-uncased' on 'Wikipedia'.

repository: URL
arXiv: URL
# Model details

'minimoe-4L-384H' distilled from 'bert-large-uncased' on 'Wikipedia'.

repository: URL
arXiv: URL
TAGS
#transformers #pytorch #bert #dataset-wikipedia #arxiv-2305.12129 #license-apache-2.0 #endpoints_compatible #region-us 
 # Model details

'minimoe-4L-384H' distilled from 'bert-large-uncased' on 'Wikipedia'.

repository: URL
arXiv: URL