This is distilled model from Bert Base uncased. It has 6 layers, 6 heads and 384 hidden Size. It has 29.8M parameter. Performance wise, it has the potential of 87% performance of bert base with has 12 layers and 12 heads with 110M parameters.
{"license": "other"}
transformers pytorch bert text-classification license:other autotrain_compatible endpoints_compatible region:us
TAGS
#transformers #pytorch #bert #text-classification #license-other #autotrain_compatible #endpoints_compatible #region-us 

This is distilled model from Bert Base uncased. It has 6 layers, 6 heads and 384 hidden Size. It has 29.8M parameter. Performance wise, it has the potential of 87% performance of bert base with has 12 layers and 12 heads with 110M parameters.
TAGS
#transformers #pytorch #bert #text-classification #license-other #autotrain_compatible #endpoints_compatible #region-us 
