NLU-Speech-MASSIVE-finetune / eval /debug_nlu_2 /predict_test_ar_SA_results.json
Beomseok-LEE's picture
Upload folder using huggingface_hub
8048f3a verified
{
"predict_ex_match_acc": 0.6422326832548756,
"predict_ex_match_acc_stderr": 0.00878974045469875,
"predict_intent_acc": 0.8254875588433087,
"predict_intent_acc_stderr": 0.006959819569927037,
"predict_loss": 0.18552251160144806,
"predict_runtime": 59.3381,
"predict_samples": 2974,
"predict_samples_per_second": 50.12,
"predict_slot_micro_f1": 0.7600713012477719,
"predict_slot_micro_f1_stderr": 0.0034290701417012625,
"predict_steps_per_second": 1.567
}