EMBEDDING_DISTANCE = 'embedding_distance'¶
Compare a prediction to a reference label using embedding distance.
PAIRWISE_EMBEDDING_DISTANCE = 'pairwise_embedding_distance'¶
Compare two predictions using embedding distance.
JSON_VALIDITY = 'json_validity'¶
Check if a prediction is valid JSON.
JSON_EQUALITY = 'json_equality'¶
Check if a prediction is equal to a reference JSON.
Examples using EvaluatorType¶
LangSmith Walkthrough
Criteria Evaluation