You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
@jtjohnston brought up some concerns about how the ConfusionMatrix metric details hallucinations separately. The primary concern is that it is not fully clear how hallucinations relate to overall false-positives and how it relates to the confusion matrix value.
Feature Description
Under the confusion matrix metric:
Rename hallucinations to unmatched_predictions
Rename missing_predictions to unmatched_ground_truths
Additional Context
No response
The text was updated successfully, but these errors were encountered:
Feature Type
Adding new functionality to valor
Changing existing functionality in valor
Removing existing functionality in valor
Problem Description
@jtjohnston brought up some concerns about how the
ConfusionMatrix
metric detailshallucinations
separately. The primary concern is that it is not fully clear how hallucinations relate to overall false-positives and how it relates to the confusion matrix value.Feature Description
Under the confusion matrix metric:
hallucinations
tounmatched_predictions
missing_predictions
tounmatched_ground_truths
Additional Context
No response
The text was updated successfully, but these errors were encountered: