Check for inconsistent relevance values — check_repair_relevance

Internal helper function to check a comparison matrix for inconsistent relevance values of gold standard and predicted labels.

check_repair_relevance_compare(
  gold_vs_pred,
  ignore_inconsistencies = options::opt("ignore_inconsistencies")
)

Arguments

gold_vs_pred: As created by create_comparison.
ignore_inconsistencies: Warnings about data inconsistencies will be silenced. (Defaults to FALSE, overwritable using option 'casimir.ignore_inconsistencies' or environment variable 'R_CASIMIR_IGNORE_INCONSISTENCIES')

A valid comparison matrix with possibly corrected relevance values, being compatible with compute_intermediate_results.