kmemo-guard-tck/dev.kmemo.guard.tck/CorpusScore

CorpusScore

class CorpusScore(val corpus: String, val nearMisses: Int, val paraphrases: Int, val caught: Int, val falseRejections: Int, val directionDisagreements: Int)

One guard's confusion matrix on one corpus.

The two numbers that matter are caught and falseRejections, and neither means anything without the other. A guard that catches everything by rejecting everything has turned a cache into an expensive proxy; a guard that never falsely rejects because it never fires does nothing while looking like it does something. Read them as a pair, always.

Constructors

constructor(corpus: String, nearMisses: Int, paraphrases: Int, caught: Int, falseRejections: Int, directionDisagreements: Int)

Properties

val catchRate: Double

Share of near misses rejected, in [0.0, 1.0]. 0.0 when the corpus has none.

catchRateInterval

val catchRateInterval: ScoreInterval

catchRate with the range the corpus supports.

val caught: Int

Near misses this guard rejected: wrong answers it would have stopped.

val corpus: String

The corpus these numbers came from.

directionDisagreements

val directionDisagreements: Int

Pairs where the guard's verdict depends on which prompt arrived first.

falseRejectionRate

val falseRejectionRate: Double

Share of paraphrases wrongly rejected, in [0.0, 1.0]. 0.0 when the corpus has none.

falseRejectionRateInterval

val falseRejectionRateInterval: ScoreInterval

falseRejectionRate with the range the corpus supports.

falseRejections

val falseRejections: Int

Paraphrases this guard rejected: real hits it would have cost, one API call each.

val nearMisses: Int

Pairs whose answers must differ.

val paraphrases: Int

Pairs whose answers may be shared.

Functions

open override fun toString(): String