kmemo-guard-tck/dev.kmemo.guard.tck

Package-level declarations

Types

class ConformanceVector(val guard: String, val query: String, val candidate: String, val reject: Boolean, val reason: String?)

One expected decision: a named guard, two prompts, and whether it rejects them.

ConformanceVectors

object ConformanceVectors

The conformance vectors: what each guard in the specification decides, pair by pair.

CorpusScore

class CorpusScore(val corpus: String, val nearMisses: Int, val paraphrases: Int, val caught: Int, val falseRejections: Int, val directionDisagreements: Int)

One guard's confusion matrix on one corpus.

GuardComplianceReport

class GuardComplianceReport(val guard: String, val scores: List<CorpusScore>)

A guard measured across every corpus it was run against, as data and as a printable table.

GuardCorpus

class GuardCorpus(val name: String, val pairs: List<GuardPair>)

A labelled set of prompt pairs a guard can be measured against.

GuardPair

class GuardPair(val a: String, val b: String, val shouldMatch: Boolean, val category: String = "uncategorised")

Two prompts and a verdict on whether one's cached answer may serve the other.

MatchGuardContract

abstract class MatchGuardContract

What a guard may and may not do, beyond what the tests check.

ScoreInterval

class ScoreInterval(val successes: Int, val trials: Int, val low: Double, val high: Double)

A measured rate with the range the sample it came from actually supports.

VectorMismatch

class VectorMismatch(val vector: ConformanceVector, val actual: Boolean)

One vector that a guard did not reproduce.