kmemo-core/dev.kmemo.calibration

Package-level declarations

Types

data class CalibrationReport(val pairCount: Int, val matchingPairs: Int, val guardVetoes: Int, val outcomes: List<ThresholdOutcome>, val recommended: ThresholdOutcome, val safest: ThresholdOutcome?, val bestF1: ThresholdOutcome)

Result of a threshold sweep.

data class PromptPair(val a: String, val b: String, val shouldMatch: Boolean, val label: String? = null)

Two prompts and a verdict on whether one's cached answer may serve the other.

class ThresholdCalibrator(embedder: Embedder, guards: List<MatchGuard> = MatchGuards.standard())

Finds the similarity threshold that fits your embedding model, by measuring instead of guessing.

data class ThresholdOutcome(val threshold: Double, val truePositives: Int, val falsePositives: Int, val trueNegatives: Int, val falseNegatives: Int)

How one threshold performed over the whole set of pairs.