QuantizationConfig

sealed interface QuantizationConfig

Vector quantization, to shrink a collection's memory footprint. Build with Scalar or Binary.

Inheritors

Types

Link copied to clipboard
data class Binary(val alwaysRam: Boolean? = null) : QuantizationConfig

Binary quantization (1 bit per dimension) — the smallest footprint.

Link copied to clipboard
data class Scalar(val quantile: Float? = null, val alwaysRam: Boolean? = null) : QuantizationConfig

Scalar (int8) quantization.