Scalar

data class Scalar(val quantile: Float? = null, val alwaysRam: Boolean? = null) : QuantizationConfig

Scalar (int8) quantization.

Constructors

Link copied to clipboard
constructor(quantile: Float? = null, alwaysRam: Boolean? = null)

Properties

Link copied to clipboard

Keep quantized vectors in RAM regardless of the main storage config.

Link copied to clipboard

Quantile in [0.5, 1.0] used to clip outliers; null uses the full value range.