Scalar

data class Scalar(val quantile: Float? = null, val alwaysRam: Boolean? = null, val memory: Memory? = null) : QuantizationConfig

Scalar (int8) quantization.

Constructors

Link copied to clipboard
constructor(quantile: Float? = null, alwaysRam: Boolean? = null, memory: Memory? = null)

Properties

Link copied to clipboard

Keep quantized vectors in RAM regardless of the main storage config.

Link copied to clipboard

Memory placement of the quantized vectors. Overrides alwaysRam when both are set.

Link copied to clipboard

Quantile in [0.5, 1.0] used to clip outliers; null uses the full value range.