kdrant-core/dev.kdrant.model/Tokenizer/WHITESPACE

WHITESPACE

@SerialName(value = "whitespace")

Split on whitespace only, keeping punctuation attached to the token.

Properties

expect val name: String

expect val ordinal: Int