CachingChatModel
constructor(delegate: ChatModel, cache: SemanticCache, scope: (ChatRequest) -> String = { SemanticCache.DEFAULT_SCOPE })
Parameters
delegate
the model to cache in front of.
cache
the semantic cache to serve from.
scope
derives the cache scope from a request; constant SemanticCache.DEFAULT_SCOPE by default.