DEFAULT_SCOPE
Scope used when a caller does not name one.
Fine for a single model with fixed parameters. The moment a second model, a second system prompt or a second tenant shares the cache, pass an explicit scope instead.
Scope used when a caller does not name one.
Fine for a single model with fixed parameters. The moment a second model, a second system prompt or a second tenant shares the cache, pass an explicit scope instead.