Results Caching

Spice supports in-memory caching of query results, which is enabled by default for both the HTTP (/v1/sql) and Arrow Flight APIs.

Results caching can help improve performance for bursts of requests and for non-accelerated results such as refresh data returned on zero results.

Results caching employs a least-recently-used (LRU) cache replacement policy with the ability to specify an item expiry duration, which defaults to 1-second.

version: v1beta1
kind: Spicepod
name: app

runtime:
  results_cache:
    enabled: true
    cache_max_size: 128MiB
    eviction_policy: lru
    item_ttl: 1s

Parameter name	Optional	Description
enabled	Yes	true by default
cache_max_size	Yes	Maximum cache size. Default is 128MiB
eviction_policy	Yes	Cache replacement policy when the cached data reaches the cache_max_size. Default and only currently supported value is lru
item_ttl	Yes	Cache entry expiration duration (Time to Live), 1 second by default.