Spice.ai OSS Blog

Spice v2.2.0 (Aug 25, 2026)

Tue, 25 Aug 2026 00:00:00 GMT

Spice v2.2.0 is now available! 🚀

Spice v2.2.0 focuses on real-time data, performance, and stability. Cloud Connect links self-hosted runtimes to Spice.ai Cloud for management and observability. MySQL datasets and PostgreSQL catalogs can now stream source changes into accelerated datasets. Debezium sources can send CDC events directly without Kafka. Warm in-memory indexes improve vector and full-text search performance.

Highlights in v2.2.0 include:

Cloud Connect — link self-hosted runtimes for BYOC (Bring Your Own Cloud) to Spice.ai Cloud for management and observability
MySQL CDC — MySQL tables now stay in sync in real time using MySQL binlog replication, with no Kafka or Debezium infrastructure and no scheduled refreshes
PostgreSQL Catalog CDC — accelerate an entire PostgreSQL database in real time with a few lines of configuration and no per-table setup
Faster Search — vector and full-text search can now serve from an in-memory index by default, with no configuration change

What's New in v2.2.0

Cloud Connect

Spice Cloud Connect is a feature of Spice.ai Cloud.

Spice Cloud Connect links self-hosted runtimes for BYOC (Bring Your Own Cloud) to Spice.ai Cloud for management and observability. Run spice cloud link to enroll a standalone runtime.

Try it with the Cloud Connect on a Development Machine recipe.

MySQL Change Data Capture

The MySQL Data Connector now supports refresh_mode: changes. The runtime loads an initial snapshot of the table. It then applies inserts, updates, and deletes from the MySQL binlog as they commit. The acceleration stays current without scheduled refreshes.

datasets:
  - from: mysql:orders
    name: orders
    params:
      mysql_host: localhost
      mysql_db: mydb
      mysql_user: replicator
      mysql_pass: ${secrets:mysql_pass}
    acceleration:
      engine: cayenne
      refresh_mode: changes

Failover-safe GTID positions: When the source server has GTID enabled, the runtime tracks the replication position as a GTID set. A GTID position stays valid across a replica promotion, so replication survives a failover to a new primary without a rebuild.

PostgreSQL Catalog CDC

The PostgreSQL Catalog Connector is now Beta with new Catalog CDC acceleration support at Alpha.

A PostgreSQL catalog can now use refresh_mode: changes. One configuration replicates every table that the include patterns match. Queries then read fresh PostgreSQL data with no per-table setup.

catalogs:
  - from: pg
    name: pg
    include:
      - 'public.*'
    params:
      pg_host: localhost
      pg_db: mydb
      pg_user: postgres
      pg_pass: ${secrets:pg_pass}
    acceleration:
      refresh_mode: changes

Known limitations while catalog CDC acceleration is Alpha: configuration may change; a table dropped and recreated in the source can serve rows captured before it was recreated (#12110); and a durable catalog acceleration can come back empty after a restart (#12729). Feedback is welcome in #11850.

Debezium CDC Without Kafka

Any Debezium source plugin can now stream change events directly into Spice, with no Kafka bus in between. A dataset with from: cdc:… accepts change events at POST /v1/datasets/{name}/cdc, in JSON or Avro. The existing Kafka path (from: debezium:…) is unchanged.

Faster Search with Warm In-Memory Indexes

Search adds a warm in-memory tier for vector and full-text indexes. The runtime writes each change to the warm tier and to the durable store together. Queries read the warm tier first and fall back to the durable store. The warm tier covers vector indexes, full-text indexes, .vectors datasets, views, and chunked Elasticsearch vector columns.

More search improvements:

cosine_distance uses SIMD instructions through the simsimd library.
Full-text search applies stemming by default.
Full-text search pushes SQL filters down into the tantivy index.
A delete now removes the document from full-text and vector indexes. BM25 statistics no longer count superseded documents.
The runtime loads local rerankers from text-embeddings-inference models.
The runtime validates vector search parameters before it runs the SQL query.

Operations & Observability

Query timeout: The new runtime.query.timeout setting bounds the duration of every query. An expired query fails with HTTP 504 or gRPC DEADLINE_EXCEEDED.

runtime:
  query:
    timeout: 30s

CPU sizing for Kubernetes pods without a CPU limit: A Spice runtime pod with a CPU request and no CPU limit now sizes itself to twice the request instead of every core on the node. Set SPICE_CPU_CORES=all (or runtime.cpu.cores: all) to burst to all cores, for example when a 0.5-core request runs on a 24-core node.
Trace IDs in logs: Every log record from a query carries the query's trace ID. Filter the logs by one ID to see everything that query did.
Improved dashboards: The Grafana and Datadog dashboards add new and improved panels, and support multi-replica and Kubernetes deployments.
Helm: The Helm chart supports a custom Deployment strategy and StatefulSet updateStrategy.
Dataset status: A non-accelerated dataset now shows the Error state when its source is unavailable, instead of appearing healthy while queries fail.

Other Notable Improvements and Bug Fixes

Drasi (Alpha): The runtime forwards CDC changes and runtime tables to a Drasi source.
Microsoft SQL Server: Kerberos integrated authentication now works on Unix.
HTTP connector: OAuth2 client-credentials authentication.
Oracle DATE: Values lost their time of day. They now map to a timestamp.
Catalog exclude patterns: The Glue and Cayenne catalogs ignored exclude patterns. Both pattern lists now apply.
Spice Cayenne schema changes: Partitioned accelerations could report a source schema change as applied while partitions kept the old schema. This mismatch caused lossy casts or append failures. Cayenne now rejects in-place evolution for partitioned accelerations. The configured schema-change policy then handles the change.
Snowflake NUMBER values: The connector could remove fractional digits during schema discovery. It treated numeric metadata as absent and defaulted the scale to zero. It now preserves the source precision and scale.

See the Changelog for the full list of fixes.

SDK Updates

Updated SDKs release alongside v2.2.0:

spice.js v3.2.0 — adds query cancellation (listActiveQueries/cancelActiveQuery), mTLS client certificates, HTTP fallback when Flight is unavailable, and typed parameter binding via Flight SQL prepared statements. Also fixes nsql() and search() response handling and named parameters over HTTP.
spicepy v4.0.0 — adds streaming of large results, natural-language queries (nsql), vector and hybrid search, and query cancellation. Spice.ai Cloud users need this update: the legacy hostnames are retired in favor of region-specific endpoints.
spice-rs v4.0.0 — adds search, NSQL, async queries, query cancellation, and mTLS.

Dependency Updates

Dependency / Component	Version
DataFusion	v54.1
iceberg-rust	v0.10.0
Turso	v0.7.2
Rust toolchain	v1.96.1

New Contributors

@boittega made their first contribution in #11509
@lesbass made their first contribution in #12253

Contributors

Breaking Changes

CPU sizing for Kubernetes pods without a CPU limit: A Spice runtime pod with a CPU request and no CPU limit now sizes itself to twice the request instead of every core on the node. Set SPICE_CPU_CORES=all (or runtime.cpu.cores: all) to keep the previous behavior, or set runtime.cpu.cores to a specific core count.
Partitioned DuckDB accelerations are removed: The DuckDB accelerator now rejects partition_by. Use the Cayenne or Arrow accelerator for partitioned datasets.
Adaptive Cayenne tuning requires an explicit opt-in: An unset cayenne_tuning now resolves to auto. Set cayenne_tuning: adaptive to enable the closed-loop controller.
ONNX ML inference is removed: The runtime no longer loads ONNX models, and it no longer serves the /v1/predict endpoints. Use an LLM model provider instead.
One process-wide Vortex segment cache: Cayenne tables now share one segment cache instead of one cache per table. Set cayenne_segment_cache_mb under runtime.params to size it. When unset, the cache takes 1/64 of the memory entitlement, clamped to 256 MiB - 2 GiB.
The Pingora cache engine is now a Spice.ai Enterprise feature: An OSS build with engine: pingora degrades to the Moka engine and logs the substitution.
Deprecated settings: pg_replication_temporary_slot is deprecated. cayenne_segment_cache_mb at the table level is deprecated — set it under runtime.params instead. This release renames the MongoDB num_docs_to_infer_schema setting to schema_infer_max_records. The old name still works and warns.

Cookbook Updates

Added a new recipe for MySQL CDC (Binlog Replication): stream real-time changes from a MySQL table into Spice with refresh_mode: changes.
Added a new recipe for Aurora MySQL CDC (Binlog Replication): the same CDC setup for an AWS-hosted Amazon Aurora MySQL cluster.
Added a new recipe for PostgreSQL Catalog CDC: replicate every table of a PostgreSQL database with one catalog configuration.
Added a new recipe for Cloud Connect on a Development Machine: connect a local Spice instance to Spice.ai Cloud, deploy live changes, and deliver a secret.

The Spice Cookbook includes more than 104 recipes to help you get started with Spice quickly and easily.

Upgrading

To upgrade to v2.2.0, use one of the following methods:

CLI:

spice upgrade

Homebrew:

brew upgrade spiceai/spiceai/spice

Docker:

Pull the spiceai/spiceai:2.2.0 image:

docker pull spiceai/spiceai:2.2.0

For available tags, see DockerHub.

Helm:

helm repo update
helm upgrade spiceai spiceai/spiceai --version 2.2.0

AWS Marketplace:

Spice is available in the AWS Marketplace.

What's Changed

Changelog

feat(testoperator): --prepare-only / --skip-prepare for htap source reuse by @bjchambers in #11486
test(cluster): de-flake scheduler_failover (drop unreliable scheduler_node assertion) by @phillipleblanc in #11518
feat(cayenne): wire orphaned-DV cleanup knob to spicepod params + doc sync by @bjchambers in #11523
fix(cayenne): warn (not panic) on benign manifest/listing race; re-enable now-passing ignored tests by @lukekim in #11511
fix(datafusion): accurate projected scan byte size so hash joins build the smaller side by @sgrebnov in #11503
fix(cayenne): seed persisted num_rows for hash-join sizing by @sgrebnov in #11515
fix(cayenne): user-visible DELETE WHERE pk IN (...) reports the real row count by @lukekim in #11514
test(cayenne): CDC convergence/resurrection fuzz harness by @bjchambers in #11502
fix(cayenne): correctness & memory_limit fixes from perf audit (2 P0, 3 P1) by @lukekim in #11516
perf(cayenne): compaction IO-hygiene follow-ups — input-page evict + O_DIRECT writer + bench by @lukekim in #11498
Update end_game.md by @bjchambers in #11535
chore: Vendor ttf-parser, lopdf, pdf-extract by @peasee in #11521
fix: Update tpch benchmark snapshots for federated/mysql[catalog].yaml by @app/github-actions in #11531
Fix s3 vectors API by @krinart in #11536
Update from spiceai/datafusion#177 by @Jeadie in #11541
perf(cayenne): off-write_lock N>1 mem-tier checkpoint + adaptive query-admission throttle by @lukekim in #11538
fix(flightsql): propagate bearer token to per-endpoint clients by @boittega in #11509
fix: Placeholder table initialization lock swap by @peasee in #11540
chore(cluster): bump ballista pin for the null-aware anti-join fix by @phillipleblanc in #11544
fix(runtime-tools): fix memory table identifier validation rejecting valid names by @Jeadie in #11546
test(chbench): enable 4-way mem-tier PK sharding on SF1000 memory-durability configurations by @sgrebnov in #11553
fix(reorder): reorder inner-join islands inside EXISTS / NOT EXISTS by @sgrebnov in #11552
feat(cayenne): enable orphaned-DV cleanup by default (per-table threshold 20) by @bjchambers in #11533
fix(postgres): delete old key on CDC primary-key updates by @phillipleblanc in #11551
Properly exclude vendored crates from make lint-rust-fix by @krinart in #11560
fix: arrow IndexedMemTable serves stale results after DML/retention/sync (fixes #11262) by @claudespice in #11532
perf(cayenne): concurrent per-shard mem-tier checkpoint encode (drain parallelism) by @lukekim in #11558
fix(physical-plan): estimate col=literal selectivity from NDV, not the flat 20% default (Datafusion) by @sgrebnov in #11562
fix: Read Postgres DB source error when available by @peasee in #11566
feat(cayenne): cold object-store tier with read-optimized clustering by @lukekim in #11543
Generic CDC replication-lag metric by @krinart in #11554
fix: ignore transitive quick-xml advisories (RUSTSEC-2026-0194/0195) in cargo-deny by @krinart in #11571
test(chbench): add cold-object-store-tier SF-1000 HTAP run; cap SF-1000 mem-tier at 1 GiB by @lukekim in #11573
fix: surface silent Turso read-path conversion failures (fixes #11276) by @claudespice in #11570
feat(testoperator): emit P99 + Max replication lag and staleness telemetry for HTAP by @sgrebnov in #11572
feat(runtime): cost-based eager aggregation, enabled by default (datafusion spiceai-54) by @bjchambers in #11446
Bump datafusion to include spiceai/datafusion#181 by @Jeadie in #11563
fix(cayenne): drain in-flight maintenance before in-process reopen (mutation_property flake) by @bjchambers in #11578
Unified JSON nesting by @krinart in #11555
feat(testoperator): capture under-load EXPLAIN plans as HTAP artifacts by @sgrebnov in #11576
feat(cayenne): freshness-SLO-driven adaptive mem-tier shrink (+ freshness diagnostics) by @lukekim in #11574
fix(cayenne): fold un-checkpointed mem-tier keys into the cold keyset rebuild by @lukekim in #11592
perf(cayenne): reuse the PK RowConverter across the sharded CDC apply by @lukekim in #11590
Add labels to spiceai-dev by @krinart in #11591
Rename mongo num_docs_to_infer_schema (deprecated) -> schema_infer_max_records by @krinart in #11593
fix(postgres): don't ACK replication slot past uncommitted envelopes on empty transactions by @bjchambers in #11582
refactor(connectors): extract abfs, adbc, cosmosdb, ducklake, gcs, git, github, glue, kafka, snowflake-native, spiceai into data-connectors crates by @Jeadie in #11407
Revert "Generic CDC replication-lag metric" by @lukekim in #11600
refactor(cayenne): remove orphaned-DV cleanup spicepod param, make it always-on by @bjchambers in #11575
fix(mongodb): substitute delete when UpdateLookup finds no document by @bjchambers in #11583
ci(chbench): SF1000 tuned+adaptive every 3h, other configs once daily by @lukekim in #11601
feat(cayenne): add integer support to maintained AVG by @bjchambers in #11564
Refresh spidapter Spice Cloud token from client credentials by @krinart in #11594
fix: cluster filtered COUNT(*) on append-only tables returns unfiltered total (fixes #11599) by @claudespice in #11603
fix(scylladb): error on lossy CQL decimal conversion instead of silent truncation/NULL (fixes #11267) by @claudespice in #11604
ci(chbench): drop postgres-arrow and tuned (non-memory) from scheduled HTAP runs by @lukekim in #11606
ci(chbench): lower tuned SF1000 mem-tier max age to 15s for scheduled HTAP runs by @lukekim in #11618
fix(cayenne): fold the un-checkpointed mem-tier into the persisted-bloom PK-index rebuild (SF-100 over-count) by @lukekim in #11609
Potential fix for 1 code quality finding by @lukekim in #11614
fix(postgres): shared replication slot drops WAL for partitioned tables (fixes #11290) by @claudespice in #11607
bench(chbench): add 4-slot CDC variant pod for SF-1000 memory (separate from default) by @bjchambers in #11605
fix(cayenne): don't serve drifted memory-CDC row count as Exact to COUNT(*) by @bjchambers in #11602
chore(deps): vendor pgwire-replication 0.3.2 by @bjchambers in #11617
Add SQL warehouse ID to integration workflow by @Jeadie in #11561
fix(search): cosine_distance returns NULL not NaN for zero-magnitude vectors by @claudespice in #11621
feat(spidapter): tuned + adaptive MongoDB CDC spicepods with scenario selection by @bjchambers in #11579
Potential fixes for 3 code quality findings by @lukekim in #11613
Potential fixes for 2 code quality findings by @lukekim in #11611
Potential fixes for 2 code quality findings by @lukekim in #11615
Potential fix for 1 code quality finding by @lukekim in #11612
feat(cayenne): split mem-tier into ingestion + immutable pieces; advance the replication slot on a cheap periodic seal (default 2s) by @lukekim in #11622
fix(mcp): encode catalog-qualified tool names without '/' (fixes #10894) by @claudespice in #11629
fix(refresh): apply refresh_sql override on manual refresh when source unchanged (fixes #11353) by @claudespice in #11626
fix: report empty accelerated schema instead of misleading missing-column error (fixes #10920) by @claudespice in #11625
fix(imap): store message date as millisecond Timestamp, not seconds in Date64 (fixes #11547) by @claudespice in #11624
test(bucket): guard frozen partition-hash output against silent ahash drift (addresses #11277) by @claudespice in #11623
Bump datafusion (spiceai/datafusion#182) and datafusion-table-providers (#27): fix q16 CollectLeft planning error and SQLite q6 wrong revenue by @Jeadie in #11598
fix(cluster): prevent executor flaps and distributed query stalls by @phillipleblanc in #11565
fix(cli): allow spice trace on dynamic MCP/custom tool_use tasks (fixes #10995) by @claudespice in #11630
docs: add clang/lld to arm64 Linux build prerequisites (fixes #11120) by @claudespice in #11632
perf(cayenne): mem-tier visible-batch memo + maintained MIN/MAX IVM by @lukekim in #11631
docs: consolidate agent instructions and fix stale references by @lukekim in #11634
build(deps): bump the github-actions-dependencies group across 2 directories with 7 updates by @app/dependabot in #11627
perf(flight): offload query-result IPC encoding off the IO runtime by @lukekim in #11608
feat(runtime): reservation-aware Cayenne CDC query-memory default (75%→70%) by @lukekim in #11641
Revert "ci(chbench): lower tuned SF1000 mem-tier max age to 15s for scheduled HTAP runs" by @lukekim in #11648
fix(cayenne): don't bump mem-tier version on seal (QPH regression from #11622) by @lukekim in #11649
feat(cayenne): vendor versioned row_converter module (byte-compatible with arrow-row 58.3.0) by @phillipleblanc in #11654
fix(flightsql): advertise analyzed query schemas by @phillipleblanc in #11656
feat(cayenne): bounded append freshness — segmented stream publishing + publish-triggered executor stats broadcast by @phillipleblanc in #11620
fix(postgres): decouple replication keepalive/feedback from apply backpressure by @bjchambers in #11653
fix: bump DataFusion for eager decimal SUM schema by @phillipleblanc in #11657
fix(cayenne): stop mem-tier snapshot storms under memory pressure and byte-range splitting of small snapshot scans by @sgrebnov in #11645
fix(ducklake): add opt-in automatic_migration to attach older catalogs (fixes #10899) by @claudespice in #11635
ci(e2e): tolerate empty-type DuckDB variant of the parquet-rename race by @claudespice in #11636
build(deps): bump the aws-sdk group with 3 updates by @app/dependabot in #11628
ci(chbench): FIFO-queue HTAP runs via concurrency queue: max; simplify dispatcher by @bjchambers in #11659
fix(bucket): guard against ahash AES-path re-bucketing of partition data (fixes #11277) by @claudespice in #11665
fix(cayenne): gate metastore reinsert_sequence schema behind a user_version (fixes #11291) by @claudespice in #11651
fix(cayenne): durable CDC delete keeps the pk IN (...) fast path (fixes #11633) by @lukekim in #11642
ci(chbench): make scheduled HTAP runs adaptive-only (retire tuned, convert cold tier to adaptive) by @lukekim in #11677
fix(imap): decode text body into content instead of storing raw MIME (fixes #11549) by @claudespice in #11667
feat(cayenne): end-to-end integrity checksums for WAL records and Vortex data files (fixes #11639) by @claudespice in #11646
feat(spidapter): date-prefix per-run MongoDB CDC databases by @bjchambers in #11658
test(cayenne): fuzz mem-tier CDC + seq-prefix bake; harden durable-path count exactness by @bjchambers in #11643
deps: bump spiceai/datafusion to pick up ORDER BY alias unparser fix by @Jeadie in #11655
fix(postgres_replication): size CDC change-batch builders to the transaction row count by @sgrebnov in #11675
Release notes for v2.1.0 by @Jeadie in #11429
perf(pgwire-replication): incremental zero-copy framing (FrameReader) + bounded message size by @lukekim in #11668
fix(cdc): memory-mode changes stream no longer fatally stops on a transient deferred-commit queue (fixes #11644) by @bjchambers in #11678
test: update snapshots from job 84685029883 by @Jeadie in #11569
fix: Distinguish no filters vs lit(false) for RefreshSql distributed accelerations by @peasee in #11596
Fix cargo-deny crossbeam-epoch advisory by @Jeadie in #11681
fix: Update benchmark snapshots for trunk run by @app/github-actions in #11666
chore(deps): upgrade Vortex to 0.76.0 by @lukekim in #11682
refactor: extract runtime-metrics crate, move ComponentType to runtime-api-types by @Jeadie in #11524
feat(cloud-connect): standalone instance adoption by @lukekim in #11060
docs: keep the feature set constant across a session (incremental-build hygiene) by @bjchambers in #11679
feat(mysql): binlog replication for refresh_mode: changes by @lukekim in #11672
feat(cdc): cap keys per durable delete plan + absorb fall-through metrics (#11673) by @bjchambers in #11680
ci(chbench): run scheduled SF1000-adaptive HTAP bench every 6h instead of 3h by @lukekim in #11698
fix: MySQL connector fails to convert unsigned integer types (fixes #8364) by @claudespice in #11691
observability(cdc): localize CDC back-pressure across the ingest pipeline by @bjchambers in #11610
fix(cache): cache empty (zero-row) SQL result sets by @bjchambers in #11699
Update spicepod.schema.json by @Jeadie in #11706
Add support for MysSQL in Ch-Bench by @krinart in #11700
observability(chbench): limit CH-BenCHmark logs to info and above by @bjchambers in #11711
perf(cdc): cache per-dataset metric labels to avoid per-event string copies by @bjchambers in #11712
feat(postgres): pgoutput binary-format CDC decoding + zero-copy decoder by @bjchambers in #11702
Update integration_models.yml by @Jeadie in #11715
fix(cayenne): zero-row append refresh fails with "No such file or directory" by @sgrebnov in #11710
perf(cdc): cut shared-slot Postgres replication pump per-event overhead by @bjchambers in #11709
fix(spicepod): reject unknown fields on columns[] config (fixes #10972) by @claudespice in #11719
feat(cayenne): tier-gated O_DIRECT compaction writer (EBS/NAS network storage) by @lukekim in #11696
fix(cayenne): harden Vortex compaction writes by @phillipleblanc in #11692
perf(vortex): push boolean NOT filters into the Vortex scan by @lukekim in #11721
chore(chbench): cap scheduled HTAP runs at 250K tpmC (rate 9250) by @sgrebnov in #11723
MySQL CH-benCHmark HTAP: SF1 + SF1000 adaptive configs by @krinart in #11722
feat(testoperator): TPC-DS SF100 federated cluster-bench spicepod + default spicehq nodegroup by @phillipleblanc in #11716
refactor(runtime): move AccelerationSource and Acceleration into runtime-acceleration by @Jeadie in #11530
remove(ml): delete model_components crate and ONNX/Tract ML inference by @Jeadie in #11684
ci: dedupe testoperator query_overrides run steps by @Jeadie in #11690
Update search snapshots by @Jeadie in #11714
refactor: use inherent is::() on dyn TableProvider/dyn ExecutionPlan for type checks by @Jeadie in #11585
chore: remove unused BlueOak license allowance by @phillipleblanc in #11762
perf(vortex): remove per-file and per-segment allocations on the scan path by @lukekim in #11733
fix(ci): use GraphQL API to check isLatest in spiced_docker workflow by @Jeadie in #11735
fix(release): use release notes heading as GitHub release title by @Jeadie in #11744
feat(chbench): headline run summary + adaptive slot-topology variants by @bjchambers in #11734
fix(ci): update e2e CLI tests for Windows-no-runtime and chat error wording by @Jeadie in #11717
build(rust): upgrade toolchain to 1.96.1 by @lukekim in #11743
fix(deps): enable reqwest "query" feature for isolated crate builds by @claudespice in #11760
build: define clippy lints in [workspace.lints], opt in every crate by @bjchambers in #11676
refactor(runtime): parameterize table-provider unwrapping by inner-fn set by @Jeadie in #11759
fix(cayenne): retain source deletion index in scan memos to close ABA hazard (fixes #11303) by @claudespice in #11739
fix(mysql): refuse binlog resume across source layout drift by @phillipleblanc in #11761
perf: avoid unnecessary allocations on search hot paths by @phillipleblanc in #11767
feat(spidapter): support cluster_name for private nodegroup targeting by @phillipleblanc in #11740
feat(cayenne): finalize datalake (cold) tier v1 UX, credentials, and e2e integration test by @sgrebnov in #11731
perf(vortex): push CAST(CASE ... END) filters into the Vortex scan by @lukekim in #11729
docs: lead README with real-time analytics-node + CDC messaging (Spice 2.0) by @lukekim in #11774
chore(chbench): extend scheduled HTAP runs to 15m by @lukekim in #11773
perf(cayenne): lazy NDV — compute on file spill, off the inline hot loop by @bjchambers in #11741
ci(rust): install 1.96.1 in workflows that pin the toolchain explicitly by @lukekim in #11769
perf(cdc): deferred parsing — move Postgres CDC decode + build off the shared pump by @bjchambers in #11732
docs: correct sort-kernel SIMD note (AVX2, not AVX-512) by @lukekim in #11771
fix(cayenne): roll cold-tier files at cayenne_cold_target_file_size_mb by @sgrebnov in #11746
docs(cayenne): move the Cayenne technical reference into the repo by @bjchambers in #11775
perf(cayenne): unify upsert PK-key hashing on prehashed XXH3-128 digests by @bjchambers in #11736
perf: avoid unnecessary allocations on query hot paths by @phillipleblanc in #11768
Extended schema inference for mysql by @krinart in #11742
chore(hash-index): add SBBF probe/insert baseline benchmark by @lukekim in #11770
feat(cayenne): incremental datalake promotion, per-file PK blooms, physical GC by @sgrebnov in #11745
test(cayenne): limit property-test concurrency by @phillipleblanc in #11784
perf(cdc): lock-free per-member ack slots + coalescing for shared Postgres replication by @bjchambers in #11779
perf(chbench): speed up MySQL and Postgres seed loading by @bjchambers in #11782
fix(ci): download MinIO client from public-data mirror by @phillipleblanc in #11790
ci: developer sign-off attestation gating the merge queue by @lukekim in #11776
fix(tests): synchronize chat expect prompts correctly by @phillipleblanc in #11802
perf(chbench): default adaptive pod to 4-slot grouping + deep prefetch by @bjchambers in #11799
refactor(cli): replace open crate with in-tree system-open by @phillipleblanc in #11791
refactor(runtime): drop direct rustls-pemfile dependency by @phillipleblanc in #11792
Cache ListingTable file statistics to avoid per-query footer re-parse by @phillipleblanc in #11793
ci: inherit sign-off across clean base merges by @phillipleblanc in #11804
perf(cayenne): hash PK once and skip OwnedRow clone on present path by @bjchambers in #11805
fix(postgres catalog): register partitioned parent, not child partitions by @bjchambers in #11798
fix(postgres catalog): quote foreign-key target identifiers by @bjchambers in #11796
refactor(cayenne): rename remaining cold_* params to cayenne_datalake_* by @sgrebnov in #11795
build: add release-profiling Cargo profile for CPU profiling by @bjchambers in #11807
fix(ci): make CH-benCH template restore robust to leftover replication slots by @sgrebnov in #11811
perf(cayenne): remove eager-NDV escape hatch, speed up per-value NDV hashing by @bjchambers in #11806
Auto-refresh the Attestation check after signoff by @bjchambers in #11815
refactor(duckdb): remove partitioned DuckDB accelerator modes by @lukekim in #11808
feat(testoperator): add option to skip the HTAP analytic gate by @bjchambers in #11810
fix: prevent executor S3 region poisoning before object-store bind by @phillipleblanc in #11766
perf(cayenne): reuse per-batch scratch allocations in KeyBasedDeletionFilterStream by @bjchambers in #11817
Update openapi.json by @app/github-actions in #11816
build(deps): bump the github-actions-dependencies group across 2 directories with 5 updates by @app/dependabot in #11819
fix(task_history): capture ExplainAnalyze metrics from the executed plan by @phillipleblanc in #11794
feat: generic spiced env-var passthrough for HTAP testoperator runs by @bjchambers in #11824
feat(cayenne): datalake tier hardening + row-capped PK-bloom-backed promotion by @sgrebnov in #11812
chore: release finalization for v2.2.0 by @Jeadie in #11738
feat(cayenne): add memory mode (mode: memory) — fully in-RAM accelerator by @lukekim in #11720
Fix secrets in .github/workflows/integration_models.yml. by @Jeadie in #11781
feat(runtime): add runtime.query.timeout parameter by @sgrebnov in #11822
feat(cloud-connect): align proto to canonical, fix enrollment ordering, add TLS e2e by @lukekim in #11829
docs(criteria): mark PostgreSQL Catalog Connector as Alpha by @bjchambers in #11785
test(cayenne): add regression tests for the mid-pass overwrite guard by @sgrebnov in #11844
perf(cayenne): light delta encoding + higher CDC coalescing defaults by @bjchambers in #11826
ci: run Cayenne doc PDF build only on trunk merges by @bjchambers in #11860
fix(cayenne): drain staged Stage-B publishes before cold promotion; add cold-tier fuzz coverage by @sgrebnov in #11847
feat(cayenne): atomic cross-partition append + delete/on-conflict atomicity by @lukekim in #11803
feat(cayenne): min/max maintained aggregates + N>1 CDC retract by @lukekim in #11862
perf(chbench): CSV-based seed loading for MySQL and Postgres by @bjchambers in #11843
fix(tests): re-enable prop_concurrent_cold_sqlite cayenne cold-tier fuzz test by @sgrebnov in #11871
fix(deps): replace yanked spin releases by @phillipleblanc in #11878
fix(cayenne): correct stale mem_checkpoint_lock comment by @bjchambers in #11872
Add run links to testoperator_dispatch.yml by @Jeadie in #11747
Cayenne serializable transactions: gated writes, per-key OCC, multi-table, FlightSQL, durable write-back by @phillipleblanc in #11870
fix(cayenne): partitioned datasets deadlock against the global encode budget and never become ready by @Jeadie in #11825
test(runtime): re-runnable turso file cleanup + bump turso to 0.7.0 by @lukekim in #11783
Use liteparse for PDF document parsing by @Jeadie in #11522
ci: add remote signoff workflow by @Jeadie in #11864
fix(cli): populate org in spice cloud apps --output json (fixes #11041) by @claudespice in #11867
fix(embeddings): restore params broken by #10853 by @Jeadie in #11788
Move cargo advisory checks to scheduled workflow by @Jeadie in #11879
perf(cayenne): bound cold-promotion Z-order sort into streaming byte-capped runs by @sgrebnov in #11890
fix(cayenne): write-back transaction atomicity — stage (not publish) and read mem-tier rows by @phillipleblanc in #11889
fix(runtime-table-partition): restore sound modulo inequality partition pruning by @Jeadie in #11891
Replace dotenvy with in-repo dotenv crate by @phillipleblanc in #11894
Remove unnecessary allocations from results-cache and hot conversion paths by @phillipleblanc in #11895
Increase ready_wait timeout for chbench sf1000 cold-tier configs by @sgrebnov in #11900
fix(mysql): retry binlog checkpoint upsert on transient accelerator write lock by @krinart in #11876
fix(cayenne): gate freshness mem-tier shrink on apply backlog by @lukekim in #11893
fix(postgres catalog): honor unsupported_type_action for catalog-discovered tables by @bjchambers in #11875
fix(postgres): make TPC-H/TPC-DS benchmark CI actually run at SF1/SF10/SF100 by @bjchambers in #11883
feat(search): writethrough compound SearchIndex/VectorIndex with optional fallback by @Jeadie in #11892
Revert "perf(cayenne): light delta encoding + higher CDC coalescing defaults" by @bjchambers in #11910
perf(vss): SIMD-accelerate cosine_distance via simsimd by @Jeadie in #11748
Add run-name to signoff.yml by @Jeadie in #11912
fix(cayenne): serialize cold-tier mem-tier checkpoint by @sgrebnov in #11907
fix(postgres catalog): discover materialized views and foreign tables by @bjchambers in #11874
test(chbench): stronger content fingerprint + MySQL sidecar template caching by @krinart in #11901
test(chbench): align money columns to canonical DECIMAL schema (CMU BenchBase) by @sgrebnov in #11921
fix(cayenne): close per-key OCC missed-conflict holes and fused-txn IVM staleness by @lukekim in #11916
ci(attestation): fast-track pure reverts past developer sign-off by @bjchambers in #11913
fix(cloud-connect): accept the portal's 5-char adoption-code segments by @phillipleblanc in #11926
docs(layering): codify crate tiers + workspace layering guard by @bjchambers in #11919
refactor(cayenne): datalake tiering UX — param rename + tracing by @sgrebnov in #11920
feat(params): typed component params via #[derive(TypedParams)] — embeddings pilot by @Jeadie in #11809
Fix SQlite round type error. by @Jeadie in #11927
fix(signoff): let remote sign-off refresh the Attestation check in CI by @bjchambers in #11929
feat(testoperator): print rows around CH-benCH analytical-gate mismatches by @bjchambers in #11923
fix(postgres catalog): don't abort the whole catalog on one schema's discovery failure by @bjchambers in #11873
ci(signoff): target-lint changed crates before full local/remote gate by @lukekim in #11909
feat(runtime)!: always-on schema inference; remove schema_inference config by @lukekim in #11880
refactor(layering): extract ClickHouse into connector-clickhouse; add restricted_deps guard by @bjchambers in #11931
perf: remove unnecessary allocations on hot query, search, and metrics paths by @phillipleblanc in #11918
Release notes for v2.1.1 by @Jeadie in #11906
refactor(layering): prepare DynamoDB for extraction from runtime by @bjchambers in #11935
Coalesce Null primary keys in RRF. by @Jeadie in #11519
ci(e2e): strip ANSI before duckdb_append graceful-shutdown log whitelist by @phillipleblanc in #11937
feat(catalog): PostgreSQL catalog-level CDC acceleration (changes mode) by @bjchambers in #11897
chbench(mysql): parallel analytical gate, decimal-comparison fix, and reseed/CI hardening by @krinart in #11946
fix: array_any_value panic when output is hash-repartitioned (empty list elements) by @bjchambers in #11952
feat(layering): checkpoint sidecar as per-engine crates + DI the dynamodb connector by @bjchambers in #11938
chore(cluster): pin Ballista to upstream 54 merge tip by @phillipleblanc in #11941
feat(vortex): upgrade fork pins to Vortex 0.79.0 by @lukekim in #11950
chbench(htap): run mysql configs at the shared 9250 rate; 2x converge wait by @sgrebnov in #11956
fix(testoperator): HTAP drain gate false-fails on stale probe observations — final snapshot decides convergence (fixes #11953) by @claudespice in #11966
feat(catalog): replica-identity-aware eligibility for PostgreSQL catalog CDC by @bjchambers in #11951
refactor(layering): extract DynamoDB into connector-dynamodb by @bjchambers in #11960
Add MemoryVectorIndex: in-memory external-store VectorIndex with brute-force exact k-NN by @Jeadie in #11908
ci(signoff): prefer lab SSH for remote sign-off; skip Rust when no .rs changes by @lukekim in #11977
Reapply #11826: light delta encoding + CDC coalescing (SF1000 convergence lever) — gated on #11943 + SF1000 fingerprint run by @lukekim in #11944
docs: align component statuses with signed release criteria by @lukekim in #11970
fix: Spidapter flight auth passthrough by @peasee in #11976
Unified CDC config by @krinart in #11777
feat(cdc): Debezium plugin push ingest to Spice without Kafka by @lukekim in #11955
refactor(connectors): unify registration on the linkme slice; restore schema coverage by @bjchambers in #11972
GTID-based MySQL CDC by @krinart in #11813
test(mysql): ignore mysql_binlog_replication_end_to_end_cayenne by @sgrebnov in #11986
fix(cayenne): support Decimal128 in maintained SUM/AVG aggregates (fixes #11933) by @claudespice in #11979
feat(params): typed params for VectorStore and FtsStore engines by @Jeadie in #11954
chore(layering): remove orphaned dead code from connector extractions by @bjchambers in #11988
feat(cayenne): default-on adaptive cold layout from observed filters (F4) by @lukekim in #11973
fix: Fairly allocate partitions from scheduler assignment cycle only by @peasee in #11853
fix(cli): avoid escaped ANSI version notification by @ewgenius in #11996
MySQL Shared binlog connection by @krinart in #11814
feat(catalog): fail-loud + metrics + by-kind reporting for PostgreSQL catalog CDC (#11850) by @bjchambers in #11983
fix(cayenne): P1 audit — subset compact, SMJ 2.5× HT, mem-tier pool account by @lukekim in #11991
Add OAuth2 client-credentials grant and configurable auth header to HTTP connector by @krinart in #11981
fix(telemetry): validate runtime.telemetry.metric_prefix against OTel name syntax by @ewgenius in #12002
fix(cayenne): purge CDC mem-tier on delete-all/TRUNCATE by @sgrebnov in #12009
Update signoff.yml. by @Jeadie in #11998
feat(dev): add scripts/signoff mine — attestation status across your open PRs by @Jeadie in #11978
refactor(layering): extract MongoDB provider into connector-mongodb by @bjchambers in #11982
perf: remove three unnecessary allocations on the query hot path by @phillipleblanc in #12029
refactor(layering): evacuate cosmosdb/graphql/github/sharepoint providers into their connector crates by @bjchambers in #12024
fix(mysql-cdc): detect source reset on GTID resume by @sgrebnov in #12023
fix(smb): exclude final SESSION_SETUP response from preauth integrity hash (fixes #11148) by @claudespice in #12003
fix(postgres): validate pg_replication_slot names before CDC refresh by @ewgenius in #12001
fix(postgres): honor pg_connection_string for CDC (closes #11994) by @ewgenius in #12000
feat: Support OTLP Histogram ingest, unix nanos time by @peasee in #11992
feat(search): write-through warm + fallback compound index for FTS (#11886) by @Jeadie in #11971
docs: PR-description and code-comment conventions by @bjchambers in #12032
refactor(postgres cdc): consolidate every dataset onto the shared pump by @bjchambers in #12028
feat(cloud-connect): Standalone instance adoption connection by @peasee in #11980
fix(cdc): don't force the durable path on zero-row readiness heartbeats (fixes #12007) by @claudespice in #12030
Upgrade DataFusion to 54.1.0 by @krinart in #11974
perf(github): parallelize serial fetches (commits + workflow logs) by @lukekim in #12017
refactor(layering): evacuate odbc/scylladb/imap/git providers into their connector crates by @bjchambers in #11993
refactor(layering): carve runtime-component out of runtime, break the ArcRuntime cycle by @bjchambers in #12031
feat(mssql): enable tiberius integrated-auth-gssapi for Kerberos integrated auth on Unix by @v1gnesh in #11386
build(deps): bump the aws-sdk group across 1 directory with 5 updates by @app/dependabot in #11821
fix(cayenne): clear a committed CDC upsert's staging WAL at finalize (#12027) by @bjchambers in #12034
feat(catalog): deterministic instance-independent replication slot + fail-loud + restart recovery (#11850) by @bjchambers in #12026
Auto-cap DuckDB accelerator memory to prevent startup over-commit by @lukekim in #11985
perf(refresh): speed up dataset refresh at startup by @lukekim in #12015
fix(cayenne): don't create stray file: directory in memory mode (fixes #11922) by @claudespice in #11940
fix(aws): accept aws_session_token for temporary credentials (fixes #10932) by @claudespice in #12041
fix(mysql): verify an adopted layout against the event's own column types (fixes #11764) by @claudespice in #12048
fix(mysql): take the binlog rotate target from the ROTATE event, not its header offset (fixes #12042) by @claudespice in #12044
fix(search): check dataset readiness before embedding the query (fixes #10956) by @claudespice in #12043
fix(databricks): pin the authentication mode with databricks_auth_mode so an auto-loaded client secret can't switch U2M to M2M (fixes #11508) by @claudespice in #12040
fix(imap): narrow scans with IMAP SEARCH instead of refetching the mailbox (fixes #11548) by @claudespice in #12039
fix(cayenne): rank inference-derived sort columns below observed filter columns by @lukekim in #12049
perf(cayenne): warm-subset compaction + mem-tier memory_limit honesty by @lukekim in #12035
fix(cayenne): purge the mem-tier on delete-all for a table without a primary key (fixes #12072) by @claudespice in #12073
fix(accelerator): let an index declare a finalize failure fatal so a stale index can't report a successful refresh (fixes #12038) by @claudespice in #12050
fix(http): restore a join's embedded projection in HTTP subquery pushdown (fixes #11009) by @claudespice in #12054
fix(e2e): report a REPL that exits mid-script instead of passing the step (fixes #12057) by @claudespice in #12059
fix(imap): fetch the raw message only when a scan reads content (fixes #12045) by @claudespice in #12060
chore: Update Turso crate to 0.7.1 by @claudespice in #12062
feat(chbench): in-memory _bench_ts watermarks for the MySQL HTAP staleness probe by @sgrebnov in #12055
test(chbench): default MySQL adaptive spicepods to one shared binlog dump by @sgrebnov in #12076
feat(search): warm in-memory writethrough/fallback index for .vectors datasets and views by @Jeadie in #11914
fix(search): expunge superseded documents from full-text BM25 statistics (fixes #12053) by @claudespice in #12056
fix(write-back): gate durable write-back on a safe source delivery primitive (fixes #11915) by @claudespice in #12051
fix(cayenne): keep protected snapshots a position-delete rewrite never folded in (fixes #11477) by @claudespice in #12052
ci(signoff): fast-track Attestation for Dependabot and non-Rust PRs, and cut the local gate by @lukekim in #12081
fix(search): reach a compound's inner full-text tier when a change stream attaches (fixes #12061) by @claudespice in #12063
fix(accelerator): report PK equality pushdown Inexact so a point lookup can't return the whole table (fixes #12070) by @claudespice in #12071
fix(github): paginate issues and pull_requests on an immutable sort key so a row touched mid-scan isn't dropped (fixes #12067) by @claudespice in #12069
fix(otel): scope reserved metric column names to the data-point shape (fixes #12064) by @claudespice in #12065
fix(cayenne): sample the subset compaction append fence before the listing it guards (fixes #12074) by @claudespice in #12075
fix(search): drop a search hit whose row is not in the base table (fixes #12089) by @claudespice in #12094
feat(datasets): mark non-accelerated datasets Error when their source is unavailable by @krinart in #12079
fix(models): restore spice.ai/spiceai as a model source by @lukekim in #12092
fix(cayenne): bound the cold PK-index rebuild; build shard views in one pass by @sgrebnov in #12078
fix: Update Search integration test snapshots by @Jeadie in #12077
feat(catalog): view warnings, docs-linked messages, and clearer startup summary for PostgreSQL catalog CDC (#11850) by @bjchambers in #12022
fix(postgres): log the cumulative delivery wait in the sink-stall warning by @sgrebnov in #12093
refactor(cloud-connect): single-source the sealed-secret wire crypto in a shared crate by @peasee in #12124
build(deps): bump quinn-proto from 0.11.14 to 0.11.16 by @app/dependabot in #12037
perf(cayenne): demand-driven scan-view cache with access-based freshness (alternative to #11948) by @bjchambers in #12005
build: exclude libnfs from the nextest workspace run by @phillipleblanc in #12131
build(deps): bump the aws-sdk group across 1 directory with 3 updates by @app/dependabot in #12068
fix(search): keep CDC changes streams working when embeddings wrap a CDC source by @Jeadie in #12086
fix(cli): report a truncated release download as a failed download (fixes #12120) by @claudespice in #12121
fix(postgres): honor inline PEM pg_sslrootcert on the replication path by @phillipleblanc in #12128
refactor(layering): extract RuntimeStatus into a runtime-status crate by @bjchambers in #12115
fix(libnfs): model AUTH as an opaque type so its layout assertion holds by @phillipleblanc in #12132
feat(duckdb): on_full_refresh: replace_file — full refresh into a new database file, atomically replaced by @lukekim in #12135
Add v2.1.2 release notes by @sgrebnov in #12146
feat(duckdb): 'on_full_refresh: checkpoint_file' to bound acceleration file growth by @sgrebnov in #12139
fix(lint): remove unused DuckDBTableWriter import in duckdb accelerator tests by @sgrebnov in #12158
fix(duckdb): drop a file-replacement test assertion that can never hold by @bjchambers in #12178
fix(cayenne): Remove redundant EmptyExec within UnionExec used by CayenneTableProvider::scan by @Jeadie in #12126
build(deps): bump async-openai for aggregated rate-limit logging by @phillipleblanc in #12149
perf(mysql): fast row-image decoder for CDC change builds by @sgrebnov in #12122
feat(catalog): pre-flight replication-slot-capacity check for PostgreSQL catalog CDC (#11850) by @bjchambers in #12114
fix(oracle): map DATE to a timestamp so the time-of-day is not silently truncated (fixes #12096) by @claudespice in #12097
fix(search): skip the warm vector index when nothing hydrates it (fixes #12101) by @claudespice in #12103
refactor(layering): extract the DataAccelerator contract into data-accelerator-api by @bjchambers in #12099
fix(cli): surface the registry error behind a failed spice add instead of blaming the archive (fixes #12116) by @claudespice in #12119
fix(ci): gate Rust checks on the lint config the gate itself reads (fixes #12111) by @claudespice in #12112
fix: Ensure executors report table statistics for distributed plan ordering by @peasee in #11854
fix: EMBED_UDF_NAME without models feature by @krinart in #12136
fix(openai): openai_responses_tools: web_search uses web_search, not web_search_preview by @Jeadie in #12142
fix(ci): cancel workflow runs left behind by superseded merge-queue batches (fixes #12170) by @claudespice in #12177
fix(runtime): return from a readiness wait when the runtime shuts down (fixes #12125) by @claudespice in #12165
perf(postgres): coalesce shared-slot CDC envelopes so a slow sink stops throttling the walsender by @bjchambers in #12147
fix(ci): make cargo_deny_advisories.yml parseable so the Rust advisory scan can run (fixes #12181) by @claudespice in #12182
fix(cluster): run GetTaskHistory under read-only SQL validation by @lukekim in #12174
fix(duckdb): count accelerated views in the coordinated memory budget (fixes #12123) by @claudespice in #12161
fix(ci): run the PR hygiene check on a GitHub-hosted runner by @claudespice in #12163
fix(cayenne): warm PK existence caches at first write; bound keyset memory during bulk load by @sgrebnov in #12133
ci: remote sign-off dispatches GitHub Actions only, never SSH to lab hosts by @lukekim in #12205
Standalone instances: spice connect enroll-only split + connect surface by @krinart in #12143
fix(search): Fix ordering to correct NDCG@k by @Jeadie in #12191
refactor(layering): carry component configuration into connectors and extract data-connector-api by @bjchambers in #12157
fix(logging): mute the candle embedding backend's GeLU notice below -vv by @phillipleblanc in #12194
test: redact connection context in federated explain snapshots by @bjchambers in #11800
Enable deletes for Index, SearchIndex, and VectorIndex by @Jeadie in #11961
feat(testoperator): trace probe latency breaches and percentiles under HTAP load by @sgrebnov in #12209
Add v2.1.1 and 2.1.2 as supported in SECURITY.md by @sgrebnov in #12190
fix(ci): seed the TPC-H Postgres benches from the fleet's dataset and schedule the catalog schema tests by @bjchambers in #12214
fix(cluster): restrict ExpandSecret to spicepod-referenced keys by @lukekim in #12156
test: redact endpoint-URL compute contexts in federated explain snapshots by @bjchambers in #12215
fix(testoperator): a fully-censored table floors worst-P99 at the discard cap by @lukekim in #12196
ci(e2e): tolerate any garbage type token in the duckdb_append parquet-rename race by @bjchambers in #12207
refactor(cloud-connect): update the proto contract for evolvability and versioning by @peasee in #12153
chore(cloud-connect): use port 443 for gateway addresses in the doc example and test fixtures by @phillipleblanc in #12252
fix(ci): authenticate the management API integration suite with secrets that exist (fixes #12184) by @claudespice in #12185
feat(search): add Recall@k, MRR@k, and Precision@k retrieval metrics by @Jeadie in #12193
fix(search): enable stemming by default for full-text search by @Jeadie in #12220
fix: Report query metrics when task history is disabled by @sgrebnov in #12227
fix(runtime): count accelerated views when gating the Cayenne compaction pool (fixes #12164) by @claudespice in #12171
fix(secrets): snapshot the store registry instead of holding its lock across awaits (fixes #12127) by @claudespice in #12166
fix(search): address Elasticsearch deletes by document _id (fixes #12267) by @claudespice in #12273
fix(postgres): deprecate pg_replication_temporary_slot, which could never work (fixes #12213) by @claudespice in #12265
fix(cayenne): always materialize a snapshot directory the catalog may reference (fixes #12208) by @claudespice in #12262
fix(duckdb): size the connection pool for accelerated views too (fixes #12160) by @claudespice in #12169
fix(ci): link brew formulas that are installed but unlinked in setup-cc by @claudespice in #12286
fix(runtime): size memory budgets from the process's own cgroup limit by @lukekim in #12263
Harden dataset availability checks against idle connection resets by @krinart in #12180
test(mysql): harden binlog CDC with dump-reconnect and full type-matrix coverage by @sgrebnov in #12264
fix: send enc_pubkey_pem on /renew for standalone runtime by @phillipleblanc in #12312
Connection-scale client modes for testoperator throughput and load tests by @lukekim in #12280
fix(search): remove all chunk documents when a chunked Elasticsearch index deletes a row (fixes #12088) by @claudespice in #12268
fix(duckdb): run spice_sys DuckDB sidecar writes on the blocking pool (fixes #12175) by @claudespice in #12204
fix(cayenne): the write-concurrency raise must respect the memory brake by @lukekim in #12317
feat(runtime): expose the memory numbers that explain an OOM as gauges by @lukekim in #12195
fix(flightsql): mark stamped statistics inexact when a LIMIT is pushed to the remote scan (fixes #12292) by @claudespice in #12293
fix(deps): bump wasmtime to 47.0.3 to clear RUSTSEC-2026-0222 (fixes #12295) by @claudespice in #12298
fix(telemetry): read the cgroup CPU quota along the whole cgroup path (fixes #12299) by @claudespice in #12300
refactor(layering): move the DataFusion helpers below runtime and derive the federation deny-list from a function registry by @bjchambers in #12210
fix(search): reject a persisted full-text index whose schema no longer matches the configuration (fixes #12274) by @claudespice in #12275
fix(spiced): keep dependency logging and chat progress alive when task history is off (fixes #12279) by @claudespice in #12281
fix(runtime): count a mid-stream response failure as a failure in the HTTP metrics (fixes #12284) by @claudespice in #12291
fix(cluster): mark a coordinator leaf scan's cached executor statistics inexact (fixes #12303) by @claudespice in #12304
fix(runtime): report a memory-pool refusal as ResourcesExhausted and answer it with 503 (fixes #12282) by @claudespice in #12289
fix(cayenne): enforce the sharded PK keyset byte budget; correct per-entry accounting by @lukekim in #12192
fix(runtime): carve the Cayenne compaction memory pool only when a dataset can compact into it (fixes #12320) by @claudespice in #12326
feat(spiced): report fatal signals before exit by @sgrebnov in #12334
bug: Filters on _match fail during planning by @Jeadie in #12247
bug: S3 metadata-filter conversion silently drops unconvertible AND/OR operands by @Jeadie in #12248
fix(ci): reject a failed sign-off on the head commit (fixes #12357) by @claudespice in #12362
ci: let signoff.yml sign off fork PRs by @Jeadie in #12025
fix(search): resolve an append stream through a vector scan (fixes #12313) by @claudespice in #12314
docs: Spice v2.1.3 release notes by @sgrebnov in #12378
bug: MemoryVectorIndex leaves external-store entries on delete. by @Jeadie in #12246
fix(cluster): keep the executor's cluster-service channel alive while idle (fixes #12301) by @claudespice in #12302
fix(https): reject OAuth2 params on structured HTTP file datasets (fixes #12315) by @claudespice in #12321
fix(scheduler): drive the interval-timing tests on a virtual clock (fixes #12323) by @claudespice in #12329
fix(ci): do not report a shutdown-cancelled sidecar task as a failure (fixes #12322) by @claudespice in #12331
fix(logging): let log colour follow the output sink (fixes #12327) by @claudespice in #12335
fix(cayenne): report the auto-tuned config once per resolution (fixes #12330) by @claudespice in #12341
chore: Update Turso crate to 0.7.2 by @claudespice in #12344
fix(runtime): stop retrying a dataset configuration failure that no retry can clear (fixes #12339) by @claudespice in #12345
build(deps): bump the github-actions-dependencies group across 3 directories with 9 updates by @app/dependabot in #12359
feat(llms): GLM 5.2 across 3+ nodes, context_length + paged_attention params, MXFP4 for DeepSeek-V4 by @lukekim in #11990
feat(runtime): size every CPU-derived pool from the CPU entitlement by @bjchambers in #12276
chore(ci): bump the spiceio setup action to v0.5.9 by @lukekim in #12391
feat(testoperator): serve /health and /v1/ready for the HTAP run by @lukekim in #12373
feat(catalog): durable storage modes for PostgreSQL catalog CDC, and let the catalog own its accelerated tables by @bjchambers in #12222
fix(runtime): correctly classify a memory-pool refusal as ResourcesExhausted (fixes #12380) by @sgrebnov in #12382
fix(ci): budget the sign-off run below the pool's job wall (fixes #12340) by @claudespice in #12343
fix(bench): install make before the seeded-database check; surface catalog error causes by @bjchambers in #12372
Clean up SQLite sidecar files in cold bloom catalog test by @sgrebnov in #12404
fix(ci): name an incoherent Cargo.lock before every cargo job fails on it (fixes #12375) by @grokspice in #12423
test(search): exercise the S3 Vectors warm-tier fallback path by @Jeadie in #12197
fix(ci): stop the spiced child E2E cleanup was leaking, scoped to this runner (fixes #12058) by @grokspice in #12431
perf(cayenne): give refresh_mode full its own write profile by @lukekim in #12338
fix(ci): skip the Attestation refresh when the sign-off SHA is no longer the PR head (fixes #12360) by @grokspice in #12433
fix(monitoring): correct p99 queries in the Datadog dashboard by @sgrebnov in #12444
fix(ci): tell an out-of-disk sign-off apart from a failing branch (fixes #12412) by @grokspice in #12426
feat(search): warm in-memory tier for chunked Elasticsearch vector columns by @Jeadie in #12082
Update spicepod.schema.json by @app/github-actions in #12451
fix(search): preserve field names with capitals and '.' by @Jeadie in #12389
fix(ci): size the cayenne property-test timeout ceiling to its measured runtime (fixes #12336) by @grokspice in #12438
fix(models): pass the pinned revision to a HuggingFace embedding model (fixes #12430) by @grokspice in #12446
fix(ci): make the out-of-disk sign-off verdict survive being out of disk (fixes #12427) by @grokspice in #12461
fix(ci): stop Enforce Pulls with Spice racing itself, and let a Dependabot PR pass it (fixes #12377) by @grokspice in #12466
docs: update v2.1.3 release notes for the Iceberg timestamptz fix (trunk sync) by @phillipleblanc in #12459
fix(ci): install protoc before building the spice CLI in the E2E CLI workflow by @phillipleblanc in #12449
fix(ci): reject an if: naming a context GitHub does not provide there (refs #12396) by @grokspice in #12468
fix(monitoring): align Datadog dashboard with OTel service instance identity by @ewgenius in #12454
chore(ci): bump the spiceio setup action to v0.5.10 by @lukekim in #12490
test(cayenne): query result correctness vs standalone engines and Spice accelerators by @lukekim in #12098
fix(elasticsearch): keep the response body out of errors on the row-data request paths (fixes #12409) by @grokspice in #12456
fix(ci): key the sign-off concurrency group on the commit, not the dispatch input (fixes #12472) by @grokspice in #12474
perf(ci): run the workspace unit-test gate in one cargo invocation by @bjchambers in #12437
feat(monitoring): Runtime Resources observability on Grafana dashboard by @ewgenius in #12441
fix(ci): report cache health on the build failures it explains (refs #12420) by @grokspice in #12471
fix: resolve fixed-offset timezones when writing Vortex files by @phillipleblanc in #12463
fix(search): stop re-parsing a dotted index key as relation.column (fixes #12462) by @grokspice in #12464
fix(ci): build the ADBC BigQuery driver with the Go version its go.mod requires by @grokspice in #12470
fix(llms): keep the Hugging Face cache token and harden the model E2E job by @grokspice in #12422
fix(ci): stop a cancelled Remote Sign-off from claiming the checks failed (fixes #12424) by @grokspice in #12425
fix(runtime): fail the write when an index cannot prepare its write window (fixes #12421) by @grokspice in #12448
fix(runtime): stop retrying a permanent configuration failure on the catalog and dataset load paths (fixes #12417) by @grokspice in #12443
chore(ci): bump spiceio setup action to v0.6.0 by @lukekim in #12522
fix(ci): say what was unready when a spiced readiness wait times out (refs #12473) by @grokspice in #12484
feat(cayenne): drive incremental vacuum from the maintenance tick by @lukekim in #12435
feat(ci): allow additional cargo features for spiceai-dev Docker builds by @ewgenius in #12198
fix(cli): authenticate the SQL REPL's nql line like the session's SQL (fixes #12491) by @grokspice in #12496
fix(search): keep the row's primary key out of Elasticsearch bulk-index failures (fixes #12370) by @claudespice in #12410
fix(cpu-budget): state a low CPU request plainly, and only below half the cores by @bjchambers in #12440
fix(models): reject a pinned Model2Vec revision instead of 401ing on it (fixes #12445) by @grokspice in #12475
fix(cli): keep a login credential on the origin it was minted for (fixes #12505) by @grokspice in #12508
bug: S3 vector indexing succeeds when the embedding column is absent by @Jeadie in #12249
bug: S3 Vectors advertises unsupported metadata predicates as exact pushdown (fixes #12243) by @Jeadie in #12250
fix(cli): treat a blank --api-key as no key at all (fixes #12498) by @grokspice in #12501
task: Add #[derive(TypedParams)] for secret stores. by @Jeadie in #12154
fix(runtime): report a deferred dataset that cannot build its connector (fixes #12414) by @grokspice in #12483
fix(mysql): pre-flight CDC replication privileges with an actionable error (fixes #11967) by @grokspice in #12485
fix(testoperator): reject a client fleet the HTTP executors cannot bound (fixes #12348) by @claudespice in #12349
fix(ci): commit the catalog schema snapshot baselines and stop the daily PR churn by @phillipleblanc in #12525
refactor(runtime): describe every table-provider wrapper layer once in a layer table by @phillipleblanc in #12200
Add testoperator dispatch support for search benchmarks and replace benchmarks_search.yml by @Jeadie in #12224
bug: RRF discards a candidate stream after an empty first batch (fixes #12239) by @Jeadie in #12384
fix(cli): stop the SQL REPL asking a runtime its queries never went to (fixes #12493) by @grokspice in #12494
test(runtime): run the metrics tests that are built but never run by @sgrebnov in #12510
fix(tests): assert the search cache status instead of wall-clock timings (fixes #12487) by @grokspice in #12488
fix(search): resolve a chunked index's entries from the authoritative store, not the read listing (fixes #12266) by @claudespice in #12411
fix(search): Improvements for search harness by @Jeadie in #12226
test(cayenne): cover the selective PK join and the inline/file tier boundary by @lukekim in #12517
fix(runtime): surface the unknown-connector suggestion, and report it once (fixes #12415) by @grokspice in #12469
fix(ci): publish no sign-off verdict when the run was signalled (fixes #12518) by @grokspice in #12544
refactor(layering): move the modules the accelerated table shares below runtime by @bjchambers in #12219
chore(ci): upgrade spiceio setup action to v0.7.0 by @lukekim in #12611
fix(runtime): keep the leading slash on an inferred local Iceberg warehouse root (fixes #12533) by @grokspice in #12540
fix(ci): let a cancelled sign-off correct only the failure it posted (fixes #12428) by @grokspice in #12432
fix(runtime): compare an append high-water mark inclusively on a day-granular time column (fixes #12492) by @grokspice in #12500
fix(runtime): report a dataset connector load failure once, not once per site (fixes #12365) by @grokspice in #12526
fix(workers): give the weighted-router test a noise margin it can survive (fixes #12537) by @grokspice in #12538
fix(runtime): reject a Hadoop table URL too short to name a namespace (fixes #12539) by @grokspice in #12542
fix(ci): probe a pinned Hugging Face revision at a URL the Hub has (fixes #12553) by @grokspice in #12554
feat(testoperator): pin the load phase to a target query rate by @lukekim in #12519
fix(cli): follow only same-origin redirects, so the API key cannot leave the origin by @grokspice in #12503
fix(ci): use spiceio and sccache for E2E macOS aarch64 builds by @lukekim in #12590
perf(cdc): build a drained CDC burst with one blocking-pool handoff by @sgrebnov in #12514
feat(cloud-connect): complete the spice connect surface — install, codeless connect, remove by @peasee in #12159
fix(scripts): distinguish merge-queue PRs in signoff mine by @Jeadie in #12383
bug: HTTP RRF truncates each candidate leg before fusion by @Jeadie in #12386
fix(cayenne): pair the cold manifest with the warm snapshot a scan captured by @phillipleblanc in #12577
fix(deps): bump the Vortex pin and guard the task-cancellation regression by @phillipleblanc in #12548
chore(deps): bump datafusion and table-providers for the DuckDB timezone and retention fixes by @phillipleblanc in #12545
fix(cayenne): surface the real error for partitioned Cayenne writes by @Jeadie in #12535
fix(postgres): re-snapshot in-memory Cayenne on slot resume, and match the slot's lifetime to the accelerator's by @bjchambers in #12221
fix(cli): bound the Spice.ai login poll instead of retrying forever (fixes #12506) by @grokspice in #12523
fix(runtime): name a UTC timestamp column's zone in a spelling DuckDB knows (fixes #12528) by @grokspice in #12534
fix(mysql): raise net_write_timeout on the shared binlog dump session (fixes #12527) by @claudespice in #12586
fix(google-genai): read a Gemini SSE stream as bytes, so a split character survives (fixes #12597) by @claudespice in #12601
fix(mssql): follow an availability group's read-only routing redirect (fixes #11453) by @claudespice in #12607
test(cayenne): measure small-file fan-out against the seeded appends, not a listed count (fixes #12602) by @claudespice in #12613
fix(ci): keep the build cache's S3 endpoint out of the runtime under test (fixes #12624) by @claudespice in #12626
perf(ci): verify the CLI binary instead of building it again by @bjchambers in #12486
fix(postgres): publish a member's held CDC envelope before a bulk transaction (fixes #12311) by @claudespice in #12408
fix(cayenne): consolidate the two partition creators, fixing the accelerator's missing directory sync (fixes #12212) by @claudespice in #12619
fix(cayenne): run a backend-parameterized test on a stack its plan fits in (fixes #12436) by @grokspice in #12561
fix(ci): let only the merge queue pass Attestation without a sign-off (fixes #12679) by @grokspice in #12681
fix(ci): take the trusted sign-off helpers from the workflow's own commit (fixes #12657) by @claudespice in #12662
fix(ci): name the E2E jobs that did not succeed (fixes #12643) by @grokspice in #12649
fix(ci): give the openai model job a ceiling above its own setup (fixes #12644) by @grokspice in #12650
fix(ci): recognise the Flight bind wording so a foreign ready cannot pass (fixes #12642) by @grokspice in #12648
fix(ci): call an unreachable compiler cache infrastructure, not a failing branch (fixes #12556) by @grokspice in #12557
fix(search): clear a replacing index instead of keeping rows the source dropped (fixes #12066) by @grokspice in #12564
fix(ci): retry the sign-off status post, and say so when it never lands (fixes #12701) by @grokspice in #12704
build(deps): bump aws-smithy-runtime from 1.12.0 to 1.12.1 in the aws-sdk group across 1 directory by @app/dependabot in #12358
task: Add #[derive(TypedParams)] for LLMs. (fixes #12150) by @Jeadie in #12155
fix(ci): let a nightly's later test suites survive an earlier one's failure (fixes #12625) by @claudespice in #12627
fix(tests): wait for a partition to persist before snapshotting its plan (fixes #12645) by @grokspice in #12652
fix(object-store): bound an FTP and SFTP connection attempt end to end (fixes #12647) by @grokspice in #12655
test(iceberg): decide the Hadoop catalog test's backends by environment (fixes #12646) by @grokspice in #12665
fix(ci): give each E2E model job its own spiced ports (fixes #12419) by @grokspice in #12685
fix(cache): evict the Pingora cache down to max_size instead of only recording it (fixes #12688) by @grokspice in #12694
fix(cayenne): bound protected-snapshot compaction by the compaction memory pool by @sgrebnov in #12541
fix(ci): leave an incomplete sign-off pending, not failed (fixes #12741) by @grokspice in #12742
fix(telemetry): resolve duration histograms below a millisecond (fixes #12693) by @grokspice in #12699
fix(ci): bound every E2E job, so a wedged build cannot hold the queue (fixes #12717) by @grokspice in #12719
feat(testoperator): add new search benchmark datasets by @Jeadie in #12237
test(cayenne): name the small-file compaction tests after the path they take (fixes #12612) by @grokspice in #12740
fix(cli): bound an inference call by silence, not by total duration (fixes #12583) by @claudespice in #12589
fix(turso): store and read back the same set of types (fixes #12628) by @claudespice in #12633
fix(catalogs): keep a Glue database whose tables the include patterns select (fixes #12630) by @claudespice in #12638
fix(catalogs): apply a catalog's exclude patterns, not just its include (fixes #12636) by @claudespice in #12641
fix(cayenne): build a carry-forward rewrite from the classified manifest rows (fixes #12708) by @claudespice in #12711
fix(runtime): subtract an append dedup window as a multiset, not a set (fixes #12499) by @grokspice in #12513
bug: FTS exec drops absent columns and violates its declared schema (fixes #12228) by @Jeadie in #12245
bug: rrf() linear recency decay divides the document age by the decay window twice (fixes #12232) by @Jeadie in #12385
chore(deps): bump datafusion rev to spiceai-54 with outer-join unparser fix by @Jeadie in #12683
fix(ci): recognise sccache's startup-timeout wording as an unusable cache (fixes #12622) by @claudespice in #12788
fix(spiced): open the log with the startup banner by @bjchambers in #12615
fix(metrics): resolve S3 Vectors latency below a hundred milliseconds (fixes #12698) by @grokspice in #12702
fix(google-genai): bound one unterminated SSE event so a stalled endpoint cannot grow spiced (fixes #12600) by @grokspice in #12690
feat(cpu-budget): size a burstable pod from its CPU request, with an all-cores opt-out by @bjchambers in #12581
fix(ci): refuse a sign-off the branch's Makefile cannot run (fixes #12813) by @claudespice in #12815
test(postgres): say which readiness wait timed out and what it saw (fixes #12730) by @grokspice in #12731
fix(mssql): bound one connection attempt, so a stalled peer cannot pin a pool slot (fixes #12606) by @grokspice in #12733
fix(ci): ask whether the disk watcher runs before make writes to it (fixes #12734) by @grokspice in #12736
fix: delete three source files that no crate root declares (fixes #12735) by @grokspice in #12738
fix(telemetry): keep a startup-recorded gauge on the operator meter, so it reaches /metrics (fixes #12667) by @grokspice in #12754
fix(cloud-connect): pin rustls where the release call presents its identity (fixes #12760) by @grokspice in #12764
test(cloud-client): assert the redirect policy by behaviour against a live server (fixes #12509) by @grokspice in #12767
fix(search): decline a warm vector tier the accelerator cannot refill (fixes #12102) by @grokspice in #12768
fix(ci): build without the compiler cache when it cannot be reached (fixes #12770) by @grokspice in #12771
fix(json): end an array element where serde did, so bare scalars read (fixes #12782) by @grokspice in #12785
fix(cache): count an invalidation as an eviction, and export the counters before one fires (fixes #12687) by @grokspice in #12791
fix(ci): ask whether the runner can hold the build before starting one (fixes #12798) by @grokspice in #12799
fix(ci): size the cayenne property-test ceiling above the pool, not at it (fixes #12811) by @grokspice in #12814
fix(ci): bound every merge-queue-required job with timeout-minutes by @grokspice in #12817
deps: bump datafusion-table-providers to 894e279 (fixes #12585) by @bjchambers in #12663
fix(ci): take stale build output off the runners, not just report a full one (fixes #12800) by @grokspice in #12801
fix(cayenne): give the Turso metastore sidecars one pool over cayenne.db (fixes #12727) by @grokspice in #12804
fix(deps): drop the unreferenced ctor dev-dependency from data_components (fixes #12664) by @grokspice in #12819
fix(ci): decline a verdict when the sign-off run itself was signalled (fixes #12710) by @grokspice in #12724
fix(postgres): hold a resuming shared slot's ack floor for tables with no member by @bjchambers in #12676
refactor(layering): split the table-provider layers out of runtime by @bjchambers in #12661
build(deps): bump the github-actions-dependencies group across 3 directories with 7 updates by @app/dependabot in #12842
fix(spiced): make the crash handler more robust by @sgrebnov in #12834
fix(catalogs): apply the Cayenne catalog's include and exclude patterns (fixes #12766) by @grokspice in #12833
fix(search): decide a compound index's write fatality per half, not by OR (fixes #12826) by @grokspice in #12828
feat(cloud): organization context for spice cloud commands by @lukekim in #12515
perf(postgres catalog): skip metadata queries for schemas no include pattern can reach by @bjchambers in #12651
bug: S3 vector metadata conversion silently drops filterable metadata (fixes #12240) by @Jeadie in #12387
build(deps): bump nvidia/cuda from 13.3.0-cudnn-runtime-ubuntu24.04 to 13.3.1-cudnn-runtime-ubuntu24.04 in the docker-dependencies group by @app/dependabot in #12356
fix(runtime): keep serving when the working directory cannot be walked (fixes #6301) by @claudespice in #12803
fix(connectors): report an object-store timeout as a timeout, not as bad credentials (fixes #12793) by @claudespice in #12797
test(runtime): say which components were not ready when the wait times out (refs #12396) by @grokspice in #12827
fix(cayenne): measure tuner memory pressure as unreclaimable demand (fixes #12531) by @sgrebnov in #12623
Include v2.1.3 and 2.1.4 in SECURITY.md by @sgrebnov in #12497
fix(search): leave the stored rows in place when a delete cannot be applied (fixes #12822) by @grokspice in #12825
fix(google-genai): resume the SSE scan where it stopped, not at the buffer start (fixes #12689) by @grokspice in #12713
fix(json): report a malformed JSON array element instead of dropping the rest of the file (fixes #12755) by @claudespice in #12777
fix(runtime): honour a declared type's precision instead of narrowing it (fixes #12756) by @claudespice in #12774
fix(cayenne): drop the partition-value guard that key encoding made unreachable (fixes #12616) by @claudespice in #12753
fix(runtime): pin the catalog-acceleration contract in both feature configurations (fixes #12743) by @claudespice in #12752
fix(cli): report an answer the model stopped early, instead of printing it as whole (fixes #12596) by @grokspice in #12715
fix(runtime): scope query jobs and active queries to the principal that submitted them by @phillipleblanc in #12841
Compute all metrics@k for all 0 < k <= n during search quality metrics. by @Jeadie in #12521
task: Add a truncate to huggingface and file embedding providers by @Jeadie in #12620
fix(cache): never serve a result whose tables changed after it read them by @bjchambers in #12703
test(cayenne): cover datalake-tier statistics, pruning, and promotion triggers by @sgrebnov in #12847
docs(ci): warn that re-running enforce-pull-with-spice replays a stale payload (fixes #12809) by @grokspice in #12810
fix(cayenne): bound the maintained-aggregate index by memory budget, and let a stale registry recover by @lukekim in #12573
fix(runtime): only initialize accelerators for the datasets a reload applies by @phillipleblanc in #12872
feat: promote BYOC and Cloud Connect changes to trunk by @phillipleblanc in #12852
fix(flight): resolve per-request settings from the live app by @phillipleblanc in #12873
fix(cli): keep polling when the token exchange has not seen the auth code yet by @phillipleblanc in #12871
feat(cayenne): inline a small whole-table refresh into the metastore by @lukekim in #12367
ci: upgrade spiceio setup action to v0.8.0 by @lukekim in #12885
fix(runtime): measure the CDC prefetch backlog, and stop its byte counter wrapping by @lukekim in #12675
fix(turso): keep a reloaded file-accelerated dataset queryable by @phillipleblanc in #12882
fix(query): preserve expression ordering across partition wrappers by @Jeadie in #12854
fix(runtime): report every start-time-only runtime.* section a reload changes by @phillipleblanc in #12874
fix(search): handle null embeddings in vector writes and JIT search by @Jeadie in #12855
test(embeddings): truncate over-length inputs in the MiniLM embed spicepods by @Jeadie in #12856
fix(search): Improve search benchmarking DX and fix some vector index names by @Jeadie in #12892
test(search): dispatch all MTEB search variants by @Jeadie in #12850
fix(runtime): stop a superseded scheduler incarnation from claiming the heartbeat key by @phillipleblanc in #12851
fix: Ensure OTel ingest materializes missing/null dimension columns by @peasee in #12087
feat(cloud-connect): apply a component-only Spicepod deployment in place by @phillipleblanc in #12895
feat(cli): typed login sessions and explicit connect organization selection by @phillipleblanc in #12912
refactor: make each table wrapper a typed layer that answers where a walk goes by @bjchambers in #12891
feat(runtime): put every query's trace id on its log records by @lukekim in #12610
feat(cayenne): bound the SUM of the per-table PK keyset caches by @lukekim in #12802
fix(cache): read and expire a Pingora entry under one hold of its shard (fixes #12832) by @grokspice in #12839
fix: Update Search integration test snapshots by @Jeadie in #12707
fix(runtime): invalidate localpod children's cached results on parent refresh by @krinart in #12897
fix(cayenne): use valid snapshot IDs for deferred appends by @Jeadie in #12853
fix(ci): New branch for each push-snap-changes (only affects integration_search.yml) by @Jeadie in #12684
fix(search): make chunked embedding and offset columns nullable (#12778) by @Jeadie in #12783
feat(cayenne): charge scan materialization to the query memory pool by @lukekim in #12759
fix(cache): run the Pingora invalidation scan off the calling runtime worker (fixes #12806) by @grokspice in #12808
fix(cache): count the removals the Pingora engine performs itself (fixes #12792) by @grokspice in #12830
fix(cayenne): reserve append sequence for partitioned upsert appends (#12779) by @Jeadie in #12784
test(cayenne): prove the keyset degrade releases each shard as it converts by @lukekim in #12790
perf(postgres catalog): resolve a schema's table schemas in one query (#12106) by @bjchambers in #12886
fix(vortex): expose segment cache metrics on scrape by @phillipleblanc in #12944
refactor: point connector imports at the crates that actually own them by @bjchambers in #12925
fix(postgres): rebuild the acceleration when a replication slot's history is gone by @bjchambers in #12922
fix(cayenne)!: only an explicit cayenne_tuning: adaptive enables the closed loop by @lukekim in #12949
fix(dev-tools): show merge-queue and conflict state as labels in scripts/signoff mine by @Jeadie in #12924
test: cover warm-index delete paths across backends (#11964) by @Jeadie in #12635
fix(cayenne): fractional proptest scaling + batch timestamp-partition test inserts by @Jeadie in #12796
Helpful tool to track what users/bots have got done lately by @Jeadie in #12603
Release notes housekeeping by @krinart in #12977
build(deps): bump serde_with from 3.20.0 to 3.21.0 by @app/dependabot in #11969
refactor: make runtime's re-export shims crate-visible by @bjchambers in #12969
fix(runtime): surface OTel metric tables with duplicate columns, and count unsupported metric types as rejected by @peasee in #12923
fix: Update Search integration test snapshots by @app/github-actions in #12979
Make signoff.yml more searchable. by @Jeadie in #12392
bug: Support search UDTFs in SQL function components by @Jeadie in #12919
docs: document the stacked-PR workflow, with a tested restack helper by @bjchambers in #12951
fix(llms): fall back to pytorch_model.bin for embeddings without safetensors by @Jeadie in #12971
feat(monitoring): improve the Datadog dashboard for multi-replica and Kubernetes deployments by @sgrebnov in #12972
Charge the query memory pool for concurrent Vortex split decodes by @lukekim in #12940
docs(release-notes): write release notes in Simplified Technical English by @lukekim in #12947
refactor: narrow the DataConnector trait off the runtime's types by @bjchambers in #12993
fix(cayenne): compact a DDL-created partition on an interval, not only on write (fixes #12617) by @grokspice in #12757
fix(cayenne): hand out a pooled Turso connection in autocommit (refs #12820) by @grokspice in #12821
fix: fail the lint gate on a source file no crate root declares (fixes #12737) by @grokspice in #12744
fix(search): stage a full refresh of the memory vector tier, so dropped rows leave it (refs #12413) by @grokspice in #12823
fix(graphql): keep the configured schema when a page has no rows (fixes #13004) by @claudespice in #13016
fix(runtime): register task_history before embeddings/rerankers load by @Jeadie in #12978
test(postgres): converge the catalog on source DDL, and warn when it selects nothing by @bjchambers in #12988
fix(cayenne): budget for catalogs in the Cayenne memory classification by @bjchambers in #13027
fix(cayenne): hold primary keys committed while the existence index is checked out by @lukekim in #13019
feat(search): push SQL filters down into tantivy full-text search by @Jeadie in #12812
fix(cayenne): serve the maintained count Inexact while its delta is queued (fixes #12824) by @grokspice in #12829
fix: Update Search integration test snapshots by @app/github-actions in #13060
fix(testoperator benchmarks): benchmark fixes by @krinart in #13012
fix(runtime): stop query_active_count drifting up when queries share a request (fixes #12883) by @claudespice in #13034
chore(deps): bump model2vec-rs for fast WordPiece tokenizer by @Jeadie in #12986
ci(cayenne-doc): render diagrams locally with mermaid-cli, and fix the diagram that has been failing the build for a month by @bjchambers in #13063
feat(monitoring): improve results cache panels on the Datadog dashboard by @sgrebnov in #13066
feat(cayenne)!: one process-wide Vortex segment cache instead of a cache per table by @bjchambers in #12983
fix(connectors): keep the projected schema when a query returns no rows (fixes #13015) by @claudespice in #13078
fix(deps): bump the datafusion pin past the merged unparser fixes (fixes #12406) by @claudespice in #13083
fix(cache): compact a sliced result before caching it (fixes #12921) by @claudespice in #13043
refactor(cdc): give the sidecar checkpoint stores a below-runtime interface by @bjchambers in #13045
fix(cayenne): re-baseline the maintained row count when a promotion folds a delete tombstone (fixes #12846) by @claudespice in #12998
fix(acceleration): stop an engine-required type rewrite reading as a stale acceleration schema (fixes #13014) by @claudespice in #13074
fix(udfs): return NULL for a vector distance that is not defined (refs #11263) by @claudespice in #13091
fix(cayenne): refuse a data directory that contains the metastore (fixes #13055) by @claudespice in #13101
fix(json): report content after a JSON array instead of dropping it (fixes #12786) by @claudespice in #13097
fix(runtime): bound the spicepod apply so an unloadable dataset cannot wedge it (fixes #12862) by @claudespice in #13095
fix(catalogs): apply the Glue catalog's exclude patterns (fixes #12634) by @claudespice in #13103
fix(metrics): make component metrics and tests more robust by @sgrebnov in #13094
feat(cache)!: ship the Pingora cache engine as an Enterprise-only feature by @lukekim in #13000
fix: Update benchmark snapshots by @app/github-actions in #13056
fix(postgres): compare CDC positions against what the slot can stream, not what it retains by @bjchambers in #12990
docs(cayenne): compress the changelog, and give it a rule for what earns a row by @bjchambers in #13067
test: remove a test's container when it is done with it, including on failure by @bjchambers in #13123
fix(flight): record one metric sample per Flight RPC (fixes #12844) by @claudespice in #13112
feat(drasi): forward CDC changes and runtime tables to a Drasi source (Alpha) by @lukekim in #12653
fix(bench): time the engine instead of the results cache, and validate ClickBench by @lukekim in #13150
refactor(connector): retype the DataConnector surface to DatasetSpec by @bjchambers in #13096
bug: SQL-tier function body does not support named arguments (=>) for search UDTFs (fixes #12898) by @Jeadie in #12920
fix(cache): compact the sliced and wide results that compaction previously skipped by @sgrebnov in #13176
docs(stacked-prs): correct when a restack forfeits the sign-off by @bjchambers in #13130
fix(postgres): load a provably empty CDC acceleration through its snapshot bootstrap by @bjchambers in #13175
fix(cayenne): keep Arrow timestamp units (Vortex supports ns) by @lukekim in #13180
Cloud Connect: enrollment and identity foundation by @phillipleblanc in #13181
refactor(model): give the model-provider contracts a home below llms by @bjchambers in #13201
Fix runtime lint with zero features by @krinart in #13208
fix(benchmarks): BigQuery + Snowflake fixes + updated snapshots by @krinart in #13136
Revert "fix(search): decline a warm vector tier the accelerator cannot refill (fixes #12102)" (#12768) by @Jeadie in #13041
fix(snapshots): don't bootstrap the snapshot file_create just discarded by @lukekim in #13179
Declare the CPU entitlement to Vortex at startup by @sgrebnov in #13173
fix(mysql): fix net_write_timeout session syntax and extend transient replication errors by @ewgenius in #13178
fix(postgres): classify EOF and server termination errors as transient in CDC replication by @ewgenius in #13163
feat(testoperator): support customer-supplied datasets in run search by @Jeadie in #12982
Add PDF page splitter and FinanceBench staging job (#12858) by @Jeadie in #12984
fix(cayenne): frame the persisted PK bloom with the probe function that filled it (fixes #13137) by @claudespice in #13153
refactor(layering): move the connectors below the runtime by @bjchambers in #13166
feat(cli): manage the Cloud Connect service with launchd on macOS by @phillipleblanc in #13203
Support local rerankers from text-embeddings-inference by @Jeadie in #12929
fix(catalog): make the PostgreSQL catalog's errors and warnings actionable by @bjchambers in #13199
fix(cloud-connect): look again when a lock create reports the entry missing by @phillipleblanc in #13231
Skip DynamoDB in scheduled benchmarks by @ewgenius in #13222
Populate the file metadata cache with Vortex footers at write time by @sgrebnov in #13228
perf(cayenne): give the PK filter a cache-line layout, and the bit count it asks for by @bjchambers in #13219
fix(mysql): rebuild a purged-position acceleration atomically instead of emptying it (fixes #12967) by @claudespice in #13023
fix(cloud-connect): heartbeat restart-required, attachment by app id, and this crate's integration tests in the gate by @phillipleblanc in #13234
fix(search): join all of a dataset's vector indexes on one VectorScanTableProvider by @krinart in #13209
Validate vector search parameters before SQL query by @lesbass in #12253
feat(helm): support customizing Deployment strategy and StatefulSet updateStrategy by @sgrebnov in #13249
fix(postgres): recover from a replication slot lost while streaming, and state what each slot costs by @bjchambers in #13221
fix(cayenne): stop a partitioned acceleration reporting a schema change it never applied (fixes #12999) by @claudespice in #13057
feat(cloud-connect): name the local spicepod a cloud-managed instance serves or ignores by @phillipleblanc in #13262
fix(snowflake): keep NUMBER precision and scale during schema discovery by @phillipleblanc in #13272
fix(secrets): check secret references where the components resolve them by @peasee in #13265
docs(criteria): sign off the PostgreSQL Catalog Connector at Beta by @bjchambers in #13235
fix(cloud-connect): resolve locked service state through the retained directory descriptor (fixes #13204) by @claudespice in #13292
chore(deps): upgrade iceberg-rust to v0.10.0 by @krinart in #13189
fix(cloud-connect): fix Windows build of identity state-file helpers by @sgrebnov in #13308
fix(cayenne): normalize append de-duplication types by @ewgenius in #13200
feat(cli): unify Spice Cloud enrollment and service workflows by @phillipleblanc in #13326
feat(postgres): native upsert delivery for durable write-back by @Jeadie in #13323
feat(cli): create an unattached Cloud Connect project by @phillipleblanc in #13333
fix(cayenne): exclude protected snapshots above the delete fence from subset compaction by @krinart in #13343
fix(cli): resolve a Cloud Connect project's data-plane region from its config by @krinart in #13370
fix(cli): keep a granted Spice Cloud login when the identity endpoint is silent by @bjchambers in #13376
fix(duckdb): fix concurrent-query failures after a replace_file swap with multiple DuckDB files by @Jeadie in #13383

*Full Changelog: https://github.com/spiceai/spiceai/compare/v2.1.0...v2.2.0

Spice v2.1.5 (Aug 12, 2026)

Wed, 12 Aug 2026 00:00:00 GMT

Spice v2.1.5 is now available! 🛠️

Spice v2.1.5 is a patch release focused on dependable cached data and predictable operation under load. Cached queries now reflect data changes more reliably, Cayenne workloads stay within configured memory limits, health checks remain responsive while cached results are updated, and cache dashboards provide a more complete view of activity.

What's New in v2.1.5

Cached Queries Stay Fresh as Data Changes

Cached results are now cleared reliably after refreshes, writes, retention changes, and updates to dependent local datasets. Expired entries are removed promptly, and entries for data that is no longer part of a Cayenne dataset are not reused by later queries.

These improvements prevent a completed data change from being followed by an older cached answer. No configuration changes are required.

More Predictable Cayenne Behavior Under Heavy Load

Cayenne now keeps track of the memory needed to prepare query results, including when several parts of a query are prepared at once. Multiple accelerated tables also share available memory instead of each planning as though it were the only table in the deployment.

Large and concurrent workloads are therefore less likely to exhaust the available memory. When a query cannot fit within the configured limit, it fails cleanly instead of putting the entire service at risk. Operators can also limit how much work one dataset does at once when it needs a smaller memory footprint, without slowing every query.

Health Checks Remain Responsive During Cache Updates

Refreshing or writing a dataset with many cached results no longer holds up Spice while it finds old answers that need to be cleared. Health checks and other requests can continue during this work, reducing avoidable service restarts under load.

More Trustworthy Cache Dashboards

Cache dashboards now show total space, space in use, stored results, requests, and successful reuse whenever the dashboard is refreshed, including for new or lightly used datasets. Counts for expired results, automatic size cleanup, and cleanup after data changes are also reported consistently, so a zero value represents no activity rather than missing information.

Contributors

Breaking Changes

No breaking changes.

Cookbook Updates

No new cookbook recipes.

The Spice Cookbook includes more than 100 recipes to help you get started with Spice quickly and easily.

Upgrading

To upgrade to v2.1.5, use one of the following methods:

CLI:

spice upgrade

Homebrew:

brew upgrade spiceai/spiceai/spice

Docker:

Pull the spiceai/spiceai:2.1.5 image:

docker pull spiceai/spiceai:2.1.5

For available tags, see DockerHub.

Helm:

helm repo update
helm upgrade spiceai spiceai/spiceai --version 2.1.5

AWS Marketplace:

Spice is available in the AWS Marketplace.

What's Changed

Changelog

fix: arrow IndexedMemTable serves stale results after DML/retention/sync (fixes #11262) by @claudespice in #11532
fix(cache): evict the Pingora cache down to max_size instead of only recording it (fixes #12688) by @grokspice in #12694
fix(cache): count an invalidation as an eviction, and export the counters before one fires (fixes #12687) by @grokspice in #12791
fix(cache): never serve a result whose tables changed after it read them by @bjchambers in #12703
Remove unnecessary allocations from results-cache and hot conversion paths by @phillipleblanc in #11895
fix(cache): read and expire a Pingora entry under one hold of its shard (fixes #12832) by @grokspice in #12839
fix(runtime): invalidate localpod children's cached results on parent refresh by @krinart in #12897
fix(cache): run the Pingora invalidation scan off the calling runtime worker (fixes #12806) by @grokspice in #12808
fix(cache): count the removals the Pingora engine performs itself (fixes #12792) by @grokspice in #12830
feat(cayenne): charge scan materialization to the query memory pool by @lukekim in #12759
feat(cayenne): bound the SUM of the per-table PK keyset caches by @lukekim in #12802
Charge the query memory pool for concurrent Vortex split decodes by @lukekim in #12940
fix(vortex): invalidate retired segment cache entries by @phillipleblanc in #12943
fix(vortex): expose segment cache metrics on scrape by @phillipleblanc in #12944

*Full Changelog: https://github.com/spiceai/spiceai/compare/v2.1.4...v2.1.5

Spice v2.1.4 (Aug 5, 2026)

Wed, 05 Aug 2026 00:00:00 GMT

Spice v2.1.4 is now available! 🛠️

Spice v2.1.4 is a patch release that improves DuckDB acceleration and runtime stability: datasets with UTC timestamp columns, such as Iceberg tables, now load successfully when accelerated with DuckDB, retention policies run reliably, and the runtime is more resilient under heavy query load.

What's New in v2.1.4

DuckDB Acceleration Works with Iceberg Timestamps

A dataset with a UTC timestamp column — for example, any Iceberg timestamptz column — could previously fail to load when accelerated with DuckDB, leaving the dataset unhealthy and unqueryable. These datasets now load and become ready normally, with no configuration changes needed.

Reliable Retention Policies on DuckDB

Retention policies now apply cleanly on DuckDB-accelerated datasets, including policies that combine a time window with an additional condition. Expired rows are evicted on every retention interval, keeping accelerated data fresh and storage bounded.

Improved Runtime Stability

The runtime is now more robust when queries are cancelled — whether by a client disconnecting, a timeout, or a new refresh superseding an in-flight read. A rare crash in this path has been eliminated.

Contributors

Breaking Changes

No breaking changes.

Cookbook Updates

No new cookbook recipes.

The Spice Cookbook includes more than 100 recipes to help you get started with Spice quickly and easily.

Upgrading

To upgrade to v2.1.4, use one of the following methods:

CLI:

spice upgrade

Homebrew:

brew upgrade spiceai/spiceai/spice

Docker:

Pull the spiceai/spiceai:2.1.4 image:

docker pull spiceai/spiceai:2.1.4

For available tags, see DockerHub.

Helm:

helm repo update
helm upgrade spiceai spiceai/spiceai --version 2.1.4

AWS Marketplace:

Spice is available in the AWS Marketplace.

What's Changed

Changelog

chore(deps): bump datafusion and table-providers for the DuckDB timezone and retention fixes (2.1 backport) by @phillipleblanc in #12546
fix(deps): bump the Vortex pin to pick up the task-cancellation fix by @phillipleblanc in #12547

*Full Changelog: https://github.com/spiceai/spiceai/compare/v2.1.3...v2.1.4

Spice v2.1.3 (Aug 4, 2026)

Tue, 04 Aug 2026 00:00:00 GMT

Spice v2.1.3 is now available! 🛠️

Spice v2.1.3 is a patch release focused on resource efficiency: explicit CPU sizing with the new runtime.cpu.cores setting, more query memory for Cayenne deployments, and improved memory and crash diagnostics. It also fixes Cayenne acceleration of Iceberg datasets with timestamptz columns and restores WHERE filters on federated LEFT/RIGHT JOIN queries.

What's New in v2.1.3

CPU Sizing with `runtime.cpu.cores`

The new runtime.cpu.cores setting controls how many cores the runtime targets. Thread pools, query partitioning, and accelerator concurrency are all derived from it.

runtime:
  cpu:
    cores: 4 # `auto` (default) detects. Accepts 4, 3.5, 3500m

Also available as --cpu-cores and SPICE_CPU_CORES (precedence: flag > environment > Spicepod).

This is most useful on large, shared nodes. A pod that sets resources.requests.cpu without a CPU limit exposes no cgroup quota, so the runtime sizes itself for every core on the node rather than its allocated share. Setting the entitlement aligns parallelism and memory footprint with the CPU the pod actually receives.

The effective value, its source, and the derived sizing are logged at startup and exported as the spiced_cpu_budget_cores gauge.

More Query Memory for Cayenne Deployments

The Cayenne compaction memory pool is now reserved only for accelerations that can compact into it: file mode with a small-write refresh profile. Other deployments, including refresh_mode: full, keep the full memory limit available to queries — up to 6.4 GiB on a 32 GiB limit, with no configuration change.

Memory budgets are now derived from the process's own cgroup limit rather than total host memory.

Diagnostics

Three new gauges report memory in use: query_memory_pool_used_bytes, cayenne_compaction_memory_pool_used_bytes, and process_resident_memory_bytes.

Memory pool refusals now return ResourcesExhausted and HTTP 503, distinguishing them from query errors.

Fatal native signals (SIGSEGV, SIGBUS, SIGILL, SIGFPE) report the signal, faulting address, and thread before exit, so a crash can be diagnosed from logs.

Fixed a bug where setting runtime.task_history.enabled: false also disabled every query metric — query_duration_ms, query_execution_duration_ms, query_executions, query_failures, query_returned_rows, and query_returned_bytes. These are now reported regardless of the task history setting.

Cayenne Acceleration of Iceberg `timestamptz` Columns

Accelerating an Iceberg dataset with a timestamptz column using the Cayenne engine previously failed during the refresh write with an error resolving the time zone +00:00. Iceberg maps every timestamptz column to the fixed-offset Arrow time zone +00:00, which the file writer could not resolve when building column statistics. Fixed-offset time zones (±HH:MM, ±HHMM, and ±HH) are now resolved wherever time zones are handled, so these datasets accelerate correctly.

Federated Outer Join Filters

A federated query combining a LEFT JOIN with a WHERE filter on the left table previously returned all rows instead of the filtered rows: when the query was pushed down to the data source or accelerator, the filter was folded into the JOIN ON clause, where it no longer filters the left side (RIGHT JOIN was affected symmetrically). Filters now stay on the side of the join they came from, so these queries return the correct rows.

Contributors

Breaking Changes

No breaking changes.

Cookbook Updates

No new cookbook recipes.

The Spice Cookbook includes more than 100 recipes to help you get started with Spice quickly and easily.

Upgrading

To upgrade to v2.1.3, use one of the following methods:

CLI:

spice upgrade

Homebrew:

brew upgrade spiceai/spiceai/spice

Docker:

Pull the spiceai/spiceai:2.1.3 image:

docker pull spiceai/spiceai:2.1.3

For available tags, see DockerHub.

Helm:

helm repo update
helm upgrade spiceai spiceai/spiceai --version 2.1.3

AWS Marketplace:

Spice is available in the AWS Marketplace.

What's Changed

Changelog

feat(runtime): size every CPU-derived pool from the CPU entitlement by @bjchambers in #12276
fix(runtime): carve the Cayenne compaction memory pool only when a dataset can compact into it by @sgrebnov in #12326
fix(runtime): size memory budgets from the process's own cgroup limit by @lukekim in #12263
fix(telemetry): read the cgroup CPU quota along the whole cgroup path by @sgrebnov in #12300
feat(runtime): expose the memory numbers that explain an OOM as gauges by @lukekim in #12195
fix(runtime): report a memory-pool refusal as ResourcesExhausted and answer it with 503 by @sgrebnov in #12289
fix(cayenne): the write-concurrency raise must respect the memory brake by @lukekim in #12317
feat(spiced): report fatal signals before exit by @sgrebnov in #12334
fix: report query metrics when task history is disabled by @sgrebnov in #12227
chore(deps): repoint vortex at the 2.1 fixed-offset timezone fix by @phillipleblanc in #12455
chore(deps): bump datafusion rev for outer-join unparser fix by @Jeadie in #12460

*Full Changelog: https://github.com/spiceai/spiceai/compare/v2.1.2...v2.1.3

Spice v2.1.2 (Jul 28, 2026)

Wed, 29 Jul 2026 00:00:00 GMT

Spice v2.1.2 is now available! 🛠️

Spice v2.1.2 is a patch release focused on improving the DuckDB data accelerator. It upgrades the DuckDB engine to v1.5.5 and introduces the on_full_refresh parameter, giving file-mode DuckDB accelerations compact, predictable disk usage across repeated full refreshes.

What's New in v2.1.2

Bounded DuckDB Acceleration File Growth with `on_full_refresh`

File-mode DuckDB accelerations using refresh_mode: full now reclaim disk space on every refresh, keeping the database file compact and disk usage predictable for long-running deployments. Each full refresh bulk-loads a fresh copy of the data, and the new on_full_refresh modes ensure the space held by prior copies is returned rather than accumulating in the file.

The new on_full_refresh acceleration parameter controls how disk space is reclaimed after each full refresh:

acceleration:
  engine: duckdb
  mode: file
  refresh_mode: full
  params:
    duckdb_file: /data/shared.duckdb
    on_full_refresh: replace_file # default: reuse_file

reuse_file (default): Existing behavior — refresh into the existing database file.
replace_file: Each full refresh streams data into a fresh staging database file, carries over every other object sharing the file (other datasets' tables, views, indexes, and Spice metadata), checkpoints it, and atomically replaces the configured file. Queries are never interrupted — in-flight queries drain against the old file while new queries see the new file — and space is fully reclaimed on every refresh.
checkpoint_file: After each refresh, run a CHECKPOINT in place, escalating to FORCE CHECKPOINT when concurrent transactions block the plain attempt (waiting for in-flight transactions; never aborting them).

DuckDB 1.5.5

The DuckDB engine is upgraded from v1.5.3 to v1.5.5, bringing the latest upstream stability fixes.

Contributors

Breaking Changes

No breaking changes.

Cookbook Updates

No new cookbook recipes.

The Spice Cookbook includes more than 100 recipes to help you get started with Spice quickly and easily.

Upgrading

To upgrade to v2.1.2, use one of the following methods:

CLI:

spice upgrade

Homebrew:

brew upgrade spiceai/spiceai/spice

Docker:

Pull the spiceai/spiceai:2.1.2 image:

docker pull spiceai/spiceai:2.1.2

For available tags, see DockerHub.

Helm:

helm repo update
helm upgrade spiceai spiceai/spiceai --version 2.1.2

AWS Marketplace:

Spice is available in the AWS Marketplace.

What's Changed

Changelog

feat(duckdb): on_full_refresh: replace_file — full refresh into a new database file, atomically replaced by @lukekim in #12135
feat(duckdb): 'on_full_refresh: checkpoint_file' to bound acceleration file growth by @sgrebnov in #12139

*Full Changelog: https://github.com/spiceai/spiceai/compare/v2.1.1...v2.1.2

Spice v2.1.1 (Jul 21, 2026)

Tue, 21 Jul 2026 00:00:00 GMT

Spice v2.1.1 is now available! 🛠️

Spice v2.1.1 is a patch release focused on reliability and performance. It resolves a possible deadlock that affected datasets with partitioned Cayenne accelerators, caches empty SQL result sets so repeat queries are served from cache, speeds up repeated queries on multi-file datasets, and restores Bedrock embedding provider parameters.

What's New in v2.1.1

Cayenne Partitioned Dataset Deadlock Fix

Cayenne datasets configured with partition_by could deadlock during their initial refresh and never become ready. Non-partitioned tables and small partitioned tables were unaffected. The root cause was a deadlock between the partition routing and the global Vortex encode budget introduced in v2.1.0.

Cayenne Zero-Row Append Refresh Stability

An idle append refresh, one where no source rows are newer than the current max(time_column), wrote no Vortex files, so the expected snapshot directory was never created. The subsequent fsync on that directory failed with ENOENT, marking the dataset unhealthy. The fix skips the snapshot sequence record and protected-snapshot publish when the write carried no rows.

Caching of Empty Result Sets

The SQL results cache now stores empty (zero-row) result sets. Queries that legitimately return no rows (e.g. WHERE 1=0, LIMIT 0) are now served from the results cache on subsequent requests instead of being re-executed against the source, reducing planning and query latency for these patterns.

Faster Repeated Queries on Multi-File Datasets

Object store datasets using parquet now cache Parquet footer statistics across queries. This reduces the frequency of Parquet footer parsing during planning, subsequently heavily reducing planning latency for certain query patterns (e.g. COUNT(*)).

Embedding Parameter Regression Fixes

v2.1.0 introduced explicit definitions across embedding component parameters (i.e. .embeddings[].params). This introduced regressions for AWS Bedrock parameters truncation and truncation_mode that caused panics.

Contributors

Breaking Changes

No breaking changes.

Cookbook Updates

No new cookbook recipes.

The Spice Cookbook includes more than 100 recipes to help you get started with Spice quickly and easily.

Upgrading

To upgrade to v2.1.1, use one of the following methods:

CLI:

spice upgrade

Homebrew:

brew upgrade spiceai/spiceai/spice

Docker:

Pull the spiceai/spiceai:2.1.1 image:

docker pull spiceai/spiceai:2.1.1

For available tags, see DockerHub.

Helm:

helm repo update
helm upgrade spiceai spiceai/spiceai --version 2.1.1

AWS Marketplace:

Spice is available in the AWS Marketplace.

What's Changed

Changelog

fix(cache): cache empty (zero-row) SQL result sets by @bjchambers in #11699
fix(cayenne): zero-row append refresh fails with "No such file or directory" by @sgrebnov in #11710
feat(file): cache ListingTable file statistics to avoid per-query footer re-parse by @phillipleblanc in #11793
fix(embeddings): restore params broken by #10853 by @Jeadie in #11788
fix(cayenne): partitioned datasets deadlock against the global encode budget and never become ready by @Jeadie in #11825

Full Changelog: https://github.com/spiceai/spiceai/compare/v2.1.0...v2.1.1

Spice v2.1.0 (Jul 9, 2026)

Thu, 09 Jul 2026 00:00:00 GMT

Spice v2.1.0 is now available! 🎉

Spice v2.1.0 is the next minor release of Spice, headlined by high-throughput Cayenne CDC, scaling and resilience improvements to PostgreSQL logical replication, expanded distributed query with Iceberg catalog scans and broadcast joins, and the upgrade to DataFusion v54 (including v53), Arrow v58.3, and Vortex v0.74. The release also adds experimental adaptive self-tuning for the Cayenne accelerator, distributed GLM inference, and a range of security, search, and connector improvements.

Highlights in v2.1.0 include:

High-Throughput Cayenne CDC — in-memory CDC tier, dedicated compaction runtime, and write-path optimizations that cut replication lag on high-volume CDC workloads
PostgreSQL Replication at Scale — multiple changes-mode datasets share a single replication slot, unchanged-TOAST recovery, and resilient reconnects across rolling deploys
Distributed Query — distributed Ballista scans of Iceberg catalog tables, broadcast joins for small dimension tables, and shared scheduler job state with failover
DataFusion v54 — upgrade to DataFusion v54 (folding in v53), Arrow v58.3, and Vortex v0.74, bringing faster joins, scans, and planning
Adaptive Self-Tuning (Experimental) — opt-in closed-loop tuning and maintained aggregates that adapt Cayenne to hardware, schema, and live workload

What's New in v2.1.0

High-Throughput Cayenne CDC

A major focus of v2.1 is Spice Cayenne write-path throughput for change-data-capture (HTAP) workloads:

In-Memory CDC Tier: A new in-memory CDC tier and follow-ups cut replication lag on hot upsert tables, with bounded mem-tier checkpointing and O(1) per-scan deletion views, plus a two-phase off-fence checkpoint on the ingest path.
Dedicated Compaction Runtime: A dedicated compaction runtime with CDC pipelining and protected snapshots isolates compaction from query and ingest paths, with parallelized deletion-vector writes, per-batch directory-barrier coalescing, and size-aware parallel encode for protected-snapshot compaction.
Incremental Protected Snapshot Compaction: Incremental compaction of protected snapshots (used in Cayenne's merge-on-read deletion index) reduces disk usage and improves query performance.
Smaller WAL & Metadata-Only Publish: cayenne_insert_record table IDs are stored as 16-byte raw-UUID BLOBs, cutting CDC WAL volume ~34%; upsert commits publish metadata-only, dropping per-key insert records; transient staged CDC deltas are light-encoded.
Delta-Write Encoding Levels: A new cayenne_delta_encoding setting (default auto) selects delta-write encoding, and cayenne_compression_strategy: zstd is now fully wired.
In-Memory CDC Sharding: PK-hash intra-apply sharding parallelizes in-memory CDC apply.
Scan Safety Under Write: In-flight scans are ref-counted so snapshot GC can't delete Vortex files mid-read; in-RAM scan parallelism, query admission control, and sound scan output ordering improve read behavior under sustained CDC.

Delta-write encoding effort and Vortex compression are tunable per accelerator. cayenne_delta_encoding: auto (the default) size-gates fresh CDC/append writes — small deltas use a light scheme and are re-encoded during compaction — or pin an explicit level 0..10 (7 is the full default cascade); cayenne_compression_strategy selects the Vortex compression:

acceleration:
  engine: cayenne
  refresh_mode: changes
  params:
    cayenne_delta_encoding: auto # 'auto' (default), or pin a level 0..10 (7 = full cascade)
    cayenne_compression_strategy: zstd # 'btrblocks' (default) or 'zstd'

Change Data Capture & HTAP

PostgreSQL logical replication (CDC, refresh_mode: changes, introduced in v2.0) gets significant scaling and resilience work in v2.1:

Shared Replication Slot: Multiple refresh_mode: changes PostgreSQL datasets on the same connection can name the same pg_replication_slot to share a single replication slot, walsender decoder, and publication, with decoded changes multiplexed by (schema, table) to each dataset. This collapses the slot count from one-per-dataset to one — staying well under Postgres's default max_replication_slots = 10.

datasets:
  - from: postgres:public.orders
    name: orders
    params:
      pg_db: mydb
      pg_replication_slot: spice_cdc # shared slot name
    acceleration:
      refresh_mode: changes
  - from: postgres:public.customers
    name: customers
    params:
      pg_db: mydb
      pg_replication_slot: spice_cdc # same name -> one slot, walsender & publication
    acceleration:
      refresh_mode: changes

Unchanged-TOAST Recovery: Under REPLICA IDENTITY FULL, when an UPDATE leaves a large TOASTed column unchanged, pgoutput sends an "unchanged" marker; Spice now fills that value from the old tuple — its old value is its current value — so updates no longer error or drop columns. Without an old tuple, the error persists with a hint to enable REPLICA IDENTITY FULL.
Transient Walsender Contention: Slot-contention errors during rolling deploys — SQLSTATE 55006 ("replication slot is active for PID") and 53300 ("requested standby connections exceeds max_wal_senders") — are now classified as transient and retried with backoff instead of fatally terminating the stream. Replication connections are also released at shutdown start (not process exit), freeing walsender seats for replacement instances.
Strict CDC Param Validation: PostgreSQL CDC parameters are strictly validated rather than silently defaulted.
Debezium Schema Evolution: Fixes for Debezium schema-evolution support, including tombstone-message handling and sign-extension of minimal-width base64 decimals.

Distributed Query

Distributed Query gains:

Distributed Iceberg Catalog Scans: Ballista distributes scans of Iceberg catalog tables across executors.
Broadcast Joins: Small dimension tables are broadcast to executors for distributed joins.
Shared Scheduler Job State with Failover: Ballista job state is shared so the scheduler can fail over without losing in-flight work.

Performance & Query Engine

Apache DataFusion is upgraded to v54, folding in v53, alongside Arrow v58.3 and Vortex v0.74 (with a pin bump adding intra-file decode split and a per-execution kernel cache). Two DataFusion releases land in this upgrade:

DataFusion v54 (release notes): adds LATERAL joins, SQL lambda functions (x -> expr with array_transform/array_filter/array_any_match), spilling nested-loop joins, and a faster arrow-avro reader. Performance work includes morsel-driven Parquet scans (up to ~2x faster for skewed scans), 20-50x faster sort-merge semi/anti/mark joins, redundant-sort-key pruning, NDV-based cardinality estimation, and inner_product/cosine_distance functions.
DataFusion v53 (release notes): adds LIMIT-aware Parquet row-group pruning, broader filter pushdown through joins and UNION, nested-field pushdown (get_field into the scan), faster query planning (some plans dropping from ~4-5ms to ~100us), and 42 faster built-in functions.

Federation deny-list enforcement and catalog DDL are restored after the DataFusion upgrades, and a cost-based left-deep join reordering rule is added for Cayenne acceleration.

AI & LLM

Native GLM Support with Distributed Inference: Native GLM model support with surfaced reasoning_content, including tensor-parallel GLM inference. Load a GLM model with model_type: glm4 (glm4moe and glm4moelite are also supported):

models:
  - name: glm
    from: huggingface:huggingface.co/THUDM/glm-4-9b-chat
    params:
      model_type: glm4

For large models, GLM inference can be distributed across nodes (tensor parallelism) via the mistral.rs pure-TCP ring all-reduce backend — no NCCL/system dependency. This is a Spice.ai Enterprise feature requiring the distributed build. Run the same model on each node, changing only node_rank:

models:
  - name: glm
    from: huggingface:huggingface.co/THUDM/glm-4-9b-chat
    params:
      model_type: glm4
      distributed_backend: ring
      nodes: 10.0.4.21,10.0.4.22 # ordered host/IP per rank; the ring backend currently requires exactly 2
      node_rank: 0 # rank of THIS node in [0, world_size); rank 0 serves the API. Set node_rank: 1 on 10.0.4.22

NSQL Context Endpoint: A new GET /v1/nsql/context endpoint returns the SQL dialect, dataset schemas (with optional sample rows), and registered functions that Spice injects into natural-language-to-SQL (POST /v1/nsql) requests — useful for inspecting or caching exactly what the model sees:

# Inspect the context injected into /v1/nsql requests (examples_limit default 3, max 100)
curl "http://localhost:8090/v1/nsql/context?include_examples=true&examples_limit=3"

Returns the dialect, per-dataset schema (keys, indexes, searchable columns), the registered function inventory, and sample rows (abbreviated):

{
  "context": "# Spice.ai NSQL Context",
  "instructions": [
    "Write SQL for the Spice runtime, which uses Apache DataFusion with the SQL parser configured for the PostgreSQL dialect.",
    "Use table and column descriptions, primary keys, foreign keys, unique constraints, and indexes when choosing joins and filters."
  ],
  "sql": {
    "engine": "Apache DataFusion",
    "version": "54.0.0",
    "dialect": "PostgreSQL",
    "parser": "DataFusion SQL parser configured with PostgreSQL dialect"
  },
  "datasets": [
    {
      "name": "sales.orders",
      "table": "orders",
      "description": "Customer orders",
      "columns": [
        { "name": "order_id", "data_type": "Int64", "nullable": false, "primary_key": true, "indexed": true },
        { "name": "customer_id", "data_type": "Utf8", "nullable": false, "vector_search": true, "full_text_search": true }
      ],
      "primary_key": ["order_id"],
      "foreign_keys": [
        { "columns": ["customer_id"], "foreign_table": "spice.sales.customers", "foreign_columns": ["id"] }
      ]
    }
  ],
  "functions": {
    "summary": "Spice SQL runs on Apache DataFusion ... Run SELECT * FROM list_udfs() to inspect the full registered function inventory",
    "search": [
      { "name": "vector_search", "syntax": "vector_search(dataset, 'query text'[, column])" },
      { "name": "text_search", "syntax": "text_search(dataset, 'query text'[, column])" }
    ]
  },
  "samples": [
    { "title": "Example rows for `sales.orders`", "content": "| order_id | customer_id |\n| --- | --- |\n| 42 | CUST-1 |" }
  ]
}

Search & Vectors

S3 Vectors Pagination: QueryVectors paginates for top-K up to 10,000.
Elasticsearch kNN Candidate Pool: The default kNN candidate pool is raised from 10 to 1000 for better recall.

SQL & Query Engine

FlightSQL Substrait Plans: CommandStatementSubstraitPlan support.
Large Result Streaming: Flight streaming is optimized for large result sets.
Write Authorization: The SQL tool allows writes for ReadWrite API keys.
Schema Evolution Policies: on_schema_change supports widening-only evolution and a drop_and_recreate policy.

Security & Connectors

Kafka mTLS: Mutual TLS configuration is surfaced in the Kafka data connector.
Secret Resolution at Startup: Secret references are checked and reported at startup.
DuckDB HNSW: Upgrade to DuckDB v1.5.3 with the statically linked VSS (HNSW) vector extension.

Adaptive Self-Tuning (Experimental)

The Spice Cayenne accelerator gains experimental opt-in self-tuning. cayenne_tuning: auto derives configuration from the detected hardware and inferred schema, while adaptive additionally runs a per-table closed-feedback controller that adapts flush caps, the in-memory CDC tier, compaction cadence, and write concurrency toward operator SLOs (replication lag, freshness, query latency, queries-per-hour). Cayenne can also maintain aggregates incrementally — with predicate-aware delta serving and incremental retraction — and fold whole-table SUM/AVG/COUNT/MIN/MAX from statistics. These features are experimental and disabled by default.

datasets:
  - from: postgres:public.orders
    name: orders
    acceleration:
      engine: cayenne
      refresh_mode: changes
      params:
        cayenne_tuning: adaptive # 'auto' (static, env- + schema-derived) or 'adaptive' (closed-loop)

Observability

Per-Dataset Query Attribution: The query_executions metric gains a datasets dimension.
HTAP Diagnostics: Improved HTAP replication diagnostics on non-convergence.
Cayenne Write Observability: Write-phase observability for the in-memory CDC tier.

Notable Bug Fixes

Cayenne Utf8View: The Utf8View read schema avoids a hash-join offset overflow.
Cayenne metastore: cayenne_metastore: turso is honored for partitioned tables and the dataset checkpoint.
Dual-write detection: Dual-write accelerated tables are detected behind the metadata-enrichment wrapper.
digest_many collisions: Values are length-prefixed so column boundaries can't collide.
Turso WAL checkpoint: WAL checkpoints route through the native Turso connection.
TLS status probe: The status check probes the metrics endpoint over HTTPS when TLS is enabled.
Search snippet offsets: Character chunk offsets persist so search snippets aren't shifted or garbled.
Async query chunk offsets: /v1/queries chunk row_offset uses the cumulative offset rather than chunk_index * chunk_size.

Dependency Updates

Dependency / Component	Version
DataFusion	v54
Arrow (arrow-rs)	v58.3
Vortex	v0.74
iceberg-rust	v0.9.1
DuckDB	v1.5.3
Rust toolchain	v1.95.0

Contributors

Breaking Changes

No breaking changes.

Cookbook Updates

No new cookbook recipes.

The Spice Cookbook includes more than 100 recipes to help you get started with Spice quickly and easily.

Upgrading

To upgrade to v2.1.0, use one of the following methods:

CLI:

spice upgrade

Homebrew:

brew upgrade spiceai/spiceai/spice

Docker:

Pull the spiceai/spiceai:2.1.0 image:

docker pull spiceai/spiceai:2.1.0

For available tags, see DockerHub.

Helm:

helm repo update
helm upgrade spiceai spiceai/spiceai --version 2.1.0

AWS Marketplace:

Spice is available in the AWS Marketplace.

What's Changed

Changelog

Make DuckDB schema cast logic more robust by @sgrebnov in #10991
perf(cayenne): reduce allocation overheads in hot paths by @lukekim in #10950
improve error message for 'params.spiceai_region' by @Jeadie in #10954
fix(acceleration): rename WriteMode variants to fix #10960 by @phillipleblanc in #10974
add Scylla, bigquery and turso to throughput benchmarking by @Jeadie in #11006
deps(ballista): pull in shuffle-on-object-store correctness fixes (datafusion-ballista PRs #42 + #43) by @phillipleblanc in #10919
fix(kafka): seek to sidecar offsets via post_rebalance callback on restart by @ewgenius in #11007
Propagate source comments into schema metadata by @lukekim in #10944
feat(chbench-driver): better alignment to BenchBase by @sgrebnov in #11012
fix: handle EXISTS/NOT EXISTS subqueries in federation analyzer by @sgrebnov in #10996
Enable filter pushdown in spicepod defined UDTFs by @Jeadie in #11004
Refactor spice dataset configuration command by @Jeadie in #10999
fix: ensure HashJoinExec partition counts match when join input is statically empty by @phillipleblanc in #11025
feat(chbench): Improve OLTP throughput and reduce PostgreSQL CDC overhead by @sgrebnov in #11018
feat(cluster): add distributed query observability metrics by @phillipleblanc in #10990
fix: delegate truncate in PolyTableProvider to inner write provider by @claudespice in #11036
Remove default runtime features - enable explicitly in spiced by @phillipleblanc in #11037
fix: preserve field and schema metadata in Vortex physical schema calculation by @claudespice in #11013
Expose metadata descriptions via PostgreSQL UDFs by @lukekim in #11032
fix: route Turso WAL checkpoint through native turso connection (fixes #10657) by @claudespice in #11048
fix: add missing truncate delegation and guards for wrapper TableProviders by @claudespice in #11014
Update DataConnector statuses by @krinart in #11052
remove redundant readonly checks by @Jeadie in #10975
Fix Unity Catalog connector compatibility with OSS Unity Catalog by @ewgenius in #11026
refactor(cdc): reduce CDC sub-batch splits for interleaved upsert/delete workloads by @sgrebnov in #11051
feat(cayenne): allow inline writes with pending deletions (deletes/upserts) by @sgrebnov in #11031
fix(sql-tool): defer read-only gate to caller's API key role by @phillipleblanc in #11040
fix: map Gemini Recitation finish reason to ContentFilter by @claudespice in #11046
feat(cayenne): fast-path CDC deletes by extracting PK values from filters by @sgrebnov in #11049
fix(cluster): gate scheduler readiness on executor partition loads by @phillipleblanc in #10992
fix(snowflake): enforce function deny-list in federation pushdown by @claudespice in #11057
perf(cdc): Last-write-wins dedup in group_into_sub_batches to reduce sub-batch splits by @sgrebnov in #11059
[Bug] Timing between reconnect and AllocateInitialPartitions leaves connection without flight_sql_client by @Jeadie in #10805
Define 'trait QueryEngine' to refactor runtime crate by @Jeadie in #11028
fix(snowflake): apply Spice function deny-list in extracted connector crate by @claudespice in #11071
perf(cayenne): keep CDC upsert PK keysets resident to avoid per-batch full-table rebuilds by @lukekim in #11074
fix(postgres-replication): emit recovery log + reduce reconnect-warn volume by @claudespice in #11084
fix metadata on search indexing by @Jeadie in #11080
perf(cayenne): scale CDC inline flush caps with memory + storage class by @lukekim in #11087
feat(cayenne): merge-on-read position deletes for PK upsert tables + memory-pool accounting by @lukekim in #11085
Support tuple-IN composite PK extraction in Cayenne delete fast-path by @sgrebnov in #11093
feat(cluster): report per-executor table statistics so distributed JoinSelection can size joins by @phillipleblanc in #11089
feat(cluster): NDV-aware executor stats so CDC q18 join swap fires by @phillipleblanc in #11098
Improve HTAP replication diagnostics on non-convergence by @sgrebnov in #11100
Normalize DataType::Null to Int32 in acceleration schema for duckdb by @krinart in #11062
Fix debezium schema evolution support by @ewgenius in #11095
feat(cayenne): incremental write-path executor statistics for distributed join sizing by @phillipleblanc in #11104
fix(cache): periodic moka maintenance to drain invalidation predicates (#11077) by @phillipleblanc in #11106
fix: validate Snowflake account identifiers and auth config by @Jeadie in #11024
fix: trace external mcp server tool calls by @ewgenius in #11058
Remove unwrap from test code; drop clippy::unwrap_used suppressions by @phillipleblanc in #11108
Upgrade to DuckDB 1.5.3 + statically link the VSS (HNSW) extension by @sgrebnov in #11107
Fix fetched_at for HTTP connector by @Jeadie in #11116
fix(search): propagate LIMIT to base TableScan in VectorScanTableProvider (fixes #8368) by @claudespice in #11124
feat(runtime): add spicebench feature to register the Cayenne catalog connector by @phillipleblanc in #11122
fix(cayenne): tombstone inline-checkpointed rows on upsert to prevent duplicate PKs by @sgrebnov in #11129
Remove possibility of a deadlock in RuntimeStatus by @krinart in #11114
Fix Windows build: vendored-vss duckdb-rs + adapt to table-providers mongodb API by @phillipleblanc in #11140
localpod: synchronize child refreshes when parent uses in-memory (arrow) accelerator by @phillipleblanc in #11139
Add datasets dimension to the query_executions metric by @phillipleblanc in #11138
fix(spiceai): keep correlated subqueries out of JOIN ON for Spice Cloud federation by @phillipleblanc in #11143
fix(duckdb): normalize timestamp columns to microsecond precision (fixes #10627) by @claudespice in #11145
feat(cayenne): sharded parallel Vortex encode with key/time clustering by @lukekim in #11144
fix(cluster): prevent DoPut write pipeline self-deadlock under ingest backpressure by @phillipleblanc in #11160
feat(chbench): configurable HTAP concurrency, DuckDB query overrides, and OLTP rate control by @sgrebnov in #11162
fix(http): preserve non-JSON response rows instead of crashing nested decomposition (fixes #11155) by @claudespice in #11161
Use declared schema in DynamoDB/MongoDB/Debezium by @krinart in #11066
fix(cluster): prevent partitioned datasets from staying Refreshing by @phillipleblanc in #11157
fix(runtime): don't list postgres as a valid accelerator engine when postgres-accel is disabled by @sgrebnov in #11169
fix(spark): recover stale or broken Spark Connect sessions on failure by @lukekim in #11171
fix(secrets): don't abort secret lookup precedence walk on a failing store by @phillipleblanc in #11175
feat(cayenne): bound aggregate write concurrency, conservative defaults, and write/read observability by @lukekim in #11170
feat(unity_catalog): support Unity Catalog credential vending for Delta Lake tables by @phillipleblanc in #11180
fix(secrets): keep failed secret stores registered so lookups report the init root cause by @phillipleblanc in #11181
fix(debezium): sign-extend minimal-width base64 decimals instead of zero-padding by @claudespice in #11184
fix(deps): update hickory-resolver to 0.26 (evicts hickory-proto 0.25.x) by @phillipleblanc in #11183
refactor(secrets): derive secret store metadata from a single registry table by @phillipleblanc in #11188
perf(cayenne): cut CDC replication lag on hot upsert tables by @lukekim in #11191
feat(cayenne): async inline-fallback (per-tombstone published flag) + 64c/256GB tuning by @lukekim in #11194
Add HTTP connector mTLS support by @lukekim in #11127
feat(snowflake): push AT TIME ZONE as CONVERT_TIMEZONE and pin session to UTC by @lukekim in #11190
feat(cdc): make cdc_max_coalesce_age_ms a real apply-loop linger by @sgrebnov in #11196
feat(cayenne): delta-write encoding levels (cayenne_delta_encoding, default auto) + make compression_strategy=zstd real by @lukekim in #11199
Add NSQL context endpoint by @lukekim in #11075
fix(federation): respect the Spice function deny-list across all SQL connectors; dialect-aware DuckDB pushdown by @claudespice in #11186
fix: surface unknown/applied cayenne_* runtime.params at startup (fixes #10970) by @claudespice in #11133
perf(cayenne): plain-fsync ordering tier on the staged-commit hot path by @lukekim in #11198
fix(kafka): decode JSON payloads to Arrow directly — fixes lossy Decimal128 + removes double-parse (#11192) by @claudespice in #11207
feat(cayenne): self-tuning accelerator — hardware + schema + closed-loop adaptive (auto/adaptive modes) by @lukekim in #11213
perf(cayenne): CDC throughput — SF-100 @10K txn/s toward <5s lag + 5K QPH by @lukekim in #11206
fix(cluster): distribute accelerated tables wrapped by metadata/index providers by @phillipleblanc in #11226
Improve Cayenne adaptive tuning and schema safety by @lukekim in #11237
feat: Add cayenne_file_pruning param by @peasee in #11239
Debezium connector - handle tombstone messages in kafka topic, with schema evolution enabled by @ewgenius in #11197
feat(cayenne): broadcast small-dimension joins to executors by @phillipleblanc in #11245
fix: scope request context across the managed query runtime by @phillipleblanc in #11253
fix: Strip inference columns from table schema on query by @peasee in #11251
fix(flightsql): don't drop un-pushed FilterExec predicates in distributed pushdown rules by @claudespice in #11256
feat(postgres): share one replication slot across multiple changes-mode datasets by @phillipleblanc in #11255
Upgrade to DataFusion v53.1, Arrow v58.3, Vortex v0.74, and dependencies by @lukekim in #11118
feat(connectors): support file_format: vortex everywhere parquet is supported by @lukekim in #11282
perf(cayenne): metadata-only publish — drop per-key insert records on upsert commit by @lukekim in #11260
fix(kafka): harden fetch_latest_message for multi-partition topics by @ewgenius in #11285
perf(cayenne): bound mem-tier checkpoint churn + O(1) per-scan deletion view by @lukekim in #11249
fix(udfs): length-prefix digest_many values so column boundaries can't collide (fixes #11272) by @claudespice in #11288
fix: restore federation deny-list enforcement regressed by the DataFusion 53 upgrade by @claudespice in #11294
fix(postgres): recover unchanged-TOAST columns from the old tuple; classify walsender contention as transient by @phillipleblanc in #11293
feat: deepen extended schema inference and wire it into cayenne compaction sharding/sorting by @lukekim in #11284
perf(cayenne): in-memory CDC tier follow-ups + write-phase observability by @lukekim in #11278
Support per-dataset CDC tunable overrides by @sgrebnov in #11295
feat(cayenne): harden adaptive auto-tuner (controller hygiene, mem-tier actuator, delete/burst signals, single opt-in) by @lukekim in #11302
fix(cayenne): scan inlined-view capture starvation under sustained CDC (analytical QPH) by @lukekim in #11299
fix(vortex): don't row-evaluate hash-join dynamic filters in the scan by @sgrebnov in #11307
fix(deps): bump rust-postgres crates (RUSTSEC-2026-0178/0179) by @lukekim in #11313
fix: strict validation of Postgres CDC params instead of silent defaults (fixes #11274) by @claudespice in #11304
fix(duckdb): always quote on-refresh sort columns so reserved-word names don't break refresh by @claudespice in #11305
feat(flightsql): fall back to original connection when endpoint location is unreachable by @melks in #11287
perf(cayenne): light-encode transient staged CDC deltas by @lukekim in #11311
feat(acceleration): widening-only schema evolution via on_schema_change by @lukekim in #11261
deps(vortex): bump pin to spiceai-53 HEAD — intra-file decode split + per-execution kernel cache by @lukekim in #11314
feat(github): enhance GitHub component validation and error handling by @lukekim in #11259
feat(cayenne): goal-driven adaptive tuning toward operator SLOs (lag, freshness, query latency, QPH) by @lukekim in #11310
fix(cayenne): broadcast-join rewrite must bail on ambiguous columns, NULL-equal joins, and residual filters by @claudespice in #11252
Add Cayenne maintained aggregates by @lukekim in #11235
perf(cayenne): single-hash composite deletion filter via KeyDeletionIndex::get_batch by @phillipleblanc in #11325
fix(Vortex): decline only the InList membership conjunct of hash-join dynamic filters by @sgrebnov in #11335
fix: scope SQL UDF arg inlining to args-table columns (fixes #11273) by @claudespice in #11337
fix(refresh): restore S3 ETag/Version refresh-skip behind provider wrappers by @phillipleblanc in #11339
fix(cayenne): ref-count in-flight scans so GC can't delete Vortex files mid-read by @phillipleblanc in #11321
fix(runtime): retry object-store dataset load when source files are not yet available by @phillipleblanc in #11342
feat(s3): default to path-style for dotted bucket names on standard AWS by @phillipleblanc in #11347
fix(runtime): resolve accelerated table through metadata-enrichment wrapper by @phillipleblanc in #11345
fix: detect dual-write accelerated tables behind the metadata-enrichment wrapper by @claudespice in #11351
feat(cayenne): incremental seq-prefix bake — shrink the merge-on-read deletion index by @lukekim in #11326
fix(adbc): prevent Spice-specific UDFs from being pushed down to ADBC sources by @krinart in #11297
fix: Query Redshift schema details from svv_redshift tables by @peasee in #11362
perf(cayenne): tune Turso connection PRAGMAs + jitter metastore retries by @lukekim in #11359
Upgrade to DataFusion 54 by @sgrebnov in #11360
feat(runtime): dedicated CDC-apply tokio runtime + per-runtime tokio metrics by @lukekim in #11370
fix(cayenne): spill oversized hash joins via sort-merge to avoid OOM by @lukekim in #11371
fix(cayenne): honor cayenne_metastore: turso for partitioned tables and the dataset checkpoint by @phillipleblanc in #11365
perf(cayenne): in-RAM scan parallelism, query admission control, skip no-op deletion encode, sound scan output_ordering by @lukekim in #11332
fix(catalog): restore DDL after DataFusion 54 broke transparent catalog-provider downcasts by @phillipleblanc in #11375
feat(flightsql): infer schema via SELECT * LIMIT 1 when GetTables is unimplemented by @melks in #11286
fix(cayenne): Utf8View read schema avoids hash-join offset overflow by @lukekim in #11379
feat(cluster): support distributed (Ballista) scans of Iceberg tables by @phillipleblanc in #11378
feat(optimizer): cost-based left-deep join reordering for Cayenne acceleration by @sgrebnov in #11377
cli - fix service-account auth in spice cloud * commands by @ewgenius in #11316
fix: Support external Redshift table schema inference and Hive external type parsing by @peasee in #11399
feat(llms): native GLM support — opt-in flash-attn + surface reasoning_content by @lukekim in #11400
feat(s3_vectors): paginate QueryVectors for topK up to 10,000 by @bjchambers in #11405
fix: surface .env parse errors with line numbers instead of silently skipping by @Oxygen56 in #11306
fix(status): probe metrics endpoint over https when TLS is enabled by @phillipleblanc in #11393
fix(mcp): record task_history spans for tool calls proxied through /v1/mcp by @phillipleblanc in #11397
Properly handle date_trunc in BigQueryDialect by @krinart in #11416
fix(snowflake): honor column scale in Int64 timestamp arm and cast TIME by @claudespice in #11418
fix: /v1/queries chunk row_offset uses cumulative offset, not chunk_index * chunk_size (fixes #11271) by @claudespice in #11398
feat(cayenne): incremental retraction for maintained aggregates + anchor bench by @lukekim in #11389
feat(cluster): support distributed (Ballista) scans of Iceberg catalog tables by @phillipleblanc in #11419
Simplify chat/responses models by @Jeadie in #10997
feat(llms): distributed tensor-parallel GLM inference via mistral.rs ring backend by @lukekim in #11406
Optimize Flight streaming for large result sets by @lukekim in #11420
fix(deps): evict rustls 0.21 / rustls-webpki 0.101.7 (GHSA-82j2-j2ch-gfr8) by @phillipleblanc in #11428
feat(cayenne): in-memory CDC intra-apply sharding (PK-hash shards) by @lukekim in #11421
fix(cayenne): shard CDC upserts with pending deletions so the N>1 slot-ack advances by @lukekim in #11445
fix(cluster): keep built-in avg over Spark avg (distributed aggregate state schema mismatch) by @phillipleblanc in #11434
feat(views): support params.file_format for embedding chunking by @Jeadie in #11424
fix: offload blocking sync calls off the primary async runtime by @phillipleblanc in #11435
fix(udfs): rebind dot_product alias to Spice's inner_product on DataFusion 54 by @lukekim in #11443
feat(secrets): add full-fidelity reference iteration and a resolution-status API by @phillipleblanc in #11195
fix: Deny unsupported array functions for Postgres pushdown by @peasee in #11450
fix(cli): spice query honors --http-endpoint instead of failing on a Flight connect by @phillipleblanc in #11452
fix(cayenne): coordinate query-pool + in-memory CDC tier budgets to prevent adaptive OOM by @lukekim in #11449
Surface mTLS config in Kafka data connector by @v1gnesh in #11372
feat(secrets): check and report secret references at startup by @phillipleblanc in #11457
Default cayenne_force_view_types to false by @sgrebnov in #11459
fix: resolve table-reference qualification in results-cache invalidation (fixes #11266) by @claudespice in #11460
feat(cayenne): metadata aggregate pushdown — fold whole-table SUM/AVG/COUNT/MIN/MAX from statistics by @bjchambers in #11414
fix(search): restore numeric trunc and fix SortPreservingMergeExec planning error (DF54) by @Jeadie in #11415
fix(cluster): route Ballista shuffle/temp to the data PVC by @phillipleblanc in #11454
fix(search): default Elasticsearch kNN candidate pool to 1000 instead of 10 (fixes #11264) by @claudespice in #11467
feat(acceleration): add on_schema_change drop_and_recreate policy by @lukekim in #11462
feat(cayenne): predicate-aware maintained aggregates serve filtered analytical queries from the CDC delta by @lukekim in #11458
feat(cluster): shared Ballista job state with scheduler failover by @phillipleblanc in #11436
feat(cayenne): extend HLL NDV sketching to string and date columns by @bjchambers in #11468
fix(search): persist character chunk offsets so search snippets aren't shifted/garbled (fixes #11269) by @claudespice in #11479
feat(cayenne): storage-aware adaptive CDC tuning — calibration probe, IMDS, I/O-cliff fast path, infeasible-SLO feedback by @lukekim in #11463
fix(cayenne): LIMIT N under-delivers on key-deletion tables by @lukekim in #11490
fix(cayenne): live/tier-accurate join build-side stats (merge-on-read deletes + never-shrink NDV) by @lukekim in #11496
perf(cayenne): kernel-space I/O hygiene — compaction fadvise + staged-commit barrier reduction by @lukekim in #11495
feat(cayenne): feed maintained-aggregate IVM from the staged-disk CDC path by @lukekim in #11491
feat(cayenne): global adaptive-tuning SLOs with per-dataset overrides; QPH global-only by @lukekim in #11497
Update search snapshots by @sgrebnov in #11473
fix: Support reading column types longer than 128 chars in Redshift by @peasee in #11500
fix(cluster): distributed (Ballista) query-execution config + scheduled SF10 bench by @phillipleblanc in #11478
fix(http): retry transient response-body read failures; de-flake backoff test by @claudespice in #11482
Re-land orphaned deletion-vector cleanup during retention deletes by @lukekim in #11501
fix(cayenne): re-upsert over a pending delete tombstone records an insert-record (overwrite resurrection) by @bjchambers in #11469
fix: Flight DoPut silently dropped client batches on early sink completion by @claudespice in #11507
Upgrade OpenTelemetry to 0.32 and reqwest to 0.13 by @phillipleblanc in #11506
fix(queries): run async /v1/queries jobs under the submitting request context by @phillipleblanc in #11505
fix(cayenne): restore append-only current-snapshot compaction by @Jeadie in #11439
perf(cayenne): orphaned deletion-vector cleanup off the write path, behind a knob by @bjchambers in #11517
fix(datafusion): accurate projected scan byte size so hash joins build the smaller side by @sgrebnov in #11503
fix(cayenne): user-visible DELETE WHERE pk IN (...) reports the real row count by @lukekim in #11514
fix(cayenne): seed persisted num_rows for hash-join sizing by @sgrebnov in #11515
fix(cayenne): correctness & memory_limit fixes from perf audit (2 P0, 3 P1) by @lukekim in #11516
feat(cayenne): wire orphaned-DV cleanup knob to spicepod params + doc sync by @bjchambers in #11523
Fix s3 vectors API by @krinart in #11536
fix: Placeholder table initialization lock swap by @peasee in #11540
chore(cluster): bump ballista pin for the null-aware anti-join fix by @phillipleblanc in #11544
fix(runtime-tools): fix memory table identifier validation rejecting valid names by @Jeadie in #11546
Bump datafusion to include spiceai/datafusion#181 by @Jeadie in #11563
Update deny.toml by @krinart in #11571
Bump datafusion (spiceai/datafusion#182) and datafusion-table-providers (#27): fix q16 CollectLeft planning error and SQLite q6 wrong revenue by @Jeadie in #11598

Full Changelog: https://github.com/spiceai/spiceai/compare/v2.0.0...v2.1.0

Spice v2.0.1 (Jun 17, 2026)

Wed, 17 Jun 2026 00:00:00 GMT

Spice v2.0.1 is now available! 🛠️

Spice v2.0.1 is a patch release focused on reliability and performance. It speeds up Apache Iceberg reads and fixes bugs across AWS S3 and object-store datasets, data acceleration, distributed query, and authenticated access.

What's New in v2.0.1

Faster Iceberg Reads with Parallel File Scanning

The Apache Iceberg reader now scans data files in parallel (#11331), improving read throughput and latency for Iceberg tables that span many files.

AWS S3 & Object-Store Reliability

Three fixes improve S3 and object-store dataset behavior:

Refresh-skip restored (#11339): ETag/Version-based refresh-skip works reliably again, so unchanged S3 objects are no longer re-downloaded on every refresh.
Retry when source files are not yet available (#11342): an object-store dataset whose source files are not present at startup now retries and becomes ready once the data appears, instead of failing permanently.
Path-style addressing for dotted bucket names (#11347): on standard AWS, buckets whose names contain dots now default to path-style addressing, avoiding TLS wildcard certificate errors under virtual-hosted-style HTTPS.

Data Acceleration & Distributed Query Fixes

Two fixes ensure accelerated datasets behave correctly in more configurations:

Acceleration endpoints (#11345): /v1/datasets/{name}/acceleration/refresh (and the related update-refresh-sql, partition-filters, and snapshots endpoints) now work for all accelerated datasets, fixing cases where some incorrectly reported Table is not accelerated.
Distributed clusters (#11226): the distributed query coordinator now serves accelerated data from executors for all accelerated datasets, instead of falling back to reading from the source for some.

Authenticated Query Fixes

With authentication enabled, queries now consistently run as the requesting user (#11253), so per-user behavior such as results caching is correctly scoped to each user.

Contributors

Breaking Changes

No breaking changes.

Cookbook Updates

No new cookbook recipes.

The Spice Cookbook includes more than 100 recipes to help you get started with Spice quickly and easily.

Upgrading

To upgrade to v2.0.1, use one of the following methods:

CLI:

spice upgrade

Homebrew:

brew upgrade spiceai/spiceai/spice

Docker:

Pull the spiceai/spiceai:2.0.1 image:

docker pull spiceai/spiceai:2.0.1

For available tags, see DockerHub.

Helm:

helm repo update
helm upgrade spiceai spiceai/spiceai --version 2.0.1

AWS Marketplace:

Spice is available in the AWS Marketplace.

What's Changed

Changelog

fix(ci): key testoperator & validator artifacts by checked-out commit by @sgrebnov in #11281
chore(deps): fix cargo-deny advisory failures on release/2.0 by @phillipleblanc in #11333
chore(deps): bump iceberg-rust to parallel file scanning fork (release/2.0) by @phillipleblanc in #11331
fix(refresh): restore S3 ETag/Version refresh-skip behind provider wrappers by @phillipleblanc in #11339
fix(runtime): retry object-store dataset load when source files are not yet available by @phillipleblanc in #11342
feat(s3): default to path-style for dotted bucket names on standard AWS by @phillipleblanc in #11347
fix(runtime): resolve accelerated table through metadata-enrichment wrapper by @phillipleblanc in #11345
fix(cluster): distribute accelerated tables wrapped by metadata/index providers by @phillipleblanc in #11226
fix: scope request context across the managed query runtime by @phillipleblanc in #11253

Full Changelog: https://github.com/spiceai/spiceai/compare/v2.0.0...v2.0.1

Spice v2.0-stable (Jun 5, 2026)

Fri, 05 Jun 2026 00:00:00 GMT

53 releases since Spice 1.0-stable, Spice.ai OSS has reached the 2.0-stable milestone! 🎉

Spice v2.0.0 is the next major release of Spice and a major milestone in the project's development, advancing Spice from a single-node engine into a distributed data and query platform built for enterprise AI agents. These agents need low-latency, governed access to data spread across many production systems, and because they generate their own queries autonomously, that access has to be sandboxed, observable, and able to absorb occasional heavy analytical queries without overwhelming the underlying systems. The release is headlined by multi-node distributed query, now generally available — multi-active, highly-available, and object-store-native, built on Apache Ballista — distributing both query execution and ingestion across executors with data-local routing and per-executor statistics for distributed join planning. Alongside it, the Spice Cayenne data accelerator is generally available, built on the Vortex compressed columnar format, with a high-throughput CDC write path, MERGE INTO, SQL-defined partitioning, inline writes, a dedicated compaction runtime, and write-path statistics for distributed join sizing. The engine also moves to DataFusion v52 with sort pushdown, a rewritten merge join, and dynamic filters, and the Spice CLI is rewritten in Rust as a single self-contained binary.

v2.0 also expands real-time and write-path capabilities across the platform: native CDC from MongoDB Change Streams and PostgreSQL WAL logical replication, durable Kafka CDC offsets, DML write-back for PostgreSQL, Snowflake, DynamoDB, Arrow, and DuckLake, DDL and MERGE INTO for Iceberg catalogs, mutual TLS across server endpoints and outbound connectors, HashiCorp Vault and Azure Key Vault secret stores, user-defined functions, hybrid search with Elasticsearch and DuckDB HNSW vector indexes, provider-aware LLM prompt caching, and the Responses API across all model providers.

Highlights in v2.0.0 include:

Spice Cayenne (GA) — generally available on the Vortex compressed columnar format, with WAL-staged writes, inline low-latency writes, fast-path CDC deletes, merge-on-read position deletes, composite & SQL-defined partitioning, MERGE INTO, dedicated compaction runtime, and join-sizing statistics maintained on the write path
Multi-Active HA Distributed Query (GA) — multi-node distributed query built on Apache Ballista, with object-store-native clustering, dynamic cluster sizing, distributed ingestion, data-local query routing, per-executor table statistics for distributed join planning, and async queries via /v1/queries
Mutual TLS (mTLS) — public mTLS for HTTP and Flight, TLS cert hot-reload, and mTLS client certificates for FlightSQL and Spice.ai connectors
Enterprise Authentication & Authorization — OIDC bearer-token verification and Cedar-based authorization policy with per-principal row- and column-level filtering
New Secret Stores — HashiCorp Vault and Azure Key Vault
CDC Sources — native MongoDB Change Streams, PostgreSQL WAL logical replication, and durable Kafka CDC offsets — no Debezium or Kafka middleware required
DML & DDL — INSERT/UPDATE/DELETE write-back for PostgreSQL, Snowflake, DynamoDB, and Arrow; CREATE TABLE/DROP TABLE and MERGE INTO for Iceberg catalogs
User-Defined Functions — SQL UDFs in spicepods, remote UDFs over HTTP, and optional geospatial ST_* UDFs
On-Demand Dataset Loading & Unified Query Cancellation — faster startup and end-to-end cancellation across HTTP, Flight, FlightSQL, and MCP
Dynamic HTTP Connector — OAuth2 refresh tokens, pagination, dynamic headers, subquery-driven parameters, and rate-control state persisted across restarts
Storage-Profile Accelerator Tuning & refresh_mode: snapshot — storage-aware acceleration defaults and point-in-time snapshot acceleration
Search & Vectors — Elasticsearch data connector with native hybrid search, DuckDB HNSW vector engine with a statically linked VSS extension, multi-vector MaxSim embeddings, and a rerank() UDTF
AI & LLM — provider-aware prompt caching, Responses API across all providers, MCP Streamable HTTP transport, and a searchable LLM tool registry
New Data Connectors — Elasticsearch (Alpha), GCS (Alpha), Azure Cosmos DB (Alpha), Git (RC), ADBC, DuckLake (Beta), and catalog connectors for PostgreSQL, MySQL, MSSQL, and Snowflake
Rust CLI — single-binary spice CLI with spice query async REPL, shell completions, and --output=json
Dependency upgrades including DataFusion v52.5, DuckDB v1.5.3, Arrow v57.2, iceberg-rust v0.9.1, Turso v0.6.1, and Vortex v0.69

Spice v2.0 includes several breaking changes. Review the breaking changes section before upgrading.

Distribution Changes

AI/ML support including local LLM/ML model and hosted LLM inference is now included in the default Spice build and image. The separate models build variant has been removed.

With models now included by default, the data-only distribution (without AI/ML support) is only published in nightly builds. Official production-ready data-only distributions are available exclusively through Spice Cloud and the Enterprise release.

A new Network Attached Storage (NAS) distribution with built-in SMB and NFS data connector support is also available in nightly builds and with Spice.ai Enterprise.

Distribution / Variant	Open Source	Spice Cloud	Enterprise
Default	✅	✅	✅
Data	Nightly only	✅	✅
NAS (SMB + NFS)	Nightly only	❌	✅
Metal (macOS)	✅	✅	✅
CUDA (Linux)	Nightly only	✅	✅
Allocator variants	Nightly only	✅	✅
ODBC connector	Local build only	✅	✅

Native Windows builds are no longer provided; use WSL for local development. For more details, see the Distributions documentation.

What's New in v2.0.0

Spice Cayenne Reaches General Availability

The Spice Cayenne data accelerator is generally available in v2.0, with a major focus across the release candidates on write-path throughput, correctness, and distributed operation.

Write path & ingest:

Staged Append Writes: WAL-based staged append writes prevent partial writes and data loss on stream errors — batches commit atomically.
Inline Writes: Small writes are serialized as Arrow IPC and committed directly into the Cayenne metastore, bypassing the staged Vortex write path for low-latency ingest. Inline upserts atomically rewrite existing inline rows, inline data stays query-visible via an in-memory union scan, and rows are checkpointed to Vortex when thresholds are reached. Inline writes now also proceed with pending deletions in flight, and inline flush caps scale with available memory and storage class.
Fast-Path CDC Deletes: DELETE statements whose filters identify primary keys directly — including composite keys expressed as (k1, k2) IN ((...), (...)) — skip the table scan entirely.
Merge-On-Read Position Deletes: Primary-key upsert tables use position deletes with memory-pool accounting, avoiding full-table rewrites on update-heavy workloads.
Resident Upsert Keysets: CDC upsert primary-key keysets stay resident between batches, avoiding per-batch full-table rebuilds.
CDC Sub-Batch Efficiency: Interleaved upsert/delete workloads produce fewer sub-batch splits, with last-write-wins deduplication applied within batches.
Dedicated Compaction Runtime: Background compaction runs on a dedicated thread pool with CDC pipelining and protected snapshots, isolating compaction work from query and ingest paths.

Query & planning:

Join Filter Propagation: Filters propagate across equi-join keys, with range fallback for large join filters and IN-list rewrites.
Write-Path Join-Sizing Statistics: Cayenne maintains live row counts and HyperLogLog-based distinct-value estimates on the write path, so distributed JoinSelection can correctly size joins without rescans.
Scan-Result Cache: A new scan-result cache accelerates hot reads, with parallel Vortex partition writes and lock-free deletion caches with bloom-prefiltered probes.

SQL & catalog:

MERGE INTO: Upsert-style MERGE INTO for Cayenne catalog tables, distributed across executors in cluster mode.
PARTITION BY in SQL: Define partitioning directly in CREATE TABLE ... PARTITION BY (...); metadata is persisted in the catalog and survives restarts.
Composite Partitioning: partition_by: [col1, col2] with hierarchical path-like keys.
File-Based Retention Deletes: Time-based retention uses file-level deletes for both position-based and primary-key tables.

Correctness: Synchronized partition commits, correct NULL-sentinel handling for nullable partition expressions, tombstoned inline-checkpointed rows on upsert (preventing duplicate primary keys), and live reads through expired protected snapshots.

Multi-Active HA Distributed Query (GA)

Spice.ai Enterprise feature. See High Availability.

Distributed Query is generally available. Built on Apache Ballista, it distributes query execution across multiple active executor nodes with no single point of failure, reading directly from object storage rather than relying on a central cluster.

Distributed query supports two execution modes:

Synchronous: Queries for accelerated datasets are distributed across executors and results stream back in real-time — best for interactive, latency-sensitive queries.
Asynchronous: Queries submitted via the HTTP /v1/queries API materialize results to object storage for later retrieval — best for long-running analytical and batch workloads.

Key capabilities:

Dynamic Cluster Sizing: The planner adjusts parallelism to the number of active executors as nodes join or leave.
Distributed Ingestion: Ingestion for partitioned accelerated tables is distributed across executors, with partition-aware write-through splitting scheduler-side Flight DoPut writes to the responsible executors.
Data-Local Query Routing: Cayenne catalog queries route to the executors holding the relevant partitions.
Per-Executor Table Statistics: Executors report table statistics — including NDV-aware estimates — so distributed JoinSelection can size joins correctly, fixing out-of-memory conditions on large semi-joins.
Readiness & Failure Detection: /v1/ready gates on a configurable executor quorum for safe rolling deployments; scheduler readiness additionally waits for executor partition loads; executor heartbeat timeout reduced from 180s to 30s.
Distributed DML & DDL: UPDATE/DELETE forwarding to all executors, executor DDL sync for late joiners, and distributed MERGE INTO.
Cluster Observability: New cluster metrics (including scheduler_active_executors_count), distributed runtime.task_history replication, and a Grafana dashboard.
Ballista S3 Shuffle: Async queries with runtime.params.shuffle_location: s3://... complete reliably with executor-environment-derived S3 clients.

Security: Mutual TLS, Secret Stores, and Hardening

Several capabilities in this section are Spice.ai Enterprise features. See Enterprise Security.

Mutual TLS across the platform:

Public mTLS for HTTP and Flight: client_auth_mode: request (optional, for migration windows) or required (strict) client-certificate verification.
TLS Cert Hot-Reload: The runtime reloads TLS certificates on SIGHUP for zero-downtime rotation.
Outbound mTLS Client Certificates: FlightSQL and Spice.ai data connectors present client certificates to upstream services; the spice sql REPL supports mTLS client auth.

runtime:
  tls:
    enabled: true
    certificate_file: /etc/spice/tls/server.crt
    key_file: /etc/spice/tls/server.key
    client_auth_mode: required
    client_auth_ca_file: /etc/spice/tls/client-ca.crt

Authentication & Authorization (Spice.ai Enterprise):

OIDC Authentication: Validate OIDC bearer tokens (JWTs) issued by enterprise identity providers — Microsoft Entra ID, Okta, Auth0, AWS Cognito, and Google — for secure access to runtime endpoints, standalone or combined with API keys.
Principal-Based Policy Enforcement: Fine-grained, Cedar-based authorization policy configured under runtime.authorization governs allow/deny access across datasets, models, tools, and endpoints. Combined with identity SQL functions (current_principal(), current_principal_email(), current_principal_groups()), policies enforce per-principal row-level filtering and column masking.

New Secret Stores: HashiCorp Vault (KV v1/v2; token, approle, kubernetes, and jwt auth with automatic lease renewal) and Azure Key Vault (service principal, managed identity, workload identity, Azure CLI, or auto-detect; sovereign cloud support).

Hardening:

Read-only API Key Enforcement on the Flight DoGet path and async query endpoints.
Per-Principal Cache Namespacing: SQL, search, and caching-accelerator caches are namespaced per authenticated principal so cached results never cross identity boundaries.
API Key Timing Leak & Remote-UDF SSRF: Closed a timing-based position-disclosure leak in API key comparison and blocked SSRF via remote UDF endpoints.
Snowflake Function Deny-List: A function deny-list is enforced in Snowflake federation pushdown, and Snowflake account identifiers and auth configuration are validated at startup.
MCP allowed_hosts: MCP servers can be restricted to an explicit allowlist of upstream hosts.

Change Data Capture (CDC) Sources

See Change Data Capture (CDC) for an overview of CDC in Spice.

MongoDB Change Streams: MongoDB datasets with refresh_mode: changes stream changes natively into any local accelerator — no Debezium or Kafka required.
PostgreSQL Native Replication (WAL): PostgreSQL datasets stream INSERT/UPDATE/DELETE directly from logical replication using pgoutput decoding, with automatic per-replica slot management, an initial REPEATABLE READ bootstrap snapshot, and durable LSN acknowledgement.
Kafka CDC Offset Persistence: Kafka CDC offsets persist in sidecar tables for durable, resumable streams across restarts and failovers.
Pipelined CDC Ingestion: Source reads overlap with batch apply, with envelope coalescing and improved nullability propagation.
Debezium Schema Evolution: Schema changes in Debezium-sourced datasets no longer break dataset initialization on reload.

datasets:
  - from: postgres:my_table
    name: my_table
    params:
      pg_host: localhost
      pg_db: mydb
    acceleration:
      enabled: true
      engine: duckdb
      refresh_mode: changes

DML, DDL, and Write-Back

Spice v2.0 turns more connectors and catalogs into full read/write tables:

PostgreSQL DML: INSERT, UPDATE, and DELETE write-back on PostgreSQL datasets, with foreign-key metadata exposed via the PostgreSQL catalog connector.
Snowflake DML: INSERT, UPDATE, and DELETE write-back on Snowflake datasets.
DynamoDB DML: INSERT, UPDATE, and DELETE for DynamoDB, complementing read and CDC streaming.
Arrow Primary Key Upserts: Native update-or-insert semantics for in-memory Arrow-accelerated tables.
DDL for Iceberg: CREATE TABLE and DROP TABLE via FlightSQL and /v1/sql for Iceberg, with catalog.access: read_write_create.
DuckLake INSERT: DuckLake catalog tables with read_write access support INSERT.

SQL & User-Defined Functions

See the SQL Reference for the full SQL surface area.

User-Defined Functions: Define reusable SQL UDFs as first-class spicepod components, or invoke remote functions over HTTP (Spice.ai Enterprise), plus table user functions.
Spatial SQL UDFs: Optional geospatial ST_* UDFs for geometry workloads.
JSON UDTFs: flatten_json, json_tree, and flatten_json_properties table-valued functions for JSON transformation and schema decomposition (with options such as expand_maps). See JSON Functions and Operators.
PostgreSQL Metadata UDFs: Dataset and column descriptions are exposed via PostgreSQL-compatible UDFs (obj_description, col_description), so BI tools and psql surface Spice metadata.
FlightSQL Substrait Plans: CommandStatementSubstraitPlan support for clients submitting Substrait-encoded plans.
SQL REPL Expanded View: Toggle \x for a vertical key-value layout on wide result sets.
Prepared statement, federation, and unparsing fixes across the engine, including keeping correlated subqueries out of JOIN ON conditions for Spice Cloud federation and correct EXISTS/NOT EXISTS subquery handling in the federation analyzer.

Runtime Features

On-Demand Dataset Loading: Datasets can be deferred — registered with a declared schema at startup (columns[].type, columns[].nullable) and fully resolved on first reference, reducing startup time and memory for large spicepods.
Unified Query Cancellation: HTTP, Flight, FlightSQL, MCP, and internal execution paths honour a unified cancellation signal — disconnects, REPL Ctrl-C, and cancelled HTTP requests cancel the query end-to-end.
Storage-Profile Accelerator Tuning: acceleration.storage_profile (auto, local_ssd, ebs, tmpfs) applies storage-aware defaults across DuckDB, SQLite, Turso, and Cayenne file-mode accelerators; auto detects the backing storage.
refresh_mode: snapshot (Spice.ai Enterprise): Point-in-time snapshot acceleration with SQLite/Turso WAL flushing and Cayenne metastore slice integration, now reporting accurate readiness when no snapshot exists yet.
Structured Component Errors: /v1/datasets?status=true and /v1/models?status=true return structured error objects (category, type, code) and human-readable error_message fields; the CLI shows an ERROR column.
Actionable Config Errors: Parameter typos, missing secret references, and unknown engine names produce specific, actionable errors with suggestions.

Spicepod v2

Spicepods now support version: v2, the default for spice init, while v1 spicepods continue to work with automatic migration of deprecated fields.

Version	Status
`v2`	Default. Used by `spice init`.
`v1`	Supported. Deprecated fields auto-migrate.
`v1beta1`	Removed. No longer accepted.

v1 (deprecated)	v2 (preferred)	Notes
`runtime.results_cache`	`runtime.caching.sql_results`	All fields migrate automatically. `cache_max_size` → `max_size`.
`runtime.memory_limit`	`runtime.query.memory_limit`	Auto-migrated. `query.memory_limit` takes priority if both set.
`runtime.temp_directory`	`runtime.query.temp_directory`	Auto-migrated. `query.temp_directory` takes priority if both set.
`dataset.invalid_type_action`	`dataset.unsupported_type_action`	Auto-migrated. v2 adds a new `string` variant.

New v2 fields include runtime.ready_state, runtime.query.spill_compression, runtime.caching.sql_results.stale_while_revalidate_ttl, runtime.caching.sql_results.encoding, scheduler partition-assignment configuration, and catalog.access: read_write_create.

Data Connectors & Catalogs

New connectors:

Elasticsearch (Alpha, Spice.ai Enterprise): Query Elasticsearch indexes as SQL tables with native hybrid search — vector_search() kNN, text_search() BM25, and rrf() fusion — plus Elasticsearch as a backing vector engine, direct FTS engine configuration, and index lifecycle controls.
GCS (Alpha): Federated queries against Google Cloud Storage, with Iceberg table support.
Azure Cosmos DB (Alpha): Read-only NoSQL / Core SQL API connector with cross-partition scans and schema inference.
Git (RC): HTTPS/SSH auth, Git LFS support, and per-repo connection resilience.
ADBC: Data connector and catalog with full query federation, BigQuery support, and schema/table discovery.
DuckLake (Beta): Lakehouse-style data management with DuckDB as the metadata catalog and object storage for data — ACID transactions, time travel, and schema evolution on Parquet.
Self-Hosted Spice Connector: Connect Spice to another self-hosted Spice runtime as a federated source.

New catalog connectors for PostgreSQL, MySQL, MSSQL, and Snowflake, using native metadata catalogs for schema and table discovery. Unity Catalog compatibility extends to OSS Unity Catalog deployments, and DDL-defined catalogs can expose and query views.

HTTP connector: OAuth2 refresh-token authentication, query-parameter and no-limit pagination, dynamic request headers parameterised from query predicates, subquery-driven request parameters for fan-out queries, response metadata as queryable columns, map-to-array conversion, shared and persistent rate-control state across restarts and replicas, no caching of transient 429/5xx errors, and a correctly populated fetched_at column.

JSON ingestion: Single-object documents, JSONL, BOM-prefixed input, Socrata SODA responses, format auto-detection, and RFC 6901 json_pointer extraction of nested payloads.

Databricks: Resilience controls, Unity Catalog-aware permission prechecks with structured advisory errors, Classic SQL Warehouse foreign-table compatibility, connect_timeout/client_timeout parameters, a Databricks SQL dialect for federation, and Delta Lake column mapping (Name and Id modes).

Other connector improvements: MongoDB SRV support; MySQL mysql_zero_date_behavior; Snowflake OBJECT, MAP, GEOGRAPHY, GEOMETRY, VECTOR, and TIMESTAMP_LTZ types plus key-pair auth; ClickHouse Date32; S3 s3_url_style for path-style addressing and faster Parquet reads; GraphQL custom auth headers; Oracle and MSSQL sort/limit pushdown; GitHub GraphQL resilience; and improved Kafka reliability.

AI & LLM

Provider-Aware Prompt Caching: LLM calls automatically use provider-side prompt caching (e.g., Anthropic, OpenAI) for system prompts and tool descriptions, reducing latency and cost.
Responses API Across All Providers: The Responses API works with every configured model provider, including streaming response.output_text.delta events and Authorization: Bearer header support.
Multi-Vector Embeddings with MaxSim: List-of-string columns produce one embedding per element with MaxSim/mean/sum scoring for ColBERT-style late-interaction retrieval, plus a _match column identifying the best-matching element.
rerank() UDTF: Reorder results from vector_search, text_search, or rrf using any registered chat model as a reranker, with automatic query propagation and pushdown support.
Searchable LLM Tool Registry: Agents discover tools via semantic search instead of enumerating every tool in the system prompt.
MCP Improvements: Streamable HTTP transport (/v1/mcp) on rmcp v1.5.0, native auth for streamable HTTP tools (mcp_auth_token, mcp_headers), external MCP server tool calls traced in task history, and configurable allowed_hosts.
Per-Model Rate-Limited AI UDF Execution for controlling concurrent AI function invocations.

Search & Vectors

DuckDB Vector Engine: vector_engine: duckdb uses DuckDB's HNSW index for fast approximate nearest-neighbor search without an external vector store. In v2.0.0, the DuckDB VSS extension is statically linked into the bundled DuckDB, so HNSW vector search works out-of-the-box on clean machines with no extension download. HNSW indexes are preserved across data refresh, and cosine_distance pushes down via array_cosine_distance.
Hybrid Search: Combine kNN vector search and BM25 full-text search with reciprocal rank fusion (rrf()), backed by Tantivy, Elasticsearch, or DuckDB.
Full-Text Search Performance: Significantly faster Tantivy ingestion with rollback-on-error, and search metadata is correctly preserved on indexing and in Vortex physical schema calculation.
Embedding Validation: row_id columns are validated during dataset initialization.

Caching

Improvements across Caching:

Stale-While-Revalidate: runtime.caching.sql_results.stale_while_revalidate_ttl serves stale results while revalidating in the background.
Cache Encoding: Optional compression (e.g., zstd) for SQL results cache entries.
Retention Policies for cached query results, and improved CDC-driven cache invalidation (including view plan invalidation on updates).
Idle Cache Maintenance: Periodic maintenance drains invalidation predicates on idle caches, fixing unbounded memory growth in rarely-read caches.

Performance & Query Engine

Apache DataFusion is upgraded to v52.5 over the course of the release cycle, bringing:

Sort Pushdown to Scans: ~30x faster top-K queries on pre-sorted data; Parquet scans reverse row-group order for DESC on ASC-sorted files.
Rewritten Sort-Merge Join: Up to three orders of magnitude faster in pathological cases (e.g., TPC-H Q21: minutes → milliseconds).
Dynamic Filters: MIN/MAX aggregates and hash-join build sides prune files, row groups, and rows during execution.
Faster CASE Expressions, statistics caching, and prefix-aware list-files caching for faster planning.
TableProvider DELETE/UPDATE hooks and the RelationPlanner API for extensible SQL planning.
Strict Overflow Handling: try_cast_to errors on overflow instead of silently producing NULLs.

Additional engine work: default query memory limit raised from 70% to 90% with GreedyMemoryPool, partial aggregation optimization for FlightSQLExec, improved partitioned query planning, and metastore transaction support to prevent concurrent conflicts.

Rust CLI

The Spice CLI is completely rewritten from Go to Rust — a single spice binary built from the same codebase as spiced, with full feature parity across 27+ commands.

spice query: Interactive REPL for async queries with multi-line SQL, progress indication, and cancellation.
spice dataset configure: Non-interactive flag-based configuration (--from, --description, --param KEY=VALUE, --set) alongside interactive prompts.
spice completions: Shell completion script generation.
--output=json: Machine-readable output for scripting; spice login --output adds env, json, and keychain modes.
spice init writes a yaml-language-server schema directive for IDE completions.

Observability

OpenTelemetry: Exporter fixes, authenticated metrics export, configurable metric name prefix (runtime.telemetry.metric_prefix), delta temporality by default, and OTLP resource attributes via runtime.telemetry.properties.
Query Metrics: The query_executions metric gains a datasets dimension for per-dataset query attribution.
Ingestion Metrics: rows_written, bytes_written, and dataset_acceleration_size_bytes for acceleration refresh and Flight DoPut/ADBC ingestion, and EXPLAIN ANALYZE metrics in FlightSQLExec.
Task History: Distributed task history in cluster mode and tracing for external MCP server tool calls.

Notable Bug Fixes

localpod synchronization: localpod child datasets correctly track parent refreshes when the parent uses the in-memory Arrow accelerator.
Spice Cloud federation: Correlated subqueries are kept out of JOIN ON conditions, fixing rejected federated queries.
refresh_mode: snapshot: No longer reports Ready with empty data when no snapshot exists.
Search metadata: Field and schema metadata preserved on search indexing and in Vortex physical schema calculation.
HTTP connector: fetched_at column is correctly populated.
Connector correctness: DynamoDB Streams transient-error retries and typed-NULL DML handling; ScyllaDB physical filter pushdown disabled to fix incorrect results; MSSQL TOP N pushdown; DuckDB DELETE/UPDATE on full and caching refresh modes; Turso checked arithmetic for timestamp conversions; ODBC queries no longer silently return 0 rows on failure; Flight GetFlightInfo/DoGet schema parity.

Dependency Updates

Dependency / Component	Version
DataFusion	v52.5
Ballista	v52
Arrow (arrow-rs)	v57.2
DuckDB	v1.5.3 (with statically linked VSS)
iceberg-rust	v0.9.1
Turso (libsql)	v0.6.1
Vortex	v0.69.0
delta_kernel	v0.18.2
rmcp (MCP)	v1.5.0
mistral.rs	v0.8.x (candle v0.10.1)
ADBC Core	v0.23
Rust toolchain	v1.94.1

Contributors

Breaking Changes

Models included by default: The separate models build variant has been removed. Local LLM inference is always included in the default build and image.
Windows native builds removed: Use WSL for local development.
Spicepod version defaults to v2: spice init creates version: v2 spicepods. v1 remains supported with auto-migration; v1beta1 is no longer accepted.

Flattened runtime.scheduler configuration: The nested runtime.scheduler.partition_management block is flattened and renamed:

# Before
runtime:
  scheduler:
    partition_management:
      interval: 30s
      max_assignments_per_cycle: 16
      discovery_timeout: 10s

# After
runtime:
  scheduler:
    partition_assignment_interval: 30s
    max_assignments_per_interval: 16
    partition_discovery_timeout: 10s

S3 metadata columns renamed: location, last_modified, size → _location, _last_modified, _size.
Default query memory limit changed: Increased from 70% to 90%.
Metric renames: accelerated_refresh metrics renamed to acceleration_refresh; last_refresh_time gauge renamed to include the milliseconds unit.
DuckDB parameter rename: partitioned_write_flush_threshold → partitioned_write_flush_threshold_rows.
/v1/search API: Always returns an array in matches, even for single results.
/v1/evals API removed.
Perplexity model provider removed.
x.ai model endpoint: x.ai models exclusively use the /v1/responses endpoint.

Upgrade Guide from v1.x

Most v1 spicepods continue to work on v2.0 — v1 remains supported and deprecated fields auto-migrate at load time — so many deployments can upgrade by updating the binary or image alone. The steps below cover the breaking changes that may require manual action. Review each before upgrading a production deployment.

1. Build, image, and platform changes

Models are now included by default. The separate models build variant (and the corresponding -models image tags) has been removed; local LLM inference is always included in the default build and image. If your deployment pinned a models build or -models-tagged image, switch to the default build/image.
Native Windows builds are removed. Use WSL for local Windows development.

2. Adopt Spicepod `v2` (recommended)

spice init now creates version: v2 spicepods. v1 spicepods remain supported with automatic migration, but v1beta1 is no longer accepted. To move to v2, set version: v2 and update the following fields — each auto-migrates from v1, but updating now clears the deprecation:

v1 (deprecated)	v2 (preferred)
`runtime.results_cache`	`runtime.caching.sql_results` (`cache_max_size` → `max_size`)
`runtime.memory_limit`	`runtime.query.memory_limit`
`runtime.temp_directory`	`runtime.query.temp_directory`
`dataset.invalid_type_action`	`dataset.unsupported_type_action`

3. Update changed configuration

DuckDB parameter rename: partitioned_write_flush_threshold → partitioned_write_flush_threshold_rows.
Default query memory limit raised from 70% to 90%. If you relied on the previous default to leave headroom for other processes on the host, set it explicitly via runtime.query.memory_limit.

4. Update queries and API clients

S3 metadata columns renamed: location, last_modified, size → _location, _last_modified, _size. Update any queries that reference these columns.
/v1/search always returns an array in matches, even for a single result. Update clients that assumed a scalar value.
/v1/evals API removed. Remove integrations that depend on it.

5. Update model providers

Perplexity model provider removed. Re-point affected models to another provider.
x.ai models use the /v1/responses endpoint exclusively. Ensure x.ai integrations target the Responses API.

6. Update observability

Metric renames: accelerated_refresh → acceleration_refresh, and the last_refresh_time gauge is renamed to include the milliseconds unit. Update dashboards and alerts that reference these metric names.

After updating, restart the runtime and verify datasets and models report ready via /v1/datasets?status=true and /v1/models?status=true (the CLI shows a Ready/ERROR column).

Cookbook Updates

New Spice Cookbook recipes added during the v2.0 release cycle:

Async Queries: Submit long-running queries asynchronously and retrieve results later.
DuckLake Catalog: Lakehouse-style data management with ACID transactions and time travel.
Distributed Query: Run Spice in multi-active distributed cluster mode.
mTLS: Mutual TLS for HTTP and Flight endpoints.
Elasticsearch Connector: Query Elasticsearch indexes as SQL tables.
MCP Server: Use Spice as an MCP server over Streamable HTTP.
Snowflake DML: Write-back to Snowflake with INSERT/UPDATE/DELETE.
PostgreSQL, MySQL, and MSSQL Catalogs: Schema and table discovery for external databases.
Full-Text Search: BM25 full-text search over accelerated datasets.

The Spice Cookbook includes more than 100 recipes to help you get started with Spice quickly and easily.

Upgrading

To upgrade to v2.0.0, use one of the following methods:

CLI:

spice upgrade

Homebrew:

brew upgrade spiceai/spiceai/spice

Docker:

Pull the spiceai/spiceai:2.0.0 image:

docker pull spiceai/spiceai:2.0.0

For available tags, see DockerHub.

Helm:

helm repo update
helm upgrade spiceai spiceai/spiceai --version 2.0.0

AWS Marketplace:

Spice is available in the AWS Marketplace.

What's Changed

Changelog

Add TPC-DS integration tests with S3 source and PostgreSQL acceleration by @phillipleblanc in #9006
fix(tests): fix flaky/slow/failing unit tests by @phillipleblanc in #9009
fix: Update benchmark snapshots for DF51 upgrade by @app/github-actions in #9008
fix: add feature gate to rrf TEST_EMBEDDING_MODEL by @phillipleblanc in #9017
fix: features check by @phillipleblanc in #9014
fix: Enable Cayenne acceleration snapshots by @lukekim in #9020
URL table support by @lukekim in #9018
ScyllaDB key filter by @lukekim in #8997
fix: Schema mismatch when using column projection with HTTP caching by @phillipleblanc in #9021
Add more tests for HTTP caching with columns selection by @sgrebnov in #9025
HTTP cache snapshots: default to time_interval and fix snapshots_creation_policy: on_change by @sgrebnov in #9026
Fix duplicate snapshot creation on startup by @sgrebnov in #9029
Add ScyllaDB and SMB to the README table by @krinart in #9034
Remove waiting for runtime to be ready before creating snapshot by @krinart in #9033
Fix snapshot on_change policy to skip when no writes occurred by @sgrebnov in #9028
Release notes for release release/1.11.0-rc.2 by @krinart in #9016
ci: use arduino/setup-protoc for official protobuf compiler by @phillipleblanc in #9036
ci: install unzip on aarch64 runner for arduino/setup-protoc by @phillipleblanc in #9038
fix: don't fail release if upload to minio fails by @phillipleblanc in #9039
Add missing protoc step to setup-cc action by @krinart in #9041
fix: Update Search integration test snapshots by @app/github-actions in #9013
Fix formula_1 and codebase_community in bird-bench by @Jeadie in #9000
Cayenne S3 Express One Zone improvements by @lukekim in #9015
Add zlib1g-dev to CI by @lukekim in #9052
Improve validation and logging for hash indexes by @lukekim in #9047
Upgrade Vortex with CASE-WHEN by @lukekim in #9051
x.ai models now exclusively use /v1/responses endpoint by @lukekim in #9400
Improvements for snapshot schema comparison by @krinart in #9401
v2.0 breaking changes by @lukekim in #9233
Create PartitionManagementTask for scheduler to update accelerated table partition assignments by @Jeadie in #9378
refactor(Cayenne): route all write orchestration through CayenneDataSink by @sgrebnov in #9402
Refactor benchmark to use QueryExecutor trait by @Jeadie in #9418
feat: Add spidapter build and release workflow by @peasee in #9427
Testoperator: add support for api-key when connecting to external spice instance by @sgrebnov in #9421
Initial implementation of Ducklake catalog & data connectors by @lukekim in #9083
Require aws_lc_rs since jsonwebtoken upgrade by @Jeadie in #9426
feat: Add spidapter tool by @peasee in #9425
Add release notes for 1.11.2 patch release by @sgrebnov in #9430
feat(spidapter): integrate system-adapter-protocol with SCP provisioning by @phillipleblanc in #9434
Add DuckLake TPCH E2E workflow and federated Spicepod configuration by @lukekim in #9431
fix(spidapter): use Flight handshake auth instead of x-api-key header by @phillipleblanc in #9435
[spidapter] Keep only what sparks joy by @Jeadie in #9439
Refactor binary operator balancing by @Jeadie in #9424
feat: Add Iceberg DDL support (CREATE TABLE / DROP TABLE) for default catalog override by @phillipleblanc in #9440
Fix Flight SQL schema consistency: expand view types and verify field names by @sgrebnov in #9438
Update spidapter for new system-adapter-protocol by @sgrebnov in #9442
docs: fix typos and syntax errors in style guide and error handling docs by @cluster2600 in #9445
Add acceleration refresh ingestion metrics (rows_written, bytes_written) by @phillipleblanc in #9461
Refactor(Cayenne): Replace CatalogError and string based errors with Snafu errors by @sgrebnov in #9403
Replace deprecated claude-3-5-haiku-latest with claude-haiku-4-5 by @Jeadie in #9492
Fix #9481: Preserve schema in results cache for empty query results by @phillipleblanc in #9485
Fix partition by serializing by @Jeadie in #9474
query: reconcile execution stream nullability with logical plan schema by @phillipleblanc in #9486
initial spice-cloud-client crate and spice cloud metrics --app . by @Jeadie in #9480
feat: Return dataset error message in datasets API by @peasee in #9487
Spicebench by @lukekim in #9447
build(deps): consolidate dependabot dependency updates by @phillipleblanc in #9504
fix(cluster): route non-partitioned accelerated tables in distributed mode by @phillipleblanc in #9508
Enable core scalar UDFs in refresh SQL by @sgrebnov in #9502
Fix metrics in Spidapter again by @Jeadie in #9497
fix(cluster): tolerate Completed->status propagation race in distributed query handle by @phillipleblanc in #9510
feat: Support distributed ingestion in cayenne catalog by @peasee in #9506
Fix Cayenne duplicate primary keys after DELETE + UPSERT CDC sequences by @krinart in #9494
fix(cluster): rewrite table scans inside subqueries for distributed execution by @phillipleblanc in #9518
fix: Set catalog mode to readwritecreate in spidapter by @peasee in #9519
Upgrade AWS SDK crates & set APN user-agent in AWS SDK credential bridge by @lukekim in #8328
feat(runtime): add runtime ready_state on_registration semantics by @lukekim in #9522
fix: Add spidapter post-setup retries by @peasee in #9526
Make partition discovery more robust and make initialization non-blocking by @sgrebnov in #9499
Make lint-rust-fix support targeted packages and features by @Jeadie in #9511
Handle new Cloud SCP API by @Jeadie in #9532
Refactor and simplify streaming benchmarks by @krinart in #9405
fix: ensure spidapter only increments attempts on failures by @peasee in #9534
feat: Support specifying app resources in spidapter by @peasee in #9536
test(runtime): Spice Cayenne DDL integration test by @lukekim in #9535
fix: Handle schema evolution mismatch errors during data refresh by @lukekim in #9527
fix: resolve clippy lint warnings by @phillipleblanc in #9547
pr-builds --tag for build_and_release.yml by @Jeadie in #9507
Add --output flag to spice login with env/json/keychain modes by @Jeadie in #9541
Don't use 'PartitionedTableScanRewrite' in async distributed query by @Jeadie in #9548
feat(spidapter): add local backend mode with single executor by @phillipleblanc in #9531
support chat template in HF by @Jeadie in #9543
fix(cayenne): stream PK retention deletes and run OOM regression in CI by @phillipleblanc in #9533
cayenne: Staged append writes to prevent partial writes and data loss on stream error by @sgrebnov in #9491
AcceleratedTable::scan use FederatedTable::scan when ClusterRole::Scheduler by @Jeadie in #9550
Upgrade to delta-kernel-rs v0.18.2 by @lukekim in #9528
Run cayenne tests as part of PR CI by @sgrebnov in #9554
Upgrade to DataFusion v52.2.0 by @lukekim in #9419
Remove Snapshot Compaction + Add snapshot existence check by @krinart in #9523
Update dependencies by @lukekim in #9566
fix: Update benchmark snapshots by @app/github-actions in #9565
fix: Compare Cayenne table configuration on startup by @peasee in #9529
Make Refresh::refresh_sql more robust to alterations over time. by @Jeadie in #9549
fix: Update datafusion-table-providers dependency to latest revision by @lukekim in #9574
Unset AWS_ENDPOINT_URL when empty by @krinart in #9575
fix: allow BytesProcessedExec repartitioning for unordered input by @lukekim in #9540
Sanitize DataFusion errors by @lukekim in #9530
Add conditional logging for partition assignments by @Jeadie in #9577
use 'properly early exit on SIGTERM' by @Jeadie in #9573
Update datafusion to 52.2.0 by @phillipleblanc in #9582
Ensure we query one and only one partition per request by @Jeadie in #9416
feat: Add support for Spicepod version v2 by @lukekim in #9583
[SpiceDQ] Improve error messages; Avoid race condition on allocate_initial_partitions. by @Jeadie in #9579
Update ballista dependencies to latest 52.0.0 revision by @lukekim in #9581
Fix Databricks spark_connect mode always disabled by @phillipleblanc in #9586
Support partitioning in Arrow accelerator by @Jeadie in #9571
Fix spice query CLI response deserialization by @phillipleblanc in #9588
fix: Update benchmark snapshots by @app/github-actions in #9584
fix: Share RuntimeEnv across Cayenne read/write/delete paths for targeted list_files_cache invalidation by @sgrebnov in #9589
feat: Add file:// state_location support for async queries scheduler by @phillipleblanc in #9590
Update endgame links by @krinart in #9598
ci: fix E2E CLI upgrade test to use latest release for spiced download by @phillipleblanc in #9613
fix(DF): Lazily initialize BatchCoalescer in RepartitionExec to avoid schema type mismatch by @sgrebnov in #9623
feat: Implement catalog connectors for various databases by @lukekim in #9509
Refactor and clean up code across multiple crates by @lukekim in #9620
fix: Improve error handling for distributed mode and state_location configuration by @lukekim in #9611
Properly install postgres in install-postgres action by @krinart in #9629
fix: Use Python venv for schema validation in CI by @phillipleblanc in #9637
Update spicepod.schema.json by @app/github-actions in #9640
Update testoperator dispatch to use release/2.0 branch by @phillipleblanc in #9641
fix: Align CUDA asset names in Dockerfile and install tests with build output by @phillipleblanc in #9639
Fix expect test scripts in E2E Installation AI test by @sgrebnov in #9643
testoperator for partitioned arrow accelerator by @Jeadie in #9635
Remove default 1s refresh_check_interval from spidapter for hive datasets by @phillipleblanc in #9645
Fix scheduler panic and cancel race condition by @phillipleblanc in #9644
Align Spice.ai connector parameter names across catalog/data connectors by @lukekim in #9632
docs: update distribution details and add NAS support in release notes by @lukekim in #9650
Enable postgres-accel in CI builds for benchmarks by @sgrebnov in #9649
perf: Cache Turso metastore connection across operations by @penberg in #9646
Add 'scheduler_state_location' to spidapter by @Jeadie in #9655
Implement Cayenne S3 Express multi-zone live test with data validation by @lukekim in #9631
chore(spidapter): bump default memory limit from 8Gi to 32Gi by @phillipleblanc in #9661
perf: Use prepare_cached() in Turso and SQLite metastore backends by @penberg in #9662
Improve CDC cache invalidation by @krinart in #9651
Refactor Cayenne IDs to use UUIDv7 strings by @lukekim in #9667
fix: add liveness check for dead executors in partition routing by @Jeadie in #9657
fix(s3): Fix metadata column schema mismatches in projected queries by @sgrebnov in #9664
s3_metadata_columns tests: include test for location outside table prefix by @sgrebnov in #9676
docs: Update DuckDB, GCS, Git connector and Cayenne documentation by @lukekim in #9671
Add s3_url_style support for S3 connector URL addressing by @phillipleblanc in #9642
Consolidate E2E workflows and require WSL for Windows runtime by @lukekim in #9660
Upgrade to Rust v1.93.1 by @lukekim in #9669
Security fixes and improvements by @lukekim in #9666
feat(flight): add DoPut rows/bytes written metrics for DoPut ETL ingestion tracking by @phillipleblanc in #9663
Skip caching http error response + add response_headers by @krinart in #9670
refactor: Remove v1/evals functionality by @Jeadie in #9420
Make a test harness for Distributed Spice integration tests by @Jeadie in #9615
Enable on_zero_results: use_source for views by @krinart in #9699
fix(spidapter): Lower memory limit, passthrough AWS secrets, override flight URL by @peasee in #9704
Show an error on a shared acceleration file with snapshots enabled by @krinart in #9698
Fixes for anthropic by @Jeadie in #9707
Use max_partitions_per_executor in allocate_initial_partitions by @Jeadie in #9659
[SpiceDQ] Accelerations must have partition key by @Jeadie in #9711
Upgrade to Turso v0.5 by @lukekim in #9628
feat: Rename metadata columns to _location, _last_modified, _size by @phillipleblanc in #9712
fix: bump datafusion-ballista to fix BatchCoalescer schema mismatch panic by @phillipleblanc in #9716
fix: Ensure Cayenne respects target file size by @peasee in #9730
refactor: Make DDL preprocessing generic from Iceberg DDL processing by @peasee in #9731
[SpiceDQ] Distribute query of Cayenne Catalog to executors with data by @Jeadie in #9727
Properly set primary_keys/on_conflict for Cayenne tables by @krinart in #9739
Add executor resource and replica support to cloud app config by @ewgenius in #9734
feat: Support PARTITION BY in Cayenne Catalog table creation by @peasee in #9741
Update datafusion and related packages to version 52.3.0 by @lukekim in #9708
Route FlightSQL statement updates through QueryBuilder by @phillipleblanc in #9754
JSON file format improvements by @lukekim in #9743
[SpiceDQ] Partition Cayenne catalogs writes through to executors by @Jeadie in #9737
Update to DF v52.3.0 versions of datafusion & datafusion-tableproviders by @lukekim in #9756
Make S3 metadata column handling more robust by @sgrebnov in #9762
Fetch API keys from dedicated endpoint instead of apps response by @phillipleblanc in #9767
Update arrow-rs, datafusion-federation, and datafusion-table-providers dependencies by @phillipleblanc in #9769
Chunk metastore batch inserts to respect SQLite parameter limits by @phillipleblanc in #9770
Improve JSON SODA support by @lukekim in #9795
Add ADBC Data Connector by @lukekim in #9723
docs: Release Cayenne as RC by @peasee in #9766
cli[feat]: cloud mode to use region-specific endpoints by @lukekim in #9803
Include updated JSON formats in HTTPS connector by @lukekim in #9800
Flight DoPut: Partition-aware write-through forwarding by @Jeadie in #9759
Pass through authentication to ADBC connector by @lukekim in #9801
Move scheduler_state_location from adapter metadata to env var by @phillipleblanc in #9802
Fix Cayenne DoPut upsert returning stale data after 3+ writes by @phillipleblanc in #9806
Fix JSON column projection producing schema mismatch by @sgrebnov in #9811
Fix http connector by @krinart in #9818
Fix ADBC Connector build and test by @lukekim in #9813
Support update & delete DML for distributed cayenne catalog by @Jeadie in #9805
Set allow_http param when S3 endpoint uses http scheme by @phillipleblanc in #9834
fix: Cayenne Catalog DDL requires a connected executor in distributed mode by @Jeadie in #9838
fix: Add conditional put support for file:// scheduler state location by @Jeadie in #9842
fix: Require the DDL primary key contain the partition key by @Jeadie in #9844
fix: Databricks SQL Warehouse schema retrieval with INLINE disposition and async retry by @lukekim in #9846
Filter pushdown improvements for SqlTable by @lukekim in #9852
feat: add iam_role_source parameter for AWS credential configuration by @lukekim in #9854
Fix ODBC queries silently returning 0 rows on query failure by @lukekim in #9864
feat(adbc): Add ADBC catalog connector with schema/table discovery by @lukekim in #9865
Make Turso SQL unparsing more robust and fix date comparisons by @lukekim in #9871
Fix Flight/FlightSQL filter precedence and mutable query consistency by @lukekim in #9876
Partial Aggregation optimisation for FlightSQLExec by @lukekim in #9882
fix: v1/responses API preserves client instructions when system_prompt is set by @Jeadie in #9884
feat: emit scheduler_active_executors_count and use it in spidapter by @Jeadie in #9885
feat: Add custom auth header support for GraphQL connector by @krinart in #9899
Add --endpoint flag to spice run with scheme-based routing by @lukekim in #9903
When executor connects, send DDL for existing tables by @Jeadie in #9904
fix: Improve ADBC driver shutdown handling and error classification by @lukekim in #9905
fix: require all executors to succeed for distributed DML (DELETE/UPDATE) forwarding by @Jeadie in #9908
fix(cayenne catalog): fix catalog refresh race condition causing duplicate primary keys by @Jeadie in #9909
Remove Perplexity support by @Jeadie in #9910
Fix refresh_sql support for debezium constraints by @krinart in #9912
Implement DML for DynamoDBTableProvider by @lukekim in #9915
chore: Update iceberg-rust fork to v0.9 by @lukekim in #9917
Run physical optimizer on FallbackOnZeroResultsScanExec fallback plan by @sgrebnov in #9927
Improve Databricks error message when dataset has no columns by @sgrebnov in #9928
Delta Lake: fix data skipping for >= timestamp predicates by @sgrebnov in #9932
fix: Ensure distributed Cayenne DML inserts are forwarded to executors by @Jeadie in #9948
Add full query federation support for ADBC data connector by @lukekim in #9953
Make time_format deserialization case-insensitive by @claudespice in #9955
Hash ADBC join-pushdown context to prevent credential leaks in EXPLAIN plans by @lukekim in #9956
fix: Normalize Arrow Dictionary types for DuckDB and SQLite acceleration by @sgrebnov in #9959
ADBC BigQuery: Improve BigQuery dialect date/time and interval SQL generation by @lukekim in #9967
Make BigQueryDialect more robust and add BigQuery TPC-H benchmark support by @lukekim in #9969
fix: Show proper unauthorized error instead of misleading runtime unavailable by @lukekim in #9972
fix: Enforce target_chunk_size as hard maximum in chunking by @lukekim in #9973
Add caching retention by @krinart in #9984
fix: improve Databricks schema error detection and messages by @lukekim in #9987
fix: Set default S3 region for opendal operator and fix cayenne nextest by @phillipleblanc in #9995
fix(PostgreSQL): fix schema discovery for PostgreSQL partitioned tables by @sgrebnov in #9997
fix: Defer cache size check until after encoding for compressed results by @krinart in #10001
fix: Rewrite numeric BETWEEN to CAST(AS REAL) for Turso by @lukekim in #10003
fix: Handle integer time columns in append refresh for all accelerators by @sgrebnov in #10004
fix: preserve s3a:// scheme when building OpenDalStorageFactory with custom endpoint by @phillipleblanc in #10006
Fix ISO8601 time_format with Vortex/Cayenne append refresh by @sgrebnov in #10009
fix: Address data correctness bugs found in audit by @sgrebnov in #10015
fix(federation): fix SQL unparsing for Inexact filter pushdown with alias by @lukekim in #10017
Improve GitHub connector ref handling and resilience by @lukekim in #10023
feat: Add spice completions command for shell completion generation by @lukekim in #10024
fix: Fix data correctness bugs in DynamoDB decimal conversion and GraphQL pagination by @sgrebnov in #10054
Implement RefreshDataset for distributed control stream by @Jeadie in #10055
perf: Improve S3 parquet read performance by @sgrebnov in #10064
fix: Prevent write-through stalls and preserve PartitionTableProvider during catalog refresh by @Jeadie in #10066
feat: spice completions auto-detects shell directory and writes file by @lukekim in #10068
fix: Bug in DynamoDB, GraphQL, and ISO8601 refresh data handling by @sgrebnov in #10063
fix partial aggregation deduplication on string checking by @lukekim in #10078
fix: add MetastoreTransaction support to prevent concurrent transaction conflicts by @phillipleblanc in #10080
fix: Use GreedyMemoryPool, add spidapter query memory limit arg by @phillipleblanc in #10082
feat: Add metrics for EXPLAIN ANALYZE in FlightSQLExec by @lukekim in #10084
Use strict cast in try_cast_to to error on overflow instead of silent NULL by @sgrebnov in #10104
feat: Implement MERGE INTO for Cayenne catalog tables by @peasee in #10105
feat: Add distributed MERGE INTO support for Cayenne catalog tables by @peasee in #10106
Improve JSON format auto-detection for single multi-line objects by @lukekim in #10107
Add mode: file_update acceleration mode by @krinart in #10108
Coerce unsupported Arrow types to Iceberg v2 equivalents in REST catalog API by @peasee in #10109
fix: Update default query memory limit to 90% from 70% by @phillipleblanc in #10112
feat: Add mTLS client auth support to spice sql REPL by @lukekim in #10113
fix(datafusion-federation): report error on overflow instead of silent NULL by @sgrebnov in #10124
fix: Prevent data loss in MERGE when source has duplicate keys by @peasee in #10126
feat: Add ClickHouse Date32 type support by @sgrebnov in #10132
Add Delta Lake column mapping support (Name/Id modes) by @sgrebnov in #10134
fix: Restore Turso numeric BETWEEN rewrite lost in DML revert by @lukekim in #10139
fix: Enable arm64 Linux builds with fp16 and lld workarounds by @lukekim in #10142
fix: remove double trailing slash in Unity Catalog storage locations by @sgrebnov in #10147
fix: Improve GitHub GraphQL client resilience and performance by @lukekim in #10151
Enable reqwest compression and optimize HTTP client settings by @lukekim in #10154
fix: executor startup failures by @Jeadie in #10155
feat: Distributed runtime.task_history support by @Jeadie in #10156
fix: Preserve timestamp timezone in DDL forwarding to executors by @peasee in #10159
feat: Per-model rate-limited concurrent AI UDF execution by @Jeadie in #10160
fix(Turso): Reject subquery/outer-ref filter pushdown in Turso provider by @lukekim in #10174
Fix linux/macos spice upgrade by @phillipleblanc in #10194
Improve CREATE TABLE LIKE error messages, success output, EXPLAIN, and validation by @peasee in #10203
fix: chunk MERGE delete filters and update Vortex for stack-safe IN-lists by @peasee in #10207
Propagate runtime.params.parquet_page_index to Delta Lake connector by @sgrebnov in #10209
Properly mark dataset as Ready on Scheduler by @Jeadie in #10215
fix: handle Utf8View/LargeUtf8 in GitHub connector ref filters by @lukekim in #10217
fix(databricks): Fix schema introspection and timestamp overflow by @lukekim in #10226
fix(databricks): Fix schema introspection failures for non-Unity-Catalog environments by @lukekim in #10227
feat: Add pagination support to HTTP data connector by @lukekim in #10228
feat(databricks): DESCRIBE TABLE fallback and source-native type parsing for Lakehouse Federation by @lukekim in #10229
fix(databricks): harden HTTP retries, compression, and token refresh by @lukekim in #10232
feat[helm chart]: Add support for ServiceAccount annotations and AWS IRSA example by @peasee in #9833
fix: Log warning and fall back gracefully on Cayenne config change by @krinart in #9092
fix: Handle engine mismatch gracefully in snapshot fallback loop by @krinart in #9187
fix: Full Text Search schema mismatch with ADBC connector by @lukekim in #10235
docs: Update v2.0.0-rc.2 release notes with latest changes by @lukekim in #10238
Fix append refresh dedup failure when refresh_sql selects column subset by @sgrebnov in #10225
Revert "Properly mark dataset as Ready on Scheduler (#10215)" by @sgrebnov in #10242
Fix failing merge conflicts for benchmarks by @krinart in #10247
fix(github): fetch commits for dynamic and slash refs by @lukekim in #10233
Upgrade DataFusion to v52.5.0-rc1 by @lukekim in #10249
Merge develop to trunk (2026-04-09) by @claudespice in #10248
fix: Validate embedding row_id columns during dataset init (fixes #8226) by @claudespice in #10208
fix: Update tpch benchmark snapshots for federated/glue[csv].yaml by @app/github-actions in #10244
feat(databricks): add resilience controls, UC awareness, and task history instrumentation by @lukekim in #10246
fix: Make PartitionManager resilient to bare vs fully qualified table references by @sgrebnov in #10257
fix: Update tpch benchmark snapshots for accelerated/s3[parquet]-cayenne[file].yaml by @app/github-actions in #10256
Merge develop to trunk (2026-04-10) by @claudespice in #10251
Improve Snowflake/ADBC dataset registration performance and observability by @lukekim in #10266
Fixes for kafka connector by @krinart in #10263
fix(runtime): gate otel code tags, suppress aws sdk noise, and unblock connector init by @lukekim in #10260
fix(runtime): avoid regionless AWS SDK loads by @lukekim in #10271
Add versioned release install workflow coverage by @lukekim in #10276
fix(runtime): handle HTTP JSON unions and spicepod reloads by @lukekim in #10277
Databricks UC permission prechecks: explicit denial as permanent error, ambiguous cases advisory by @lukekim in #10274
Revert component status changes re-introduced by develop merge (#10248) by @sgrebnov in #10293
Fix broken CI workflows by @ewgenius in #10294
Group dependabot updates by ecosystem by @lukekim in #10296
fix(tests): Replace flaky S3 Vectors snapshot tests with structural validation by @lukekim in #10301
Update test_github_workflows snapshot by @lukekim in #10304
fix(ci): fix Bedrock runner mismatch and snapshot auto-merge failure by @ewgenius in #10306
feat(http): Add map-to-array conversion and query-parameter pagination by @lukekim in #10295
New crate: datafusion-ddl by @Jeadie in #10205
Make Databricks UC permission checks advisory with structured error reporting by @lukekim in #10283
build(deps): bump the github-actions-dependencies group with 4 updates by @app/dependabot in #10298
fix: Clear cached plans on view updates by @peasee in #10312
build(deps): bump the aws-sdk group with 7 updates by @app/dependabot in #10299
Code out of runtime. by @Jeadie in #10178
fix: Respect function registry denies for accelerated table filter pushdown by @peasee in #10311
fix: Don't block heartbeat when all slots acquired by @peasee in #10322
fix: strip only outer parens in get_table_partition_expr_from_ctx by @Jeadie in #10323
Upgrade datafusion-table-providers with MongoDB SRV support by @lukekim in #10317
fix: Avoid pushing down bucketing partition expressions into executors by @peasee in #10324
Upgrade datafusion-table-providers to d1b911a5 and bump adbc to 0.23 by @lukekim in #10329
fix: Update Search integration test snapshots by @app/github-actions in #10308
Handle foreign table + Classic sql warehouse combination gracefully by @krinart in #10318
New crate datafusion-flightsql by @Jeadie in #10201
Set tantivy=warn unless very verbose logging by @Jeadie in #10338
Remove image registry and image name options from spidapter by @ewgenius in #10241
build(deps): bump sysinfo from 0.37.2 to 0.38.4 by @app/dependabot in #10291
build(deps): bump futures from 0.3.31 to 0.3.32 by @app/dependabot in #10289
New crate 'datafusion-dml' by @Jeadie in #10334
Jeadie/26 04 16/spice sql by @Jeadie in #10343
Add Teraswitch/Pittsburgh apt mirrors + retry config for CI runners by @lukekim in #10349
Implement sort pushdown and fix pushdown gaps across providers by @lukekim in #10337
Merge develop to trunk (2026-04-16) by @claudespice in #10345
Update candle and mistral.rs lock-step pins by @lukekim in #10278
docs: fix status badges in README by @lukekim in #10350
Migrate secrets to vars by @krinart in #10354
Add limit pushdown and improve sort pushdown for Oracle and MSSQL by @sgrebnov in #10351
Fix ubuntu mirror configuration by @ewgenius in #10359
fix: Increase throughput test default ready_wait from 30s to 300s (fixes #8207) by @claudespice in #10344
Add auth headers support to OTEL metrics exporter by @lukekim in #10347
fix(github): shrink GraphQL page size on gateway errors; lower comment defaults by @lukekim in #10355
Relax apt mirror substitution failure to warning in CI action by @ewgenius in #10361
feat(http): Add OAuth2 refresh-token auth to HTTP connector by @lukekim in #10348
Upgrade Rust toolchain to 1.94.1 by @lukekim in #10353
Handle order by and sort in PartitionedTableScanRewrite by @Jeadie in #9656
Fix OTEL Exporter by @krinart in #10363
Pin spiceai candle / TEI forks to merged revs; drop local [patch] overrides by @lukekim in #10362
Integrate spiceio and makefile_targets into pr.yml by @lukekim in #10357
ci: skip artifact compression for test binaries/archives by @lukekim in #10381
chore(deps): bump spiceai/candle, spiceai/mistral.rs, aws-lc-rs, tantivy, rand by @lukekim in #10379
Bump datafusion-table-providers (#10375) by @lukekim in #10384
fix: Update Search integration test snapshots by @app/github-actions in #10376
v2.0.0-rc.3 preparation by @ewgenius in #10382
fix(spicepod): JSON schema accepts string or {name: expr} for partition_by by @lukekim in #10352
fix: Use ROUND for Turso decimal BETWEEN comparisons (fixes #9872) by @claudespice in #10360
Revert "v2.0.0-rc.3 preparation" from trunk by @ewgenius in #10386
Add on_schema_resolved dataset ready state by @lukekim in #10368
feat: Add Elasticsearch data connector with hybrid search support by @lukekim in #10258
ci: bump test archive upload compression-level to 1 by @lukekim in #10388
feat(git-connector): promote Git connector to RC status by @lukekim in #10385
feat(postgres): stream WAL directly to Spice accelerators by @lukekim in #10364
Add schema decomposition to the HTTP connector by @lukekim in #10393
fix(cayenne): Skip catalog refresh state reload for existing providers by @sgrebnov in #10396
Make cayenne-flightsql tool by @Jeadie in #10356
build(deps): bump the github-actions-dependencies group with 2 updates by @app/dependabot in #10398
Update openapi.json by @app/github-actions in #10272
Merge develop to trunk — 2026-04-19 by @claudespice in #10407
feat(otel): default OTLP push exporter to delta temporality by @phillipleblanc in #10412
fix: Restore analyzer rule ordering to run federation before type coercion by @sgrebnov in #10415
fix: Map Utf8/LargeUtf8 to STRING in Databricks/Spark SQL dialects by @sgrebnov in #10420
feat(otel): add metric name prefix at runtime.telemetry.metric_prefix by @phillipleblanc in #10418
fix: Map LargeUtf8 to VARCHAR in Athena ODBC dialect by @sgrebnov in #10419
feat(cluster): connector-driven object store registration on executors by @phillipleblanc in #10414
build(deps): bump ubuntu from 22.04 to 24.04 in the docker-dependencies group by @app/dependabot in #10397
fix: Update benchmark snapshots Apr 20 by @app/github-actions in #10417
feat(otel): apply runtime.telemetry.properties as resource attributes on exported metrics by @phillipleblanc in #10416
Publish RC releases to DockerHub; upgrade runners to ubuntu-24.04 by @lukekim in #10428
feat: Add Azure Cosmos DB (NoSQL) data connector (RC) by @lukekim in #10392
feat(datafusion): flatten_json_properties + json_tree UDTFs by @lukekim in #10406
Harden /v1/tools and /v1/nsql against unauthenticated / LLM-driven SQL by @lukekim in #10365
feat(embeddings): multi-vector embeddings with MaxSim + late-interaction by @lukekim in #10408
Update GH runners for CUDA builds by @ewgenius in #10432
fix(delta_lake): register object stores on cluster executors by @phillipleblanc in #10436
DF-native DML by @krinart in #10327
ci: run Build and Test on spiceai-macos; split install jobs by profile by @lukekim in #10434
Improve search UDTFs: text_search, vector_search, rrf by @lukekim in #10387
fix(model2vec): Improve robustness of model loading for sentence-transformers layouts by @sgrebnov in #10444
Merge develop to trunk — 2026-04-21 by @claudespice in #10448
Enable filter pushdown for vector_search UDTF by @sgrebnov in #10447
Support Snowflake OBJECT, MAP, GEOGRAPHY, GEOMETRY, VECTOR, TIMESTAMP_LTZ types by @lukekim in #10451
Fix Databricks tests by @krinart in #10449
fix(cluster): forward register_object_stores through connector wrappers by @phillipleblanc in #10460
Fixes for vector-search by @krinart in #10455
Add expand_maps option and flatten_json UDTF by @lukekim in #10452
fix: Update Search integration test snapshots by @app/github-actions in #10458
Fix physical codec decode ambiguity for empty protobuf messages by @sgrebnov in #10466
chore(logging): demote s3_single_file_cached skip refresh log to debug by @phillipleblanc in #10467
Enable filter pushdown for rrf UDTF by @sgrebnov in #10465
feat(cluster): consolidate distributed state into cluster.json by @phillipleblanc in #10463
feat(cayenne): Add column statistics and data inlining by @lukekim in #10314
docs(copilot): flag missing wrapper delegation when adding default trait methods by @phillipleblanc in #10461
Wire Elasticsearch vector engine write path through acceleration by @lukekim in #10453
Add helm lint CI by @ewgenius in #10468
Fix Azure and GCS acceleration snapshot object store credential handling by @phillipleblanc in #10486
Update spicepod.schema.json by @app/github-actions in #10485
fix(secrets): harden AWS Secrets Manager secret store by @lukekim in #10478
Update datafusion-ballista crate by @sgrebnov in #10488
feat(secrets): add ParameterSpec and more params for AWS secrets manager by @phillipleblanc in #10487
Add rerank UDTF for hybrid search with query auto-propagation by @lukekim in #10469
Fix flatten_json_properties by @krinart in #10475
fix: preserve field and schema metadata in expand_views_schema by @claudespice in #10494
Upgrade rmcp to upstream 1.5.0; switch MCP server to Streamable HTTP by @lukekim in #10491
fix: handle Snowflake TIMESTAMP_LTZ wire format and prevent nanosecond overflow by @claudespice in #10493
Lint parity in Makefile by @krinart in #10492
Add connect_timeout/client_timeout params to Databricks sql_warehouse mode by @lukekim in #10495
fix(tracing): suppress opentelemetry INFO logs at all verbosity levels by @lukekim in #10497
DynamoDB DML by @krinart in #10470
feat(cayenne): native vector search via SIMD similarity UDFs by @lukekim in #10456
fix(cli): suppress banner for all JSON-producing cloud subcommands (fixes #10498) by @claudespice in #10510
fix(deps): bump openssl to 0.10.78 by @phillipleblanc in #10509
fix(s3): quiet AWS SDK credential probe when no region is configured by @phillipleblanc in #10506
fix(cdc): emit ready signal on caught-up Kafka/Debezium streams (#5201) by @phillipleblanc in #10504
runtime-cluster crate + Run partition discovery before forwarding refresh to executors by @krinart in #10490
Update lint-rust target to use --keep-going by @Jeadie in #10508
Add TPC-H SF100 s3[parquet]-duckdb[file] benchmark spicepod by @lukekim in #10524
Remove dev-profile install steps from pr.yml by @Jeadie in #10507
fix: add missing NULL check on Timestamp path in append refresh by @claudespice in #10518
fix: return error on Decimal128/256 overflow instead of silently dropping scale by @claudespice in #10519
fix: delegate update and delete_from in IndexedTableProvider and EmbeddingTable by @claudespice in #10520
feat(devx): make config errors, CLI, and REPL lead users to success by @lukekim in #10489
fix(rerank): defer execution to RerankExec, enable filters and projection pushdown by @sgrebnov in #10514
fix(llms): support Gemma models with missing attention_bias config field by @lukekim in #10523
Fix vector_search silently ignoring named limit/column/include_score args by @sgrebnov in #10527
fix: split unsupported filters locally in scan() for UseSource mode by @ewgenius in #10528
feat(secrets): add Azure Key Vault secret store by @lukekim in #10496
Bump mistralrs by @krinart in #10532
Fix benchmark configurations and CI build issues by @sgrebnov in #10535
Fix catalog query overrides for MySQL and MSSQL benchmarks by @sgrebnov in #10543
For Cayenne, preserve matched columns for MERGE ... ON by @Jeadie in #10340
build(deps): bump the aws-sdk group across 1 directory with 5 updates by @app/dependabot in #10538
docs: update AI agent instructions (git workflow + Rust 1.94) by @lukekim in #10544
fix: Update tpch benchmark snapshots by @app/github-actions in #10529
fix: Update tpch benchmark snapshots for accelerated/s3[parquet]-duckdb[file].yaml by @app/github-actions in #10525
Extract runtime-datafusion from runtime by @krinart in #10545
Use generic DML extension planner for Cayenne by @Jeadie in #10437
fix: Update Search integration test snapshots by @app/github-actions in #10552
Fix security and correctness audit issues by @lukekim in #10526
fix(MySQL): revert MySQL result column reorder to fix federated query failures by @sgrebnov in #10557
Fix protoc installation by @krinart in #10566
fix: Disable Ballista dynamic filters on HashJoinExec by @peasee in #10548
Support views on DDL catalogs by @Jeadie in #10554
Update datafusion by @Jeadie in #10422
Improve full-text search indexing performance by @sgrebnov in #10464
feat(mysql): add mysql_zero_date_behavior parameter (null|error) by @phillipleblanc in #10573
fix(snowflake): declare private_key in connector PARAMETERS (fixes #10517) by @claudespice in #10559
Honour CARGO_TARGET_DIR in Makefiles by @Jeadie in #10569
Enable cosine_distance pushdown to DuckDB accelerator via array_cosine_distance by @sgrebnov in #10564
fix: Update test snapshots by @app/github-actions in #10570
fix: Update tpch benchmark snapshots by @app/github-actions in #10560
feat(snapshots): make snapshots an optional feature by @phillipleblanc in #10574
Enforce read-only API key restrictions on Flight DoGet and async query paths by @Jeadie in #10551
Improved security posture on Github workflows by @Jeadie in #10556
fix: Update datafusion-table-providers to improve SqlTable filter pushdown by @sgrebnov in #10595
feat(secrets): add HashiCorp Vault secret store by @phillipleblanc in #10561
fix: delegate update() in UpsertDedupTableProvider to inner provider by @claudespice in #10593
Add DuckDB vector engine support by @lukekim in #10562
Sharepoint - add object-store listing connector with expanded auth and write support by @lukekim in #10473
fix: Install protoc from source by @peasee in #10597
Enable DML support for PostgreSQL data connector by @phillipleblanc in #10446
feat(postgres): support inline PEM sslrootcert by @claudespice in #10578
Add foreign key metadata discovery to PostgreSQL Catalog by @sgrebnov in #10849
Add Snowflake DML support by @lukekim in #10747
Add MongoDB Change Streams support by @lukekim in #10813
Add user-defined functions by @lukekim in #10571
Add table user functions and gate HTTP servers by @lukekim in #10675
feat: add on-demand dataset loading by @phillipleblanc in #10629
feat(runtime): declared-schema deferred datasets by @phillipleblanc in #10669
feat(spicepod, runtime): add columns[].type / nullable + lenient type parser by @phillipleblanc in #10661
Replace external smb crate with internal SMB 3.1.1 client by @phillipleblanc in #10516
Add unified query cancellation across all paths by @lukekim in #10390
Add dynamic HTTP request headers by @lukekim in #10604
feat(http): Support dynamic HTTP connector request params from subqueries by @lukekim in #10636
feat(http): pass through HTTP metadata columns with JSON schema decomposition by @lukekim in #10679
Add nolimit HTTP pagination max pages by @lukekim in #10673
Add shared HTTP rate control for connectors by @lukekim in #10648
Use origin label instead of name for HTTP rate control metrics by @lukekim in #10689
fix(http): reject OR across different HTTP filter columns by @lukekim in #10625
Add provider-aware LLM prompt caching by @lukekim in #10645
Add searchable registry mode for LLM tools by @lukekim in #10647
feat: refresh_mode: snapshot + SQLite/Turso WAL flush + Cayenne metastore slice by @phillipleblanc in #10651
feat: per-principal cache namespacing for SQL/search/caching-accelerator by @lukekim in #10702
Add self-hosted Spice connector support by @phillipleblanc in #10546
Add Delta Lake Azure tenant parameter by @phillipleblanc in #10671
Support OAuth2 client credentials in 'spice cloud login' by @ewgenius in #10586
Add configurable allowed_hosts for MCP by @lukekim in #10638
fix: make Helm chart probes configurable by @peasee in #10696
Strip high-cardinality datasets dim from anonymous telemetry by @lukekim in #10711
feat(elasticsearch): direct FTS engine config + index lifecycle and ingestion controls by @lukekim in #10672
Add DuckDB HNSW vector index support for accelerated views by @sgrebnov in #10695
Rewrite DuckDB vector search SQL to activate HNSW_INDEX_SCAN by @sgrebnov in #10674
Fix DuckDB HNSW vector indexes lost after data refresh by @sgrebnov in #10668
Fix DuckDB DELETE/UPDATE on full and caching refresh mode datasets by @phillipleblanc in #10632
Fix DuckLake connector: downcast, module registration, schema discovery, and S3 credentials by @sgrebnov in #10650
Fix federation pushing denied functions inside subqueries to remote engines by @phillipleblanc in #10692
fix(caching): honour refresh_on_startup: always in caching mode by @phillipleblanc in #10594
fix(iceberg): rebuild storage factory when Hadoop catalog scheme is inferred by @sgrebnov in #10601
Pipeline CDC ingestion: overlap source reads with batch apply by @lukekim in #10676
fix: add NULL check to CDC primary key extraction by @lukekim in #10684
Properly handle nullability during CDC processing by @krinart in #10803
Flatten scheduler config and rename partition management → partition assignment by @lukekim in #10450
Improve NSQL UX and harden internal LLM tools by @lukekim in #10715
Support Responses API across model providers by @lukekim in #10724
Update xAI default model and handle Grok model retirements by @Jeadie in #10723
Improve cli table layout by @krinart in #10725
TLS cert hot-reload (mTLS plan M1) by @phillipleblanc in #10727
Fix DuckLake catalog include filter being ignored by @phillipleblanc in #10738
Promote DuckLake Catalog and Data Connector to Beta quality by @sgrebnov in #10743
feat(ducklake): Support INSERT on catalog tables with read_write access by @sgrebnov in #10744
perf(cdc): coalesce envelopes and overlap commits in apply pipeline by @lukekim in #10745
feat: Allow full version tags in spicepod version by @peasee in #10748
Add Arrow primary key upserts by @lukekim in #10749
fix(snapshot): keep refresh_mode snapshot read-only by @phillipleblanc in #10752
feat(tls): public mTLS for HTTP and Flight (channel + identity modes) by @phillipleblanc in #10753
perf(cayenne): lock-free deletion caches with bloom-prefiltered probe by @lukekim in #10756
fix(security): close API key timing-position leak and remote-UDF SSRF by @lukekim in #10757
Fix 'wait_until_dependent_tables_are_ready' for catalogs by @phillipleblanc in #10758
Fixes for views and resolved tables on 'spice refresh' CLI by @phillipleblanc in #10759
Implement FlightSQL CommandStatementSubstraitPlan support by @lukekim in #10761
feat(connectors): mTLS client cert support for flightsql and spiceai connectors by @phillipleblanc in #10764
Allow arbitrary filenames when specifying spicepod path + kind validation by @krinart in #10777
fix: ignore field metadata in schema compatibility check in index_table_scan by @Jeadie in #10778
Display pushed-down limits in EXPLAIN TREE output by @lukekim in #10779
fix: enable streaming append for Kafka with Cayenne accelerator by @lukekim in #10780
fix: bound chunked-index intermediate batch size to prevent OOM by @phillipleblanc in #10783
fix: label all columns in spice cloud metrics table output by @claudespice in #10784
fix: use checked arithmetic for Turso integer-millis timestamp read path by @claudespice in #10786
fix: use checked arithmetic in timestamp-to-nanosecond conversions by @claudespice in #10666
Upgrade to DuckDB v1.5.2 by @sgrebnov in #10788
Improve CDC ingestion performance by @lukekim in #10789
Fix tool_search/tool_invoke spans by @lukekim in #10791
Add Cayenne inline mutations and benchmark coverage by @lukekim in #10792
Ensure we always resolve table names in distributed mode/metadata by @Jeadie in #10793
Remove permanent errors from DynamoDB Streams by @krinart in #10794
Add expanded view mode for wide table display in SQL REPL by @lukekim in #10797
Fix Cayenne CDC schema mismatch error by @sgrebnov in #10800
Executors should create catalog tables on join by @Jeadie in #10807
Add compressed file support for listing connectors by @lukekim in #10809
Improve Cayenne mutation, scan, and inline memtable scaling by @lukekim in #10811
Add range fallback for large join filters by @lukekim in #10816
Improve Cayenne join filter pushdown by @lukekim in #10818
Synchronize Cayenne partition commits across partitions by @phillipleblanc in #10819
fix: Deny nondistributed cayenne catalog by @peasee in #10821
Enable parallel Cayenne Vortex writes by @lukekim in #10822
Expand Arrow type handling in formatting and Elasticsearch by @lukekim in #10825
Add response.output_text.delta to responses API by @krinart in #10828
feat(cayenne): add join filter propagation and no-spill Q21 planning by @lukekim in #10840
Upgrade Turso to v0.6.0 by @sgrebnov in #10843
feat(cli): add spice feedback command to open community Slack by @lukekim in #10856
Upgrade iceberg to v0.9.1 by @sgrebnov in #10859
feat(cluster): per-request executor readiness gate on /v1/ready by @phillipleblanc in #10860
fix: Require dim-side statistics for CayennePropagateFilterAcrossEquiJoinKeys by @sgrebnov in #10863
fix: Debezium schema evolution breaks dataset init on reload by @claudespice in #10144
fix(mssql): Push topK limit to SQL Server for non-nullable sort columns by @Jeadie in #10621
fix(ScyllaDB): disable physical filter pushdown by @sgrebnov in #10772
fix: handle typed NULLs and prevent overflow in DynamoDB DML type conversions by @krinart in #10511
fix: use InsertOp::Overwrite in DynamoDB bootstrap scan_and_overwrite_accelerator by @krinart in #10639
Improve DynamoDB Bootstrap performance by @krinart in #10616
fix: preserve field and schema metadata in Vortex type transformation by @lukekim in #10628
fix: GH connector - explicitly use AWS LC RS crypto provider for jwt by @phillipleblanc in #10619
fix: add snapshot mode guards to delete_from/update and delegate DML in SwappableTableProvider by @phillipleblanc in #10685
Persist HTTP rate-control state in object storage by @lukekim in #10697
Rate limit metrics HTTP endpoint by @lukekim in #10162
feat(geo): add optional spatial SQL UDF support by @lukekim in #10833
feat(cayenne): CDC throughput, compaction, scan caching, and benchmarks by @lukekim in #10852
fix(cayenne): fix Vortex panic on highly compressible data by @sgrebnov in #10855
fix(cayenne): Read live protected snapshots after cleanup grace period by @sgrebnov in #10901
fix: Disable Cayenne HashJoin rewriter optimizer by @sgrebnov in #10882
Fix GetFlightInfo vs DoGet Flight Schema by @krinart in #10864
fix(search): preserve column casing in /v1/search primary key plumbing by @claudespice in #10909
fix(object-store): dedupe s3 url style auto-detection log by @phillipleblanc in #10898
Improve Spice CLI manifest editing and direct command modes by @lukekim in #10815
Persist Kafka CDC offsets in sidecar tables by @lukekim in #10823
feat(task-history): record Ballista stages for distributed queries by @phillipleblanc in #10831
Add '#[deny(clippy::missing_trait_methods)]' to wrapper/delegation trait impls by @Jeadie in #10795
Optimize Cayenne catalog maintenance paths by @lukekim in #10904
Centralize DuckDB settings for accelerator by @ewgenius in #10895
deps(ballista): bump to 47e2b494 to fix S3 shuffle reads under cluster mode by @phillipleblanc in #10910
Authorization header + Bump async-openai + responses_adapter fix by @krinart in #10911
Tune accelerators by storage profile by @lukekim in #10913
feat: add dataset-level on_schema_change config by @lukekim in #10908
Handle NULL sentinel for nullable partition expressions by @Jeadie in #10880
fix: Remove Cayenne Catalog from catalog registration by @peasee in #10914
Add catalog name to foreign key metadata in postgres catalog by @Jeadie in #10917
Cayenne perf: eliminate redundant clones, PK point-lookup fanout fix, IN-list rewrite + microbench coverage by @lukekim in #10916
fix(turso-shared): retry on Turso BEGIN CONCURRENT "Write-write conflict" by @lukekim in #10946
Vendor Vortex DataFusion for Cayenne by @lukekim in #10933
perf(cayenne): background retention + enable CDC pipelining for retention-configured tables by @lukekim in #10936
feat(cayenne): scale metastore pool to 32 + vs_duckdb_scaling benches (1→128 concurrency, sqlite + turso lanes) by @lukekim in #10943
feat(mcp): support auth for streamable HTTP tools by @phillipleblanc in #10927
Explicit error if v1/search requests a table without search index by @Jeadie in #10968
Fix spicepod loading failure when directory name contains dots by @sgrebnov in #10958
Extend append tests with arrow engine configurations by @sgrebnov in #10959
Remove dataset on_schema_change Policy from rc.5 release notes by @sgrebnov in #10964
Skip tpcds_q78 for Cayenne engine at SF100 by @sgrebnov in #10966
fix: Update benchmark snapshots May-20 by @app/github-actions in #10952
Fix #10951: UdtfExec invariant Vec lengths must match children count by @phillipleblanc in #10953
docs(release): update v2.0.0-rc.5 notes with latest trunk PRs by @lukekim in #10949
Remove eval related things for v2.0.0 by @Jeadie in #10945
build(deps): bump ubuntu from 24.04 to 26.04 in the docker-dependencies group by @app/dependabot in #10883
fix: Add publish = false to chbench-driver by @sgrebnov in #10939
[Bug] Timing between reconnect and AllocateInitialPartitions leaves connection without flight_sql_client by @Jeadie in #10805
Fix: refresh_mode: snapshot reports Ready with empty data when no snapshot exists by @sgrebnov in #10979
fix(cluster): gate scheduler readiness on executor partition loads by @phillipleblanc in #10992
fix: handle EXISTS/NOT EXISTS subqueries in federation analyzer by @sgrebnov in #10996
Refactor spice dataset configuration command by @Jeadie in #10999
fix: preserve field and schema metadata in Vortex physical schema calculation by @claudespice in #11013
fix: validate Snowflake account identifiers and auth config by @Jeadie in #11024
Fix Unity Catalog connector deserialization failure with OSS Unity Catalog by @ewgenius in #11026
feat(cayenne): allow inline writes with pending deletions (deletes/upserts) by @sgrebnov in #11031
Expose metadata descriptions via PostgreSQL UDFs by @lukekim in #11032
Remove default runtime features - enable explicitly in spiced by @phillipleblanc in #11037
feat(cayenne): fast-path CDC deletes by extracting PK values from filters by @sgrebnov in #11049
Cayenne optimizer rules: auto relevance test for q21-shape (all-Cayenne CH-Bench) and runtime rule selection by @lukekim in #11050
refactor(cdc): reduce CDC sub-batch splits for interleaved upsert/delete workloads by @sgrebnov in #11051
fix(snowflake): enforce function deny-list in federation pushdown by @claudespice in #11057
fix(mcp): trace external server tool calls in task history by @ewgenius in #11058
perf(cdc): Last-write-wins dedup in group_into_sub_batches to reduce sub-batch splits by @sgrebnov in #11059
PM edits to v2.0.0-rc5 by @lukekim in #11067
fix(snowflake): wire deny-list in extracted connector crate (#10703) by @claudespice in #11071
perf(cayenne): keep CDC upsert PK keysets resident to avoid per-batch full-table rebuilds by @lukekim in #11074
Fix metadata on search indexing by @Jeadie in #11080
feat(cayenne): merge-on-read position deletes for PK upsert tables + memory-pool accounting by @lukekim in #11085
perf(cayenne): scale CDC inline flush caps with memory + storage class by @lukekim in #11087
feat(cluster): report per-executor table statistics so distributed JoinSelection can size joins by @phillipleblanc in #11089
Improve Cayenne CDC write and compaction path tracing by @sgrebnov in #11091
Support tuple-IN composite PK extraction in Cayenne delete fast-path by @sgrebnov in #11093
feat(cluster): NDV-aware executor stats so CDC q18 join swap fires by @phillipleblanc in #11098
feat(cayenne): maintain join-sizing stats on the write path by @phillipleblanc in #11104
fix(cache): run periodic moka maintenance for idle caches by @phillipleblanc in #11106
Upgrade to DuckDB 1.5.3 + statically link the VSS (HNSW) extension by @sgrebnov in #11107
Fix fetched_at for HTTP connector by @Jeadie in #11116
fix(cayenne): tombstone inline-checkpointed rows on upsert to prevent duplicate PKs by @sgrebnov in #11129
feat: dedicated compaction runtime for Cayenne + CDC pipelining, protected snapshots, and test coverage by @lukekim in #11130
Add datasets dimension to the query_executions metric by @phillipleblanc in #11138
Fix #11137: localpod child not tracking parent refreshes with in-memory (arrow) parent accelerator by @phillipleblanc in #11139
Fix Windows build: vendor the VSS extension (drop nested submodule) by @phillipleblanc in #11140
fix(spiceai): keep correlated subqueries out of JOIN ON for Spice Cloud federation by @phillipleblanc in #11143
Refactor spice dataset configuration command by @Jeadie in #10999
feat(cayenne): sharded parallel Vortex encode with key/time clustering by @lukekim in #11144
fix(cluster): prevent DoPut write pipeline self-deadlock under ingest backpressure by @phillipleblanc in #11160
fix(cayenne): only warn on genuine protected-snapshot amplification by @lukekim in #11158

Full Changelog: https://github.com/spiceai/spiceai/compare/v1.11.6...v2.0.0

Spice v2.0-rc.5 (May 27, 2026)

Wed, 27 May 2026 00:00:00 GMT

Spice v2.0-rc.5 is now available! 🔥

v2.0.0-rc.5 is the fifth release candidate for advanced testing of v2.0, building on v2.0.0-rc.4.

This release completes the mTLS implementation across server endpoints and outbound connectors, adds MongoDB Change Streams and durable Kafka offset persistence as new CDC sources, expands DML write-back to PostgreSQL, Snowflake, and Arrow, promotes DuckLake to Beta, introduces user-defined functions, on-demand dataset loading, unified query cancellation, dynamic HTTP request headers and subquery-driven request parameters, provider-aware LLM prompt caching, and a long list of Cayenne performance improvements.

Highlights in this release candidate include:

Spice Cayenne — CDC throughput, compaction and scan caching, synchronized partition commits, join filter propagation, parallel Vortex writes, lock-free deletion caches
Mutual TLS (mTLS) — TLS cert hot-reload, public mTLS for HTTP and Flight (channel + identity modes), mTLS client certs for FlightSQL and Spice.ai connectors
MongoDB Change Streams — native real-time CDC for MongoDB, no Debezium or Kafka required
Kafka CDC offsets — offsets persisted in sidecar tables for durable, resumable Kafka CDC
PostgreSQL DML — INSERT, UPDATE, DELETE write-back on PostgreSQL datasets
Snowflake DML — INSERT, UPDATE, DELETE write-back on Snowflake datasets
Arrow Primary Key Upserts — native upsert path using primary key matching
DuckLake promoted to Beta — with INSERT support on catalog tables
User-Defined Functions — define SQL UDFs in spicepods, plus remote UDFs over HTTP (Spice.ai Enterprise)
Spatial SQL UDFs — optional geospatial UDFs (ST_*) for geometry workloads
On-Demand Dataset Loading — datasets can be deferred and loaded on first reference
Unified Query Cancellation — Ctrl-C and HTTP request cancellation propagate across all execution paths
Dynamic HTTP Connector — pass-through request headers, subquery-driven params, and JSON schema decomposition
HTTP Rate-Control persistence — rate-limit state persisted in object storage across restarts
refresh_mode: snapshot — point-in-time snapshot acceleration with SQLite/Turso WAL flushing
Storage-profile accelerator tuning — accelerators auto-tune defaults based on local SSD, EBS-class disk, or tmpfs
Provider-Aware LLM Prompt Caching — automatic prompt caching for OpenAI-compatible providers that support it
Responses API — support across all model providers with streaming response.output_text.delta, plus Authorization: Bearer header support

What's New in v2.0.0-rc.5

Cayenne Improvements

Significant performance work across Spice Cayenne-backed catalogs and accelerators.

Ingest throughput: End-to-end improvements to CDC ingest, background compaction, and a new scan-result cache for hot reads; parallel Vortex partition writes; lock-free deletion caches with bloom-prefiltered probes; background retention with CDC pipelining; SQLite metastore pool scaled to 32 for high-concurrency mutation workloads.
Data inlining: Small writes are serialized as Arrow IPC and committed directly into the Cayenne metastore (cayenne_inlined_data), bypassing the staged Vortex write path for low-latency ingest. Inline upserts atomically rewrite existing inline rows instead of emitting side delete markers, and inline data remains query-visible via an in-memory union scan with a generation-keyed decode cache. Inline rows are checkpointed to Vortex when row, segment, or byte thresholds are reached. Defaults are refresh-mode aware: inline writes are enabled by default for high-frequency caching, changes, and fast append workloads and disabled for full, snapshot, and slower append.
Query planning: Join filter propagation across equi-join keys (gated behind runtime.params.cayenne_filter_propagation), range fallback for large join filters, hot-path clone elimination, and IN-list rewrites for large filter lists.
Correctness: Synchronized partition commits across partitions, correct NULL-sentinel handling for nullable partition expressions (e.g. bucket(N, col)), Vortex panic fix on highly compressible data, and live reads through expired protected snapshots.
Catalog and platform: Refresh-mode-aware compaction defaults, rejection of non-distributed Cayenne catalog configurations, and a vendored Vortex DataFusion integration for faster iteration on the Cayenne planner.

Mutual TLS (mTLS)

Spice.ai Enterprise feature. See Enterprise Security.

Spice now supports full mutual TLS for both HTTP and Arrow Flight endpoints.

TLS cert hot-reload (#10727): The Spice runtime watches for SIGHUP and reloads TLS certificates without restarting, enabling cert rotation with zero downtime.

Public mTLS for HTTP and Flight (#10753): Two client_auth_mode values control how the server handles client certificates:

request — optional mTLS: the server requests a client cert but accepts connections without one (useful for migration windows).
required — strict mTLS: the server requires a valid client cert signed by the configured CA.

mTLS client certs for FlightSQL and Spice.ai connectors (#10764): Outbound connections from the FlightSQL and Spice.ai data connectors can now present client certificates for mutual authentication with upstream services.

Example configuration:

runtime:
  tls:
    enabled: true
    certificate_file: /etc/spice/tls/server.crt
    key_file: /etc/spice/tls/server.key
    client_auth_mode: required
    client_auth_ca_file: /etc/spice/tls/client-ca.crt

MongoDB Change Streams

MongoDB datasets configured with refresh_mode: changes now stream changes from MongoDB Change Streams into any local accelerator (#10813), providing real-time CDC without Debezium or Kafka.

Example configuration:

datasets:
  - from: mongodb:my_collection
    name: my_collection
    params:
      host: my-cluster.mongodb.net
      db: mydb
    acceleration:
      enabled: true
      engine: duckdb
      refresh_mode: changes

CDC Improvements

See Change Data Capture (CDC) for an overview of CDC in Spice.

Kafka CDC offset persistence (#10823): Kafka CDC offsets are persisted in sidecar tables for durable, resumable streams. On restart or failover, Spice resumes from the last committed offset.
Pipelined CDC ingestion (#10676): Source reads overlap with batch apply, with additional batching, envelope coalescing, and nullability propagation improvements across the apply pipeline.
Debezium schema evolution fix (#10144): Schema changes in Debezium-sourced datasets no longer break dataset initialization on reload (fixes #9782).

PostgreSQL DML Support

The PostgreSQL data connector now supports write-back via INSERT, UPDATE, and DELETE operations (#10446). Combined with the existing read-side federation, PostgreSQL-backed datasets can serve as full read/write tables. The PostgreSQL Catalog connector additionally exposes foreign-key metadata for NSQL and query planning (#10849).

Snowflake DML Support

The Snowflake data connector now supports write-back via INSERT, UPDATE, and DELETE operations (#10747), complementing its existing read capabilities.

Arrow Primary Key Upserts

Arrow-accelerated tables now support native upsert operations using primary key matching (#10749), providing efficient update-or-insert semantics for in-memory datasets.

DuckLake Promoted to Beta

The DuckLake Catalog and Data Connector are promoted to Beta quality (#10743).

DuckLake catalog tables with read_write access now support INSERT operations (#10744), enabling full read/write workflows against DuckLake-backed catalogs. The DuckLake connector also gains a series of correctness fixes for downcast, module registration, schema discovery, and S3 credentials (#10650).

User-Defined Functions

Spice now supports user-defined functions (UDFs) as a first-class spicepod component (#10571), letting you define reusable SQL functions in the spicepod or invoke remote functions over HTTP. The runtime also gains table user functions with HTTP server gating (#10675).

A security fix closes a remote-UDF SSRF vector (#10757).

Spatial SQL UDFs

Spice now ships an optional set of geospatial SQL UDFs (ST_*) for geometry workloads (#10833). The functions are gated behind a build feature and can be invoked from any SQL surface.

On-Demand Dataset Loading

Datasets can now be marked for on-demand loading (#10629). Deferred datasets are registered with a declared schema at startup (#10669) and only fully resolve when first referenced, reducing startup time and memory footprint for spicepods with many seldom-used datasets.

Spicepods also gain columns[].type and columns[].nullable (#10661) with a lenient type parser for declaring schemas inline.

Unified Query Cancellation

All query execution paths — HTTP, Flight, FlightSQL, MCP, and internal — now honour a unified cancellation signal (#10390). When a client disconnects, presses Ctrl-C in the REPL, or cancels an in-flight HTTP request, the corresponding query is cancelled end-to-end, freeing resources promptly.

Dynamic HTTP Connector

The HTTP data connector gains dynamic request headers parameterised from query predicates (#10604), subquery-driven request parameters for fan-out queries (#10636), HTTP response metadata as queryable columns via JSON schema decomposition (#10679), no-limit pagination (#10673), and shared rate-control across HTTP-based connectors using the same backend host (#10648).

HTTP Rate-Control Persistence

The HTTP rate-control state (per-endpoint throttle counters) is now persisted in object storage (#10697), ensuring rate limits survive restarts and are consistent across replicas. Rate-control metrics now use an origin label rather than the connector name for cleaner aggregation (#10689).

The metrics HTTP endpoint (/metrics) is also independently rate-limited (#10162) to prevent scraping from impacting query serving.

`refresh_mode: snapshot`

Spice.ai Enterprise feature. See Acceleration Snapshots.

A new refresh_mode: snapshot provides point-in-time snapshot acceleration (#10651), with SQLite and Turso WAL flushing and a Cayenne metastore slice integration so accelerated readers see a consistent snapshot while writes continue.

Storage-Profile Accelerator Tuning

Acceleration configs gain a new storage_profile field (#10913) with values auto (default), local_ssd, ebs, and tmpfs. Under auto, the runtime detects whether the acceleration store is backed by local SSD, EBS-class network disk, or tmpfs, and applies storage-aware defaults across DuckDB, partitioned DuckDB, SQLite, Turso, and Cayenne file-mode accelerators. Explicit per-accelerator parameters always override the profile defaults.

Provider-Aware LLM Prompt Caching

LLM calls automatically use provider-aware prompt caching (#10645) when the configured model provider supports it (e.g., Anthropic, OpenAI). System prompts and tool descriptions are marked for caching so repeated invocations within the cache window reuse the provider-side cached prefix, reducing latency and cost.

A new searchable registry mode for LLM tools (#10647) lets agents discover tools by semantic search rather than enumerating all tools in the system prompt, which scales to large tool inventories.

Responses API Improvements

The Responses API is now supported across all configured model providers (#10724). Streaming delta events via response.output_text.delta are also supported (#10828). The runtime now also accepts Authorization: Bearer headers in addition to x-api-key, bumps async-openai, and stops populating FunctionToolCall.id so OpenAI-compatible servers can assign the ID themselves (#10911).

Distributed Cluster Improvements

Spice.ai Enterprise feature. See High Availability.

Per-request executor readiness gate (#10860): /v1/ready on schedulers waits for a configurable quorum of executors before returning healthy, enabling proper rolling deployments.
Ballista S3 shuffle reads under cluster mode (#10910): The shuffle reader builds its S3 client from the executor pod's environment, matching the writer. Async queries with runtime.params.shuffle_location: s3://... now complete instead of failing with AccessDenied on shuffle fetches.
Flattened scheduler config (#10450): runtime.scheduler.partition_management.* fields are flattened directly onto runtime.scheduler and renamed under the canonical "partition assignment" terminology. See Breaking Changes.

Caching & Search

Improvements across Caching and Search:

Per-principal cache namespacing (#10702): SQL, search, and caching-accelerator caches are now namespaced per authenticated principal, so cached results never cross identity boundaries.
DuckDB HNSW vector indexes (#10695, #10674, #10668): DuckDB-accelerated views support HNSW vector indexes for vector search, vector search SQL is rewritten to activate HNSW_INDEX_SCAN, and HNSW indexes are preserved across data refresh.

Security Improvements

See Authentication and TLS for configuring Spice security.

API key timing-position leak and remote-UDF SSRF (#10757): Closed a timing-based position-disclosure leak in API key comparison and blocked SSRF via remote UDF endpoint parameters.
Configurable allowed_hosts for MCP (#10638): MCP servers can be restricted to an explicit allowlist of upstream hosts.

SQL, Query, and Developer Experience

See the SQL Reference for the full SQL surface area.

SQL REPL expanded view (#10797): Toggle \x in the REPL for a vertical key-value layout on wide result sets.
FlightSQL Substrait plan support (#10761): The Spice runtime now implements CommandStatementSubstraitPlan, enabling clients that submit plans as Substrait-encoded protobuf.
MCP auth for streamable HTTP tools (#10927): Streamable HTTP MCP tools support native authentication via mcp_auth_token and mcp_headers, both with full Spice secret expansion.
Elasticsearch FTS engine config and index lifecycle (#10672): Direct FTS engine configuration plus index lifecycle and ingestion controls for the Elasticsearch connector.
Self-hosted Spice connector (#10546): Connect Spice to another self-hosted Spice runtime as a federated source.

Connector Bug Fixes

Notable correctness fixes across the Data Connectors: DynamoDB Streams retry on transient errors (#10794) and typed-NULL handling in DML (#10511); ScyllaDB physical filter pushdown disabled to fix incorrect results (#10772); MSSQL TOP N pushdown for non-nullable sort columns (#10621); DuckLake include filter applied (#10738); DuckDB DELETE/UPDATE on full and caching refresh modes (#10632); checked arithmetic for Turso integer-millis and timestamp-to-nanosecond conversions (#10786, #10666); and Flight GetFlightInfo/DoGet schema parity (#10864). See the Changelog for the full list.

Dependency Updates

Dependency / Component	Version
DuckDB	v1.5.2
Iceberg	v0.9.1
Turso	v0.6.0
Vortex	v0.69.0

Contributors

Breaking Changes

Flattened runtime.scheduler configuration (#10450): The nested runtime.scheduler.partition_management block has been flattened and renamed to use the canonical "partition assignment" terminology. Migrate as follows:

# Before
runtime:
  scheduler:
    partition_management:
      interval: 30s
      max_assignments_per_cycle: 16
      discovery_timeout: 10s

# After
runtime:
  scheduler:
    partition_assignment_interval: 30s
    max_assignments_per_interval: 16
    partition_discovery_timeout: 10s

Cookbook Updates

No new cookbook recipes.

The Spice Cookbook includes 86 recipes to help you get started with Spice quickly and easily.

Upgrading

To upgrade to v2.0.0-rc.5, use one of the following methods:

CLI:

spice upgrade v2.0.0-rc.5

Homebrew:

brew upgrade spiceai/spiceai/spice

Docker:

Pull the spiceai/spiceai:2.0.0-rc.5 image:

docker pull spiceai/spiceai:2.0.0-rc.5

For available tags, see DockerHub.

Helm:

helm repo update
helm upgrade spiceai spiceai/spiceai --version 2.0.0-rc.5

AWS Marketplace:

Spice is available in the AWS Marketplace.

What's Changed

Changelog

Enable DML support for PostgreSQL data connector by @phillipleblanc in #10446
feat(postgres): support inline PEM sslrootcert by @claudespice in #10578
Add foreign key metadata discovery to PostgreSQL Catalog by @sgrebnov in #10849
Add Snowflake DML support by @lukekim in #10747
Add MongoDB Change Streams support by @lukekim in #10813
Add user-defined functions by @lukekim in #10571
Add table user functions and gate HTTP servers by @lukekim in #10675
feat: add on-demand dataset loading by @phillipleblanc in #10629
feat(runtime): declared-schema deferred datasets by @phillipleblanc in #10669
feat(spicepod, runtime): add columns[].type / nullable + lenient type parser by @phillipleblanc in #10661
Replace external smb crate with internal SMB 3.1.1 client by @phillipleblanc in #10516
Add unified query cancellation across all paths by @lukekim in #10390
Add dynamic HTTP request headers by @lukekim in #10604
feat(http): Support dynamic HTTP connector request params from subqueries by @lukekim in #10636
feat(http): pass through HTTP metadata columns with JSON schema decomposition by @lukekim in #10679
Add nolimit HTTP pagination max pages by @lukekim in #10673
Add shared HTTP rate control for connectors by @lukekim in #10648
Use origin label instead of name for HTTP rate control metrics by @lukekim in #10689
fix(http): reject OR across different HTTP filter columns by @lukekim in #10625
Add provider-aware LLM prompt caching by @lukekim in #10645
Add searchable registry mode for LLM tools by @lukekim in #10647
feat: refresh_mode: snapshot + SQLite/Turso WAL flush + Cayenne metastore slice by @phillipleblanc in #10651
feat: per-principal cache namespacing for SQL/search/caching-accelerator by @lukekim in #10702
Add self-hosted Spice connector support by @phillipleblanc in #10546
Add Delta Lake Azure tenant parameter by @phillipleblanc in #10671
Support OAuth2 client credentials in 'spice cloud login' by @ewgenius in #10586
Add configurable allowed_hosts for MCP by @lukekim in #10638
fix: make Helm chart probes configurable by @peasee in #10696
Strip high-cardinality datasets dim from anonymous telemetry by @lukekim in #10711
feat(elasticsearch): direct FTS engine config + index lifecycle and ingestion controls by @lukekim in #10672
Add DuckDB HNSW vector index support for accelerated views by @sgrebnov in #10695
Rewrite DuckDB vector search SQL to activate HNSW_INDEX_SCAN by @sgrebnov in #10674
Fix DuckDB HNSW vector indexes lost after data refresh by @sgrebnov in #10668
Fix DuckDB DELETE/UPDATE on full and caching refresh mode datasets by @phillipleblanc in #10632
Fix DuckLake connector: downcast, module registration, schema discovery, and S3 credentials by @sgrebnov in #10650
Fix federation pushing denied functions inside subqueries to remote engines by @phillipleblanc in #10692
fix(caching): honour refresh_on_startup: always in caching mode by @phillipleblanc in #10594
fix(iceberg): rebuild storage factory when Hadoop catalog scheme is inferred by @sgrebnov in #10601
Pipeline CDC ingestion: overlap source reads with batch apply by @lukekim in #10676
fix: add NULL check to CDC primary key extraction by @lukekim in #10684
Properly handle nullability during CDC processing by @krinart in #10803
Flatten scheduler config and rename partition management → partition assignment by @lukekim in #10450
Improve NSQL UX and harden internal LLM tools by @lukekim in #10715
Support Responses API across model providers by @lukekim in #10724
Update xAI default model and handle Grok model retirements by @Jeadie in #10723
Improve cli table layout by @krinart in #10725
TLS cert hot-reload (mTLS plan M1) by @phillipleblanc in #10727
Fix DuckLake catalog include filter being ignored by @phillipleblanc in #10738
Promote DuckLake Catalog and Data Connector to Beta quality by @sgrebnov in #10743
feat(ducklake): Support INSERT on catalog tables with read_write access by @sgrebnov in #10744
perf(cdc): coalesce envelopes and overlap commits in apply pipeline by @lukekim in #10745
feat: Allow full version tags in spicepod version by @peasee in #10748
Add Arrow primary key upserts by @lukekim in #10749
fix(snapshot): keep refresh_mode snapshot read-only by @phillipleblanc in #10752
feat(tls): public mTLS for HTTP and Flight (channel + identity modes) by @phillipleblanc in #10753
perf(cayenne): lock-free deletion caches with bloom-prefiltered probe by @lukekim in #10756
fix(security): close API key timing-position leak and remote-UDF SSRF by @lukekim in #10757
Fix 'wait_until_dependent_tables_are_ready' for catalogs by @phillipleblanc in #10758
Fixes for views and resolved tables on 'spice refresh' CLI by @phillipleblanc in #10759
Implement FlightSQL CommandStatementSubstraitPlan support by @lukekim in #10761
feat(connectors): mTLS client cert support for flightsql and spiceai connectors by @phillipleblanc in #10764
Allow arbitrary filenames when specifying spicepod path + kind validation by @krinart in #10777
fix: ignore field metadata in schema compatibility check in index_table_scan by @Jeadie in #10778
Display pushed-down limits in EXPLAIN TREE output by @lukekim in #10779
fix: enable streaming append for Kafka with Cayenne accelerator by @lukekim in #10780
fix: bound chunked-index intermediate batch size to prevent OOM by @phillipleblanc in #10783
fix: label all columns in spice cloud metrics table output by @claudespice in #10784
fix: use checked arithmetic for Turso integer-millis timestamp read path by @claudespice in #10786
fix: use checked arithmetic in timestamp-to-nanosecond conversions by @claudespice in #10666
Upgrade to DuckDB v1.5.2 by @sgrebnov in #10788
Improve CDC ingestion performance by @lukekim in #10789
Fix tool_search/tool_invoke spans by @lukekim in #10791
Add Cayenne inline mutations and benchmark coverage by @lukekim in #10792
Ensure we always resolve table names in distributed mode/metadata by @Jeadie in #10793
Remove permanent errors from DynamoDB Streams by @krinart in #10794
Add expanded view mode for wide table display in SQL REPL by @lukekim in #10797
Fix Cayenne CDC schema mismatch error by @sgrebnov in #10800
Executors should create catalog tables on join by @Jeadie in #10807
Add compressed file support for listing connectors by @lukekim in #10809
Improve Cayenne mutation, scan, and inline memtable scaling by @lukekim in #10811
Add range fallback for large join filters by @lukekim in #10816
Improve Cayenne join filter pushdown by @lukekim in #10818
Synchronize Cayenne partition commits across partitions by @phillipleblanc in #10819
fix: Deny nondistributed cayenne catalog by @peasee in #10821
Enable parallel Cayenne Vortex writes by @lukekim in #10822
Expand Arrow type handling in formatting and Elasticsearch by @lukekim in #10825
Add response.output_text.delta to responses API by @krinart in #10828
feat(cayenne): add join filter propagation and no-spill Q21 planning by @lukekim in #10840
Upgrade Turso to v0.6.0 by @sgrebnov in #10843
feat(cli): add spice feedback command to open community Slack by @lukekim in #10856
Upgrade iceberg to v0.9.1 by @sgrebnov in #10859
feat(cluster): per-request executor readiness gate on /v1/ready by @phillipleblanc in #10860
fix: Require dim-side statistics for CayennePropagateFilterAcrossEquiJoinKeys by @sgrebnov in #10863
fix: Debezium schema evolution breaks dataset init on reload by @claudespice in #10144
fix(mssql): Push topK limit to SQL Server for non-nullable sort columns by @Jeadie in #10621
fix(ScyllaDB): disable physical filter pushdown by @sgrebnov in #10772
fix: handle typed NULLs and prevent overflow in DynamoDB DML type conversions by @krinart in #10511
fix: use InsertOp::Overwrite in DynamoDB bootstrap scan_and_overwrite_accelerator by @krinart in #10639
Improve DynamoDB Bootstrap performance by @krinart in #10616
fix: preserve field and schema metadata in Vortex type transformation by @lukekim in #10628
fix: GH connector - explicitly use AWS LC RS crypto provider for jwt by @phillipleblanc in #10619
fix: add snapshot mode guards to delete_from/update and delegate DML in SwappableTableProvider by @phillipleblanc in #10685
Persist HTTP rate-control state in object storage by @lukekim in #10697
Rate limit metrics HTTP endpoint by @lukekim in #10162
feat(geo): add optional spatial SQL UDF support by @lukekim in #10833
feat(cayenne): CDC throughput, compaction, scan caching, and benchmarks by @lukekim in #10852
fix(cayenne): fix Vortex panic on highly compressible data by @sgrebnov in #10855
fix(cayenne): Read live protected snapshots after cleanup grace period by @sgrebnov in #10901
fix: Disable Cayenne HashJoin rewriter optimizer by @sgrebnov in #10882
Fix GetFlightInfo vs DoGet Flight Schema by @krinart in #10864
fix(search): preserve column casing in /v1/search primary key plumbing by @claudespice in #10909
fix(object-store): dedupe s3 url style auto-detection log by @phillipleblanc in #10898
Improve Spice CLI manifest editing and direct command modes by @lukekim in #10815
Persist Kafka CDC offsets in sidecar tables by @lukekim in #10823
feat(task-history): record Ballista stages for distributed queries by @phillipleblanc in #10831
Add '#[deny(clippy::missing_trait_methods)]' to wrapper/delegation trait impls by @Jeadie in #10795
Optimize Cayenne catalog maintenance paths by @lukekim in #10904
Centralize DuckDB settings for accelerator by @ewgenius in #10895
deps(ballista): bump to 47e2b494 to fix S3 shuffle reads under cluster mode by @phillipleblanc in #10910
Authorization header + Bump async-openai + responses_adapter fix by @krinart in #10911
Tune accelerators by storage profile by @lukekim in #10913
feat: add dataset-level on_schema_change config by @lukekim in #10908
Handle NULL sentinel for nullable partition expressions by @Jeadie in #10880
fix: Remove Cayenne Catalog from catalog registration by @peasee in #10914
Add catalog name to foreign key metadata in postgres catalog by @Jeadie in #10917
Cayenne perf: eliminate redundant clones, PK point-lookup fanout fix, IN-list rewrite + microbench coverage by @lukekim in #10916
fix(turso-shared): retry on Turso BEGIN CONCURRENT "Write-write conflict" by @lukekim in #10946
Vendor Vortex DataFusion for Cayenne by @lukekim in #10933
perf(cayenne): background retention + enable CDC pipelining for retention-configured tables by @lukekim in #10936
feat(cayenne): scale metastore pool to 32 + vs_duckdb_scaling benches (1→128 concurrency, sqlite + turso lanes) by @lukekim in #10943
feat(mcp): support auth for streamable HTTP tools by @phillipleblanc in #10927
Explicit error if v1/search requests a table without search index by @Jeadie in #10968
Fix spicepod loading failure when directory name contains dots by @sgrebnov in #10958
Extend append tests with arrow engine configurations by @sgrebnov in #10959
Remove dataset on_schema_change Policy from rc.5 release notes by @sgrebnov in #10964
Skip tpcds_q78 for Cayenne engine at SF100 by @sgrebnov in #10966
fix: Update benchmark snapshots May-20 by @app/github-actions in #10952
Fix #10951: UdtfExec invariant Vec lengths must match children count by @phillipleblanc in #10953
docs(release): update v2.0.0-rc.5 notes with latest trunk PRs by @lukekim in #10949
Remove eval related things for v2.0.0 by @Jeadie in #10945
build(deps): bump ubuntu from 24.04 to 26.04 in the docker-dependencies group by @app/dependabot in #10883
fix: Add publish = false to chbench-driver by @sgrebnov in #10939

Full Changelog: https://github.com/spiceai/spiceai/compare/v2.0.0-rc.4...v2.0.0-rc.5

Spice v1.11.6 (May 6, 2026)

Wed, 06 May 2026 00:00:00 GMT

Spice v1.11.6 is now available! 🛠️

Spice v1.11.6 is a patch release improving DynamoDB bootstrap ingestion performance and making Helm chart health probes configurable.

What's New in v1.11.6

DynamoDB: Faster Bootstrap Ingestion

Improved DynamoDB bootstrap ingestion throughput for refresh_mode: changes datasets (#10616). Large tables now maintain a high, steady ingestion rate throughout the entire bootstrap, even for very large tables.

Helm Chart: Configurable Health Probes

The Spice Helm chart now supports configurable livenessProbe, readinessProbe, and startupProbe settings (#10696), including probe path, port, and timing parameters.

Example values.yaml:

...
livenessProbe:
  httpGet:
    path: /health
    port: 8090
  timeoutSeconds: 1
  periodSeconds: 10
  failureThreshold: 3

readinessProbe:
  httpGet:
    path: /v1/ready
    port: 8090
  timeoutSeconds: 5
  periodSeconds: 10
  failureThreshold: 3

startupProbe:
  httpGet:
    path: /health
    port: 8090
  timeoutSeconds: 1
  periodSeconds: 10
  failureThreshold: 30

Contributors

Breaking Changes

No breaking changes.

Cookbook Updates

No new cookbook recipes.

The Spice Cookbook includes 86 recipes to help you get started with Spice quickly and easily.

Upgrading

To upgrade to v1.11.6, use one of the following methods:

CLI:

spice upgrade

Homebrew:

brew upgrade spiceai/spiceai/spice

Docker:

Pull the spiceai/spiceai:1.11.6 image:

docker pull spiceai/spiceai:1.11.6

For available tags, see DockerHub.

Helm:

helm repo update
helm upgrade spiceai spiceai/spiceai --version 1.11.6

AWS Marketplace:

Spice is available in the AWS Marketplace.

What's Changed

Changelog

Improve DynamoDB Bootstrap performance by @krinart in #10616
fix: use InsertOp::Overwrite in DynamoDB bootstrap scan_and_overwrite_accelerator by @claudespice in #10639
fix: make Helm chart probes configurable by @lukekim in #10696
Migrate secrets to vars by @krinart in #10354

Full Changelog: https://github.com/spiceai/spiceai/compare/v1.11.5...v1.11.6

Spice v2.0-rc.4 (Apr 30, 2026)

Fri, 01 May 2026 00:00:00 GMT

Announcing the release of Spice v2.0-rc.4! 🚀

v2.0.0-rc.4 is the fourth release candidate for advanced testing of v2.0, building on v2.0.0-rc.3.

Highlights in this release candidate include:

Elasticsearch Data Connector (Alpha) with native hybrid search (BM25 full-text + kNN vector + RRF)
PostgreSQL Native CDC via WAL logical replication, eliminating the need for Debezium or Kafka
Multi-vector Embeddings with MaxSim for ColBERT-style late-interaction retrieval
Rerank UDTF for hybrid search pipelines with automatic query propagation
HashiCorp Vault and Azure Key Vault Secret Stores for enterprise secret management
DuckDB Vector Engine with HNSW index support
Azure Cosmos DB Connector (RC), Git Connector promoted to RC
MCP Streamable HTTP transport
Read-only API Key Enforcement on Flight DoGet and async query paths

What's New in v2.0.0-rc.4

Elasticsearch Data Connector (Alpha, Spice.ai Enterprise)

The new Elasticsearch data connector enables querying Elasticsearch indexes as SQL tables with full hybrid search support. Currently available in Spice.ai Enterprise.

Key capabilities:

SQL Table Access: Query any Elasticsearch index with standard SQL via a native DataFusion TableProvider.
kNN Vector Search: Use the vector_search() UDTF against Elasticsearch-backed vector fields.
BM25 Full-Text Search: Use the text_search() UDTF for native Elasticsearch full-text queries.
Hybrid Search: Combine kNN and BM25 results with the rrf() UDTF for reciprocal rank fusion.
Elasticsearch as a Vector Engine: Accelerated datasets can use Elasticsearch as the backing vector engine for embedding storage and retrieval.

Example configuration:

datasets:
  - from: elasticsearch:my_index
    name: my_data
    params:
      elasticsearch_endpoint: https://my-cluster.es.io:9200
      elasticsearch_username: ${secrets:es_user}
      elasticsearch_password: ${secrets:es_password}

PostgreSQL Native Replication via WAL

Postgres datasets configured with refresh_mode: changes can now stream changes directly from PostgreSQL logical replication (WAL) into any local accelerator without Debezium or Kafka required.

Key capabilities:

Native Logical Replication: Uses pgoutput decoding to stream INSERT/UPDATE/DELETE events.
Automatic Slot Management: Each Spice replica creates a distinct replication slot (spice__), so multi-replica deployments work automatically. Publications are shared.
Bootstrap Snapshot: An initial REPEATABLE READ snapshot seeds the accelerator before replication begins.
LSN Acknowledgement: The LsnCommitter sends durable LSN back to Postgres so WAL segments are reclaimed.
All Accelerators Supported: Works with DuckDB, SQLite, Postgres, Cayenne, and Arrow accelerators.

Example configuration:

datasets:
  - from: postgres:my_table
    name: my_table
    params:
      pg_host: localhost
      pg_port: 5432
      pg_db: mydb
      pg_publication: my_publication   # optional; auto-created if omitted
    acceleration:
      enabled: true
      engine: duckdb
      refresh_mode: changes

Multi-vector Embeddings with MaxSim (Late Interaction)

Column-level embeddings now support list-of-string columns, producing one embedding vector per list element and enabling ColBERT-style late-interaction retrieval.

Key capabilities:

Multi-vector per Row: Columns of type List produce List> — one embedding per list element.
MaxSim / Mean / Sum Scoring: Per-row score is the max, mean, or sum cosine over the list elements. Default is MaxSim (ColBERT).
_match Column: Returns the specific list element that produced the highest cosine similarity.
No Schema Changes Required: Works with existing embedding configurations; activates automatically for list-type columns.

Rerank UDTF for Hybrid Search

A new rerank() table-valued function reorders scored results from vector_search, text_search, or rrf by a reranker model's relevance judgements. See Search Functionality for an overview of search UDTFs.

Key capabilities:

Auto Query Propagation: The query string is automatically inherited from a nested search UDTF — no repetition required.
Any Chat Model as Reranker: Any registered chat/completion model can serve as a reranker via the built-in LlmRerank adapter (listwise prompt by default; pointwise available).
Filter and Projection Pushdown: The RerankExec physical node supports pushdown, reducing data movement.
Extensible: A new RerankerModelStore sits alongside ChatModelStore and EmbeddingModelStore; native providers (Cohere, Voyage, BGE) can be added without runtime plumbing changes.

SELECT * FROM rerank(
    rrf(vector_search('my_table', 'query text'), text_search('my_table', 'query text')),
    document => content
) LIMIT 10;

New Secret Stores: HashiCorp Vault and Azure Key Vault

Two new enterprise-grade Secret Stores are now available.

HashiCorp Vault (hashicorp_vault):

KV v2 (default) and KV v1 mount support.
Auth methods: token, approle, kubernetes, jwt.
Token leases are cached and automatically re-acquired on expiry.

secrets:
  - from: hashicorp_vault:secret/my-app
    name: my_secrets
    params:
      hashicorp_vault_addr: https://vault.example.com
      hashicorp_vault_auth_method: approle
      hashicorp_vault_role_id: ${env:VAULT_ROLE_ID}
      hashicorp_vault_secret_id: ${secrets:vault_secret_id}

Azure Key Vault (azure_keyvault):

Per-key caching with single-flight fetch coalescing.
Auth methods: service principal, managed identity, workload identity, Azure CLI, or auto-detect.
Supports sovereign clouds via endpoint parameter.

secrets:
  - from: azure_keyvault:my-vault
    name: my_secrets
    params:
      azure_keyvault_auth_method: managed_identity

DuckDB Vector Engine

DuckDB-accelerated tables can now use DuckDB's HNSW index for vector search via the vector_engine: duckdb option, enabling fast approximate nearest-neighbor search without an external vector store.

Example configuration:

datasets:
  - from: postgres:public.documents
    name: documents
    columns:
      - name: content
        embeddings:
          - from: hf_minilm
            row_id: id
    acceleration:
      enabled: true
      engine: duckdb
      mode: file
    vectors:
      enabled: true
      engine: duckdb
      params:
        duckdb_distance_metric: cosine
        duckdb_hnsw_m: 16
        duckdb_hnsw_ef_construction: 64
        duckdb_hnsw_ef_search: 32

embeddings:
  - from: huggingface:huggingface.co/minishlab/potion-base-2M
    name: hf_minilm

New and Promoted Connectors

Azure Cosmos DB (Alpha):

A new read-only Azure Cosmos DB NoSQL / Core SQL API connector built on the azure_data_cosmos 0.30 SDK. Supports cross-partition scans, schema inference from document samples, and key-based auth (connection string or account endpoint + key).

Git Connector (RC):

The Git data connector is promoted to RC status with HTTPS/SSH auth (git_token, git_username/git_password, git_ssh_key), Git LFS support (enable_lfs), and per-repo connection resilience (semaphore, bounded retries with exponential backoff, permanent-error circuit breaking).

DynamoDB Write Support (DML)

DynamoDB datasets now support write-back via INSERT, UPDATE, and DELETE operations, complementing the existing read and CDC streaming capabilities.

MCP Streamable HTTP Transport

The MCP server has been upgraded to rmcp 1.5.0 and switched to the Streamable HTTP transport (/v1/mcp), replacing the previous SSE-based endpoint. The client-side transport is updated to StreamableHttpClientTransport.

Security Improvements

Read-only API Key Enforcement: API keys with read-only scope are now strictly enforced on the Flight DoGet path and on async query endpoints, preventing write operations from being issued under a read-only key.

GitHub Workflow Hardening: CI workflows have been hardened with improved security posture to reduce supply-chain risk.

Developer Experience Improvements

Actionable Config Errors: Parameter typos, missing secret references, and unknown engine names now produce specific, actionable error messages with Levenshtein-based suggestions, rather than silent drops or generic "missing required parameter" messages.
spice init Improvements: Written spicepods now include a yaml-language-server: $schema=... directive for IDE completions. Creation messages print regardless of log level.
REPL Improvements: Log filter honors RUST_LOG when -v is not passed; version banner moves to stderr and prints only on an interactive TTY.
403 / 401 Routing: HTTP 403 responses route to a new PermissionDenied variant; 401 messages point at spice login / SPICE_API_KEY.

OpenTelemetry Improvements

See Observability & Monitoring and the runtime.telemetry reference for full configuration details.

Metric Name Prefix: Configure a prefix for all exported OTLP metric names via runtime.telemetry.metric_prefix.
Delta Temporality Default: The OTLP push exporter now defaults to delta temporality, matching Prometheus and most backends.
Resource Attributes: runtime.telemetry.properties are applied as OTLP resource attributes on exported metrics.

Full-text Search Performance

Tantivy full-text search ingestion performance is significantly improved with better batch handling and a rollback-on-error path.

SQL and Query Engine

DataFusion Upgrade: Updated to a newer DataFusion revision with additional bug fixes and performance improvements.
Views on DDL Catalogs: DDL-defined catalogs (e.g., Unity Catalog) can now expose and query views.
flatten_json / json_tree / expand_maps UDTFs: New table-valued functions for JSON transformation, map expansion, and schema decomposition in query pipelines. See JSON Functions and Operators.
cosine_distance Pushdown to DuckDB: cosine_distance is now pushed down to DuckDB accelerators via array_cosine_distance.
Snowflake Type Support: Added support for OBJECT, MAP, GEOGRAPHY, GEOMETRY, VECTOR, and TIMESTAMP_LTZ types in the Snowflake connector.
MySQL Zero-Date Behavior: The MySQL connector adds a new mysql_zero_date_behavior parameter (null or error) controlling how MySQL zero-date values (0000-00-00) are handled.
Databricks Timeouts: The Databricks connector adds new connect_timeout and client_timeout parameters for sql_warehouse mode.

Dependency Updates

Dependency / Component	Version / Update
DataFusion	Updated
rmcp	v1.5.0 (from fork pin)
mistral.rs	Updated
openssl	0.10.78

Contributors

Breaking Changes

No breaking changes.

Cookbook Updates

No new cookbook recipes.

The Spice Cookbook includes 86 recipes to help you get started with Spice quickly and easily.

Upgrading

To upgrade to v2.0.0-rc.4, use one of the following methods:

CLI:

spice upgrade v2.0.0-rc.4

Homebrew:

brew upgrade spiceai/spiceai/spice

Docker:

Pull the spiceai/spiceai:2.0.0-rc.4 image:

docker pull spiceai/spiceai:2.0.0-rc.4

For available tags, see DockerHub.

Helm:

helm repo update
helm upgrade spiceai spiceai/spiceai --version 2.0.0-rc.4

AWS Marketplace:

Spice is available in the AWS Marketplace.

What's Changed

Changelog

Integrate spiceio and makefile_targets into pr.yml by @lukekim in #10357
ci: skip artifact compression for test binaries/archives by @lukekim in #10381
chore(deps): bump spiceai/candle, spiceai/mistral.rs, aws-lc-rs, tantivy, rand by @lukekim in #10379
Bump datafusion-table-providers (#10375) by @lukekim in #10384
fix: Update Search integration test snapshots by @app/github-actions in #10376
v2.0.0-rc.3 preparation by @ewgenius in #10382
fix(spicepod): JSON schema accepts string or {name: expr} for partition_by by @lukekim in #10352
fix: Use ROUND for Turso decimal BETWEEN comparisons (fixes #9872) by @claudespice in #10360
Revert "v2.0.0-rc.3 preparation" from trunk by @ewgenius in #10386
Add on_schema_resolved dataset ready state by @lukekim in #10368
feat: Add Elasticsearch data connector with hybrid search support by @lukekim in #10258
ci: bump test archive upload compression-level to 1 by @lukekim in #10388
feat(git-connector): promote Git connector to RC status by @lukekim in #10385
feat(postgres): stream WAL directly to Spice accelerators by @lukekim in #10364
Add schema decomposition to the HTTP connector by @lukekim in #10393
fix(cayenne): Skip catalog refresh state reload for existing providers by @sgrebnov in #10396
Make cayenne-flightsql tool by @Jeadie in #10356
build(deps): bump the github-actions-dependencies group with 2 updates by @app/dependabot in #10398
Update openapi.json by @app/github-actions in #10272
Merge develop to trunk — 2026-04-19 by @claudespice in #10407
feat(otel): default OTLP push exporter to delta temporality by @phillipleblanc in #10412
fix: Restore analyzer rule ordering to run federation before type coercion by @sgrebnov in #10415
fix: Map Utf8/LargeUtf8 to STRING in Databricks/Spark SQL dialects by @sgrebnov in #10420
feat(otel): add metric name prefix at runtime.telemetry.metric_prefix by @phillipleblanc in #10418
fix: Map LargeUtf8 to VARCHAR in Athena ODBC dialect by @sgrebnov in #10419
feat(cluster): connector-driven object store registration on executors by @phillipleblanc in #10414
build(deps): bump ubuntu from 22.04 to 24.04 in the docker-dependencies group by @app/dependabot in #10397
fix: Update benchmark snapshots Apr 20 by @app/github-actions in #10417
feat(otel): apply runtime.telemetry.properties as resource attributes on exported metrics by @phillipleblanc in #10416
Publish RC releases to DockerHub; upgrade runners to ubuntu-24.04 by @lukekim in #10428
feat: Add Azure Cosmos DB (NoSQL) data connector (RC) by @lukekim in #10392
feat(datafusion): flatten_json_properties + json_tree UDTFs by @lukekim in #10406
Harden /v1/tools and /v1/nsql against unauthenticated / LLM-driven SQL by @lukekim in #10365
feat(embeddings): multi-vector embeddings with MaxSim + late-interaction by @lukekim in #10408
Update GH runners for CUDA builds by @ewgenius in #10432
fix(delta_lake): register object stores on cluster executors by @phillipleblanc in #10436
DF-native DML by @krinart in #10327
ci: run Build and Test on spiceai-macos; split install jobs by profile by @lukekim in #10434
Improve search UDTFs: text_search, vector_search, rrf by @lukekim in #10387
fix(model2vec): Improve robustness of model loading for sentence-transformers layouts by @sgrebnov in #10444
Merge develop to trunk — 2026-04-21 by @claudespice in #10448
Enable filter pushdown for vector_search UDTF by @sgrebnov in #10447
Support Snowflake OBJECT, MAP, GEOGRAPHY, GEOMETRY, VECTOR, TIMESTAMP_LTZ types by @lukekim in #10451
Fix Databricks tests by @krinart in #10449
fix(cluster): forward register_object_stores through connector wrappers by @phillipleblanc in #10460
Fixes for vector-search by @krinart in #10455
Add expand_maps option and flatten_json UDTF by @lukekim in #10452
fix: Update Search integration test snapshots by @app/github-actions in #10458
Fix physical codec decode ambiguity for empty protobuf messages by @sgrebnov in #10466
chore(logging): demote s3_single_file_cached skip refresh log to debug by @phillipleblanc in #10467
Enable filter pushdown for rrf UDTF by @sgrebnov in #10465
feat(cluster): consolidate distributed state into cluster.json by @phillipleblanc in #10463
feat(cayenne): Add column statistics and data inlining by @lukekim in #10314
docs(copilot): flag missing wrapper delegation when adding default trait methods by @phillipleblanc in #10461
Wire Elasticsearch vector engine write path through acceleration by @lukekim in #10453
Add helm lint CI by @ewgenius in #10468
Fix Azure and GCS acceleration snapshot object store credential handling by @phillipleblanc in #10486
Update spicepod.schema.json by @app/github-actions in #10485
fix(secrets): harden AWS Secrets Manager secret store by @lukekim in #10478
Update datafusion-ballista crate by @sgrebnov in #10488
feat(secrets): add ParameterSpec and more params for AWS secrets manager by @phillipleblanc in #10487
Add rerank UDTF for hybrid search with query auto-propagation by @lukekim in #10469
Fix flatten_json_properties by @krinart in #10475
fix: preserve field and schema metadata in expand_views_schema by @claudespice in #10494
Upgrade rmcp to upstream 1.5.0; switch MCP server to Streamable HTTP by @lukekim in #10491
fix: handle Snowflake TIMESTAMP_LTZ wire format and prevent nanosecond overflow by @claudespice in #10493
Lint parity in Makefile by @krinart in #10492
Add connect_timeout/client_timeout params to Databricks sql_warehouse mode by @lukekim in #10495
fix(tracing): suppress opentelemetry INFO logs at all verbosity levels by @lukekim in #10497
DynamoDB DML by @krinart in #10470
feat(cayenne): native vector search via SIMD similarity UDFs by @lukekim in #10456
fix(cli): suppress banner for all JSON-producing cloud subcommands (fixes #10498) by @claudespice in #10510
fix(deps): bump openssl to 0.10.78 by @phillipleblanc in #10509
fix(s3): quiet AWS SDK credential probe when no region is configured by @phillipleblanc in #10506
fix(cdc): emit ready signal on caught-up Kafka/Debezium streams (#5201) by @phillipleblanc in #10504
runtime-cluster crate + Run partition discovery before forwarding refresh to executors by @krinart in #10490
Update lint-rust target to use --keep-going by @Jeadie in #10508
Add TPC-H SF100 s3[parquet]-duckdb[file] benchmark spicepod by @lukekim in #10524
Remove dev-profile install steps from pr.yml by @Jeadie in #10507
fix: add missing NULL check on Timestamp path in append refresh by @claudespice in #10518
fix: return error on Decimal128/256 overflow instead of silently dropping scale by @claudespice in #10519
fix: delegate update and delete_from in IndexedTableProvider and EmbeddingTable by @claudespice in #10520
feat(devx): make config errors, CLI, and REPL lead users to success by @lukekim in #10489
fix(rerank): defer execution to RerankExec, enable filters and projection pushdown by @sgrebnov in #10514
fix(llms): support Gemma models with missing attention_bias config field by @lukekim in #10523
Fix vector_search silently ignoring named limit/column/include_score args by @sgrebnov in #10527
fix: split unsupported filters locally in scan() for UseSource mode by @ewgenius in #10528
feat(secrets): add Azure Key Vault secret store by @lukekim in #10496
Bump mistralrs by @krinart in #10532
Fix benchmark configurations and CI build issues by @sgrebnov in #10535
Fix catalog query overrides for MySQL and MSSQL benchmarks by @sgrebnov in #10543
For Cayenne, preserve matched columns for MERGE ... ON by @Jeadie in #10340
build(deps): bump the aws-sdk group across 1 directory with 5 updates by @app/dependabot in #10538
docs: update AI agent instructions (git workflow + Rust 1.94) by @lukekim in #10544
fix: Update tpch benchmark snapshots by @app/github-actions in #10529
fix: Update tpch benchmark snapshots for accelerated/s3[parquet]-duckdb[file].yaml by @app/github-actions in #10525
Extract runtime-datafusion from runtime by @krinart in #10545
Use generic DML extension planner for Cayenne by @Jeadie in #10437
fix: Update Search integration test snapshots by @app/github-actions in #10552
Fix security and correctness audit issues by @lukekim in #10526
fix(MySQL): revert MySQL result column reorder to fix federated query failures by @sgrebnov in #10557
Fix protoc installation by @krinart in #10566
fix: Disable Ballista dynamic filters on HashJoinExec by @peasee in #10548
Support views on DDL catalogs by @Jeadie in #10554
Update datafusion by @Jeadie in #10422
Improve full-text search indexing performance by @sgrebnov in #10464
feat(mysql): add mysql_zero_date_behavior parameter (null|error) by @phillipleblanc in #10573
fix(snowflake): declare private_key in connector PARAMETERS (fixes #10517) by @claudespice in #10559
Honour CARGO_TARGET_DIR in Makefiles by @Jeadie in #10569
Enable cosine_distance pushdown to DuckDB accelerator via array_cosine_distance by @sgrebnov in #10564
fix: Update test snapshots by @app/github-actions in #10570
fix: Update tpch benchmark snapshots by @app/github-actions in #10560
feat(snapshots): make snapshots an optional feature by @phillipleblanc in #10574
Enforce read-only API key restrictions on Flight DoGet and async query paths by @Jeadie in #10551
Improved security posture on Github workflows by @Jeadie in #10556
fix: Update datafusion-table-providers to improve SqlTable filter pushdown by @sgrebnov in #10595
feat(secrets): add HashiCorp Vault secret store by @phillipleblanc in #10561
fix: delegate update() in UpsertDedupTableProvider to inner provider by @claudespice in #10593
Add DuckDB vector engine support by @lukekim in #10562
Sharepoint - add object-store listing connector with expanded auth and write support by @lukekim in #10473
fix: Install protoc from source by @peasee in #10597

Full Changelog: https://github.com/spiceai/spiceai/compare/v2.0.0-rc.3...v2.0.0-rc.4

Spice v2.0-rc.3 (Apr 21, 2026)

Tue, 21 Apr 2026 00:00:00 GMT

Announcing the release of Spice v2.0-rc.3! ⚡

v2.0.0-rc.3 is the third release candidate for advanced testing of v2.0, building on v2.0.0-rc.2.

Highlights in this release candidate include:

HTTP Connector Enhancements with OAuth2 refresh-token authentication, query-parameter pagination, and map-to-array conversion for broader API compatibility
Databricks and Unity Catalog Reliability Improvements with resilience controls, improved UC-awareness, permission checks, and structured error reporting
Snowflake and ADBC Registration Performance Improvements with better observability during dataset registration
OpenTelemetry Exporter Improvements with exporter fixes and support for authenticated metrics export
Kafka, GitHub, and HTTP Connector Fixes including Kafka reliability improvements, GitHub GraphQL resilience updates, and HTTP JSON union/reload fixes

What's New in v2.0.0-rc.3

HTTP Connector Enhancements

The HTTP connector now supports more authentication and API response patterns, making it easier to integrate with modern REST APIs.

Key improvements:

OAuth2 Refresh-Token Authentication: Added support for OAuth2 refresh-token flows for APIs that issue short-lived access tokens.
Query-Parameter Pagination: Added pagination support using query parameters for APIs that expose page or cursor controls in the URL.
Map-to-Array Conversion: Added response transformation support for APIs that return map-shaped payloads that need to be normalized into arrays.
Improved JSON Union Handling: Better handling for heterogeneous JSON payloads during ingestion.
More Reliable Reloads: Fixed runtime behavior for HTTP-backed datasets during spicepod reloads.

Example configuration of an HTTP connector using the OAuth2 refresh token flow:

datasets:
  - from: https://api.example.com
    name: secure_data
    params:
      file_format: json
      allowed_request_paths: '/v1/**'
      auth_token_url: https://auth.example.com/oauth/token
      http_auth_refresh_token: ${secrets:my_refresh_token}
      http_auth_client_id: ${secrets:my_client_id}
      http_auth_client_secret: ${secrets:my_client_secret}
      auth_scopes: 'read:data offline_access'

Databricks and Unity Catalog Reliability Improvements

Databricks and Unity Catalog integrations are now more resilient and provide clearer behavior in permission-constrained environments.

Key improvements:

Resilience Controls: Added controls to improve reliability when interacting with Databricks services.
Unity Catalog Awareness: Improved handling for Unity Catalog-specific behaviors and mixed deployment configurations.
Permission Prechecks: Databricks UC permission checks now distinguish explicit denials from ambiguous cases.
Structured Error Reporting: Advisory permission failures now surface with more actionable structured errors.
Classic SQL Warehouse Compatibility: Improved handling for foreign table scenarios with Classic SQL Warehouse combinations.
Task History Instrumentation: Added instrumentation to improve observability for Databricks-related operations.

Snowflake and ADBC Improvements

Snowflake and ADBC-backed dataset registration is now faster and easier to observe.

Key improvements:

Faster Dataset Registration: Improved registration performance for Snowflake and ADBC datasets.
Better Observability: Added better instrumentation and visibility into registration workflows.
ADBC Alignment: Updated ADBC dependencies and integration points for improved compatibility.
Search Schema Fix: Fixed a full-text search schema mismatch issue with the ADBC connector.

OpenTelemetry and Observability Improvements

Spice improves telemetry export reliability and authenticated metrics delivery for the OpenTelemetry integration.

Key improvements:

OTEL Exporter Fixes: Fixed issues in the OpenTelemetry exporter.
Authenticated Metrics Export: Added support for authorization headers in the OTEL metrics exporter.
Reduced Startup Noise: Suppressed unnecessary AWS SDK noise and improved OTEL-related initialization behavior.
Connector Initialization Reliability: Fixed issues that could block connector initialization in telemetry-related code paths.

Dependency and Toolchain Updates

Dependency / Component	Version / Update
Rust toolchain	v1.94.1 (from v1.93.1)
DataFusion	v52.5.0-rc1
mistral.rs / candle	`mistral.rs` v0.8.x, `candle` v0.10.1
ADBC Core	v0.23

Other Improvements

Improved Query Pushdown: Expanded sort and limit pushdown, including improved pushdown behavior for Oracle and MSSQL connectors.
Partitioned Query Planning Improvements: Improved PartitionedTableScanRewrite handling for ORDER BY, partition expressions, and fully qualified table references, while preventing incorrect bucketing partition pushdown to executors.
MongoDB SRV Support: Upgraded datafusion-table-providers with MongoDB SRV support.
Tantivy Logging: Search logging now defaults to warn unless very verbose logging is enabled.
Kafka Connector Fixes: Improved reliability for the Kafka connector behavior.
GitHub Connector Resilience: Improved commit fetching for dynamic and slash refs, and reduced GraphQL page sizes on gateway errors for the GitHub connector.
GitHub API Efficiency: Lowered default comment fetch sizes to reduce pressure on GitHub GraphQL APIs.
Embedding Validation: Added validation for embedding row_id columns during dataset initialization.
View Cache Invalidation: Cached plans are now cleared when views are updated.
Refresh SQL Dedup Fix: Fixed append refresh deduplication when refresh_sql selects a subset of columns.

Contributors

Breaking Changes

No breaking changes.

Cookbook Updates

No new cookbook recipes.

The Spice Cookbook includes 86 recipes to help you get started with Spice quickly and easily.

Upgrading

To upgrade to v2.0.0-rc.3, use one of the following methods:

CLI:

spice upgrade v2.0.0-rc.3

Homebrew:

brew upgrade spiceai/spiceai/spice

Docker:

Pull the spiceai/spiceai:2.0.0-rc.3 image:

docker pull spiceai/spiceai:2.0.0-rc.3

For available tags, see DockerHub.

Helm:

helm repo update
helm upgrade spiceai spiceai/spiceai --version 2.0.0-rc.3

AWS Marketplace:

Spice is available in the AWS Marketplace.

What's Changed

Changelog

fix: Full Text Search schema mismatch with ADBC connector by @lukekim in #10235
docs: Update v2.0.0-rc.2 release notes with latest changes by @lukekim in #10238
Fix append refresh dedup failure when refresh_sql selects column subset by @sgrebnov in #10225
Revert "Properly mark dataset as Ready on Scheduler (#10215)" by @sgrebnov in #10242
Fix failing merge conflicts for benchmarks by @krinart in #10247
fix(github): fetch commits for dynamic and slash refs by @lukekim in #10233
Upgrade DataFusion to v52.5.0-rc1 by @lukekim in #10249
Merge develop to trunk (2026-04-09) by @claudespice in #10248
fix: Validate embedding row_id columns during dataset init (fixes #8226) by @claudespice in #10208
fix: Update tpch benchmark snapshots for federated/glue[csv].yaml by @app/github-actions in #10244
feat(databricks): add resilience controls, UC awareness, and task history instrumentation by @lukekim in #10246
fix: Make PartitionManager resilient to bare vs fully qualified table references by @sgrebnov in #10257
fix: Update tpch benchmark snapshots for accelerated/s3[parquet]-cayenne[file].yaml by @app/github-actions in #10256
Merge develop to trunk (2026-04-10) by @claudespice in #10251
Improve Snowflake/ADBC dataset registration performance and observability by @lukekim in #10266
Fixes for kafka connector by @krinart in #10263
fix(runtime): gate otel code tags, suppress aws sdk noise, and unblock connector init by @lukekim in #10260
fix(runtime): avoid regionless AWS SDK loads by @lukekim in #10271
Add versioned release install workflow coverage by @lukekim in #10276
fix(runtime): handle HTTP JSON unions and spicepod reloads by @lukekim in #10277
Databricks UC permission prechecks: explicit denial as permanent error, ambiguous cases advisory by @lukekim in #10274
Revert component status changes re-introduced by develop merge (#10248) by @sgrebnov in #10293
Fix broken CI workflows by @ewgenius in #10294
Group dependabot updates by ecosystem by @lukekim in #10296
fix(tests): Replace flaky S3 Vectors snapshot tests with structural validation by @lukekim in #10301
Update test_github_workflows snapshot by @lukekim in #10304
fix(ci): fix Bedrock runner mismatch and snapshot auto-merge failure by @ewgenius in #10306
feat(http): Add map-to-array conversion and query-parameter pagination by @lukekim in #10295
New crate: datafusion-ddl by @Jeadie in #10205
Make Databricks UC permission checks advisory with structured error reporting by @lukekim in #10283
build(deps): bump the github-actions-dependencies group with 4 updates by @app/dependabot in #10298
fix: Clear cached plans on view updates by @peasee in #10312
build(deps): bump the aws-sdk group with 7 updates by @app/dependabot in #10299
Code out of runtime. by @Jeadie in #10178
fix: Respect function registry denies for accelerated table filter pushdown by @peasee in #10311
fix: Don't block heartbeat when all slots acquired by @peasee in #10322
fix: strip only outer parens in get_table_partition_expr_from_ctx by @Jeadie in #10323
Upgrade datafusion-table-providers with MongoDB SRV support by @lukekim in #10317
fix: Avoid pushing down bucketing partition expressions into executors by @peasee in #10324
Upgrade datafusion-table-providers to d1b911a5 and bump adbc to 0.23 by @lukekim in #10329
fix: Update Search integration test snapshots by @app/github-actions in #10308
Handle foreign table + Classic sql warehouse combination gracefully by @krinart in #10318
New crate datafusion-flightsql by @Jeadie in #10201
Set tantivy=warn unless very verbose logging by @Jeadie in #10338
Remove image registry and image name options from spidapter by @ewgenius in #10241
build(deps): bump sysinfo from 0.37.2 to 0.38.4 by @app/dependabot in #10291
build(deps): bump futures from 0.3.31 to 0.3.32 by @app/dependabot in #10289
New crate 'datafusion-dml' by @Jeadie in #10334
Jeadie/26 04 16/spice sql by @Jeadie in #10343
Add Teraswitch/Pittsburgh apt mirrors + retry config for CI runners by @lukekim in #10349
Implement sort pushdown and fix pushdown gaps across providers by @lukekim in #10337
Merge develop to trunk (2026-04-16) by @claudespice in #10345
Update candle and mistral.rs lock-step pins by @lukekim in #10278
docs: fix status badges in README by @lukekim in #10350
Migrate secrets to vars by @krinart in #10354
Add limit pushdown and improve sort pushdown for Oracle and MSSQL by @sgrebnov in #10351
Fix ubuntu mirror configuration by @ewgenius in #10359
fix: Increase throughput test default ready_wait from 30s to 300s (fixes #8207) by @claudespice in #10344
Add auth headers support to OTEL metrics exporter by @lukekim in #10347
fix(github): shrink GraphQL page size on gateway errors; lower comment defaults by @lukekim in #10355
Relax apt mirror substitution failure to warning in CI action by @ewgenius in #10361
feat(http): Add OAuth2 refresh-token auth to HTTP connector by @lukekim in #10348
Upgrade Rust toolchain to 1.94.1 by @lukekim in #10353
Handle order by and sort in PartitionedTableScanRewrite by @Jeadie in #9656
Fix OTEL Exporter by @krinart in #10363
Pin spiceai candle / TEI forks to merged revs; drop local [patch] overrides by @lukekim in #10362

Full Changelog: https://github.com/spiceai/spiceai/compare/v2.0.0-rc.2...v2.0.0-rc.3

Spice v2.0-rc.2 (Apr 10, 2026)

Fri, 10 Apr 2026 00:00:00 GMT

Announcing the release of Spice v2.0-rc.2! 🔥

v2.0.0-rc.2 is the second release candidate for advanced testing of v2.0, building on v2.0.0-rc.1.

Highlights in this release candidate include:

Distributed Spice Cayenne Query and Write Improvements with data-local query routing and partition-aware write-through
DataFusion v52.4.0 Upgrade with aligned arrow-rs, datafusion-federation, and datafusion-table-providers
MERGE INTO for Spice Cayenne catalog tables with distributed support across executors
PARTITION BY Support for Cayenne enabling SQL-defined partitioning in CREATE TABLE statements
ADBC Data Connector & Catalog with full query federation, BigQuery support, and schema/table discovery
Databricks Lakehouse Federation Improvements with improved reliability, resilience, DESCRIBE TABLE fallback, and source-native type parsing
Delta Lake Column Mapping supporting Name and Id mapping modes
HTTP Pagination support for paginated API endpoints in the HTTP data connector
New Catalog Connectors for PostgreSQL, MySQL, MSSQL, and Snowflake
JSON Ingestion Improvements with single-object support, soda (Socrata Open Data) format support, json_pointer extraction, and auto-detection
Per-Model Rate-Limited AI UDF Execution for controlling concurrent AI function invocations
Dependency upgrades including Turso v0.5.3, iceberg-rust v0.9, and Vortex improvements

What's New in v2.0.0-rc.2

Distributed Cayenne Query and Write Improvements

Distributed query for Cayenne-backed tables now has better partition awareness for both reads and writes.

Key improvements:

Data-Local Query Routing: Cayenne catalog queries can now be routed to executors that hold the relevant partitions, improving distributed query efficiency.
Partition-Aware Write Through: Scheduler-side Flight DoPut ingestion now splits partitioned Cayenne writes and forwards them to the responsible executors instead of routing through a single raw-forward path.
Dynamic Partition Assignment: Newly observed partitions can be added and assigned atomically as data arrives, with persisted partition metadata for future routing.
Better Cluster Coordination: Partition management is now separated for accelerated and federated tables, improving routing behavior for distributed Cayenne catalog workloads.
Distributed UPDATE/DELETE DML: UPDATE and DELETE statements for Cayenne catalog tables are now forwarded to all executors in distributed mode, with all executors required to succeed.
Distributed runtime.task_history: Task history is now replicated across the distributed cluster for observability.
RefreshDataset Control Stream: Dataset refresh operations are now distributed via the control stream to executors.
Executor DDL Sync: When an executor connects, it receives DDL for all existing tables, ensuring late-joining executors have full table state.

MERGE INTO for Spice Cayenne

Spice now supports MERGE INTO statements for Cayenne catalog tables, enabling upsert-style data operations with full distributed support.

Key improvements:

MERGE INTO Support: Execute MERGE INTO statements against Cayenne catalog tables for combined insert/update/delete operations.
Distributed MERGE: MERGE operations are automatically distributed across executors in cluster mode.
Data Safety: Duplicate source keys are detected and prevented to avoid data loss during MERGE operations.
Chunked Delete Filters: Large MERGE delete filter lists are chunked to prevent stack overflow with Vortex IN-list expressions.

`PARTITION BY` Support for Cayenne

SQL Partition Management: Spice now supports PARTITION BY for Cayenne-backed CREATE TABLE statements, enabling partition definitions to be expressed directly in SQL and persisted in the Cayenne catalog.

Key improvements:

SQL Partition Definition: Define Cayenne table partitioning directly in SQL using CREATE TABLE ... PARTITION BY (...).
Partition Validation: Partition expressions are parsed and validated during DDL analysis before table creation.
Persisted Partition Metadata: Partition metadata is stored in the Cayenne catalog and can be reloaded by the runtime after restart.
Distributed DDL Support: Partition metadata is forwarded when CREATE TABLE is distributed to executors in cluster mode.
Improved Type Support: Partition utilities now support newer string scalar variants such as Utf8View.

Example:

CREATE TABLE events (id INT, region TEXT, ts TIMESTAMP) PARTITION BY (region)

Catalog Connector Enhancements

Spice now includes additional catalog connectors for major database systems, improving schema discovery and federation workflows across external data systems.

Key improvements:

New Catalog Connectors: Added catalog connectors for PostgreSQL, MySQL, MSSQL, and Snowflake.
Schema and Table Discovery: Connectors use native metadata catalogs such as information_schema / INFORMATION_SCHEMA to discover schemas and tables.
Improved Federation Workflows: These connectors make it easier to expose external database metadata through Spice for cross-system federation scenarios.
PostgreSQL Partitioned Tables: Fixed schema discovery for PostgreSQL partitioned tables.

Example PostgreSQL catalog configuration:

catalogs:
  - from: pg
    name: pg
    include:
      - 'public.*'
    params:
      pg_host: localhost
      pg_port: 5432
      pg_user: postgres
      pg_pass: ${secrets:POSTGRES_PASSWORD}
      pg_db: my_database
      pg_sslmode: disable

JSON Ingestion Improvements

JSON ingestion is now more flexible and robust.

Key improvements:

More JSON Formats: Added support for single-object JSON documents, auto-detected JSON formats, and Socrata SODA responses.
json_pointer Extraction: Extract nested payloads before schema inference and reading using RFC 6901 JSON Pointer syntax.
Better Auto-Detection: JSON format detection now handles arrays, objects, JSONL, and BOM-prefixed input more reliably, including single multi-line objects.
SODA Support: Added schema extraction and data conversion for Socrata Open Data API responses.
Broader Compatibility: Improved handling for BOM-prefixed files, CRLF-delimited JSONL, nested payloads, mixed structures, and wrapped documents.

Example using json_pointer to extract nested data from an API response:

datasets:
  - from: https://api.example.com/v1/data
    name: users
    params:
      json_pointer: /data/users

DataFusion v52.4.0 Upgrade

Apache DataFusion has been upgraded from v52.2.0 to v52.4.0, with aligned updates across arrow-rs, datafusion-federation, and datafusion-table-providers.

Key improvements:

DataFusion v52.4.0: Brings the latest fixes and compatibility improvements across query planning and execution.
Strict Overflow Handling: try_cast_to now uses strict cast to return errors on overflow instead of silently producing NULL values.
Federation Fix: Fixed SQL unparsing for Inexact filter pushdown with aliases.
Partial Aggregation Optimization: Improved partial aggregation performance for FlightSQLExec.

Dependency Upgrades

Dependency	Version / Update
Turso (libsql)	v0.5.3 (from v0.4.4)
iceberg-rust	v0.9
Vortex	Map type support, stack-safe IN-lists
arrow-rs	Arrow v57.2.0
datafusion-federation	Updated for DataFusion v52.4.0 alignment
datafusion-table-providers	Updated for DataFusion v52.4.0 alignment
datafusion-ballista	Bumped to fix BatchCoalescer schema mismatch panic

Other Improvements

Cayenne released as RC: Cayenne data accelerator is now promoted to release candidate status.
File Update Acceleration Mode: Added mode: file_update acceleration mode for file-based data refresh.
spice completions Command: New CLI command for generating shell completion scripts, with auto-detection of shell directory.
--endpoint Flag: Added --endpoint flag to spice run with scheme-based routing for custom endpoints.
mTLS Client Auth: Added mTLS client authentication support to the spice sql REPL.
DynamoDB DML: Implemented DML (INSERT, UPDATE, DELETE) support for the DynamoDB table provider.
Caching Retention: Added retention policies for cached query results.
GraphQL Custom Auth Headers: Added custom authorization header support for the GraphQL connector.
ClickHouse Date32 Support: Added Date32 type support for the ClickHouse connector.
AWS IAM Role Source: Added iam_role_source parameter for fine-grained AWS credential configuration.
S3 Metadata Columns: Metadata columns renamed to _location, _last_modified, _size for consistency, with more robust handling in projected queries.
S3 URL Style: Added s3_url_style parameter for S3 connector URL addressing (path-style vs virtual-hosted). Useful for S3-compatible stores like MinIO:
```
params:
  s3_endpoint: https://minio.local:9000
  s3_url_style: path
```
S3 Parquet Performance: Improved S3 parquet read performance.
HTTP Caching: Transient HTTP error responses such as 429 and 5xx are no longer cached, preventing stale error payloads from being served from cache.
HTTP Connector Metadata: Added response_headers as structured map data for HTTP datasets.

Views on_zero_results: Accelerated views now support on_zero_results: use_source to fall back to the source when no results are found:

views:
  - name: sales_summary
    sql: |
      SELECT region, SUM(amount) as total
      FROM sales
      GROUP BY region
    acceleration:
      enabled: true
      on_zero_results: use_source

Flight DoPut Ingestion Metrics: Added rows_written and bytes_written metrics for Flight DoPut / ADBC ETL ingestion.
EXPLAIN ANALYZE Metrics: Added metrics for EXPLAIN ANALYZE in FlightSQLExec.
Scheduler Executor Metrics: Added scheduler_active_executors_count metric for monitoring active executors.
Query Memory Limit: Updated default query memory limit from 70% to 90%, with GreedyMemoryPool for improved memory management.
MetastoreTransaction Support: Added transaction support to prevent concurrent metastore transaction conflicts.
Iceberg REST Catalog: Coerce unsupported Arrow types to Iceberg v2 equivalents in the REST catalog API.
CDC Cache Invalidation: Improved cache invalidation for CDC-backed datasets.
Spice.ai Connector Alignment: Parameter names aligned across catalog and data connectors for Spice.ai Cloud.
Cayenne File Size: Cayenne now correctly respects the configured target file size (defaults to 128MB).
Cayenne Primary Keys: Properly set primary_keys/on_conflict for Cayenne tables.
Turso Metastore Performance: Cached metastore connections and prepared statements for improved Turso and SQLite metastore performance.
Turso SQL Robustness: More robust SQL unparsing and date comparison handling for Turso.
Dictionary Type Normalization: Normalize Arrow Dictionary types for DuckDB and SQLite acceleration.
GitHub Connector Resilience: Improved GraphQL client resilience, performance, and ref filter handling.
ODBC Fix: Fixed ODBC queries silently returning 0 rows on query failure.
Anthropic Fixes: Fixed compatibility issues with Anthropic model provider.
v1/responses API Fix: The /v1/responses API now correctly preserves client instructions when system_prompt is set.
Shared Acceleration Snapshots: Show an error when snapshots are enabled on a shared acceleration file.
Distributed Mode Error Handling: Improved error handling for distributed mode and state_location configuration.
Helm Chart: Added support for ServiceAccount annotations and AWS IRSA example.
Perplexity Removed: Removed Perplexity model provider support.
Rust v1.93.1: Upgraded Rust toolchain to v1.93.1.

Contributors

Breaking Changes

S3 metadata columns renamed: S3 metadata columns renamed from location, last_modified, size to _location, _last_modified, _size.
v1/evals API removed: The /v1/evals endpoint has been removed.
Perplexity removed: Perplexity model provider support has been removed.
Default query memory limit changed: Default query memory limit increased from 70% to 90%.

Upgrading

To upgrade to v2.0.0-rc.2, use one of the following methods:

CLI:

spice upgrade v2.0.0-rc.2

Homebrew:

brew upgrade spiceai/spiceai/spice

Docker:

Pull the spiceai/spiceai:2.0.0-rc.2 image:

docker pull spiceai/spiceai:2.0.0-rc.2

For available tags, see DockerHub.

Helm:

helm repo update
helm upgrade spiceai spiceai/spiceai --version 2.0.0-rc.2

AWS Marketplace:

Spice is available in the AWS Marketplace.

What's Changed

Changelog

ci: fix E2E CLI upgrade test to use latest release for spiced download by @phillipleblanc in #9613
fix(DF): Lazily initialize BatchCoalescer in RepartitionExec to avoid schema type mismatch by @sgrebnov in #9623
feat: Implement catalog connectors for various databases by @lukekim in #9509
Refactor and clean up code across multiple crates by @lukekim in #9620
fix: Improve error handling for distributed mode and state_location configuration by @lukekim in #9611
Properly install postgres in install-postgres action by @krinart in #9629
fix: Use Python venv for schema validation in CI by @phillipleblanc in #9637
Update spicepod.schema.json by @app/github-actions in #9640
Update testoperator dispatch to use release/2.0 branch by @phillipleblanc in #9641
fix: Align CUDA asset names in Dockerfile and install tests with build output by @phillipleblanc in #9639
Fix expect test scripts in E2E Installation AI test by @sgrebnov in #9643
testoperator for partitioned arrow accelerator by @Jeadie in #9635
Remove default 1s refresh_check_interval from spidapter for hive datasets by @phillipleblanc in #9645
Fix scheduler panic and cancel race condition by @phillipleblanc in #9644
Align Spice.ai connector parameter names across catalog/data connectors by @lukekim in #9632
docs: update distribution details and add NAS support in release notes by @lukekim in #9650
Enable postgres-accel in CI builds for benchmarks by @sgrebnov in #9649
perf: Cache Turso metastore connection across operations by @penberg in #9646
Add 'scheduler_state_location' to spidapter by @Jeadie in #9655
Implement Cayenne S3 Express multi-zone live test with data validation by @lukekim in #9631
chore(spidapter): bump default memory limit from 8Gi to 32Gi by @phillipleblanc in #9661
perf: Use prepare_cached() in Turso and SQLite metastore backends by @penberg in #9662
Improve CDC cache invalidation by @krinart in #9651
Refactor Cayenne IDs to use UUIDv7 strings by @lukekim in #9667
fix: add liveness check for dead executors in partition routing by @Jeadie in #9657
fix(s3): Fix metadata column schema mismatches in projected queries by @sgrebnov in #9664
s3_metadata_columns tests: include test for location outside table prefix by @sgrebnov in #9676
docs: Update DuckDB, GCS, Git connector and Cayenne documentation by @lukekim in #9671
Add s3_url_style support for S3 connector URL addressing by @phillipleblanc in #9642
Consolidate E2E workflows and require WSL for Windows runtime by @lukekim in #9660
Upgrade to Rust v1.93.1 by @lukekim in #9669
Security fixes and improvements by @lukekim in #9666
feat(flight): add DoPut rows/bytes written metrics for DoPut ETL ingestion tracking by @phillipleblanc in #9663
Skip caching http error response + add response_headers by @krinart in #9670
refactor: Remove v1/evals functionality by @Jeadie in #9420
Make a test harness for Distributed Spice integration tests by @Jeadie in #9615
Enable on_zero_results: use_source for views by @krinart in #9699
fix(spidapter): Lower memory limit, passthrough AWS secrets, override flight URL by @peasee in #9704
Show an error on a shared acceleration file with snapshots enabled by @krinart in #9698
Fixes for anthropic by @Jeadie in #9707
Use max_partitions_per_executor in allocate_initial_partitions by @Jeadie in #9659
[SpiceDQ] Accelerations must have partition key by @Jeadie in #9711
Upgrade to Turso v0.5 by @lukekim in #9628
feat: Rename metadata columns to _location, _last_modified, _size by @phillipleblanc in #9712
fix: bump datafusion-ballista to fix BatchCoalescer schema mismatch panic by @phillipleblanc in #9716
fix: Ensure Cayenne respects target file size by @peasee in #9730
refactor: Make DDL preprocessing generic from Iceberg DDL processing by @peasee in #9731
[SpiceDQ] Distribute query of Cayenne Catalog to executors with data by @Jeadie in #9727
Properly set primary_keys/on_conflict for Cayenne tables by @krinart in #9739
Add executor resource and replica support to cloud app config by @ewgenius in #9734
feat: Support PARTITION BY in Cayenne Catalog table creation by @peasee in #9741
Update datafusion and related packages to version 52.3.0 by @lukekim in #9708
Route FlightSQL statement updates through QueryBuilder by @phillipleblanc in #9754
JSON file format improvements by @lukekim in #9743
[SpiceDQ] Partition Cayenne catalogs writes through to executors by @Jeadie in #9737
Update to DF v52.3.0 versions of datafusion & datafusion-tableproviders by @lukekim in #9756
Make S3 metadata column handling more robust by @sgrebnov in #9762
Fetch API keys from dedicated endpoint instead of apps response by @phillipleblanc in #9767
Update arrow-rs, datafusion-federation, and datafusion-table-providers dependencies by @phillipleblanc in #9769
Chunk metastore batch inserts to respect SQLite parameter limits by @phillipleblanc in #9770
Improve JSON SODA support by @lukekim in #9795
Add ADBC Data Connector by @lukekim in #9723
docs: Release Cayenne as RC by @peasee in #9766
cli[feat]: cloud mode to use region-specific endpoints by @lukekim in #9803
Include updated JSON formats in HTTPS connector by @lukekim in #9800
Flight DoPut: Partition-aware write-through forwarding by @Jeadie in #9759
Pass through authentication to ADBC connector by @lukekim in #9801
Move scheduler_state_location from adapter metadata to env var by @phillipleblanc in #9802
Fix Cayenne DoPut upsert returning stale data after 3+ writes by @phillipleblanc in #9806
Fix JSON column projection producing schema mismatch by @sgrebnov in #9811
Fix http connector by @krinart in #9818
Fix ADBC Connector build and test by @lukekim in #9813
Support update & delete DML for distributed cayenne catalog by @Jeadie in #9805
Set allow_http param when S3 endpoint uses http scheme by @phillipleblanc in #9834
fix: Cayenne Catalog DDL requires a connected executor in distributed mode by @Jeadie in #9838
fix: Add conditional put support for file:// scheduler state location by @Jeadie in #9842
fix: Require the DDL primary key contain the partition key by @Jeadie in #9844
fix: Databricks SQL Warehouse schema retrieval with INLINE disposition and async retry by @lukekim in #9846
Filter pushdown improvements for SqlTable by @lukekim in #9852
feat: add iam_role_source parameter for AWS credential configuration by @lukekim in #9854
Fix ODBC queries silently returning 0 rows on query failure by @lukekim in #9864
feat(adbc): Add ADBC catalog connector with schema/table discovery by @lukekim in #9865
Make Turso SQL unparsing more robust and fix date comparisons by @lukekim in #9871
Fix Flight/FlightSQL filter precedence and mutable query consistency by @lukekim in #9876
Partial Aggregation optimisation for FlightSQLExec by @lukekim in #9882
fix: v1/responses API preserves client instructions when system_prompt is set by @Jeadie in #9884
feat: emit scheduler_active_executors_count and use it in spidapter by @Jeadie in #9885
feat: Add custom auth header support for GraphQL connector by @krinart in #9899
Add --endpoint flag to spice run with scheme-based routing by @lukekim in #9903
When executor connects, send DDL for existing tables by @Jeadie in #9904
fix: Improve ADBC driver shutdown handling and error classification by @lukekim in #9905
fix: require all executors to succeed for distributed DML (DELETE/UPDATE) forwarding by @Jeadie in #9908
fix(cayenne catalog): fix catalog refresh race condition causing duplicate primary keys by @Jeadie in #9909
Remove Perplexity support by @Jeadie in #9910
Fix refresh_sql support for debezium constraints by @krinart in #9912
Implement DML for DynamoDBTableProvider by @lukekim in #9915
chore: Update iceberg-rust fork to v0.9 by @lukekim in #9917
Run physical optimizer on FallbackOnZeroResultsScanExec fallback plan by @sgrebnov in #9927
Improve Databricks error message when dataset has no columns by @sgrebnov in #9928
Delta Lake: fix data skipping for >= timestamp predicates by @sgrebnov in #9932
fix: Ensure distributed Cayenne DML inserts are forwarded to executors by @Jeadie in #9948
Add full query federation support for ADBC data connector by @lukekim in #9953
Make time_format deserialization case-insensitive by @vyershov in #9955
Hash ADBC join-pushdown context to prevent credential leaks in EXPLAIN plans by @lukekim in #9956
fix: Normalize Arrow Dictionary types for DuckDB and SQLite acceleration by @sgrebnov in #9959
ADBC BigQuery: Improve BigQuery dialect date/time and interval SQL generation by @lukekim in #9967
Make BigQueryDialect more robust and add BigQuery TPC-H benchmark support by @lukekim in #9969
fix: Show proper unauthorized error instead of misleading runtime unavailable by @lukekim in #9972
fix: Enforce target_chunk_size as hard maximum in chunking by @lukekim in #9973
Add caching retention by @krinart in #9984
fix: improve Databricks schema error detection and messages by @lukekim in #9987
fix: Set default S3 region for opendal operator and fix cayenne nextest by @phillipleblanc in #9995
fix(PostgreSQL): fix schema discovery for PostgreSQL partitioned tables by @sgrebnov in #9997
fix: Defer cache size check until after encoding for compressed results by @krinart in #10001
fix: Rewrite numeric BETWEEN to CAST(AS REAL) for Turso by @lukekim in #10003
fix: Handle integer time columns in append refresh for all accelerators by @sgrebnov in #10004
fix: preserve s3a:// scheme when building OpenDalStorageFactory with custom endpoint by @phillipleblanc in #10006
Fix ISO8601 time_format with Vortex/Cayenne append refresh by @sgrebnov in #10009
fix: Address data correctness bugs found in audit by @sgrebnov in #10015
fix(federation): fix SQL unparsing for Inexact filter pushdown with alias by @lukekim in #10017
Improve GitHub connector ref handling and resilience by @lukekim in #10023
feat: Add spice completions command for shell completion generation by @lukekim in #10024
fix: Fix data correctness bugs in DynamoDB decimal conversion and GraphQL pagination by @sgrebnov in #10054
Implement RefreshDataset for distributed control stream by @Jeadie in #10055
perf: Improve S3 parquet read performance by @sgrebnov in #10064
fix: Prevent write-through stalls and preserve PartitionTableProvider during catalog refresh by @Jeadie in #10066
feat: spice completions auto-detects shell directory and writes file by @lukekim in #10068
fix: Bug in DynamoDB, GraphQL, and ISO8601 refresh data handling by @sgrebnov in #10063
fix partial aggregation deduplication on string checking by @lukekim in #10078
fix: add MetastoreTransaction support to prevent concurrent transaction conflicts by @phillipleblanc in #10080
fix: Use GreedyMemoryPool, add spidapter query memory limit arg by @phillipleblanc in #10082
feat: Add metrics for EXPLAIN ANALYZE in FlightSQLExec by @lukekim in #10084
Use strict cast in try_cast_to to error on overflow instead of silent NULL by @sgrebnov in #10104
feat: Implement MERGE INTO for Cayenne catalog tables by @peasee in #10105
feat: Add distributed MERGE INTO support for Cayenne catalog tables by @peasee in #10106
Improve JSON format auto-detection for single multi-line objects by @lukekim in #10107
Add mode: file_update acceleration mode by @krinart in #10108
Coerce unsupported Arrow types to Iceberg v2 equivalents in REST catalog API by @peasee in #10109
fix: Update default query memory limit to 90% from 70% by @phillipleblanc in #10112
feat: Add mTLS client auth support to spice sql REPL by @lukekim in #10113
fix(datafusion-federation): report error on overflow instead of silent NULL by @sgrebnov in #10124
fix: Prevent data loss in MERGE when source has duplicate keys by @peasee in #10126
feat: Add ClickHouse Date32 type support by @sgrebnov in #10132
Add Delta Lake column mapping support (Name/Id modes) by @sgrebnov in #10134
fix: Restore Turso numeric BETWEEN rewrite lost in DML revert by @lukekim in #10139
fix: Enable arm64 Linux builds with fp16 and lld workarounds by @lukekim in #10142
fix: remove double trailing slash in Unity Catalog storage locations by @sgrebnov in #10147
fix: Improve GitHub GraphQL client resilience and performance by @lukekim in #10151
Enable reqwest compression and optimize HTTP client settings by @lukekim in #10154
fix: executor startup failures by @Jeadie in #10155
feat: Distributed runtime.task_history support by @Jeadie in #10156
fix: Preserve timestamp timezone in DDL forwarding to executors by @peasee in #10159
feat: Per-model rate-limited concurrent AI UDF execution by @Jeadie in #10160
fix(Turso): Reject subquery/outer-ref filter pushdown in Turso provider by @lukekim in #10174
Fix linux/macos spice upgrade by @phillipleblanc in #10194
Improve CREATE TABLE LIKE error messages, success output, EXPLAIN, and validation by @peasee in #10203
fix: chunk MERGE delete filters and update Vortex for stack-safe IN-lists by @peasee in #10207
Propagate runtime.params.parquet_page_index to Delta Lake connector by @sgrebnov in #10209
Properly mark dataset as Ready on Scheduler by @Jeadie in #10215
fix: handle Utf8View/LargeUtf8 in GitHub connector ref filters by @lukekim in #10217
fix(databricks): Fix schema introspection and timestamp overflow by @lukekim in #10226
fix(databricks): Fix schema introspection failures for non-Unity-Catalog environments by @lukekim in #10227
feat: Add pagination support to HTTP data connector by @lukekim in #10228
feat(databricks): DESCRIBE TABLE fallback and source-native type parsing for Lakehouse Federation by @lukekim in #10229
fix(databricks): harden HTTP retries, compression, and token refresh by @lukekim in #10232
feat[helm chart]: Add support for ServiceAccount annotations and AWS IRSA example by @peasee in #9833
fix: Log warning and fall back gracefully on Cayenne config change by @krinart in #9092
fix: Handle engine mismatch gracefully in snapshot fallback loop by @krinart in #9187

Full Changelog: https://github.com/spiceai/spiceai/compare/v2.0.0-rc.1...v2.0.0-rc.2

Spice v1.11.5 (Apr 1, 2026)

Wed, 01 Apr 2026 00:00:00 GMT

Announcing the release of Spice v1.11.5! 🛠️

Spice v1.11.5 is a patch release improving on_zero_results: use_source fallback performance, Delta Lake timestamp predicate data skipping, S3 Parquet read performance, PostgreSQL partitioned table support, Cayenne target file size handling, and preparing the CLI for v2.0 runtime upgrades.

What's New in v1.11.5

`on_zero_results: use_source` Fallback Performance Improvement

Improved the on_zero_results: use_source fallback path to run DataFusion's physical optimizer on the federated scan plan (#9927). The fallback path now runs SessionState::physical_optimizers() rules on the federated scan plan before execution, enabling parallel file group scanning and other optimizations. This results in significantly faster fallback queries on multi-core machines, particularly for file-based data sources like Delta Lake.

Delta Lake: Improved Data Skipping for `>=` Timestamp Predicates

Delta Lake table scans with >= timestamp filters now correctly prune files that do not match the predicate (#9932), improving query performance through more effective data skipping (file-level pruning).

PostgreSQL: Partitioned Tables Support

The PostgreSQL data connector now supports partitioned tables (#9997) for both federated and accelerated queries.

S3 Parquet Read Performance Improvement

Improved parquet read performance from S3 and other object stores (#10064), particularly for tables with many columns. Column data ranges are now coalesced into fewer, larger requests instead of being fetched individually, reducing the number of HTTP round-trips.

Cayenne: Ensure Target File Size is Respected

The Cayenne accelerator now correctly respects the configured target file size (#10071). Previously, Cayenne could produce many small, fragmented Vortex files; with this fix, files are written at the expected target size, improving storage efficiency and query performance.

CLI: Support for v2.0 Runtime Upgrades

The Spice CLI can now upgrade to v2.0 runtime versions. This enables upgrading to v2.0 release candidates and, once released, the v2.0 stable runtime.

spice upgrade v2.0.0-rc.1

Running spice upgrade without a version will upgrade to the latest stable version, including v2.0 once released.

Note: Native Windows runtime builds will no longer be provided in v2.0. Use WSL for local development instead.

Contributors

Breaking Changes

No breaking changes.

Cookbook Updates

No new cookbook recipes.

The Spice Cookbook includes 86 recipes to help you get started with Spice quickly and easily.

Upgrading

To upgrade to v1.11.5, use one of the following methods:

CLI:

spice upgrade

Homebrew:

brew upgrade spiceai/spiceai/spice

Docker:

Pull the spiceai/spiceai:1.11.5 image:

docker pull spiceai/spiceai:1.11.5

For available tags, see DockerHub.

Helm:

helm repo update
helm upgrade spiceai spiceai/spiceai --version 1.11.5

AWS Marketplace:

Spice is available in the AWS Marketplace.

What's Changed

Changelog

fix(runtime): Run physical optimizer on FallbackOnZeroResultsScanExec fallback plan by @sgrebnov in #9927
fix(delta_lake): Fix data skipping for >= timestamp predicates by @sgrebnov in #9932
fix(PostgreSQL): Fix schema discovery for PostgreSQL partitioned tables by @sgrebnov in #9997
fix(cli): Skip models variant download for v2+ in upgrade/install by @lukekim and @sgrebnov in #10052
perf(s3): Improve Parquet read performance by @sgrebnov in #10064
fix(cayenne): Ensure Cayenne respects target file size by @krinart in #10071

Full Changelog: https://github.com/spiceai/spiceai/compare/v1.11.4...v1.11.5

Spice v1.11.4 (Mar 12, 2026)

Thu, 12 Mar 2026 00:00:00 GMT

Announcing the release of Spice v1.11.4! ⚡

Spice v1.11.4 is a patch release improving S3 metadata column query robustness and enabling on_zero_results: use_source for accelerated views.

What's New in v1.11.4

Accelerated Views: `on_zero_results: use_source` Support

Accelerated views now support the on_zero_results: use_source configuration (#9699). Previously, accelerated views only supported on_zero_results: return_empty, which returned an empty result set when the accelerated data contained no matching rows. With this change, views can fall back to querying the source data when the accelerated query returns zero results, matching the behavior already available for accelerated datasets.

Example configuration:

views:
  - name: sales_summary
    sql: |
      SELECT region, SUM(amount) as total
      FROM sales
      GROUP BY region
    acceleration:
      enabled: true
      on_zero_results: use_source

How the Fallback Works

When an accelerated view is configured with on_zero_results: use_source, the following happens at query time:

The accelerated store is queried first. The query runs against the view's accelerated data (e.g., Spice Cayenne, Arrow, DuckDB, or SQLite).
If the accelerated query returns zero rows, the runtime falls back to re-executing the view's SQL query against the datasets it references.
Referenced datasets are queried according to their own configuration. The view's SQL is re-executed against each referenced dataset as it is configured. This means:
- If a referenced dataset is accelerated, the query hits that dataset's accelerated store — not the raw data source.
- If a referenced dataset is accelerated with on_zero_results: use_source and its accelerated store also returns zero rows, it will independently fall back to its own federated data source (e.g., Postgres, S3, etc.).
- If a referenced dataset is federated (not accelerated), the query goes directly to the data source.

This means the fallback can chain through multiple layers: first the view's acceleration, then each referenced dataset's acceleration, and finally the original data source — each layer independently applying its own on_zero_results behavior.

Example: Multi-layer fallback

datasets:
  - from: postgres:orders
    name: orders
    acceleration:
      enabled: true
      refresh_sql: "SELECT * FROM orders WHERE created_at > now() - interval '7 days'"
      on_zero_results: use_source  # Falls back to Postgres if accelerated data has no matches

views:
  - name: recent_orders_summary
    sql: |
      SELECT status, COUNT(*) as order_count
      FROM orders
      GROUP BY status
    acceleration:
      enabled: true
      on_zero_results: use_source  # Falls back to re-running the SQL against referenced datasets

In this example, a query like SELECT * FROM recent_orders_summary WHERE status = 'cancelled' follows this path:

Queries recent_orders_summary in the view's accelerated store (DuckDB/SQLite).
If zero rows are returned, re-executes SELECT status, COUNT(*) ... FROM orders GROUP BY status against the orders dataset.
Since orders is accelerated, the query hits the orders accelerated store.
If orders also returns zero rows (e.g., the refresh_sql excluded cancelled orders), it falls back to querying Postgres directly.

S3 Data Connector: More Robust Metadata Column Handling

Improved the robustness of metadata column (location, last_modified, size) handling for S3 datasets. Building on the v1.11.3 release, this update addresses an additional edge case where the query optimizer's projection swap could cause an index out of bounds panic when metadata columns are referenced in projections with filters or scalar functions.

Contributors

Breaking Changes

No breaking changes.

Cookbook Updates

No new cookbook recipes.

The Spice Cookbook includes 86 recipes to help you get started with Spice quickly and easily.

Upgrading

To upgrade to v1.11.4, use one of the following methods:

CLI:

spice upgrade

Homebrew:

brew upgrade spiceai/spiceai/spice

Docker:

Pull the spiceai/spiceai:1.11.4 image:

docker pull spiceai/spiceai:1.11.4

For available tags, see DockerHub.

Helm:

helm repo update
helm upgrade spiceai spiceai/spiceai --version 1.11.4

AWS Marketplace:

Spice is available in the AWS Marketplace.

What's Changed

Changelog

fix(s3): Make metadata column handling more robust by @sgrebnov in #9714
feat(views): Enable on_zero_results: use_source for accelerated views by @krinart in #9699

Full Changelog: https://github.com/spiceai/spiceai/compare/v1.11.3...v1.11.4

Spice v1.11.3 (Mar 9, 2026)

Mon, 09 Mar 2026 00:00:00 GMT

Announcing the release of Spice v1.11.3! 🛠️

Spice v1.11.3 is a patch release fixing schema consistency issues in the S3 and FlightSQL data connectors, improving CDC cache invalidation, and enhancing the HTTP data connector's error handling and response metadata.

What's New in v1.11.3

S3 Data Connector Fix

Fixed an issue where queries using metadata columns (location, last_modified, size) on S3 datasets produced Input field name does not match with the projection expression errors (#9647). This occurred when projecting metadata columns with filters or scalar functions (e.g., SELECT lower(location) FROM table WHERE location = '...'), and when projection returned no matching files.

FlightSQL Schema Consistency

Fixed an issue where the Flight SQL JDBC driver returned Unsupported ArrowType Utf8View errors when performing ::TEXT type casts (#9253). The FlightSQL endpoint now maps view types (e.g., Utf8View, BinaryView) to their non-view equivalents, ensuring compatibility with JDBC and ODBC clients.

CDC Cache Invalidation

Fixed an issue where the SQL results cache was invalidated on every change stream poll, even when zero records were returned (#9472). This caused near-total cache miss rates for datasets using refresh_mode: changes (e.g., DynamoDB Streams), effectively rendering the cache useless. Cache invalidation now only occurs when a change batch contains actual data changes.

HTTP Data Connector Improvements

HTTP error responses (e.g., 5xx) are now excluded from the cache, preventing transient server errors from polluting cached results.
Added a response_headers column (Map type) to HTTP responses, providing access to response header metadata in query results.

Contributors

Breaking Changes

No breaking changes.

Cookbook Updates

No new cookbook recipes.

The Spice Cookbook includes 86 recipes to help you get started with Spice quickly and easily.

Upgrading

To upgrade to v1.11.3, use one of the following methods:

CLI:

spice upgrade

Homebrew:

brew upgrade spiceai/spiceai/spice

Docker:

Pull the spiceai/spiceai:1.11.3 image:

docker pull spiceai/spiceai:1.11.3

For available tags, see DockerHub.

Helm:

helm repo update
helm upgrade spiceai spiceai/spiceai --version 1.11.3

AWS Marketplace:

Spice is available in the AWS Marketplace.

What's Changed

Changelog

fix(s3): Fix metadata column schema mismatches in projected queries by @sgrebnov in #9664
s3_metadata_columns tests: include test for location outside table prefix by @sgrebnov in #9676
Fix Flight SQL schema consistency: expand view types and verify field names by @sgrebnov in #9438
Improve CDC cache invalidation by @krinart in #9651
Skip caching http error response + add response_headers by @krinart in #9670

Full Changelog: https://github.com/spiceai/spiceai/compare/v1.11.2...v1.11.3

Spice v2.0-rc.1 (Mar 4, 2026)

Wed, 04 Mar 2026 00:00:00 GMT

Announcing the release of Spice v2.0-rc.1! 🚀

v2.0.0-rc.1 is the first release candidate for early testing of v2.0.

Highlights in this release candidate include:

Active-Active Highly-Available Distributed Query that is object-store-native and built on Apache Ballista, with dynamic cluster sizing, distributed ingestion, and cluster observability
Spice Cayenne RC with staged append writes, file-based retention deletes, composite partitioning, and distributed ingestion
DataFusion v52.2.0 Upgrade with sort pushdown, a new merge join, and dynamic filters
DDL Support for CREATE TABLE and DROP TABLE via SQL for Iceberg and Cayenne catalogs
DuckLake Catalog & Data Connector for lakehouse-style data management
GCS Data Connector (Alpha) for Google Cloud Storage
Rust CLI Rewrite for a unified single-binary experience
Dependency upgrades including DuckDB v1.4.4, delta_kernel v0.18.2, and mistral.rs

Spice v2.0 includes several breaking changes. Review the breaking changes section before upgrading.

Distribution Changes

AI/ML support including local LLM/ML model and hosted LLM inference is now included in the default Spice build and image. The separate models build variant has been removed.

A new Network Attached Storage (NAS) distribution with built-in SMB and NFS data connector support is also now available in nightly builds and with Spice.ai Enterprise.

Distribution / Variant	Open Source	Spice Cloud	Enterprise
Default	✅	✅	✅
Data	Nightly only	✅	✅
NAS (SMB + NFS)	Nightly only	❌	✅
Metal (macOS)	✅	✅	✅
CUDA (Linux)	Nightly only	✅	✅
Allocator variants	Nightly only	✅	✅
ODBC connector	Local build only	✅	✅

For more details, see the Distributions documentation.

What's New in v2.0.0-rc.1

Active-Active HA Distributed Query

Distributed Query exits Beta with active-active highly-available object-store-based distributed query.

Distributed query supports two execution modes:

Synchronous: Queries for accelerated datasets are distributed across executors and results are streamed back in real-time. Non-accelerated datasets execute only on the scheduler. Best for interactive queries where low latency is critical.
Asynchronous: Queries are submitted via the new HTTP-only /v1/queries API and results are materialized to object storage for later retrieval. Best for long-running analytical workloads, batch processing, and non-accelerated datasets in distributed mode.

Key improvements:

Dynamic Cluster Sizing: The query planner automatically adjusts parallelism based on the number of active executors in the cluster, ensuring optimal resource utilization as nodes are added or removed.
Distributed Ingestion: Data ingestion for partitioned accelerated tables is now distributed across executor nodes, enabling higher throughput and parallel data loading in cluster mode. Regular (non-partitioned) accelerated tables do not distribute ingestion loads.
Synchronous Execution on Scheduler: /v1/sql and FlightSQL queries now execute synchronously on the scheduler when appropriate, reducing inter-node overhead for queries that don't benefit from distribution.
Faster Failure Detection: Executor heartbeat timeout reduced from 180s to 30s, enabling the cluster to quickly detect and respond to executor failures.
Cluster Observability: New metrics and Grafana dashboard for monitoring distributed query clusters.

Spice Cayenne Improvements

The Spice Cayenne data accelerator exits Beta with significant reliability and performance improvements:

Staged Append Writes: WAL-based staged append writes prevent partial writes and data loss on stream errors. Batches are written to a WAL file before being committed, ensuring atomicity.
File-Based Retention Deletes: Time-based retention now supports file-level deletes for both position-based and primary-key tables, reducing I/O overhead compared to row-level deletion.
Multiple Partition Expressions: Support for composite partitioning with partition_by: [col1, col2] using hierarchical path-like keys (e.g., 2025/10/15).
Distributed Ingestion: Cayenne catalog now supports distributed ingestion across executor nodes in cluster mode, including UPDATE operations.
Improved Robustness: Fixed CDC edge case where DELETE + UPSERT sequences could produce duplicate primary keys across protected snapshots. Improved upsert handling during runtime restarts.

DataFusion v52.2.0 Upgrade

Apache DataFusion has been upgraded to v52.2.0, bringing significant performance improvements, new query features, and enhanced extensibility.

Performance Improvements:

Faster CASE Expressions: Lookup-table-based evaluation for certain CASE expressions avoids repeated evaluation, accelerating common ETL patterns
MIN/MAX Aggregate Dynamic Filters: Queries with MIN/MAX aggregates now create dynamic filters during scan to prune files and rows as tighter bounds are discovered during execution
New Merge Join: Rewritten sort-merge join (SMJ) operator with speedups of three orders of magnitude in pathological cases (e.g., TPC-H Q21: minutes → milliseconds)
Caching Improvements: New statistics cache for file metadata avoids repeatedly recalculating statistics, significantly improving planning time. A prefix-aware list-files cache accelerates evaluating partition predicates for Hive partitioned tables
Improved Hash Join Filter Pushdown: Build-side hash map contents are now passed dynamically to probe-side scans for pruning files, row groups, and individual rows

Major Features:

Sort Pushdown to Scans: Sorts are pushed into data sources, enabling ~30x performance improvement on pre-sorted data with top-K queries. Parquet scans now reverse row group order for DESC queries on ASC-sorted files
TableProvider supports DELETE and UPDATE: New hooks for DELETE and UPDATE statements in the TableProvider trait, enabling Iceberg and Cayenne connectors to implement SQL DELETE and UPDATE operations
More Extensible SQL Planning: New RelationPlanner API for extending SQL planning for FROM clauses, enabling support for vendor-specific SQL dialects

DDL Support for Iceberg and Cayenne

SQL Schema Management: Spice now supports CREATE TABLE and DROP TABLE DDL operations for Iceberg and Cayenne catalogs via FlightSQL and the /v1/sql API. DML validation has been updated for catalog-level writability.

DuckLake Catalog & Data Connector

Lakehouse-Style Data Management: New DuckLake catalog and data connector enable lakehouse-style data management with DuckDB as the metadata catalog and object storage for data files. DuckLake provides ACID transactions, time travel, and schema evolution on top of Parquet files.

GCS Data Connector (Alpha)

Google Cloud Storage Support: New Google Cloud Storage data connector enables federated queries against data stored in GCS buckets, with Iceberg table support.

Rust CLI Rewrite

Unified Single-Binary Experience: The Spice CLI has been completely rewritten from Go to Rust, eliminating the Go dependency and providing a single spice binary built from the same codebase as spiced. This improves startup performance, reduces distribution size, and ensures consistent behavior between CLI and runtime.

Key Features:

Full Feature Parity: All 27+ CLI commands re-implemented in Rust with identical behavior
New spice query Command: Interactive REPL for async queries via the /v1/queries API with multi-line SQL input, spinner progress indicator, Ctrl+C cancellation, and partial query ID matching
--output=json Flag: Machine-readable JSON output for CLI commands, enabling scripting and automation
spice login --output: New output modes (env, json, keychain) for flexible credential management
spice cloud metrics: New command for Spice Cloud deployment metrics

Models Included by Default

Local LLM/ML model inference (via mistral.rs) is now included in the default Spice build. The separate models build variant has been removed. This simplifies installation and ensures all users have access to local AI inference capabilities.

Error Propagation for Dataset and Model Status APIs

The /v1/datasets and /v1/models APIs now return structured error information when a component is in an Error state. The ?status=true query parameter must be passed to retrieve the real-time component status, including the error state and details. Previously, the status field only indicated Error with no further detail. Now, two new fields are included when ?status=true is specified:

error: A structured object with category, type, and code fields for programmatic error handling (e.g. { "category": "dataset", "type": "auth", "code": "dataset.auth" }).
error_message: A human-readable description of why the component entered an error state.

These fields are only present when ?status=true is passed and the component is in an error state.

Example /v1/datasets?status=true response:

[
  {
    "from": "postgres:syncs",
    "name": "daily_journal",
    "replication_enabled": false,
    "acceleration_enabled": true,
    "status": "Ready"
  },
  {
    "from": "databricks:hive_metastore.default.messages",
    "name": "messages",
    "replication_enabled": false,
    "acceleration_enabled": true,
    "status": "Error",
    "error": {
      "category": "dataset",
      "type": "auth",
      "code": "dataset.auth"
    },
    "error_message": "Unable to authenticate with datasource credentials"
  }
]

The spice datasets and spice models CLI commands now include an ERROR column that displays the error message for any component in an error state.

Additional Dependency Upgrades

Dependency	Version
Ballista	v52.0.0
DuckDB	v1.4.4
delta_kernel	v0.18.2
mistral.rs	v0.7.0 (candle fork removed, now uses candle 0.9.2 from crates.io)
Turso (libsql)	v0.4.4
Vortex	Upgraded with CASE-WHEN support
AWS SDK	Multiple crates updated + APN user-agent support

Other Improvements

Spicepod v2 Support: Spicepods now support version v2, and spice init generates spicepod.yaml files with version: v2 by default while maintaining backward compatibility for existing v1 spicepods.
x.ai Models: x.ai models now exclusively use the /v1/responses endpoint with rate limiting support.
HuggingFace Chat Templates: Added support for chat templates in HuggingFace model configurations.
Databricks SQL Dialect: Added Databricks SQL dialect for DataFusion unparser, improving federation query generation.
Snowflake: Added snowflake_private_key parameter for key-pair authentication.
Acceleration Metrics: New rows_written, bytes_written, and dataset_acceleration_size_bytes metrics for acceleration refresh ingestion.
Refresh SQL UDFs: Core scalar UDFs are now enabled in refresh SQL expressions.
FlightSQL: Fixed TLS connection handling for grpc+tls:// endpoints with custom CA certificate support.
FlightSQL: Fixed schema consistency by expanding view types and verifying field names.
Hash Index: Fixed query correctness when hash index is used with additional filters.
Results Cache: Fixed schema preservation for empty query results.
Query Nullability: Reconciled execution stream nullability with logical plan schema.
Schema Evolution: Graceful handling of schema evolution mismatch errors during data refresh.
Internal YAML Parser: Replaced deprecated serde_yaml with an internal YAML implementation.

Spicepod v1 to v2 Changes

Spicepod v2 introduces configuration improvements while maintaining backward compatibility with v1. Existing v1 spicepods continue to work — deprecated fields are automatically migrated at load time.

Version support:

Version	Status
`v2`	Default. Used by `spice init`.
`v1`	Supported. Deprecated fields auto-migrate.
`v1beta1`	Removed. No longer accepted.

Configuration changes:

v1 (deprecated)	v2 (preferred)	Notes
`runtime.results_cache`	`runtime.caching.sql_results`	All fields migrate automatically. `cache_max_size` → `max_size`.
`runtime.memory_limit`	`runtime.query.memory_limit`	Auto-migrated. `query.memory_limit` takes priority if both set.
`runtime.temp_directory`	`runtime.query.temp_directory`	Auto-migrated. `query.temp_directory` takes priority if both set.
`dataset.invalid_type_action`	`dataset.unsupported_type_action`	Auto-migrated. v2 adds a new `string` variant.

New v2 fields:

runtime.ready_state — Controls when the runtime reports ready (on_load default, or on_registration).
runtime.flight.do_put_rate_limit_enabled — Enable/disable FlightSQL DoPut rate limiting (default: true).
runtime.query.spill_compression — Compression for query spill files (e.g., lz4_frame).
runtime.scheduler.partition_management — Configure partition assignment interval, limits, and timeouts for distributed mode.
runtime.caching.sql_results.stale_while_revalidate_ttl — Serve stale cached results while revalidating in the background.
runtime.caching.sql_results.encoding — Cache entry compression (e.g., zstd).
catalog.access: read_write_create — New access mode for catalogs that support DDL operations.

Migration note: When both the deprecated v1 field and its v2 equivalent are set, the v2 field takes priority.

Contributors

Breaking Changes

Cayenne and Distributed Query exit Beta: Beta warnings have been removed from documentation and code. Both features are now considered GA-ready.
Models included by default: The separate models build variant has been removed. Local LLM inference is now always included.
Spicepod version defaults to v2: New spicepods created with spice init now default to version: v2. Existing v1 spicepods remain supported, and v1beta1 is no longer accepted.
Windows native builds removed: Native Windows builds are no longer provided. Use WSL for local development instead.
Metric renames: accelerated_refresh metrics renamed to acceleration_refresh for consistency. last_refresh_time gauge renamed to include milliseconds unit.
Caching config renamed: ResultsCache replaced with SQLResultsCacheConfig in configuration.
DuckDB parameter rename: partitioned_write_flush_threshold renamed to partitioned_write_flush_threshold_rows.
v1/search API: The /v1/search API now always returns an array in matches, even for single results.
x.ai model endpoint: x.ai models now exclusively use the /v1/responses endpoint.
Error messages: Error messages across S3 Vectors, ScyllaDB, Snowflake, ClickHouse, and other components have been refactored for clarity and consistency.

Cookbook Updates

New and updated Spice Cookbook recipes:

Async Queries: Submit long-running queries asynchronously and retrieve results later.
DuckLake Catalog Connector: Use DuckLake for lakehouse-style data management with ACID transactions and time travel.

The Spice Cookbook includes 88 recipes to help you get started with Spice quickly and easily.

Upgrading

To upgrade to v2.0.0-rc.1, use one of the following methods:

CLI:

spice upgrade

Homebrew:

brew upgrade spiceai/spiceai/spice

Docker:

Pull the spiceai/spiceai:2.0.0-rc.1 image:

docker pull spiceai/spiceai:2.0.0-rc.1

For available tags, see DockerHub.

Helm:

helm repo update
helm upgrade spiceai spiceai/spiceai --version 2.0.0-rc.1

AWS Marketplace:

Spice is available in the AWS Marketplace.

What's Changed

Changelog

Add TPC-DS integration tests with S3 source and PostgreSQL acceleration by @phillipleblanc in #9006
fix(tests): fix flaky/slow/failing unit tests by @phillipleblanc in #9009
fix: Update benchmark snapshots for DF51 upgrade by @app/github-actions in #9008
fix: add feature gate to rrf TEST_EMBEDDING_MODEL by @phillipleblanc in #9017
fix: features check by @phillipleblanc in #9014
fix: Enable Cayenne acceleration snapshots by @lukekim in #9020
URL table support by @lukekim in #9018
ScyllaDB key filter by @lukekim in #8997
fix: Schema mismatch when using column projection with HTTP caching by @phillipleblanc in #9021
Add more tests for HTTP caching with columns selection by @sgrebnov in #9025
HTTP cache snapshots: default to time_interval and fix snapshots_creation_policy: on_change by @sgrebnov in #9026
Fix duplicate snapshot creation on startup by @sgrebnov in #9029
Add ScyllaDB and SMB to the README table by @krinart in #9034
Remove waiting for runtime to be ready before creating snapshot by @krinart in #9033
Fix snapshot on_change policy to skip when no writes occurred by @sgrebnov in #9028
Release notes for release release/1.11.0-rc.2 by @krinart in #9016
ci: use arduino/setup-protoc for official protobuf compiler by @phillipleblanc in #9036
ci: install unzip on aarch64 runner for arduino/setup-protoc by @phillipleblanc in #9038
fix: don't fail release if upload to minio fails by @phillipleblanc in #9039
Add missing protoc step to setup-cc action by @krinart in #9041
fix: Update Search integration test snapshots by @app/github-actions in #9013
Fix formula_1 and codebase_community in bird-bench by @Jeadie in #9000
Cayenne S3 Express One Zone improvements by @lukekim in #9015
Add zlib1g-dev to CI by @lukekim in #9052
Improve validation and logging for hash indexes by @lukekim in #9047
Upgrade Vortex with CASE-WHEN by @lukekim in #9051
x.ai models now exclusively use /v1/responses endpoint by @lukekim in #9400
Improvements for snapshot schema comparison by @krinart in #9401
v2.0 breaking changes by @lukekim in #9233
Create PartitionManagementTask for scheduler to update accelerated table partition assignments by @Jeadie in #9378
refactor(Cayenne): route all write orchestration through CayenneDataSink by @sgrebnov in #9402
Refactor benchmark to use QueryExecutor trait by @Jeadie in #9418
feat: Add spidapter build and release workflow by @peasee in #9427
Testoperator: add support for api-key when connecting to external spice instance by @sgrebnov in #9421
Initial implementation of Ducklake catalog & data connectors by @lukekim in #9083
Require aws_lc_rs since jsonwebtoken upgrade by @Jeadie in #9426
feat: Add spidapter tool by @peasee in #9425
Add release notes for 1.11.2 patch release by @sgrebnov in #9430
feat(spidapter): integrate system-adapter-protocol with SCP provisioning by @phillipleblanc in #9434
Add DuckLake TPCH E2E workflow and federated Spicepod configuration by @lukekim in #9431
fix(spidapter): use Flight handshake auth instead of x-api-key header by @phillipleblanc in #9435
[spidapter] Keep only what sparks joy by @Jeadie in #9439
Refactor binary operator balancing by @Jeadie in #9424
feat: Add Iceberg DDL support (CREATE TABLE / DROP TABLE) for default catalog override by @phillipleblanc in #9440
Fix Flight SQL schema consistency: expand view types and verify field names by @sgrebnov in #9438
Update spidapter for new system-adapter-protocol by @sgrebnov in #9442
docs: fix typos and syntax errors in style guide and error handling docs by @cluster2600 in #9445
Add acceleration refresh ingestion metrics (rows_written, bytes_written) by @phillipleblanc in #9461
Refactor(Cayenne): Replace CatalogError and string based errors with Snafu errors by @sgrebnov in #9403
Replace deprecated claude-3-5-haiku-latest with claude-haiku-4-5 by @Jeadie in #9492
Fix #9481: Preserve schema in results cache for empty query results by @phillipleblanc in #9485
Fix partition by serializing by @Jeadie in #9474
query: reconcile execution stream nullability with logical plan schema by @phillipleblanc in #9486
initial spice-cloud-client crate and spice cloud metrics --app . by @Jeadie in #9480
feat: Return dataset error message in datasets API by @peasee in #9487
Spicebench by @lukekim in #9447
build(deps): consolidate dependabot dependency updates by @phillipleblanc in #9504
fix(cluster): route non-partitioned accelerated tables in distributed mode by @phillipleblanc in #9508
Enable core scalar UDFs in refresh SQL by @sgrebnov in #9502
Fix metrics in Spidapter again by @Jeadie in #9497
fix(cluster): tolerate Completed->status propagation race in distributed query handle by @phillipleblanc in #9510
feat: Support distributed ingestion in cayenne catalog by @peasee in #9506
Fix Cayenne duplicate primary keys after DELETE + UPSERT CDC sequences by @krinart in #9494
fix(cluster): rewrite table scans inside subqueries for distributed execution by @phillipleblanc in #9518
fix: Set catalog mode to readwritecreate in spidapter by @peasee in #9519
Upgrade AWS SDK crates & set APN user-agent in AWS SDK credential bridge by @lukekim in #8328
feat(runtime): add runtime ready_state on_registration semantics by @lukekim in #9522
fix: Add spidapter post-setup retries by @peasee in #9526
Make partition discovery more robust and make initialization non-blocking by @sgrebnov in #9499
Make lint-rust-fix support targeted packages and features by @Jeadie in #9511
Handle new Cloud SCP API by @Jeadie in #9532
Refactor and simplify streaming benchmarks by @krinart in #9405
fix: ensure spidapter only increments attempts on failures by @peasee in #9534
feat: Support specifying app resources in spidapter by @peasee in #9536
test(runtime): Spice Cayenne DDL integration test by @lukekim in #9535
fix: Handle schema evolution mismatch errors during data refresh by @lukekim in #9527
fix: resolve clippy lint warnings by @phillipleblanc in #9547
pr-builds --tag for build_and_release.yml by @Jeadie in #9507
Add --output flag to spice login with env/json/keychain modes by @Jeadie in #9541
Don't use 'PartitionedTableScanRewrite' in async distributed query by @Jeadie in #9548
feat(spidapter): add local backend mode with single executor by @phillipleblanc in #9531
support chat template in HF by @Jeadie in #9543
fix(cayenne): stream PK retention deletes and run OOM regression in CI by @phillipleblanc in #9533
cayenne: Staged append writes to prevent partial writes and data loss on stream error by @sgrebnov in #9491
AcceleratedTable::scan use FederatedTable::scan when ClusterRole::Scheduler by @Jeadie in #9550
Upgrade to delta-kernel-rs v0.18.2 by @lukekim in #9528
Run cayenne tests as part of PR CI by @sgrebnov in #9554
Upgrade to DataFusion v52.2.0 by @lukekim in #9419
Remove Snapshot Compaction + Add snapshot existence check by @krinart in #9523
Update dependencies by @lukekim in #9566
fix: Update benchmark snapshots by @app/github-actions in #9565
fix: Compare Cayenne table configuration on startup by @peasee in #9529
Make Refresh::refresh_sql more robust to alterations over time. by @Jeadie in #9549
fix: Update datafusion-table-providers dependency to latest revision by @lukekim in #9574
Unset AWS_ENDPOINT_URL when empty by @krinart in #9575
fix: allow BytesProcessedExec repartitioning for unordered input by @lukekim in #9540
Sanitize DataFusion errors by @lukekim in #9530
Add conditional logging for partition assignments by @Jeadie in #9577
use 'properly early exit on SIGTERM' by @Jeadie in #9573
Update datafusion to 52.2.0 by @phillipleblanc in #9582
Ensure we query one and only one partition per request by @Jeadie in #9416
feat: Add support for Spicepod version v2 by @lukekim in #9583
[SpiceDQ] Improve error messages; Avoid race condition on allocate_initial_partitions. by @Jeadie in #9579
Update ballista dependencies to latest 52.0.0 revision by @lukekim in #9581
Fix Databricks spark_connect mode always disabled by @phillipleblanc in #9586
Support partitioning in Arrow accelerator by @Jeadie in #9571
Fix spice query CLI response deserialization by @phillipleblanc in #9588
fix: Update benchmark snapshots by @app/github-actions in #9584
fix: Share RuntimeEnv across Cayenne read/write/delete paths for targeted list_files_cache invalidation by @sgrebnov in #9589
feat: Add file:// state_location support for async queries scheduler by @phillipleblanc in #9590
Update endgame links by @krinart in #9598

Full Changelog: https://github.com/spiceai/spiceai/compare/v1.11.2...v2.0.0-rc.1

Spice v1.11.1 (Feb 10, 2026)

Tue, 10 Feb 2026 00:00:00 GMT

Announcing the release of Spice v1.11.1! 🛠️

v1.11.1 is a patch release improving Spice Cayenne accelerator reliability and performance, enhancing DynamoDB Streams and HTTP data connectors, and fixing issues in Federated Task History and FlightSQL.

What's New in v1.11.1

Spice Cayenne Accelerator Improvements

This release includes stability and performance fixes for the Spice Cayenne accelerator:

Row-based Deletion Logic: Refactored row-based delete operations to use per-file deletion vectors with RoaringBitmap. Deletion scans now use Vortex-native streaming with filter pushdown and project only row indices, achieving zero data I/O for delete operations.
Constraints & On Conflict: constraints and on_conflict configurations are now automatically inferred from federated table metadata, enabling datasets like DynamoDB to work without explicitly defining primary_key in the Spicepod.
Partitioned Table Deletion: Fixed an issue where DELETE operations on partitioned Cayenne tables failed.
Data Integrity: Fixed two issues with acceleration snapshot handling: protected snapshots are now included in conflict detection keyset scans (preventing duplicate key creation during append refresh), and snapshot cleanup no longer deletes protected snapshots.

Data Connector Improvements

DynamoDB Streams: Added automatic re-bootstrapping when the stream lag exceeds DynamoDB shard retention (24h). Configurable via the new lag_exceeds_shard_retention_behavior parameter with values error (default), ready_before_load, or ready_after_load.
HTTP Connector: HTTP responses now include a response_status column (UInt16). 4xx responses (e.g., 404 Not Found) are treated as valid queryable data and cached normally. 5xx responses are retried with backoff, returned to the user, but excluded from the cache to prevent transient server errors from polluting cached results.

Other Improvements

Reliability: Added retries for SnapshotManager operations and general snapshot reliability improvements.
Reliability: Fixed handling of timestamp precision mismatches in query result caching.
Reliability: Fixed a double projection issue in federated task history queries that caused Schema error: project index out of bounds errors in cluster mode.
Developer Experience: Added cookie middleware support to the FlightSQL data connector.

Contributors

Breaking Changes

No breaking changes.

Cookbook Updates

No major cookbook updates. The Spice Cookbook includes 86 recipes to help you get started with Spice quickly and easily.

Upgrading

To upgrade to v1.11.1, use one of the following methods:

CLI:

spice upgrade

Homebrew:

brew upgrade spiceai/spiceai/spice

Docker:

Pull the spiceai/spiceai:1.11.1 image:

docker pull spiceai/spiceai:1.11.1

For available tags, see DockerHub.

Helm:

helm repo update
helm upgrade spiceai spiceai/spiceai --version 1.11.1

AWS Marketplace:

Spice is available in the AWS Marketplace.

What's Changed

Changelog

Cayenne: row-based delete logic improvements by @sgrebnov in #9237
Proper support for constraints/on_conflict in Cayenne Acceleration by @krinart in #9335
Retries for SnapshotManager by @krinart in #9334
fix(cayenne): Include protected snapshots in conflict detection keyset scan by @sgrebnov in #9176
fix(cayenne): Fix data loss by preserving protected snapshots during cleanup by @sgrebnov in #9182
Simplify retention filter expressions before pushdown by @sgrebnov in #9244
Fix test_retention_complex_sql by @sgrebnov in #9270
runtime: avoid double projection in federated task history by @phillipleblanc in #9326
feat(http): Return all HTTP responses as data, skip caching 5xx by @sgrebnov in #9313
Snapshots Improvements by @krinart in #9318
fix(caching): Handle timestamp precision mismatch and add more tests by @sgrebnov in #9315
DynamoDB Streams Table Rebootstrapping by @krinart in #9305
Fix Cayenne partitioned table deletion support by @sgrebnov in #9267
FlightSQL: add cookie middleware support by @phillipleblanc in #9282
Apply SchemaCastScanExec before applying changes in process_upsert_batch by @krinart in #9297

Spice v1.11.0 (Jan 28, 2026)

Wed, 28 Jan 2026 00:00:00 GMT

Announcing the release of Spice v1.11.0-stable! ⚡

In Spice v1.11.0, Spice Cayenne reaches Beta status with acceleration snapshots, Key-based deletion vectors, and Amazon S3 Express One Zone support. DataFusion has been upgraded to v51 along with Arrow v57.2, and iceberg-rust v0.8.0. v1.11 adds several DynamoDB & DynamoDB Streams improvements such as JSON nesting, and adds significant improvements to Distributed Query with active-active schedulers and mTLS for enterprise-grade high-availability and secure cluster communication.

This release also adds new SMB, NFS, and ScyllaDB Data Connectors (Alpha), Prepared Statements with full SDK support (gospice, spice-rs, spice-dotnet, spice-java, spice.js, and spicepy), Google LLM Support for expanded AI inference capabilities, and significant improvements to caching, observability, and Hash Indexing for Arrow Acceleration.

What's New in v1.11.0

Spice Cayenne Accelerator Reaches Beta

Spice Cayenne has been promoted to Beta status with acceleration snapshots support and numerous performance and stability improvements.

Key Enhancements:

Key-based Deletion Vectors: Improved deletion vector support using key-based lookups for more efficient data management and faster delete operations. Key-based deletion vectors are more memory-efficient than positional vectors for sparse deletions.
S3 Express One Zone Support: Store Cayenne data files in S3 Express One Zone for single-digit millisecond latency, ideal for latency-sensitive query workloads that require persistence.

Improved Reliability:

Resolved FuturesUnordered reentrant drop crashes
Fixed memory growth issues related to Vortex metrics allocation
Metadata catalog now properly respects cayenne_file_path location
Added warnings for unparseable configuration values

For more details, refer to the Cayenne Documentation.

DataFusion v51 Upgrade

Apache DataFusion has been upgraded to v51, bringing significant performance improvements, new SQL features, and enhanced observability.

Performance Improvements:

Faster CASE Expression Evaluation: Expressions now short-circuit earlier, reuse partial results, and avoid unnecessary scattering, speeding up common ETL patterns
Better Defaults for Remote Parquet Reads: DataFusion now fetches the last 512KB of Parquet files by default, typically avoiding 2 I/O requests per file
Faster Parquet Metadata Parsing: Leverages Arrow 57's new thrift metadata parser for up to 4x faster metadata parsing

New SQL Features:

SQL Pipe Operators: Support for |> syntax for inline transforms
DESCRIBE : Returns the schema of any query without executing it
Named Arguments in SQL Functions: PostgreSQL-style param => value syntax for scalar, aggregate, and window functions
Decimal32/Decimal64 Support: New Arrow types supported including aggregations like SUM, AVG, and MIN/MAX

Example pipe operator:

SELECT * FROM t
|> WHERE a > 10
|> ORDER BY b
|> LIMIT 5;

Improved Observability:

Improved EXPLAIN ANALYZE Metrics: New metrics including output_bytes, selectivity for filters, reduction_factor for aggregates, and detailed timing breakdowns

Arrow 57.2 Upgrade

Apache Arrow has been upgraded to v57.2, bringing major performance improvements and new capabilities.

Key Features:

4x Faster Parquet Metadata Parsing: A rewritten thrift metadata parser delivers up to 4x faster metadata parsing, especially beneficial for low-latency use cases and files with large amounts of metadata
Parquet Variant Support: Experimental support for reading and writing the new Parquet Variant type for semi-structured data, including shredded variant values
Parquet Geometry Support: Read and write support for Parquet Geometry types (GEOMETRY and GEOGRAPHY) with GeospatialStatistics
New arrow-avro Crate: Efficient conversion between Apache Avro and Arrow RecordBatches with projection pushdown and vectorized execution support

DynamoDB Connector Enhancements

Added JSON nesting for DynamoDB Streams
Improved batch deletion handling

Distributed Query Improvements

High Availability Clusters: Spice now supports running multiple active schedulers in an active/active configuration for production deployments. This eliminates the scheduler as a single point of failure and enables graceful handling of node failures.

Multiple schedulers run simultaneously, each capable of accepting queries
Schedulers coordinate via a shared S3-compatible object store
Executors discover all schedulers automatically
A load balancer distributes client queries across schedulers

Example HA configuration:

runtime:
  scheduler:
    state_location: s3://my-bucket/spice-cluster
    params:
      region: us-east-1

mTLS Verification: Cluster communication between scheduler and executors now supports mutual TLS verification for enhanced security.

Credential Propagation: S3, ABFS, and GCS credentials are now automatically propagated to executors in cluster mode, enabling access to cloud storage across the distributed query cluster.

Improved Resilience:

Exponential backoff for scheduler disconnection recovery
Increased gRPC message size limit from 16MB to 100MB for large query plans
HTTP health endpoint for cluster executors
Automatic executor role inference when --scheduler-address is provided

For more details, refer to the Distributed Query Documentation.

iceberg-rust v0.8.0 Upgrade

Spice has been upgraded to iceberg-rust v0.8.0, bringing improved Iceberg table support.

Key Features:

V3 Metadata Support: Full support for Iceberg V3 table metadata format
INSERT INTO Partitioned Tables: DataFusion integration now supports inserting data into partitioned Iceberg tables
Improved Delete File Handling: Better support for position and equality delete files, including shared delete file loading and caching
SQL Catalog Updates: Implement update_table and register_table for SQL catalog
S3 Tables Catalog: Implement update_table for S3 Tables catalog
Enhanced Arrow Integration: Convert Arrow schema to Iceberg schema with auto-assigned field IDs, _file column support, and Date32 type support

Acceleration Snapshots

Acceleration snapshots enable point-in-time recovery and data versioning for accelerated datasets. Snapshots capture the state of accelerated data at specific points, allowing for fast bootstrap recovery and rollback capabilities.

Key Features:

Flexible Triggers: Configure when snapshots are created based on time intervals or stream batch counts
Automatic Compaction: Reduce storage overhead by compacting older snapshots (DuckDB only)
Bootstrap Integration: Snapshots can reset cache expiry on load for seamless recovery (DuckDB with Caching refresh mode)
Smart Creation Policies: Only create snapshots when data has actually changed

Example configuration:

datasets:
  - from: s3://my-bucket/data.parquet
    name: my_dataset
    acceleration:
      enabled: true
      engine: cayenne
      mode: file
      snapshots: enabled
      snapshots_trigger: time_interval
      snapshots_trigger_threshold: 1h
      snapshots_creation_policy: on_changed

Snapshots API and CLI: New API endpoints and CLI commands for managing snapshots programmatically.

CLI Commands:

# List all snapshots for a dataset
spice acceleration snapshots taxi_trips

# Get details of a specific snapshot
spice acceleration snapshot taxi_trips 3

# Set the current snapshot for rollback (requires runtime restart)
spice acceleration set-snapshot taxi_trips 2

HTTP API Endpoints:

Method	Endpoint	Description
GET	`/v1/datasets/{dataset}/acceleration/snapshots`	List all snapshots for a dataset
GET	`/v1/datasets/{dataset}/acceleration/snapshots/{id}`	Get details of a specific snapshot
POST	`/v1/datasets/{dataset}/acceleration/snapshots/current`	Set the current snapshot for rollback

For more details, refer to the Acceleration Snapshots Documentation.

Caching Acceleration Mode Improvements

The Caching Acceleration Mode introduced in v1.10.0 has received significant performance optimizations and reliability fixes in this release.

Performance Optimizations:

Non-blocking Cache Writes: Cache misses no longer block query responses. Data is written to the cache asynchronously after the query returns, reducing query latency for cache miss scenarios.
Batch Cache Writes: Multiple cache entries are now written in batches rather than individually, significantly improving write throughput for high-volume cache operations.

Reliability Fixes:

Correct SWR Refresh Behavior: The stale-while-revalidate (SWR) pattern now correctly refreshes only the specific entries that were accessed instead of refreshing all stale rows in the dataset. This prevents unnecessary source queries and reduces load on upstream data sources.
Deduplicated Refresh Requests: Fixed an issue where JSON array responses could trigger multiple redundant refresh operations. Refresh requests are now properly deduplicated.
Fixed Cache Hit Detection: Resolved an issue where queries that didn't include fetched_at in their projection would always result in cache misses, even when cached data was available.
Unfiltered Query Optimization: SELECT * queries without filters now return cached data directly without unnecessary filtering overhead.

For more details, refer to the Caching Acceleration Mode Documentation.

Prepared Statements

Improved Query Performance and Security: Spice now supports prepared statements, enabling parameterized queries that improve both performance through query plan caching and security by preventing SQL injection attacks.

Key Features:

Query Plan Caching: Prepared statements cache query plans, reducing planning overhead for repeated queries
SQL Injection Prevention: Parameters are safely bound, preventing SQL injection vulnerabilities
Arrow Flight SQL Support: Full prepared statement support via Arrow Flight SQL protocol

SDK Support:

SDK	Support	Min Version	Method
gospice (Go)	✅ Full	v8.0.0+	`SqlWithParams()` with typed constructors (`Int32Param`, `StringParam`, `TimestampParam`, etc.)
spice-rs (Rust)	✅ Full	v3.0.0+	`query_with_params()` with `RecordBatch` parameters
spice-dotnet (.NET)	✅ Full	v0.3.0+	`QueryWithParams()` with typed parameter builders
spice-java (Java)	✅ Full	v0.5.0+	`queryWithParams()` with typed `Param` constructors (`Param.int64()`, `Param.string()`, etc.)
spice.js (JavaScript)	✅ Full	v3.1.0+	`query()` with parameterized query support
spicepy (Python)	✅ Full	v3.1.0+	`query()` with parameterized query support

Example (Go):

import "github.com/spiceai/gospice/v8"

client, _ := spice.NewClient()
defer client.Close()

// Parameterized query with typed parameters
results, _ := client.SqlWithParams(ctx,
    "SELECT * FROM products WHERE price > $1 AND category = $2",
    spice.Float64Param(10.0),
    spice.StringParam("electronics"),
)

Example (Java):

import ai.spice.SpiceClient;
import ai.spice.Param;
import org.apache.arrow.adbc.core.ArrowReader;

try (SpiceClient client = new SpiceClient()) {
    // With automatic type inference
    ArrowReader reader = client.queryWithParams(
        "SELECT * FROM products WHERE price > $1 AND category = $2",
        10.0, "electronics");

    // With explicit typed parameters
    ArrowReader reader = client.queryWithParams(
        "SELECT * FROM products WHERE price > $1 AND category = $2",
        Param.float64(10.0),
        Param.string("electronics"));
}

For more details, refer to the Parameterized Queries Documentation.

Spice Java SDK v0.5.0

Parameterized Query Support for Java: The Spice Java SDK v0.5.0 introduces parameterized queries using ADBC (Arrow Database Connectivity), providing a safer and more efficient way to execute queries with dynamic parameters.

Key Features:

SQL Injection Prevention: Parameters are safely bound, preventing SQL injection vulnerabilities
Automatic Type Inference: Java types are automatically mapped to Arrow types (e.g., double → Float64, String → Utf8)
Explicit Type Control: Use the new Param class with typed factory methods (Param.int64(), Param.string(), Param.decimal128(), etc.) for precise control over Arrow types
Updated Dependencies: Apache Arrow Flight SQL upgraded to 18.3.0, plus new ADBC driver support

Example:

import ai.spice.SpiceClient;
import ai.spice.Param;

try (SpiceClient client = new SpiceClient()) {
    // With automatic type inference
    ArrowReader reader = client.queryWithParams(
        "SELECT * FROM taxi_trips WHERE trip_distance > $1 LIMIT 10",
        5.0);

    // With explicit typed parameters for precise control
    ArrowReader reader = client.queryWithParams(
        "SELECT * FROM orders WHERE order_id = $1 AND amount >= $2",
        Param.int64(12345),
        Param.decimal128(new BigDecimal("99.99"), 10, 2));
}

Maven:

<dependency>
  <groupId>ai.spicegroupId>
  <artifactId>spiceaiartifactId>
  <version>0.5.0version>
dependency>

For more details, refer to the Spice Java SDK Repository.

Google LLM Support

Expanded AI Provider Support: Spice now supports Google embedding and chat models via the Google AI provider, expanding the available LLM options for AI inference workloads alongside existing providers like OpenAI, Anthropic, and AWS Bedrock.

Key Features:

Google Chat Models: Access Google's Gemini models for chat completions
Google Embeddings: Generate embeddings using Google's text embedding models
Unified API: Use the same OpenAI-compatible API endpoints for all LLM providers

Example spicepod.yaml configuration:

models:
  - from: google:gemini-2.0-flash
    name: gemini
    params:
      google_api_key: ${secrets:GOOGLE_API_KEY}

embeddings:
  - from: google:text-embedding-004
    name: google_embeddings
    params:
      google_api_key: ${secrets:GOOGLE_API_KEY}

For more details, refer to the Google LLM Documentation (see docs PR #1286).

URL Tables

Query data sources directly via URL in SQL without prior dataset registration. Supports S3, Azure Blob Storage, and HTTP/HTTPS URLs with automatic format detection and partition inference.

Supported Patterns:

Single files: SELECT * FROM 's3://bucket/data.parquet'
Directories/prefixes: SELECT * FROM 's3://bucket/data/'
Glob patterns: SELECT * FROM 's3://bucket/year=*/month=*/data.parquet'

Key Features:

Automatic file format detection (Parquet, CSV, JSON, etc.)
Hive-style partition inference with filter pushdown
Schema inference from files
Works with both SQL and DataFrame APIs

Example with hive partitioning:

-- Partitions are automatically inferred from paths
SELECT * FROM 's3://bucket/data/' WHERE year = '2024' AND month = '01'

Enable via spicepod.yml:

runtime:
  params:
    url_tables: enabled

Cluster Mode Async Query APIs (experimental)

New asynchronous query APIs for long-running queries in cluster mode:

/v1/queries endpoint: Submit queries and retrieve results asynchronously

OpenTelemetry Improvements

Unified Telemetry Endpoint: OTel metrics ingestion has been consolidated to the Flight port (50051), simplifying deployment by removing the separate OTel port (50052). The push-based metrics exporter continues to support integration with OpenTelemetry collectors.

Note: This is a breaking change. Update your configurations if you were using the dedicated OTel port 50052. Internal cluster communication now uses port 50052 exclusively.

Observability Improvements

Enhanced Dashboards: Updated Grafana and Datadog example dashboards with:

Snapshot monitoring widgets
Improved accelerated datasets section
Renamed ingestion lag charts for clarity

Additional Histogram Buckets: Added more buckets to histogram metrics for better latency distribution visibility.

For more details, refer to the Monitoring Documentation.

Hash Indexing for Arrow Acceleration (experimental)

Arrow-based accelerations now support hash indexing for faster point lookups on equality predicates. Hash indexes provide O(1) average-case lookup performance for columns with high cardinality.

Features:

Primary key hash index support
Secondary index support for non-primary key columns
Composite key support with proper null value handling

Example configuration:

datasets:
  - from: postgres:users
    name: users
    acceleration:
      enabled: true
      engine: arrow
      primary_key: user_id
      indexes:
        '(tenant_id, user_id)': unique  # Composite hash index

For more details, refer to the Hash Index Documentation.

SMB and NFS Data Connectors

Network-Attached Storage Connectors: New data connectors for SMB (Server Message Block) and NFS (Network File System) protocols enable direct federated queries against network-attached storage without requiring data movement to cloud object stores.

Key Features:

SMB Protocol Support: Connect to Windows file shares and Samba servers with authentication support
NFS Protocol Support: Connect to Unix/Linux NFS exports for direct data access
Federated Queries: Query Parquet, CSV, JSON, and other file formats directly from network storage with full SQL support
Acceleration Support: Accelerate data from SMB/NFS sources using DuckDB, Spice Cayenne, or other accelerators

Example spicepod.yaml configuration:

datasets:
  # SMB share
  - from: smb://fileserver/share/data.parquet
    name: smb_data
    params:
      smb_username: ${secrets:SMB_USER}
      smb_password: ${secrets:SMB_PASS}

  # NFS export
  - from: nfs://nfsserver/export/data.parquet
    name: nfs_data

For more details, refer to the Data Connectors Documentation.

ScyllaDB Data Connector

A new data connector for ScyllaDB, the high-performance NoSQL database compatible with Apache Cassandra. Query ScyllaDB tables directly or accelerate them for faster analytics.

Example configuration:

datasets:
  - from: scylladb:my_keyspace.my_table
    name: scylla_data
    acceleration:
      enabled: true
      engine: duckdb

For more details, refer to the ScyllaDB Data Connector Documentation.

Flight SQL TLS Connection Fixes

TLS Connection Support: Fixed TLS connection issues when using grpc+tls:// scheme with Flight SQL endpoints. Added support for custom CA certificate files via the new flightsql_tls_ca_certificate_file parameter.

Developer Experience Improvements

Turso v0.3.2 Upgrade: Upgraded Turso accelerator for improved performance and reliability
Rust 1.91 Upgrade: Updated to Rust 1.91 for latest language features and performance improvements
Spice Cloud CLI: Added spice cloud CLI commands for cloud deployment management
Improved Spicepod Schema: Improved JSON schema generation for better IDE support and validation
Acceleration Snapshots: Added configurable snapshots_create_interval for periodic acceleration snapshots independent of refresh cycles
Tiered Caching with Localpod: The Localpod connector now supports caching refresh mode, enabling multi-layer acceleration where a persistent cache feeds a fast in-memory cache
GitHub Data Connector: Added workflows and workflow runs support for GitHub repositories
NDJSON/LDJSON Support: Added support for Newline Delimited JSON and Line Delimited JSON file formats

Additional Improvements & Bug Fixes

Model Listing: New functionality to list available models across multiple AI providers
DuckDB Partitioned Tables: Primary key constraints now supported in partitioned DuckDB table mode
Post-refresh Sorting: New on_refresh_sort_columns parameter for DuckDB enables data ordering after writes
Improved Install Scripts: Removed jq dependency and improved cross-platform compatibility
Better Error Messages: Improved error messaging for bucket UDF arguments and deprecated OpenAI parameters
Reliability: Fixed DynamoDB IAM role authentication with new dynamodb_auth: iam_role parameter
Reliability: Fixed cluster executors to use scheduler's temp_directory parameter for shuffle files
Reliability: Initialize secrets before object stores in cluster executor mode
Reliability: Added page-level retry with backoff for transient GitHub GraphQL errors
Performance: Improved statistics for rewritten DistributeFileScanOptimizer plans
Developer Experience: Added max_message_size configuration for Flight service

Contributors

Breaking Changes

OTel Ingestion Port Change

OTel ingestion has been moved to the Flight port (50051), removing the separate OTel port 50052. Port 50052 is now used exclusively for internal cluster communication. Update your configurations if you were using the dedicated OTel port.

Distributed Query Cluster Mode Requires mTLS

Distributed query cluster mode now requires mTLS for secure communication between cluster nodes. This is a security enhancement to prevent unauthorized nodes from joining the cluster and accessing secrets.

Migration Steps:

Generate certificates using spice cluster tls init and spice cluster tls add
Update scheduler and executor startup commands with --node-mtls-* arguments
For development/testing, use --allow-insecure-connections to opt out of mTLS

Renamed CLI Arguments:

Old Name	New Name
`--cluster-mode`	`--role`
`--cluster-ca-certificate-file`	`--node-mtls-ca-certificate-file`
`--cluster-certificate-file`	`--node-mtls-certificate-file`
`--cluster-key-file`	`--node-mtls-key-file`
`--cluster-address`	`--node-bind-address`
`--cluster-advertise-address`	`--node-advertise-address`
`--cluster-scheduler-url`	`--scheduler-address`

Removed CLI Arguments:

--cluster-api-key: Replaced by mTLS authentication

Cookbook Updates

New ScyllaDB Data Connector Recipe: New recipe demonstrating how to use the ScyllaDB Data Connector. See ScyllaDB Data Connector Recipe for details.

New SMB Data Connector Recipe: New recipe demonstrating how to use the SMB Data Connector. See SMB Data Connector Recipe for details.

The Spice Cookbook includes 86 recipes to help you get started with Spice quickly and easily.

Upgrading

To upgrade to v1.11.0, use one of the following methods:

CLI:

spice upgrade

Homebrew:

brew upgrade spiceai/spiceai/spice

Docker:

Pull the spiceai/spiceai:1.11.0 image:

docker pull spiceai/spiceai:1.11.0

For available tags, see DockerHub.

Helm:

helm repo update
helm upgrade spiceai spiceai/spiceai --version 1.11.0

AWS Marketplace:

Spice is available in the AWS Marketplace.

Dependencies

DataFusion: Upgraded to v51 (release notes)
Arrow: Upgraded to v57.2 (release notes)
iceberg-rust: Upgraded to v0.8.0 (release notes)

What's Changed

Changelog

OTel exporter for push metrics by @lukekim in #8442
fix: Update benchmark snapshots by @app/github-actions in #8448
Add TPCH append tests to scheduled dispatch workflow by @sgrebnov in #8451
Add snapshot creation logging by @krinart in #8469
Fix PeriodicReader panic by @krinart in #8471
Benchmarks: increase readiness timeout for turso acceleration (TPC-H) by @sgrebnov in #8470
fix: Pin CUDA build actions to commits by @peasee in #8477
Add Criterion benchmarking to chunking crate. by @Jeadie in #8431
DuckDB agg pushdown: gate behind accelerator parameter by @mach-kernel in #8474
Rename aggregate_pushdown_optimization -> optimizer_duckdb_aggregate_pushdown by @ewgenius in #8485
Handle throttling exception for DynamoDB streams by @phillipleblanc in #8492
docs: Add release notes by @peasee in #8478
Update spicepod.schema.json by @app/github-actions in #8496
Move 'test_projection_pushdown' to runtime-datafusion by @Jeadie in #8490
Fix OTEL metrics HTTP exporter client setup by @phillipleblanc in #8489
Update endgame to include new caching accelerator cookbook by @phillipleblanc in #8487
DynamoDB tests and fixes by @lukekim in #8491
Align make lint-rust-fix with make lint-rust by @Jeadie in #8499
fix: Remove unused Cayenne parameters by @peasee in #8500
Force task history captured_plan outputs to be captured even if they would be filtered out otherwise by @phillipleblanc in #8501
release: post-release updates by @peasee in #8503
CI: Fix E2E models dispatch by @mach-kernel in #8505
Use an isolated Tokio runtime for refresh tasks that is separate from the main query API by @phillipleblanc in #8504
Update openapi.json by @app/github-actions in #8512
Update dependencies by @phillipleblanc in #8513
fix: Avoid double hashing cache key by @peasee in #8511
fix: Eagerly drop cached records for results larger than max by @peasee in #8516
feat: Support vortex zstd compressor by @peasee in #8515
warning if column is defined in spicepod but is non-existant by @Jeadie in #8498
Return summarized spicepods from /v1/spicepods by @phillipleblanc in #8404
Fix for idle DynamoDB Stream by @krinart in #8506
Use Datafusion::Plan over Datafusion::Internal for user-facing search errors. by @Jeadie in #8484
DDB Streams Integration Test + Memory Acceleration + Improved Warning by @krinart in #8520
Upgrade to gospice v8 by @lukekim in #8524
Vortex file format for object store by @Jeadie in #8525
docs: Add missing cookbooks to endgame, focus area section by @peasee in #8527
ListingTableConnector: Drop partition columns that reoccur in file schema by @mach-kernel in #8519
fix(cluster): initialize secrets before object stores in executor by @sgrebnov in #8532
Use separate Tokio runtime for SWR refreshes by @phillipleblanc in #8530
fix: SQL Results Cache SWR triggers incorrect cache miss metric by @phillipleblanc in #8529
feat: testoperator: OTLP streaming metrics / connect to existing instance / infinite mode / query timeout by @phillipleblanc in #8537
Update openapi.json by @app/github-actions in #8518
Add better attributes for search testing by @Jeadie in #8531
fix: Improve Cayenne errors, ID selection for table/partition creation by @peasee in #8523
Percent-encode Kubernetes secret name path segment by @phillipleblanc in #8522
Initial parameterisation of Search integration tests by @Jeadie in #8066
fix: Add warning when multiple partitions are defined for the same table by @peasee in #8540
Add DuckDB file-mode support for search test parameterization. by @Jeadie in #8541
fix: Add recursion depth limits to prevent DoS via deeply nested data (DynamoDB + S3 Vectors) by @phillipleblanc in #8544
Remove the clippy::too_many_lines lint by @phillipleblanc in #8549
feat: Add spice cluster tls commands by @phillipleblanc in #8550
Move OTel ingestion to Flight port, remove separate OTel port 50052 by @phillipleblanc in #8551
Move verbose tool init messages to trace by @phillipleblanc in #8552
Add SANs to spice cluster tls add certificates by @phillipleblanc in #8554
Add cpu, gpu, and memory to telemetry by @lukekim in #8483
feat: Add workflows and workflow runs to GitHub Data Connector by @peasee in #8548
Add S3Vectors option for paramterised search tests by @Jeadie in #8555
Distributed query: TLS + API key by @mach-kernel in #8468
Refactor RRF SQL to use LogicalPlanBuilder by @Jeadie in #7968
Require mTLS for distributed query cluster mode by @phillipleblanc in #8580
Fix stats for rewritten DistributeFileScanOptimizer plans by @mach-kernel in #8581
Bump actions/cache from 4.3.0 to 5.0.1 by @app/dependabot in #8573
Show user-friendly error on empty DDB table by @krinart in #8586
Add (Deprecated) labels to deprecated spice sql params by @krinart in #8588
Fix kafka warning when security.protocol is set to PLAINTEXT by @krinart in #8587
Upgrade dependencies by @phillipleblanc in #8593
Release notes for v1.10.1 by @Jeadie in #8568
Run search benchmarks twice a week. by @Jeadie in #8592
Add cayenne data accelerator by @Jeadie in #8553
SQL allowlist for tools: sql, list_datasets, search, table_schema by @Jeadie in #8449
use rstest for llms integration tests by @Jeadie in #8566
Post v1.10.1 housekeeping by @Jeadie in #8600
Add checklist for SDK publication in end_game.md by @Jeadie in #8602
Fix IMAGE_TAG assignment for Docker compatibility by @Jeadie in #8599
Modify cluster arguments to spiced for UX review by @phillipleblanc in #8603
Update QA analytics with new release data by @Jeadie in #8601
Remove 'tract-core' dependency. by @Jeadie in #8605
Google embedding and chat models. by @Jeadie in #8423
Fix test_github_workflows integration test by @sgrebnov in #8607
Update openapi.json by @app/github-actions in #8604
ci: Upload artifacts to MinIO eagerly after each build step by @phillipleblanc in #8615
fix: SQLite accelerator decimal/date handling by @phillipleblanc in #8606
Configure mTLS for executor-to-executor gRPC connections by @sgrebnov in #8617
feat: Enable localpod with caching mode accelerator for tiered caching by @phillipleblanc in #8621
Add Cayenne S3 Express One Zone support for data files by @lukekim in #8502
Add snapshot interval for acceleration snapshots by @phillipleblanc in #8627
Add dataset_load_parallelism parameter to spicepod.yml by @peasee in #8630
Json Nesting for DynamoDB by @krinart in #8623
Restore deprecated open-telemetry flag in spiced by @phillipleblanc in #8629
Implement batching for Kafka/Debezium + null Decimal handling by @krinart in #8622
fix: Status field in /v1/datasets & /v1/models by @lukekim in #8633
Add Spice test operator improvements by @sgrebnov in #8625
Add v1.10.2 release notes by @sgrebnov in #8640
Align object-store vortex with runtime feature flagging by @Jeadie in #8620
Extended LLM & search tests on cron by @Jeadie in #8624
Test-operator: emit main metrics as part of load tests by @sgrebnov in #8639
Build a local docker image from an existing Spice binary by @phillipleblanc in #8619
fix: Use runtime-rate-control for GitHub Data Connector by @peasee in #8638
Upgrade dependencies by @phillipleblanc in #8655
Bump headers-accept from 0.1.4 to 0.3.0 by @app/dependabot in #8644
Update openapi.json by @app/github-actions in #8637
Update SECURITY.md - Include v1.10.2 by @sgrebnov in #8661
Serialize acceleration snapshots with refresh writes by @phillipleblanc in #8652
Update AI Installation test to use minilm_l6_v2 by @sgrebnov in #8659
Fixes for search integration test CI by @Jeadie in #8656
fix: Use a GitHub rate controller per auth context by @peasee in #8662
fix: Update Search integration test snapshots by @app/github-actions in #8654
Make E2E Test Release Installation (AI, Local HF model) test more robust by @sgrebnov in #8666
Fix issue with location predicate for custom S3 endpoints + regression integration test by @phillipleblanc in #8668
fix: Validate schema match before projection pushdown in UnionProjectionPushdownOptimizer by @phillipleblanc in #8669
Proper batch commit for kafka/debezium by @krinart in #8671
Improve spicepod json schema generation by @ewgenius in #8547
Start the anonymous telemetry exporter asynchronously by @phillipleblanc in #8679
fix: Move enforce-pulls to hosted runner by @phillipleblanc in #8686
Update QA analytics with 1.10.2 release data by @sgrebnov in #8667
fix: Azure does not support suffix range requests by @phillipleblanc in #8685
Remove spicepod-validator cargo build from build-dev target by @Jeadie in #8684
fix: Update test snapshots by @app/github-actions in #8680
fix: Update Search integration test snapshots by @app/github-actions in #8681
SMB and NFS Data Connectors by @lukekim in #8674
Upgrade to openai-async v0.32 by @lukekim in #8635
v1.10.3 release notes by @phillipleblanc in #8693
Upgrade dependencies by @phillipleblanc in #8704
fix: Support NDJSON and LDJSON by @lukekim in #8649
move OpenAI overrides to non-prefixed by @Jeadie in #8678
Update Google LLM param: google_dimensions -> dimensions by @Jeadie in #8677
Make cluster mTLS optional with insecure flag by @phillipleblanc in #8703
Revert "fix: Move enforce-pulls to hosted runner (#8686)" by @phillipleblanc in #8709
Initial 'testoperator run text-to-sql' by @Jeadie in #8618
Add support for abfss by @krinart in #8706
Add testoperator TPCH dispatch for ABFS with hierarchical namespace disabled + versioning enabled by @phillipleblanc in #8711
Update openapi.json by @app/github-actions in #8692
cluster: validate --role argument by @phillipleblanc in #8717
Upgrade to Turso v0.3.2 by @lukekim in #8716
Rename --insecure to --allow-insecure-connections to be consistent with existing naming by @lukekim in #8720
Remove 'testoperator run http-consistency/http-overhead' by @Jeadie in #8708
refactor: Remove cluster feature flag by @phillipleblanc in #8718
Docs: Distributed query ADR by @mach-kernel in #8608
Use model.datasets to allowlist on tools by @Jeadie in #8714
cluster: quality of life improvements to starting cluster mode locally by @phillipleblanc in #8719
Docs: Ballista extension ADR by @mach-kernel in #8616
Improve deprecation messages when going from prefixed -> non-prefixed. by @Jeadie in #8724
Remove tools from auto-defaults by @Jeadie in #8725
Make distinct providers for vector spilling, vector partitioning. by @Jeadie in #8546
cluster: default scheduler address port by @phillipleblanc in #8728
Add Makefile targets for testoperator by @Jeadie in #8729
text-to-sql dispatch in testoperator by @Jeadie in #8705
DR-006: High Availability Distributed Query with Stateless Schedulers by @lukekim in #8721
DR-007: mTLS for Distributed Query Cluster Communication by @lukekim in #8722
SMB and NFS improvements by @lukekim in #8710
fix: Cluster executors use scheduler's temp_directory for shuffle files by @phillipleblanc in #8733
use 'max_message_size' in flight service too by @Jeadie in #8730
Add page-level retry for transient GraphQL errors with backoff and increase GitHub rate limit buffer up to 100 by @ewgenius in #8726
Make testoperator Dockerfile; CI to build docker image to ghcr.io. by @Jeadie in #8732
cluster: UnionProjectionPushdownOptimizer: Add projection pushdown diagnostics for union children by @phillipleblanc in #8734
Fix column projection order mismatch with location metadata columns by @phillipleblanc in #8738
Fixes for testoperator. by @Jeadie in #8737
Improve Cayenne Deletion Vectors with KeyBased support by @lukekim in #8713
Fix testoperator_dispatch.yaml by @Jeadie in #8740
Add spice cloud CLI commands by @lukekim in #8528
Add FTP, NFS, & SMB TPCH SF1 spicepods by @lukekim in #8739
Prepared Statements by @lukekim in #7588
Schedule dispatch of testoperator run text-to-sql. by @Jeadie in #8745
Fix minio for ai benchmark CI by @Jeadie in #8743
Upgrade to Rust 1.91 by @phillipleblanc in #8749
fix: Update benchmark snapshots by @app/github-actions in #8763
Benchmarks: make row count validation skip logic configurable by scale factor, query set, and overrides by @sgrebnov in #8756
Make benchmark tests more robust by @sgrebnov in #8766
Add parameter to force using iam_role for DynamoDB by @krinart in #8767
fix: Update Search integration test snapshots by @app/github-actions in #8735
v1.10.4 release notes by @phillipleblanc in #8790
Trace metrics export errors by @sgrebnov in #8791
v1.10.4 SECURITY.md update by @phillipleblanc in #8800
Add timezone database to Docker image to fix Cayenne acceleration panic by @sgrebnov in #8799
Upgrade dependencies by @phillipleblanc in #8801
Fix table_allowlist for table sampling and NSQL by @Jeadie in #8789
Cayenne primary key on-conflict handling by @lukekim in #8788
fix: Update benchmark snapshots by @app/github-actions in #8773
fix: correctly identify deprecated openai_* parameters by @phillipleblanc in #8809
fix: Update benchmark snapshots by @app/github-actions in #8812
Use workspace version for cayenne crate by @phillipleblanc in #8811
Don't CAST strings which breaks push down optimizer by @lukekim in #8810
fix: Update benchmark snapshots by @app/github-actions in #8815
Update async-openai to latest revision 4dcd633aad6f - brings fix for openai compatible model providers by @ewgenius in #8816
Add auth/iam_role_source to DynamoDB connector by @krinart in #8808
DynamoDB fixes: JSON nesting for Streams, proper batch deletions by @krinart in #8821
Rough roadmap for 2026-2027 by @lukekim in #8805
Release notes for v1.11.0-rc1 by @ewgenius in #8786
Make S3V integration tests prepare_for_aws_tests more robust by @sgrebnov in #8820
Bump rsa from 0.9.9 to 0.9.10 in the cargo group across 1 directory by @app/dependabot in #8819
Add timezone database to Release and CUDA Docker images to fix Cayene panic by @sgrebnov in #8832
fix: UnionProjectionPushdownOptimizer - Schema change during transform_down breaks parent nodes by @phillipleblanc in #8831
Update grafana/datadog example dashboards by @krinart in #8833
Add Dev bird bench as text-to-sql queryset in CI. by @Jeadie in #8753
Update testoperator scheduler to use release/1.11 branch by @ewgenius in #8829
Spice Cayenne fixes and test spicepods for Beta & RC by @lukekim in #8787
testoperator dispatch all bird-bench database variants by @Jeadie in #8835
feat: Improve column statistics handling with safe access and defaults by @phillipleblanc in #8836
cluster: mTLS verification by @phillipleblanc in #8837
fix: 8770: Unsupported ScalarFunctionExpr in ORDER BY by @lukekim in #8838
Workflow tweaks by @lukekim in #8845
Cayenne: metadata catalog should respect cayenne_file_path location by @sgrebnov in #8844
Expand Cayenne feature coverage by @lukekim in #8848
docs: HA distributed query decisions by @phillipleblanc in #8817
fix(optimizer): Fix correctness issues in UnionProjectionPushdownOptimizer by @phillipleblanc in #8851
Pin reqwest to 0.12.24 to fix HuggingFace embedding model download by @ewgenius in #8853
Fix builds and pin to Ubuntu 22.04 by @lukekim in #8856
Revert "Fix builds and pin to Ubuntu 22.04" by @lukekim in #8861
Ensure setup Rust is run by @lukekim in #8862
fix: Ubuntu 24.04+ renamed libaio1 to libaio1t64 by @lukekim in #8865
Upgrade to Pulls with Spice v2 by @lukekim in #8866
Add limit and configuration name to 'testoperator run text-to-sql' by @Jeadie in #8839
PR check and test optimization by @lukekim in #8868
Upgrade S3 Vectors SDK and improve test robustness by @lukekim in #8867
[Testoperator] Query level and improved aggregate level for NSQL by @Jeadie in #8840
Add docker build for private branches for ghcr.io/spiceai/spiceai-dev by @phillipleblanc in #8873
Expand the data acceleration round-trip test coverage by @lukekim in #8855
fix: Provide a better error for improper bucket UDF arguments by @peasee in #8849
ScyllaDB Data Connector by @lukekim in #8827
Use tokio-rusqlite for Spice Cayenne SQLite by @lukekim in #8857
Cayenne: fix FuturesUnordered reentrant drop crash by @sgrebnov in #8863
Bump github/codeql-action from 4.31.9 to 4.31.10 by @app/dependabot in #8884
Bump golang.org/x/sys from 0.39.0 to 0.40.0 by @app/dependabot in #8881
Bump github.com/spiceai/gospice/v8 from 8.0.0 to 8.0.1 by @app/dependabot in #8883
Bump roaring from 0.11.2 to 0.11.3 by @app/dependabot in #8885
Bump golang.org/x/mod from 0.31.0 to 0.32.0 by @app/dependabot in #8882
Bump aws-sdk-s3 from 1.115.0 to 1.119.0 by @app/dependabot in #8887
Bump libc from 0.2.177 to 0.2.180 by @app/dependabot in #8886
Bump tokio-util from 0.7.17 to 0.7.18 by @app/dependabot in #8889
Bump governor from 0.10.2 to 0.10.4 by @app/dependabot in #8888
fix: flaky test test_concurrent_partition_creation by @phillipleblanc in #8898
Update Cayenne snapshots for TPC-DS by @lukekim in #8890
Add more buckets to histogram metrics by @krinart in #8850
feat: Add HTTP health endpoint for cluster executors by @phillipleblanc in #8899
feat: Implement model listing functionality for multiple providers by @lukekim in #8901
feat: Initial HA schedulers distributed query implementation by @phillipleblanc in #8852
fix: infer executor role from --scheduler-address when --role is omitted by @phillipleblanc in #8903
Improve install scripts and remove jq dependency by @lukekim in #8847
Benchmarks: sort PartitionedUnionExec children for deterministic snapshot comparison by @sgrebnov in #8877
Cayenne: share VortexFileCache across partitions via CayenneContext by @sgrebnov in #8880
Update ballista to add exponential backoff for scheduler disconnection by @phillipleblanc in #8905
Configurably add BirdBench evidence to testoperator text-to-SQL. by @Jeadie in #8904
Helm: Allow command override via values.yaml by @sgrebnov in #8906
Fix distributed query gRPC message size limit (16MB -> 100MB) by @phillipleblanc in #8900
OS specific setup actions by @lukekim in #8909
Cayenne should warn if unable to parse configuration value by @sgrebnov in #8907
Add snapshots widgets to example dashboard by @krinart in #8910
Add quality criteria for the features by @krinart in #8897
Improve Accelerated Datasets section for Grafana/Datadog dashboards by @krinart in #8915
Use HTTP traceparent in NSQL to support concurrency in 'testoperator run text-to-SQL' by @Jeadie in #8912
Remove setup for cc from integration_models.yml by @Jeadie in #8917
Propagate Azure and GCS credentials to executors in cluster mode by @phillipleblanc in #8918
Cayenne: fix memory growth due to vortex metrics allocation by @sgrebnov in #8908
fix(caching): Deduplicate refresh requests for JSON array responses by @sgrebnov in #8921
fix(caching): Return cached data directly for unfiltered queries (SELECT *) by @sgrebnov in #8919
Correct MinIO path syntax for spiced download by @Jeadie in #8916
Acceleration snapshots compaction + Improved Snapshots UX by @krinart in #8858
Change base image from bookworm-slim to trixie-slim by @Jeadie in #8923
Add testoperator run text-to-sql metrics from LogicalPlan by @Jeadie in #8895
Fix spicepod dependencies in testoperator by @Jeadie in #8875
Update copilot instructions for data correctness by @lukekim in #8922
Add BootstrapStatus + Snapshot bootstrapping parallelization by @krinart in #8926
fix: add missing feature-gate for AWS Secrets Manager error variant by @phillipleblanc in #8928
refactor: make ConnectorParams fields public for external connectors by @phillipleblanc in #8929
fix(caching): SWR refreshes only accessed entry instead of all stale rows by @sgrebnov in #8931
Cayenne: include cayenne_metadata_dir to known params by @sgrebnov in #8933
Rename Ingestion Lag chart in example dashboards by @krinart in #8932
fix(caching): Fix HTTP caching always MISS when projection excludes fetched_at by @sgrebnov in #8930
Reset expiry after snapshot bootstraping for Caching by @krinart in #8925
Set use_ssl=false for sccache by @lukekim in #8945
Hash indexing for Arrow Acceleration by @lukekim in #8924
[Cayenne] Acceleration snapshots support by @lukekim in #7973
perf(caching): Non-blocking cache writes on cache miss by @sgrebnov in #8948
Update NSQL models by @lukekim in #8951
Hash Index Key verification by @lukekim in #8949
Add snapshots_creation_policy param by @krinart in #8954
Remove candle & cudarc from non-models build by @lukekim in #8955
Acceleration Snapshots API and CLI by @lukekim in #8934
Ignore test for data_components arrow::indexed::test_primary_key_value_matches_batch by @Jeadie in #8962
fix: Update benchmark snapshots by @app/github-actions in #8965
Hash Index secondary index support by @lukekim in #8958
fix: Support primary key constraints in partitioned DuckDB tables mode by @sgrebnov in #8966
perf(caching): Batch cache writes by @sgrebnov in #8959
CI perf optimizations by @lukekim in #8968
Fix Makefile linting by @Jeadie in #8970
Fixes in testoperator run text-to-sql. by @Jeadie in #8927
implement Chat::as_sql for xAI anthropic by @Jeadie in #8957
Fix duckdb_file_path in search integration test by @Jeadie in #8972
fix: Update benchmark snapshots by @app/github-actions in #8971
Maintenance updates to Anthropic API by @Jeadie in #8956
Add CacheBackend Trait, implement pingora-lru, and add throughput tests by @lukekim in #8080
fix: Update benchmark snapshots by @app/github-actions in #8974
fix: Update benchmark snapshots by @app/github-actions in #8975
Make accelerator shutdown more robust by @lukekim in #8969
feat(duckdb): Add on_refresh_sort_columns for post-write data ordering (initial version) by @sgrebnov in #8964
Proper handling for initial snapshot by @krinart in #8911
fix: Remove --no-default-features from cargo-hack command in features workflow by @phillipleblanc in #8977
build(deps): bump actions/cache from 5.0.1 to 5.0.2 by @app/dependabot in #8983
build(deps): bump actions/checkout from 4 to 6 by @app/dependabot in #8982
build(deps): bump actions/setup-go from 6.1.0 to 6.2.0 by @app/dependabot in #8984
build(deps): bump github.com/olekukonko/tablewriter from 1.1.2 to 1.1.3 by @app/dependabot in #8979
build(deps): bump github.com/klauspost/compress from 1.18.2 to 1.18.3 by @app/dependabot in #8980
Add /v1/queries and Arrow Flight async APIs by @lukekim in #8946
build(deps): bump Vampire/setup-wsl from 5 to 6 by @app/dependabot in #8981
fix: Update Search integration test snapshots by @app/github-actions in #8973
build(deps): bump insta from 1.46.0 to 1.46.1 by @app/dependabot in #8988
build(deps): bump schemars from 1.1.0 to 1.2.0 by @app/dependabot in #8985
fix: Update benchmark snapshots by @app/github-actions in #8978
fix: Data correctness edge cases by @lukekim in #8953
Correct MinIO path syntax for spiced download (Part 2) by @Jeadie in #8995
Make .spice/data in search integration tests by @Jeadie in #8992
fix: Hash index composite keys null values by @lukekim in #9001
Update Cayenne status to Beta by @lukekim in #9002
fix: Disable TPC-DS result validation (not yet supported) by @sgrebnov in #9004
feat: Upgrade to DataFusion v51 and dependencies by @lukekim in #8864
Improvements for snapshots_creation_policy by @krinart in #9003
fix(ci): restore cached spicepod-validator binary instead of lookup-only by @phillipleblanc in #9007
Update version by @krinart in #9010
Update lock file - https://github.com/spiceai/spiceai/commit/53babbf07ca8c1c7b2e1da42ce58c465d9bc9276/
fix: Enable Cayenne acceleration snapshots by @lukekim in #9020
Add TPC-DS integration tests with S3 source and PostgreSQL acceleration by @phillipleblanc in #9006
fix(tests): fix flaky/slow/failing unit tests by @phillipleblanc in #9009
fix: Update benchmark snapshots for DF51 upgrade by @app/github-actions in #9008
fix: add feature gate to rrf TEST_EMBEDDING_MODEL by @phillipleblanc in #9017
fix: features check by @phillipleblanc in #9014
URL table support by @lukekim in #9018
ScyllaDB key filter by @lukekim in #8997
fix: Schema mismatch when using column projection with HTTP caching by @phillipleblanc in #9021
Add more tests for HTTP caching with columns selection by @sgrebnov in #9025
HTTP cache snapshots: default to time_interval and fix snapshots_creation_policy: on_change by @sgrebnov in #9026
Fix duplicate snapshot creation on startup by @sgrebnov in #9029
Remove waiting for runtime to be ready before creating snapshot by @krinart in #9033
Fix snapshot on_change policy to skip when no writes occurred by @sgrebnov in #9028
Release notes for release release/1.11.0-rc.2 by @krinart in #9016
ci: use arduino/setup-protoc for official protobuf compiler by @phillipleblanc in #9036
ci: install unzip on aarch64 runner for arduino/setup-protoc by @phillipleblanc in #9038
fix: don't fail release if upload to minio fails by @phillipleblanc in #9039
Improve validation and logging for hash indexes by @lukekim in #9047
Pin to ubuntu-22.04 by @lukekim in #9068
Fix broken telemetry for testoperator by @krinart in #9054
Fix release builds by @lukekim in #9069
Spice 1.11.0-rc3 release notes by @krinart in #9070
Update spicepod.schema.json by @app/github-actions in #9071
Add missing protoc step to setup-cc action by @krinart in #9041
Fix TLS connection for grpc+tls:// Flight SQL endpoints and add custom CA certificate support by @phillipleblanc in #9073
Update 1.11.0-rc.3 release notes by @krinart in #9082
Fix formula_1 and codebase_community in bird-bench by @Jeadie in #9000
Cayenne S3 Express One Zone improvements by @lukekim in #9015
Add zlib1g-dev to CI by @lukekim in #9052
Upgrade Vortex with CASE-WHEN by @lukekim in #9051
fix: Cayenne CatalogError handling for constraint violations by @lukekim in #9050
Fix Docker build failing to copy shared libraries due to ldd output parsing by @phillipleblanc in #9058
feat: Change /v1/sql and FlightSQL to use local execution in cluster mode by @phillipleblanc in #9055
Remove unmaintained dependencies by @lukekim in #9045
Enable cayenne + changes stream by @Jeadie in #9053
feat(cli): add spice query command for async queries REPL by @phillipleblanc in #9057
Remove unncessary allocations by @lukekim in #9059
Add dataset_acceleration_size_bytes metric by @krinart in #9062
Fix tracing of sql_query beneath tool_use::sample_data. by @Jeadie in #9043
Basic script to run distributed spice by @Jeadie in #9049
Add integration tests for Acceleration Snapshots by @krinart in #9067
Upgrade CUDA toolkit to 12.6.0 by @sgrebnov in #9079
Install required protoc dependency for CUDA build by @sgrebnov in #9080
feat(cluster): add executor control stream heartbeat by @phillipleblanc in #9072
feat: Fix async queries API and integrate Ballista shuffle improvements by @lukekim in #9075
Remove models variant (now default) & Windows builds (use WSL) by @lukekim in #9063
Cayenne: share upload semaphore across partitions to bound memory growth and optimize I/O by @sgrebnov in #9078
Snowflake data connector - add snowflake_private_key parameter by @ewgenius in #9085
Rewrite Go CLI in Rust by @phillipleblanc in #9061
GCS Data Connector (Alpha) by @lukekim in #9084
Skip 'latest' Docker tag for pre-release versions by @sgrebnov in #9077
Add HTTP endpoints for acceleration snapshots API by @phillipleblanc in #9065
Cayenne: Allow append mode with both primary_key and time_column by @sgrebnov in #9090
Add Cluster Observability (Metrics+Dashboard) by @phillipleblanc in #9066
proto for 'CayenneAccelerationExec' by @Jeadie in #9094
Add 'anthropic-beta' header for structured outputs by @Jeadie in #9093
Cayenne: refactor write path to use insert_into() as single entry point (part 1) by @sgrebnov in #9088
Fix testoperator dispatch by @sgrebnov in #9097
Fix setup-spiced GH action (_models suffix does not exist anymore) by @sgrebnov in #9102
build(deps): bump github/codeql-action from 4.31.10 to 4.31.11 by @app/dependabot in #9108
Remove DistributeFileScanOptimizer and UnionProjectionPushdownOptimizer & set target_partitions dynamically based on cluster capacity by @phillipleblanc in #9100
build(deps): bump zip from 2.4.2 to 6.0.0 by @app/dependabot in #9111
fix: Preserve query parameter order in HTTP connector to match filter values by @sgrebnov in #9114
Add PollNow interrupt for Ballista executors to reduce task scheduling latency by @phillipleblanc in #9098
Revert "GCS Data Connector (Alpha) " by @lukekim in #9084
Fix stack overflow for CDC batching by @krinart in #9115
fix: update Ballista fork to include executor timeout fix by @phillipleblanc in #9124
Properly propagate SIGINT/SIGTERM from CLI to runtime by @krinart in #9127
fix: Use the same vortex dependency as ballista by @peasee in #9123
release: Bump version to 1.11.0 for stable - https://github.com/spiceai/spiceai/commit/14d09f8e262008df69ded898ed3bebee08471508/
Cayenne snapshots with shared metadata by @lukekim in #9118
Improve error handling for URL tables with Azure URLs by @phillipleblanc in #9129
Add missing Windows build step for spice CLI in build_and_release workflow by @phillipleblanc in #9143
Fix install-dev to use debug build path for spice binary by @phillipleblanc in #9142
fix: CLI builds by @peasee in #9145
Always create initial snapshots (unless bootstrapped) + when no snapshots exist by @krinart in #9119
fix(cayenne): Fix upsert with pending deletions causing duplicate PKs by @sgrebnov in #9152
fix(flightrepl): Add chrono-tz feature to flightrepl for timezone formatting by @sgrebnov in #9153
fix(delta_lake): Preserve container name in ABFSS URLs for Azure Delta Lake tables by @sgrebnov in #9155
fix: Make CLI system and asset type detection more robust by @peasee in #9148
fix: Set query set properly on benchmarks telemetry metrics attributes by @peasee in #9162
fix: Download _models variant - https://github.com/spiceai/spiceai/commit/27f3058d0007595b02c198755c3b22319032ff30/
fix: Helm chart image tag - https://github.com/spiceai/spiceai/commit/7405c8df0db4ecce0ed6d4a4d424553d604b9036/
Revert "Remove models variant (now default) & Windows builds (use WSL) " by @lukekim in #9063
fix(cli): Several CLI fixes from the Go to Rust migration by @lukekim in #9157

Spice.ai OSS Blog

Spice v2.2.0 (Aug 25, 2026)

What's New in v2.2.0​

Cloud Connect​

MySQL Change Data Capture​

PostgreSQL Catalog CDC​

Debezium CDC Without Kafka​

Faster Search with Warm In-Memory Indexes​

Operations & Observability​

Other Notable Improvements and Bug Fixes​

SDK Updates​

Dependency Updates​

New Contributors​

Contributors​

Breaking Changes​

Cookbook Updates​

Upgrading​

What's Changed​

Changelog​

Spice v2.1.5 (Aug 12, 2026)

What's New in v2.1.5​

Cached Queries Stay Fresh as Data Changes​

More Predictable Cayenne Behavior Under Heavy Load​

Health Checks Remain Responsive During Cache Updates​

More Trustworthy Cache Dashboards​

Contributors​

Breaking Changes​

Cookbook Updates​

Upgrading​

What's Changed​

Changelog​

Spice v2.1.4 (Aug 5, 2026)

What's New in v2.1.4​

DuckDB Acceleration Works with Iceberg Timestamps​

Reliable Retention Policies on DuckDB​

Improved Runtime Stability​

Contributors​

Breaking Changes​

Cookbook Updates​

Upgrading​

What's Changed​

Changelog​

Spice v2.1.3 (Aug 4, 2026)

What's New in v2.1.3​

CPU Sizing with runtime.cpu.cores​

More Query Memory for Cayenne Deployments​

Diagnostics​

Cayenne Acceleration of Iceberg timestamptz Columns​

Federated Outer Join Filters​

Contributors​

Breaking Changes​

Cookbook Updates​

Upgrading​

What's Changed​

Changelog​

Spice v2.1.2 (Jul 28, 2026)

What's New in v2.1.2​

Bounded DuckDB Acceleration File Growth with on_full_refresh​

DuckDB 1.5.5​

Contributors​

Breaking Changes​

Cookbook Updates​

Upgrading​

What's Changed​

Changelog​

Spice v2.1.1 (Jul 21, 2026)

What's New in v2.1.1​

Cayenne Partitioned Dataset Deadlock Fix​

Cayenne Zero-Row Append Refresh Stability​

Caching of Empty Result Sets​

Faster Repeated Queries on Multi-File Datasets​

Embedding Parameter Regression Fixes​

Contributors​

Breaking Changes​

Cookbook Updates​

Upgrading​

What's Changed​

Changelog​

Spice v2.1.0 (Jul 9, 2026)

What's New in v2.1.0​

What's New in v2.2.0

Cloud Connect

MySQL Change Data Capture

PostgreSQL Catalog CDC

Debezium CDC Without Kafka

Faster Search with Warm In-Memory Indexes

Operations & Observability

Other Notable Improvements and Bug Fixes

SDK Updates

Dependency Updates

New Contributors

Contributors

Breaking Changes

Cookbook Updates

Upgrading

What's Changed

Changelog

What's New in v2.1.5

Cached Queries Stay Fresh as Data Changes

More Predictable Cayenne Behavior Under Heavy Load

Health Checks Remain Responsive During Cache Updates

More Trustworthy Cache Dashboards

Contributors

Breaking Changes

Cookbook Updates

Upgrading

What's Changed

Changelog

What's New in v2.1.4

DuckDB Acceleration Works with Iceberg Timestamps

Reliable Retention Policies on DuckDB

Improved Runtime Stability

Contributors

Breaking Changes

Cookbook Updates

Upgrading

What's Changed

Changelog

What's New in v2.1.3

CPU Sizing with `runtime.cpu.cores`

More Query Memory for Cayenne Deployments

Diagnostics

Cayenne Acceleration of Iceberg `timestamptz` Columns

Federated Outer Join Filters

Contributors

Breaking Changes

Cookbook Updates

Upgrading

What's Changed

Changelog

What's New in v2.1.2

Bounded DuckDB Acceleration File Growth with `on_full_refresh`

DuckDB 1.5.5

Contributors

Breaking Changes

Cookbook Updates

Upgrading

What's Changed

Changelog

What's New in v2.1.1

Cayenne Partitioned Dataset Deadlock Fix

Cayenne Zero-Row Append Refresh Stability

Caching of Empty Result Sets

Faster Repeated Queries on Multi-File Datasets

Embedding Parameter Regression Fixes

Contributors

Breaking Changes

Cookbook Updates

Upgrading

What's Changed

Changelog

What's New in v2.1.0

High-Throughput Cayenne CDC

Change Data Capture & HTAP

Distributed Query

Performance & Query Engine

AI & LLM

Search & Vectors

SQL & Query Engine

Security & Connectors