Benchmark coverage and cold starts
Comparative performance results are separate from product release validation. Customer clean-install and duration testing belongs to release validation.
The historical board's parenthesized first-touch values are not verified independent cold starts. The earlier Siglake/Quickwit restart pass reset once for a suite; only the first query started cold. No historical row is relabeled.
The new protocol driver covers all eight series. Each cold sample requires a fresh reset receipt covering all workers, host page cache, persistent local caches and result-cache settings, followed by separate warm execution samples. Remote object-store caches remain uncontrolled. Reset adapters and live qualification are pending; there are no new verified cold numbers here yet.
| Series | HTTP logs | Independent cold | Rally EventData | ClickBench | Adapted Big5 |
|---|---|---|---|---|---|
| Siglake | historical measurements; version refresh pending | protocol driver ready; reset adapter and live qualification pending | live suite, cold/warm oracle and export ready; isolated qualification pending | planned | planned |
| quickwit | historical measurements; version refresh pending | protocol driver ready; reset adapter and live qualification pending | live suite, cold/warm oracle and export ready; isolated qualification pending | planned | planned |
| elasticsearch | historical measurements; version refresh pending | protocol driver ready; reset adapter and live qualification pending | live suite, cold/warm oracle and export ready; isolated qualification pending | planned | planned |
| clickhouse | historical measurements; version refresh pending | protocol driver ready; reset adapter and live qualification pending | live suite, cold/warm oracle and export ready; isolated qualification pending | planned | planned |
| clickhouse-s3 | historical measurements; version refresh pending | protocol driver ready; reset adapter and live qualification pending | live suite, cold/warm oracle and export ready; isolated qualification pending | planned | planned |
| duckdb | historical measurements; version refresh pending | protocol driver ready; reset adapter and live qualification pending | live suite, cold/warm oracle and export ready; isolated qualification pending | planned | planned |
| duckdb-s3 | historical measurements; version refresh pending | protocol driver ready; reset adapter and live qualification pending | live suite, cold/warm oracle and export ready; isolated qualification pending | planned | planned |
| victorialogs | historical measurements; version refresh pending | protocol driver ready; reset adapter and live qualification pending | live suite, cold/warm oracle and export ready; isolated qualification pending | planned | planned |
New corpus adapters require frozen data, pinned engine versions, explicit unsupported operations and independent answer checks before publication. Unsupported shapes and failed resets will remain visible.