[DO NOT MERGE] chDB: diagnostic run for chdb-core v26.9.1-rc.1 by ShawnChen-Sirius · Pull Request #2463 · ClickHouse/ClickBench

ShawnChen-Sirius · 2026-10-08T09:25:42Z

Warning

DO NOT MERGE. This is a temporary benchmark-only pull request and will be closed after the comparison.

Purpose

Run the current chDB configuration (OPTIMIZE FINAL after load) against the chdb-core release candidate v26.9.1-rc.1, and record how the load turns into MergeTree parts and merges.

chdb-rc/install pins chdb==4.4.0 and installs the v26.9.1-rc.1 wheel from the chdb-core GitHub release; the install log prints both package versions.
chdb-rc/create.sql relies on chdb-core's new default for auto_statistics_types instead of setting it explicitly.
After the measured flow, chdb-rc/profile repeats the load once with part_log/query_log enabled and prints a JSON report between === load_profile json === and === load_profile end ===. It runs outside every measured window and removes its data afterwards.

chdb/ is unchanged.

Validation

bash -n for all scripts
python3 -m json.tool chdb-rc/template.json
the profile step was run locally against a 300k-row sample of the dataset

Temporary, not for merging. Pins the chdb-core release candidate, relies on its auto_statistics_types default, and after the measured flow repeats the load with part_log and query_log enabled to report parts and merges. Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com>

…l, c6a.xlarge, c7a.metal-48xl, c8g.4xlarge, c8g.metal-48xl)

github-actions · 2026-10-08T10:26:39Z

Results for chdb-rc are ready for: c6a.2xlarge, c6a.4xlarge, c6a.metal, c6a.xlarge, c7a.metal-48xl, c8g.4xlarge, c8g.metal-48xl.
The result files are committed as 106e846.
Preview of the benchmark page with these results

Logs:

chdb-rc on c8g.metal-48xl: benchmark log, cloud-init log
chdb-rc on c7a.metal-48xl: benchmark log, cloud-init log
chdb-rc on c6a.metal: benchmark log, cloud-init log
chdb-rc on c8g.4xlarge: benchmark log, cloud-init log
chdb-rc on c6a.4xlarge: benchmark log, cloud-init log
chdb-rc on c6a.2xlarge: benchmark log, cloud-init log
chdb-rc on c6a.xlarge: benchmark log, cloud-init log

github-actions · 2026-10-08T11:23:44Z

Results for chdb-rc are ready for: c6a.large.
The result files are committed as 3360698.
Preview of the benchmark page with these results

Logs:

chdb-rc on c6a.large: benchmark log, cloud-init log

github-actions · 2026-10-08T12:36:53Z

Results for chdb-rc are ready for: t3a.small.
The result files are committed as f0ead50.
Preview of the benchmark page with these results

Logs:

chdb-rc on t3a.small: benchmark log, cloud-init log

…lz4, chdb-rc-no-final-lz4-i1 (c6a.2xlarge, c6a.4xlarge, c6a.metal, c6a.xlarge, c7a.metal-48xl, c8g.4xlarge, c8g.metal-48xl)

github-actions · 2026-10-08T22:24:13Z

Results for chdb-rc-no-final-default are ready for: c6a.2xlarge, c6a.4xlarge, c6a.metal, c6a.xlarge, c7a.metal-48xl, c8g.4xlarge, c8g.metal-48xl.
Results for chdb-rc-no-final-lz4 are ready for: c6a.2xlarge, c6a.4xlarge, c6a.metal, c6a.xlarge, c7a.metal-48xl, c8g.4xlarge, c8g.metal-48xl.
Results for chdb-rc-no-final-lz4-i1 are ready for: c6a.2xlarge, c6a.4xlarge, c6a.metal, c6a.xlarge, c7a.metal-48xl, c8g.4xlarge, c8g.metal-48xl.
The result files are committed as e2c28fa.
Preview of the benchmark page with these results

Logs:

chdb-rc-no-final-default on c8g.metal-48xl: benchmark log, cloud-init log
chdb-rc-no-final-default on c6a.metal: benchmark log, cloud-init log
chdb-rc-no-final-lz4 on c7a.metal-48xl: benchmark log, cloud-init log
chdb-rc-no-final-lz4 on c8g.metal-48xl: benchmark log, cloud-init log
chdb-rc-no-final-default on c7a.metal-48xl: benchmark log, cloud-init log
chdb-rc-no-final-lz4 on c6a.metal: benchmark log, cloud-init log
chdb-rc-no-final-lz4-i1 on c7a.metal-48xl: benchmark log, cloud-init log
chdb-rc-no-final-lz4-i1 on c6a.metal: benchmark log, cloud-init log
chdb-rc-no-final-lz4-i1 on c8g.metal-48xl: benchmark log, cloud-init log
chdb-rc-no-final-default on c8g.4xlarge: benchmark log, cloud-init log
chdb-rc-no-final-default on c6a.4xlarge: benchmark log, cloud-init log
chdb-rc-no-final-lz4 on c8g.4xlarge: benchmark log, cloud-init log
chdb-rc-no-final-lz4-i1 on c8g.4xlarge: benchmark log, cloud-init log
chdb-rc-no-final-lz4-i1 on c6a.4xlarge: benchmark log, cloud-init log
chdb-rc-no-final-default on c6a.2xlarge: benchmark log, cloud-init log
chdb-rc-no-final-lz4 on c6a.4xlarge: benchmark log, cloud-init log
chdb-rc-no-final-lz4 on c6a.2xlarge: benchmark log, cloud-init log
chdb-rc-no-final-lz4-i1 on c6a.2xlarge: benchmark log, cloud-init log
chdb-rc-no-final-default on c6a.xlarge: benchmark log, cloud-init log
chdb-rc-no-final-lz4-i1 on c6a.xlarge: benchmark log, cloud-init log
chdb-rc-no-final-lz4 on c6a.xlarge: benchmark log, cloud-init log

…i1 (c6a.large)

github-actions · 2026-10-08T22:46:15Z

Results for chdb-rc-no-final-lz4 are ready for: c6a.large.
Results for chdb-rc-no-final-lz4-i1 are ready for: c6a.large.
The result files are committed as bb4b1da.
Preview of the benchmark page with these results

Logs:

chdb-rc-no-final-lz4-i1 on c6a.large: benchmark log, cloud-init log
chdb-rc-no-final-lz4 on c6a.large: benchmark log, cloud-init log

github-actions · 2026-10-08T23:22:22Z

Results for chdb-rc-no-final-default are ready for: c6a.large.
The result files are committed as 2edd1de.
Preview of the benchmark page with these results

Logs:

chdb-rc-no-final-default on c6a.large: benchmark log, cloud-init log

github-actions · 2026-10-08T23:45:04Z

Results for chdb-rc-no-final-default are ready for: t3a.small.
The result files are committed as 80e28b0.
Preview of the benchmark page with these results

Logs:

chdb-rc-no-final-default on t3a.small: benchmark log, cloud-init log

…std-i1, chdb-rc-parquet-not-null (c6a.2xlarge, c6a.4xlarge, c6a.large, c6a.metal, c6a.xlarge, c7a.metal-48xl, c8g.4xlarge, c8g.metal-48xl, t3a.small)

github-actions · 2026-10-09T01:05:04Z

Results for chdb-rc-no-final-lz4-i1 are ready for: c6a.2xlarge, c6a.4xlarge, c6a.metal, c6a.xlarge, c7a.metal-48xl, c8g.4xlarge, c8g.metal-48xl.
Results for chdb-rc-no-final-zstd-i1 are ready for: c6a.2xlarge, c6a.4xlarge, c6a.metal, c6a.xlarge, c7a.metal-48xl, c8g.4xlarge, c8g.metal-48xl.
Results for chdb-rc-parquet-not-null are ready for: c6a.2xlarge, c6a.4xlarge, c6a.large, c6a.metal, c6a.xlarge, c7a.metal-48xl, c8g.4xlarge, c8g.metal-48xl, t3a.small.
The result files are committed as 4c7f38a.
Preview of the benchmark page with these results

Logs:

chdb-rc-parquet-not-null on c8g.4xlarge: benchmark log, cloud-init log
chdb-rc-parquet-not-null on c6a.4xlarge: benchmark log, cloud-init log
chdb-rc-parquet-not-null on c6a.metal: benchmark log, cloud-init log
chdb-rc-parquet-not-null on c7a.metal-48xl: benchmark log, cloud-init log
chdb-rc-parquet-not-null on c6a.2xlarge: benchmark log, cloud-init log
chdb-rc-parquet-not-null on c8g.metal-48xl: benchmark log, cloud-init log
chdb-rc-parquet-not-null on c6a.xlarge: benchmark log, cloud-init log
chdb-rc-no-final-zstd-i1 on c8g.metal-48xl: benchmark log, cloud-init log
chdb-rc-no-final-zstd-i1 on c6a.metal: benchmark log, cloud-init log
chdb-rc-no-final-zstd-i1 on c7a.metal-48xl: benchmark log, cloud-init log
chdb-rc-no-final-lz4-i1 on c6a.metal: benchmark log, cloud-init log
chdb-rc-parquet-not-null on c6a.large: benchmark log, cloud-init log
chdb-rc-no-final-lz4-i1 on c8g.metal-48xl: benchmark log, cloud-init log
chdb-rc-no-final-lz4-i1 on c7a.metal-48xl: benchmark log, cloud-init log
chdb-rc-no-final-zstd-i1 on c8g.4xlarge: benchmark log, cloud-init log
chdb-rc-no-final-zstd-i1 on c6a.4xlarge: benchmark log, cloud-init log
chdb-rc-no-final-zstd-i1 on c6a.2xlarge: benchmark log, cloud-init log
chdb-rc-no-final-lz4-i1 on c8g.4xlarge: benchmark log, cloud-init log
chdb-rc-no-final-lz4-i1 on c6a.4xlarge: benchmark log, cloud-init log
chdb-rc-no-final-lz4-i1 on c6a.2xlarge: benchmark log, cloud-init log
chdb-rc-no-final-zstd-i1 on c6a.xlarge: benchmark log, cloud-init log
chdb-rc-no-final-lz4-i1 on c6a.xlarge: benchmark log, cloud-init log
chdb-rc-parquet-not-null on t3a.small: benchmark log, cloud-init log

…i1, chdb-rc-no-final-zstd-i1 (c6a.large, t3a.small)

github-actions · 2026-10-09T01:45:42Z

Results for chdb-rc-no-final-lz4 are ready for: t3a.small.
Results for chdb-rc-no-final-lz4-i1 are ready for: c6a.large, t3a.small.
Results for chdb-rc-no-final-zstd-i1 are ready for: c6a.large.
The result files are committed as f883a9d.
Preview of the benchmark page with these results

Logs:

chdb-rc-no-final-lz4 on t3a.small: benchmark log, cloud-init log
chdb-rc-no-final-lz4-i1 on c6a.large: benchmark log, cloud-init log
chdb-rc-no-final-zstd-i1 on c6a.large: benchmark log, cloud-init log
chdb-rc-no-final-lz4-i1 on t3a.small: benchmark log, cloud-init log

github-actions · 2026-10-09T02:38:05Z

Results for chdb-rc-no-final-zstd-i1 are ready for: t3a.small.
The result files are committed as 8112895.
Preview of the benchmark page with these results

Logs:

chdb-rc-no-final-zstd-i1 on t3a.small: benchmark log, cloud-init log

github-actions · 2026-10-09T04:30:45Z

Results for chdb-rc-no-final-lz4-i1 are ready for: t3a.small.
This pull request is from a fork, so the automation cannot push to it; save this result as chdb-rc-no-final-lz4-i1/results/20261009/t3a.small.json.
Tick "Allow edits by maintainers" on the pull request to let the automation commit the results itself.

Logs:

chdb-rc-no-final-lz4-i1 on t3a.small: benchmark log, cloud-init log

ShawnChen-Sirius added the machine:all PR benchmark on every machine type label Oct 8, 2026

ShawnChen-Sirius had a problem deploying to benchmark-approval October 8, 2026 09:25 — with GitHub Actions Error

ShawnChen-Sirius had a problem deploying to benchmark-approval October 8, 2026 09:26 — with GitHub Actions Error

Add benchmark results for chdb-rc (c6a.2xlarge, c6a.4xlarge, c6a.meta…

106e846

…l, c6a.xlarge, c7a.metal-48xl, c8g.4xlarge, c8g.metal-48xl)

robot-clickhouse had a problem deploying to benchmark-approval October 8, 2026 10:26 — with GitHub Actions Error

Add benchmark results for chdb-rc (c6a.large)

3360698

robot-clickhouse had a problem deploying to benchmark-approval October 8, 2026 11:23 — with GitHub Actions Error

Add benchmark results for chdb-rc (t3a.small)

f0ead50

robot-clickhouse had a problem deploying to benchmark-approval October 8, 2026 12:37 — with GitHub Actions Error

Add no-FINAL chDB RC benchmark variants

a5282e6

ShawnChen-Sirius had a problem deploying to benchmark-approval October 8, 2026 21:23 — with GitHub Actions Error

Add benchmark results for chdb-rc-no-final-default, chdb-rc-no-final-…

e2c28fa

…lz4, chdb-rc-no-final-lz4-i1 (c6a.2xlarge, c6a.4xlarge, c6a.metal, c6a.xlarge, c7a.metal-48xl, c8g.4xlarge, c8g.metal-48xl)

robot-clickhouse had a problem deploying to benchmark-approval October 8, 2026 22:24 — with GitHub Actions Error

Add benchmark results for chdb-rc-no-final-lz4, chdb-rc-no-final-lz4-…

bb4b1da

…i1 (c6a.large)

robot-clickhouse had a problem deploying to benchmark-approval October 8, 2026 22:46 — with GitHub Actions Error

Add benchmark results for chdb-rc-no-final-default (c6a.large)

2edd1de

robot-clickhouse had a problem deploying to benchmark-approval October 8, 2026 23:22 — with GitHub Actions Error

Add benchmark results for chdb-rc-no-final-default (t3a.small)

80e28b0

robot-clickhouse had a problem deploying to benchmark-approval October 8, 2026 23:45 — with GitHub Actions Error

Add chDB ZSTD and explicit-schema diagnostics

0558100

ShawnChen-Sirius had a problem deploying to benchmark-approval October 8, 2026 23:55 — with GitHub Actions Error

Add benchmark results for chdb-rc-no-final-lz4-i1, chdb-rc-no-final-z…

4c7f38a

…std-i1, chdb-rc-parquet-not-null (c6a.2xlarge, c6a.4xlarge, c6a.large, c6a.metal, c6a.xlarge, c7a.metal-48xl, c8g.4xlarge, c8g.metal-48xl, t3a.small)

robot-clickhouse had a problem deploying to benchmark-approval October 9, 2026 01:05 — with GitHub Actions Error

Add benchmark results for chdb-rc-no-final-lz4, chdb-rc-no-final-lz4-…

f883a9d

…i1, chdb-rc-no-final-zstd-i1 (c6a.large, t3a.small)

robot-clickhouse had a problem deploying to benchmark-approval October 9, 2026 01:45 — with GitHub Actions Error

Add benchmark results for chdb-rc-no-final-zstd-i1 (t3a.small)

8112895

robot-clickhouse had a problem deploying to benchmark-approval October 9, 2026 02:38 — with GitHub Actions Error

ShawnChen-Sirius closed this Oct 9, 2026

ShawnChen-Sirius mentioned this pull request Oct 9, 2026

[DO NOT MERGE] chDB: test query memory guard on two-vCPU machines #2488

Closed

Navigation Menu

Repository navigation

[DO NOT MERGE] chDB: diagnostic run for chdb-core v26.9.1-rc.1 - #2463

[DO NOT MERGE] chDB: diagnostic run for chdb-core v26.9.1-rc.1#2463
ShawnChen-Sirius wants to merge 13 commits into
ClickHouse:mainfrom
ShawnChen-Sirius:codex/chdb-rc-diagnostic

ShawnChen-Sirius commented Oct 8, 2026

Uh oh!

github-actions Bot commented Oct 8, 2026

Uh oh!

github-actions Bot commented Oct 8, 2026

Uh oh!

github-actions Bot commented Oct 8, 2026

Uh oh!

github-actions Bot commented Oct 8, 2026

Uh oh!

github-actions Bot commented Oct 8, 2026

Uh oh!

github-actions Bot commented Oct 8, 2026

Uh oh!

github-actions Bot commented Oct 8, 2026

Uh oh!

github-actions Bot commented Oct 9, 2026

Uh oh!

github-actions Bot commented Oct 9, 2026

Uh oh!

github-actions Bot commented Oct 9, 2026

Uh oh!

github-actions Bot commented Oct 9, 2026

Uh oh!

This branch was successfully deployed

Reviewers

Assignees

Labels

Projects

Milestone

Development

Uh oh!

2 participants

Conversation

ShawnChen-Sirius commented Oct 8, 2026

Purpose

Validation

Uh oh!

github-actions Bot commented Oct 8, 2026

Uh oh!

github-actions Bot commented Oct 8, 2026

Uh oh!

github-actions Bot commented Oct 8, 2026

Uh oh!

github-actions Bot commented Oct 8, 2026

Uh oh!

github-actions Bot commented Oct 8, 2026

Uh oh!

github-actions Bot commented Oct 8, 2026

Uh oh!

github-actions Bot commented Oct 8, 2026

Uh oh!

github-actions Bot commented Oct 9, 2026

Uh oh!

github-actions Bot commented Oct 9, 2026

Uh oh!

github-actions Bot commented Oct 9, 2026

Uh oh!

github-actions Bot commented Oct 9, 2026

Uh oh!

This branch was successfully deployed

Reviewers

Assignees

Labels

Projects

Milestone

Development

Uh oh!

2 participants