Skip to content

reenable LTO for release builds and benchmarks#7740

Open
myrrc wants to merge 1 commit intodevelopfrom
myrrc/lto
Open

reenable LTO for release builds and benchmarks#7740
myrrc wants to merge 1 commit intodevelopfrom
myrrc/lto

Conversation

@myrrc
Copy link
Copy Markdown
Contributor

@myrrc myrrc commented Apr 30, 2026

No description provided.

@myrrc myrrc added the changelog/chore A trivial change label Apr 30, 2026
Signed-off-by: Mikhail Kot <to@myrrc.dev>
@myrrc myrrc added action/benchmark Trigger full benchmarks to run on this PR action/benchmark-sql Trigger SQL benchmarks to run on this PR labels Apr 30, 2026
@github-actions github-actions Bot removed action/benchmark-sql Trigger SQL benchmarks to run on this PR action/benchmark Trigger full benchmarks to run on this PR labels Apr 30, 2026
Copy link
Copy Markdown
Contributor

@0ax1 0ax1 left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

The rationale from prev discussions was that our perf should not rely on LTO. We can't make assumption about other crates that import Vortex whether LTO is enabled. Story would be diff if Vortex would be the executable top-level binary. Should we leave perf on the table due to missing cross crate opt, we should scan our APIs for missing inline annotations which also benefit clients that don't use LTO.

@codspeed-hq
Copy link
Copy Markdown

codspeed-hq Bot commented Apr 30, 2026

Merging this PR will degrade performance by 15.94%

⚡ 64 improved benchmarks
❌ 8 regressed benchmarks
✅ 103 untouched benchmarks
⏩ 1023 skipped benchmarks1

⚠️ Please fix the performance issues or acknowledge them on CodSpeed.

Performance Changes

Mode Benchmark BASE HEAD Efficiency
Simulation append_arrow_buffer[128] 1.4 µs 1.2 µs +14.55%
Simulation append_arrow_buffer[16384] 136.6 µs 118.4 µs +15.41%
Simulation bitwise_and_arrow_buffer[16384] 6 µs 5.3 µs +12.68%
Simulation append_arrow_buffer[1024] 8.8 µs 7.6 µs +15.32%
Simulation bitwise_and_arrow_buffer[128] 1.9 µs 1.3 µs +48.3%
Simulation append_buffer_arrow_buffer[1024] 12.7 µs 11.4 µs +12.01%
Simulation append_arrow_buffer[2048] 17.3 µs 15 µs +15.37%
Simulation bitwise_not_vortex_buffer[1024] 3.7 µs 2.6 µs +42.31%
Simulation bitwise_not_vortex_buffer[128] 4.4 µs 3.3 µs +32.13%
Simulation bitwise_and_arrow_buffer[1024] 2.1 µs 1.4 µs +44.31%
Simulation bitwise_not_vortex_buffer[16384] 7.3 µs 6.2 µs +17.89%
Simulation bitwise_not_vortex_buffer[2048] 3.8 µs 2.7 µs +40.86%
Simulation bitwise_and_vortex_buffer[16384] 9.5 µs 7.4 µs +28.72%
Simulation append_arrow_buffer[65536] 545.6 µs 472.7 µs +15.41%
Simulation bitwise_not_arrow_buffer[2048] 2.4 µs 1.9 µs +21.01%
Simulation bitwise_and_vortex_buffer[2048] 4.4 µs 2.7 µs +62.71%
Simulation append_buffer_arrow_buffer[128] 3.3 µs 2.4 µs +35.25%
Simulation bitwise_not_arrow_buffer[1024] 2.3 µs 1.9 µs +21.72%
Simulation bitwise_and_arrow_buffer[2048] 2.3 µs 1.6 µs +39.33%
Simulation bitwise_not_arrow_buffer[128] 2.1 µs 1.7 µs +22.21%
... ... ... ... ... ...

ℹ️ Only the first 20 benchmarks are displayed. Go to the app to view all benchmarks.


Comparing myrrc/lto (d75de6d) with develop (deb7de0)

Open in CodSpeed

Footnotes

  1. 1023 benchmarks were skipped, so the baseline results were used instead. If they were deleted from the codebase, click here and archive them to remove them from the performance reports.

@github-actions
Copy link
Copy Markdown
Contributor

github-actions Bot commented Apr 30, 2026

Polar Signals Profiling Results

Latest Run

Status Commit Job Attempt Link
🟢 Done d75de6d 1 Explore Profiling Data

Powered by Polar Signals Cloud

@github-actions
Copy link
Copy Markdown
Contributor

github-actions Bot commented Apr 30, 2026

Benchmarks: PolarSignals Profiling

Vortex (geomean): 0.996x ➖


datafusion / vortex-file-compressed (0.996x ➖, 0↑ 0↓)
name PR d75de6d (ns) base deb7de0 (ns) ratio (PR/base)
polarsignals_q00/datafusion:vortex-file-compressed 123522632 126816661 0.97
polarsignals_q01/datafusion:vortex-file-compressed 275142830 289899629 0.95
polarsignals_q02/datafusion:vortex-file-compressed 23652903 24621874 0.96
polarsignals_q03/datafusion:vortex-file-compressed 287320719 281313711 1.02
polarsignals_q04/datafusion:vortex-file-compressed 12330456 12281605 1.00
polarsignals_q05/datafusion:vortex-file-compressed 15662939 14876545 1.05
polarsignals_q06/datafusion:vortex-file-compressed 18669782 19453034 0.96
polarsignals_q07/datafusion:vortex-file-compressed 14425567 14421850 1.00
polarsignals_q08/datafusion:vortex-file-compressed 367430159 358511429 1.02
polarsignals_q09/datafusion:vortex-file-compressed 11436470 11204107 1.02

@github-actions
Copy link
Copy Markdown
Contributor

File Sizes: PolarSignals Profiling

No file size changes detected.

@github-actions
Copy link
Copy Markdown
Contributor

github-actions Bot commented Apr 30, 2026

Benchmarks: FineWeb NVMe

Verdict: No clear signal (low confidence)
Attributed Vortex impact: +1.1%
Vortex (geomean): 0.941x ➖
Parquet (geomean): 0.930x ➖
Shifts: Parquet (control) -7.0% · Median polish -6.2%


datafusion / vortex-file-compressed (0.927x ➖, 4↑ 1↓)
name PR d75de6d (ns) base deb7de0 (ns) ratio (PR/base)
fineweb_q00/datafusion:vortex-file-compressed 🚀 4738033 5886129 0.80
fineweb_q01/datafusion:vortex-file-compressed 20967415 22188538 0.94
fineweb_q02/datafusion:vortex-file-compressed 🚀 19994374 22509707 0.89
fineweb_q03/datafusion:vortex-file-compressed 🚀 76427528 88856582 0.86
fineweb_q04/datafusion:vortex-file-compressed 229845114 229522330 1.00
fineweb_q05/datafusion:vortex-file-compressed 207000253 220281046 0.94
fineweb_q06/datafusion:vortex-file-compressed 50065343 53908848 0.93
fineweb_q07/datafusion:vortex-file-compressed 🚀 55782397 66372032 0.84
fineweb_q08/datafusion:vortex-file-compressed 🚨 25414162 21366506 1.19
datafusion / vortex-compact (0.904x ➖, 2↑ 0↓)
name PR d75de6d (ns) base deb7de0 (ns) ratio (PR/base)
fineweb_q00/datafusion:vortex-compact 🚀 4796969 6108695 0.79
fineweb_q01/datafusion:vortex-compact 122584294 131539167 0.93
fineweb_q02/datafusion:vortex-compact 126224253 135461641 0.93
fineweb_q03/datafusion:vortex-compact 1022400110 1116558207 0.92
fineweb_q04/datafusion:vortex-compact 1123631779 1179103847 0.95
fineweb_q05/datafusion:vortex-compact 934702418 1035555239 0.90
fineweb_q06/datafusion:vortex-compact 519016315 566282986 0.92
fineweb_q07/datafusion:vortex-compact 549730601 577782254 0.95
fineweb_q08/datafusion:vortex-compact 🚀 17962541 20807613 0.86
datafusion / parquet (0.927x ➖, 2↑ 0↓)
name PR d75de6d (ns) base deb7de0 (ns) ratio (PR/base)
fineweb_q00/datafusion:parquet 6466167 6604721 0.98
fineweb_q01/datafusion:parquet 🚀 278738339 314487464 0.89
fineweb_q02/datafusion:parquet 🚀 283703685 322702894 0.88
fineweb_q03/datafusion:parquet 294917071 302547214 0.97
fineweb_q04/datafusion:parquet 294663595 325057050 0.91
fineweb_q05/datafusion:parquet 296359865 315370358 0.94
fineweb_q06/datafusion:parquet 282940513 309922193 0.91
fineweb_q07/datafusion:parquet 280500593 303181412 0.93
fineweb_q08/datafusion:parquet 278598335 296222649 0.94
duckdb / vortex-file-compressed (0.984x ➖, 0↑ 1↓)
name PR d75de6d (ns) base deb7de0 (ns) ratio (PR/base)
fineweb_q00/duckdb:vortex-file-compressed 3369057 3612955 0.93
fineweb_q01/duckdb:vortex-file-compressed 20935160 22023239 0.95
fineweb_q02/duckdb:vortex-file-compressed 23473739 24327166 0.96
fineweb_q03/duckdb:vortex-file-compressed 🚨 152991930 126060037 1.21
fineweb_q04/duckdb:vortex-file-compressed 219538839 222832490 0.99
fineweb_q05/duckdb:vortex-file-compressed 204863162 217768717 0.94
fineweb_q06/duckdb:vortex-file-compressed 51477277 56057559 0.92
fineweb_q07/duckdb:vortex-file-compressed 52860011 56177940 0.94
fineweb_q08/duckdb:vortex-file-compressed 25158072 24257329 1.04
duckdb / vortex-compact (0.949x ➖, 1↑ 0↓)
name PR d75de6d (ns) base deb7de0 (ns) ratio (PR/base)
fineweb_q00/duckdb:vortex-compact 3774507 4080435 0.93
fineweb_q01/duckdb:vortex-compact 101981281 100038647 1.02
fineweb_q02/duckdb:vortex-compact 🚀 106110026 124552380 0.85
fineweb_q03/duckdb:vortex-compact 868171767 919608886 0.94
fineweb_q04/duckdb:vortex-compact 905071565 964873257 0.94
fineweb_q05/duckdb:vortex-compact 808732490 863177068 0.94
fineweb_q06/duckdb:vortex-compact 460461373 484133096 0.95
fineweb_q07/duckdb:vortex-compact 471872368 502486040 0.94
fineweb_q08/duckdb:vortex-compact 20687462 19815081 1.04
duckdb / parquet (0.933x ➖, 2↑ 0↓)
name PR d75de6d (ns) base deb7de0 (ns) ratio (PR/base)
fineweb_q00/duckdb:parquet 🚀 27336388 31019789 0.88
fineweb_q01/duckdb:parquet 84450837 88772261 0.95
fineweb_q02/duckdb:parquet 83771692 90430517 0.93
fineweb_q03/duckdb:parquet 318011005 328787831 0.97
fineweb_q04/duckdb:parquet 444267595 462179710 0.96
fineweb_q05/duckdb:parquet 410941140 432420633 0.95
fineweb_q06/duckdb:parquet 199992057 211715945 0.94
fineweb_q07/duckdb:parquet 209429235 222686000 0.94
fineweb_q08/duckdb:parquet 🚀 32265331 36658194 0.88
Full attributed analysis
Query Config Raw Δ Control Δ Attributed α Noise floor Significant?
0 datafusion:vortex-compact -21.5% -7.1% -15.5% +51.7% ➖ noise
0 datafusion:vortex-file-compressed -19.5% -7.1% -13.3% +56.5% ➖ noise
0 duckdb:vortex-compact -7.5% -7.1% -0.4% +51.1% ➖ noise
0 duckdb:vortex-file-compressed -6.8% -7.1% +0.4% +87.2% ➖ noise
1 datafusion:vortex-compact -6.8% -8.2% +1.5% +16.1% ➖ noise
1 datafusion:vortex-file-compressed -5.5% -8.2% +2.9% +31.3% ➖ noise
1 duckdb:vortex-compact +1.9% -8.2% +11.0% +23.2% ➖ noise
1 duckdb:vortex-file-compressed -4.9% -8.2% +3.5% +64.2% ➖ noise
2 datafusion:vortex-compact -6.8% -9.8% +3.3% +12.3% ➖ noise
2 datafusion:vortex-file-compressed -11.2% -9.8% -1.6% +12.2% ➖ noise
2 duckdb:vortex-compact -14.8% -9.8% -5.6% +21.5% ➖ noise
2 duckdb:vortex-file-compressed -3.5% -9.8% +6.9% +10.0% ➖ noise
3 datafusion:vortex-compact -8.4% -2.9% -5.7% +10.0% ➖ noise
3 datafusion:vortex-file-compressed -14.0% -2.9% -11.4% +29.4% ➖ noise
3 duckdb:vortex-compact -5.6% -2.9% -2.8% +10.0% ➖ noise
3 duckdb:vortex-file-compressed +21.4% -2.9% +25.0% +30.5% ➖ noise
4 datafusion:vortex-compact -4.7% -6.7% +2.1% +10.0% ➖ noise
4 datafusion:vortex-file-compressed +0.1% -6.7% +7.3% +10.0% ➖ noise
4 duckdb:vortex-compact -6.2% -6.7% +0.5% +10.0% ➖ noise
4 duckdb:vortex-file-compressed -1.5% -6.7% +5.5% +10.0% ➖ noise
5 datafusion:vortex-compact -9.7% -5.5% -4.5% +10.0% ➖ noise
5 datafusion:vortex-file-compressed -6.0% -5.5% -0.6% +10.0% ➖ noise
5 duckdb:vortex-compact -6.3% -5.5% -0.9% +10.0% ➖ noise
5 duckdb:vortex-file-compressed -5.9% -5.5% -0.5% +10.0% ➖ noise
6 datafusion:vortex-compact -8.3% -7.1% -1.3% +10.0% ➖ noise
6 datafusion:vortex-file-compressed -7.1% -7.1% +0.0% +16.8% ➖ noise
6 duckdb:vortex-compact -4.9% -7.1% +2.4% +10.0% ➖ noise
6 duckdb:vortex-file-compressed -8.2% -7.1% -1.1% +10.0% ➖ noise
7 datafusion:vortex-compact -4.9% -6.7% +2.0% +10.0% ➖ noise
7 datafusion:vortex-file-compressed -16.0% -6.7% -9.9% +21.2% ➖ noise
7 duckdb:vortex-compact -6.1% -6.7% +0.7% +10.0% ➖ noise
7 duckdb:vortex-file-compressed -5.9% -6.7% +0.9% +31.3% ➖ noise
8 datafusion:vortex-compact -13.7% -9.0% -5.1% +23.1% ➖ noise
8 datafusion:vortex-file-compressed +18.9% -9.0% +30.7% +40.4% ➖ noise
8 duckdb:vortex-compact +4.4% -9.0% +14.7% +16.8% ➖ noise
8 duckdb:vortex-file-compressed +3.7% -9.0% +14.0% +25.7% ➖ noise

@github-actions
Copy link
Copy Markdown
Contributor

File Sizes: FineWeb NVMe

No file size changes detected.

@github-actions
Copy link
Copy Markdown
Contributor

github-actions Bot commented Apr 30, 2026

Benchmarks: TPC-DS SF=1 on NVME

Verdict: No clear signal (low confidence)
Attributed Vortex impact: -1.9%
Vortex (geomean): 0.955x ➖
Parquet (geomean): 0.979x ➖
Shifts: Parquet (control) -2.1% · Median polish -3.6%


datafusion / vortex-file-compressed (0.959x ➖, 5↑ 1↓)
name PR d75de6d (ns) base deb7de0 (ns) ratio (PR/base)
tpcds_q01/datafusion:vortex-file-compressed 23516376 25299809 0.93
tpcds_q02/datafusion:vortex-file-compressed 44955152 47000243 0.96
tpcds_q03/datafusion:vortex-file-compressed 14542880 15811927 0.92
tpcds_q04/datafusion:vortex-file-compressed 250011810 254046843 0.98
tpcds_q05/datafusion:vortex-file-compressed 43854721 42752639 1.03
tpcds_q06/datafusion:vortex-file-compressed 60171749 61515974 0.98
tpcds_q07/datafusion:vortex-file-compressed 40632671 43295336 0.94
tpcds_q08/datafusion:vortex-file-compressed 27641753 29816082 0.93
tpcds_q09/datafusion:vortex-file-compressed 41425554 43884979 0.94
tpcds_q10/datafusion:vortex-file-compressed 38595652 39115703 0.99
tpcds_q11/datafusion:vortex-file-compressed 124963496 128488876 0.97
tpcds_q12/datafusion:vortex-file-compressed 19610779 19252818 1.02
tpcds_q13/datafusion:vortex-file-compressed 43468922 43940379 0.99
tpcds_q14/datafusion:vortex-file-compressed 163572110 174708576 0.94
tpcds_q15/datafusion:vortex-file-compressed 27481781 29651836 0.93
tpcds_q16/datafusion:vortex-file-compressed 🚀 27740368 31627380 0.88
tpcds_q17/datafusion:vortex-file-compressed 61767893 63691579 0.97
tpcds_q18/datafusion:vortex-file-compressed 64947925 67216900 0.97
tpcds_q19/datafusion:vortex-file-compressed 23312586 21975374 1.06
tpcds_q20/datafusion:vortex-file-compressed 20789431 20475703 1.02
tpcds_q21/datafusion:vortex-file-compressed 34013403 35601852 0.96
tpcds_q22/datafusion:vortex-file-compressed 🚨 152134699 119739039 1.27
tpcds_q23/datafusion:vortex-file-compressed 155679055 148130307 1.05
tpcds_q24/datafusion:vortex-file-compressed 83225768 82690899 1.01
tpcds_q25/datafusion:vortex-file-compressed 64746166 66763551 0.97
tpcds_q26/datafusion:vortex-file-compressed 32740068 34756063 0.94
tpcds_q27/datafusion:vortex-file-compressed 99232700 101978471 0.97
tpcds_q28/datafusion:vortex-file-compressed 40037069 41303844 0.97
tpcds_q29/datafusion:vortex-file-compressed 61165963 61670633 0.99
tpcds_q30/datafusion:vortex-file-compressed 23610316 23532641 1.00
tpcds_q31/datafusion:vortex-file-compressed 72030409 74621742 0.97
tpcds_q32/datafusion:vortex-file-compressed 19380553 21178258 0.92
tpcds_q33/datafusion:vortex-file-compressed 27301541 30060624 0.91
tpcds_q34/datafusion:vortex-file-compressed 23202801 24603876 0.94
tpcds_q35/datafusion:vortex-file-compressed 43788718 44492693 0.98
tpcds_q36/datafusion:vortex-file-compressed 55384733 58045711 0.95
tpcds_q37/datafusion:vortex-file-compressed 24877301 25175784 0.99
tpcds_q38/datafusion:vortex-file-compressed 42203521 46078550 0.92
tpcds_q39/datafusion:vortex-file-compressed 106151874 106107377 1.00
tpcds_q40/datafusion:vortex-file-compressed 31091538 33615407 0.92
tpcds_q41/datafusion:vortex-file-compressed 🚀 14482677 17081277 0.85
tpcds_q42/datafusion:vortex-file-compressed 13393642 14517025 0.92
tpcds_q43/datafusion:vortex-file-compressed 18015101 18792692 0.96
tpcds_q44/datafusion:vortex-file-compressed 29796089 32871969 0.91
tpcds_q45/datafusion:vortex-file-compressed 25477319 27417506 0.93
tpcds_q46/datafusion:vortex-file-compressed 33397320 34904180 0.96
tpcds_q47/datafusion:vortex-file-compressed 127593595 133386561 0.96
tpcds_q48/datafusion:vortex-file-compressed 36811753 38406867 0.96
tpcds_q49/datafusion:vortex-file-compressed 55429522 57080885 0.97
tpcds_q50/datafusion:vortex-file-compressed 38031835 41088138 0.93
tpcds_q51/datafusion:vortex-file-compressed 83694238 88934422 0.94
tpcds_q52/datafusion:vortex-file-compressed 13435149 14534384 0.92
tpcds_q53/datafusion:vortex-file-compressed 20009696 21285350 0.94
tpcds_q54/datafusion:vortex-file-compressed 34317466 35274758 0.97
tpcds_q55/datafusion:vortex-file-compressed 12947271 13867276 0.93
tpcds_q56/datafusion:vortex-file-compressed 27744863 30750778 0.90
tpcds_q57/datafusion:vortex-file-compressed 104659930 103876659 1.01
tpcds_q58/datafusion:vortex-file-compressed 50441273 54506677 0.93
tpcds_q59/datafusion:vortex-file-compressed 54769997 57116935 0.96
tpcds_q60/datafusion:vortex-file-compressed 🚀 27279031 30319214 0.90
tpcds_q61/datafusion:vortex-file-compressed 37694931 40575513 0.93
tpcds_q62/datafusion:vortex-file-compressed 26451304 26921669 0.98
tpcds_q63/datafusion:vortex-file-compressed 🚀 19554283 22129544 0.88
tpcds_q64/datafusion:vortex-file-compressed 394493124 404488503 0.98
tpcds_q65/datafusion:vortex-file-compressed 41685840 41834818 1.00
tpcds_q66/datafusion:vortex-file-compressed 66629941 72788997 0.92
tpcds_q67/datafusion:vortex-file-compressed 142046113 144867919 0.98
tpcds_q68/datafusion:vortex-file-compressed 30674933 32558727 0.94
tpcds_q69/datafusion:vortex-file-compressed 34339263 37625528 0.91
tpcds_q70/datafusion:vortex-file-compressed 83220901 87356607 0.95
tpcds_q71/datafusion:vortex-file-compressed 22446502 22878455 0.98
tpcds_q72/datafusion:vortex-file-compressed 2147833380 2191239413 0.98
tpcds_q73/datafusion:vortex-file-compressed 21805979 23496493 0.93
tpcds_q74/datafusion:vortex-file-compressed 79371948 77217098 1.03
tpcds_q75/datafusion:vortex-file-compressed 102805176 110381183 0.93
tpcds_q76/datafusion:vortex-file-compressed 24698492 23723310 1.04
tpcds_q77/datafusion:vortex-file-compressed 38154137 39751890 0.96
tpcds_q78/datafusion:vortex-file-compressed 120066657 124632207 0.96
tpcds_q79/datafusion:vortex-file-compressed 28793297 29357660 0.98
tpcds_q80/datafusion:vortex-file-compressed 88907021 93260522 0.95
tpcds_q81/datafusion:vortex-file-compressed 23081899 23951421 0.96
tpcds_q82/datafusion:vortex-file-compressed 25884778 26475208 0.98
tpcds_q83/datafusion:vortex-file-compressed 31845105 33359263 0.95
tpcds_q84/datafusion:vortex-file-compressed 12599277 13262440 0.95
tpcds_q85/datafusion:vortex-file-compressed 85775533 94064757 0.91
tpcds_q86/datafusion:vortex-file-compressed 16286140 17048526 0.96
tpcds_q87/datafusion:vortex-file-compressed 42263528 45786167 0.92
tpcds_q88/datafusion:vortex-file-compressed 54739348 55772002 0.98
tpcds_q89/datafusion:vortex-file-compressed 23565533 24604996 0.96
tpcds_q90/datafusion:vortex-file-compressed 14123994 15082061 0.94
tpcds_q91/datafusion:vortex-file-compressed 18637920 18821697 0.99
tpcds_q92/datafusion:vortex-file-compressed 17768749 19391517 0.92
tpcds_q93/datafusion:vortex-file-compressed 33029241 34821691 0.95
tpcds_q94/datafusion:vortex-file-compressed 🚀 21823218 25011251 0.87
tpcds_q95/datafusion:vortex-file-compressed 57449080 58321182 0.99
tpcds_q96/datafusion:vortex-file-compressed 13208651 13950759 0.95
tpcds_q97/datafusion:vortex-file-compressed 31680348 31523906 1.00
tpcds_q98/datafusion:vortex-file-compressed 23525370 23787288 0.99
tpcds_q99/datafusion:vortex-file-compressed 27496073 29119516 0.94
datafusion / vortex-compact (0.942x ➖, 12↑ 0↓)
name PR d75de6d (ns) base deb7de0 (ns) ratio (PR/base)
tpcds_q01/datafusion:vortex-compact 25017633 27002209 0.93
tpcds_q02/datafusion:vortex-compact 51256110 54070335 0.95
tpcds_q03/datafusion:vortex-compact 19910409 19357440 1.03
tpcds_q04/datafusion:vortex-compact 291444541 291043740 1.00
tpcds_q05/datafusion:vortex-compact 🚀 43954116 48938553 0.90
tpcds_q06/datafusion:vortex-compact 61270560 60197317 1.02
tpcds_q07/datafusion:vortex-compact 50864137 52373758 0.97
tpcds_q08/datafusion:vortex-compact 32913592 35631103 0.92
tpcds_q09/datafusion:vortex-compact 58370525 62410583 0.94
tpcds_q10/datafusion:vortex-compact 48906755 50470447 0.97
tpcds_q11/datafusion:vortex-compact 141308096 150915898 0.94
tpcds_q12/datafusion:vortex-compact 21203797 22500801 0.94
tpcds_q13/datafusion:vortex-compact 89184399 93985456 0.95
tpcds_q14/datafusion:vortex-compact 188435311 207620229 0.91
tpcds_q15/datafusion:vortex-compact 28436571 30685472 0.93
tpcds_q16/datafusion:vortex-compact 30832683 32499961 0.95
tpcds_q17/datafusion:vortex-compact 70438255 73040311 0.96
tpcds_q18/datafusion:vortex-compact 75276969 75649584 1.00
tpcds_q19/datafusion:vortex-compact 28134518 30028138 0.94
tpcds_q20/datafusion:vortex-compact 23789153 25821945 0.92
tpcds_q21/datafusion:vortex-compact 37366208 39505249 0.95
tpcds_q22/datafusion:vortex-compact 116648487 124074282 0.94
tpcds_q23/datafusion:vortex-compact 160774198 163209440 0.99
tpcds_q24/datafusion:vortex-compact 94024994 96104631 0.98
tpcds_q25/datafusion:vortex-compact 76639758 79932145 0.96
tpcds_q26/datafusion:vortex-compact 41790819 46240918 0.90
tpcds_q27/datafusion:vortex-compact 125632757 123050732 1.02
tpcds_q28/datafusion:vortex-compact 73428302 79575272 0.92
tpcds_q29/datafusion:vortex-compact 72940027 73431688 0.99
tpcds_q30/datafusion:vortex-compact 26848566 28231154 0.95
tpcds_q31/datafusion:vortex-compact 93277194 98559865 0.95
tpcds_q32/datafusion:vortex-compact 25370318 26264550 0.97
tpcds_q33/datafusion:vortex-compact 🚀 33161125 36943196 0.90
tpcds_q34/datafusion:vortex-compact 29922017 32324295 0.93
tpcds_q35/datafusion:vortex-compact 48674657 51163855 0.95
tpcds_q36/datafusion:vortex-compact 71990003 78085303 0.92
tpcds_q37/datafusion:vortex-compact 37086562 40609959 0.91
tpcds_q38/datafusion:vortex-compact 🚀 48032108 53903224 0.89
tpcds_q39/datafusion:vortex-compact 109540989 116309031 0.94
tpcds_q40/datafusion:vortex-compact 34671817 36998910 0.94
tpcds_q41/datafusion:vortex-compact 🚀 16650276 18732680 0.89
tpcds_q42/datafusion:vortex-compact 17948408 18834360 0.95
tpcds_q43/datafusion:vortex-compact 23183414 25577453 0.91
tpcds_q44/datafusion:vortex-compact 45785701 50786758 0.90
tpcds_q45/datafusion:vortex-compact 29510144 30805253 0.96
tpcds_q46/datafusion:vortex-compact 42055343 44671177 0.94
tpcds_q47/datafusion:vortex-compact 144692292 152130817 0.95
tpcds_q48/datafusion:vortex-compact 67465735 71749526 0.94
tpcds_q49/datafusion:vortex-compact 🚀 64516348 72147250 0.89
tpcds_q50/datafusion:vortex-compact 47089131 47108341 1.00
tpcds_q51/datafusion:vortex-compact 90834770 95244396 0.95
tpcds_q52/datafusion:vortex-compact 17559277 18456681 0.95
tpcds_q53/datafusion:vortex-compact 26683903 27996625 0.95
tpcds_q54/datafusion:vortex-compact 41846038 41729756 1.00
tpcds_q55/datafusion:vortex-compact 17413320 18548440 0.94
tpcds_q56/datafusion:vortex-compact 33962528 35837205 0.95
tpcds_q57/datafusion:vortex-compact 116530249 116326461 1.00
tpcds_q58/datafusion:vortex-compact 59384769 62826380 0.95
tpcds_q59/datafusion:vortex-compact 66467411 69828587 0.95
tpcds_q60/datafusion:vortex-compact 🚀 32762510 36423185 0.90
tpcds_q61/datafusion:vortex-compact 52278548 54458249 0.96
tpcds_q62/datafusion:vortex-compact 🚀 23953504 28374196 0.84
tpcds_q63/datafusion:vortex-compact 26248435 29080136 0.90
tpcds_q64/datafusion:vortex-compact 446381262 448497072 1.00
tpcds_q65/datafusion:vortex-compact 51826801 55157858 0.94
tpcds_q66/datafusion:vortex-compact 74078969 74589644 0.99
tpcds_q67/datafusion:vortex-compact 149465201 153614448 0.97
tpcds_q68/datafusion:vortex-compact 42810712 45397108 0.94
tpcds_q69/datafusion:vortex-compact 45176081 46906113 0.96
tpcds_q70/datafusion:vortex-compact 96464692 97430028 0.99
tpcds_q71/datafusion:vortex-compact 28416164 30333878 0.94
tpcds_q72/datafusion:vortex-compact 2090738434 2149466015 0.97
tpcds_q73/datafusion:vortex-compact 28704135 30584261 0.94
tpcds_q74/datafusion:vortex-compact 87134373 93615107 0.93
tpcds_q75/datafusion:vortex-compact 120973657 127930806 0.95
tpcds_q76/datafusion:vortex-compact 31056924 33179048 0.94
tpcds_q77/datafusion:vortex-compact 47458439 50828360 0.93
tpcds_q78/datafusion:vortex-compact 130144735 137049070 0.95
tpcds_q79/datafusion:vortex-compact 37053183 37678508 0.98
tpcds_q80/datafusion:vortex-compact 96614361 104253828 0.93
tpcds_q81/datafusion:vortex-compact 🚀 24902170 30951157 0.80
tpcds_q82/datafusion:vortex-compact 37975312 40672198 0.93
tpcds_q83/datafusion:vortex-compact 32358638 33742803 0.96
tpcds_q84/datafusion:vortex-compact 🚀 13398089 15563992 0.86
tpcds_q85/datafusion:vortex-compact 122587554 129332231 0.95
tpcds_q86/datafusion:vortex-compact 🚀 17153779 22670410 0.76
tpcds_q87/datafusion:vortex-compact 49079547 53056315 0.93
tpcds_q88/datafusion:vortex-compact 71814032 75656644 0.95
tpcds_q89/datafusion:vortex-compact 29208128 31660520 0.92
tpcds_q90/datafusion:vortex-compact 🚀 14122399 16276778 0.87
tpcds_q91/datafusion:vortex-compact 30086302 33084649 0.91
tpcds_q92/datafusion:vortex-compact 22855864 25137540 0.91
tpcds_q93/datafusion:vortex-compact 38264774 39209962 0.98
tpcds_q94/datafusion:vortex-compact 26529034 26440450 1.00
tpcds_q95/datafusion:vortex-compact 59140044 62830982 0.94
tpcds_q96/datafusion:vortex-compact 16211963 17677620 0.92
tpcds_q97/datafusion:vortex-compact 🚀 33948318 37721597 0.90
tpcds_q98/datafusion:vortex-compact 28131077 29242686 0.96
tpcds_q99/datafusion:vortex-compact 34657671 31793842 1.09
datafusion / parquet (0.967x ➖, 3↑ 0↓)
name PR d75de6d (ns) base deb7de0 (ns) ratio (PR/base)
tpcds_q01/datafusion:parquet 30256417 30643773 0.99
tpcds_q02/datafusion:parquet 40308277 43907643 0.92
tpcds_q03/datafusion:parquet 13074943 13784149 0.95
tpcds_q04/datafusion:parquet 263998773 274512896 0.96
tpcds_q05/datafusion:parquet 38888281 41972462 0.93
tpcds_q06/datafusion:parquet 59190894 60423069 0.98
tpcds_q07/datafusion:parquet 78580202 79226327 0.99
tpcds_q08/datafusion:parquet 24984261 26154982 0.96
tpcds_q09/datafusion:parquet 42328134 44415314 0.95
tpcds_q10/datafusion:parquet 78528603 75162868 1.04
tpcds_q11/datafusion:parquet 146705042 145466281 1.01
tpcds_q12/datafusion:parquet 16467292 16122597 1.02
tpcds_q13/datafusion:parquet 74800326 76101952 0.98
tpcds_q14/datafusion:parquet 157377152 163989671 0.96
tpcds_q15/datafusion:parquet 20589001 22271102 0.92
tpcds_q16/datafusion:parquet 23181179 23904792 0.97
tpcds_q17/datafusion:parquet 61481586 66867223 0.92
tpcds_q18/datafusion:parquet 115206554 117062894 0.98
tpcds_q19/datafusion:parquet 22562752 23500692 0.96
tpcds_q20/datafusion:parquet 16967359 16083948 1.05
tpcds_q21/datafusion:parquet 19607486 19582105 1.00
tpcds_q22/datafusion:parquet 143520716 143081736 1.00
tpcds_q23/datafusion:parquet 144802113 144148868 1.00
tpcds_q24/datafusion:parquet 90561273 92519278 0.98
tpcds_q25/datafusion:parquet 62896206 63893306 0.98
tpcds_q26/datafusion:parquet 66226314 67958456 0.97
tpcds_q27/datafusion:parquet 144213454 148725005 0.97
tpcds_q28/datafusion:parquet 44104130 44444309 0.99
tpcds_q29/datafusion:parquet 65038629 64845660 1.00
tpcds_q30/datafusion:parquet 33909340 35331098 0.96
tpcds_q31/datafusion:parquet 62769668 64601065 0.97
tpcds_q32/datafusion:parquet 17786312 18402679 0.97
tpcds_q33/datafusion:parquet 25379505 26696558 0.95
tpcds_q34/datafusion:parquet 20550427 21441632 0.96
tpcds_q35/datafusion:parquet 73245753 72573564 1.01
tpcds_q36/datafusion:parquet 53521722 56435321 0.95
tpcds_q37/datafusion:parquet 20084023 19234782 1.04
tpcds_q38/datafusion:parquet 40654194 40397742 1.01
tpcds_q39/datafusion:parquet 71978266 72842204 0.99
tpcds_q40/datafusion:parquet 23859759 24790966 0.96
tpcds_q41/datafusion:parquet 13130727 13399980 0.98
tpcds_q42/datafusion:parquet 11597445 11704601 0.99
tpcds_q43/datafusion:parquet 16403856 16675215 0.98
tpcds_q44/datafusion:parquet 31715976 33091331 0.96
tpcds_q45/datafusion:parquet 27253058 29209984 0.93
tpcds_q46/datafusion:parquet 31696263 33040597 0.96
tpcds_q47/datafusion:parquet 123219879 125123982 0.98
tpcds_q48/datafusion:parquet 70636617 73537696 0.96
tpcds_q49/datafusion:parquet 53598412 54222230 0.99
tpcds_q50/datafusion:parquet 45161941 43190664 1.05
tpcds_q51/datafusion:parquet 80566227 86325852 0.93
tpcds_q52/datafusion:parquet 11760970 12607250 0.93
tpcds_q53/datafusion:parquet 17189951 18482132 0.93
tpcds_q54/datafusion:parquet 32950750 34588423 0.95
tpcds_q55/datafusion:parquet 11414163 11939654 0.96
tpcds_q56/datafusion:parquet 26119060 26018335 1.00
tpcds_q57/datafusion:parquet 98915541 96543143 1.02
tpcds_q58/datafusion:parquet 47860454 50626837 0.95
tpcds_q59/datafusion:parquet 50973104 52854928 0.96
tpcds_q60/datafusion:parquet 25272887 27520647 0.92
tpcds_q61/datafusion:parquet 39951146 41790761 0.96
tpcds_q62/datafusion:parquet 23519765 25230952 0.93
tpcds_q63/datafusion:parquet 17091316 17852721 0.96
tpcds_q64/datafusion:parquet 518102667 517339538 1.00
tpcds_q65/datafusion:parquet 37586645 36869187 1.02
tpcds_q66/datafusion:parquet 🚀 61602840 69992236 0.88
tpcds_q67/datafusion:parquet 141104561 139062571 1.01
tpcds_q68/datafusion:parquet 31413504 32161567 0.98
tpcds_q69/datafusion:parquet 70462206 69728741 1.01
tpcds_q70/datafusion:parquet 82043037 89740040 0.91
tpcds_q71/datafusion:parquet 21476719 23389127 0.92
tpcds_q72/datafusion:parquet 588873994 606122053 0.97
tpcds_q73/datafusion:parquet 20961567 21590518 0.97
tpcds_q74/datafusion:parquet 81736906 82056085 1.00
tpcds_q75/datafusion:parquet 94466582 99371023 0.95
tpcds_q76/datafusion:parquet 28885239 30986736 0.93
tpcds_q77/datafusion:parquet 36343665 38566831 0.94
tpcds_q78/datafusion:parquet 108096323 112734226 0.96
tpcds_q79/datafusion:parquet 25823773 26456424 0.98
tpcds_q80/datafusion:parquet 74802687 77725899 0.96
tpcds_q81/datafusion:parquet 30327782 33040543 0.92
tpcds_q82/datafusion:parquet 18745734 19104723 0.98
tpcds_q83/datafusion:parquet 37093953 39044141 0.95
tpcds_q84/datafusion:parquet 38809009 39376669 0.99
tpcds_q85/datafusion:parquet 147279591 150087064 0.98
tpcds_q86/datafusion:parquet 🚀 13534044 15576687 0.87
tpcds_q87/datafusion:parquet 38974345 42804276 0.91
tpcds_q88/datafusion:parquet 55718301 58597045 0.95
tpcds_q89/datafusion:parquet 19727960 21497334 0.92
tpcds_q90/datafusion:parquet 14278785 13903519 1.03
tpcds_q91/datafusion:parquet 58082571 61792550 0.94
tpcds_q92/datafusion:parquet 16870837 18403186 0.92
tpcds_q93/datafusion:parquet 30083414 31156726 0.97
tpcds_q94/datafusion:parquet 18904417 19722373 0.96
tpcds_q95/datafusion:parquet 57069576 56813329 1.00
tpcds_q96/datafusion:parquet 🚀 11139130 13127248 0.85
tpcds_q97/datafusion:parquet 29094358 30273736 0.96
tpcds_q98/datafusion:parquet 20986787 21526070 0.97
tpcds_q99/datafusion:parquet 24958300 24689550 1.01
duckdb / vortex-file-compressed (0.956x ➖, 11↑ 1↓)
name PR d75de6d (ns) base deb7de0 (ns) ratio (PR/base)
tpcds_q01/duckdb:vortex-file-compressed 20774783 21526775 0.97
tpcds_q02/duckdb:vortex-file-compressed 33776051 32800157 1.03
tpcds_q03/duckdb:vortex-file-compressed 30789223 33176489 0.93
tpcds_q04/duckdb:vortex-file-compressed 98715941 109099786 0.90
tpcds_q05/duckdb:vortex-file-compressed 37181487 36516233 1.02
tpcds_q06/duckdb:vortex-file-compressed 32011920 32161113 1.00
tpcds_q07/duckdb:vortex-file-compressed 🚀 18266927 20313772 0.90
tpcds_q08/duckdb:vortex-file-compressed 27183628 28506855 0.95
tpcds_q09/duckdb:vortex-file-compressed 35207891 36987729 0.95
tpcds_q10/duckdb:vortex-file-compressed 38728212 40577528 0.95
tpcds_q11/duckdb:vortex-file-compressed 60653383 62264856 0.97
tpcds_q12/duckdb:vortex-file-compressed 14080201 14890031 0.95
tpcds_q13/duckdb:vortex-file-compressed 32155134 32949659 0.98
tpcds_q14/duckdb:vortex-file-compressed 105239567 111319919 0.95
tpcds_q15/duckdb:vortex-file-compressed 26196867 26910841 0.97
tpcds_q16/duckdb:vortex-file-compressed 🚀 24791294 27726259 0.89
tpcds_q17/duckdb:vortex-file-compressed 41134962 43202068 0.95
tpcds_q18/duckdb:vortex-file-compressed 43749072 46614477 0.94
tpcds_q19/duckdb:vortex-file-compressed 32015015 32726121 0.98
tpcds_q20/duckdb:vortex-file-compressed 🚀 14304745 15910189 0.90
tpcds_q21/duckdb:vortex-file-compressed 16299448 17433321 0.93
tpcds_q22/duckdb:vortex-file-compressed 74115713 74345718 1.00
tpcds_q23/duckdb:vortex-file-compressed 103479584 108990472 0.95
tpcds_q24/duckdb:vortex-file-compressed 47366178 50961498 0.93
tpcds_q25/duckdb:vortex-file-compressed 47164425 48114161 0.98
tpcds_q26/duckdb:vortex-file-compressed 39093945 40393377 0.97
tpcds_q27/duckdb:vortex-file-compressed 🚀 43044358 48584539 0.89
tpcds_q28/duckdb:vortex-file-compressed 35339450 34852249 1.01
tpcds_q29/duckdb:vortex-file-compressed 40528418 42179228 0.96
tpcds_q30/duckdb:vortex-file-compressed 23824305 24819438 0.96
tpcds_q31/duckdb:vortex-file-compressed 33498870 35838750 0.93
tpcds_q32/duckdb:vortex-file-compressed 13286707 14260648 0.93
tpcds_q33/duckdb:vortex-file-compressed 23291629 23731944 0.98
tpcds_q34/duckdb:vortex-file-compressed 22232266 23138533 0.96
tpcds_q35/duckdb:vortex-file-compressed 62917798 66042321 0.95
tpcds_q36/duckdb:vortex-file-compressed 25223339 25161352 1.00
tpcds_q37/duckdb:vortex-file-compressed 14763022 16041702 0.92
tpcds_q38/duckdb:vortex-file-compressed 35105220 36419567 0.96
tpcds_q39/duckdb:vortex-file-compressed 34054106 34304004 0.99
tpcds_q40/duckdb:vortex-file-compressed 19345116 19140046 1.01
tpcds_q41/duckdb:vortex-file-compressed 12388870 13373223 0.93
tpcds_q42/duckdb:vortex-file-compressed 🚀 11497916 13629938 0.84
tpcds_q43/duckdb:vortex-file-compressed 22082729 22670036 0.97
tpcds_q44/duckdb:vortex-file-compressed 21776727 21199900 1.03
tpcds_q45/duckdb:vortex-file-compressed 27832833 29197470 0.95
tpcds_q46/duckdb:vortex-file-compressed 49976833 50971276 0.98
tpcds_q47/duckdb:vortex-file-compressed 46897946 46736753 1.00
tpcds_q48/duckdb:vortex-file-compressed 🚀 29170485 32530226 0.90
tpcds_q49/duckdb:vortex-file-compressed 34987466 36337581 0.96
tpcds_q50/duckdb:vortex-file-compressed 32809054 34111153 0.96
tpcds_q51/duckdb:vortex-file-compressed 96440295 103501940 0.93
tpcds_q52/duckdb:vortex-file-compressed 12080884 12802132 0.94
tpcds_q53/duckdb:vortex-file-compressed 22054467 22996020 0.96
tpcds_q54/duckdb:vortex-file-compressed 26942557 28476338 0.95
tpcds_q55/duckdb:vortex-file-compressed 🚀 12345499 14383742 0.86
tpcds_q56/duckdb:vortex-file-compressed 22742187 24473467 0.93
tpcds_q57/duckdb:vortex-file-compressed 39712907 39661253 1.00
tpcds_q58/duckdb:vortex-file-compressed 29269188 28759253 1.02
tpcds_q59/duckdb:vortex-file-compressed 68382912 68563721 1.00
tpcds_q60/duckdb:vortex-file-compressed 24681367 24997991 0.99
tpcds_q61/duckdb:vortex-file-compressed 30181721 31071685 0.97
tpcds_q62/duckdb:vortex-file-compressed 16476558 17697375 0.93
tpcds_q63/duckdb:vortex-file-compressed 20910099 23067567 0.91
tpcds_q64/duckdb:vortex-file-compressed 80247087 83190114 0.96
tpcds_q65/duckdb:vortex-file-compressed 21684726 21653714 1.00
tpcds_q66/duckdb:vortex-file-compressed 29562305 30403087 0.97
tpcds_q67/duckdb:vortex-file-compressed 136483208 141160477 0.97
tpcds_q68/duckdb:vortex-file-compressed 38950512 39890396 0.98
tpcds_q69/duckdb:vortex-file-compressed 41456269 42461215 0.98
tpcds_q70/duckdb:vortex-file-compressed 25420068 25381545 1.00
tpcds_q71/duckdb:vortex-file-compressed 20948617 22203565 0.94
tpcds_q72/duckdb:vortex-file-compressed 173082087 173410489 1.00
tpcds_q73/duckdb:vortex-file-compressed 22675746 24133126 0.94
tpcds_q74/duckdb:vortex-file-compressed 71665949 72439213 0.99
tpcds_q75/duckdb:vortex-file-compressed 56439253 58870231 0.96
tpcds_q76/duckdb:vortex-file-compressed 17485061 18212218 0.96
tpcds_q77/duckdb:vortex-file-compressed 🚨 27575114 24733247 1.11
tpcds_q78/duckdb:vortex-file-compressed 77072688 77506081 0.99
tpcds_q79/duckdb:vortex-file-compressed 31452637 32365806 0.97
tpcds_q80/duckdb:vortex-file-compressed 44553847 47232507 0.94
tpcds_q81/duckdb:vortex-file-compressed 27448663 29948875 0.92
tpcds_q82/duckdb:vortex-file-compressed 16237714 16963460 0.96
tpcds_q83/duckdb:vortex-file-compressed 22511897 24836175 0.91
tpcds_q84/duckdb:vortex-file-compressed 18792423 20068339 0.94
tpcds_q85/duckdb:vortex-file-compressed 44284294 46483816 0.95
tpcds_q86/duckdb:vortex-file-compressed 🚀 14839773 16942171 0.88
tpcds_q87/duckdb:vortex-file-compressed 40158949 42706053 0.94
tpcds_q88/duckdb:vortex-file-compressed 32052085 33002873 0.97
tpcds_q89/duckdb:vortex-file-compressed 22674533 22676811 1.00
tpcds_q90/duckdb:vortex-file-compressed 12134362 13292752 0.91
tpcds_q91/duckdb:vortex-file-compressed 🚀 28783975 32380280 0.89
tpcds_q92/duckdb:vortex-file-compressed 🚀 19419022 22661938 0.86
tpcds_q93/duckdb:vortex-file-compressed 27069396 27249691 0.99
tpcds_q94/duckdb:vortex-file-compressed 21881737 23042063 0.95
tpcds_q95/duckdb:vortex-file-compressed 🚀 129963709 149062056 0.87
tpcds_q96/duckdb:vortex-file-compressed 13452323 13232101 1.02
tpcds_q97/duckdb:vortex-file-compressed 37624309 39534421 0.95
tpcds_q98/duckdb:vortex-file-compressed 17765550 18518248 0.96
tpcds_q99/duckdb:vortex-file-compressed 25571045 27131571 0.94
duckdb / vortex-compact (0.966x ➖, 6↑ 1↓)
name PR d75de6d (ns) base deb7de0 (ns) ratio (PR/base)
tpcds_q01/duckdb:vortex-compact 22992655 23857152 0.96
tpcds_q02/duckdb:vortex-compact 38320852 37302844 1.03
tpcds_q03/duckdb:vortex-compact 54862230 57852066 0.95
tpcds_q04/duckdb:vortex-compact 121325336 122420882 0.99
tpcds_q05/duckdb:vortex-compact 51761662 51021925 1.01
tpcds_q06/duckdb:vortex-compact 38452531 40653558 0.95
tpcds_q07/duckdb:vortex-compact 32565982 35423667 0.92
tpcds_q08/duckdb:vortex-compact 43137167 45416349 0.95
tpcds_q09/duckdb:vortex-compact 55300896 57839613 0.96
tpcds_q10/duckdb:vortex-compact 58126441 64199635 0.91
tpcds_q11/duckdb:vortex-compact 72332709 72968394 0.99
tpcds_q12/duckdb:vortex-compact 21587622 23758873 0.91
tpcds_q13/duckdb:vortex-compact 🚀 55452154 63062058 0.88
tpcds_q14/duckdb:vortex-compact 126129443 131220521 0.96
tpcds_q15/duckdb:vortex-compact 30919533 31139804 0.99
tpcds_q16/duckdb:vortex-compact 29839302 32060990 0.93
tpcds_q17/duckdb:vortex-compact 53722045 53749774 1.00
tpcds_q18/duckdb:vortex-compact 56824597 59071171 0.96
tpcds_q19/duckdb:vortex-compact 52077006 50855538 1.02
tpcds_q20/duckdb:vortex-compact 19746609 20854359 0.95
tpcds_q21/duckdb:vortex-compact 🚀 18462417 21904895 0.84
tpcds_q22/duckdb:vortex-compact 77139069 80968070 0.95
tpcds_q23/duckdb:vortex-compact 🚀 118914057 133911673 0.89
tpcds_q24/duckdb:vortex-compact 62009754 61980215 1.00
tpcds_q25/duckdb:vortex-compact 78003041 80053229 0.97
tpcds_q26/duckdb:vortex-compact 52182567 51796728 1.01
tpcds_q27/duckdb:vortex-compact 68126579 69109679 0.99
tpcds_q28/duckdb:vortex-compact 82007744 84308850 0.97
tpcds_q29/duckdb:vortex-compact 53624643 53946446 0.99
tpcds_q30/duckdb:vortex-compact 27424062 29056031 0.94
tpcds_q31/duckdb:vortex-compact 45180174 47014952 0.96
tpcds_q32/duckdb:vortex-compact 21832487 22656970 0.96
tpcds_q33/duckdb:vortex-compact 33609760 36246493 0.93
tpcds_q34/duckdb:vortex-compact 36397957 38641240 0.94
tpcds_q35/duckdb:vortex-compact 80239108 83232227 0.96
tpcds_q36/duckdb:vortex-compact 39449094 40829259 0.97
tpcds_q37/duckdb:vortex-compact 22758598 24572638 0.93
tpcds_q38/duckdb:vortex-compact 47468651 47478620 1.00
tpcds_q39/duckdb:vortex-compact 36612989 36675654 1.00
tpcds_q40/duckdb:vortex-compact 24414795 26916548 0.91
tpcds_q41/duckdb:vortex-compact 🚀 14687195 16343579 0.90
tpcds_q42/duckdb:vortex-compact 20662617 22208139 0.93
tpcds_q43/duckdb:vortex-compact 35981226 34867281 1.03
tpcds_q44/duckdb:vortex-compact 28836799 30913362 0.93
tpcds_q45/duckdb:vortex-compact 36567818 37998991 0.96
tpcds_q46/duckdb:vortex-compact 69176720 69508384 1.00
tpcds_q47/duckdb:vortex-compact 61288912 64872368 0.94
tpcds_q48/duckdb:vortex-compact 49945395 51454624 0.97
tpcds_q49/duckdb:vortex-compact 56099657 56433883 0.99
tpcds_q50/duckdb:vortex-compact 44947215 46849542 0.96
tpcds_q51/duckdb:vortex-compact 106457385 109795345 0.97
tpcds_q52/duckdb:vortex-compact 21130075 22683581 0.93
tpcds_q53/duckdb:vortex-compact 36310865 38483546 0.94
tpcds_q54/duckdb:vortex-compact 39288208 38993243 1.01
tpcds_q55/duckdb:vortex-compact 21859644 24264358 0.90
tpcds_q56/duckdb:vortex-compact 34363694 35532300 0.97
tpcds_q57/duckdb:vortex-compact 43348965 43433309 1.00
tpcds_q58/duckdb:vortex-compact 43091422 41560064 1.04
tpcds_q59/duckdb:vortex-compact 89018974 87841031 1.01
tpcds_q60/duckdb:vortex-compact 38098708 37060439 1.03
tpcds_q61/duckdb:vortex-compact 64499564 60437167 1.07
tpcds_q62/duckdb:vortex-compact 25986750 26087856 1.00
tpcds_q63/duckdb:vortex-compact 35967839 37973222 0.95
tpcds_q64/duckdb:vortex-compact 113290849 115962206 0.98
tpcds_q65/duckdb:vortex-compact 31701757 32609830 0.97
tpcds_q66/duckdb:vortex-compact 37396208 40470493 0.92
tpcds_q67/duckdb:vortex-compact 154038189 155967556 0.99
tpcds_q68/duckdb:vortex-compact 59015222 61963643 0.95
tpcds_q69/duckdb:vortex-compact 60074933 61711769 0.97
tpcds_q70/duckdb:vortex-compact 35181310 37358646 0.94
tpcds_q71/duckdb:vortex-compact 31842444 34284971 0.93
tpcds_q72/duckdb:vortex-compact 191902816 195092870 0.98
tpcds_q73/duckdb:vortex-compact 36767486 36612005 1.00
tpcds_q74/duckdb:vortex-compact 79274266 80374877 0.99
tpcds_q75/duckdb:vortex-compact 68314198 70855789 0.96
tpcds_q76/duckdb:vortex-compact 34834800 35146756 0.99
tpcds_q77/duckdb:vortex-compact 42943966 40758703 1.05
tpcds_q78/duckdb:vortex-compact 86771861 87342874 0.99
tpcds_q79/duckdb:vortex-compact 53986106 55401377 0.97
tpcds_q80/duckdb:vortex-compact 76969813 81048547 0.95
tpcds_q81/duckdb:vortex-compact 32683136 33328161 0.98
tpcds_q82/duckdb:vortex-compact 25552942 24860271 1.03
tpcds_q83/duckdb:vortex-compact 32651563 32240853 1.01
tpcds_q84/duckdb:vortex-compact 26025844 27331484 0.95
tpcds_q85/duckdb:vortex-compact 🚀 54614465 62403052 0.88
tpcds_q86/duckdb:vortex-compact 🚀 21561991 25327787 0.85
tpcds_q87/duckdb:vortex-compact 48536538 49096793 0.99
tpcds_q88/duckdb:vortex-compact 39094107 40534495 0.96
tpcds_q89/duckdb:vortex-compact 36593501 37748614 0.97
tpcds_q90/duckdb:vortex-compact 14878680 15028826 0.99
tpcds_q91/duckdb:vortex-compact 49697819 51629008 0.96
tpcds_q92/duckdb:vortex-compact 53272360 52429123 1.02
tpcds_q93/duckdb:vortex-compact 30798473 33116687 0.93
tpcds_q94/duckdb:vortex-compact 30967186 32453580 0.95
tpcds_q95/duckdb:vortex-compact 🚨 164182663 145526875 1.13
tpcds_q96/duckdb:vortex-compact 16938389 18461774 0.92
tpcds_q97/duckdb:vortex-compact 45401470 45168210 1.01
tpcds_q98/duckdb:vortex-compact 27630485 29132868 0.95
tpcds_q99/duckdb:vortex-compact 30065770 31186956 0.96
duckdb / parquet (0.992x ➖, 1↑ 2↓)
name PR d75de6d (ns) base deb7de0 (ns) ratio (PR/base)
tpcds_q01/duckdb:parquet 28007412 27180205 1.03
tpcds_q02/duckdb:parquet 22888842 24094344 0.95
tpcds_q03/duckdb:parquet 🚀 11356856 13147785 0.86
tpcds_q04/duckdb:parquet 169368254 166099352 1.02
tpcds_q05/duckdb:parquet 28337940 27179138 1.04
tpcds_q06/duckdb:parquet 27617524 27496231 1.00
tpcds_q07/duckdb:parquet 20871609 20807642 1.00
tpcds_q08/duckdb:parquet 26226127 26899424 0.97
tpcds_q09/duckdb:parquet 40431940 39170116 1.03
tpcds_q10/duckdb:parquet 32847869 34043232 0.96
tpcds_q11/duckdb:parquet 84124148 89401337 0.94
tpcds_q12/duckdb:parquet 14836731 14452729 1.03
tpcds_q13/duckdb:parquet 32933432 33493335 0.98
tpcds_q14/duckdb:parquet 100087945 99653627 1.00
tpcds_q15/duckdb:parquet 28763051 30846219 0.93
tpcds_q16/duckdb:parquet 19860009 21344389 0.93
tpcds_q17/duckdb:parquet 36441500 36707221 0.99
tpcds_q18/duckdb:parquet 43982852 46862288 0.94
tpcds_q19/duckdb:parquet 28275357 28664480 0.99
tpcds_q20/duckdb:parquet 15038869 16061524 0.94
tpcds_q21/duckdb:parquet 🚨 11197470 10175698 1.10
tpcds_q22/duckdb:parquet 68709184 67630960 1.02
tpcds_q23/duckdb:parquet 80445463 79109727 1.02
tpcds_q24/duckdb:parquet 43283287 45719815 0.95
tpcds_q25/duckdb:parquet 31659259 31549549 1.00
tpcds_q26/duckdb:parquet 36456611 35234397 1.03
tpcds_q27/duckdb:parquet 49053420 50015599 0.98
tpcds_q28/duckdb:parquet 37974111 37484727 1.01
tpcds_q29/duckdb:parquet 37311920 34427490 1.08
tpcds_q30/duckdb:parquet 34409968 34273420 1.00
tpcds_q31/duckdb:parquet 22690963 22783371 1.00
tpcds_q32/duckdb:parquet 11935675 12720569 0.94
tpcds_q33/duckdb:parquet 21659598 20549886 1.05
tpcds_q34/duckdb:parquet 20262857 20622515 0.98
tpcds_q35/duckdb:parquet 55812145 55759722 1.00
tpcds_q36/duckdb:parquet 19516793 19826612 0.98
tpcds_q37/duckdb:parquet 12051067 12268699 0.98
tpcds_q38/duckdb:parquet 33071969 32068773 1.03
tpcds_q39/duckdb:parquet 28493777 29452044 0.97
tpcds_q40/duckdb:parquet 17780114 17728444 1.00
tpcds_q41/duckdb:parquet 7412307 7587628 0.98
tpcds_q42/duckdb:parquet 9426407 9655322 0.98
tpcds_q43/duckdb:parquet 14984793 15081032 0.99
tpcds_q44/duckdb:parquet 22546288 22167524 1.02
tpcds_q45/duckdb:parquet 25532559 26848774 0.95
tpcds_q46/duckdb:parquet 45479441 46111047 0.99
tpcds_q47/duckdb:parquet 43731872 43061361 1.02
tpcds_q48/duckdb:parquet 29217768 29658157 0.99
tpcds_q49/duckdb:parquet 24597193 24798278 0.99
tpcds_q50/duckdb:parquet 23540143 23608348 1.00
tpcds_q51/duckdb:parquet 94472645 94568508 1.00
tpcds_q52/duckdb:parquet 10529893 10046801 1.05
tpcds_q53/duckdb:parquet 14932722 15008391 0.99
tpcds_q54/duckdb:parquet 25126292 25650876 0.98
tpcds_q55/duckdb:parquet 9766575 9807728 1.00
tpcds_q56/duckdb:parquet 19870656 21065304 0.94
tpcds_q57/duckdb:parquet 34671660 34935890 0.99
tpcds_q58/duckdb:parquet 23058697 22301245 1.03
tpcds_q59/duckdb:parquet 34219152 35101313 0.97
tpcds_q60/duckdb:parquet 22340936 22516551 0.99
tpcds_q61/duckdb:parquet 31409684 29984181 1.05
tpcds_q62/duckdb:parquet 11458061 12328388 0.93
tpcds_q63/duckdb:parquet 13653313 14088478 0.97
tpcds_q64/duckdb:parquet 75491818 73909154 1.02
tpcds_q65/duckdb:parquet 19501200 19606689 0.99
tpcds_q66/duckdb:parquet 28216025 29210596 0.97
tpcds_q67/duckdb:parquet 134436118 135108828 1.00
tpcds_q68/duckdb:parquet 36739531 36548023 1.01
tpcds_q69/duckdb:parquet 33766323 36112789 0.94
tpcds_q70/duckdb:parquet 19279238 19086894 1.01
tpcds_q71/duckdb:parquet 18489327 20295214 0.91
tpcds_q72/duckdb:parquet 164177674 166706845 0.98
tpcds_q73/duckdb:parquet 16957708 18226843 0.93
tpcds_q74/duckdb:parquet 125364119 130078281 0.96
tpcds_q75/duckdb:parquet 54723332 52928374 1.03
tpcds_q76/duckdb:parquet 19664768 19947888 0.99
tpcds_q77/duckdb:parquet 21792920 21128458 1.03
tpcds_q78/duckdb:parquet 74804299 75450998 0.99
tpcds_q79/duckdb:parquet 26812969 27151639 0.99
tpcds_q80/duckdb:parquet 40753543 41260715 0.99
tpcds_q81/duckdb:parquet 32430730 31761425 1.02
tpcds_q82/duckdb:parquet 13361753 13519553 0.99
tpcds_q83/duckdb:parquet 15912562 15796002 1.01
tpcds_q84/duckdb:parquet 18680715 19281965 0.97
tpcds_q85/duckdb:parquet 38061931 39497709 0.96
tpcds_q86/duckdb:parquet 12845995 12220712 1.05
tpcds_q87/duckdb:parquet 35975666 37718555 0.95
tpcds_q88/duckdb:parquet 47888931 48640323 0.98
tpcds_q89/duckdb:parquet 15907238 16109337 0.99
tpcds_q90/duckdb:parquet 7569549 7505064 1.01
tpcds_q91/duckdb:parquet 22325707 21837442 1.02
tpcds_q92/duckdb:parquet 11000997 11847588 0.93
tpcds_q93/duckdb:parquet 29591696 29626379 1.00
tpcds_q94/duckdb:parquet 17232975 15704434 1.10
tpcds_q95/duckdb:parquet 🚨 138815638 122112490 1.14
tpcds_q96/duckdb:parquet 8823954 9344709 0.94
tpcds_q97/duckdb:parquet 34266984 35292420 0.97
tpcds_q98/duckdb:parquet 17325707 17597116 0.98
tpcds_q99/duckdb:parquet 19606669 19341798 1.01
duckdb / duckdb (0.981x ➖, 6↑ 5↓)
name PR d75de6d (ns) base deb7de0 (ns) ratio (PR/base)
tpcds_q01/duckdb:duckdb 18857820 20750901 0.91
tpcds_q02/duckdb:duckdb 18162895 18261085 0.99
tpcds_q03/duckdb:duckdb 8356298 8968554 0.93
tpcds_q04/duckdb:duckdb 171666675 177384667 0.97
tpcds_q05/duckdb:duckdb 19244007 19360183 0.99
tpcds_q06/duckdb:duckdb 22429624 22856292 0.98
tpcds_q07/duckdb:duckdb 37797893 38055381 0.99
tpcds_q08/duckdb:duckdb 120747378 120923513 1.00
tpcds_q09/duckdb:duckdb 19817435 19983125 0.99
tpcds_q10/duckdb:duckdb 24893414 25058782 0.99
tpcds_q11/duckdb:duckdb 86683483 91837907 0.94
tpcds_q12/duckdb:duckdb 11049242 11857531 0.93
tpcds_q13/duckdb:duckdb 24166014 24230667 1.00
tpcds_q14/duckdb:duckdb 92426144 94189192 0.98
tpcds_q15/duckdb:duckdb 23436800 24950394 0.94
tpcds_q16/duckdb:duckdb 18090321 17351764 1.04
tpcds_q17/duckdb:duckdb 21695958 22477396 0.97
tpcds_q18/duckdb:duckdb 44318991 46628695 0.95
tpcds_q19/duckdb:duckdb 16416440 17042735 0.96
tpcds_q20/duckdb:duckdb 🚀 11239977 12715611 0.88
tpcds_q21/duckdb:duckdb 6474218 7004676 0.92
tpcds_q22/duckdb:duckdb 63104977 61542554 1.03
tpcds_q23/duckdb:duckdb 🚨 84073388 76250189 1.10
tpcds_q24/duckdb:duckdb 27307804 25237070 1.08
tpcds_q25/duckdb:duckdb 16930272 18023977 0.94
tpcds_q26/duckdb:duckdb 26838736 27405849 0.98
tpcds_q27/duckdb:duckdb 🚀 36225446 40383543 0.90
tpcds_q28/duckdb:duckdb 21671067 21610156 1.00
tpcds_q29/duckdb:duckdb 20178980 20285669 0.99
tpcds_q30/duckdb:duckdb 29639359 31526534 0.94
tpcds_q31/duckdb:duckdb 46923866 49643251 0.95
tpcds_q32/duckdb:duckdb 7306019 7744453 0.94
tpcds_q33/duckdb:duckdb 12791252 12929739 0.99
tpcds_q34/duckdb:duckdb 🚨 17486006 15046109 1.16
tpcds_q35/duckdb:duckdb 33648294 34567986 0.97
tpcds_q36/duckdb:duckdb 67785341 72142550 0.94
tpcds_q37/duckdb:duckdb 🚀 7178823 8095432 0.89
tpcds_q38/duckdb:duckdb 33351881 30675294 1.09
tpcds_q39/duckdb:duckdb 25125792 25686619 0.98
tpcds_q40/duckdb:duckdb 13265250 13206267 1.00
tpcds_q41/duckdb:duckdb 7720238 8542291 0.90
tpcds_q42/duckdb:duckdb 6644162 6479251 1.03
tpcds_q43/duckdb:duckdb 11168152 11564724 0.97
tpcds_q44/duckdb:duckdb 13829728 13134191 1.05
tpcds_q45/duckdb:duckdb 16442050 18195779 0.90
tpcds_q46/duckdb:duckdb 🚨 40896133 37116757 1.10
tpcds_q47/duckdb:duckdb 41105812 40921020 1.00
tpcds_q48/duckdb:duckdb 23490881 23791645 0.99
tpcds_q49/duckdb:duckdb 16375278 17138481 0.96
tpcds_q50/duckdb:duckdb 14222052 14252637 1.00
tpcds_q51/duckdb:duckdb 89412149 90596094 0.99
tpcds_q52/duckdb:duckdb 7822904 7593474 1.03
tpcds_q53/duckdb:duckdb 13167087 13645306 0.96
tpcds_q54/duckdb:duckdb 16128788 17106490 0.94
tpcds_q55/duckdb:duckdb 7205318 7423103 0.97
tpcds_q56/duckdb:duckdb 13443401 13824343 0.97
tpcds_q57/duckdb:duckdb 32531753 31439681 1.03
tpcds_q58/duckdb:duckdb 12426709 12470324 1.00
tpcds_q59/duckdb:duckdb 35179343 35623772 0.99
tpcds_q60/duckdb:duckdb 14495632 14585924 0.99
tpcds_q61/duckdb:duckdb 14435216 15150700 0.95
tpcds_q62/duckdb:duckdb 9398000 9959462 0.94
tpcds_q63/duckdb:duckdb 12187838 12814400 0.95
tpcds_q64/duckdb:duckdb 53523291 55990201 0.96
tpcds_q65/duckdb:duckdb 31713134 34912740 0.91
tpcds_q66/duckdb:duckdb 25486858 25739931 0.99
tpcds_q67/duckdb:duckdb 128736524 131454168 0.98
tpcds_q68/duckdb:duckdb 28086292 25564642 1.10
tpcds_q69/duckdb:duckdb 24725456 25801827 0.96
tpcds_q70/duckdb:duckdb 🚀 13915283 15476139 0.90
tpcds_q71/duckdb:duckdb 13180819 13006824 1.01
tpcds_q72/duckdb:duckdb 41410805 44635665 0.93
tpcds_q73/duckdb:duckdb 11851822 11119469 1.07
tpcds_q74/duckdb:duckdb 147372442 145327821 1.01
tpcds_q75/duckdb:duckdb 42283408 43042466 0.98
tpcds_q76/duckdb:duckdb 12135472 12299092 0.99
tpcds_q77/duckdb:duckdb 12721442 12949181 0.98
tpcds_q78/duckdb:duckdb 62983200 65527748 0.96
tpcds_q79/duckdb:duckdb 🚨 21843264 19463847 1.12
tpcds_q80/duckdb:duckdb 26300767 27446165 0.96
tpcds_q81/duckdb:duckdb 40779672 41050723 0.99
tpcds_q82/duckdb:duckdb 🚀 7641657 8872305 0.86
tpcds_q83/duckdb:duckdb 9269918 9384624 0.99
tpcds_q84/duckdb:duckdb 🚨 15981041 14403721 1.11
tpcds_q85/duckdb:duckdb 24115750 25062589 0.96
tpcds_q86/duckdb:duckdb 11367667 11386388 1.00
tpcds_q87/duckdb:duckdb 35368673 33889418 1.04
tpcds_q88/duckdb:duckdb 25786659 26078656 0.99
tpcds_q89/duckdb:duckdb 14855643 14579889 1.02
tpcds_q90/duckdb:duckdb 5527882 5888033 0.94
tpcds_q91/duckdb:duckdb 12644523 12612432 1.00
tpcds_q92/duckdb:duckdb 🚀 8431688 9512575 0.89
tpcds_q93/duckdb:duckdb 22467599 22397580 1.00
tpcds_q94/duckdb:duckdb 13681682 13691246 1.00
tpcds_q95/duckdb:duckdb 129437101 128716663 1.01
tpcds_q96/duckdb:duckdb 4310678 4576553 0.94
tpcds_q97/duckdb:duckdb 30097083 30925185 0.97
tpcds_q98/duckdb:duckdb 13018358 13580539 0.96
tpcds_q99/duckdb:duckdb 16189608 16845959 0.96
Full attributed analysis
Query Config Raw Δ Control Δ Attributed α Noise floor Significant?
1 datafusion:vortex-compact -7.3% +0.9% -8.1% +19.3% ➖ noise
1 datafusion:vortex-file-compressed -7.0% +0.9% -7.8% +19.1% ➖ noise
1 duckdb:duckdb -9.1% +0.9% -9.9% +25.2% ➖ noise
1 duckdb:vortex-compact -3.6% +0.9% -4.5% +24.1% ➖ noise
1 duckdb:vortex-file-compressed -3.5% +0.9% -4.3% +34.1% ➖ noise
2 datafusion:vortex-compact -5.2% -6.6% +1.5% +10.0% ➖ noise
2 datafusion:vortex-file-compressed -4.4% -6.6% +2.4% +10.0% ➖ noise
2 duckdb:duckdb -0.5% -6.6% +6.5% +14.8% ➖ noise
2 duckdb:vortex-compact +2.7% -6.6% +10.0% +26.4% ➖ noise
2 duckdb:vortex-file-compressed +3.0% -6.6% +10.3% +20.7% ➖ noise
3 datafusion:vortex-compact +2.9% -9.5% +13.6% +21.6% ➖ noise
3 datafusion:vortex-file-compressed -8.0% -9.5% +1.6% +12.0% ➖ noise
3 duckdb:duckdb -6.8% -9.5% +2.9% +17.7% ➖ noise
3 duckdb:vortex-compact -5.2% -9.5% +4.8% +10.0% ➖ noise
3 duckdb:vortex-file-compressed -7.2% -9.5% +2.5% +12.7% ➖ noise
4 datafusion:vortex-compact +0.1% -1.0% +1.1% +10.0% ➖ noise
4 datafusion:vortex-file-compressed -1.6% -1.0% -0.6% +10.0% ➖ noise
4 duckdb:duckdb -3.2% -1.0% -2.3% +10.0% ➖ noise
4 duckdb:vortex-compact -0.9% -1.0% +0.1% +10.0% ➖ noise
4 duckdb:vortex-file-compressed -9.5% -1.0% -8.6% +10.0% ➖ noise
5 datafusion:vortex-compact -10.2% -1.7% -8.6% +11.2% ➖ noise
5 datafusion:vortex-file-compressed +2.6% -1.7% +4.4% +10.0% ➖ noise
5 duckdb:duckdb -0.6% -1.7% +1.1% +13.6% ➖ noise
5 duckdb:vortex-compact +1.4% -1.7% +3.2% +14.6% ➖ noise
5 duckdb:vortex-file-compressed +1.8% -1.7% +3.6% +10.0% ➖ noise
6 datafusion:vortex-compact +1.8% -0.8% +2.6% +11.3% ➖ noise
6 datafusion:vortex-file-compressed -2.2% -0.8% -1.4% +10.0% ➖ noise
6 duckdb:duckdb -1.9% -0.8% -1.1% +11.7% ➖ noise
6 duckdb:vortex-compact -5.4% -0.8% -4.6% +10.0% ➖ noise
6 duckdb:vortex-file-compressed -0.5% -0.8% +0.3% +10.0% ➖ noise
7 datafusion:vortex-compact -2.9% -0.3% -2.6% +13.9% ➖ noise
7 datafusion:vortex-file-compressed -6.2% -0.3% -5.9% +10.0% ➖ noise
7 duckdb:duckdb -0.7% -0.3% -0.4% +18.4% ➖ noise
7 duckdb:vortex-compact -8.1% -0.3% -7.8% +14.0% ➖ noise
7 duckdb:vortex-file-compressed -10.1% -0.3% -9.8% +19.6% ➖ noise
8 datafusion:vortex-compact -7.6% -3.5% -4.3% +10.0% ➖ noise
8 datafusion:vortex-file-compressed -7.3% -3.5% -3.9% +10.0% ➖ noise
8 duckdb:duckdb -0.1% -3.5% +3.5% +10.0% ➖ noise
8 duckdb:vortex-compact -5.0% -3.5% -1.6% +10.0% ➖ noise
8 duckdb:vortex-file-compressed -4.6% -3.5% -1.2% +11.3% ➖ noise
9 datafusion:vortex-compact -6.5% -0.8% -5.7% +10.0% ➖ noise
9 datafusion:vortex-file-compressed -5.6% -0.8% -4.8% +10.4% ➖ noise
9 duckdb:duckdb -0.8% -0.8% -0.0% +10.0% ➖ noise
9 duckdb:vortex-compact -4.4% -0.8% -3.6% +10.0% ➖ noise
9 duckdb:vortex-file-compressed -4.8% -0.8% -4.0% +11.2% ➖ noise
10 datafusion:vortex-compact -3.1% +0.4% -3.5% +10.9% ➖ noise
10 datafusion:vortex-file-compressed -1.3% +0.4% -1.7% +10.0% ➖ noise
10 duckdb:duckdb -0.7% +0.4% -1.1% +20.5% ➖ noise
10 duckdb:vortex-compact -9.5% +0.4% -9.8% +12.3% ➖ noise
10 duckdb:vortex-file-compressed -4.6% +0.4% -4.9% +10.0% ➖ noise
11 datafusion:vortex-compact -6.4% -2.6% -3.9% +10.9% ➖ noise
11 datafusion:vortex-file-compressed -2.7% -2.6% -0.2% +10.0% ➖ noise
11 duckdb:duckdb -5.6% -2.6% -3.1% +10.0% ➖ noise
11 duckdb:vortex-compact -0.9% -2.6% +1.8% +10.0% ➖ noise
11 duckdb:vortex-file-compressed -2.6% -2.6% -0.0% +11.0% ➖ noise
12 datafusion:vortex-compact -5.8% +2.4% -8.0% +14.7% ➖ noise
12 datafusion:vortex-file-compressed +1.9% +2.4% -0.5% +17.4% ➖ noise
12 duckdb:duckdb -6.8% +2.4% -9.0% +10.0% ➖ noise
12 duckdb:vortex-compact -9.1% +2.4% -11.3% +10.0% ✅ faster
12 duckdb:vortex-file-compressed -5.4% +2.4% -7.7% +12.5% ➖ noise
13 datafusion:vortex-compact -5.1% -1.7% -3.5% +10.0% ➖ noise
13 datafusion:vortex-file-compressed -1.1% -1.7% +0.6% +10.0% ➖ noise
13 duckdb:duckdb -0.3% -1.7% +1.4% +10.0% ➖ noise
13 duckdb:vortex-compact -12.1% -1.7% -10.6% +10.0% ✅ faster
13 duckdb:vortex-file-compressed -2.4% -1.7% -0.7% +10.0% ➖ noise
14 datafusion:vortex-compact -9.2% -1.8% -7.6% +10.0% ➖ noise
14 datafusion:vortex-file-compressed -6.4% -1.8% -4.6% +10.0% ➖ noise
14 duckdb:duckdb -1.9% -1.8% -0.0% +10.0% ➖ noise
14 duckdb:vortex-compact -3.9% -1.8% -2.1% +10.0% ➖ noise
14 duckdb:vortex-file-compressed -5.5% -1.8% -3.7% +12.2% ➖ noise
15 datafusion:vortex-compact -7.3% -7.2% -0.2% +13.2% ➖ noise
15 datafusion:vortex-file-compressed -7.3% -7.2% -0.2% +10.0% ➖ noise
15 duckdb:duckdb -6.1% -7.2% +1.2% +11.4% ➖ noise
15 duckdb:vortex-compact -0.7% -7.2% +6.9% +15.9% ➖ noise
15 duckdb:vortex-file-compressed -2.7% -7.2% +4.8% +10.1% ➖ noise
16 datafusion:vortex-compact -5.1% -5.0% -0.1% +10.0% ➖ noise
16 datafusion:vortex-file-compressed -12.3% -5.0% -7.7% +15.2% ➖ noise
16 duckdb:duckdb +4.3% -5.0% +9.8% +10.8% ➖ noise
16 duckdb:vortex-compact -6.9% -5.0% -2.0% +10.0% ➖ noise
16 duckdb:vortex-file-compressed -10.6% -5.0% -5.9% +10.0% ➖ noise
17 datafusion:vortex-compact -3.6% -4.5% +0.9% +13.9% ➖ noise
17 datafusion:vortex-file-compressed -3.0% -4.5% +1.5% +10.0% ➖ noise
17 duckdb:duckdb -3.5% -4.5% +1.0% +10.0% ➖ noise
17 duckdb:vortex-compact -0.1% -4.5% +4.6% +12.8% ➖ noise
17 duckdb:vortex-file-compressed -4.8% -4.5% -0.3% +15.5% ➖ noise
18 datafusion:vortex-compact -0.5% -3.9% +3.5% +10.0% ➖ noise
18 datafusion:vortex-file-compressed -3.4% -3.9% +0.5% +17.1% ➖ noise
18 duckdb:duckdb -5.0% -3.9% -1.1% +10.7% ➖ noise
18 duckdb:vortex-compact -3.8% -3.9% +0.1% +11.1% ➖ noise
18 duckdb:vortex-file-compressed -6.1% -3.9% -2.3% +14.4% ➖ noise
19 datafusion:vortex-compact -6.3% -2.7% -3.7% +10.0% ➖ noise
19 datafusion:vortex-file-compressed +6.1% -2.7% +9.0% +10.0% ➖ noise
19 duckdb:duckdb -3.7% -2.7% -1.0% +11.2% ➖ noise
19 duckdb:vortex-compact +2.4% -2.7% +5.2% +10.0% ➖ noise
19 duckdb:vortex-file-compressed -2.2% -2.7% +0.5% +12.2% ➖ noise
20 datafusion:vortex-compact -7.9% -0.6% -7.3% +10.0% ➖ noise
20 datafusion:vortex-file-compressed +1.5% -0.6% +2.2% +10.0% ➖ noise
20 duckdb:duckdb -11.6% -0.6% -11.1% +11.5% ✅ faster
20 duckdb:vortex-compact -5.3% -0.6% -4.7% +11.7% ➖ noise
20 duckdb:vortex-file-compressed -10.1% -0.6% -9.5% +10.0% ✅ faster
21 datafusion:vortex-compact -5.4% +5.0% -9.9% +12.0% ➖ noise
21 datafusion:vortex-file-compressed -4.5% +5.0% -9.0% +10.8% ➖ noise
21 duckdb:duckdb -7.6% +5.0% -11.9% +20.1% ➖ noise
21 duckdb:vortex-compact -15.7% +5.0% -19.7% +14.3% ✅ faster
21 duckdb:vortex-file-compressed -6.5% +5.0% -10.9% +13.1% ➖ noise
22 datafusion:vortex-compact -6.0% +0.9% -6.9% +28.7% ➖ noise
22 datafusion:vortex-file-compressed +27.1% +0.9% +25.9% +30.0% ➖ noise
22 duckdb:duckdb +2.5% +0.9% +1.6% +12.6% ➖ noise
22 duckdb:vortex-compact -4.7% +0.9% -5.6% +12.1% ➖ noise
22 duckdb:vortex-file-compressed -0.3% +0.9% -1.2% +12.4% ➖ noise
23 datafusion:vortex-compact -1.5% +1.1% -2.5% +10.0% ➖ noise
23 datafusion:vortex-file-compressed +5.1% +1.1% +4.0% +10.0% ➖ noise
23 duckdb:duckdb +10.3% +1.1% +9.1% +18.6% ➖ noise
23 duckdb:vortex-compact -11.2% +1.1% -12.1% +14.9% ➖ noise
23 duckdb:vortex-file-compressed -5.1% +1.1% -6.1% +12.0% ➖ noise
24 datafusion:vortex-compact -2.2% -3.7% +1.6% +10.0% ➖ noise
24 datafusion:vortex-file-compressed +0.6% -3.7% +4.6% +10.0% ➖ noise
24 duckdb:duckdb +8.2% -3.7% +12.4% +10.1% 🚨 regression
24 duckdb:vortex-compact +0.0% -3.7% +3.9% +10.0% ➖ noise
24 duckdb:vortex-file-compressed -7.1% -3.7% -3.4% +13.1% ➖ noise
25 datafusion:vortex-compact -4.1% -0.6% -3.5% +11.6% ➖ noise
25 datafusion:vortex-file-compressed -3.0% -0.6% -2.4% +10.0% ➖ noise
25 duckdb:duckdb -6.1% -0.6% -5.5% +11.2% ➖ noise
25 duckdb:vortex-compact -2.6% -0.6% -2.0% +10.0% ➖ noise
25 duckdb:vortex-file-compressed -2.0% -0.6% -1.4% +10.0% ➖ noise
26 datafusion:vortex-compact -9.6% +0.4% -10.0% +10.3% ✅ faster
26 datafusion:vortex-file-compressed -5.8% +0.4% -6.2% +10.0% ➖ noise
26 duckdb:duckdb -2.1% +0.4% -2.5% +14.9% ➖ noise
26 duckdb:vortex-compact +0.7% +0.4% +0.3% +10.0% ➖ noise
26 duckdb:vortex-file-compressed -3.2% +0.4% -3.6% +10.0% ➖ noise
27 datafusion:vortex-compact +2.1% -2.5% +4.7% +10.0% ➖ noise
27 datafusion:vortex-file-compressed -2.7% -2.5% -0.2% +13.2% ➖ noise
27 duckdb:duckdb -10.3% -2.5% -8.0% +18.4% ➖ noise
27 duckdb:vortex-compact -1.4% -2.5% +1.1% +15.3% ➖ noise
27 duckdb:vortex-file-compressed -11.4% -2.5% -9.1% +17.0% ➖ noise
28 datafusion:vortex-compact -7.7% +0.3% -8.0% +10.0% ➖ noise
28 datafusion:vortex-file-compressed -3.1% +0.3% -3.3% +10.0% ➖ noise
28 duckdb:duckdb +0.3% +0.3% +0.0% +10.0% ➖ noise
28 duckdb:vortex-compact -2.7% +0.3% -3.0% +10.0% ➖ noise
28 duckdb:vortex-file-compressed +1.4% +0.3% +1.1% +10.0% ➖ noise
29 datafusion:vortex-compact -0.7% +4.3% -4.7% +10.0% ➖ noise
29 datafusion:vortex-file-compressed -0.8% +4.3% -4.9% +10.0% ➖ noise
29 duckdb:duckdb -0.5% +4.3% -4.6% +11.0% ➖ noise
29 duckdb:vortex-compact -0.6% +4.3% -4.7% +12.1% ➖ noise
29 duckdb:vortex-file-compressed -3.9% +4.3% -7.8% +10.0% ➖ noise
30 datafusion:vortex-compact -4.9% -1.8% -3.1% +11.8% ➖ noise
30 datafusion:vortex-file-compressed +0.3% -1.8% +2.2% +10.6% ➖ noise
30 duckdb:duckdb -6.0% -1.8% -4.2% +10.0% ➖ noise
30 duckdb:vortex-compact -5.6% -1.8% -3.8% +13.4% ➖ noise
30 duckdb:vortex-file-compressed -4.0% -1.8% -2.2% +13.3% ➖ noise
31 datafusion:vortex-compact -5.4% -1.6% -3.8% +10.0% ➖ noise
31 datafusion:vortex-file-compressed -3.5% -1.6% -1.9% +10.0% ➖ noise
31 duckdb:duckdb -5.5% -1.6% -3.9% +10.0% ➖ noise
31 duckdb:vortex-compact -3.9% -1.6% -2.3% +12.5% ➖ noise
31 duckdb:vortex-file-compressed -6.5% -1.6% -5.0% +11.5% ➖ noise
32 datafusion:vortex-compact -3.4% -4.8% +1.4% +10.0% ➖ noise
32 datafusion:vortex-file-compressed -8.5% -4.8% -3.9% +10.0% ➖ noise
32 duckdb:duckdb -5.7% -4.8% -0.9% +12.9% ➖ noise
32 duckdb:vortex-compact -3.6% -4.8% +1.2% +10.0% ➖ noise
32 duckdb:vortex-file-compressed -6.8% -4.8% -2.2% +10.9% ➖ noise
33 datafusion:vortex-compact -10.2% +0.1% -10.3% +10.0% ✅ faster
33 datafusion:vortex-file-compressed -9.2% +0.1% -9.3% +10.0% ✅ faster
33 duckdb:duckdb -1.1% +0.1% -1.2% +10.0% ➖ noise
33 duckdb:vortex-compact -7.3% +0.1% -7.4% +10.0% ➖ noise
33 duckdb:vortex-file-compressed -1.9% +0.1% -2.0% +10.0% ➖ noise
34 datafusion:vortex-compact -7.4% -3.0% -4.6% +14.9% ➖ noise
34 datafusion:vortex-file-compressed -5.7% -3.0% -2.8% +10.0% ➖ noise
34 duckdb:duckdb +16.2% -3.0% +19.8% +11.0% 🚨 regression
34 duckdb:vortex-compact -5.8% -3.0% -2.9% +10.0% ➖ noise
34 duckdb:vortex-file-compressed -3.9% -3.0% -1.0% +10.0% ➖ noise
35 datafusion:vortex-compact -4.9% +0.5% -5.3% +15.8% ➖ noise
35 datafusion:vortex-file-compressed -1.6% +0.5% -2.1% +10.0% ➖ noise
35 duckdb:duckdb -2.7% +0.5% -3.2% +16.5% ➖ noise
35 duckdb:vortex-compact -3.6% +0.5% -4.1% +10.0% ➖ noise
35 duckdb:vortex-file-compressed -4.7% +0.5% -5.2% +11.9% ➖ noise
36 datafusion:vortex-compact -7.8% -3.4% -4.6% +10.0% ➖ noise
36 datafusion:vortex-file-compressed -4.6% -3.4% -1.2% +10.0% ➖ noise
36 duckdb:duckdb -6.0% -3.4% -2.8% +10.0% ➖ noise
36 duckdb:vortex-compact -3.4% -3.4% -0.0% +10.0% ➖ noise
36 duckdb:vortex-file-compressed +0.2% -3.4% +3.8% +15.5% ➖ noise
37 datafusion:vortex-compact -8.7% +1.3% -9.8% +10.0% ✅ faster
37 datafusion:vortex-file-compressed -1.2% +1.3% -2.4% +10.0% ➖ noise
37 duckdb:duckdb -11.3% +1.3% -12.4% +17.3% ➖ noise
37 duckdb:vortex-compact -7.4% +1.3% -8.5% +10.0% ➖ noise
37 duckdb:vortex-file-compressed -8.0% +1.3% -9.1% +10.6% ➖ noise
38 datafusion:vortex-compact -10.9% +1.9% -12.5% +13.3% ✅ faster
38 datafusion:vortex-file-compressed -8.4% +1.9% -10.1% +10.0% ✅ faster
38 duckdb:duckdb +8.7% +1.9% +6.7% +11.2% ➖ noise
38 duckdb:vortex-compact -0.0% +1.9% -1.9% +14.0% ➖ noise
38 duckdb:vortex-file-compressed -3.6% +1.9% -5.4% +11.5% ➖ noise
39 datafusion:vortex-compact -5.8% -2.2% -3.7% +12.7% ➖ noise
39 datafusion:vortex-file-compressed +0.0% -2.2% +2.3% +12.1% ➖ noise
39 duckdb:duckdb -2.2% -2.2% +0.0% +15.9% ➖ noise
39 duckdb:vortex-compact -0.2% -2.2% +2.1% +13.6% ➖ noise
39 duckdb:vortex-file-compressed -0.7% -2.2% +1.5% +13.2% ➖ noise
40 datafusion:vortex-compact -6.3% -1.8% -4.6% +10.0% ➖ noise
40 datafusion:vortex-file-compressed -7.5% -1.8% -5.9% +10.0% ➖ noise
40 duckdb:duckdb +0.4% -1.8% +2.2% +13.8% ➖ noise
40 duckdb:vortex-compact -9.3% -1.8% -7.7% +11.9% ➖ noise
40 duckdb:vortex-file-compressed +1.1% -1.8% +2.9% +13.7% ➖ noise
41 datafusion:vortex-compact -11.1% -2.2% -9.2% +10.0% ✅ faster
41 datafusion:vortex-file-compressed -15.2% -2.2% -13.3% +10.0% ✅ faster
41 duckdb:duckdb -9.6% -2.2% -7.6% +10.0% ➖ noise
41 duckdb:vortex-compact -10.1% -2.2% -8.2% +10.0% ➖ noise
41 duckdb:vortex-file-compressed -7.4% -2.2% -5.3% +10.0% ➖ noise
42 datafusion:vortex-compact -4.7% -1.6% -3.1% +12.6% ➖ noise
42 datafusion:vortex-file-compressed -7.7% -1.6% -6.2% +12.1% ➖ noise
42 duckdb:duckdb +2.5% -1.6% +4.3% +16.8% ➖ noise
42 duckdb:vortex-compact -7.0% -1.6% -5.4% +13.7% ➖ noise
42 duckdb:vortex-file-compressed -15.6% -1.6% -14.2% +15.5% ✅ faster
43 datafusion:vortex-compact -9.4% -1.1% -8.3% +10.0% ➖ noise
43 datafusion:vortex-file-compressed -4.1% -1.1% -3.0% +10.0% ➖ noise
43 duckdb:duckdb -3.4% -1.1% -2.3% +11.9% ➖ noise
43 duckdb:vortex-compact +3.2% -1.1% +4.4% +13.8% ➖ noise
43 duckdb:vortex-file-compressed -2.6% -1.1% -1.5% +13.5% ➖ noise
44 datafusion:vortex-compact -9.8% -1.3% -8.7% +14.2% ➖ noise
44 datafusion:vortex-file-compressed -9.4% -1.3% -8.2% +10.0% ➖ noise
44 duckdb:duckdb +5.3% -1.3% +6.6% +14.1% ➖ noise
44 duckdb:vortex-compact -6.7% -1.3% -5.5% +14.5% ➖ noise
44 duckdb:vortex-file-compressed +2.7% -1.3% +4.0% +13.9% ➖ noise
45 datafusion:vortex-compact -4.2% -5.8% +1.7% +10.0% ➖ noise
45 datafusion:vortex-file-compressed -7.1% -5.8% -1.3% +10.0% ➖ noise
45 duckdb:duckdb -9.6% -5.8% -4.1% +10.1% ➖ noise
45 duckdb:vortex-compact -3.8% -5.8% +2.2% +10.0% ➖ noise
45 duckdb:vortex-file-compressed -4.7% -5.8% +1.2% +10.7% ➖ noise
46 datafusion:vortex-compact -5.9% -2.7% -3.2% +10.0% ➖ noise
46 datafusion:vortex-file-compressed -4.3% -2.7% -1.6% +12.4% ➖ noise
46 duckdb:duckdb +10.2% -2.7% +13.3% +10.2% 🚨 regression
46 duckdb:vortex-compact -0.5% -2.7% +2.3% +10.0% ➖ noise
46 duckdb:vortex-file-compressed -2.0% -2.7% +0.8% +10.0% ➖ noise
47 datafusion:vortex-compact -4.9% +0.0% -4.9% +10.0% ➖ noise
47 datafusion:vortex-file-compressed -4.3% +0.0% -4.3% +10.0% ➖ noise
47 duckdb:duckdb +0.5% +0.0% +0.4% +10.0% ➖ noise
47 duckdb:vortex-compact -5.5% +0.0% -5.5% +10.0% ➖ noise
47 duckdb:vortex-file-compressed +0.3% +0.0% +0.3% +10.0% ➖ noise
48 datafusion:vortex-compact -6.0% -2.7% -3.3% +10.0% ➖ noise
48 datafusion:vortex-file-compressed -4.2% -2.7% -1.5% +10.0% ➖ noise
48 duckdb:duckdb -1.3% -2.7% +1.5% +11.0% ➖ noise
48 duckdb:vortex-compact -2.9% -2.7% -0.2% +10.0% ➖ noise
48 duckdb:vortex-file-compressed -10.3% -2.7% -7.8% +12.3% ➖ noise
49 datafusion:vortex-compact -10.6% -1.0% -9.7% +10.2% ✅ faster
49 datafusion:vortex-file-compressed -2.9% -1.0% -1.9% +10.0% ➖ noise
49 duckdb:duckdb -4.5% -1.0% -3.5% +10.0% ➖ noise
49 duckdb:vortex-compact -0.6% -1.0% +0.4% +16.5% ➖ noise
49 duckdb:vortex-file-compressed -3.7% -1.0% -2.8% +21.0% ➖ noise
50 datafusion:vortex-compact -0.0% +2.1% -2.1% +10.0% ➖ noise
50 datafusion:vortex-file-compressed -7.4% +2.1% -9.4% +10.0% ✅ faster
50 duckdb:duckdb -0.2% +2.1% -2.3% +10.2% ➖ noise
50 duckdb:vortex-compact -4.1% +2.1% -6.0% +11.7% ➖ noise
50 duckdb:vortex-file-compressed -3.8% +2.1% -5.8% +10.0% ➖ noise
51 datafusion:vortex-compact -4.6% -3.4% -1.2% +14.4% ➖ noise
51 datafusion:vortex-file-compressed -5.9% -3.4% -2.5% +10.0% ➖ noise
51 duckdb:duckdb -1.3% -3.4% +2.2% +16.6% ➖ noise
51 duckdb:vortex-compact -3.0% -3.4% +0.4% +18.0% ➖ noise
51 duckdb:vortex-file-compressed -6.8% -3.4% -3.5% +17.7% ➖ noise
52 datafusion:vortex-compact -4.9% -1.1% -3.8% +10.0% ➖ noise
52 datafusion:vortex-file-compressed -7.6% -1.1% -6.5% +11.3% ➖ noise
52 duckdb:duckdb +3.0% -1.1% +4.2% +14.6% ➖ noise
52 duckdb:vortex-compact -6.8% -1.1% -5.8% +11.8% ➖ noise
52 duckdb:vortex-file-compressed -5.6% -1.1% -4.6% +24.0% ➖ noise
53 datafusion:vortex-compact -4.7% -3.8% -0.9% +14.5% ➖ noise
53 datafusion:vortex-file-compressed -6.0% -3.8% -2.3% +10.0% ➖ noise
53 duckdb:duckdb -3.5% -3.8% +0.3% +10.0% ➖ noise
53 duckdb:vortex-compact -5.6% -3.8% -1.9% +10.0% ➖ noise
53 duckdb:vortex-file-compressed -4.1% -3.8% -0.3% +10.0% ➖ noise
54 datafusion:vortex-compact +0.3% -3.4% +3.8% +12.4% ➖ noise
54 datafusion:vortex-file-compressed -2.7% -3.4% +0.7% +14.1% ➖ noise
54 duckdb:duckdb -5.7% -3.4% -2.4% +11.9% ➖ noise
54 duckdb:vortex-compact +0.8% -3.4% +4.3% +15.3% ➖ noise
54 duckdb:vortex-file-compressed -5.4% -3.4% -2.1% +10.0% ➖ noise
55 datafusion:vortex-compact -6.1% -2.4% -3.8% +10.8% ➖ noise
55 datafusion:vortex-file-compressed -6.6% -2.4% -4.3% +11.7% ➖ noise
55 duckdb:duckdb -2.9% -2.4% -0.5% +17.9% ➖ noise
55 duckdb:vortex-compact -9.9% -2.4% -7.7% +15.2% ➖ noise
55 duckdb:vortex-file-compressed -14.2% -2.4% -12.0% +21.7% ➖ noise
56 datafusion:vortex-compact -5.2% -2.7% -2.6% +10.7% ➖ noise
56 datafusion:vortex-file-compressed -9.8% -2.7% -7.3% +10.0% ➖ noise
56 duckdb:duckdb -2.8% -2.7% -0.1% +14.2% ➖ noise
56 duckdb:vortex-compact -3.3% -2.7% -0.6% +10.0% ➖ noise
56 duckdb:vortex-file-compressed -7.1% -2.7% -4.5% +10.0% ➖ noise
57 datafusion:vortex-compact +0.2% +0.8% -0.7% +12.4% ➖ noise
57 datafusion:vortex-file-compressed +0.8% +0.8% -0.1% +13.0% ➖ noise
57 duckdb:duckdb +3.5% +0.8% +2.6% +13.3% ➖ noise
57 duckdb:vortex-compact -0.2% +0.8% -1.0% +13.6% ➖ noise
57 duckdb:vortex-file-compressed +0.1% +0.8% -0.7% +12.3% ➖ noise
58 datafusion:vortex-compact -5.5% -1.1% -4.4% +10.0% ➖ noise
58 datafusion:vortex-file-compressed -7.5% -1.1% -6.4% +10.0% ➖ noise
58 duckdb:duckdb -0.3% -1.1% +0.8% +14.9% ➖ noise
58 duckdb:vortex-compact +3.7% -1.1% +4.9% +19.5% ➖ noise
58 duckdb:vortex-file-compressed +1.8% -1.1% +2.9% +13.1% ➖ noise
59 datafusion:vortex-compact -4.8% -3.0% -1.8% +10.0% ➖ noise
59 datafusion:vortex-file-compressed -4.1% -3.0% -1.1% +10.0% ➖ noise
59 duckdb:duckdb -1.2% -3.0% +1.8% +10.0% ➖ noise
59 duckdb:vortex-compact +1.3% -3.0% +4.5% +12.2% ➖ noise
59 duckdb:vortex-file-compressed -0.3% -3.0% +2.9% +12.3% ➖ noise
60 datafusion:vortex-compact -10.1% -4.5% -5.8% +11.0% ➖ noise
60 datafusion:vortex-file-compressed -10.0% -4.5% -5.7% +10.1% ➖ noise
60 duckdb:duckdb -0.6% -4.5% +4.1% +14.9% ➖ noise
60 duckdb:vortex-compact +2.8% -4.5% +7.7% +12.8% ➖ noise
60 duckdb:vortex-file-compressed -1.3% -4.5% +3.4% +29.3% ➖ noise
61 datafusion:vortex-compact -4.0% +0.1% -4.1% +10.1% ➖ noise
61 datafusion:vortex-file-compressed -7.1% +0.1% -7.2% +10.0% ➖ noise
61 duckdb:duckdb -4.7% +0.1% -4.8% +10.0% ➖ noise
61 duckdb:vortex-compact +6.7% +0.1% +6.6% +10.0% ➖ noise
61 duckdb:vortex-file-compressed -2.9% +0.1% -2.9% +20.2% ➖ noise
62 datafusion:vortex-compact -15.6% -6.9% -9.3% +27.2% ➖ noise
62 datafusion:vortex-file-compressed -1.7% -6.9% +5.6% +23.9% ➖ noise
62 duckdb:duckdb -5.6% -6.9% +1.4% +12.6% ➖ noise
62 duckdb:vortex-compact -0.4% -6.9% +7.0% +16.5% ➖ noise
62 duckdb:vortex-file-compressed -6.9% -6.9% +0.0% +16.9% ➖ noise
63 datafusion:vortex-compact -9.7% -3.7% -6.3% +10.0% ➖ noise
63 datafusion:vortex-file-compressed -11.6% -3.7% -8.3% +10.0% ➖ noise
63 duckdb:duckdb -4.9% -3.7% -1.3% +10.0% ➖ noise
63 duckdb:vortex-compact -5.3% -3.7% -1.7% +10.0% ➖ noise
63 duckdb:vortex-file-compressed -9.4% -3.7% -5.9% +13.3% ➖ noise
64 datafusion:vortex-compact -0.5% +1.1% -1.6% +10.0% ➖ noise
64 datafusion:vortex-file-compressed -2.5% +1.1% -3.6% +10.0% ➖ noise
64 duckdb:duckdb -4.4% +1.1% -5.5% +10.0% ➖ noise
64 duckdb:vortex-compact -2.3% +1.1% -3.4% +10.0% ➖ noise
64 duckdb:vortex-file-compressed -3.5% +1.1% -4.6% +10.0% ➖ noise
65 datafusion:vortex-compact -6.0% +0.7% -6.7% +11.4% ➖ noise
65 datafusion:vortex-file-compressed -0.4% +0.7% -1.0% +18.9% ➖ noise
65 duckdb:duckdb -9.2% +0.7% -9.8% +14.3% ➖ noise
65 duckdb:vortex-compact -2.8% +0.7% -3.5% +10.0% ➖ noise
65 duckdb:vortex-file-compressed +0.1% +0.7% -0.5% +10.0% ➖ noise
66 datafusion:vortex-compact -0.7% -7.8% +7.7% +12.6% ➖ noise
66 datafusion:vortex-file-compressed -8.5% -7.8% -0.7% +10.3% ➖ noise
66 duckdb:duckdb -1.0% -7.8% +7.4% +11.6% ➖ noise
66 duckdb:vortex-compact -7.6% -7.8% +0.2% +18.3% ➖ noise
66 duckdb:vortex-file-compressed -2.8% -7.8% +5.5% +11.7% ➖ noise
67 datafusion:vortex-compact -2.7% +0.5% -3.2% +11.6% ➖ noise
67 datafusion:vortex-file-compressed -1.9% +0.5% -2.4% +10.0% ➖ noise
67 duckdb:duckdb -2.1% +0.5% -2.5% +10.0% ➖ noise
67 duckdb:vortex-compact -1.2% +0.5% -1.7% +10.0% ➖ noise
67 duckdb:vortex-file-compressed -3.3% +0.5% -3.8% +10.0% ➖ noise
68 datafusion:vortex-compact -5.7% -0.9% -4.8% +10.0% ➖ noise
68 datafusion:vortex-file-compressed -5.8% -0.9% -4.9% +10.0% ➖ noise
68 duckdb:duckdb +9.9% -0.9% +10.9% +10.0% 🚨 regression
68 duckdb:vortex-compact -4.8% -0.9% -3.9% +10.0% ➖ noise
68 duckdb:vortex-file-compressed -2.4% -0.9% -1.5% +10.9% ➖ noise
69 datafusion:vortex-compact -3.7% -2.8% -0.9% +10.0% ➖ noise
69 datafusion:vortex-file-compressed -8.7% -2.8% -6.1% +10.0% ➖ noise
69 duckdb:duckdb -4.2% -2.8% -1.4% +10.0% ➖ noise
69 duckdb:vortex-compact -2.7% -2.8% +0.1% +12.2% ➖ noise
69 duckdb:vortex-file-compressed -2.4% -2.8% +0.4% +10.0% ➖ noise
70 datafusion:vortex-compact -1.0% -3.9% +3.0% +10.0% ➖ noise
70 datafusion:vortex-file-compressed -4.7% -3.9% -0.9% +11.0% ➖ noise
70 duckdb:duckdb -10.1% -3.9% -6.4% +15.4% ➖ noise
70 duckdb:vortex-compact -5.8% -3.9% -2.0% +10.4% ➖ noise
70 duckdb:vortex-file-compressed +0.2% -3.9% +4.2% +17.1% ➖ noise
71 datafusion:vortex-compact -6.3% -8.5% +2.4% +22.9% ➖ noise
71 datafusion:vortex-file-compressed -1.9% -8.5% +7.3% +18.8% ➖ noise
71 duckdb:duckdb +1.3% -8.5% +10.8% +15.9% ➖ noise
71 duckdb:vortex-compact -7.1% -8.5% +1.5% +11.4% ➖ noise
71 duckdb:vortex-file-compressed -5.7% -8.5% +3.2% +11.4% ➖ noise
72 datafusion:vortex-compact -2.7% -2.2% -0.6% +10.0% ➖ noise
72 datafusion:vortex-file-compressed -2.0% -2.2% +0.2% +10.0% ➖ noise
72 duckdb:duckdb -7.2% -2.2% -5.2% +14.3% ➖ noise
72 duckdb:vortex-compact -1.6% -2.2% +0.6% +10.0% ➖ noise
72 duckdb:vortex-file-compressed -0.2% -2.2% +2.0% +10.0% ➖ noise
73 datafusion:vortex-compact -6.1% -5.0% -1.2% +10.0% ➖ noise
73 datafusion:vortex-file-compressed -7.2% -5.0% -2.4% +26.6% ➖ noise
73 duckdb:duckdb +6.6% -5.0% +12.1% +38.4% ➖ noise
73 duckdb:vortex-compact +0.4% -5.0% +5.7% +10.0% ➖ noise
73 duckdb:vortex-file-compressed -6.0% -5.0% -1.1% +10.0% ➖ noise
74 datafusion:vortex-compact -6.9% -2.0% -5.0% +14.1% ➖ noise
74 datafusion:vortex-file-compressed +2.8% -2.0% +4.9% +10.0% ➖ noise
74 duckdb:duckdb +1.4% -2.0% +3.5% +10.0% ➖ noise
74 duckdb:vortex-compact -1.4% -2.0% +0.7% +21.1% ➖ noise
74 duckdb:vortex-file-compressed -1.1% -2.0% +1.0% +28.7% ➖ noise
75 datafusion:vortex-compact -5.4% -0.9% -4.6% +10.0% ➖ noise
75 datafusion:vortex-file-compressed -6.9% -0.9% -6.1% +10.0% ➖ noise
75 duckdb:duckdb -1.8% -0.9% -0.9% +10.0% ➖ noise
75 duckdb:vortex-compact -3.6% -0.9% -2.8% +10.0% ➖ noise
75 duckdb:vortex-file-compressed -4.1% -0.9% -3.3% +11.9% ➖ noise
76 datafusion:vortex-compact -6.4% -4.1% -2.4% +20.1% ➖ noise
76 datafusion:vortex-file-compressed +4.1% -4.1% +8.6% +34.6% ➖ noise
76 duckdb:duckdb -1.3% -4.1% +2.9% +16.6% ➖ noise
76 duckdb:vortex-compact -0.9% -4.1% +3.4% +15.8% ➖ noise
76 duckdb:vortex-file-compressed -4.0% -4.1% +0.2% +15.5% ➖ noise
77 datafusion:vortex-compact -6.6% -1.4% -5.3% +10.0% ➖ noise
77 datafusion:vortex-file-compressed -4.0% -1.4% -2.6% +10.0% ➖ noise
77 duckdb:duckdb -1.8% -1.4% -0.4% +12.8% ➖ noise
77 duckdb:vortex-compact +5.4% -1.4% +6.9% +10.3% ➖ noise
77 duckdb:vortex-file-compressed +11.5% -1.4% +13.1% +16.8% ➖ noise
78 datafusion:vortex-compact -5.0% -2.5% -2.6% +10.0% ➖ noise
78 datafusion:vortex-file-compressed -3.7% -2.5% -1.2% +10.0% ➖ noise
78 duckdb:duckdb -3.9% -2.5% -1.4% +10.0% ➖ noise
78 duckdb:vortex-compact -0.7% -2.5% +1.9% +10.0% ➖ noise
78 duckdb:vortex-file-compressed -0.6% -2.5% +2.0% +11.2% ➖ noise
79 datafusion:vortex-compact -1.7% -1.8% +0.2% +12.6% ➖ noise
79 datafusion:vortex-file-compressed -1.9% -1.8% -0.1% +26.0% ➖ noise
79 duckdb:duckdb +12.2% -1.8% +14.3% +10.7% 🚨 regression
79 duckdb:vortex-compact -2.6% -1.8% -0.7% +10.0% ➖ noise
79 duckdb:vortex-file-compressed -2.8% -1.8% -1.0% +10.0% ➖ noise
80 datafusion:vortex-compact -7.3% -2.5% -4.9% +10.0% ➖ noise
80 datafusion:vortex-file-compressed -4.7% -2.5% -2.2% +10.0% ➖ noise
80 duckdb:duckdb -4.2% -2.5% -1.7% +10.3% ➖ noise
80 duckdb:vortex-compact -5.0% -2.5% -2.6% +10.0% ➖ noise
80 duckdb:vortex-file-compressed -5.7% -2.5% -3.2% +13.9% ➖ noise
81 datafusion:vortex-compact -19.5% -3.2% -16.9% +14.4% ✅ faster
81 datafusion:vortex-file-compressed -3.6% -3.2% -0.5% +10.0% ➖ noise
81 duckdb:duckdb -0.7% -3.2% +2.6% +10.0% ➖ noise
81 duckdb:vortex-compact -1.9% -3.2% +1.3% +10.0% ➖ noise
81 duckdb:vortex-file-compressed -8.3% -3.2% -5.3% +14.3% ➖ noise
82 datafusion:vortex-compact -6.6% -1.5% -5.2% +10.0% ➖ noise
82 datafusion:vortex-file-compressed -2.2% -1.5% -0.7% +12.0% ➖ noise
82 duckdb:duckdb -13.9% -1.5% -12.5% +13.8% ✅ faster
82 duckdb:vortex-compact +2.8% -1.5% +4.4% +10.0% ➖ noise
82 duckdb:vortex-file-compressed -4.3% -1.5% -2.8% +11.3% ➖ noise
83 datafusion:vortex-compact -4.1% -2.2% -2.0% +15.6% ➖ noise
83 datafusion:vortex-file-compressed -4.5% -2.2% -2.4% +10.0% ➖ noise
83 duckdb:duckdb -1.2% -2.2% +1.0% +11.6% ➖ noise
83 duckdb:vortex-compact +1.3% -2.2% +3.5% +13.9% ➖ noise
83 duckdb:vortex-file-compressed -9.4% -2.2% -7.3% +10.0% ➖ noise
84 datafusion:vortex-compact -13.9% -2.3% -11.9% +11.5% ✅ faster
84 datafusion:vortex-file-compressed -5.0% -2.3% -2.8% +19.6% ➖ noise
84 duckdb:duckdb +11.0% -2.3% +13.5% +10.6% 🚨 regression
84 duckdb:vortex-compact -4.8% -2.3% -2.6% +10.0% ➖ noise
84 duckdb:vortex-file-compressed -6.4% -2.3% -4.2% +10.0% ➖ noise
85 datafusion:vortex-compact -5.2% -2.8% -2.5% +11.9% ➖ noise
85 datafusion:vortex-file-compressed -8.8% -2.8% -6.2% +10.0% ➖ noise
85 duckdb:duckdb -3.8% -2.8% -1.1% +10.0% ➖ noise
85 duckdb:vortex-compact -12.5% -2.8% -10.0% +10.0% ✅ faster
85 duckdb:vortex-file-compressed -4.7% -2.8% -2.0% +14.5% ➖ noise
86 datafusion:vortex-compact -24.3% -4.4% -20.8% +17.5% ✅ faster
86 datafusion:vortex-file-compressed -4.5% -4.4% -0.0% +16.8% ➖ noise
86 duckdb:duckdb -0.2% -4.4% +4.5% +12.6% ➖ noise
86 duckdb:vortex-compact -14.9% -4.4% -10.9% +14.7% ➖ noise
86 duckdb:vortex-file-compressed -12.4% -4.4% -8.3% +15.6% ➖ noise
87 datafusion:vortex-compact -7.5% -6.8% -0.7% +12.2% ➖ noise
87 datafusion:vortex-file-compressed -7.7% -6.8% -0.9% +10.8% ➖ noise
87 duckdb:duckdb +4.4% -6.8% +12.0% +13.7% ➖ noise
87 duckdb:vortex-compact -1.1% -6.8% +6.1% +10.0% ➖ noise
87 duckdb:vortex-file-compressed -6.0% -6.8% +0.9% +14.8% ➖ noise
88 datafusion:vortex-compact -5.1% -3.2% -1.9% +10.0% ➖ noise
88 datafusion:vortex-file-compressed -1.9% -3.2% +1.4% +10.0% ➖ noise
88 duckdb:duckdb -1.1% -3.2% +2.2% +10.0% ➖ noise
88 duckdb:vortex-compact -3.6% -3.2% -0.3% +14.7% ➖ noise
88 duckdb:vortex-file-compressed -2.9% -3.2% +0.4% +10.0% ➖ noise
89 datafusion:vortex-compact -7.7% -4.8% -3.1% +11.6% ➖ noise
89 datafusion:vortex-file-compressed -4.2% -4.8% +0.6% +10.7% ➖ noise
89 duckdb:duckdb +1.9% -4.8% +7.0% +10.1% ➖ noise
89 duckdb:vortex-compact -3.1% -4.8% +1.8% +10.0% ➖ noise
89 duckdb:vortex-file-compressed -0.0% -4.8% +5.0% +15.8% ➖ noise
90 datafusion:vortex-compact -13.2% +1.8% -14.7% +10.0% ✅ faster
90 datafusion:vortex-file-compressed -6.4% +1.8% -8.0% +10.6% ➖ noise
90 duckdb:duckdb -6.1% +1.8% -7.8% +10.3% ➖ noise
90 duckdb:vortex-compact -1.0% +1.8% -2.7% +10.0% ➖ noise
90 duckdb:vortex-file-compressed -8.7% +1.8% -10.3% +14.3% ➖ noise
91 datafusion:vortex-compact -9.1% -2.0% -7.2% +10.0% ➖ noise
91 datafusion:vortex-file-compressed -1.0% -2.0% +1.0% +12.9% ➖ noise
91 duckdb:duckdb +0.3% -2.0% +2.3% +16.5% ➖ noise
91 duckdb:vortex-compact -3.7% -2.0% -1.8% +11.8% ➖ noise
91 duckdb:vortex-file-compressed -11.1% -2.0% -9.3% +10.0% ✅ faster
92 datafusion:vortex-compact -9.1% -7.7% -1.5% +13.1% ➖ noise
92 datafusion:vortex-file-compressed -8.4% -7.7% -0.7% +11.2% ➖ noise
92 duckdb:duckdb -11.4% -7.7% -3.9% +14.8% ➖ noise
92 duckdb:vortex-compact +1.6% -7.7% +10.1% +20.3% ➖ noise
92 duckdb:vortex-file-compressed -14.3% -7.7% -7.1% +18.0% ➖ noise
93 datafusion:vortex-compact -2.4% -1.8% -0.6% +10.0% ➖ noise
93 datafusion:vortex-file-compressed -5.1% -1.8% -3.4% +10.0% ➖ noise
93 duckdb:duckdb +0.3% -1.8% +2.1% +15.2% ➖ noise
93 duckdb:vortex-compact -7.0% -1.8% -5.3% +11.5% ➖ noise
93 duckdb:vortex-file-compressed -0.7% -1.8% +1.2% +11.8% ➖ noise
94 datafusion:vortex-compact +0.3% +2.6% -2.2% +11.8% ➖ noise
94 datafusion:vortex-file-compressed -12.7% +2.6% -14.9% +13.1% ✅ faster
94 duckdb:duckdb -0.1% +2.6% -2.6% +13.5% ➖ noise
94 duckdb:vortex-compact -4.6% +2.6% -7.0% +13.7% ➖ noise
94 duckdb:vortex-file-compressed -5.0% +2.6% -7.4% +11.3% ➖ noise
95 datafusion:vortex-compact -5.9% +6.9% -11.9% +10.0% ✅ faster
95 datafusion:vortex-file-compressed -1.5% +6.9% -7.8% +10.0% ➖ noise
95 duckdb:duckdb +0.6% +6.9% -5.9% +20.2% ➖ noise
95 duckdb:vortex-compact +12.8% +6.9% +5.6% +21.0% ➖ noise
95 duckdb:vortex-file-compressed -12.8% +6.9% -18.4% +21.9% ✅ faster
96 datafusion:vortex-compact -8.3% -10.5% +2.5% +10.0% ➖ noise
96 datafusion:vortex-file-compressed -5.3% -10.5% +5.8% +23.6% ➖ noise
96 duckdb:duckdb -5.8% -10.5% +5.2% +20.2% ➖ noise
96 duckdb:vortex-compact -8.3% -10.5% +2.5% +10.6% ➖ noise
96 duckdb:vortex-file-compressed +1.7% -10.5% +13.6% +13.5% 🚨 regression
97 datafusion:vortex-compact -10.0% -3.4% -6.8% +19.9% ➖ noise
97 datafusion:vortex-file-compressed +0.5% -3.4% +4.0% +10.0% ➖ noise
97 duckdb:duckdb -2.7% -3.4% +0.7% +10.3% ➖ noise
97 duckdb:vortex-compact +0.5% -3.4% +4.1% +16.4% ➖ noise
97 duckdb:vortex-file-compressed -4.8% -3.4% -1.5% +13.6% ➖ noise
98 datafusion:vortex-compact -3.8% -2.0% -1.8% +13.7% ➖ noise
98 datafusion:vortex-file-compressed -1.1% -2.0% +0.9% +12.8% ➖ noise
98 duckdb:duckdb -4.1% -2.0% -2.2% +14.6% ➖ noise
98 duckdb:vortex-compact -5.2% -2.0% -3.2% +10.0% ➖ noise
98 duckdb:vortex-file-compressed -4.1% -2.0% -2.1% +10.0% ➖ noise
99 datafusion:vortex-compact +9.0% +1.2% +7.7% +20.0% ➖ noise
99 datafusion:vortex-file-compressed -5.6% +1.2% -6.7% +19.6% ➖ noise
99 duckdb:duckdb -3.9% +1.2% -5.1% +14.4% ➖ noise
99 duckdb:vortex-compact -3.6% +1.2% -4.8% +24.3% ➖ noise
99 duckdb:vortex-file-compressed -5.8% +1.2% -6.9% +14.2% ➖ noise

@github-actions
Copy link
Copy Markdown
Contributor

github-actions Bot commented Apr 30, 2026

Benchmarks: TPC-H SF=1 on NVME

Verdict: No clear signal (environment too noisy confidence)
Attributed Vortex impact: -2.8%
Vortex (geomean): 0.981x ➖
Parquet (geomean): 1.023x ➖
Shifts: Parquet (control) +2.3% · Median polish -1.1%


datafusion / vortex-file-compressed (0.992x ➖, 0↑ 1↓)
name PR d75de6d (ns) base deb7de0 (ns) ratio (PR/base)
tpch_q01/datafusion:vortex-file-compressed 51798983 49710418 1.04
tpch_q02/datafusion:vortex-file-compressed 21532167 21885183 0.98
tpch_q03/datafusion:vortex-file-compressed 27840887 28577504 0.97
tpch_q04/datafusion:vortex-file-compressed 20300793 20657942 0.98
tpch_q05/datafusion:vortex-file-compressed 47978951 47383349 1.01
tpch_q06/datafusion:vortex-file-compressed 11807261 12749901 0.93
tpch_q07/datafusion:vortex-file-compressed 53827735 53878871 1.00
tpch_q08/datafusion:vortex-file-compressed 38441692 39171572 0.98
tpch_q09/datafusion:vortex-file-compressed 50744842 50210685 1.01
tpch_q10/datafusion:vortex-file-compressed 39154646 38902123 1.01
tpch_q11/datafusion:vortex-file-compressed 14982731 15447966 0.97
tpch_q12/datafusion:vortex-file-compressed 25049404 24949655 1.00
tpch_q13/datafusion:vortex-file-compressed 24067781 24951416 0.96
tpch_q14/datafusion:vortex-file-compressed 16878096 16861081 1.00
tpch_q15/datafusion:vortex-file-compressed 25227897 27432976 0.92
tpch_q16/datafusion:vortex-file-compressed 18035263 18753373 0.96
tpch_q17/datafusion:vortex-file-compressed 🚨 73506797 64771965 1.13
tpch_q18/datafusion:vortex-file-compressed 86506161 80030658 1.08
tpch_q19/datafusion:vortex-file-compressed 22330973 23003032 0.97
tpch_q20/datafusion:vortex-file-compressed 29887767 30136921 0.99
tpch_q21/datafusion:vortex-file-compressed 68981057 70885390 0.97
tpch_q22/datafusion:vortex-file-compressed 11722763 12329809 0.95
datafusion / vortex-compact (0.964x ➖, 0↑ 0↓)
name PR d75de6d (ns) base deb7de0 (ns) ratio (PR/base)
tpch_q01/datafusion:vortex-compact 57951145 58604677 0.99
tpch_q02/datafusion:vortex-compact 23973234 25736529 0.93
tpch_q03/datafusion:vortex-compact 29150912 29809959 0.98
tpch_q04/datafusion:vortex-compact 22735237 23997522 0.95
tpch_q05/datafusion:vortex-compact 50135341 52093042 0.96
tpch_q06/datafusion:vortex-compact 14272999 14663075 0.97
tpch_q07/datafusion:vortex-compact 58744464 59384403 0.99
tpch_q08/datafusion:vortex-compact 42501136 44722654 0.95
tpch_q09/datafusion:vortex-compact 55207689 55987183 0.99
tpch_q10/datafusion:vortex-compact 44435193 47274642 0.94
tpch_q11/datafusion:vortex-compact 15308251 16713998 0.92
tpch_q12/datafusion:vortex-compact 30976173 32311472 0.96
tpch_q13/datafusion:vortex-compact 30277186 31934205 0.95
tpch_q14/datafusion:vortex-compact 19587631 19787628 0.99
tpch_q15/datafusion:vortex-compact 31479036 32447557 0.97
tpch_q16/datafusion:vortex-compact 21909864 22758131 0.96
tpch_q17/datafusion:vortex-compact 67226302 67571897 0.99
tpch_q18/datafusion:vortex-compact 85190891 84163036 1.01
tpch_q19/datafusion:vortex-compact 28870114 31067617 0.93
tpch_q20/datafusion:vortex-compact 33111629 35294731 0.94
tpch_q21/datafusion:vortex-compact 78286999 78496024 1.00
tpch_q22/datafusion:vortex-compact 12099956 12625863 0.96
datafusion / parquet (1.031x ➖, 0↑ 2↓)
name PR d75de6d (ns) base deb7de0 (ns) ratio (PR/base)
tpch_q01/datafusion:parquet 🚨 135343907 96335293 1.40
tpch_q02/datafusion:parquet 64362186 63207943 1.02
tpch_q03/datafusion:parquet 74591001 69976645 1.07
tpch_q04/datafusion:parquet 46467271 45142258 1.03
tpch_q05/datafusion:parquet 97147867 93914532 1.03
tpch_q06/datafusion:parquet 39938257 42426387 0.94
tpch_q07/datafusion:parquet 107094437 105616856 1.01
tpch_q08/datafusion:parquet 92602509 95707741 0.97
tpch_q09/datafusion:parquet 130547028 132066470 0.99
tpch_q10/datafusion:parquet 113147148 112701397 1.00
tpch_q11/datafusion:parquet 42755716 41278608 1.04
tpch_q12/datafusion:parquet 78783361 86241294 0.91
tpch_q13/datafusion:parquet 193115761 191238978 1.01
tpch_q14/datafusion:parquet 47676553 47671409 1.00
tpch_q15/datafusion:parquet 65533577 61000471 1.07
tpch_q16/datafusion:parquet 45644086 43386204 1.05
tpch_q17/datafusion:parquet 🚨 148561852 126552675 1.17
tpch_q18/datafusion:parquet 167214956 154434050 1.08
tpch_q19/datafusion:parquet 84975309 85778148 0.99
tpch_q20/datafusion:parquet 70654830 69237491 1.02
tpch_q21/datafusion:parquet 134453068 136731566 0.98
tpch_q22/datafusion:parquet 31015427 32018989 0.97
datafusion / arrow (1.052x ➖, 0↑ 6↓)
name PR d75de6d (ns) base deb7de0 (ns) ratio (PR/base)
tpch_q01/datafusion:arrow 55514901 58504468 0.95
tpch_q02/datafusion:arrow 17962708 18577259 0.97
tpch_q03/datafusion:arrow 🚨 32821866 29062622 1.13
tpch_q04/datafusion:arrow 🚨 27837141 24706667 1.13
tpch_q05/datafusion:arrow 🚨 82369250 71858969 1.15
tpch_q06/datafusion:arrow 🚨 22503578 19648299 1.15
tpch_q07/datafusion:arrow 101168521 100976897 1.00
tpch_q08/datafusion:arrow 41524953 41432571 1.00
tpch_q09/datafusion:arrow 66474333 63371944 1.05
tpch_q10/datafusion:arrow 51456003 48675295 1.06
tpch_q11/datafusion:arrow 8645050 9184570 0.94
tpch_q12/datafusion:arrow 55001554 52288469 1.05
tpch_q13/datafusion:arrow 48001499 47865340 1.00
tpch_q14/datafusion:arrow 22870551 21315493 1.07
tpch_q15/datafusion:arrow 45274523 41792772 1.08
tpch_q16/datafusion:arrow 18627820 18207108 1.02
tpch_q17/datafusion:arrow 🚨 74780657 67032868 1.12
tpch_q18/datafusion:arrow 146792764 134874494 1.09
tpch_q19/datafusion:arrow 39029679 36486184 1.07
tpch_q20/datafusion:arrow 🚨 39017959 34398551 1.13
tpch_q21/datafusion:arrow 152061533 147825137 1.03
tpch_q22/datafusion:arrow 17424647 17289975 1.01
duckdb / vortex-file-compressed (0.984x ➖, 0↑ 0↓)
name PR d75de6d (ns) base deb7de0 (ns) ratio (PR/base)
tpch_q01/duckdb:vortex-file-compressed 31109339 31012260 1.00
tpch_q02/duckdb:vortex-file-compressed 23660427 24426067 0.97
tpch_q03/duckdb:vortex-file-compressed 28769810 28813267 1.00
tpch_q04/duckdb:vortex-file-compressed 28018714 28854659 0.97
tpch_q05/duckdb:vortex-file-compressed 31627165 33129268 0.95
tpch_q06/duckdb:vortex-file-compressed 10140442 9967893 1.02
tpch_q07/duckdb:vortex-file-compressed 36183284 36092407 1.00
tpch_q08/duckdb:vortex-file-compressed 36958506 39449711 0.94
tpch_q09/duckdb:vortex-file-compressed 72362912 71897194 1.01
tpch_q10/duckdb:vortex-file-compressed 33145955 33800411 0.98
tpch_q11/duckdb:vortex-file-compressed 14262398 14591659 0.98
tpch_q12/duckdb:vortex-file-compressed 21947216 21735025 1.01
tpch_q13/duckdb:vortex-file-compressed 34518575 34816968 0.99
tpch_q14/duckdb:vortex-file-compressed 20279802 20703997 0.98
tpch_q15/duckdb:vortex-file-compressed 16245180 16556954 0.98
tpch_q16/duckdb:vortex-file-compressed 27278122 28513822 0.96
tpch_q17/duckdb:vortex-file-compressed 24045399 24163493 1.00
tpch_q18/duckdb:vortex-file-compressed 48632380 48513476 1.00
tpch_q19/duckdb:vortex-file-compressed 28721143 28938581 0.99
tpch_q20/duckdb:vortex-file-compressed 32635656 33555622 0.97
tpch_q21/duckdb:vortex-file-compressed 102141452 104625551 0.98
tpch_q22/duckdb:vortex-file-compressed 16403284 16847478 0.97
duckdb / vortex-compact (0.985x ➖, 0↑ 0↓)
name PR d75de6d (ns) base deb7de0 (ns) ratio (PR/base)
tpch_q01/duckdb:vortex-compact 38026810 37941129 1.00
tpch_q02/duckdb:vortex-compact 34730583 35498600 0.98
tpch_q03/duckdb:vortex-compact 29887219 31832454 0.94
tpch_q04/duckdb:vortex-compact 34286437 34150421 1.00
tpch_q05/duckdb:vortex-compact 36742735 37078210 0.99
tpch_q06/duckdb:vortex-compact 14141644 14724085 0.96
tpch_q07/duckdb:vortex-compact 41280915 41850216 0.99
tpch_q08/duckdb:vortex-compact 43105110 44748431 0.96
tpch_q09/duckdb:vortex-compact 80939270 84704574 0.96
tpch_q10/duckdb:vortex-compact 38567850 39251523 0.98
tpch_q11/duckdb:vortex-compact 19710922 18989746 1.04
tpch_q12/duckdb:vortex-compact 34385876 34468151 1.00
tpch_q13/duckdb:vortex-compact 44036225 44544789 0.99
tpch_q14/duckdb:vortex-compact 28515272 28073584 1.02
tpch_q15/duckdb:vortex-compact 19141225 19916945 0.96
tpch_q16/duckdb:vortex-compact 34242733 35469102 0.97
tpch_q17/duckdb:vortex-compact 28881275 29924649 0.97
tpch_q18/duckdb:vortex-compact 51088288 49628155 1.03
tpch_q19/duckdb:vortex-compact 34424848 34301334 1.00
tpch_q20/duckdb:vortex-compact 40633225 41687489 0.97
tpch_q21/duckdb:vortex-compact 107540029 109888433 0.98
tpch_q22/duckdb:vortex-compact 19373241 19638917 0.99
duckdb / parquet (1.014x ➖, 1↑ 2↓)
name PR d75de6d (ns) base deb7de0 (ns) ratio (PR/base)
tpch_q01/duckdb:parquet 81473683 75221134 1.08
tpch_q02/duckdb:parquet 39929242 39399923 1.01
tpch_q03/duckdb:parquet 70345724 69358302 1.01
tpch_q04/duckdb:parquet 47321002 46814378 1.01
tpch_q05/duckdb:parquet 66693070 66235042 1.01
tpch_q06/duckdb:parquet 19933148 20301961 0.98
tpch_q07/duckdb:parquet 🚨 74394032 67032535 1.11
tpch_q08/duckdb:parquet 🚨 90436229 80284118 1.13
tpch_q09/duckdb:parquet 150566388 153245669 0.98
tpch_q10/duckdb:parquet 117262336 115404580 1.02
tpch_q11/duckdb:parquet 23481956 22022850 1.07
tpch_q12/duckdb:parquet 45430785 46015769 0.99
tpch_q13/duckdb:parquet 254169929 247007790 1.03
tpch_q14/duckdb:parquet 48550937 48634776 1.00
tpch_q15/duckdb:parquet 🚀 24279034 28874982 0.84
tpch_q16/duckdb:parquet 56324237 55660344 1.01
tpch_q17/duckdb:parquet 50867185 54810612 0.93
tpch_q18/duckdb:parquet 117742782 114285080 1.03
tpch_q19/duckdb:parquet 65883276 64638115 1.02
tpch_q20/duckdb:parquet 62970532 62792072 1.00
tpch_q21/duckdb:parquet 172818572 159495850 1.08
tpch_q22/duckdb:parquet 51748227 51615889 1.00
duckdb / duckdb (0.989x ➖, 0↑ 0↓)
name PR d75de6d (ns) base deb7de0 (ns) ratio (PR/base)
tpch_q01/duckdb:duckdb 15892593 16099893 0.99
tpch_q02/duckdb:duckdb 12803717 12304003 1.04
tpch_q03/duckdb:duckdb 18957379 18971504 1.00
tpch_q04/duckdb:duckdb 19332629 19262498 1.00
tpch_q05/duckdb:duckdb 19440759 19932684 0.98
tpch_q06/duckdb:duckdb 5341140 5281952 1.01
tpch_q07/duckdb:duckdb 22061401 22246680 0.99
tpch_q08/duckdb:duckdb 20761242 21296426 0.97
tpch_q09/duckdb:duckdb 54353270 55807694 0.97
tpch_q10/duckdb:duckdb 43765072 43178190 1.01
tpch_q11/duckdb:duckdb 5749334 5785845 0.99
tpch_q12/duckdb:duckdb 13770252 14056520 0.98
tpch_q13/duckdb:duckdb 37816252 37804195 1.00
tpch_q14/duckdb:duckdb 17612284 18694932 0.94
tpch_q15/duckdb:duckdb 12181700 12270871 0.99
tpch_q16/duckdb:duckdb 23870873 23017710 1.04
tpch_q17/duckdb:duckdb 13555874 13961354 0.97
tpch_q18/duckdb:duckdb 39291283 38409610 1.02
tpch_q19/duckdb:duckdb 27093238 29181124 0.93
tpch_q20/duckdb:duckdb 22586199 23068010 0.98
tpch_q21/duckdb:duckdb 54516224 57601580 0.95
tpch_q22/duckdb:duckdb 24692235 24736353 1.00
Full attributed analysis
Query Config Raw Δ Control Δ Attributed α Noise floor Significant?
1 datafusion:arrow -5.1% +23.4% -23.1% +18.5% ✅ faster
1 datafusion:vortex-compact -1.1% +23.4% -19.8% +16.2% ✅ faster
1 datafusion:vortex-file-compressed +4.2% +23.4% -15.5% +16.8% ✅ faster
1 duckdb:duckdb -1.3% +23.4% -20.0% +16.6% ✅ faster
1 duckdb:vortex-compact +0.2% +23.4% -18.8% +15.5% ✅ faster
1 duckdb:vortex-file-compressed +0.3% +23.4% -18.7% +19.2% ✅ faster
2 datafusion:arrow -3.3% +1.6% -4.8% +14.5% ➖ noise
2 datafusion:vortex-compact -6.9% +1.6% -8.3% +14.5% ➖ noise
2 datafusion:vortex-file-compressed -1.6% +1.6% -3.1% +14.5% ➖ noise
2 duckdb:duckdb +4.1% +1.6% +2.4% +14.5% ➖ noise
2 duckdb:vortex-compact -2.2% +1.6% -3.7% +14.5% ➖ noise
2 duckdb:vortex-file-compressed -3.1% +1.6% -4.6% +14.5% ➖ noise
3 datafusion:arrow +12.9% +4.0% +8.6% +14.5% ➖ noise
3 datafusion:vortex-compact -2.2% +4.0% -6.0% +14.5% ➖ noise
3 datafusion:vortex-file-compressed -2.6% +4.0% -6.3% +14.5% ➖ noise
3 duckdb:duckdb -0.1% +4.0% -3.9% +14.5% ➖ noise
3 duckdb:vortex-compact -6.1% +4.0% -9.7% +14.5% ➖ noise
3 duckdb:vortex-file-compressed -0.2% +4.0% -4.0% +14.5% ➖ noise
4 datafusion:arrow +12.7% +2.0% +10.5% +14.5% ➖ noise
4 datafusion:vortex-compact -5.3% +2.0% -7.1% +14.5% ➖ noise
4 datafusion:vortex-file-compressed -1.7% +2.0% -3.7% +14.5% ➖ noise
4 duckdb:duckdb +0.4% +2.0% -1.6% +14.5% ➖ noise
4 duckdb:vortex-compact +0.4% +2.0% -1.6% +14.5% ➖ noise
4 duckdb:vortex-file-compressed -2.9% +2.0% -4.8% +14.5% ➖ noise
5 datafusion:arrow +14.6% +2.1% +12.3% +14.5% ➖ noise
5 datafusion:vortex-compact -3.8% +2.1% -5.7% +14.5% ➖ noise
5 datafusion:vortex-file-compressed +1.3% +2.1% -0.8% +14.5% ➖ noise
5 duckdb:duckdb -2.5% +2.1% -4.4% +14.5% ➖ noise
5 duckdb:vortex-compact -0.9% +2.1% -2.9% +14.5% ➖ noise
5 duckdb:vortex-file-compressed -4.5% +2.1% -6.5% +14.5% ➖ noise
6 datafusion:arrow +14.5% -3.9% +19.1% +14.5% 🚨 regression
6 datafusion:vortex-compact -2.7% -3.9% +1.2% +14.5% ➖ noise
6 datafusion:vortex-file-compressed -7.4% -3.9% -3.7% +14.5% ➖ noise
6 duckdb:duckdb +1.1% -3.9% +5.2% +14.5% ➖ noise
6 duckdb:vortex-compact -4.0% -3.9% -0.1% +22.8% ➖ noise
6 duckdb:vortex-file-compressed +1.7% -3.9% +5.8% +14.5% ➖ noise
7 datafusion:arrow +0.2% +6.1% -5.6% +14.5% ➖ noise
7 datafusion:vortex-compact -1.1% +6.1% -6.7% +14.5% ➖ noise
7 datafusion:vortex-file-compressed -0.1% +6.1% -5.8% +14.5% ➖ noise
7 duckdb:duckdb -0.8% +6.1% -6.5% +14.5% ➖ noise
7 duckdb:vortex-compact -1.4% +6.1% -7.0% +14.5% ➖ noise
7 duckdb:vortex-file-compressed +0.3% +6.1% -5.5% +14.5% ➖ noise
8 datafusion:arrow +0.2% +4.4% -4.0% +14.5% ➖ noise
8 datafusion:vortex-compact -5.0% +4.4% -9.0% +14.5% ➖ noise
8 datafusion:vortex-file-compressed -1.9% +4.4% -6.0% +14.5% ➖ noise
8 duckdb:duckdb -2.5% +4.4% -6.6% +14.5% ➖ noise
8 duckdb:vortex-compact -3.7% +4.4% -7.7% +14.5% ➖ noise
8 duckdb:vortex-file-compressed -6.3% +4.4% -10.3% +15.6% ➖ noise
9 datafusion:arrow +4.9% -1.4% +6.4% +14.5% ➖ noise
9 datafusion:vortex-compact -1.4% -1.4% +0.1% +14.5% ➖ noise
9 datafusion:vortex-file-compressed +1.1% -1.4% +2.6% +14.5% ➖ noise
9 duckdb:duckdb -2.6% -1.4% -1.2% +14.5% ➖ noise
9 duckdb:vortex-compact -4.4% -1.4% -3.0% +14.5% ➖ noise
9 duckdb:vortex-file-compressed +0.6% -1.4% +2.1% +14.5% ➖ noise
10 datafusion:arrow +5.7% +1.0% +4.7% +14.5% ➖ noise
10 datafusion:vortex-compact -6.0% +1.0% -6.9% +14.5% ➖ noise
10 datafusion:vortex-file-compressed +0.6% +1.0% -0.3% +14.5% ➖ noise
10 duckdb:duckdb +1.4% +1.0% +0.4% +14.5% ➖ noise
10 duckdb:vortex-compact -1.7% +1.0% -2.7% +14.5% ➖ noise
10 duckdb:vortex-file-compressed -1.9% +1.0% -2.9% +14.5% ➖ noise
11 datafusion:arrow -5.9% +5.1% -10.4% +14.5% ➖ noise
11 datafusion:vortex-compact -8.4% +5.1% -12.8% +14.5% ✅ faster
11 datafusion:vortex-file-compressed -3.0% +5.1% -7.7% +14.5% ➖ noise
11 duckdb:duckdb -0.6% +5.1% -5.4% +14.5% ➖ noise
11 duckdb:vortex-compact +3.8% +5.1% -1.2% +14.5% ➖ noise
11 duckdb:vortex-file-compressed -2.3% +5.1% -7.0% +14.5% ➖ noise
12 datafusion:arrow +5.2% -5.0% +10.8% +18.1% ➖ noise
12 datafusion:vortex-compact -4.1% -5.0% +0.9% +14.5% ➖ noise
12 datafusion:vortex-file-compressed +0.4% -5.0% +5.7% +14.5% ➖ noise
12 duckdb:duckdb -2.0% -5.0% +3.2% +14.5% ➖ noise
12 duckdb:vortex-compact -0.2% -5.0% +5.0% +14.5% ➖ noise
12 duckdb:vortex-file-compressed +1.0% -5.0% +6.3% +14.5% ➖ noise
13 datafusion:arrow +0.3% +1.9% -1.6% +14.5% ➖ noise
13 datafusion:vortex-compact -5.2% +1.9% -7.0% +14.5% ➖ noise
13 datafusion:vortex-file-compressed -3.5% +1.9% -5.4% +14.5% ➖ noise
13 duckdb:duckdb +0.0% +1.9% -1.9% +14.5% ➖ noise
13 duckdb:vortex-compact -1.1% +1.9% -3.0% +14.5% ➖ noise
13 duckdb:vortex-file-compressed -0.9% +1.9% -2.7% +14.5% ➖ noise
14 datafusion:arrow +7.3% -0.1% +7.4% +14.5% ➖ noise
14 datafusion:vortex-compact -1.0% -0.1% -0.9% +14.5% ➖ noise
14 datafusion:vortex-file-compressed +0.1% -0.1% +0.2% +14.5% ➖ noise
14 duckdb:duckdb -5.8% -0.1% -5.7% +14.5% ➖ noise
14 duckdb:vortex-compact +1.6% -0.1% +1.7% +14.5% ➖ noise
14 duckdb:vortex-file-compressed -2.0% -0.1% -2.0% +14.5% ➖ noise
15 datafusion:arrow +8.3% -5.0% +14.0% +14.5% ➖ noise
15 datafusion:vortex-compact -3.0% -5.0% +2.1% +14.5% ➖ noise
15 datafusion:vortex-file-compressed -8.0% -5.0% -3.2% +14.5% ➖ noise
15 duckdb:duckdb -0.7% -5.0% +4.5% +19.5% ➖ noise
15 duckdb:vortex-compact -3.9% -5.0% +1.1% +16.8% ➖ noise
15 duckdb:vortex-file-compressed -1.9% -5.0% +3.2% +14.5% ➖ noise
16 datafusion:arrow +2.3% +3.2% -0.8% +14.5% ➖ noise
16 datafusion:vortex-compact -3.7% +3.2% -6.7% +14.5% ➖ noise
16 datafusion:vortex-file-compressed -3.8% +3.2% -6.8% +14.5% ➖ noise
16 duckdb:duckdb +3.7% +3.2% +0.5% +14.5% ➖ noise
16 duckdb:vortex-compact -3.5% +3.2% -6.4% +14.5% ➖ noise
16 duckdb:vortex-file-compressed -4.3% +3.2% -7.3% +14.5% ➖ noise
17 datafusion:arrow +11.6% +4.4% +6.9% +14.5% ➖ noise
17 datafusion:vortex-compact -0.5% +4.4% -4.7% +14.5% ➖ noise
17 datafusion:vortex-file-compressed +13.5% +4.4% +8.7% +14.5% ➖ noise
17 duckdb:duckdb -2.9% +4.4% -7.0% +14.5% ➖ noise
17 duckdb:vortex-compact -3.5% +4.4% -7.5% +14.5% ➖ noise
17 duckdb:vortex-file-compressed -0.5% +4.4% -4.7% +14.8% ➖ noise
18 datafusion:arrow +8.8% +5.6% +3.0% +14.5% ➖ noise
18 datafusion:vortex-compact +1.2% +5.6% -4.2% +14.5% ➖ noise
18 datafusion:vortex-file-compressed +8.1% +5.6% +2.3% +14.5% ➖ noise
18 duckdb:duckdb +2.3% +5.6% -3.1% +14.5% ➖ noise
18 duckdb:vortex-compact +2.9% +5.6% -2.5% +14.5% ➖ noise
18 duckdb:vortex-file-compressed +0.2% +5.6% -5.1% +14.5% ➖ noise
19 datafusion:arrow +7.0% +0.5% +6.5% +16.3% ➖ noise
19 datafusion:vortex-compact -7.1% +0.5% -7.5% +14.5% ➖ noise
19 datafusion:vortex-file-compressed -2.9% +0.5% -3.4% +14.5% ➖ noise
19 duckdb:duckdb -7.2% +0.5% -7.6% +14.5% ➖ noise
19 duckdb:vortex-compact +0.4% +0.5% -0.1% +14.5% ➖ noise
19 duckdb:vortex-file-compressed -0.8% +0.5% -1.2% +14.5% ➖ noise
20 datafusion:arrow +13.4% +1.2% +12.1% +14.5% ➖ noise
20 datafusion:vortex-compact -6.2% +1.2% -7.3% +14.5% ➖ noise
20 datafusion:vortex-file-compressed -0.8% +1.2% -2.0% +14.5% ➖ noise
20 duckdb:duckdb -2.1% +1.2% -3.2% +14.5% ➖ noise
20 duckdb:vortex-compact -2.5% +1.2% -3.6% +14.5% ➖ noise
20 duckdb:vortex-file-compressed -2.7% +1.2% -3.9% +14.5% ➖ noise
21 datafusion:arrow +2.9% +3.2% -0.3% +14.5% ➖ noise
21 datafusion:vortex-compact -0.3% +3.2% -3.4% +14.5% ➖ noise
21 datafusion:vortex-file-compressed -2.7% +3.2% -5.7% +14.5% ➖ noise
21 duckdb:duckdb -5.4% +3.2% -8.3% +14.5% ➖ noise
21 duckdb:vortex-compact -2.1% +3.2% -5.2% +14.5% ➖ noise
21 duckdb:vortex-file-compressed -2.4% +3.2% -5.4% +14.5% ➖ noise
22 datafusion:arrow +0.8% -1.5% +2.3% +14.5% ➖ noise
22 datafusion:vortex-compact -4.2% -1.5% -2.8% +14.5% ➖ noise
22 datafusion:vortex-file-compressed -4.9% -1.5% -3.5% +14.5% ➖ noise
22 duckdb:duckdb -0.2% -1.5% +1.3% +14.5% ➖ noise
22 duckdb:vortex-compact -1.4% -1.5% +0.1% +14.5% ➖ noise
22 duckdb:vortex-file-compressed -2.6% -1.5% -1.2% +14.5% ➖ noise

@github-actions
Copy link
Copy Markdown
Contributor

File Sizes: TPC-DS SF=1 on NVME

No file size changes detected.

@github-actions
Copy link
Copy Markdown
Contributor

File Sizes: TPC-H SF=1 on NVME

No file size changes detected.

@github-actions
Copy link
Copy Markdown
Contributor

github-actions Bot commented Apr 30, 2026

Benchmarks: FineWeb S3

Verdict: No clear signal (environment too noisy confidence)
Attributed Vortex impact: +5.6%
Vortex (geomean): 1.054x ➖
Parquet (geomean): 0.999x ➖
Shifts: Parquet (control) -0.1% · Median polish +5.5%


datafusion / vortex-file-compressed (1.031x ➖, 0↑ 0↓)
name PR d75de6d (ns) base deb7de0 (ns) ratio (PR/base)
fineweb_q00/datafusion:vortex-file-compressed 33566687 31839650 1.05
fineweb_q01/datafusion:vortex-file-compressed 581772696 631267450 0.92
fineweb_q02/datafusion:vortex-file-compressed 480626631 459441243 1.05
fineweb_q03/datafusion:vortex-file-compressed 1521458501 1350642518 1.13
fineweb_q04/datafusion:vortex-file-compressed 1377031469 1399664697 0.98
fineweb_q05/datafusion:vortex-file-compressed 1386990973 1369541356 1.01
fineweb_q06/datafusion:vortex-file-compressed 1569391260 1586873817 0.99
fineweb_q07/datafusion:vortex-file-compressed 1340175043 1351712401 0.99
fineweb_q08/datafusion:vortex-file-compressed 604054558 512237513 1.18
datafusion / vortex-compact (1.045x ➖, 0↑ 0↓)
name PR d75de6d (ns) base deb7de0 (ns) ratio (PR/base)
fineweb_q00/datafusion:vortex-compact 34958718 33530583 1.04
fineweb_q01/datafusion:vortex-compact 804375283 693922101 1.16
fineweb_q02/datafusion:vortex-compact 575789618 543025770 1.06
fineweb_q03/datafusion:vortex-compact 1613487677 1502981100 1.07
fineweb_q04/datafusion:vortex-compact 1906008521 1735091004 1.10
fineweb_q05/datafusion:vortex-compact 1544079296 1462772696 1.06
fineweb_q06/datafusion:vortex-compact 1382838179 1348811714 1.03
fineweb_q07/datafusion:vortex-compact 1227923750 1347414969 0.91
fineweb_q08/datafusion:vortex-compact 377246766 378526088 1.00
datafusion / parquet (0.960x ➖, 0↑ 0↓)
name PR d75de6d (ns) base deb7de0 (ns) ratio (PR/base)
fineweb_q00/datafusion:parquet 1228219483 1081619881 1.14
fineweb_q01/datafusion:parquet 1851237608 1707809173 1.08
fineweb_q02/datafusion:parquet 1842170083 2129337312 0.87
fineweb_q03/datafusion:parquet 1682854599 1864078770 0.90
fineweb_q04/datafusion:parquet 1769017385 1928845068 0.92
fineweb_q05/datafusion:parquet 1990276900 2060997623 0.97
fineweb_q06/datafusion:parquet 1975926444 2115401237 0.93
fineweb_q07/datafusion:parquet 1776376031 2114381199 0.84
fineweb_q08/datafusion:parquet 1808265355 1742284143 1.04
duckdb / vortex-file-compressed (1.067x ➖, 0↑ 0↓)
name PR d75de6d (ns) base deb7de0 (ns) ratio (PR/base)
fineweb_q00/duckdb:vortex-file-compressed 87790445 97737527 0.90
fineweb_q01/duckdb:vortex-file-compressed 603330187 565137362 1.07
fineweb_q02/duckdb:vortex-file-compressed 506640397 493054312 1.03
fineweb_q03/duckdb:vortex-file-compressed 1778028358 1649347371 1.08
fineweb_q04/duckdb:vortex-file-compressed 1896192187 1512428488 1.25
fineweb_q05/duckdb:vortex-file-compressed 1692235718 1475603219 1.15
fineweb_q06/duckdb:vortex-file-compressed 1895405211 1763315542 1.07
fineweb_q07/duckdb:vortex-file-compressed 1736533949 1514832688 1.15
fineweb_q08/duckdb:vortex-file-compressed 694178869 729126515 0.95
duckdb / vortex-compact (1.075x ➖, 0↑ 0↓)
name PR d75de6d (ns) base deb7de0 (ns) ratio (PR/base)
fineweb_q00/duckdb:vortex-compact 61673601 78689546 0.78
fineweb_q01/duckdb:vortex-compact 576997139 538266423 1.07
fineweb_q02/duckdb:vortex-compact 607825056 581602598 1.05
fineweb_q03/duckdb:vortex-compact 1778681147 1622925943 1.10
fineweb_q04/duckdb:vortex-compact 2010652949 1727400318 1.16
fineweb_q05/duckdb:vortex-compact 1889647891 1542626669 1.22
fineweb_q06/duckdb:vortex-compact 1622184045 1475150229 1.10
fineweb_q07/duckdb:vortex-compact 1557216123 1397881432 1.11
fineweb_q08/duckdb:vortex-compact 552746100 486014816 1.14
duckdb / parquet (1.038x ➖, 0↑ 0↓)
name PR d75de6d (ns) base deb7de0 (ns) ratio (PR/base)
fineweb_q00/duckdb:parquet 1136816905 1128902111 1.01
fineweb_q01/duckdb:parquet 1547526104 1470665909 1.05
fineweb_q02/duckdb:parquet 1430330410 1441491171 0.99
fineweb_q03/duckdb:parquet 3771061341 3726855699 1.01
fineweb_q04/duckdb:parquet 2004676771 1948438504 1.03
fineweb_q05/duckdb:parquet 2279806304 2127489888 1.07
fineweb_q06/duckdb:parquet 4524547168 4613634385 0.98
fineweb_q07/duckdb:parquet 3117318489 2806785747 1.11
fineweb_q08/duckdb:parquet 1257488436 1144137295 1.10
Full attributed analysis
Query Config Raw Δ Control Δ Attributed α Noise floor Significant?
0 datafusion:vortex-compact +4.3% +6.9% -2.5% +194.5% ➖ noise
0 datafusion:vortex-file-compressed +5.4% +6.9% -1.4% +279.6% ➖ noise
0 duckdb:vortex-compact -21.6% +6.9% -26.7% +68.9% ➖ noise
0 duckdb:vortex-file-compressed -10.2% +6.9% -16.0% +63.9% ➖ noise
1 datafusion:vortex-compact +15.9% +6.8% +8.5% +35.6% ➖ noise
1 datafusion:vortex-file-compressed -7.8% +6.8% -13.7% +63.4% ➖ noise
1 duckdb:vortex-compact +7.2% +6.8% +0.4% +30.0% ➖ noise
1 duckdb:vortex-file-compressed +6.8% +6.8% -0.0% +30.0% ➖ noise
2 datafusion:vortex-compact +6.0% -7.3% +14.4% +30.0% ➖ noise
2 datafusion:vortex-file-compressed +4.6% -7.3% +12.9% +44.3% ➖ noise
2 duckdb:vortex-compact +4.5% -7.3% +12.8% +30.0% ➖ noise
2 duckdb:vortex-file-compressed +2.8% -7.3% +10.9% +37.5% ➖ noise
3 datafusion:vortex-compact +7.4% -4.4% +12.3% +30.0% ➖ noise
3 datafusion:vortex-file-compressed +12.6% -4.4% +17.9% +30.0% ➖ noise
3 duckdb:vortex-compact +9.6% -4.4% +14.7% +30.0% ➖ noise
3 duckdb:vortex-file-compressed +7.8% -4.4% +12.8% +30.0% ➖ noise
4 datafusion:vortex-compact +9.9% -2.9% +13.1% +30.0% ➖ noise
4 datafusion:vortex-file-compressed -1.6% -2.9% +1.3% +30.0% ➖ noise
4 duckdb:vortex-compact +16.4% -2.9% +19.8% +30.0% ➖ noise
4 duckdb:vortex-file-compressed +25.4% -2.9% +29.1% +30.0% ➖ noise
5 datafusion:vortex-compact +5.6% +1.7% +3.8% +30.0% ➖ noise
5 datafusion:vortex-file-compressed +1.3% +1.7% -0.4% +30.0% ➖ noise
5 duckdb:vortex-compact +22.5% +1.7% +20.4% +30.0% ➖ noise
5 duckdb:vortex-file-compressed +14.7% +1.7% +12.7% +30.0% ➖ noise
6 datafusion:vortex-compact +2.5% -4.3% +7.1% +30.0% ➖ noise
6 datafusion:vortex-file-compressed -1.1% -4.3% +3.3% +30.0% ➖ noise
6 duckdb:vortex-compact +10.0% -4.3% +14.9% +30.0% ➖ noise
6 duckdb:vortex-file-compressed +7.5% -4.3% +12.3% +30.0% ➖ noise
7 datafusion:vortex-compact -8.9% -3.4% -5.7% +30.0% ➖ noise
7 datafusion:vortex-file-compressed -0.9% -3.4% +2.6% +30.0% ➖ noise
7 duckdb:vortex-compact +11.4% -3.4% +15.3% +30.0% ➖ noise
7 duckdb:vortex-file-compressed +14.6% -3.4% +18.7% +30.0% ➖ noise
8 datafusion:vortex-compact -0.3% +6.8% -6.7% +30.0% ➖ noise
8 datafusion:vortex-file-compressed +17.9% +6.8% +10.4% +30.0% ➖ noise
8 duckdb:vortex-compact +13.7% +6.8% +6.5% +30.0% ➖ noise
8 duckdb:vortex-file-compressed -4.8% +6.8% -10.9% +30.0% ➖ noise

@github-actions
Copy link
Copy Markdown
Contributor

github-actions Bot commented Apr 30, 2026

Benchmarks: Statistical and Population Genetics

Verdict: No clear signal (low confidence)
Attributed Vortex impact: +0.7%
Vortex (geomean): 1.017x ➖
Parquet (geomean): 1.011x ➖
Shifts: Parquet (control) +1.1% · Median polish +2.1%


duckdb / vortex-file-compressed (1.013x ➖, 0↑ 0↓)
name PR d75de6d (ns) base deb7de0 (ns) ratio (PR/base)
statpopgen_q00/duckdb:vortex-file-compressed 11602813 11596263 1.00
statpopgen_q01/duckdb:vortex-file-compressed 26228437 26126102 1.00
statpopgen_q02/duckdb:vortex-file-compressed 1411611587 1381949837 1.02
statpopgen_q03/duckdb:vortex-file-compressed 3212210049 3099297980 1.04
statpopgen_q04/duckdb:vortex-file-compressed 3263632984 3160580656 1.03
statpopgen_q05/duckdb:vortex-file-compressed 1466208277 1436082861 1.02
statpopgen_q06/duckdb:vortex-file-compressed 2179881395 2137426113 1.02
statpopgen_q07/duckdb:vortex-file-compressed 207714235 207801065 1.00
statpopgen_q08/duckdb:vortex-file-compressed 238703938 255816424 0.93
statpopgen_q09/duckdb:vortex-file-compressed 3051730090 2914531617 1.05
statpopgen_q10/duckdb:vortex-file-compressed 4835828197 4673967236 1.03
duckdb / vortex-compact (1.021x ➖, 0↑ 0↓)
name PR d75de6d (ns) base deb7de0 (ns) ratio (PR/base)
statpopgen_q00/duckdb:vortex-compact 11152623 11228732 0.99
statpopgen_q01/duckdb:vortex-compact 168118948 165729025 1.01
statpopgen_q02/duckdb:vortex-compact 1883035922 1821961743 1.03
statpopgen_q03/duckdb:vortex-compact 3630698617 3510102843 1.03
statpopgen_q04/duckdb:vortex-compact 3662065255 3515883156 1.04
statpopgen_q05/duckdb:vortex-compact 1866727353 1804460912 1.03
statpopgen_q06/duckdb:vortex-compact 2709791688 2692212991 1.01
statpopgen_q07/duckdb:vortex-compact 899248904 888463661 1.01
statpopgen_q08/duckdb:vortex-compact 925916443 922607171 1.00
statpopgen_q09/duckdb:vortex-compact 3494237542 3334043270 1.05
statpopgen_q10/duckdb:vortex-compact 5506443507 5429469030 1.01
duckdb / parquet (1.011x ➖, 0↑ 0↓)
name PR d75de6d (ns) base deb7de0 (ns) ratio (PR/base)
statpopgen_q00/duckdb:parquet 320987790 333614266 0.96
statpopgen_q01/duckdb:parquet 410537659 406187047 1.01
statpopgen_q02/duckdb:parquet 1020744162 1009571447 1.01
statpopgen_q03/duckdb:parquet 1579493955 1494280022 1.06
statpopgen_q04/duckdb:parquet 1568819805 1535474308 1.02
statpopgen_q05/duckdb:parquet 1033150439 1012419262 1.02
statpopgen_q06/duckdb:parquet 1504568077 1486540000 1.01
statpopgen_q07/duckdb:parquet 1276558826 1317315446 0.97
statpopgen_q08/duckdb:parquet 1299715721 1317088585 0.99
statpopgen_q09/duckdb:parquet 1447518615 1394477649 1.04
statpopgen_q10/duckdb:parquet 2769056347 2684908493 1.03
Full attributed analysis
Query Config Raw Δ Control Δ Attributed α Noise floor Significant?
0 duckdb:vortex-compact -0.7% -3.8% +3.2% +10.0% ➖ noise
0 duckdb:vortex-file-compressed +0.1% -3.8% +4.0% +12.4% ➖ noise
1 duckdb:vortex-compact +1.4% +1.1% +0.4% +35.1% ➖ noise
1 duckdb:vortex-file-compressed +0.4% +1.1% -0.7% +187.6% ➖ noise
2 duckdb:vortex-compact +3.4% +1.1% +2.2% +10.0% ➖ noise
2 duckdb:vortex-file-compressed +2.1% +1.1% +1.0% +10.0% ➖ noise
3 duckdb:vortex-compact +3.4% +5.7% -2.1% +10.0% ➖ noise
3 duckdb:vortex-file-compressed +3.6% +5.7% -1.9% +10.0% ➖ noise
4 duckdb:vortex-compact +4.2% +2.2% +1.9% +10.0% ➖ noise
4 duckdb:vortex-file-compressed +3.3% +2.2% +1.1% +10.0% ➖ noise
5 duckdb:vortex-compact +3.5% +2.0% +1.4% +10.0% ➖ noise
5 duckdb:vortex-file-compressed +2.1% +2.0% +0.0% +10.0% ➖ noise
6 duckdb:vortex-compact +0.7% +1.2% -0.6% +10.0% ➖ noise
6 duckdb:vortex-file-compressed +2.0% +1.2% +0.8% +10.0% ➖ noise
7 duckdb:vortex-compact +1.2% -3.1% +4.4% +10.0% ➖ noise
7 duckdb:vortex-file-compressed -0.0% -3.1% +3.1% +11.5% ➖ noise
8 duckdb:vortex-compact +0.4% -1.3% +1.7% +10.0% ➖ noise
8 duckdb:vortex-file-compressed -6.7% -1.3% -5.4% +10.0% ➖ noise
9 duckdb:vortex-compact +4.8% +3.8% +1.0% +10.0% ➖ noise
9 duckdb:vortex-file-compressed +4.7% +3.8% +0.9% +10.0% ➖ noise
10 duckdb:vortex-compact +1.4% +3.1% -1.7% +10.0% ➖ noise
10 duckdb:vortex-file-compressed +3.5% +3.1% +0.3% +10.0% ➖ noise

@github-actions
Copy link
Copy Markdown
Contributor

File Sizes: Statistical and Population Genetics

No file size changes detected.

@github-actions
Copy link
Copy Markdown
Contributor

github-actions Bot commented Apr 30, 2026

Benchmarks: TPC-H SF=10 on NVME

Verdict: No clear signal (low confidence)
Attributed Vortex impact: +5.0%
Vortex (geomean): 1.034x ➖
Parquet (geomean): 1.004x ➖
Shifts: Parquet (control) +0.4% · Median polish +1.0%


datafusion / vortex-file-compressed (1.014x ➖, 0↑ 1↓)
name PR d75de6d (ns) base deb7de0 (ns) ratio (PR/base)
tpch_q01/datafusion:vortex-file-compressed 398174597 388441705 1.03
tpch_q02/datafusion:vortex-file-compressed 105194123 105019405 1.00
tpch_q03/datafusion:vortex-file-compressed 212802318 211122638 1.01
tpch_q04/datafusion:vortex-file-compressed 115289656 113098075 1.02
tpch_q05/datafusion:vortex-file-compressed 364158247 366076633 0.99
tpch_q06/datafusion:vortex-file-compressed 42641445 43108246 0.99
tpch_q07/datafusion:vortex-file-compressed 494927935 493106394 1.00
tpch_q08/datafusion:vortex-file-compressed 355616933 348708033 1.02
tpch_q09/datafusion:vortex-file-compressed 607942571 617893385 0.98
tpch_q10/datafusion:vortex-file-compressed 231840563 227037448 1.02
tpch_q11/datafusion:vortex-file-compressed 84162297 79557701 1.06
tpch_q12/datafusion:vortex-file-compressed 120587263 118373927 1.02
tpch_q13/datafusion:vortex-file-compressed 215395840 209144688 1.03
tpch_q14/datafusion:vortex-file-compressed 55220701 56186827 0.98
tpch_q15/datafusion:vortex-file-compressed 103492202 104968873 0.99
tpch_q16/datafusion:vortex-file-compressed 73901048 73800366 1.00
tpch_q17/datafusion:vortex-file-compressed 626875148 617486575 1.02
tpch_q18/datafusion:vortex-file-compressed 819494639 820827454 1.00
tpch_q19/datafusion:vortex-file-compressed 92545681 91332559 1.01
tpch_q20/datafusion:vortex-file-compressed 🚨 183557310 164874687 1.11
tpch_q21/datafusion:vortex-file-compressed 662299320 638881791 1.04
tpch_q22/datafusion:vortex-file-compressed 62965967 63290996 0.99
datafusion / vortex-compact (1.016x ➖, 0↑ 1↓)
name PR d75de6d (ns) base deb7de0 (ns) ratio (PR/base)
tpch_q01/datafusion:vortex-compact 444001610 448055061 0.99
tpch_q02/datafusion:vortex-compact 114290412 106533932 1.07
tpch_q03/datafusion:vortex-compact 221115357 216019183 1.02
tpch_q04/datafusion:vortex-compact 118155883 121448404 0.97
tpch_q05/datafusion:vortex-compact 365639749 367284340 1.00
tpch_q06/datafusion:vortex-compact 62069193 63534680 0.98
tpch_q07/datafusion:vortex-compact 510347991 511063470 1.00
tpch_q08/datafusion:vortex-compact 362764774 354518929 1.02
tpch_q09/datafusion:vortex-compact 654358143 624902700 1.05
tpch_q10/datafusion:vortex-compact 267313563 244793323 1.09
tpch_q11/datafusion:vortex-compact 🚨 89635575 80613183 1.11
tpch_q12/datafusion:vortex-compact 175387525 163691261 1.07
tpch_q13/datafusion:vortex-compact 267186331 260447925 1.03
tpch_q14/datafusion:vortex-compact 72343515 72343331 1.00
tpch_q15/datafusion:vortex-compact 165818671 158098730 1.05
tpch_q16/datafusion:vortex-compact 77272262 77090106 1.00
tpch_q17/datafusion:vortex-compact 632989544 620932904 1.02
tpch_q18/datafusion:vortex-compact 831180922 829332105 1.00
tpch_q19/datafusion:vortex-compact 127770371 130845982 0.98
tpch_q20/datafusion:vortex-compact 183898606 188300616 0.98
tpch_q21/datafusion:vortex-compact 639482745 648070878 0.99
tpch_q22/datafusion:vortex-compact 67149383 70208667 0.96
datafusion / parquet (1.006x ➖, 0↑ 0↓)
name PR d75de6d (ns) base deb7de0 (ns) ratio (PR/base)
tpch_q01/datafusion:parquet 483238312 445577173 1.08
tpch_q02/datafusion:parquet 184327068 171559473 1.07
tpch_q03/datafusion:parquet 311114138 283450705 1.10
tpch_q04/datafusion:parquet 129066962 127670956 1.01
tpch_q05/datafusion:parquet 472625442 436733117 1.08
tpch_q06/datafusion:parquet 123709212 135961255 0.91
tpch_q07/datafusion:parquet 596960707 606427211 0.98
tpch_q08/datafusion:parquet 468285723 468406440 1.00
tpch_q09/datafusion:parquet 732496984 739345837 0.99
tpch_q10/datafusion:parquet 485584499 494148160 0.98
tpch_q11/datafusion:parquet 119293410 118255082 1.01
tpch_q12/datafusion:parquet 193331893 206189102 0.94
tpch_q13/datafusion:parquet 329377308 333471169 0.99
tpch_q14/datafusion:parquet 166411511 161821229 1.03
tpch_q15/datafusion:parquet 244214650 249731929 0.98
tpch_q16/datafusion:parquet 125509445 124891616 1.00
tpch_q17/datafusion:parquet 685487845 673262819 1.02
tpch_q18/datafusion:parquet 885970723 865808798 1.02
tpch_q19/datafusion:parquet 279587997 277223481 1.01
tpch_q20/datafusion:parquet 290902942 296904290 0.98
tpch_q21/datafusion:parquet 682711489 696315597 0.98
tpch_q22/datafusion:parquet 208799122 214046037 0.98
datafusion / arrow (1.090x ➖, 0↑ 8↓)
name PR d75de6d (ns) base deb7de0 (ns) ratio (PR/base)
tpch_q01/datafusion:arrow 643985570 591888211 1.09
tpch_q02/datafusion:arrow 173211246 160148442 1.08
tpch_q03/datafusion:arrow 496972545 459163744 1.08
tpch_q04/datafusion:arrow 360988372 329087468 1.10
tpch_q05/datafusion:arrow 🚨 1013530848 910361850 1.11
tpch_q06/datafusion:arrow 300498903 280011924 1.07
tpch_q07/datafusion:arrow 1238169173 1136068783 1.09
tpch_q08/datafusion:arrow 1209685830 1118088659 1.08
tpch_q09/datafusion:arrow 1436061379 1341599961 1.07
tpch_q10/datafusion:arrow 637591776 583294710 1.09
tpch_q11/datafusion:arrow 141992636 134101417 1.06
tpch_q12/datafusion:arrow 821460269 812357527 1.01
tpch_q13/datafusion:arrow 520078387 504463390 1.03
tpch_q14/datafusion:arrow 🚨 351911755 316882690 1.11
tpch_q15/datafusion:arrow 🚨 784078362 685972590 1.14
tpch_q16/datafusion:arrow 🚨 115964935 101355916 1.14
tpch_q17/datafusion:arrow 🚨 1528448640 1313013932 1.16
tpch_q18/datafusion:arrow 🚨 2149751760 1837636443 1.17
tpch_q19/datafusion:arrow 🚨 530601796 477061344 1.11
tpch_q20/datafusion:arrow 🚨 547719902 483877060 1.13
tpch_q21/datafusion:arrow 3178363635 2975201736 1.07
tpch_q22/datafusion:arrow 126372275 128857661 0.98
duckdb / vortex-file-compressed (0.994x ➖, 0↑ 0↓)
name PR d75de6d (ns) base deb7de0 (ns) ratio (PR/base)
tpch_q01/duckdb:vortex-file-compressed 170614951 171492387 0.99
tpch_q02/duckdb:vortex-file-compressed 51594003 51523343 1.00
tpch_q03/duckdb:vortex-file-compressed 123759244 126882975 0.98
tpch_q04/duckdb:vortex-file-compressed 149705479 151500012 0.99
tpch_q05/duckdb:vortex-file-compressed 125925612 128812050 0.98
tpch_q06/duckdb:vortex-file-compressed 44400053 46623240 0.95
tpch_q07/duckdb:vortex-file-compressed 143497632 140583143 1.02
tpch_q08/duckdb:vortex-file-compressed 171518596 167607805 1.02
tpch_q09/duckdb:vortex-file-compressed 327820561 324390278 1.01
tpch_q10/duckdb:vortex-file-compressed 143656594 142168641 1.01
tpch_q11/duckdb:vortex-file-compressed 32808643 32758495 1.00
tpch_q12/duckdb:vortex-file-compressed 92104112 93551919 0.98
tpch_q13/duckdb:vortex-file-compressed 226160042 227799616 0.99
tpch_q14/duckdb:vortex-file-compressed 64829907 66917303 0.97
tpch_q15/duckdb:vortex-file-compressed 85204028 88780506 0.96
tpch_q16/duckdb:vortex-file-compressed 78994832 80502650 0.98
tpch_q17/duckdb:vortex-file-compressed 95530776 100203538 0.95
tpch_q18/duckdb:vortex-file-compressed 288825861 283041683 1.02
tpch_q19/duckdb:vortex-file-compressed 81991438 83225854 0.99
tpch_q20/duckdb:vortex-file-compressed 155984259 157678468 0.99
tpch_q21/duckdb:vortex-file-compressed 569799069 565217243 1.01
tpch_q22/duckdb:vortex-file-compressed 75633585 70657253 1.07
duckdb / vortex-compact (1.116x ❌, 0↑ 16↓)
name PR d75de6d (ns) base deb7de0 (ns) ratio (PR/base)
tpch_q01/duckdb:vortex-compact 238168235 227052086 1.05
tpch_q02/duckdb:vortex-compact 60560823 55997725 1.08
tpch_q03/duckdb:vortex-compact 🚨 157489658 137506570 1.15
tpch_q04/duckdb:vortex-compact 🚨 189937814 170485719 1.11
tpch_q05/duckdb:vortex-compact 🚨 161496308 142779279 1.13
tpch_q06/duckdb:vortex-compact 91050368 84469402 1.08
tpch_q07/duckdb:vortex-compact 🚨 218084463 196347678 1.11
tpch_q08/duckdb:vortex-compact 🚨 224455873 182646319 1.23
tpch_q09/duckdb:vortex-compact 🚨 390869005 353649908 1.11
tpch_q10/duckdb:vortex-compact 🚨 197460407 175932164 1.12
tpch_q11/duckdb:vortex-compact 🚨 43943627 39884905 1.10
tpch_q12/duckdb:vortex-compact 218048956 200695306 1.09
tpch_q13/duckdb:vortex-compact 🚨 314959121 279044852 1.13
tpch_q14/duckdb:vortex-compact 🚨 109176451 97935832 1.11
tpch_q15/duckdb:vortex-compact 🚨 124912780 112004505 1.12
tpch_q16/duckdb:vortex-compact 🚨 93770738 82570641 1.14
tpch_q17/duckdb:vortex-compact 🚨 125219288 111686221 1.12
tpch_q18/duckdb:vortex-compact 🚨 319929088 284324944 1.13
tpch_q19/duckdb:vortex-compact 114761050 106060429 1.08
tpch_q20/duckdb:vortex-compact 🚨 230665866 201071900 1.15
tpch_q21/duckdb:vortex-compact 🚨 707674353 615549425 1.15
tpch_q22/duckdb:vortex-compact 91823873 84423773 1.09
duckdb / parquet (1.002x ➖, 1↑ 0↓)
name PR d75de6d (ns) base deb7de0 (ns) ratio (PR/base)
tpch_q01/duckdb:parquet 256078408 257322410 1.00
tpch_q02/duckdb:parquet 103295653 96778859 1.07
tpch_q03/duckdb:parquet 217498131 210567519 1.03
tpch_q04/duckdb:parquet 131422730 130803002 1.00
tpch_q05/duckdb:parquet 218983044 212140575 1.03
tpch_q06/duckdb:parquet 66537836 67571805 0.98
tpch_q07/duckdb:parquet 178176374 179823975 0.99
tpch_q08/duckdb:parquet 251203097 249600291 1.01
tpch_q09/duckdb:parquet 488271058 480417661 1.02
tpch_q10/duckdb:parquet 610034112 610294574 1.00
tpch_q11/duckdb:parquet 🚀 52742492 58866075 0.90
tpch_q12/duckdb:parquet 122579689 122213464 1.00
tpch_q13/duckdb:parquet 440202339 448283523 0.98
tpch_q14/duckdb:parquet 175478556 172615341 1.02
tpch_q15/duckdb:parquet 96165502 95448664 1.01
tpch_q16/duckdb:parquet 161650767 163033507 0.99
tpch_q17/duckdb:parquet 175815072 177950229 0.99
tpch_q18/duckdb:parquet 350472689 350725954 1.00
tpch_q19/duckdb:parquet 288568723 282759624 1.02
tpch_q20/duckdb:parquet 227182401 233660537 0.97
tpch_q21/duckdb:parquet 571051125 555155084 1.03
tpch_q22/duckdb:parquet 292778187 289843382 1.01
duckdb / duckdb (1.101x ❌, 0↑ 10↓)
name PR d75de6d (ns) base deb7de0 (ns) ratio (PR/base)
tpch_q01/duckdb:duckdb 123144069 115993474 1.06
tpch_q02/duckdb:duckdb 48773538 48650220 1.00
tpch_q03/duckdb:duckdb 🚨 109937526 96425749 1.14
tpch_q04/duckdb:duckdb 🚨 150370587 130140747 1.16
tpch_q05/duckdb:duckdb 🚨 123363491 108067878 1.14
tpch_q06/duckdb:duckdb 🚨 42429992 36804584 1.15
tpch_q07/duckdb:duckdb 94201875 86249300 1.09
tpch_q08/duckdb:duckdb 🚨 121953704 109154849 1.12
tpch_q09/duckdb:duckdb 🚨 306215755 277718631 1.10
tpch_q10/duckdb:duckdb 🚨 227146162 204169648 1.11
tpch_q11/duckdb:duckdb 16750467 15284698 1.10
tpch_q12/duckdb:duckdb 92759297 85112992 1.09
tpch_q13/duckdb:duckdb 🚨 251671876 220242399 1.14
tpch_q14/duckdb:duckdb 🚨 76895483 69580083 1.11
tpch_q15/duckdb:duckdb 84230327 76954336 1.09
tpch_q16/duckdb:duckdb 80374035 73383383 1.10
tpch_q17/duckdb:duckdb 90879820 84788813 1.07
tpch_q18/duckdb:duckdb 234716289 215914999 1.09
tpch_q19/duckdb:duckdb 125164642 115734784 1.08
tpch_q20/duckdb:duckdb 120313125 111613038 1.08
tpch_q21/duckdb:duckdb 🚨 333167753 296142496 1.13
tpch_q22/duckdb:duckdb 73418471 67675843 1.08
Full attributed analysis
Query Config Raw Δ Control Δ Attributed α Noise floor Significant?
1 datafusion:arrow +8.8% +3.9% +4.7% +10.0% ➖ noise
1 datafusion:vortex-compact -0.9% +3.9% -4.6% +10.0% ➖ noise
1 datafusion:vortex-file-compressed +2.5% +3.9% -1.3% +10.0% ➖ noise
1 duckdb:duckdb +6.2% +3.9% +2.2% +10.0% ➖ noise
1 duckdb:vortex-compact +4.9% +3.9% +1.0% +10.0% ➖ noise
1 duckdb:vortex-file-compressed -0.5% +3.9% -4.2% +10.0% ➖ noise
2 datafusion:arrow +8.2% +7.1% +1.0% +10.0% ➖ noise
2 datafusion:vortex-compact +7.3% +7.1% +0.2% +10.0% ➖ noise
2 datafusion:vortex-file-compressed +0.2% +7.1% -6.5% +10.0% ➖ noise
2 duckdb:duckdb +0.3% +7.1% -6.4% +10.0% ➖ noise
2 duckdb:vortex-compact +8.1% +7.1% +1.0% +11.6% ➖ noise
2 duckdb:vortex-file-compressed +0.1% +7.1% -6.5% +10.0% ➖ noise
3 datafusion:arrow +8.2% +6.5% +1.7% +10.0% ➖ noise
3 datafusion:vortex-compact +2.4% +6.5% -3.9% +10.0% ➖ noise
3 datafusion:vortex-file-compressed +0.8% +6.5% -5.3% +10.0% ➖ noise
3 duckdb:duckdb +14.0% +6.5% +7.1% +10.0% ➖ noise
3 duckdb:vortex-compact +14.5% +6.5% +7.6% +10.0% ➖ noise
3 duckdb:vortex-file-compressed -2.5% +6.5% -8.4% +10.0% ➖ noise
4 datafusion:arrow +9.7% +0.8% +8.8% +10.0% ➖ noise
4 datafusion:vortex-compact -2.7% +0.8% -3.5% +10.0% ➖ noise
4 datafusion:vortex-file-compressed +1.9% +0.8% +1.1% +10.0% ➖ noise
4 duckdb:duckdb +15.5% +0.8% +14.6% +10.0% 🚨 regression
4 duckdb:vortex-compact +11.4% +0.8% +10.5% +10.0% 🚨 regression
4 duckdb:vortex-file-compressed -1.2% +0.8% -2.0% +10.0% ➖ noise
5 datafusion:arrow +11.3% +5.7% +5.3% +10.0% ➖ noise
5 datafusion:vortex-compact -0.4% +5.7% -5.8% +10.0% ➖ noise
5 datafusion:vortex-file-compressed -0.5% +5.7% -5.9% +10.0% ➖ noise
5 duckdb:duckdb +14.2% +5.7% +8.0% +10.0% ➖ noise
5 duckdb:vortex-compact +13.1% +5.7% +7.0% +10.0% ➖ noise
5 duckdb:vortex-file-compressed -2.2% +5.7% -7.5% +10.0% ➖ noise
6 datafusion:arrow +7.3% -5.3% +13.4% +10.0% 🚨 regression
6 datafusion:vortex-compact -2.3% -5.3% +3.2% +10.0% ➖ noise
6 datafusion:vortex-file-compressed -1.1% -5.3% +4.5% +10.0% ➖ noise
6 duckdb:duckdb +15.3% -5.3% +21.8% +10.9% 🚨 regression
6 duckdb:vortex-compact +7.8% -5.3% +13.9% +10.0% 🚨 regression
6 duckdb:vortex-file-compressed -4.8% -5.3% +0.6% +10.0% ➖ noise
7 datafusion:arrow +9.0% -1.2% +10.4% +10.0% 🚨 regression
7 datafusion:vortex-compact -0.1% -1.2% +1.1% +10.0% ➖ noise
7 datafusion:vortex-file-compressed +0.4% -1.2% +1.6% +10.0% ➖ noise
7 duckdb:duckdb +9.2% -1.2% +10.6% +10.0% 🚨 regression
7 duckdb:vortex-compact +11.1% -1.2% +12.5% +10.0% 🚨 regression
7 duckdb:vortex-file-compressed +2.1% -1.2% +3.4% +10.0% ➖ noise
8 datafusion:arrow +8.2% +0.3% +7.9% +10.0% ➖ noise
8 datafusion:vortex-compact +2.3% +0.3% +2.0% +10.0% ➖ noise
8 datafusion:vortex-file-compressed +2.0% +0.3% +1.7% +10.0% ➖ noise
8 duckdb:duckdb +11.7% +0.3% +11.4% +10.0% 🚨 regression
8 duckdb:vortex-compact +22.9% +0.3% +22.5% +10.0% 🚨 regression
8 duckdb:vortex-file-compressed +2.3% +0.3% +2.0% +10.0% ➖ noise
9 datafusion:arrow +7.0% +0.3% +6.7% +10.0% ➖ noise
9 datafusion:vortex-compact +4.7% +0.3% +4.4% +10.0% ➖ noise
9 datafusion:vortex-file-compressed -1.6% +0.3% -1.9% +10.0% ➖ noise
9 duckdb:duckdb +10.3% +0.3% +9.9% +10.0% ➖ noise
9 duckdb:vortex-compact +10.5% +0.3% +10.1% +10.0% 🚨 regression
9 duckdb:vortex-file-compressed +1.1% +0.3% +0.7% +10.0% ➖ noise
10 datafusion:arrow +9.3% -0.9% +10.3% +10.0% 🚨 regression
10 datafusion:vortex-compact +9.2% -0.9% +10.2% +10.0% 🚨 regression
10 datafusion:vortex-file-compressed +2.1% -0.9% +3.0% +10.0% ➖ noise
10 duckdb:duckdb +11.3% -0.9% +12.3% +10.0% 🚨 regression
10 duckdb:vortex-compact +12.2% -0.9% +13.2% +10.0% 🚨 regression
10 duckdb:vortex-file-compressed +1.0% -0.9% +2.0% +10.0% ➖ noise
11 datafusion:arrow +5.9% -4.9% +11.4% +10.8% 🚨 regression
11 datafusion:vortex-compact +11.2% -4.9% +17.0% +10.0% 🚨 regression
11 datafusion:vortex-file-compressed +5.8% -4.9% +11.3% +10.0% 🚨 regression
11 duckdb:duckdb +9.6% -4.9% +15.3% +12.9% 🚨 regression
11 duckdb:vortex-compact +10.2% -4.9% +15.9% +10.0% 🚨 regression
11 duckdb:vortex-file-compressed +0.2% -4.9% +5.3% +11.6% ➖ noise
12 datafusion:arrow +1.1% -3.0% +4.3% +36.6% ➖ noise
12 datafusion:vortex-compact +7.1% -3.0% +10.5% +10.0% 🚨 regression
12 datafusion:vortex-file-compressed +1.9% -3.0% +5.0% +10.0% ➖ noise
12 duckdb:duckdb +9.0% -3.0% +12.4% +10.0% 🚨 regression
12 duckdb:vortex-compact +8.6% -3.0% +12.0% +10.0% 🚨 regression
12 duckdb:vortex-file-compressed -1.5% -3.0% +1.5% +10.0% ➖ noise
13 datafusion:arrow +3.1% -1.5% +4.7% +10.0% ➖ noise
13 datafusion:vortex-compact +2.6% -1.5% +4.2% +10.0% ➖ noise
13 datafusion:vortex-file-compressed +3.0% -1.5% +4.6% +10.0% ➖ noise
13 duckdb:duckdb +14.3% -1.5% +16.0% +10.0% 🚨 regression
13 duckdb:vortex-compact +12.9% -1.5% +14.6% +10.0% 🚨 regression
13 duckdb:vortex-file-compressed -0.7% -1.5% +0.8% +10.0% ➖ noise
14 datafusion:arrow +11.1% +2.2% +8.6% +10.0% ➖ noise
14 datafusion:vortex-compact +0.0% +2.2% -2.2% +10.0% ➖ noise
14 datafusion:vortex-file-compressed -1.7% +2.2% -3.9% +10.0% ➖ noise
14 duckdb:duckdb +10.5% +2.2% +8.1% +10.0% ➖ noise
14 duckdb:vortex-compact +11.5% +2.2% +9.0% +10.0% ➖ noise
14 duckdb:vortex-file-compressed -3.1% +2.2% -5.2% +10.0% ➖ noise
15 datafusion:arrow +14.3% -0.7% +15.2% +10.0% 🚨 regression
15 datafusion:vortex-compact +4.9% -0.7% +5.7% +10.0% ➖ noise
15 datafusion:vortex-file-compressed -1.4% -0.7% -0.7% +10.0% ➖ noise
15 duckdb:duckdb +9.5% -0.7% +10.3% +10.0% 🚨 regression
15 duckdb:vortex-compact +11.5% -0.7% +12.4% +10.0% 🚨 regression
15 duckdb:vortex-file-compressed -4.0% -0.7% -3.3% +10.0% ➖ noise
16 datafusion:arrow +14.4% -0.2% +14.6% +10.0% 🚨 regression
16 datafusion:vortex-compact +0.2% -0.2% +0.4% +10.0% ➖ noise
16 datafusion:vortex-file-compressed +0.1% -0.2% +0.3% +10.0% ➖ noise
16 duckdb:duckdb +9.5% -0.2% +9.7% +10.0% ➖ noise
16 duckdb:vortex-compact +13.6% -0.2% +13.8% +10.0% 🚨 regression
16 duckdb:vortex-file-compressed -1.9% -0.2% -1.7% +10.0% ➖ noise
17 datafusion:arrow +16.4% +0.3% +16.1% +10.0% 🚨 regression
17 datafusion:vortex-compact +1.9% +0.3% +1.6% +10.0% ➖ noise
17 datafusion:vortex-file-compressed +1.5% +0.3% +1.2% +10.0% ➖ noise
17 duckdb:duckdb +7.2% +0.3% +6.9% +10.0% ➖ noise
17 duckdb:vortex-compact +12.1% +0.3% +11.8% +10.0% 🚨 regression
17 duckdb:vortex-file-compressed -4.7% +0.3% -4.9% +10.0% ➖ noise
18 datafusion:arrow +17.0% +1.1% +15.7% +10.0% 🚨 regression
18 datafusion:vortex-compact +0.2% +1.1% -0.9% +10.0% ➖ noise
18 datafusion:vortex-file-compressed -0.2% +1.1% -1.3% +10.0% ➖ noise
18 duckdb:duckdb +8.7% +1.1% +7.5% +10.0% ➖ noise
18 duckdb:vortex-compact +12.5% +1.1% +11.3% +10.0% 🚨 regression
18 duckdb:vortex-file-compressed +2.0% +1.1% +0.9% +10.0% ➖ noise
19 datafusion:arrow +11.2% +1.5% +9.6% +10.0% ➖ noise
19 datafusion:vortex-compact -2.4% +1.5% -3.7% +10.0% ➖ noise
19 datafusion:vortex-file-compressed +1.3% +1.5% -0.1% +10.0% ➖ noise
19 duckdb:duckdb +8.1% +1.5% +6.6% +10.0% ➖ noise
19 duckdb:vortex-compact +8.2% +1.5% +6.7% +10.0% ➖ noise
19 duckdb:vortex-file-compressed -1.5% +1.5% -2.9% +10.0% ➖ noise
20 datafusion:arrow +13.2% -2.4% +16.0% +10.0% 🚨 regression
20 datafusion:vortex-compact -2.3% -2.4% +0.1% +10.0% ➖ noise
20 datafusion:vortex-file-compressed +11.3% -2.4% +14.1% +10.0% 🚨 regression
20 duckdb:duckdb +7.8% -2.4% +10.4% +10.0% 🚨 regression
20 duckdb:vortex-compact +14.7% -2.4% +17.5% +10.0% 🚨 regression
20 duckdb:vortex-file-compressed -1.1% -2.4% +1.4% +10.0% ➖ noise
21 datafusion:arrow +6.8% +0.4% +6.4% +10.0% ➖ noise
21 datafusion:vortex-compact -1.3% +0.4% -1.7% +10.0% ➖ noise
21 datafusion:vortex-file-compressed +3.7% +0.4% +3.2% +10.0% ➖ noise
21 duckdb:duckdb +12.5% +0.4% +12.0% +10.0% 🚨 regression
21 duckdb:vortex-compact +15.0% +0.4% +14.5% +10.0% 🚨 regression
21 duckdb:vortex-file-compressed +0.8% +0.4% +0.4% +10.0% ➖ noise
22 datafusion:arrow -1.9% -0.7% -1.2% +10.0% ➖ noise
22 datafusion:vortex-compact -4.4% -0.7% -3.6% +10.0% ➖ noise
22 datafusion:vortex-file-compressed -0.5% -0.7% +0.2% +10.0% ➖ noise
22 duckdb:duckdb +8.5% -0.7% +9.3% +10.0% ➖ noise
22 duckdb:vortex-compact +8.8% -0.7% +9.6% +10.0% ➖ noise
22 duckdb:vortex-file-compressed +7.0% -0.7% +7.8% +10.0% ➖ noise

@github-actions
Copy link
Copy Markdown
Contributor

File Sizes: TPC-H SF=10 on NVME

No file size changes detected.

@github-actions
Copy link
Copy Markdown
Contributor

github-actions Bot commented Apr 30, 2026

Benchmarks: TPC-H SF=1 on S3

Verdict: No clear signal (environment too noisy confidence)
Attributed Vortex impact: +0.0%
Vortex (geomean): 0.979x ➖
Parquet (geomean): 0.979x ➖
Shifts: Parquet (control) -2.1% · Median polish -1.1%


datafusion / vortex-file-compressed (0.986x ➖, 0↑ 2↓)
name PR d75de6d (ns) base deb7de0 (ns) ratio (PR/base)
tpch_q01/datafusion:vortex-file-compressed 247759813 246103664 1.01
tpch_q02/datafusion:vortex-file-compressed 401250506 528605150 0.76
tpch_q03/datafusion:vortex-file-compressed 401264321 430493311 0.93
tpch_q04/datafusion:vortex-file-compressed 259706298 266984669 0.97
tpch_q05/datafusion:vortex-file-compressed 449054305 492181921 0.91
tpch_q06/datafusion:vortex-file-compressed 379201137 347032428 1.09
tpch_q07/datafusion:vortex-file-compressed 410639660 429428459 0.96
tpch_q08/datafusion:vortex-file-compressed 584259720 604120438 0.97
tpch_q09/datafusion:vortex-file-compressed 439185386 395978353 1.11
tpch_q10/datafusion:vortex-file-compressed 560356442 525806380 1.07
tpch_q11/datafusion:vortex-file-compressed 288565013 316236255 0.91
tpch_q12/datafusion:vortex-file-compressed 🚨 618672985 462631580 1.34
tpch_q13/datafusion:vortex-file-compressed 165170789 201198921 0.82
tpch_q14/datafusion:vortex-file-compressed 294282719 316046259 0.93
tpch_q15/datafusion:vortex-file-compressed 503947820 557486305 0.90
tpch_q16/datafusion:vortex-file-compressed 190783870 214113001 0.89
tpch_q17/datafusion:vortex-file-compressed 502261087 474155253 1.06
tpch_q18/datafusion:vortex-file-compressed 🚨 551635407 365586512 1.51
tpch_q19/datafusion:vortex-file-compressed 648788595 518784773 1.25
tpch_q20/datafusion:vortex-file-compressed 474202123 564763647 0.84
tpch_q21/datafusion:vortex-file-compressed 576282314 626885306 0.92
tpch_q22/datafusion:vortex-file-compressed 112228573 135350518 0.83
datafusion / vortex-compact (0.886x ➖, 2↑ 0↓)
name PR d75de6d (ns) base deb7de0 (ns) ratio (PR/base)
tpch_q01/datafusion:vortex-compact 254830560 278942191 0.91
tpch_q02/datafusion:vortex-compact 412287734 548002797 0.75
tpch_q03/datafusion:vortex-compact 429351503 377554386 1.14
tpch_q04/datafusion:vortex-compact 275501117 214821687 1.28
tpch_q05/datafusion:vortex-compact 393773137 440131211 0.89
tpch_q06/datafusion:vortex-compact 398533248 430354125 0.93
tpch_q07/datafusion:vortex-compact 437166717 419686424 1.04
tpch_q08/datafusion:vortex-compact 561512589 594401962 0.94
tpch_q09/datafusion:vortex-compact 437613597 434584762 1.01
tpch_q10/datafusion:vortex-compact 417038144 430403799 0.97
tpch_q11/datafusion:vortex-compact 261736225 294970014 0.89
tpch_q12/datafusion:vortex-compact 🚀 386242249 623438584 0.62
tpch_q13/datafusion:vortex-compact 134881687 158190686 0.85
tpch_q14/datafusion:vortex-compact 259515266 350904157 0.74
tpch_q15/datafusion:vortex-compact 456745193 556487152 0.82
tpch_q16/datafusion:vortex-compact 215291225 228502992 0.94
tpch_q17/datafusion:vortex-compact 🚀 375367100 597265340 0.63
tpch_q18/datafusion:vortex-compact 338496299 400892505 0.84
tpch_q19/datafusion:vortex-compact 528851357 507862772 1.04
tpch_q20/datafusion:vortex-compact 443484452 536730474 0.83
tpch_q21/datafusion:vortex-compact 527058014 572954340 0.92
tpch_q22/datafusion:vortex-compact 114854939 147549877 0.78
datafusion / parquet (0.956x ➖, 2↑ 1↓)
name PR d75de6d (ns) base deb7de0 (ns) ratio (PR/base)
tpch_q01/datafusion:parquet 230102341 238767553 0.96
tpch_q02/datafusion:parquet 571337925 482222919 1.18
tpch_q03/datafusion:parquet 324001442 384779317 0.84
tpch_q04/datafusion:parquet 179266922 208171221 0.86
tpch_q05/datafusion:parquet 🚀 496746374 733577700 0.68
tpch_q06/datafusion:parquet 🚀 179097349 283409982 0.63
tpch_q07/datafusion:parquet 543082240 742888203 0.73
tpch_q08/datafusion:parquet 698203184 688572428 1.01
tpch_q09/datafusion:parquet 556125252 573810294 0.97
tpch_q10/datafusion:parquet 545190984 545288817 1.00
tpch_q11/datafusion:parquet 339727516 341583097 0.99
tpch_q12/datafusion:parquet 256955569 244828473 1.05
tpch_q13/datafusion:parquet 436999839 438433551 1.00
tpch_q14/datafusion:parquet 182079796 172020441 1.06
tpch_q15/datafusion:parquet 296943787 300558254 0.99
tpch_q16/datafusion:parquet 174650540 180978841 0.97
tpch_q17/datafusion:parquet 420067561 413005091 1.02
tpch_q18/datafusion:parquet 473737317 461076592 1.03
tpch_q19/datafusion:parquet 370651396 393154995 0.94
tpch_q20/datafusion:parquet 383100395 339880096 1.13
tpch_q21/datafusion:parquet 504369191 535292613 0.94
tpch_q22/datafusion:parquet 🚨 156836413 119250227 1.32
duckdb / vortex-file-compressed (1.032x ➖, 0↑ 0↓)
name PR d75de6d (ns) base deb7de0 (ns) ratio (PR/base)
tpch_q01/duckdb:vortex-file-compressed 269695548 284086430 0.95
tpch_q02/duckdb:vortex-file-compressed 977994638 959609290 1.02
tpch_q03/duckdb:vortex-file-compressed 668686678 624677247 1.07
tpch_q04/duckdb:vortex-file-compressed 451857516 419846599 1.08
tpch_q05/duckdb:vortex-file-compressed 1030164314 931576849 1.11
tpch_q06/duckdb:vortex-file-compressed 406794698 432386639 0.94
tpch_q07/duckdb:vortex-file-compressed 818391063 818676748 1.00
tpch_q08/duckdb:vortex-file-compressed 1060825302 992175846 1.07
tpch_q09/duckdb:vortex-file-compressed 880699510 900453454 0.98
tpch_q10/duckdb:vortex-file-compressed 844582830 784055125 1.08
tpch_q11/duckdb:vortex-file-compressed 507167723 530245107 0.96
tpch_q12/duckdb:vortex-file-compressed 505283573 460275538 1.10
tpch_q13/duckdb:vortex-file-compressed 457550995 460694437 0.99
tpch_q14/duckdb:vortex-file-compressed 450835790 529916294 0.85
tpch_q15/duckdb:vortex-file-compressed 279747048 305403430 0.92
tpch_q16/duckdb:vortex-file-compressed 393866626 403511717 0.98
tpch_q17/duckdb:vortex-file-compressed 794490630 722768181 1.10
tpch_q18/duckdb:vortex-file-compressed 570960696 557067741 1.02
tpch_q19/duckdb:vortex-file-compressed 517893892 418752076 1.24
tpch_q20/duckdb:vortex-file-compressed 862464934 848752510 1.02
tpch_q21/duckdb:vortex-file-compressed 1156272864 1064726100 1.09
tpch_q22/duckdb:vortex-file-compressed 433395400 348285187 1.24
duckdb / vortex-compact (1.021x ➖, 0↑ 0↓)
name PR d75de6d (ns) base deb7de0 (ns) ratio (PR/base)
tpch_q01/duckdb:vortex-compact 303173628 245055471 1.24
tpch_q02/duckdb:vortex-compact 959516190 927386305 1.03
tpch_q03/duckdb:vortex-compact 628700072 652185635 0.96
tpch_q04/duckdb:vortex-compact 364145983 340682620 1.07
tpch_q05/duckdb:vortex-compact 918815175 1030564406 0.89
tpch_q06/duckdb:vortex-compact 487617571 447593249 1.09
tpch_q07/duckdb:vortex-compact 919598925 815723152 1.13
tpch_q08/duckdb:vortex-compact 1011876877 1013806089 1.00
tpch_q09/duckdb:vortex-compact 923950815 1004843128 0.92
tpch_q10/duckdb:vortex-compact 701689018 731435337 0.96
tpch_q11/duckdb:vortex-compact 523135848 506423152 1.03
tpch_q12/duckdb:vortex-compact 491320347 455327905 1.08
tpch_q13/duckdb:vortex-compact 480657296 435496141 1.10
tpch_q14/duckdb:vortex-compact 472627579 492926193 0.96
tpch_q15/duckdb:vortex-compact 287104002 293157706 0.98
tpch_q16/duckdb:vortex-compact 372204302 381706141 0.98
tpch_q17/duckdb:vortex-compact 581346988 625804933 0.93
tpch_q18/duckdb:vortex-compact 532509581 479846866 1.11
tpch_q19/duckdb:vortex-compact 519359616 448889926 1.16
tpch_q20/duckdb:vortex-compact 750223158 747419876 1.00
tpch_q21/duckdb:vortex-compact 1082812824 1077369594 1.01
tpch_q22/duckdb:vortex-compact 344181042 374688740 0.92
duckdb / parquet (1.003x ➖, 0↑ 0↓)
name PR d75de6d (ns) base deb7de0 (ns) ratio (PR/base)
tpch_q01/duckdb:parquet 472096225 489101774 0.97
tpch_q02/duckdb:parquet 1278285875 1343114225 0.95
tpch_q03/duckdb:parquet 1013786567 1137937413 0.89
tpch_q04/duckdb:parquet 638134543 705132522 0.90
tpch_q05/duckdb:parquet 1499364839 1621425780 0.92
tpch_q06/duckdb:parquet 419332053 446475322 0.94
tpch_q07/duckdb:parquet 1420381258 1317166265 1.08
tpch_q08/duckdb:parquet 1748299341 1838991184 0.95
tpch_q09/duckdb:parquet 1634765419 1557692671 1.05
tpch_q10/duckdb:parquet 1383592545 1287679950 1.07
tpch_q11/duckdb:parquet 898449307 864854740 1.04
tpch_q12/duckdb:parquet 700616967 735775526 0.95
tpch_q13/duckdb:parquet 997391853 972176148 1.03
tpch_q14/duckdb:parquet 734045588 704164907 1.04
tpch_q15/duckdb:parquet 556555825 512341780 1.09
tpch_q16/duckdb:parquet 680257161 644366251 1.06
tpch_q17/duckdb:parquet 764636082 793032634 0.96
tpch_q18/duckdb:parquet 905983610 917528757 0.99
tpch_q19/duckdb:parquet 802764368 805668931 1.00
tpch_q20/duckdb:parquet 1249665538 1114001299 1.12
tpch_q21/duckdb:parquet 1235811959 1193207937 1.04
tpch_q22/duckdb:parquet 614719964 568572612 1.08
Full attributed analysis
Query Config Raw Δ Control Δ Attributed α Noise floor Significant?
1 datafusion:vortex-compact -8.6% -3.6% -5.3% +82.3% ➖ noise
1 datafusion:vortex-file-compressed +0.7% -3.6% +4.4% +77.5% ➖ noise
1 duckdb:vortex-compact +23.7% -3.6% +28.3% +44.3% ➖ noise
1 duckdb:vortex-file-compressed -5.1% -3.6% -1.6% +69.3% ➖ noise
2 datafusion:vortex-compact -24.8% +6.2% -29.2% +33.8% ✅ faster
2 datafusion:vortex-file-compressed -24.1% +6.2% -28.5% +31.7% ✅ faster
2 duckdb:vortex-compact +3.5% +6.2% -2.6% +30.2% ➖ noise
2 duckdb:vortex-file-compressed +1.9% +6.2% -4.0% +30.2% ➖ noise
3 datafusion:vortex-compact +13.7% -13.4% +31.3% +52.9% ➖ noise
3 datafusion:vortex-file-compressed -6.8% -13.4% +7.6% +48.3% ➖ noise
3 duckdb:vortex-compact -3.6% -13.4% +11.3% +39.2% ➖ noise
3 duckdb:vortex-file-compressed +7.0% -13.4% +23.6% +39.0% ➖ noise
4 datafusion:vortex-compact +28.2% -11.7% +45.3% +34.2% 🚨 regression
4 datafusion:vortex-file-compressed -2.7% -11.7% +10.2% +50.8% ➖ noise
4 duckdb:vortex-compact +6.9% -11.7% +21.1% +36.5% ➖ noise
4 duckdb:vortex-file-compressed +7.6% -11.7% +21.9% +31.9% ➖ noise
5 datafusion:vortex-compact -10.5% -20.9% +13.1% +30.2% ➖ noise
5 datafusion:vortex-file-compressed -8.8% -20.9% +15.3% +30.2% ➖ noise
5 duckdb:vortex-compact -10.8% -20.9% +12.7% +30.2% ➖ noise
5 duckdb:vortex-file-compressed +10.6% -20.9% +39.7% +30.2% 🚨 regression
6 datafusion:vortex-compact -7.4% -23.0% +20.2% +37.5% ➖ noise
6 datafusion:vortex-file-compressed +9.3% -23.0% +41.8% +37.6% 🚨 regression
6 duckdb:vortex-compact +8.9% -23.0% +41.4% +38.1% 🚨 regression
6 duckdb:vortex-file-compressed -5.9% -23.0% +22.1% +36.1% ➖ noise
7 datafusion:vortex-compact +4.2% -11.2% +17.3% +30.2% ➖ noise
7 datafusion:vortex-file-compressed -4.4% -11.2% +7.7% +30.2% ➖ noise
7 duckdb:vortex-compact +12.7% -11.2% +27.0% +30.6% ➖ noise
7 duckdb:vortex-file-compressed -0.0% -11.2% +12.6% +30.2% ➖ noise
8 datafusion:vortex-compact -5.5% -1.8% -3.8% +30.2% ➖ noise
8 datafusion:vortex-file-compressed -3.3% -1.8% -1.5% +31.3% ➖ noise
8 duckdb:vortex-compact -0.2% -1.8% +1.7% +30.2% ➖ noise
8 duckdb:vortex-file-compressed +6.9% -1.8% +8.9% +30.2% ➖ noise
9 datafusion:vortex-compact +0.7% +0.9% -0.2% +30.2% ➖ noise
9 datafusion:vortex-file-compressed +10.9% +0.9% +10.0% +30.2% ➖ noise
9 duckdb:vortex-compact -8.1% +0.9% -8.8% +30.2% ➖ noise
9 duckdb:vortex-file-compressed -2.2% +0.9% -3.0% +30.2% ➖ noise
10 datafusion:vortex-compact -3.1% +3.6% -6.5% +30.2% ➖ noise
10 datafusion:vortex-file-compressed +6.6% +3.6% +2.8% +30.2% ➖ noise
10 duckdb:vortex-compact -4.1% +3.6% -7.4% +30.2% ➖ noise
10 duckdb:vortex-file-compressed +7.7% +3.6% +3.9% +30.2% ➖ noise
11 datafusion:vortex-compact -11.3% +1.6% -12.7% +30.2% ➖ noise
11 datafusion:vortex-file-compressed -8.8% +1.6% -10.2% +30.2% ➖ noise
11 duckdb:vortex-compact +3.3% +1.6% +1.6% +50.9% ➖ noise
11 duckdb:vortex-file-compressed -4.4% +1.6% -5.9% +30.2% ➖ noise
12 datafusion:vortex-compact -38.0% -0.0% -38.0% +32.9% ✅ faster
12 datafusion:vortex-file-compressed +33.7% -0.0% +33.8% +30.2% 🚨 regression
12 duckdb:vortex-compact +7.9% -0.0% +7.9% +30.2% ➖ noise
12 duckdb:vortex-file-compressed +9.8% -0.0% +9.8% +30.2% ➖ noise
13 datafusion:vortex-compact -14.7% +1.1% -15.7% +62.2% ➖ noise
13 datafusion:vortex-file-compressed -17.9% +1.1% -18.8% +34.2% ➖ noise
13 duckdb:vortex-compact +10.4% +1.1% +9.1% +30.2% ➖ noise
13 duckdb:vortex-file-compressed -0.7% +1.1% -1.8% +30.3% ➖ noise
14 datafusion:vortex-compact -26.0% +5.0% -29.6% +31.9% ✅ faster
14 datafusion:vortex-file-compressed -6.9% +5.0% -11.4% +30.2% ➖ noise
14 duckdb:vortex-compact -4.1% +5.0% -8.7% +30.2% ➖ noise
14 duckdb:vortex-file-compressed -14.9% +5.0% -19.0% +30.2% ➖ noise
15 datafusion:vortex-compact -17.9% +3.6% -20.8% +30.2% ➖ noise
15 datafusion:vortex-file-compressed -9.6% +3.6% -12.7% +30.2% ➖ noise
15 duckdb:vortex-compact -2.1% +3.6% -5.5% +30.2% ➖ noise
15 duckdb:vortex-file-compressed -8.4% +3.6% -11.6% +33.6% ➖ noise
16 datafusion:vortex-compact -5.8% +0.9% -6.7% +30.2% ➖ noise
16 datafusion:vortex-file-compressed -10.9% +0.9% -11.7% +30.2% ➖ noise
16 duckdb:vortex-compact -2.5% +0.9% -3.4% +30.2% ➖ noise
16 duckdb:vortex-file-compressed -2.4% +0.9% -3.3% +30.2% ➖ noise
17 datafusion:vortex-compact -37.2% -1.0% -36.5% +36.5% ✅ faster
17 datafusion:vortex-file-compressed +5.9% -1.0% +7.0% +30.2% ➖ noise
17 duckdb:vortex-compact -7.1% -1.0% -6.2% +30.2% ➖ noise
17 duckdb:vortex-file-compressed +9.9% -1.0% +11.0% +30.2% ➖ noise
18 datafusion:vortex-compact -15.6% +0.7% -16.2% +30.2% ➖ noise
18 datafusion:vortex-file-compressed +50.9% +0.7% +49.8% +31.0% 🚨 regression
18 duckdb:vortex-compact +11.0% +0.7% +10.2% +30.2% ➖ noise
18 duckdb:vortex-file-compressed +2.5% +0.7% +1.8% +30.2% ➖ noise
19 datafusion:vortex-compact +4.1% -3.1% +7.4% +30.2% ➖ noise
19 datafusion:vortex-file-compressed +25.1% -3.1% +29.0% +46.3% ➖ noise
19 duckdb:vortex-compact +15.7% -3.1% +19.4% +30.2% ➖ noise
19 duckdb:vortex-file-compressed +23.7% -3.1% +27.6% +30.2% ➖ noise
20 datafusion:vortex-compact -17.4% +12.4% -26.5% +30.2% ✅ faster
20 datafusion:vortex-file-compressed -16.0% +12.4% -25.3% +30.2% ✅ faster
20 duckdb:vortex-compact +0.4% +12.4% -10.7% +30.2% ➖ noise
20 duckdb:vortex-file-compressed +1.6% +12.4% -9.6% +30.2% ➖ noise
21 datafusion:vortex-compact -8.0% -1.2% -6.9% +30.2% ➖ noise
21 datafusion:vortex-file-compressed -8.1% -1.2% -6.9% +30.2% ➖ noise
21 duckdb:vortex-compact +0.5% -1.2% +1.7% +30.2% ➖ noise
21 duckdb:vortex-file-compressed +8.6% -1.2% +9.9% +30.2% ➖ noise
22 datafusion:vortex-compact -22.2% +19.2% -34.7% +46.2% ✅ faster
22 datafusion:vortex-file-compressed -17.1% +19.2% -30.5% +49.7% ➖ noise
22 duckdb:vortex-compact -8.1% +19.2% -23.0% +30.2% ➖ noise
22 duckdb:vortex-file-compressed +24.4% +19.2% +4.4% +30.2% ➖ noise

@github-actions
Copy link
Copy Markdown
Contributor

github-actions Bot commented Apr 30, 2026

Benchmarks: Clickbench on NVME

Verdict: No clear signal (low confidence)
Attributed Vortex impact: -2.1%
Vortex (geomean): 1.008x ➖
Parquet (geomean): 1.029x ➖
Shifts: Parquet (control) +2.9% · Median polish +1.0%


datafusion / vortex-file-compressed (1.041x ➖, 0↑ 7↓)
name PR d75de6d (ns) base deb7de0 (ns) ratio (PR/base)
clickbench_q00/datafusion:vortex-file-compressed 1691906 1691439 1.00
clickbench_q01/datafusion:vortex-file-compressed 19805251 18397553 1.08
clickbench_q02/datafusion:vortex-file-compressed 38382030 37738293 1.02
clickbench_q03/datafusion:vortex-file-compressed 45482892 41740447 1.09
clickbench_q04/datafusion:vortex-file-compressed 307435761 288267578 1.07
clickbench_q05/datafusion:vortex-file-compressed 293955691 302412367 0.97
clickbench_q06/datafusion:vortex-file-compressed 1659027 1659446 1.00
clickbench_q07/datafusion:vortex-file-compressed 🚨 27215851 22226930 1.22
clickbench_q08/datafusion:vortex-file-compressed 362717663 349438731 1.04
clickbench_q09/datafusion:vortex-file-compressed 567555970 555796121 1.02
clickbench_q10/datafusion:vortex-file-compressed 74018155 71072122 1.04
clickbench_q11/datafusion:vortex-file-compressed 84693038 86404320 0.98
clickbench_q12/datafusion:vortex-file-compressed 266745567 263278603 1.01
clickbench_q13/datafusion:vortex-file-compressed 421591474 404084903 1.04
clickbench_q14/datafusion:vortex-file-compressed 258606047 252000789 1.03
clickbench_q15/datafusion:vortex-file-compressed 344552953 328628962 1.05
clickbench_q16/datafusion:vortex-file-compressed 673817770 639311881 1.05
clickbench_q17/datafusion:vortex-file-compressed 666651847 624721036 1.07
clickbench_q18/datafusion:vortex-file-compressed 1364410137 1336987875 1.02
clickbench_q19/datafusion:vortex-file-compressed 30519311 30890440 0.99
clickbench_q20/datafusion:vortex-file-compressed 336060217 344934794 0.97
clickbench_q21/datafusion:vortex-file-compressed 404251310 368941500 1.10
clickbench_q22/datafusion:vortex-file-compressed 🚨 497090653 434457193 1.14
clickbench_q23/datafusion:vortex-file-compressed 🚨 765534342 659473144 1.16
clickbench_q24/datafusion:vortex-file-compressed 45831946 46554155 0.98
clickbench_q25/datafusion:vortex-file-compressed 🚨 79513707 70473726 1.13
clickbench_q26/datafusion:vortex-file-compressed 46501587 46657106 1.00
clickbench_q27/datafusion:vortex-file-compressed 728017908 733613423 0.99
clickbench_q28/datafusion:vortex-file-compressed 7185504023 6829620834 1.05
clickbench_q29/datafusion:vortex-file-compressed 247741419 243057239 1.02
clickbench_q30/datafusion:vortex-file-compressed 🚨 267082118 231335580 1.15
clickbench_q31/datafusion:vortex-file-compressed 🚨 302141150 273763995 1.10
clickbench_q32/datafusion:vortex-file-compressed 🚨 1344553561 1193248636 1.13
clickbench_q33/datafusion:vortex-file-compressed 1459839260 1328743315 1.10
clickbench_q34/datafusion:vortex-file-compressed 1314252705 1290103513 1.02
clickbench_q35/datafusion:vortex-file-compressed 472531170 461829772 1.02
clickbench_q36/datafusion:vortex-file-compressed 69972750 71850073 0.97
clickbench_q37/datafusion:vortex-file-compressed 35094578 35366670 0.99
clickbench_q38/datafusion:vortex-file-compressed 18581099 20056258 0.93
clickbench_q39/datafusion:vortex-file-compressed 139215034 129659645 1.07
clickbench_q40/datafusion:vortex-file-compressed 15976481 16191319 0.99
clickbench_q41/datafusion:vortex-file-compressed 15111964 15150875 1.00
clickbench_q42/datafusion:vortex-file-compressed 17371631 17083320 1.02
datafusion / parquet (1.039x ➖, 0↑ 2↓)
name PR d75de6d (ns) base deb7de0 (ns) ratio (PR/base)
clickbench_q00/datafusion:parquet 1553982 1725851 0.90
clickbench_q01/datafusion:parquet 18456761 18611153 0.99
clickbench_q02/datafusion:parquet 45904632 48294833 0.95
clickbench_q03/datafusion:parquet 37656538 37307243 1.01
clickbench_q04/datafusion:parquet 319443842 301404487 1.06
clickbench_q05/datafusion:parquet 363478993 353069050 1.03
clickbench_q06/datafusion:parquet 1591861 1572560 1.01
clickbench_q07/datafusion:parquet 22429012 22087549 1.02
clickbench_q08/datafusion:parquet 393632571 370658523 1.06
clickbench_q09/datafusion:parquet 671921410 640374445 1.05
clickbench_q10/datafusion:parquet 120781625 110256663 1.10
clickbench_q11/datafusion:parquet 147473671 138485077 1.06
clickbench_q12/datafusion:parquet 364775359 352843280 1.03
clickbench_q13/datafusion:parquet 533703368 491556780 1.09
clickbench_q14/datafusion:parquet 375852497 342867859 1.10
clickbench_q15/datafusion:parquet 🚨 380095232 345079160 1.10
clickbench_q16/datafusion:parquet 725462051 668440276 1.09
clickbench_q17/datafusion:parquet 688737599 651721798 1.06
clickbench_q18/datafusion:parquet 1398724344 1305887594 1.07
clickbench_q19/datafusion:parquet 28701171 30098530 0.95
clickbench_q20/datafusion:parquet 635176485 615918337 1.03
clickbench_q21/datafusion:parquet 698277001 659479832 1.06
clickbench_q22/datafusion:parquet 1040568617 977963258 1.06
clickbench_q23/datafusion:parquet 4006950656 3781663564 1.06
clickbench_q24/datafusion:parquet 89181259 86347089 1.03
clickbench_q25/datafusion:parquet 145316859 139837868 1.04
clickbench_q26/datafusion:parquet 87769744 83637796 1.05
clickbench_q27/datafusion:parquet 1072785465 1054816172 1.02
clickbench_q28/datafusion:parquet 6901989371 6768605832 1.02
clickbench_q29/datafusion:parquet 235075711 239662660 0.98
clickbench_q30/datafusion:parquet 333826824 327976025 1.02
clickbench_q31/datafusion:parquet 381742118 364837929 1.05
clickbench_q32/datafusion:parquet 🚨 1284378546 1164203981 1.10
clickbench_q33/datafusion:parquet 1531330440 1495733830 1.02
clickbench_q34/datafusion:parquet 1503387058 1474286636 1.02
clickbench_q35/datafusion:parquet 502797700 466812621 1.08
clickbench_q36/datafusion:parquet 145530141 139522053 1.04
clickbench_q37/datafusion:parquet 58588792 56684594 1.03
clickbench_q38/datafusion:parquet 89350838 86330560 1.03
clickbench_q39/datafusion:parquet 271044619 254966455 1.06
clickbench_q40/datafusion:parquet 31246002 29774211 1.05
clickbench_q41/datafusion:parquet 28897612 26362644 1.10
clickbench_q42/datafusion:parquet 30175733 29469477 1.02
duckdb / vortex-file-compressed (0.976x ➖, 7↑ 0↓)
name PR d75de6d (ns) base deb7de0 (ns) ratio (PR/base)
clickbench_q00/duckdb:vortex-file-compressed 6108626 5851223 1.04
clickbench_q01/duckdb:vortex-file-compressed 12504633 13124784 0.95
clickbench_q02/duckdb:vortex-file-compressed 25759386 25499477 1.01
clickbench_q03/duckdb:vortex-file-compressed 30440049 29896567 1.02
clickbench_q04/duckdb:vortex-file-compressed 177961608 181541024 0.98
clickbench_q05/duckdb:vortex-file-compressed 175234755 175813882 1.00
clickbench_q06/duckdb:vortex-file-compressed 20240312 19977422 1.01
clickbench_q07/duckdb:vortex-file-compressed 🚀 14546979 16313525 0.89
clickbench_q08/duckdb:vortex-file-compressed 260824494 256462363 1.02
clickbench_q09/duckdb:vortex-file-compressed 348495349 334140128 1.04
clickbench_q10/duckdb:vortex-file-compressed 67836181 68609982 0.99
clickbench_q11/duckdb:vortex-file-compressed 78848709 77187627 1.02
clickbench_q12/duckdb:vortex-file-compressed 210006002 203102160 1.03
clickbench_q13/duckdb:vortex-file-compressed 411081008 394724582 1.04
clickbench_q14/duckdb:vortex-file-compressed 242386049 225536745 1.07
clickbench_q15/duckdb:vortex-file-compressed 252386251 243100581 1.04
clickbench_q16/duckdb:vortex-file-compressed 596131178 577716667 1.03
clickbench_q17/duckdb:vortex-file-compressed 480950583 470324716 1.02
clickbench_q18/duckdb:vortex-file-compressed 1001424415 985900779 1.02
clickbench_q19/duckdb:vortex-file-compressed 20446240 20811541 0.98
clickbench_q20/duckdb:vortex-file-compressed 325013236 322117969 1.01
clickbench_q21/duckdb:vortex-file-compressed 361818288 361227588 1.00
clickbench_q22/duckdb:vortex-file-compressed 478556496 492615833 0.97
clickbench_q23/duckdb:vortex-file-compressed 410453204 373430292 1.10
clickbench_q24/duckdb:vortex-file-compressed 37482251 37178320 1.01
clickbench_q25/duckdb:vortex-file-compressed 69566896 75571533 0.92
clickbench_q26/duckdb:vortex-file-compressed 49194172 48942917 1.01
clickbench_q27/duckdb:vortex-file-compressed 462065335 459432580 1.01
clickbench_q28/duckdb:vortex-file-compressed 2976335073 2975787995 1.00
clickbench_q29/duckdb:vortex-file-compressed 28792053 28238992 1.02
clickbench_q30/duckdb:vortex-file-compressed 185079123 183427153 1.01
clickbench_q31/duckdb:vortex-file-compressed 284564304 278883503 1.02
clickbench_q32/duckdb:vortex-file-compressed 1185919831 1125975339 1.05
clickbench_q33/duckdb:vortex-file-compressed 1166400144 1126363941 1.04
clickbench_q34/duckdb:vortex-file-compressed 1272519081 1206781169 1.05
clickbench_q35/duckdb:vortex-file-compressed 383921286 376089095 1.02
clickbench_q36/duckdb:vortex-file-compressed 🚀 25150713 30536636 0.82
clickbench_q37/duckdb:vortex-file-compressed 🚀 16643387 22420230 0.74
clickbench_q38/duckdb:vortex-file-compressed 🚀 18963744 24184580 0.78
clickbench_q39/duckdb:vortex-file-compressed 38634815 40861310 0.95
clickbench_q40/duckdb:vortex-file-compressed 🚀 17374896 21633198 0.80
clickbench_q41/duckdb:vortex-file-compressed 🚀 16841965 20817041 0.81
clickbench_q42/duckdb:vortex-file-compressed 🚀 18190205 22862514 0.80
duckdb / parquet (1.019x ➖, 0↑ 2↓)
name PR d75de6d (ns) base deb7de0 (ns) ratio (PR/base)
clickbench_q00/duckdb:parquet 26869413 25666372 1.05
clickbench_q01/duckdb:parquet 27401221 26574061 1.03
clickbench_q02/duckdb:parquet 48428892 48880877 0.99
clickbench_q03/duckdb:parquet 39402269 37834098 1.04
clickbench_q04/duckdb:parquet 207092487 202833615 1.02
clickbench_q05/duckdb:parquet 265646990 262678616 1.01
clickbench_q06/duckdb:parquet 46388942 46295693 1.00
clickbench_q07/duckdb:parquet 29847853 29111810 1.03
clickbench_q08/duckdb:parquet 270541289 266854762 1.01
clickbench_q09/duckdb:parquet 406458484 399894343 1.02
clickbench_q10/duckdb:parquet 82259111 80872709 1.02
clickbench_q11/duckdb:parquet 99439807 97809391 1.02
clickbench_q12/duckdb:parquet 295015067 292391930 1.01
clickbench_q13/duckdb:parquet 516485569 489382630 1.06
clickbench_q14/duckdb:parquet 327214173 326222924 1.00
clickbench_q15/duckdb:parquet 262892805 262898800 1.00
clickbench_q16/duckdb:parquet 654110471 638638258 1.02
clickbench_q17/duckdb:parquet 555705397 539479516 1.03
clickbench_q18/duckdb:parquet 1095920893 1077825090 1.02
clickbench_q19/duckdb:parquet 26175091 26221274 1.00
clickbench_q20/duckdb:parquet 428751314 424529755 1.01
clickbench_q21/duckdb:parquet 548844497 546730408 1.00
clickbench_q22/duckdb:parquet 935847561 935752100 1.00
clickbench_q23/duckdb:parquet 325375471 303157771 1.07
clickbench_q24/duckdb:parquet 70516564 68804578 1.02
clickbench_q25/duckdb:parquet 158544048 158077629 1.00
clickbench_q26/duckdb:parquet 49458330 50739945 0.97
clickbench_q27/duckdb:parquet 649816507 650673392 1.00
clickbench_q28/duckdb:parquet 4839508642 4824149140 1.00
clickbench_q29/duckdb:parquet 41150309 41195890 1.00
clickbench_q30/duckdb:parquet 300734409 300737507 1.00
clickbench_q31/duckdb:parquet 366556050 361496138 1.01
clickbench_q32/duckdb:parquet 1202951651 1136231219 1.06
clickbench_q33/duckdb:parquet 1217607664 1191578555 1.02
clickbench_q34/duckdb:parquet 1337570155 1255939165 1.06
clickbench_q35/duckdb:parquet 366714540 363559826 1.01
clickbench_q36/duckdb:parquet 45095196 48664089 0.93
clickbench_q37/duckdb:parquet 30897574 31855180 0.97
clickbench_q38/duckdb:parquet 33216797 33803810 0.98
clickbench_q39/duckdb:parquet 🚨 88696905 75446544 1.18
clickbench_q40/duckdb:parquet 🚨 19136804 17372735 1.10
clickbench_q41/duckdb:parquet 18784562 17619367 1.07
clickbench_q42/duckdb:parquet 20990391 21372029 0.98
duckdb / duckdb (1.006x ➖, 0↑ 1↓)
name PR d75de6d (ns) base deb7de0 (ns) ratio (PR/base)
clickbench_q00/duckdb:duckdb 19021556 18916875 1.01
clickbench_q01/duckdb:duckdb 34923344 33744184 1.03
clickbench_q02/duckdb:duckdb 46138680 45105369 1.02
clickbench_q03/duckdb:duckdb 48782214 47255500 1.03
clickbench_q04/duckdb:duckdb 189775473 188765322 1.01
clickbench_q05/duckdb:duckdb 265842045 265128108 1.00
clickbench_q06/duckdb:duckdb 🚨 37183099 28625700 1.30
clickbench_q07/duckdb:duckdb 37338095 36859025 1.01
clickbench_q08/duckdb:duckdb 252009714 247883744 1.02
clickbench_q09/duckdb:duckdb 367166610 364028174 1.01
clickbench_q10/duckdb:duckdb 99284547 98525440 1.01
clickbench_q11/duckdb:duckdb 109423063 108457846 1.01
clickbench_q12/duckdb:duckdb 238209439 235335502 1.01
clickbench_q13/duckdb:duckdb 450499486 468983253 0.96
clickbench_q14/duckdb:duckdb 274313033 272985161 1.00
clickbench_q15/duckdb:duckdb 218960734 222051104 0.99
clickbench_q16/duckdb:duckdb 616846719 620093073 0.99
clickbench_q17/duckdb:duckdb 536827347 532961643 1.01
clickbench_q18/duckdb:duckdb 1156717591 1177362773 0.98
clickbench_q19/duckdb:duckdb 35992100 35961540 1.00
clickbench_q20/duckdb:duckdb 859525476 855505967 1.00
clickbench_q21/duckdb:duckdb 882348528 901540716 0.98
clickbench_q22/duckdb:duckdb 1044487879 1159201837 0.90
clickbench_q23/duckdb:duckdb 266576717 257573029 1.03
clickbench_q24/duckdb:duckdb 62989849 62461438 1.01
clickbench_q25/duckdb:duckdb 140812801 144029742 0.98
clickbench_q26/duckdb:duckdb 60758990 60894111 1.00
clickbench_q27/duckdb:duckdb 909669387 898859068 1.01
clickbench_q28/duckdb:duckdb 4690154916 4592509037 1.02
clickbench_q29/duckdb:duckdb 49128846 49726780 0.99
clickbench_q30/duckdb:duckdb 257771879 260522007 0.99
clickbench_q31/duckdb:duckdb 400151438 403537714 0.99
clickbench_q32/duckdb:duckdb 1429930392 1523758209 0.94
clickbench_q33/duckdb:duckdb 1942664341 1856738068 1.05
clickbench_q34/duckdb:duckdb 1988641585 1931616136 1.03
clickbench_q35/duckdb:duckdb 286599206 280143364 1.02
clickbench_q36/duckdb:duckdb 42063491 41585994 1.01
clickbench_q37/duckdb:duckdb 31737651 30483892 1.04
clickbench_q38/duckdb:duckdb 31728261 33529757 0.95
clickbench_q39/duckdb:duckdb 68841780 67475106 1.02
clickbench_q40/duckdb:duckdb 32087798 33262116 0.96
clickbench_q41/duckdb:duckdb 31693745 31843522 1.00
clickbench_q42/duckdb:duckdb 32618443 33038427 0.99
Full attributed analysis
Query Config Raw Δ Control Δ Attributed α Noise floor Significant?
0 datafusion:vortex-file-compressed +0.0% -2.9% +3.0% +778.4% ➖ noise
0 duckdb:duckdb +0.6% -2.9% +3.6% +285.7% ➖ noise
0 duckdb:vortex-file-compressed +4.4% -2.9% +7.5% +473.4% ➖ noise
1 datafusion:vortex-file-compressed +7.7% +1.1% +6.5% +27.0% ➖ noise
1 duckdb:duckdb +3.5% +1.1% +2.3% +57.2% ➖ noise
1 duckdb:vortex-file-compressed -4.7% +1.1% -5.8% +26.1% ➖ noise
2 datafusion:vortex-file-compressed +1.7% -3.0% +4.8% +10.7% ➖ noise
2 duckdb:duckdb +2.3% -3.0% +5.4% +19.4% ➖ noise
2 duckdb:vortex-file-compressed +1.0% -3.0% +4.1% +10.0% ➖ noise
3 datafusion:vortex-file-compressed +9.0% +2.5% +6.3% +139.3% ➖ noise
3 duckdb:duckdb +3.2% +2.5% +0.7% +36.2% ➖ noise
3 duckdb:vortex-file-compressed +1.8% +2.5% -0.7% +40.9% ➖ noise
4 datafusion:vortex-file-compressed +6.6% +4.0% +2.5% +10.0% ➖ noise
4 duckdb:duckdb +0.5% +4.0% -3.4% +10.0% ➖ noise
4 duckdb:vortex-file-compressed -2.0% +4.0% -5.8% +10.0% ➖ noise
5 datafusion:vortex-file-compressed -2.8% +2.0% -4.7% +10.0% ➖ noise
5 duckdb:duckdb +0.3% +2.0% -1.7% +10.0% ➖ noise
5 duckdb:vortex-file-compressed -0.3% +2.0% -2.3% +10.0% ➖ noise
6 datafusion:vortex-file-compressed -0.0% +0.7% -0.7% +39.5% ➖ noise
6 duckdb:duckdb +29.9% +0.7% +29.0% +29.0% ➖ noise
6 duckdb:vortex-file-compressed +1.3% +0.7% +0.6% +20.5% ➖ noise
7 datafusion:vortex-file-compressed +22.4% +2.0% +20.0% +12.0% 🚨 regression
7 duckdb:duckdb +1.3% +2.0% -0.7% +10.7% ➖ noise
7 duckdb:vortex-file-compressed -10.8% +2.0% -12.6% +10.0% ✅ faster
8 datafusion:vortex-file-compressed +3.8% +3.8% +0.0% +10.0% ➖ noise
8 duckdb:duckdb +1.7% +3.8% -2.0% +10.0% ➖ noise
8 duckdb:vortex-file-compressed +1.7% +3.8% -2.0% +10.0% ➖ noise
9 datafusion:vortex-file-compressed +2.1% +3.3% -1.1% +10.0% ➖ noise
9 duckdb:duckdb +0.9% +3.3% -2.3% +10.0% ➖ noise
9 duckdb:vortex-file-compressed +4.3% +3.3% +1.0% +10.0% ➖ noise
10 datafusion:vortex-file-compressed +4.1% +5.6% -1.3% +10.0% ➖ noise
10 duckdb:duckdb +0.8% +5.6% -4.5% +10.0% ➖ noise
10 duckdb:vortex-file-compressed -1.1% +5.6% -6.3% +10.9% ➖ noise
11 datafusion:vortex-file-compressed -2.0% +4.1% -5.8% +10.0% ➖ noise
11 duckdb:duckdb +0.9% +4.1% -3.0% +10.0% ➖ noise
11 duckdb:vortex-file-compressed +2.2% +4.1% -1.8% +10.0% ➖ noise
12 datafusion:vortex-file-compressed +1.3% +2.1% -0.8% +10.0% ➖ noise
12 duckdb:duckdb +1.2% +2.1% -0.9% +10.0% ➖ noise
12 duckdb:vortex-file-compressed +3.4% +2.1% +1.2% +10.0% ➖ noise
13 datafusion:vortex-file-compressed +4.3% +7.0% -2.5% +10.0% ➖ noise
13 duckdb:duckdb -3.9% +7.0% -10.3% +10.0% ✅ faster
13 duckdb:vortex-file-compressed +4.1% +7.0% -2.7% +10.0% ➖ noise
14 datafusion:vortex-file-compressed +2.6% +4.9% -2.1% +10.0% ➖ noise
14 duckdb:duckdb +0.5% +4.9% -4.2% +10.0% ➖ noise
14 duckdb:vortex-file-compressed +7.5% +4.9% +2.5% +10.0% ➖ noise
15 datafusion:vortex-file-compressed +4.8% +4.9% -0.1% +10.0% ➖ noise
15 duckdb:duckdb -1.4% +4.9% -6.0% +10.0% ➖ noise
15 duckdb:vortex-file-compressed +3.8% +4.9% -1.1% +10.0% ➖ noise
16 datafusion:vortex-file-compressed +5.4% +5.4% -0.0% +10.0% ➖ noise
16 duckdb:duckdb -0.5% +5.4% -5.6% +10.0% ➖ noise
16 duckdb:vortex-file-compressed +3.2% +5.4% -2.1% +10.0% ➖ noise
17 datafusion:vortex-file-compressed +6.7% +4.3% +2.3% +10.0% ➖ noise
17 duckdb:duckdb +0.7% +4.3% -3.5% +10.0% ➖ noise
17 duckdb:vortex-file-compressed +2.3% +4.3% -2.0% +10.0% ➖ noise
18 datafusion:vortex-file-compressed +2.1% +4.4% -2.2% +10.0% ➖ noise
18 duckdb:duckdb -1.8% +4.4% -5.9% +10.0% ➖ noise
18 duckdb:vortex-file-compressed +1.6% +4.4% -2.7% +10.0% ➖ noise
19 datafusion:vortex-file-compressed -1.2% -2.4% +1.3% +24.9% ➖ noise
19 duckdb:duckdb +0.1% -2.4% +2.6% +19.5% ➖ noise
19 duckdb:vortex-file-compressed -1.8% -2.4% +0.7% +19.2% ➖ noise
20 datafusion:vortex-file-compressed -2.6% +2.1% -4.5% +209.1% ➖ noise
20 duckdb:duckdb +0.5% +2.1% -1.6% +29.5% ➖ noise
20 duckdb:vortex-file-compressed +0.9% +2.1% -1.1% +52.2% ➖ noise
21 datafusion:vortex-file-compressed +9.6% +3.1% +6.3% +10.0% ➖ noise
21 duckdb:duckdb -2.1% +3.1% -5.1% +10.0% ➖ noise
21 duckdb:vortex-file-compressed +0.2% +3.1% -2.8% +10.0% ➖ noise
22 datafusion:vortex-file-compressed +14.4% +3.2% +10.9% +13.4% ➖ noise
22 duckdb:duckdb -9.9% +3.2% -12.7% +14.2% ✅ faster
22 duckdb:vortex-file-compressed -2.9% +3.2% -5.8% +12.5% ➖ noise
23 datafusion:vortex-file-compressed +16.1% +6.6% +8.9% +40.9% ➖ noise
23 duckdb:duckdb +3.5% +6.6% -2.9% +10.0% ➖ noise
23 duckdb:vortex-file-compressed +9.9% +6.6% +3.1% +10.1% ➖ noise
24 datafusion:vortex-file-compressed -1.6% +2.9% -4.3% +11.0% ➖ noise
24 duckdb:duckdb +0.8% +2.9% -2.0% +10.0% ➖ noise
24 duckdb:vortex-file-compressed +0.8% +2.9% -2.0% +23.4% ➖ noise
25 datafusion:vortex-file-compressed +12.8% +2.1% +10.5% +10.0% 🚨 regression
25 duckdb:duckdb -2.2% +2.1% -4.2% +10.0% ➖ noise
25 duckdb:vortex-file-compressed -7.9% +2.1% -9.8% +10.1% ✅ faster
26 datafusion:vortex-file-compressed -0.3% +1.1% -1.5% +10.6% ➖ noise
26 duckdb:duckdb -0.2% +1.1% -1.3% +13.8% ➖ noise
26 duckdb:vortex-file-compressed +0.5% +1.1% -0.6% +19.1% ➖ noise
27 datafusion:vortex-file-compressed -0.8% +0.8% -1.5% +10.0% ➖ noise
27 duckdb:duckdb +1.2% +0.8% +0.4% +10.0% ➖ noise
27 duckdb:vortex-file-compressed +0.6% +0.8% -0.2% +10.0% ➖ noise
28 datafusion:vortex-file-compressed +5.2% +1.1% +4.0% +10.0% ➖ noise
28 duckdb:duckdb +2.1% +1.1% +1.0% +10.0% ➖ noise
28 duckdb:vortex-file-compressed +0.0% +1.1% -1.1% +10.0% ➖ noise
29 datafusion:vortex-file-compressed +1.9% -1.0% +3.0% +10.0% ➖ noise
29 duckdb:duckdb -1.2% -1.0% -0.2% +10.0% ➖ noise
29 duckdb:vortex-file-compressed +2.0% -1.0% +3.0% +10.8% ➖ noise
30 datafusion:vortex-file-compressed +15.5% +0.9% +14.4% +10.0% 🚨 regression
30 duckdb:duckdb -1.1% +0.9% -1.9% +10.0% ➖ noise
30 duckdb:vortex-file-compressed +0.9% +0.9% +0.0% +10.0% ➖ noise
31 datafusion:vortex-file-compressed +10.4% +3.0% +7.1% +10.0% ➖ noise
31 duckdb:duckdb -0.8% +3.0% -3.7% +10.0% ➖ noise
31 duckdb:vortex-file-compressed +2.0% +3.0% -0.9% +10.0% ➖ noise
32 datafusion:vortex-file-compressed +12.7% +8.1% +4.3% +10.0% ➖ noise
32 duckdb:duckdb -6.2% +8.1% -13.2% +10.0% ✅ faster
32 duckdb:vortex-file-compressed +5.3% +8.1% -2.5% +10.0% ➖ noise
33 datafusion:vortex-file-compressed +9.9% +2.3% +7.4% +10.0% ➖ noise
33 duckdb:duckdb +4.6% +2.3% +2.3% +10.0% ➖ noise
33 duckdb:vortex-file-compressed +3.6% +2.3% +1.2% +10.0% ➖ noise
34 datafusion:vortex-file-compressed +1.9% +4.2% -2.2% +10.0% ➖ noise
34 duckdb:duckdb +3.0% +4.2% -1.2% +10.0% ➖ noise
34 duckdb:vortex-file-compressed +5.4% +4.2% +1.2% +10.0% ➖ noise
35 datafusion:vortex-file-compressed +2.3% +4.2% -1.8% +10.0% ➖ noise
35 duckdb:duckdb +2.3% +4.2% -1.8% +10.0% ➖ noise
35 duckdb:vortex-file-compressed +2.1% +4.2% -2.1% +10.0% ➖ noise
36 datafusion:vortex-file-compressed -2.6% -1.7% -0.9% +11.7% ➖ noise
36 duckdb:duckdb +1.1% -1.7% +2.9% +16.0% ➖ noise
36 duckdb:vortex-file-compressed -17.6% -1.7% -16.2% +14.6% ✅ faster
37 datafusion:vortex-file-compressed -0.8% +0.1% -0.9% +10.0% ➖ noise
37 duckdb:duckdb +4.1% +0.1% +4.0% +10.0% ➖ noise
37 duckdb:vortex-file-compressed -25.8% +0.1% -25.9% +10.0% ✅ faster
38 datafusion:vortex-file-compressed -7.4% +0.8% -8.1% +10.0% ➖ noise
38 duckdb:duckdb -5.4% +0.8% -6.2% +10.0% ➖ noise
38 duckdb:vortex-file-compressed -21.6% +0.8% -22.2% +12.0% ✅ faster
39 datafusion:vortex-file-compressed +7.4% +11.8% -4.0% +10.0% ➖ noise
39 duckdb:duckdb +2.0% +11.8% -8.7% +18.8% ➖ noise
39 duckdb:vortex-file-compressed -5.4% +11.8% -15.4% +15.1% ✅ faster
40 datafusion:vortex-file-compressed -1.3% +7.5% -8.2% +11.2% ➖ noise
40 duckdb:duckdb -3.5% +7.5% -10.3% +10.1% ✅ faster
40 duckdb:vortex-file-compressed -19.7% +7.5% -25.3% +16.3% ✅ faster
41 datafusion:vortex-file-compressed -0.3% +8.1% -7.7% +10.0% ➖ noise
41 duckdb:duckdb -0.5% +8.1% -7.9% +13.6% ➖ noise
41 duckdb:vortex-file-compressed -19.1% +8.1% -25.2% +10.0% ✅ faster
42 datafusion:vortex-file-compressed +1.7% +0.3% +1.4% +10.0% ➖ noise
42 duckdb:duckdb -1.3% +0.3% -1.6% +11.4% ➖ noise
42 duckdb:vortex-file-compressed -20.4% +0.3% -20.7% +12.7% ✅ faster

@github-actions
Copy link
Copy Markdown
Contributor

github-actions Bot commented Apr 30, 2026

File Sizes: Clickbench on NVME

File Size Changes (1 files changed, -0.0% overall, 0↑ 1↓)
File Scale Format Base HEAD Change %
duckdb.db 1.0 vortex-compact 268.00 KB 0 B 268.00 KB -100.0%

Totals:

  • vortex-compact: 7.06 GB → 7.06 GB (-0.0%)
  • vortex-file-compressed: 14.01 GB → 14.01 GB (0.0%)

@github-actions
Copy link
Copy Markdown
Contributor

github-actions Bot commented Apr 30, 2026

Benchmarks: TPC-H SF=10 on S3

Verdict: No clear signal (environment too noisy confidence)
Attributed Vortex impact: +6.1%
Vortex (geomean): 1.031x ➖
Parquet (geomean): 0.971x ➖
Shifts: Parquet (control) -2.9% · Median polish +1.4%


datafusion / vortex-file-compressed (1.069x ➖, 0↑ 3↓)
name PR d75de6d (ns) base deb7de0 (ns) ratio (PR/base)
tpch_q01/datafusion:vortex-file-compressed 681947903 692270240 0.99
tpch_q02/datafusion:vortex-file-compressed 757516648 821023726 0.92
tpch_q03/datafusion:vortex-file-compressed 926757572 814823121 1.14
tpch_q04/datafusion:vortex-file-compressed 625495522 646863363 0.97
tpch_q05/datafusion:vortex-file-compressed 1065385292 979882895 1.09
tpch_q06/datafusion:vortex-file-compressed 🚨 849809196 651147279 1.31
tpch_q07/datafusion:vortex-file-compressed 1310620816 1028268802 1.27
tpch_q08/datafusion:vortex-file-compressed 1264992724 1150561350 1.10
tpch_q09/datafusion:vortex-file-compressed 1313271561 1280505432 1.03
tpch_q10/datafusion:vortex-file-compressed 🚨 1370625907 993767339 1.38
tpch_q11/datafusion:vortex-file-compressed 🚨 668411224 473684423 1.41
tpch_q12/datafusion:vortex-file-compressed 1060512324 1120184014 0.95
tpch_q13/datafusion:vortex-file-compressed 449501254 441416570 1.02
tpch_q14/datafusion:vortex-file-compressed 635571185 680761588 0.93
tpch_q15/datafusion:vortex-file-compressed 1127323299 1217153945 0.93
tpch_q16/datafusion:vortex-file-compressed 460156711 378584188 1.22
tpch_q17/datafusion:vortex-file-compressed 1209276020 1233867987 0.98
tpch_q18/datafusion:vortex-file-compressed 1305959793 1268515848 1.03
tpch_q19/datafusion:vortex-file-compressed 817805533 811899915 1.01
tpch_q20/datafusion:vortex-file-compressed 991661781 945205678 1.05
tpch_q21/datafusion:vortex-file-compressed 1657532031 1607536626 1.03
tpch_q22/datafusion:vortex-file-compressed 354671127 361074498 0.98
datafusion / vortex-compact (1.033x ➖, 0↑ 1↓)
name PR d75de6d (ns) base deb7de0 (ns) ratio (PR/base)
tpch_q01/datafusion:vortex-compact 715780038 760216161 0.94
tpch_q02/datafusion:vortex-compact 620940341 692095231 0.90
tpch_q03/datafusion:vortex-compact 730390862 799793244 0.91
tpch_q04/datafusion:vortex-compact 609673258 546977867 1.11
tpch_q05/datafusion:vortex-compact 977628844 845024475 1.16
tpch_q06/datafusion:vortex-compact 645601211 579538117 1.11
tpch_q07/datafusion:vortex-compact 986859265 975748472 1.01
tpch_q08/datafusion:vortex-compact 🚨 1366206242 1048926524 1.30
tpch_q09/datafusion:vortex-compact 1389201317 1155494603 1.20
tpch_q10/datafusion:vortex-compact 1013262430 1104680815 0.92
tpch_q11/datafusion:vortex-compact 426871832 471995630 0.90
tpch_q12/datafusion:vortex-compact 823496288 800985909 1.03
tpch_q13/datafusion:vortex-compact 443618485 390724583 1.14
tpch_q14/datafusion:vortex-compact 573822344 575380089 1.00
tpch_q15/datafusion:vortex-compact 1057456689 1053222165 1.00
tpch_q16/datafusion:vortex-compact 365539651 346459097 1.06
tpch_q17/datafusion:vortex-compact 1132092792 1177442153 0.96
tpch_q18/datafusion:vortex-compact 1093614975 1075749034 1.02
tpch_q19/datafusion:vortex-compact 988557996 796142713 1.24
tpch_q20/datafusion:vortex-compact 1001951267 1018604853 0.98
tpch_q21/datafusion:vortex-compact 1415664769 1529864767 0.93
tpch_q22/datafusion:vortex-compact 396932024 385350094 1.03
datafusion / parquet (0.910x ➖, 2↑ 0↓)
name PR d75de6d (ns) base deb7de0 (ns) ratio (PR/base)
tpch_q01/datafusion:parquet 672836331 650338407 1.03
tpch_q02/datafusion:parquet 811105676 715593942 1.13
tpch_q03/datafusion:parquet 919993863 1028060195 0.89
tpch_q04/datafusion:parquet 425159949 505572396 0.84
tpch_q05/datafusion:parquet 1151145470 1186713484 0.97
tpch_q06/datafusion:parquet 534849420 557861478 0.96
tpch_q07/datafusion:parquet 1309392166 1353175081 0.97
tpch_q08/datafusion:parquet 1626718511 1682707332 0.97
tpch_q09/datafusion:parquet 1855562764 1789545886 1.04
tpch_q10/datafusion:parquet 1939738290 1999205134 0.97
tpch_q11/datafusion:parquet 600002776 557120943 1.08
tpch_q12/datafusion:parquet 630450763 741035870 0.85
tpch_q13/datafusion:parquet 683703564 868245458 0.79
tpch_q14/datafusion:parquet 797291763 963428374 0.83
tpch_q15/datafusion:parquet 1198533886 1291959679 0.93
tpch_q16/datafusion:parquet 🚀 369508220 619681597 0.60
tpch_q17/datafusion:parquet 1390568770 1501020187 0.93
tpch_q18/datafusion:parquet 1581657132 1520655374 1.04
tpch_q19/datafusion:parquet 1004670315 984328650 1.02
tpch_q20/datafusion:parquet 1342765837 1120940081 1.20
tpch_q21/datafusion:parquet 2064747567 2525184786 0.82
tpch_q22/datafusion:parquet 🚀 722911332 1428588201 0.51
duckdb / vortex-file-compressed (0.988x ➖, 0↑ 0↓)
name PR d75de6d (ns) base deb7de0 (ns) ratio (PR/base)
tpch_q01/duckdb:vortex-file-compressed 630107937 663890293 0.95
tpch_q02/duckdb:vortex-file-compressed 1253303368 1143809120 1.10
tpch_q03/duckdb:vortex-file-compressed 953544815 898622171 1.06
tpch_q04/duckdb:vortex-file-compressed 644207309 660214264 0.98
tpch_q05/duckdb:vortex-file-compressed 1072762637 1098332943 0.98
tpch_q06/duckdb:vortex-file-compressed 807639096 767823292 1.05
tpch_q07/duckdb:vortex-file-compressed 1309021435 1212004077 1.08
tpch_q08/duckdb:vortex-file-compressed 1375355083 1388232668 0.99
tpch_q09/duckdb:vortex-file-compressed 1422900407 1473293101 0.97
tpch_q10/duckdb:vortex-file-compressed 1144013183 1175644480 0.97
tpch_q11/duckdb:vortex-file-compressed 654690148 614741453 1.06
tpch_q12/duckdb:vortex-file-compressed 696388875 732455994 0.95
tpch_q13/duckdb:vortex-file-compressed 931162692 940912926 0.99
tpch_q14/duckdb:vortex-file-compressed 847547841 835210443 1.01
tpch_q15/duckdb:vortex-file-compressed 530194204 550257916 0.96
tpch_q16/duckdb:vortex-file-compressed 514028300 498763979 1.03
tpch_q17/duckdb:vortex-file-compressed 942967148 976822057 0.97
tpch_q18/duckdb:vortex-file-compressed 883718162 829017528 1.07
tpch_q19/duckdb:vortex-file-compressed 740874359 748058557 0.99
tpch_q20/duckdb:vortex-file-compressed 1139687936 1354097403 0.84
tpch_q21/duckdb:vortex-file-compressed 1878631327 2001094690 0.94
tpch_q22/duckdb:vortex-file-compressed 606931039 713246643 0.85
duckdb / vortex-compact (1.034x ➖, 0↑ 1↓)
name PR d75de6d (ns) base deb7de0 (ns) ratio (PR/base)
tpch_q01/duckdb:vortex-compact 573676147 594686735 0.96
tpch_q02/duckdb:vortex-compact 1097339739 1126155077 0.97
tpch_q03/duckdb:vortex-compact 802149701 735531899 1.09
tpch_q04/duckdb:vortex-compact 534924913 511859110 1.05
tpch_q05/duckdb:vortex-compact 1043778736 999946354 1.04
tpch_q06/duckdb:vortex-compact 748094998 729813720 1.03
tpch_q07/duckdb:vortex-compact 1088896945 1133109284 0.96
tpch_q08/duckdb:vortex-compact 1405555278 1364489062 1.03
tpch_q09/duckdb:vortex-compact 1369775794 1333767906 1.03
tpch_q10/duckdb:vortex-compact 1043959453 1098160284 0.95
tpch_q11/duckdb:vortex-compact 770368889 685943646 1.12
tpch_q12/duckdb:vortex-compact 🚨 894464970 686193973 1.30
tpch_q13/duckdb:vortex-compact 856914311 872022267 0.98
tpch_q14/duckdb:vortex-compact 904465700 817945784 1.11
tpch_q15/duckdb:vortex-compact 550566998 524397186 1.05
tpch_q16/duckdb:vortex-compact 498141899 458373664 1.09
tpch_q17/duckdb:vortex-compact 901307252 894585656 1.01
tpch_q18/duckdb:vortex-compact 734266277 750778795 0.98
tpch_q19/duckdb:vortex-compact 730038722 755199138 0.97
tpch_q20/duckdb:vortex-compact 1197557749 1123130571 1.07
tpch_q21/duckdb:vortex-compact 1767467104 1639504945 1.08
tpch_q22/duckdb:vortex-compact 606293014 638712348 0.95
duckdb / parquet (1.038x ➖, 0↑ 1↓)
name PR d75de6d (ns) base deb7de0 (ns) ratio (PR/base)
tpch_q01/duckdb:parquet 792124454 815279012 0.97
tpch_q02/duckdb:parquet 1505621019 1536915164 0.98
tpch_q03/duckdb:parquet 1667301620 1658711785 1.01
tpch_q04/duckdb:parquet 🚨 1258698103 963895572 1.31
tpch_q05/duckdb:parquet 2231738731 2207096672 1.01
tpch_q06/duckdb:parquet 781562560 761868735 1.03
tpch_q07/duckdb:parquet 1909849014 1748031769 1.09
tpch_q08/duckdb:parquet 2603272036 2483530414 1.05
tpch_q09/duckdb:parquet 2568016723 2352421474 1.09
tpch_q10/duckdb:parquet 3145754055 2975600590 1.06
tpch_q11/duckdb:parquet 1176222990 1095166528 1.07
tpch_q12/duckdb:parquet 1114131753 1174543521 0.95
tpch_q13/duckdb:parquet 1315674634 1222069459 1.08
tpch_q14/duckdb:parquet 1232217350 1192317698 1.03
tpch_q15/duckdb:parquet 842678190 923160906 0.91
tpch_q16/duckdb:parquet 931672052 853540621 1.09
tpch_q17/duckdb:parquet 1332976072 1265154498 1.05
tpch_q18/duckdb:parquet 1356117235 1277656491 1.06
tpch_q19/duckdb:parquet 1468654209 1462710833 1.00
tpch_q20/duckdb:parquet 1873046757 1718302816 1.09
tpch_q21/duckdb:parquet 1849075401 1844748699 1.00
tpch_q22/duckdb:parquet 1044454024 1100163831 0.95
Full attributed analysis
Query Config Raw Δ Control Δ Attributed α Noise floor Significant?
1 datafusion:vortex-compact -5.8% +0.3% -6.1% +50.3% ➖ noise
1 datafusion:vortex-file-compressed -1.5% +0.3% -1.7% +50.0% ➖ noise
1 duckdb:vortex-compact -3.5% +0.3% -3.8% +38.9% ➖ noise
1 duckdb:vortex-file-compressed -5.1% +0.3% -5.3% +33.7% ➖ noise
2 datafusion:vortex-compact -10.3% +5.4% -14.9% +45.4% ➖ noise
2 datafusion:vortex-file-compressed -7.7% +5.4% -12.4% +36.5% ➖ noise
2 duckdb:vortex-compact -2.6% +5.4% -7.5% +31.8% ➖ noise
2 duckdb:vortex-file-compressed +9.6% +5.4% +4.0% +31.8% ➖ noise
3 datafusion:vortex-compact -8.7% -5.2% -3.7% +47.2% ➖ noise
3 datafusion:vortex-file-compressed +13.7% -5.2% +19.9% +47.7% ➖ noise
3 duckdb:vortex-compact +9.1% -5.2% +15.0% +37.0% ➖ noise
3 duckdb:vortex-file-compressed +6.1% -5.2% +11.9% +39.3% ➖ noise
4 datafusion:vortex-compact +11.5% +4.8% +6.4% +31.8% ➖ noise
4 datafusion:vortex-file-compressed -3.3% +4.8% -7.7% +31.8% ➖ noise
4 duckdb:vortex-compact +4.5% +4.8% -0.3% +33.3% ➖ noise
4 duckdb:vortex-file-compressed -2.4% +4.8% -6.9% +31.8% ➖ noise
5 datafusion:vortex-compact +15.7% -1.0% +16.8% +31.8% ➖ noise
5 datafusion:vortex-file-compressed +8.7% -1.0% +9.8% +31.8% ➖ noise
5 duckdb:vortex-compact +4.4% -1.0% +5.4% +31.8% ➖ noise
5 duckdb:vortex-file-compressed -2.3% -1.0% -1.4% +31.8% ➖ noise
6 datafusion:vortex-compact +11.4% -0.8% +12.3% +43.5% ➖ noise
6 datafusion:vortex-file-compressed +30.5% -0.8% +31.6% +47.0% ➖ noise
6 duckdb:vortex-compact +2.5% -0.8% +3.4% +42.7% ➖ noise
6 duckdb:vortex-file-compressed +5.2% -0.8% +6.1% +43.0% ➖ noise
7 datafusion:vortex-compact +1.1% +2.8% -1.6% +31.8% ➖ noise
7 datafusion:vortex-file-compressed +27.5% +2.8% +24.0% +31.8% ➖ noise
7 duckdb:vortex-compact -3.9% +2.8% -6.5% +31.8% ➖ noise
7 duckdb:vortex-file-compressed +8.0% +2.8% +5.0% +31.8% ➖ noise
8 datafusion:vortex-compact +30.2% +0.7% +29.4% +31.8% ➖ noise
8 datafusion:vortex-file-compressed +9.9% +0.7% +9.2% +31.8% ➖ noise
8 duckdb:vortex-compact +3.0% +0.7% +2.3% +31.8% ➖ noise
8 duckdb:vortex-file-compressed -0.9% +0.7% -1.6% +31.8% ➖ noise
9 datafusion:vortex-compact +20.2% +6.4% +13.0% +31.8% ➖ noise
9 datafusion:vortex-file-compressed +2.6% +6.4% -3.6% +31.8% ➖ noise
9 duckdb:vortex-compact +2.7% +6.4% -3.5% +31.8% ➖ noise
9 duckdb:vortex-file-compressed -3.4% +6.4% -9.2% +31.8% ➖ noise
10 datafusion:vortex-compact -8.3% +1.3% -9.4% +31.8% ➖ noise
10 datafusion:vortex-file-compressed +37.9% +1.3% +36.2% +31.8% 🚨 regression
10 duckdb:vortex-compact -4.9% +1.3% -6.1% +31.8% ➖ noise
10 duckdb:vortex-file-compressed -2.7% +1.3% -3.9% +31.8% ➖ noise
11 datafusion:vortex-compact -9.6% +7.5% -15.9% +31.8% ➖ noise
11 datafusion:vortex-file-compressed +41.1% +7.5% +31.2% +31.8% ➖ noise
11 duckdb:vortex-compact +12.3% +7.5% +4.4% +33.0% ➖ noise
11 duckdb:vortex-file-compressed +6.5% +7.5% -1.0% +31.8% ➖ noise
12 datafusion:vortex-compact +2.8% -10.2% +14.4% +31.8% ➖ noise
12 datafusion:vortex-file-compressed -5.3% -10.2% +5.4% +31.8% ➖ noise
12 duckdb:vortex-compact +30.4% -10.2% +45.1% +31.8% 🚨 regression
12 duckdb:vortex-file-compressed -4.9% -10.2% +5.8% +31.8% ➖ noise
13 datafusion:vortex-compact +13.5% -7.9% +23.3% +31.8% ➖ noise
13 datafusion:vortex-file-compressed +1.8% -7.9% +10.6% +31.8% ➖ noise
13 duckdb:vortex-compact -1.7% -7.9% +6.7% +38.7% ➖ noise
13 duckdb:vortex-file-compressed -1.0% -7.9% +7.5% +40.3% ➖ noise
14 datafusion:vortex-compact -0.3% -7.5% +7.8% +31.8% ➖ noise
14 datafusion:vortex-file-compressed -6.6% -7.5% +1.0% +31.8% ➖ noise
14 duckdb:vortex-compact +10.6% -7.5% +19.6% +31.8% ➖ noise
14 duckdb:vortex-file-compressed +1.5% -7.5% +9.7% +31.8% ➖ noise
15 datafusion:vortex-compact +0.4% -8.0% +9.1% +31.8% ➖ noise
15 datafusion:vortex-file-compressed -7.4% -8.0% +0.6% +32.4% ➖ noise
15 duckdb:vortex-compact +5.0% -8.0% +14.1% +31.8% ➖ noise
15 duckdb:vortex-file-compressed -3.6% -8.0% +4.7% +31.8% ➖ noise
16 datafusion:vortex-compact +5.5% -19.3% +30.8% +31.8% ➖ noise
16 datafusion:vortex-file-compressed +21.5% -19.3% +50.7% +36.6% 🚨 regression
16 duckdb:vortex-compact +8.7% -19.3% +34.7% +31.8% 🚨 regression
16 duckdb:vortex-file-compressed +3.1% -19.3% +27.7% +31.8% ➖ noise
17 datafusion:vortex-compact -3.9% -1.2% -2.7% +31.8% ➖ noise
17 datafusion:vortex-file-compressed -2.0% -1.2% -0.8% +31.8% ➖ noise
17 duckdb:vortex-compact +0.8% -1.2% +2.0% +31.8% ➖ noise
17 duckdb:vortex-file-compressed -3.5% -1.2% -2.3% +31.8% ➖ noise
18 datafusion:vortex-compact +1.7% +5.1% -3.2% +31.8% ➖ noise
18 datafusion:vortex-file-compressed +3.0% +5.1% -2.0% +31.8% ➖ noise
18 duckdb:vortex-compact -2.2% +5.1% -6.9% +31.8% ➖ noise
18 duckdb:vortex-file-compressed +6.6% +5.1% +1.5% +31.8% ➖ noise
19 datafusion:vortex-compact +24.2% +1.2% +22.7% +31.8% ➖ noise
19 datafusion:vortex-file-compressed +0.7% +1.2% -0.5% +31.8% ➖ noise
19 duckdb:vortex-compact -3.3% +1.2% -4.5% +31.8% ➖ noise
19 duckdb:vortex-file-compressed -1.0% +1.2% -2.2% +31.8% ➖ noise
20 datafusion:vortex-compact -1.6% +14.3% -13.9% +31.8% ➖ noise
20 datafusion:vortex-file-compressed +4.9% +14.3% -8.2% +31.8% ➖ noise
20 duckdb:vortex-compact +6.6% +14.3% -6.7% +31.8% ➖ noise
20 duckdb:vortex-file-compressed -15.8% +14.3% -26.3% +31.8% ✅ faster
21 datafusion:vortex-compact -7.5% -9.5% +2.2% +40.0% ➖ noise
21 datafusion:vortex-file-compressed +3.1% -9.5% +13.9% +31.8% ➖ noise
21 duckdb:vortex-compact +7.8% -9.5% +19.1% +34.1% ➖ noise
21 duckdb:vortex-file-compressed -6.1% -9.5% +3.7% +31.8% ➖ noise
22 datafusion:vortex-compact +3.0% -30.7% +48.6% +31.8% 🚨 regression
22 datafusion:vortex-file-compressed -1.8% -30.7% +41.7% +44.5% ➖ noise
22 duckdb:vortex-compact -5.1% -30.7% +37.0% +31.8% 🚨 regression
22 duckdb:vortex-file-compressed -14.9% -30.7% +22.8% +36.4% ➖ noise

@github-actions
Copy link
Copy Markdown
Contributor

Benchmarks: Compression

Vortex (geomean): 0.989x ➖
Parquet (geomean): 0.994x ➖


unknown / unknown (0.993x ➖, 3↑ 4↓)
name PR d75de6d (ns) base deb7de0 (ns) ratio (PR/base)
compress time/Arade 1103071936 1137343802 0.97
compress time/Bimbo 6486538947 6775498143 0.96
compress time/CMSprovider 2739007382 2866542853 0.96
compress time/Euro2016 430510021 427508020 1.01
compress time/Food 398052735 391483888 1.02
compress time/HashTags 846143965 804093551 1.05
compress time/TPC-H l_comment canonical 1218405165 1318415749 0.92
compress time/TPC-H l_comment chunked 1280866483 1294312643 0.99
compress time/taxi 707520257 720629231 0.98
compress time/wide table cols=100 chunks=1 rows=1000 10858605 11409942 0.95
compress time/wide table cols=100 chunks=50 rows=1000 12603356 11820394 1.07
compress time/wide table cols=1000 chunks=1 rows=1000 128563918 123747620 1.04
compress time/wide table cols=1000 chunks=50 rows=1000 128664281 127953732 1.01
compress time/wide table cols=10000 chunks=1 rows=1000 1367132557 1404136481 0.97
compress time/wide table cols=10000 chunks=50 rows=1000 1395689742 1402297048 1.00
decompress time/Arade 25742916 25769824 1.00
decompress time/Bimbo 77313465 78751979 0.98
decompress time/CMSprovider 80217287 75593715 1.06
decompress time/Euro2016 🚨 19522862 17142814 1.14
decompress time/Food 8075779 7672877 1.05
decompress time/HashTags 68275924 71480460 0.96
decompress time/TPC-H l_comment canonical 38030755 39511040 0.96
decompress time/TPC-H l_comment chunked 38611577 39134929 0.99
decompress time/taxi 14595633 15964391 0.91
decompress time/wide table cols=100 chunks=1 rows=1000 2231400 2474074 0.90
decompress time/wide table cols=100 chunks=50 rows=1000 2413734 2418682 1.00
decompress time/wide table cols=1000 chunks=1 rows=1000 21959262 22912171 0.96
decompress time/wide table cols=1000 chunks=50 rows=1000 21337212 23612365 0.90
decompress time/wide table cols=10000 chunks=1 rows=1000 241372561 257929752 0.94
decompress time/wide table cols=10000 chunks=50 rows=1000 230036408 252048571 0.91
parquet size/Arade 258014282 258014282 1.00
parquet size/Bimbo 384517292 384517292 1.00
parquet size/CMSprovider 376885545 376885545 1.00
parquet size/Euro2016 122975499 122975499 1.00
parquet size/Food 35699500 35699500 1.00
parquet size/HashTags 133510943 133510943 1.00
parquet size/TPC-H l_comment canonical 158358238 158358238 1.00
parquet size/TPC-H l_comment chunked 158358238 158358238 1.00
parquet size/taxi 55283635 55283635 1.00
parquet size/wide table cols=100 chunks=1 rows=1000 932404 932404 1.00
parquet size/wide table cols=100 chunks=50 rows=1000 932404 932404 1.00
parquet size/wide table cols=1000 chunks=1 rows=1000 9324004 9324004 1.00
parquet size/wide table cols=1000 chunks=50 rows=1000 9324004 9324004 1.00
parquet size/wide table cols=10000 chunks=1 rows=1000 93240004 93240004 1.00
parquet size/wide table cols=10000 chunks=50 rows=1000 93240004 93240004 1.00
parquet_rs-zstd compress time/Arade 3043643117 2894426532 1.05
parquet_rs-zstd compress time/Bimbo 16214160859 15003428803 1.08
parquet_rs-zstd compress time/CMSprovider 7458474698 7368598934 1.01
parquet_rs-zstd compress time/Euro2016 1384926911 1342795582 1.03
parquet_rs-zstd compress time/Food 913760541 875607570 1.04
parquet_rs-zstd compress time/HashTags 2496695487 2281496315 1.09
parquet_rs-zstd compress time/TPC-H l_comment canonical 3088288056 3126661596 0.99
parquet_rs-zstd compress time/TPC-H l_comment chunked 3104521711 3073816842 1.01
parquet_rs-zstd compress time/taxi 1412265743 1349130129 1.05
parquet_rs-zstd compress time/wide table cols=100 chunks=1 rows=1000 6805444 6687968 1.02
parquet_rs-zstd compress time/wide table cols=100 chunks=50 rows=1000 6823334 6523125 1.05
parquet_rs-zstd compress time/wide table cols=1000 chunks=1 rows=1000 85020573 80654192 1.05
parquet_rs-zstd compress time/wide table cols=1000 chunks=50 rows=1000 85264864 80327690 1.06
parquet_rs-zstd compress time/wide table cols=10000 chunks=1 rows=1000 904445757 843604276 1.07
parquet_rs-zstd compress time/wide table cols=10000 chunks=50 rows=1000 905345986 887045761 1.02
parquet_rs-zstd decompress time/Arade 593911873 640335893 0.93
parquet_rs-zstd decompress time/Bimbo 1640534305 1692360410 0.97
parquet_rs-zstd decompress time/CMSprovider 🚀 1699006534 1922072053 0.88
parquet_rs-zstd decompress time/Euro2016 368412090 383239465 0.96
parquet_rs-zstd decompress time/Food 197246190 216707006 0.91
parquet_rs-zstd decompress time/HashTags 666632040 623932281 1.07
parquet_rs-zstd decompress time/TPC-H l_comment canonical 547069220 555973178 0.98
parquet_rs-zstd decompress time/TPC-H l_comment chunked 550623160 558742164 0.99
parquet_rs-zstd decompress time/taxi 238161090 243143063 0.98
parquet_rs-zstd decompress time/wide table cols=100 chunks=1 rows=1000 2711672 2739792 0.99
parquet_rs-zstd decompress time/wide table cols=100 chunks=50 rows=1000 2672300 2721236 0.98
parquet_rs-zstd decompress time/wide table cols=1000 chunks=1 rows=1000 31085883 31587850 0.98
parquet_rs-zstd decompress time/wide table cols=1000 chunks=50 rows=1000 31484882 32334009 0.97
parquet_rs-zstd decompress time/wide table cols=10000 chunks=1 rows=1000 332779336 336710502 0.99
parquet_rs-zstd decompress time/wide table cols=10000 chunks=50 rows=1000 337562237 346429118 0.97
vortex-file-compressed size/Arade 145363796 145363796 1.00
vortex-file-compressed size/Bimbo 468763332 468763332 1.00
vortex-file-compressed size/CMSprovider 417907812 417907812 1.00
vortex-file-compressed size/Euro2016 163395292 163497796 1.00
vortex-file-compressed size/Food 41926936 41926936 1.00
vortex-file-compressed size/HashTags 195647828 195647828 1.00
vortex-file-compressed size/TPC-H l_comment canonical 179087360 179087360 1.00
vortex-file-compressed size/TPC-H l_comment chunked 179087360 179087360 1.00
vortex-file-compressed size/taxi 52363948 52363948 1.00
vortex-file-compressed size/wide table cols=100 chunks=1 rows=1000 930848 930848 1.00
vortex-file-compressed size/wide table cols=100 chunks=50 rows=1000 930848 930848 1.00
vortex-file-compressed size/wide table cols=1000 chunks=1 rows=1000 9293648 9293648 1.00
vortex-file-compressed size/wide table cols=1000 chunks=50 rows=1000 9293648 9293648 1.00
vortex-file-compressed size/wide table cols=10000 chunks=1 rows=1000 92957648 92957648 1.00
vortex-file-compressed size/wide table cols=10000 chunks=50 rows=1000 92957648 92957648 1.00
vortex:parquet-zstd ratio compress time/Arade 0 0 0.92
vortex:parquet-zstd ratio compress time/Bimbo 🚀 0 0 0.89
vortex:parquet-zstd ratio compress time/CMSprovider 0 0 0.94
vortex:parquet-zstd ratio compress time/Euro2016 0 0 0.98
vortex:parquet-zstd ratio compress time/Food 0 0 0.97
vortex:parquet-zstd ratio compress time/HashTags 0 0 0.96
vortex:parquet-zstd ratio compress time/TPC-H l_comment canonical 0 0 0.94
vortex:parquet-zstd ratio compress time/TPC-H l_comment chunked 0 0 0.98
vortex:parquet-zstd ratio compress time/taxi 0 0 0.94
vortex:parquet-zstd ratio compress time/wide table cols=100 chunks=1 rows=1000 1 1 0.94
vortex:parquet-zstd ratio compress time/wide table cols=100 chunks=50 rows=1000 1 1 1.02
vortex:parquet-zstd ratio compress time/wide table cols=1000 chunks=1 rows=1000 1 1 0.99
vortex:parquet-zstd ratio compress time/wide table cols=1000 chunks=50 rows=1000 1 1 0.95
vortex:parquet-zstd ratio compress time/wide table cols=10000 chunks=1 rows=1000 1 1 0.91
vortex:parquet-zstd ratio compress time/wide table cols=10000 chunks=50 rows=1000 1 1 0.98
vortex:parquet-zstd ratio decompress time/Arade 0 0 1.08
vortex:parquet-zstd ratio decompress time/Bimbo 0 0 1.01
vortex:parquet-zstd ratio decompress time/CMSprovider 🚨 0 0 1.20
vortex:parquet-zstd ratio decompress time/Euro2016 🚨 0 0 1.18
vortex:parquet-zstd ratio decompress time/Food 🚨 0 0 1.16
vortex:parquet-zstd ratio decompress time/HashTags 🚀 0 0 0.89
vortex:parquet-zstd ratio decompress time/TPC-H l_comment canonical 0 0 0.98
vortex:parquet-zstd ratio decompress time/TPC-H l_comment chunked 0 0 1.00
vortex:parquet-zstd ratio decompress time/taxi 0 0 0.93
vortex:parquet-zstd ratio decompress time/wide table cols=100 chunks=1 rows=1000 0 0 0.91
vortex:parquet-zstd ratio decompress time/wide table cols=100 chunks=50 rows=1000 0 0 1.02
vortex:parquet-zstd ratio decompress time/wide table cols=1000 chunks=1 rows=1000 0 0 0.97
vortex:parquet-zstd ratio decompress time/wide table cols=1000 chunks=50 rows=1000 0 0 0.93
vortex:parquet-zstd ratio decompress time/wide table cols=10000 chunks=1 rows=1000 0 0 0.95
vortex:parquet-zstd ratio decompress time/wide table cols=10000 chunks=50 rows=1000 0 0 0.94
vortex:parquet-zstd size/Arade 0 0 1.00
vortex:parquet-zstd size/Bimbo 1 1 1.00
vortex:parquet-zstd size/CMSprovider 1 1 1.00
vortex:parquet-zstd size/Euro2016 1 1 1.00
vortex:parquet-zstd size/Food 1 1 1.00
vortex:parquet-zstd size/HashTags 1 1 1.00
vortex:parquet-zstd size/TPC-H l_comment canonical 1 1 1.00
vortex:parquet-zstd size/TPC-H l_comment chunked 1 1 1.00
vortex:parquet-zstd size/taxi 0 0 1.00
vortex:parquet-zstd size/wide table cols=100 chunks=1 rows=1000 0 0 1.00
vortex:parquet-zstd size/wide table cols=100 chunks=50 rows=1000 0 0 1.00
vortex:parquet-zstd size/wide table cols=1000 chunks=1 rows=1000 0 0 1.00
vortex:parquet-zstd size/wide table cols=1000 chunks=50 rows=1000 0 0 1.00
vortex:parquet-zstd size/wide table cols=10000 chunks=1 rows=1000 0 0 1.00
vortex:parquet-zstd size/wide table cols=10000 chunks=50 rows=1000 0 0 1.00

@github-actions
Copy link
Copy Markdown
Contributor

Benchmarks: Random Access

Vortex (geomean): 0.907x ➖
Parquet (geomean): 0.989x ➖


unknown / unknown (0.942x ➖, 9↑ 0↓)
name PR d75de6d (ns) base deb7de0 (ns) ratio (PR/base)
random-access/feature-vectors/correlated/lance-tokio-local-disk 🚀 2079476 2967960 0.70
random-access/feature-vectors/correlated/lance-tokio-local-disk-footer 🚀 1237383 1399105 0.88
random-access/feature-vectors/correlated/parquet-tokio-local-disk 8261708873 8385242905 0.99
random-access/feature-vectors/correlated/parquet-tokio-local-disk-footer 8421227108 8440279863 1.00
random-access/feature-vectors/correlated/vortex-tokio-local-disk 7389135 7976757 0.93
random-access/feature-vectors/correlated/vortex-tokio-local-disk-footer 6971986 7612352 0.92
random-access/feature-vectors/uniform/lance-tokio-local-disk 5682113 5692018 1.00
random-access/feature-vectors/uniform/lance-tokio-local-disk-footer 6221561 6404058 0.97
random-access/feature-vectors/uniform/parquet-tokio-local-disk 8319293027 8439051354 0.99
random-access/feature-vectors/uniform/parquet-tokio-local-disk-footer 8255847816 8450040452 0.98
random-access/feature-vectors/uniform/vortex-tokio-local-disk 12763238 13597852 0.94
random-access/feature-vectors/uniform/vortex-tokio-local-disk-footer 12487152 13360770 0.93
random-access/lance-tokio-local-disk 701520 746889 0.94
random-access/lance-tokio-local-disk-footer 1183660 1242764 0.95
random-access/nested-lists/correlated/lance-tokio-local-disk 🚀 214580 248207 0.86
random-access/nested-lists/correlated/lance-tokio-local-disk-footer 589777 624490 0.94
random-access/nested-lists/correlated/parquet-tokio-local-disk 131920798 130899800 1.01
random-access/nested-lists/correlated/parquet-tokio-local-disk-footer 130431474 130608206 1.00
random-access/nested-lists/correlated/vortex-tokio-local-disk 🚀 552522 622370 0.89
random-access/nested-lists/correlated/vortex-tokio-local-disk-footer 567711 587420 0.97
random-access/nested-lists/uniform/lance-tokio-local-disk 1037598 1080723 0.96
random-access/nested-lists/uniform/lance-tokio-local-disk-footer 1423616 1470330 0.97
random-access/nested-lists/uniform/parquet-tokio-local-disk 130311764 130639342 1.00
random-access/nested-lists/uniform/parquet-tokio-local-disk-footer 130675301 132238290 0.99
random-access/nested-lists/uniform/vortex-tokio-local-disk 2027608 2136079 0.95
random-access/nested-lists/uniform/vortex-tokio-local-disk-footer 2015692 2135336 0.94
random-access/nested-structs/correlated/lance-tokio-local-disk 352760 390546 0.90
random-access/nested-structs/correlated/lance-tokio-local-disk-footer 528378 583859 0.90
random-access/nested-structs/correlated/parquet-tokio-local-disk 24962346 26569841 0.94
random-access/nested-structs/correlated/parquet-tokio-local-disk-footer 25322915 25990513 0.97
random-access/nested-structs/correlated/vortex-tokio-local-disk 706018 775339 0.91
random-access/nested-structs/correlated/vortex-tokio-local-disk-footer 707339 768123 0.92
random-access/nested-structs/uniform/lance-tokio-local-disk 2615618 2686334 0.97
random-access/nested-structs/uniform/lance-tokio-local-disk-footer 2820016 2903937 0.97
random-access/nested-structs/uniform/parquet-tokio-local-disk 25993258 26054044 1.00
random-access/nested-structs/uniform/parquet-tokio-local-disk-footer 26197059 26672849 0.98
random-access/nested-structs/uniform/vortex-tokio-local-disk 1585644 1649376 0.96
random-access/nested-structs/uniform/vortex-tokio-local-disk-footer 1585581 1616942 0.98
random-access/parquet-tokio-local-disk 176820124 178146446 0.99
random-access/parquet-tokio-local-disk-footer 177988873 178528711 1.00
random-access/taxi/correlated/lance-tokio-local-disk 886591 927460 0.96
random-access/taxi/correlated/lance-tokio-local-disk-footer 1473022 1545545 0.95
random-access/taxi/correlated/parquet-tokio-local-disk 265032569 268450401 0.99
random-access/taxi/correlated/parquet-tokio-local-disk-footer 266435221 268178630 0.99
random-access/taxi/correlated/vortex-tokio-local-disk 🚀 1469943 1862721 0.79
random-access/taxi/correlated/vortex-tokio-local-disk-footer 🚀 1635712 1882033 0.87
random-access/taxi/uniform/lance-tokio-local-disk 9465359 9675229 0.98
random-access/taxi/uniform/lance-tokio-local-disk-footer 10034982 10284935 0.98
random-access/taxi/uniform/parquet-tokio-local-disk 280255560 282933834 0.99
random-access/taxi/uniform/parquet-tokio-local-disk-footer 279243724 278464032 1.00
random-access/taxi/uniform/vortex-tokio-local-disk 4287828 4760781 0.90
random-access/taxi/uniform/vortex-tokio-local-disk-footer 🚀 4254978 4731980 0.90
random-access/vortex-tokio-local-disk 🚀 1088944 1311520 0.83
random-access/vortex-tokio-local-disk-footer 🚀 1114220 1336365 0.83

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

changelog/chore A trivial change

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants