Skip to content

Report column size stat for primitive columns in df#7636

Draft
AdamGS wants to merge 2 commits intodevelopfrom
adamg/primitive-col-byte-size
Draft

Report column size stat for primitive columns in df#7636
AdamGS wants to merge 2 commits intodevelopfrom
adamg/primitive-col-byte-size

Conversation

@AdamGS
Copy link
Copy Markdown
Contributor

@AdamGS AdamGS commented Apr 25, 2026

No description provided.

Signed-off-by: Adam Gutglick <adam@spiraldb.com>
@AdamGS AdamGS added changelog/performance A performance improvement ext/datafusion Relates to the DataFusion integration action/benchmark-sql Trigger SQL benchmarks to run on this PR labels Apr 25, 2026
@github-actions github-actions Bot removed the action/benchmark-sql Trigger SQL benchmarks to run on this PR label Apr 25, 2026
@github-actions
Copy link
Copy Markdown
Contributor

github-actions Bot commented Apr 25, 2026

Polar Signals Profiling Results

Latest Run

Status Commit Job Attempt Link
🟢 Done ca6942f 1 Explore Profiling Data
Previous Runs (1)
Status Commit Job Attempt Link
🟢 Done afe48ee 1 Explore Profiling Data

Powered by Polar Signals Cloud

@github-actions
Copy link
Copy Markdown
Contributor

github-actions Bot commented Apr 25, 2026

Benchmarks: PolarSignals Profiling

Vortex (geomean): 1.141x ❌


datafusion / vortex-file-compressed (1.141x ❌, 0↑ 8↓)
name PR ca6942f (ns) base 1838a7a (ns) ratio (PR/base)
polarsignals_q00/datafusion:vortex-file-compressed 136393734 125080602 1.09
polarsignals_q01/datafusion:vortex-file-compressed 289173742 283998375 1.02
polarsignals_q02/datafusion:vortex-file-compressed 🚨 25715511 22998797 1.12
polarsignals_q03/datafusion:vortex-file-compressed 🚨 304180295 269640578 1.13
polarsignals_q04/datafusion:vortex-file-compressed 🚨 13869291 11439022 1.21
polarsignals_q05/datafusion:vortex-file-compressed 🚨 19611645 14802491 1.32
polarsignals_q06/datafusion:vortex-file-compressed 🚨 21000250 18216020 1.15
polarsignals_q07/datafusion:vortex-file-compressed 🚨 15878453 14135448 1.12
polarsignals_q08/datafusion:vortex-file-compressed 🚨 415732103 355179792 1.17
polarsignals_q09/datafusion:vortex-file-compressed 🚨 11989216 10892754 1.10

@github-actions
Copy link
Copy Markdown
Contributor

File Sizes: PolarSignals Profiling

No file size changes detected.

@github-actions
Copy link
Copy Markdown
Contributor

github-actions Bot commented Apr 25, 2026

Benchmarks: FineWeb NVMe

Verdict: No clear signal (low confidence)
Attributed Vortex impact: -1.2%
Vortex (geomean): 0.997x ➖
Parquet (geomean): 1.009x ➖
Shifts: Parquet (control) +0.9% · Median polish +0.4%


datafusion / vortex-file-compressed (1.039x ➖, 0↑ 2↓)
name PR ca6942f (ns) base 1838a7a (ns) ratio (PR/base)
fineweb_q00/datafusion:vortex-file-compressed 5304849 4968232 1.07
fineweb_q01/datafusion:vortex-file-compressed 21090534 21367164 0.99
fineweb_q02/datafusion:vortex-file-compressed 🚨 23598647 20878041 1.13
fineweb_q03/datafusion:vortex-file-compressed 🚨 89622976 79484567 1.13
fineweb_q04/datafusion:vortex-file-compressed 230789461 231375859 1.00
fineweb_q05/datafusion:vortex-file-compressed 215235089 211896980 1.02
fineweb_q06/datafusion:vortex-file-compressed 51667472 52994097 0.97
fineweb_q07/datafusion:vortex-file-compressed 59321837 59844582 0.99
fineweb_q08/datafusion:vortex-file-compressed 22129106 20628434 1.07
datafusion / vortex-compact (1.024x ➖, 1↑ 1↓)
name PR ca6942f (ns) base 1838a7a (ns) ratio (PR/base)
fineweb_q00/datafusion:vortex-compact 🚨 7120943 5479883 1.30
fineweb_q01/datafusion:vortex-compact 126867817 124677592 1.02
fineweb_q02/datafusion:vortex-compact 131310866 128470093 1.02
fineweb_q03/datafusion:vortex-compact 1130283881 1030391269 1.10
fineweb_q04/datafusion:vortex-compact 1101496857 1097812662 1.00
fineweb_q05/datafusion:vortex-compact 941703058 939813965 1.00
fineweb_q06/datafusion:vortex-compact 530464475 520579068 1.02
fineweb_q07/datafusion:vortex-compact 542423789 558443690 0.97
fineweb_q08/datafusion:vortex-compact 🚀 18956744 22677524 0.84
datafusion / parquet (1.021x ➖, 0↑ 1↓)
name PR ca6942f (ns) base 1838a7a (ns) ratio (PR/base)
fineweb_q00/datafusion:parquet 🚨 7064849 6294935 1.12
fineweb_q01/datafusion:parquet 281689278 279594076 1.01
fineweb_q02/datafusion:parquet 285513572 287295390 0.99
fineweb_q03/datafusion:parquet 286115353 280540424 1.02
fineweb_q04/datafusion:parquet 303280125 292801901 1.04
fineweb_q05/datafusion:parquet 299958666 292146768 1.03
fineweb_q06/datafusion:parquet 287450668 299789707 0.96
fineweb_q07/datafusion:parquet 282817008 276596639 1.02
fineweb_q08/datafusion:parquet 279030684 276994407 1.01
duckdb / vortex-file-compressed (0.980x ➖, 1↑ 0↓)
name PR ca6942f (ns) base 1838a7a (ns) ratio (PR/base)
fineweb_q00/duckdb:vortex-file-compressed 3015471 3029138 1.00
fineweb_q01/duckdb:vortex-file-compressed 21370865 22280857 0.96
fineweb_q02/duckdb:vortex-file-compressed 22885620 24109163 0.95
fineweb_q03/duckdb:vortex-file-compressed 🚀 117945002 136781567 0.86
fineweb_q04/duckdb:vortex-file-compressed 223651313 223991687 1.00
fineweb_q05/duckdb:vortex-file-compressed 214122288 210015427 1.02
fineweb_q06/duckdb:vortex-file-compressed 51422767 51612165 1.00
fineweb_q07/duckdb:vortex-file-compressed 56262943 54151556 1.04
fineweb_q08/duckdb:vortex-file-compressed 22262667 22054641 1.01
duckdb / vortex-compact (0.948x ➖, 2↑ 0↓)
name PR ca6942f (ns) base 1838a7a (ns) ratio (PR/base)
fineweb_q00/duckdb:vortex-compact 3756670 3987430 0.94
fineweb_q01/duckdb:vortex-compact 🚀 90053611 110047695 0.82
fineweb_q02/duckdb:vortex-compact 110390623 113891498 0.97
fineweb_q03/duckdb:vortex-compact 852056840 848656047 1.00
fineweb_q04/duckdb:vortex-compact 895019735 898760888 1.00
fineweb_q05/duckdb:vortex-compact 797655694 805087639 0.99
fineweb_q06/duckdb:vortex-compact 460686382 454544352 1.01
fineweb_q07/duckdb:vortex-compact 470646287 471410228 1.00
fineweb_q08/duckdb:vortex-compact 🚀 19440777 23490683 0.83
duckdb / parquet (0.998x ➖, 0↑ 0↓)
name PR ca6942f (ns) base 1838a7a (ns) ratio (PR/base)
fineweb_q00/duckdb:parquet 30128621 31370742 0.96
fineweb_q01/duckdb:parquet 82925413 82103587 1.01
fineweb_q02/duckdb:parquet 84309192 83099009 1.01
fineweb_q03/duckdb:parquet 309194946 307209571 1.01
fineweb_q04/duckdb:parquet 436958576 437866323 1.00
fineweb_q05/duckdb:parquet 408858869 408647895 1.00
fineweb_q06/duckdb:parquet 197021792 198920738 0.99
fineweb_q07/duckdb:parquet 207893311 208083979 1.00
fineweb_q08/duckdb:parquet 28067514 28012521 1.00
Full attributed analysis
Query Config Raw Δ Control Δ Attributed α Noise floor Significant?
0 datafusion:vortex-compact +29.9% +3.8% +25.2% +81.7% ➖ noise
0 datafusion:vortex-file-compressed +6.8% +3.8% +2.8% +49.0% ➖ noise
0 duckdb:vortex-compact -5.8% +3.8% -9.3% +104.4% ➖ noise
0 duckdb:vortex-file-compressed -0.5% +3.8% -4.1% +96.2% ➖ noise
1 datafusion:vortex-compact +1.8% +0.9% +0.9% +10.2% ➖ noise
1 datafusion:vortex-file-compressed -1.3% +0.9% -2.2% +36.1% ➖ noise
1 duckdb:vortex-compact -18.2% +0.9% -18.9% +23.3% ✅ faster
1 duckdb:vortex-file-compressed -4.1% +0.9% -4.9% +60.5% ➖ noise
2 datafusion:vortex-compact +2.2% +0.4% +1.8% +10.0% ➖ noise
2 datafusion:vortex-file-compressed +13.0% +0.4% +12.6% +13.4% ➖ noise
2 duckdb:vortex-compact -3.1% +0.4% -3.5% +14.1% ➖ noise
2 duckdb:vortex-file-compressed -5.1% +0.4% -5.5% +10.0% ➖ noise
3 datafusion:vortex-compact +9.7% +1.3% +8.3% +10.0% ➖ noise
3 datafusion:vortex-file-compressed +12.8% +1.3% +11.3% +51.7% ➖ noise
3 duckdb:vortex-compact +0.4% +1.3% -0.9% +10.0% ➖ noise
3 duckdb:vortex-file-compressed -13.8% +1.3% -14.9% +31.6% ➖ noise
4 datafusion:vortex-compact +0.3% +1.7% -1.3% +10.0% ➖ noise
4 datafusion:vortex-file-compressed -0.3% +1.7% -1.9% +10.0% ➖ noise
4 duckdb:vortex-compact -0.4% +1.7% -2.1% +10.0% ➖ noise
4 duckdb:vortex-file-compressed -0.2% +1.7% -1.8% +10.0% ➖ noise
5 datafusion:vortex-compact +0.2% +1.4% -1.1% +10.0% ➖ noise
5 datafusion:vortex-file-compressed +1.6% +1.4% +0.2% +10.0% ➖ noise
5 duckdb:vortex-compact -0.9% +1.4% -2.2% +10.0% ➖ noise
5 duckdb:vortex-file-compressed +2.0% +1.4% +0.6% +10.0% ➖ noise
6 datafusion:vortex-compact +1.9% -2.5% +4.6% +10.0% ➖ noise
6 datafusion:vortex-file-compressed -2.5% -2.5% +0.0% +10.0% ➖ noise
6 duckdb:vortex-compact +1.4% -2.5% +4.0% +10.0% ➖ noise
6 duckdb:vortex-file-compressed -0.4% -2.5% +2.2% +10.0% ➖ noise
7 datafusion:vortex-compact -2.9% +1.1% -3.9% +10.0% ➖ noise
7 datafusion:vortex-file-compressed -0.9% +1.1% -1.9% +32.7% ➖ noise
7 duckdb:vortex-compact -0.2% +1.1% -1.2% +10.0% ➖ noise
7 duckdb:vortex-file-compressed +3.9% +1.1% +2.8% +15.3% ➖ noise
8 datafusion:vortex-compact -16.4% +0.5% -16.8% +33.6% ➖ noise
8 datafusion:vortex-file-compressed +7.3% +0.5% +6.8% +16.7% ➖ noise
8 duckdb:vortex-compact -17.2% +0.5% -17.6% +17.6% ✅ faster
8 duckdb:vortex-file-compressed +0.9% +0.5% +0.5% +10.0% ➖ noise

@github-actions
Copy link
Copy Markdown
Contributor

File Sizes: FineWeb NVMe

No file size changes detected.

@github-actions
Copy link
Copy Markdown
Contributor

github-actions Bot commented Apr 25, 2026

Benchmarks: TPC-H SF=1 on NVME

Verdict: No clear signal (low confidence)
Attributed Vortex impact: +5.5%
Vortex (geomean): 1.079x ➖
Parquet (geomean): 1.036x ➖
Shifts: Parquet (control) +3.6% · Median polish +5.5%


datafusion / vortex-file-compressed (1.094x ➖, 0↑ 7↓)
name PR ca6942f (ns) base 1838a7a (ns) ratio (PR/base)
tpch_q01/datafusion:vortex-file-compressed 50956280 48192985 1.06
tpch_q02/datafusion:vortex-file-compressed 22561275 22534340 1.00
tpch_q03/datafusion:vortex-file-compressed 27983308 28671691 0.98
tpch_q04/datafusion:vortex-file-compressed 21199454 20928729 1.01
tpch_q05/datafusion:vortex-file-compressed 47919667 47472378 1.01
tpch_q06/datafusion:vortex-file-compressed 12888778 12836130 1.00
tpch_q07/datafusion:vortex-file-compressed 55436713 55605769 1.00
tpch_q08/datafusion:vortex-file-compressed 40092955 39057992 1.03
tpch_q09/datafusion:vortex-file-compressed 51814094 51701747 1.00
tpch_q10/datafusion:vortex-file-compressed 42209551 39775120 1.06
tpch_q11/datafusion:vortex-file-compressed 🚨 18207430 15685820 1.16
tpch_q12/datafusion:vortex-file-compressed 28274624 25790422 1.10
tpch_q13/datafusion:vortex-file-compressed 24673441 24971676 0.99
tpch_q14/datafusion:vortex-file-compressed 🚨 22858481 16504919 1.38
tpch_q15/datafusion:vortex-file-compressed 🚨 31087283 26824744 1.16
tpch_q16/datafusion:vortex-file-compressed 19355055 19193094 1.01
tpch_q17/datafusion:vortex-file-compressed 🚨 83437876 67503104 1.24
tpch_q18/datafusion:vortex-file-compressed 🚨 107059298 78992912 1.36
tpch_q19/datafusion:vortex-file-compressed 24737238 22685140 1.09
tpch_q20/datafusion:vortex-file-compressed 🚨 41355748 30345259 1.36
tpch_q21/datafusion:vortex-file-compressed 🚨 86038399 71185970 1.21
tpch_q22/datafusion:vortex-file-compressed 12726723 12475716 1.02
datafusion / vortex-compact (1.043x ➖, 0↑ 3↓)
name PR ca6942f (ns) base 1838a7a (ns) ratio (PR/base)
tpch_q01/datafusion:vortex-compact 🚨 66792117 57653273 1.16
tpch_q02/datafusion:vortex-compact 🚨 31958723 25701650 1.24
tpch_q03/datafusion:vortex-compact 33405949 30583570 1.09
tpch_q04/datafusion:vortex-compact 24903943 24397572 1.02
tpch_q05/datafusion:vortex-compact 🚨 60049957 52214977 1.15
tpch_q06/datafusion:vortex-compact 15468373 14826474 1.04
tpch_q07/datafusion:vortex-compact 60042839 60376276 0.99
tpch_q08/datafusion:vortex-compact 44425467 44960292 0.99
tpch_q09/datafusion:vortex-compact 57618460 56928388 1.01
tpch_q10/datafusion:vortex-compact 47920665 47183374 1.02
tpch_q11/datafusion:vortex-compact 16804136 16370717 1.03
tpch_q12/datafusion:vortex-compact 34044581 33772261 1.01
tpch_q13/datafusion:vortex-compact 32733826 32594275 1.00
tpch_q14/datafusion:vortex-compact 20963899 20433812 1.03
tpch_q15/datafusion:vortex-compact 33549079 32940755 1.02
tpch_q16/datafusion:vortex-compact 23189672 22141601 1.05
tpch_q17/datafusion:vortex-compact 71840829 69197702 1.04
tpch_q18/datafusion:vortex-compact 87427262 83969602 1.04
tpch_q19/datafusion:vortex-compact 32076016 31288548 1.03
tpch_q20/datafusion:vortex-compact 36249680 34957948 1.04
tpch_q21/datafusion:vortex-compact 78864947 80020555 0.99
tpch_q22/datafusion:vortex-compact 12619695 12659815 1.00
datafusion / parquet (1.007x ➖, 0↑ 0↓)
name PR ca6942f (ns) base 1838a7a (ns) ratio (PR/base)
tpch_q01/datafusion:parquet 123584259 134211858 0.92
tpch_q02/datafusion:parquet 63796083 62750376 1.02
tpch_q03/datafusion:parquet 70696078 65247399 1.08
tpch_q04/datafusion:parquet 45259758 44980969 1.01
tpch_q05/datafusion:parquet 94911397 93592971 1.01
tpch_q06/datafusion:parquet 40271145 43260351 0.93
tpch_q07/datafusion:parquet 107987777 105229863 1.03
tpch_q08/datafusion:parquet 99039576 100605889 0.98
tpch_q09/datafusion:parquet 129938191 126099864 1.03
tpch_q10/datafusion:parquet 114618372 115213914 0.99
tpch_q11/datafusion:parquet 42483460 41966007 1.01
tpch_q12/datafusion:parquet 91641015 88952337 1.03
tpch_q13/datafusion:parquet 190695739 189809896 1.00
tpch_q14/datafusion:parquet 48097394 46976189 1.02
tpch_q15/datafusion:parquet 62797960 58963172 1.07
tpch_q16/datafusion:parquet 44822699 43011284 1.04
tpch_q17/datafusion:parquet 130779564 129978310 1.01
tpch_q18/datafusion:parquet 165307954 159849468 1.03
tpch_q19/datafusion:parquet 82660773 83388463 0.99
tpch_q20/datafusion:parquet 69751529 69881569 1.00
tpch_q21/datafusion:parquet 135157986 138788599 0.97
tpch_q22/datafusion:parquet 30686338 31443015 0.98
datafusion / arrow (1.190x ❌, 0↑ 12↓)
name PR ca6942f (ns) base 1838a7a (ns) ratio (PR/base)
tpch_q01/datafusion:arrow 🚨 73769364 54262189 1.36
tpch_q02/datafusion:arrow 🚨 21885269 18845081 1.16
tpch_q03/datafusion:arrow 🚨 45256262 29359704 1.54
tpch_q04/datafusion:arrow 🚨 36526344 24620335 1.48
tpch_q05/datafusion:arrow 🚨 108578626 74156556 1.46
tpch_q06/datafusion:arrow 🚨 29998921 19217401 1.56
tpch_q07/datafusion:arrow 🚨 132828428 98258306 1.35
tpch_q08/datafusion:arrow 🚨 67373335 41187506 1.64
tpch_q09/datafusion:arrow 🚨 86657872 64781803 1.34
tpch_q10/datafusion:arrow 🚨 60330663 48736403 1.24
tpch_q11/datafusion:arrow 🚨 10238604 9003453 1.14
tpch_q12/datafusion:arrow 🚨 62847689 51690654 1.22
tpch_q13/datafusion:arrow 50373066 48143169 1.05
tpch_q14/datafusion:arrow 21472682 21295104 1.01
tpch_q15/datafusion:arrow 42023905 43107055 0.97
tpch_q16/datafusion:arrow 18439161 18938168 0.97
tpch_q17/datafusion:arrow 66343815 68502959 0.97
tpch_q18/datafusion:arrow 132573279 132223357 1.00
tpch_q19/datafusion:arrow 36084354 36148116 1.00
tpch_q20/datafusion:arrow 36019330 33459462 1.08
tpch_q21/datafusion:arrow 151334589 145766162 1.04
tpch_q22/datafusion:arrow 17834731 17487365 1.02
duckdb / vortex-file-compressed (1.085x ➖, 0↑ 5↓)
name PR ca6942f (ns) base 1838a7a (ns) ratio (PR/base)
tpch_q01/duckdb:vortex-file-compressed 31193404 31320325 1.00
tpch_q02/duckdb:vortex-file-compressed 🚨 27564988 24422710 1.13
tpch_q03/duckdb:vortex-file-compressed 29866078 29258810 1.02
tpch_q04/duckdb:vortex-file-compressed 29938927 29185271 1.03
tpch_q05/duckdb:vortex-file-compressed 🚨 40369019 32576739 1.24
tpch_q06/duckdb:vortex-file-compressed 11064655 10574258 1.05
tpch_q07/duckdb:vortex-file-compressed 39474319 36346925 1.09
tpch_q08/duckdb:vortex-file-compressed 39423572 38478908 1.02
tpch_q09/duckdb:vortex-file-compressed 77174929 71417324 1.08
tpch_q10/duckdb:vortex-file-compressed 36927428 34585228 1.07
tpch_q11/duckdb:vortex-file-compressed 15163148 14111485 1.07
tpch_q12/duckdb:vortex-file-compressed 22606613 22453408 1.01
tpch_q13/duckdb:vortex-file-compressed 36584047 34168478 1.07
tpch_q14/duckdb:vortex-file-compressed 21137858 22063923 0.96
tpch_q15/duckdb:vortex-file-compressed 17619937 16203109 1.09
tpch_q16/duckdb:vortex-file-compressed 29022496 28517656 1.02
tpch_q17/duckdb:vortex-file-compressed 24421825 24557007 0.99
tpch_q18/duckdb:vortex-file-compressed 50714639 48790293 1.04
tpch_q19/duckdb:vortex-file-compressed 🚨 39872887 28766832 1.39
tpch_q20/duckdb:vortex-file-compressed 34812497 33984003 1.02
tpch_q21/duckdb:vortex-file-compressed 🚨 125301655 106875554 1.17
tpch_q22/duckdb:vortex-file-compressed 🚨 24854986 16932258 1.47
duckdb / vortex-compact (1.095x ➖, 0↑ 8↓)
name PR ca6942f (ns) base 1838a7a (ns) ratio (PR/base)
tpch_q01/duckdb:vortex-compact 38776261 38797050 1.00
tpch_q02/duckdb:vortex-compact 🚨 43113856 35170507 1.23
tpch_q03/duckdb:vortex-compact 32367784 32150425 1.01
tpch_q04/duckdb:vortex-compact 34049512 34095763 1.00
tpch_q05/duckdb:vortex-compact 🚨 49153508 37204895 1.32
tpch_q06/duckdb:vortex-compact 14438716 15007226 0.96
tpch_q07/duckdb:vortex-compact 🚨 53949874 41625343 1.30
tpch_q08/duckdb:vortex-compact 47074456 44034200 1.07
tpch_q09/duckdb:vortex-compact 90013892 83094224 1.08
tpch_q10/duckdb:vortex-compact 40344100 38563229 1.05
tpch_q11/duckdb:vortex-compact 20042485 18655671 1.07
tpch_q12/duckdb:vortex-compact 🚨 42302583 34650521 1.22
tpch_q13/duckdb:vortex-compact 44355282 44342347 1.00
tpch_q14/duckdb:vortex-compact 🚨 36600419 29513395 1.24
tpch_q15/duckdb:vortex-compact 20119372 19697905 1.02
tpch_q16/duckdb:vortex-compact 35084218 34812882 1.01
tpch_q17/duckdb:vortex-compact 🚨 35339613 30347376 1.16
tpch_q18/duckdb:vortex-compact 53183988 49561666 1.07
tpch_q19/duckdb:vortex-compact 34376360 34253790 1.00
tpch_q20/duckdb:vortex-compact 🚨 49122562 41089917 1.20
tpch_q21/duckdb:vortex-compact 116741118 111165251 1.05
tpch_q22/duckdb:vortex-compact 🚨 22067779 19263677 1.15
duckdb / parquet (1.065x ➖, 1↑ 6↓)
name PR ca6942f (ns) base 1838a7a (ns) ratio (PR/base)
tpch_q01/duckdb:parquet 79160238 76217450 1.04
tpch_q02/duckdb:parquet 40413555 38913535 1.04
tpch_q03/duckdb:parquet 71661863 69860065 1.03
tpch_q04/duckdb:parquet 49690239 46615666 1.07
tpch_q05/duckdb:parquet 69242192 65877921 1.05
tpch_q06/duckdb:parquet 🚨 26555796 20305609 1.31
tpch_q07/duckdb:parquet 70290981 73696110 0.95
tpch_q08/duckdb:parquet 88098534 80119720 1.10
tpch_q09/duckdb:parquet 🚨 164632867 140218962 1.17
tpch_q10/duckdb:parquet 121415831 114940109 1.06
tpch_q11/duckdb:parquet 23181699 22328720 1.04
tpch_q12/duckdb:parquet 47223889 44928824 1.05
tpch_q13/duckdb:parquet 266510974 246763799 1.08
tpch_q14/duckdb:parquet 🚨 57492697 48828269 1.18
tpch_q15/duckdb:parquet 🚀 24284018 30227458 0.80
tpch_q16/duckdb:parquet 60637008 55851903 1.09
tpch_q17/duckdb:parquet 50971823 52515407 0.97
tpch_q18/duckdb:parquet 119857975 113996969 1.05
tpch_q19/duckdb:parquet 🚨 71806333 63931441 1.12
tpch_q20/duckdb:parquet 🚨 71154412 62897670 1.13
tpch_q21/duckdb:parquet 🚨 180395488 155224631 1.16
tpch_q22/duckdb:parquet 53984911 51796297 1.04
duckdb / duckdb (1.054x ➖, 0↑ 5↓)
name PR ca6942f (ns) base 1838a7a (ns) ratio (PR/base)
tpch_q01/duckdb:duckdb 17202670 15828108 1.09
tpch_q02/duckdb:duckdb 12507372 12627937 0.99
tpch_q03/duckdb:duckdb 19452951 19204742 1.01
tpch_q04/duckdb:duckdb 19535863 18582534 1.05
tpch_q05/duckdb:duckdb 🚨 23529612 20281236 1.16
tpch_q06/duckdb:duckdb 5344163 5343366 1.00
tpch_q07/duckdb:duckdb 21973242 21723815 1.01
tpch_q08/duckdb:duckdb 21505721 20507487 1.05
tpch_q09/duckdb:duckdb 🚨 63837096 54987054 1.16
tpch_q10/duckdb:duckdb 43089695 44064942 0.98
tpch_q11/duckdb:duckdb 5953022 5819125 1.02
tpch_q12/duckdb:duckdb 15193008 13822262 1.10
tpch_q13/duckdb:duckdb 39930782 36407077 1.10
tpch_q14/duckdb:duckdb 🚨 19142552 16422457 1.17
tpch_q15/duckdb:duckdb 11849201 11805574 1.00
tpch_q16/duckdb:duckdb 24684171 23816473 1.04
tpch_q17/duckdb:duckdb 🚨 15795154 14073437 1.12
tpch_q18/duckdb:duckdb 39345793 39058271 1.01
tpch_q19/duckdb:duckdb 28175958 27467151 1.03
tpch_q20/duckdb:duckdb 🚨 24682735 22343954 1.10
tpch_q21/duckdb:duckdb 58535591 56293680 1.04
tpch_q22/duckdb:duckdb 24365779 24351109 1.00
Full attributed analysis
Query Config Raw Δ Control Δ Attributed α Noise floor Significant?
1 datafusion:arrow +35.9% -2.2% +39.0% +16.0% 🚨 regression
1 datafusion:vortex-compact +15.9% -2.2% +18.5% +15.9% 🚨 regression
1 datafusion:vortex-file-compressed +5.7% -2.2% +8.1% +16.6% ➖ noise
1 duckdb:duckdb +8.7% -2.2% +11.1% +14.5% ➖ noise
1 duckdb:vortex-compact -0.1% -2.2% +2.2% +15.4% ➖ noise
1 duckdb:vortex-file-compressed -0.4% -2.2% +1.8% +18.7% ➖ noise
2 datafusion:arrow +16.1% +2.8% +13.0% +11.5% 🚨 regression
2 datafusion:vortex-compact +24.3% +2.8% +21.0% +13.1% 🚨 regression
2 datafusion:vortex-file-compressed +0.1% +2.8% -2.6% +11.1% ➖ noise
2 duckdb:duckdb -1.0% +2.8% -3.6% +11.1% ➖ noise
2 duckdb:vortex-compact +22.6% +2.8% +19.3% +11.3% 🚨 regression
2 duckdb:vortex-file-compressed +12.9% +2.8% +9.8% +13.2% ➖ noise
3 datafusion:arrow +54.1% +5.4% +46.2% +11.1% 🚨 regression
3 datafusion:vortex-compact +9.2% +5.4% +3.6% +11.1% ➖ noise
3 datafusion:vortex-file-compressed -2.4% +5.4% -7.4% +11.1% ➖ noise
3 duckdb:duckdb +1.3% +5.4% -3.9% +11.1% ➖ noise
3 duckdb:vortex-compact +0.7% +5.4% -4.5% +16.6% ➖ noise
3 duckdb:vortex-file-compressed +2.1% +5.4% -3.2% +22.4% ➖ noise
4 datafusion:arrow +48.4% +3.6% +43.3% +11.1% 🚨 regression
4 datafusion:vortex-compact +2.1% +3.6% -1.4% +11.1% ➖ noise
4 datafusion:vortex-file-compressed +1.3% +3.6% -2.2% +11.1% ➖ noise
4 duckdb:duckdb +5.1% +3.6% +1.5% +11.1% ➖ noise
4 duckdb:vortex-compact -0.1% +3.6% -3.6% +11.1% ➖ noise
4 duckdb:vortex-file-compressed +2.6% +3.6% -0.9% +11.1% ➖ noise
5 datafusion:arrow +46.4% +3.2% +41.8% +11.1% 🚨 regression
5 datafusion:vortex-compact +15.0% +3.2% +11.4% +15.4% ➖ noise
5 datafusion:vortex-file-compressed +0.9% +3.2% -2.2% +11.1% ➖ noise
5 duckdb:duckdb +16.0% +3.2% +12.4% +11.1% 🚨 regression
5 duckdb:vortex-compact +32.1% +3.2% +28.0% +20.5% 🚨 regression
5 duckdb:vortex-file-compressed +23.9% +3.2% +20.0% +19.5% 🚨 regression
6 datafusion:arrow +56.1% +10.3% +41.5% +14.4% 🚨 regression
6 datafusion:vortex-compact +4.3% +10.3% -5.4% +15.5% ➖ noise
6 datafusion:vortex-file-compressed +0.4% +10.3% -9.0% +15.2% ➖ noise
6 duckdb:duckdb +0.0% +10.3% -9.4% +17.0% ➖ noise
6 duckdb:vortex-compact -3.8% +10.3% -12.8% +18.0% ➖ noise
6 duckdb:vortex-file-compressed +4.6% +10.3% -5.2% +16.2% ➖ noise
7 datafusion:arrow +35.2% -1.1% +36.6% +11.7% 🚨 regression
7 datafusion:vortex-compact -0.6% -1.1% +0.5% +11.1% ➖ noise
7 datafusion:vortex-file-compressed -0.3% -1.1% +0.8% +11.1% ➖ noise
7 duckdb:duckdb +1.1% -1.1% +2.2% +11.1% ➖ noise
7 duckdb:vortex-compact +29.6% -1.1% +31.0% +15.2% 🚨 regression
7 duckdb:vortex-file-compressed +8.6% -1.1% +9.8% +11.1% ➖ noise
8 datafusion:arrow +63.6% +4.0% +57.2% +11.1% 🚨 regression
8 datafusion:vortex-compact -1.2% +4.0% -5.0% +11.1% ➖ noise
8 datafusion:vortex-file-compressed +2.6% +4.0% -1.3% +11.1% ➖ noise
8 duckdb:duckdb +4.9% +4.0% +0.8% +11.1% ➖ noise
8 duckdb:vortex-compact +6.9% +4.0% +2.8% +11.1% ➖ noise
8 duckdb:vortex-file-compressed +2.5% +4.0% -1.5% +11.1% ➖ noise
9 datafusion:arrow +33.8% +10.0% +21.6% +15.9% 🚨 regression
9 datafusion:vortex-compact +1.2% +10.0% -8.0% +11.1% ➖ noise
9 datafusion:vortex-file-compressed +0.2% +10.0% -8.9% +11.1% ➖ noise
9 duckdb:duckdb +16.1% +10.0% +5.5% +13.0% ➖ noise
9 duckdb:vortex-compact +8.3% +10.0% -1.5% +18.2% ➖ noise
9 duckdb:vortex-file-compressed +8.1% +10.0% -1.8% +11.1% ➖ noise
10 datafusion:arrow +23.8% +2.5% +20.8% +13.0% 🚨 regression
10 datafusion:vortex-compact +1.6% +2.5% -0.9% +11.1% ➖ noise
10 datafusion:vortex-file-compressed +6.1% +2.5% +3.5% +11.6% ➖ noise
10 duckdb:duckdb -2.2% +2.5% -4.6% +12.9% ➖ noise
10 duckdb:vortex-compact +4.6% +2.5% +2.1% +11.1% ➖ noise
10 duckdb:vortex-file-compressed +6.8% +2.5% +4.2% +11.6% ➖ noise
11 datafusion:arrow +13.7% +2.5% +10.9% +11.1% ➖ noise
11 datafusion:vortex-compact +2.6% +2.5% +0.1% +11.1% ➖ noise
11 datafusion:vortex-file-compressed +16.1% +2.5% +13.2% +11.1% 🚨 regression
11 duckdb:duckdb +2.3% +2.5% -0.2% +12.0% ➖ noise
11 duckdb:vortex-compact +7.4% +2.5% +4.8% +11.1% ➖ noise
11 duckdb:vortex-file-compressed +7.5% +2.5% +4.8% +11.1% ➖ noise
12 datafusion:arrow +21.6% +4.1% +16.8% +18.2% ➖ noise
12 datafusion:vortex-compact +0.8% +4.1% -3.1% +11.1% ➖ noise
12 datafusion:vortex-file-compressed +9.6% +4.1% +5.4% +11.1% ➖ noise
12 duckdb:duckdb +9.9% +4.1% +5.6% +11.1% ➖ noise
12 duckdb:vortex-compact +22.1% +4.1% +17.3% +12.2% 🚨 regression
12 duckdb:vortex-file-compressed +0.7% +4.1% -3.2% +11.1% ➖ noise
13 datafusion:arrow +4.6% +4.2% +0.4% +11.1% ➖ noise
13 datafusion:vortex-compact +0.4% +4.2% -3.6% +11.1% ➖ noise
13 datafusion:vortex-file-compressed -1.2% +4.2% -5.1% +11.1% ➖ noise
13 duckdb:duckdb +9.7% +4.2% +5.3% +11.4% ➖ noise
13 duckdb:vortex-compact +0.0% +4.2% -4.0% +11.1% ➖ noise
13 duckdb:vortex-file-compressed +7.1% +4.2% +2.8% +11.1% ➖ noise
14 datafusion:arrow +0.8% +9.8% -8.2% +13.3% ➖ noise
14 datafusion:vortex-compact +2.6% +9.8% -6.6% +11.1% ➖ noise
14 datafusion:vortex-file-compressed +38.5% +9.8% +26.1% +14.2% 🚨 regression
14 duckdb:duckdb +16.6% +9.8% +6.2% +20.9% ➖ noise
14 duckdb:vortex-compact +24.0% +9.8% +12.9% +15.5% ➖ noise
14 duckdb:vortex-file-compressed -4.2% +9.8% -12.7% +14.6% ✅ faster
15 datafusion:arrow -2.5% -7.5% +5.4% +11.1% ➖ noise
15 datafusion:vortex-compact +1.8% -7.5% +10.1% +13.7% ➖ noise
15 datafusion:vortex-file-compressed +15.9% -7.5% +25.3% +14.6% 🚨 regression
15 duckdb:duckdb +0.4% -7.5% +8.5% +12.6% ➖ noise
15 duckdb:vortex-compact +2.1% -7.5% +10.4% +24.8% ➖ noise
15 duckdb:vortex-file-compressed +8.7% -7.5% +17.6% +15.0% 🚨 regression
16 datafusion:arrow -2.6% +6.4% -8.5% +11.1% ➖ noise
16 datafusion:vortex-compact +4.7% +6.4% -1.5% +11.1% ➖ noise
16 datafusion:vortex-file-compressed +0.8% +6.4% -5.2% +11.1% ➖ noise
16 duckdb:duckdb +3.6% +6.4% -2.6% +11.1% ➖ noise
16 duckdb:vortex-compact +0.8% +6.4% -5.3% +11.1% ➖ noise
16 duckdb:vortex-file-compressed +1.8% +6.4% -4.3% +11.1% ➖ noise
17 datafusion:arrow -3.2% -1.2% -2.0% +11.1% ➖ noise
17 datafusion:vortex-compact +3.8% -1.2% +5.1% +13.2% ➖ noise
17 datafusion:vortex-file-compressed +23.6% -1.2% +25.1% +15.7% 🚨 regression
17 duckdb:duckdb +12.2% -1.2% +13.6% +11.1% 🚨 regression
17 duckdb:vortex-compact +16.5% -1.2% +17.8% +17.3% 🚨 regression
17 duckdb:vortex-file-compressed -0.6% -1.2% +0.6% +11.3% ➖ noise
18 datafusion:arrow +0.3% +4.3% -3.8% +11.1% ➖ noise
18 datafusion:vortex-compact +4.1% +4.3% -0.2% +11.1% ➖ noise
18 datafusion:vortex-file-compressed +35.5% +4.3% +30.0% +13.4% 🚨 regression
18 duckdb:duckdb +0.7% +4.3% -3.4% +11.1% ➖ noise
18 duckdb:vortex-compact +7.3% +4.3% +2.9% +11.1% ➖ noise
18 duckdb:vortex-file-compressed +3.9% +4.3% -0.3% +11.1% ➖ noise
19 datafusion:arrow -0.2% +5.5% -5.4% +14.0% ➖ noise
19 datafusion:vortex-compact +2.5% +5.5% -2.8% +12.1% ➖ noise
19 datafusion:vortex-file-compressed +9.0% +5.5% +3.3% +12.9% ➖ noise
19 duckdb:duckdb +2.6% +5.5% -2.8% +15.2% ➖ noise
19 duckdb:vortex-compact +0.4% +5.5% -4.9% +13.6% ➖ noise
19 duckdb:vortex-file-compressed +38.6% +5.5% +31.4% +18.1% 🚨 regression
20 datafusion:arrow +7.7% +6.3% +1.3% +11.4% ➖ noise
20 datafusion:vortex-compact +3.7% +6.3% -2.4% +11.1% ➖ noise
20 datafusion:vortex-file-compressed +36.3% +6.3% +28.3% +11.4% 🚨 regression
20 duckdb:duckdb +10.5% +6.3% +4.0% +11.1% ➖ noise
20 duckdb:vortex-compact +19.5% +6.3% +12.5% +14.6% ➖ noise
20 duckdb:vortex-file-compressed +2.4% +6.3% -3.6% +11.1% ➖ noise
21 datafusion:arrow +3.8% +6.4% -2.4% +11.1% ➖ noise
21 datafusion:vortex-compact -1.4% +6.4% -7.4% +11.1% ➖ noise
21 datafusion:vortex-file-compressed +20.9% +6.4% +13.6% +14.1% ➖ noise
21 duckdb:duckdb +4.0% +6.4% -2.3% +11.1% ➖ noise
21 duckdb:vortex-compact +5.0% +6.4% -1.3% +11.1% ➖ noise
21 duckdb:vortex-file-compressed +17.2% +6.4% +10.2% +20.1% ➖ noise
22 datafusion:arrow +2.0% +0.9% +1.1% +11.1% ➖ noise
22 datafusion:vortex-compact -0.3% +0.9% -1.2% +11.1% ➖ noise
22 datafusion:vortex-file-compressed +2.0% +0.9% +1.1% +11.1% ➖ noise
22 duckdb:duckdb +0.1% +0.9% -0.8% +11.1% ➖ noise
22 duckdb:vortex-compact +14.6% +0.9% +13.6% +11.1% 🚨 regression
22 duckdb:vortex-file-compressed +46.8% +0.9% +45.5% +11.1% 🚨 regression

@github-actions
Copy link
Copy Markdown
Contributor

github-actions Bot commented Apr 25, 2026

File Sizes: TPC-H SF=1 on NVME

File Size Changes (195 files changed, -98.4% overall, 0↑ 195↓)
File Scale Format Base HEAD Change %
orders_14.vortex 100 vortex-file-compressed 180.18 MB 0 B 180.18 MB -100.0%
lineitem_72.vortex 100 vortex-file-compressed 147.99 MB 0 B 147.99 MB -100.0%
part_12.vortex 100 vortex-file-compressed 28.43 MB 0 B 28.43 MB -100.0%
lineitem_92.vortex 100 vortex-file-compressed 148.08 MB 0 B 148.08 MB -100.0%
part_0.vortex 100 vortex-file-compressed 28.45 MB 0 B 28.45 MB -100.0%
lineitem_119.vortex 100 vortex-file-compressed 148.33 MB 0 B 148.33 MB -100.0%
partsupp_16.vortex 100 vortex-file-compressed 191.25 MB 0 B 191.25 MB -100.0%
partsupp_10.vortex 100 vortex-file-compressed 191.59 MB 0 B 191.59 MB -100.0%
lineitem_77.vortex 100 vortex-file-compressed 148.24 MB 0 B 148.24 MB -100.0%
orders_3.vortex 100 vortex-file-compressed 180.12 MB 0 B 180.12 MB -100.0%
lineitem_81.vortex 100 vortex-file-compressed 147.75 MB 0 B 147.75 MB -100.0%
lineitem_111.vortex 100 vortex-file-compressed 147.77 MB 0 B 147.77 MB -100.0%
lineitem_47.vortex 100 vortex-file-compressed 148.26 MB 0 B 148.26 MB -100.0%
part_18.vortex 100 vortex-file-compressed 28.51 MB 0 B 28.51 MB -100.0%
lineitem_2.vortex 100 vortex-file-compressed 148.59 MB 0 B 148.59 MB -100.0%
orders_19.vortex 100 vortex-file-compressed 180.04 MB 0 B 180.04 MB -100.0%
lineitem_12.vortex 100 vortex-file-compressed 148.19 MB 0 B 148.19 MB -100.0%
customer_3.vortex 100 vortex-file-compressed 261.80 MB 0 B 261.80 MB -100.0%
lineitem_43.vortex 100 vortex-file-compressed 147.84 MB 0 B 147.84 MB -100.0%
lineitem_52.vortex 100 vortex-file-compressed 146.97 MB 0 B 146.97 MB -100.0%
lineitem_97.vortex 100 vortex-file-compressed 148.10 MB 0 B 148.10 MB -100.0%
part_4.vortex 100 vortex-file-compressed 28.42 MB 0 B 28.42 MB -100.0%
lineitem_54.vortex 100 vortex-file-compressed 149.12 MB 0 B 149.12 MB -100.0%
orders_16.vortex 100 vortex-file-compressed 179.88 MB 0 B 179.88 MB -100.0%
lineitem_41.vortex 100 vortex-file-compressed 146.66 MB 0 B 146.66 MB -100.0%
lineitem_76.vortex 100 vortex-file-compressed 147.35 MB 0 B 147.35 MB -100.0%
orders_11.vortex 100 vortex-file-compressed 180.08 MB 0 B 180.08 MB -100.0%
lineitem_88.vortex 100 vortex-file-compressed 148.71 MB 0 B 148.71 MB -100.0%
lineitem_17.vortex 100 vortex-file-compressed 148.59 MB 0 B 148.59 MB -100.0%
orders_4.vortex 100 vortex-file-compressed 180.39 MB 0 B 180.39 MB -100.0%
lineitem_105.vortex 100 vortex-file-compressed 147.47 MB 0 B 147.47 MB -100.0%
lineitem_0.vortex 100 vortex-file-compressed 148.68 MB 0 B 148.68 MB -100.0%
lineitem_9.vortex 100 vortex-file-compressed 148.87 MB 0 B 148.87 MB -100.0%
lineitem_87.vortex 100 vortex-file-compressed 147.46 MB 0 B 147.46 MB -100.0%
lineitem_70.vortex 100 vortex-file-compressed 147.89 MB 0 B 147.89 MB -100.0%
lineitem_58.vortex 100 vortex-file-compressed 148.72 MB 0 B 148.72 MB -100.0%
orders_13.vortex 100 vortex-file-compressed 179.83 MB 0 B 179.83 MB -100.0%
lineitem_26.vortex 100 vortex-file-compressed 148.11 MB 0 B 148.11 MB -100.0%
lineitem_24.vortex 100 vortex-file-compressed 147.50 MB 0 B 147.50 MB -100.0%
partsupp_6.vortex 100 vortex-file-compressed 191.38 MB 0 B 191.38 MB -100.0%
part_9.vortex 100 vortex-file-compressed 28.41 MB 0 B 28.41 MB -100.0%
partsupp_17.vortex 100 vortex-file-compressed 191.49 MB 0 B 191.49 MB -100.0%
lineitem_19.vortex 100 vortex-file-compressed 148.77 MB 0 B 148.77 MB -100.0%
lineitem_66.vortex 100 vortex-file-compressed 148.09 MB 0 B 148.09 MB -100.0%
partsupp_7.vortex 100 vortex-file-compressed 191.61 MB 0 B 191.61 MB -100.0%
lineitem_65.vortex 100 vortex-file-compressed 147.57 MB 0 B 147.57 MB -100.0%
part_14.vortex 100 vortex-file-compressed 28.46 MB 0 B 28.46 MB -100.0%
lineitem_11.vortex 100 vortex-file-compressed 148.62 MB 0 B 148.62 MB -100.0%
lineitem_101.vortex 100 vortex-file-compressed 148.35 MB 0 B 148.35 MB -100.0%
partsupp_4.vortex 100 vortex-file-compressed 191.40 MB 0 B 191.40 MB -100.0%
lineitem_32.vortex 100 vortex-file-compressed 148.90 MB 0 B 148.90 MB -100.0%
lineitem_8.vortex 100 vortex-file-compressed 148.56 MB 0 B 148.56 MB -100.0%
lineitem_79.vortex 100 vortex-file-compressed 148.43 MB 0 B 148.43 MB -100.0%
lineitem_38.vortex 100 vortex-file-compressed 149.09 MB 0 B 149.09 MB -100.0%
customer_2.vortex 100 vortex-file-compressed 261.69 MB 0 B 261.69 MB -100.0%
part_6.vortex 100 vortex-file-compressed 28.44 MB 0 B 28.44 MB -100.0%
lineitem_110.vortex 100 vortex-file-compressed 148.41 MB 0 B 148.41 MB -100.0%
part_13.vortex 100 vortex-file-compressed 28.44 MB 0 B 28.44 MB -100.0%
lineitem_100.vortex 100 vortex-file-compressed 148.11 MB 0 B 148.11 MB -100.0%
lineitem_106.vortex 100 vortex-file-compressed 148.07 MB 0 B 148.07 MB -100.0%
lineitem_60.vortex 100 vortex-file-compressed 148.62 MB 0 B 148.62 MB -100.0%
lineitem_15.vortex 100 vortex-file-compressed 147.63 MB 0 B 147.63 MB -100.0%
lineitem_61.vortex 100 vortex-file-compressed 147.73 MB 0 B 147.73 MB -100.0%
lineitem_96.vortex 100 vortex-file-compressed 148.03 MB 0 B 148.03 MB -100.0%
orders_0.vortex 100 vortex-file-compressed 180.00 MB 0 B 180.00 MB -100.0%
lineitem_25.vortex 100 vortex-file-compressed 148.52 MB 0 B 148.52 MB -100.0%
lineitem_83.vortex 100 vortex-file-compressed 148.68 MB 0 B 148.68 MB -100.0%
lineitem_78.vortex 100 vortex-file-compressed 147.35 MB 0 B 147.35 MB -100.0%
lineitem_90.vortex 100 vortex-file-compressed 147.82 MB 0 B 147.82 MB -100.0%
partsupp_14.vortex 100 vortex-file-compressed 191.62 MB 0 B 191.62 MB -100.0%
lineitem_28.vortex 100 vortex-file-compressed 148.66 MB 0 B 148.66 MB -100.0%
lineitem_94.vortex 100 vortex-file-compressed 148.40 MB 0 B 148.40 MB -100.0%
orders_22.vortex 100 vortex-file-compressed 180.04 MB 0 B 180.04 MB -100.0%
orders_12.vortex 100 vortex-file-compressed 180.32 MB 0 B 180.32 MB -100.0%
partsupp_0.vortex 100 vortex-file-compressed 191.37 MB 0 B 191.37 MB -100.0%
part_11.vortex 100 vortex-file-compressed 28.45 MB 0 B 28.45 MB -100.0%
duckdb.db 100 vortex-file-compressed 268.00 KB 0 B 268.00 KB -100.0%
lineitem_30.vortex 100 vortex-file-compressed 147.46 MB 0 B 147.46 MB -100.0%
part_10.vortex 100 vortex-file-compressed 28.43 MB 0 B 28.43 MB -100.0%
partsupp_2.vortex 100 vortex-file-compressed 191.39 MB 0 B 191.39 MB -100.0%
orders_24.vortex 100 vortex-file-compressed 179.56 MB 0 B 179.56 MB -100.0%
lineitem_35.vortex 100 vortex-file-compressed 148.35 MB 0 B 148.35 MB -100.0%
lineitem_86.vortex 100 vortex-file-compressed 147.62 MB 0 B 147.62 MB -100.0%
lineitem_13.vortex 100 vortex-file-compressed 148.26 MB 0 B 148.26 MB -100.0%
lineitem_112.vortex 100 vortex-file-compressed 147.42 MB 0 B 147.42 MB -100.0%
orders_15.vortex 100 vortex-file-compressed 180.19 MB 0 B 180.19 MB -100.0%
orders_27.vortex 100 vortex-file-compressed 179.78 MB 0 B 179.78 MB -100.0%
partsupp_11.vortex 100 vortex-file-compressed 191.43 MB 0 B 191.43 MB -100.0%
lineitem_80.vortex 100 vortex-file-compressed 147.55 MB 0 B 147.55 MB -100.0%
customer_1.vortex 100 vortex-file-compressed 261.77 MB 0 B 261.77 MB -100.0%
lineitem_40.vortex 100 vortex-file-compressed 147.97 MB 0 B 147.97 MB -100.0%
lineitem_55.vortex 100 vortex-file-compressed 148.16 MB 0 B 148.16 MB -100.0%
lineitem_63.vortex 100 vortex-file-compressed 148.65 MB 0 B 148.65 MB -100.0%
lineitem_99.vortex 100 vortex-file-compressed 147.26 MB 0 B 147.26 MB -100.0%
lineitem_108.vortex 100 vortex-file-compressed 147.29 MB 0 B 147.29 MB -100.0%
lineitem_46.vortex 100 vortex-file-compressed 147.77 MB 0 B 147.77 MB -100.0%
orders_21.vortex 100 vortex-file-compressed 179.89 MB 0 B 179.89 MB -100.0%
orders_25.vortex 100 vortex-file-compressed 179.82 MB 0 B 179.82 MB -100.0%
partsupp_9.vortex 100 vortex-file-compressed 191.50 MB 0 B 191.50 MB -100.0%
lineitem_29.vortex 100 vortex-file-compressed 148.75 MB 0 B 148.75 MB -100.0%
lineitem_73.vortex 100 vortex-file-compressed 148.32 MB 0 B 148.32 MB -100.0%
lineitem_16.vortex 100 vortex-file-compressed 148.03 MB 0 B 148.03 MB -100.0%
part_8.vortex 100 vortex-file-compressed 28.43 MB 0 B 28.43 MB -100.0%
lineitem_59.vortex 100 vortex-file-compressed 148.42 MB 0 B 148.42 MB -100.0%
lineitem_114.vortex 100 vortex-file-compressed 147.46 MB 0 B 147.46 MB -100.0%
lineitem_51.vortex 100 vortex-file-compressed 148.42 MB 0 B 148.42 MB -100.0%
lineitem_44.vortex 100 vortex-file-compressed 147.91 MB 0 B 147.91 MB -100.0%
lineitem_104.vortex 100 vortex-file-compressed 148.59 MB 0 B 148.59 MB -100.0%
orders_2.vortex 100 vortex-file-compressed 180.35 MB 0 B 180.35 MB -100.0%
lineitem_102.vortex 100 vortex-file-compressed 148.14 MB 0 B 148.14 MB -100.0%
orders_6.vortex 100 vortex-file-compressed 179.80 MB 0 B 179.80 MB -100.0%
part_2.vortex 100 vortex-file-compressed 28.46 MB 0 B 28.46 MB -100.0%
partsupp_12.vortex 100 vortex-file-compressed 191.50 MB 0 B 191.50 MB -100.0%
part_1.vortex 100 vortex-file-compressed 28.49 MB 0 B 28.49 MB -100.0%
lineitem_49.vortex 100 vortex-file-compressed 148.47 MB 0 B 148.47 MB -100.0%
lineitem_107.vortex 100 vortex-file-compressed 148.04 MB 0 B 148.04 MB -100.0%
part_16.vortex 100 vortex-file-compressed 28.42 MB 0 B 28.42 MB -100.0%
part_5.vortex 100 vortex-file-compressed 28.38 MB 0 B 28.38 MB -100.0%
lineitem_4.vortex 100 vortex-file-compressed 147.27 MB 0 B 147.27 MB -100.0%
lineitem_117.vortex 100 vortex-file-compressed 148.24 MB 0 B 148.24 MB -100.0%
lineitem_48.vortex 100 vortex-file-compressed 148.23 MB 0 B 148.23 MB -100.0%
lineitem_115.vortex 100 vortex-file-compressed 147.64 MB 0 B 147.64 MB -100.0%
orders_26.vortex 100 vortex-file-compressed 179.99 MB 0 B 179.99 MB -100.0%
orders_23.vortex 100 vortex-file-compressed 179.94 MB 0 B 179.94 MB -100.0%
partsupp_13.vortex 100 vortex-file-compressed 191.35 MB 0 B 191.35 MB -100.0%
lineitem_53.vortex 100 vortex-file-compressed 148.23 MB 0 B 148.23 MB -100.0%
lineitem_67.vortex 100 vortex-file-compressed 148.84 MB 0 B 148.84 MB -100.0%
partsupp_3.vortex 100 vortex-file-compressed 191.37 MB 0 B 191.37 MB -100.0%
lineitem_89.vortex 100 vortex-file-compressed 148.03 MB 0 B 148.03 MB -100.0%
lineitem_23.vortex 100 vortex-file-compressed 148.19 MB 0 B 148.19 MB -100.0%
lineitem_93.vortex 100 vortex-file-compressed 147.77 MB 0 B 147.77 MB -100.0%
lineitem_116.vortex 100 vortex-file-compressed 148.20 MB 0 B 148.20 MB -100.0%
orders_7.vortex 100 vortex-file-compressed 180.12 MB 0 B 180.12 MB -100.0%
lineitem_84.vortex 100 vortex-file-compressed 147.94 MB 0 B 147.94 MB -100.0%
lineitem_36.vortex 100 vortex-file-compressed 147.64 MB 0 B 147.64 MB -100.0%
lineitem_18.vortex 100 vortex-file-compressed 147.55 MB 0 B 147.55 MB -100.0%
lineitem_21.vortex 100 vortex-file-compressed 148.33 MB 0 B 148.33 MB -100.0%
lineitem_22.vortex 100 vortex-file-compressed 147.32 MB 0 B 147.32 MB -100.0%
lineitem_3.vortex 100 vortex-file-compressed 148.16 MB 0 B 148.16 MB -100.0%
lineitem_68.vortex 100 vortex-file-compressed 148.03 MB 0 B 148.03 MB -100.0%
orders_10.vortex 100 vortex-file-compressed 180.14 MB 0 B 180.14 MB -100.0%
lineitem_39.vortex 100 vortex-file-compressed 147.38 MB 0 B 147.38 MB -100.0%
lineitem_37.vortex 100 vortex-file-compressed 147.47 MB 0 B 147.47 MB -100.0%
orders_18.vortex 100 vortex-file-compressed 180.45 MB 0 B 180.45 MB -100.0%
part_15.vortex 100 vortex-file-compressed 28.48 MB 0 B 28.48 MB -100.0%
lineitem_14.vortex 100 vortex-file-compressed 147.79 MB 0 B 147.79 MB -100.0%
lineitem_10.vortex 100 vortex-file-compressed 148.35 MB 0 B 148.35 MB -100.0%
orders_1.vortex 100 vortex-file-compressed 179.92 MB 0 B 179.92 MB -100.0%
orders_9.vortex 100 vortex-file-compressed 180.11 MB 0 B 180.11 MB -100.0%
region_0.vortex 100 vortex-file-compressed 6.13 KB 0 B 6.13 KB -100.0%
part_17.vortex 100 vortex-file-compressed 28.41 MB 0 B 28.41 MB -100.0%
lineitem_98.vortex 100 vortex-file-compressed 148.59 MB 0 B 148.59 MB -100.0%
partsupp_18.vortex 100 vortex-file-compressed 191.38 MB 0 B 191.38 MB -100.0%
partsupp_15.vortex 100 vortex-file-compressed 191.52 MB 0 B 191.52 MB -100.0%
lineitem_120.vortex 100 vortex-file-compressed 147.10 MB 0 B 147.10 MB -100.0%
lineitem_33.vortex 100 vortex-file-compressed 147.74 MB 0 B 147.74 MB -100.0%
supplier_0.vortex 100 vortex-file-compressed 66.71 MB 0 B 66.71 MB -100.0%
lineitem_113.vortex 100 vortex-file-compressed 147.56 MB 0 B 147.56 MB -100.0%
lineitem_50.vortex 100 vortex-file-compressed 148.88 MB 0 B 148.88 MB -100.0%
lineitem_56.vortex 100 vortex-file-compressed 147.73 MB 0 B 147.73 MB -100.0%
orders_17.vortex 100 vortex-file-compressed 180.01 MB 0 B 180.01 MB -100.0%
orders_8.vortex 100 vortex-file-compressed 180.21 MB 0 B 180.21 MB -100.0%
lineitem_1.vortex 100 vortex-file-compressed 148.56 MB 0 B 148.56 MB -100.0%
part_3.vortex 100 vortex-file-compressed 28.43 MB 0 B 28.43 MB -100.0%
lineitem_31.vortex 100 vortex-file-compressed 148.50 MB 0 B 148.50 MB -100.0%
orders_20.vortex 100 vortex-file-compressed 179.85 MB 0 B 179.85 MB -100.0%
lineitem_69.vortex 100 vortex-file-compressed 148.10 MB 0 B 148.10 MB -100.0%
lineitem_109.vortex 100 vortex-file-compressed 148.03 MB 0 B 148.03 MB -100.0%
lineitem_95.vortex 100 vortex-file-compressed 147.49 MB 0 B 147.49 MB -100.0%
lineitem_118.vortex 100 vortex-file-compressed 147.83 MB 0 B 147.83 MB -100.0%
lineitem_6.vortex 100 vortex-file-compressed 147.90 MB 0 B 147.90 MB -100.0%
partsupp_8.vortex 100 vortex-file-compressed 191.49 MB 0 B 191.49 MB -100.0%
lineitem_34.vortex 100 vortex-file-compressed 148.93 MB 0 B 148.93 MB -100.0%
lineitem_42.vortex 100 vortex-file-compressed 148.38 MB 0 B 148.38 MB -100.0%
lineitem_71.vortex 100 vortex-file-compressed 147.94 MB 0 B 147.94 MB -100.0%
partsupp_5.vortex 100 vortex-file-compressed 191.41 MB 0 B 191.41 MB -100.0%
orders_5.vortex 100 vortex-file-compressed 180.03 MB 0 B 180.03 MB -100.0%
lineitem_82.vortex 100 vortex-file-compressed 148.37 MB 0 B 148.37 MB -100.0%
nation_0.vortex 100 vortex-file-compressed 10.97 KB 0 B 10.97 KB -100.0%
customer_0.vortex 100 vortex-file-compressed 261.80 MB 0 B 261.80 MB -100.0%
lineitem_5.vortex 100 vortex-file-compressed 148.16 MB 0 B 148.16 MB -100.0%
lineitem_7.vortex 100 vortex-file-compressed 147.86 MB 0 B 147.86 MB -100.0%
lineitem_75.vortex 100 vortex-file-compressed 147.88 MB 0 B 147.88 MB -100.0%
lineitem_91.vortex 100 vortex-file-compressed 148.27 MB 0 B 148.27 MB -100.0%
lineitem_74.vortex 100 vortex-file-compressed 147.55 MB 0 B 147.55 MB -100.0%
lineitem_45.vortex 100 vortex-file-compressed 146.88 MB 0 B 146.88 MB -100.0%
lineitem_20.vortex 100 vortex-file-compressed 148.78 MB 0 B 148.78 MB -100.0%
lineitem_85.vortex 100 vortex-file-compressed 147.92 MB 0 B 147.92 MB -100.0%
lineitem_64.vortex 100 vortex-file-compressed 147.72 MB 0 B 147.72 MB -100.0%
partsupp_1.vortex 100 vortex-file-compressed 191.69 MB 0 B 191.69 MB -100.0%
lineitem_103.vortex 100 vortex-file-compressed 148.37 MB 0 B 148.37 MB -100.0%
part_7.vortex 100 vortex-file-compressed 28.41 MB 0 B 28.41 MB -100.0%
lineitem_27.vortex 100 vortex-file-compressed 148.45 MB 0 B 148.45 MB -100.0%
lineitem_57.vortex 100 vortex-file-compressed 148.37 MB 0 B 148.37 MB -100.0%
lineitem_62.vortex 100 vortex-file-compressed 146.94 MB 0 B 146.94 MB -100.0%

Totals:

  • vortex-compact: 194.82 MB → 194.82 MB (0.0%)
  • vortex-file-compressed: 27.85 GB → 266.60 MB (-99.1%)

@github-actions
Copy link
Copy Markdown
Contributor

github-actions Bot commented Apr 25, 2026

Benchmarks: TPC-DS SF=1 on NVME

Verdict: No clear signal (low confidence)
Attributed Vortex impact: +2.7%
Vortex (geomean): 1.065x ➖
Parquet (geomean): 1.036x ➖
Shifts: Parquet (control) +3.6% · Median polish +4.4%


datafusion / vortex-file-compressed (1.085x ➖, 0↑ 36↓)
name PR ca6942f (ns) base 1838a7a (ns) ratio (PR/base)
tpcds_q01/datafusion:vortex-file-compressed 26148519 25139990 1.04
tpcds_q02/datafusion:vortex-file-compressed 49969971 48551260 1.03
tpcds_q03/datafusion:vortex-file-compressed 17086236 15777772 1.08
tpcds_q04/datafusion:vortex-file-compressed 271522922 252608069 1.07
tpcds_q05/datafusion:vortex-file-compressed 🚨 47659355 41597026 1.15
tpcds_q06/datafusion:vortex-file-compressed 59799483 59196857 1.01
tpcds_q07/datafusion:vortex-file-compressed 46448375 42483304 1.09
tpcds_q08/datafusion:vortex-file-compressed 30983584 29207432 1.06
tpcds_q09/datafusion:vortex-file-compressed 48430368 44965651 1.08
tpcds_q10/datafusion:vortex-file-compressed 🚨 41961221 37558623 1.12
tpcds_q11/datafusion:vortex-file-compressed 138481052 130155908 1.06
tpcds_q12/datafusion:vortex-file-compressed 20616490 18927911 1.09
tpcds_q13/datafusion:vortex-file-compressed 47094493 43084697 1.09
tpcds_q14/datafusion:vortex-file-compressed 185239053 170941331 1.08
tpcds_q15/datafusion:vortex-file-compressed 🚨 30430199 27093912 1.12
tpcds_q16/datafusion:vortex-file-compressed 29984671 28310775 1.06
tpcds_q17/datafusion:vortex-file-compressed 66683193 61953678 1.08
tpcds_q18/datafusion:vortex-file-compressed 72374797 66399434 1.09
tpcds_q19/datafusion:vortex-file-compressed 🚨 23744891 21154665 1.12
tpcds_q20/datafusion:vortex-file-compressed 22002443 21465695 1.03
tpcds_q21/datafusion:vortex-file-compressed 36207931 36248205 1.00
tpcds_q22/datafusion:vortex-file-compressed 🚨 156493792 112089178 1.40
tpcds_q23/datafusion:vortex-file-compressed 161944504 156037713 1.04
tpcds_q24/datafusion:vortex-file-compressed 87116623 81585796 1.07
tpcds_q25/datafusion:vortex-file-compressed 70737405 64747921 1.09
tpcds_q26/datafusion:vortex-file-compressed 🚨 36915782 33134628 1.11
tpcds_q27/datafusion:vortex-file-compressed 🚨 114127500 101162531 1.13
tpcds_q28/datafusion:vortex-file-compressed 41728743 40692329 1.03
tpcds_q29/datafusion:vortex-file-compressed 65886804 63153701 1.04
tpcds_q30/datafusion:vortex-file-compressed 🚨 24831754 22543741 1.10
tpcds_q31/datafusion:vortex-file-compressed 🚨 79636405 71927024 1.11
tpcds_q32/datafusion:vortex-file-compressed 22208388 20192764 1.10
tpcds_q33/datafusion:vortex-file-compressed 32084531 29359101 1.09
tpcds_q34/datafusion:vortex-file-compressed 26412793 24299220 1.09
tpcds_q35/datafusion:vortex-file-compressed 48068399 44868162 1.07
tpcds_q36/datafusion:vortex-file-compressed 57549102 56750720 1.01
tpcds_q37/datafusion:vortex-file-compressed 🚨 28565285 24779917 1.15
tpcds_q38/datafusion:vortex-file-compressed 🚨 48629579 43047165 1.13
tpcds_q39/datafusion:vortex-file-compressed 🚨 117919615 104358000 1.13
tpcds_q40/datafusion:vortex-file-compressed 35030845 32130668 1.09
tpcds_q41/datafusion:vortex-file-compressed 🚨 17673092 15337261 1.15
tpcds_q42/datafusion:vortex-file-compressed 🚨 15558451 13947049 1.12
tpcds_q43/datafusion:vortex-file-compressed 19225752 18505515 1.04
tpcds_q44/datafusion:vortex-file-compressed 32275592 32927578 0.98
tpcds_q45/datafusion:vortex-file-compressed 26473523 26433496 1.00
tpcds_q46/datafusion:vortex-file-compressed 35191300 34282586 1.03
tpcds_q47/datafusion:vortex-file-compressed 🚨 142674409 129037611 1.11
tpcds_q48/datafusion:vortex-file-compressed 40652441 37548962 1.08
tpcds_q49/datafusion:vortex-file-compressed 62340135 56885706 1.10
tpcds_q50/datafusion:vortex-file-compressed 42277973 38558496 1.10
tpcds_q51/datafusion:vortex-file-compressed 89665719 90609130 0.99
tpcds_q52/datafusion:vortex-file-compressed 15504105 14342554 1.08
tpcds_q53/datafusion:vortex-file-compressed 22538189 20708206 1.09
tpcds_q54/datafusion:vortex-file-compressed 🚨 37263539 33668565 1.11
tpcds_q55/datafusion:vortex-file-compressed 🚨 15726152 13516362 1.16
tpcds_q56/datafusion:vortex-file-compressed 🚨 32411989 28784598 1.13
tpcds_q57/datafusion:vortex-file-compressed 110554689 106860150 1.03
tpcds_q58/datafusion:vortex-file-compressed 53797654 51781194 1.04
tpcds_q59/datafusion:vortex-file-compressed 60734893 57112597 1.06
tpcds_q60/datafusion:vortex-file-compressed 32220922 29824892 1.08
tpcds_q61/datafusion:vortex-file-compressed 🚨 44997243 40248990 1.12
tpcds_q62/datafusion:vortex-file-compressed 🚨 28891133 21410536 1.35
tpcds_q63/datafusion:vortex-file-compressed 🚨 22742547 20612731 1.10
tpcds_q64/datafusion:vortex-file-compressed 437457088 404406092 1.08
tpcds_q65/datafusion:vortex-file-compressed 42308351 39175106 1.08
tpcds_q66/datafusion:vortex-file-compressed 🚨 77968300 70131548 1.11
tpcds_q67/datafusion:vortex-file-compressed 155545996 148245955 1.05
tpcds_q68/datafusion:vortex-file-compressed 34269792 36124486 0.95
tpcds_q69/datafusion:vortex-file-compressed 39027863 36076724 1.08
tpcds_q70/datafusion:vortex-file-compressed 🚨 91608411 81589901 1.12
tpcds_q71/datafusion:vortex-file-compressed 24923873 23144895 1.08
tpcds_q72/datafusion:vortex-file-compressed 🚨 2310901303 2083905349 1.11
tpcds_q73/datafusion:vortex-file-compressed 24934184 22792767 1.09
tpcds_q74/datafusion:vortex-file-compressed 84565769 79504363 1.06
tpcds_q75/datafusion:vortex-file-compressed 113759160 107413784 1.06
tpcds_q76/datafusion:vortex-file-compressed 26074209 23736456 1.10
tpcds_q77/datafusion:vortex-file-compressed 🚨 42472399 38610963 1.10
tpcds_q78/datafusion:vortex-file-compressed 🚨 133808920 120092675 1.11
tpcds_q79/datafusion:vortex-file-compressed 🚨 31332175 27525954 1.14
tpcds_q80/datafusion:vortex-file-compressed 🚨 103801996 92817020 1.12
tpcds_q81/datafusion:vortex-file-compressed 🚨 27118602 23729448 1.14
tpcds_q82/datafusion:vortex-file-compressed 🚨 29274282 26078427 1.12
tpcds_q83/datafusion:vortex-file-compressed 35926711 33872734 1.06
tpcds_q84/datafusion:vortex-file-compressed 🚨 14422957 12501835 1.15
tpcds_q85/datafusion:vortex-file-compressed 🚨 100500479 88699856 1.13
tpcds_q86/datafusion:vortex-file-compressed 🚨 18247471 15377967 1.19
tpcds_q87/datafusion:vortex-file-compressed 43983974 43730807 1.01
tpcds_q88/datafusion:vortex-file-compressed 60348906 55954036 1.08
tpcds_q89/datafusion:vortex-file-compressed 26562507 24245085 1.10
tpcds_q90/datafusion:vortex-file-compressed 15773105 14953116 1.05
tpcds_q91/datafusion:vortex-file-compressed 🚨 20923582 17840869 1.17
tpcds_q92/datafusion:vortex-file-compressed 🚨 21505319 18036963 1.19
tpcds_q93/datafusion:vortex-file-compressed 🚨 37426485 32240215 1.16
tpcds_q94/datafusion:vortex-file-compressed 25768873 26365124 0.98
tpcds_q95/datafusion:vortex-file-compressed 64671920 61376822 1.05
tpcds_q96/datafusion:vortex-file-compressed 14139736 13244245 1.07
tpcds_q97/datafusion:vortex-file-compressed 32536005 32055002 1.02
tpcds_q98/datafusion:vortex-file-compressed 23812763 23968403 0.99
tpcds_q99/datafusion:vortex-file-compressed 30008988 31895885 0.94
datafusion / vortex-compact (1.036x ➖, 0↑ 3↓)
name PR ca6942f (ns) base 1838a7a (ns) ratio (PR/base)
tpcds_q01/datafusion:vortex-compact 26710002 26257856 1.02
tpcds_q02/datafusion:vortex-compact 56778011 53793604 1.06
tpcds_q03/datafusion:vortex-compact 20555579 19236269 1.07
tpcds_q04/datafusion:vortex-compact 308386587 291387565 1.06
tpcds_q05/datafusion:vortex-compact 🚨 54253378 48155090 1.13
tpcds_q06/datafusion:vortex-compact 61259787 63298995 0.97
tpcds_q07/datafusion:vortex-compact 55780340 52109379 1.07
tpcds_q08/datafusion:vortex-compact 36689141 35106860 1.05
tpcds_q09/datafusion:vortex-compact 64444006 61698916 1.04
tpcds_q10/datafusion:vortex-compact 52449833 48790638 1.07
tpcds_q11/datafusion:vortex-compact 158657907 152053770 1.04
tpcds_q12/datafusion:vortex-compact 24329753 23930236 1.02
tpcds_q13/datafusion:vortex-compact 94033919 90760022 1.04
tpcds_q14/datafusion:vortex-compact 215921877 198241058 1.09
tpcds_q15/datafusion:vortex-compact 29732888 29590329 1.00
tpcds_q16/datafusion:vortex-compact 34927623 34341092 1.02
tpcds_q17/datafusion:vortex-compact 76299855 72649759 1.05
tpcds_q18/datafusion:vortex-compact 82066281 75669073 1.08
tpcds_q19/datafusion:vortex-compact 32531354 30038520 1.08
tpcds_q20/datafusion:vortex-compact 26962003 25087738 1.07
tpcds_q21/datafusion:vortex-compact 🚨 43830060 39093453 1.12
tpcds_q22/datafusion:vortex-compact 128877204 119032978 1.08
tpcds_q23/datafusion:vortex-compact 172884307 162537259 1.06
tpcds_q24/datafusion:vortex-compact 102272276 95715879 1.07
tpcds_q25/datafusion:vortex-compact 85234694 78554582 1.09
tpcds_q26/datafusion:vortex-compact 46850666 44052221 1.06
tpcds_q27/datafusion:vortex-compact 132389393 122905519 1.08
tpcds_q28/datafusion:vortex-compact 80865778 79141007 1.02
tpcds_q29/datafusion:vortex-compact 77237770 72112370 1.07
tpcds_q30/datafusion:vortex-compact 29784391 27098539 1.10
tpcds_q31/datafusion:vortex-compact 102599100 94473326 1.09
tpcds_q32/datafusion:vortex-compact 25620310 27143708 0.94
tpcds_q33/datafusion:vortex-compact 36405970 37548657 0.97
tpcds_q34/datafusion:vortex-compact 32212417 32129572 1.00
tpcds_q35/datafusion:vortex-compact 50786633 50411172 1.01
tpcds_q36/datafusion:vortex-compact 76648239 74815137 1.02
tpcds_q37/datafusion:vortex-compact 40676705 39042647 1.04
tpcds_q38/datafusion:vortex-compact 50957931 50204776 1.02
tpcds_q39/datafusion:vortex-compact 110073911 111589104 0.99
tpcds_q40/datafusion:vortex-compact 36200908 35836707 1.01
tpcds_q41/datafusion:vortex-compact 18307537 17289316 1.06
tpcds_q42/datafusion:vortex-compact 18430365 18732735 0.98
tpcds_q43/datafusion:vortex-compact 25583542 25137289 1.02
tpcds_q44/datafusion:vortex-compact 49324350 48502904 1.02
tpcds_q45/datafusion:vortex-compact 32899041 30965713 1.06
tpcds_q46/datafusion:vortex-compact 45128693 45009539 1.00
tpcds_q47/datafusion:vortex-compact 153148318 149299788 1.03
tpcds_q48/datafusion:vortex-compact 73819642 72908140 1.01
tpcds_q49/datafusion:vortex-compact 71404012 68207447 1.05
tpcds_q50/datafusion:vortex-compact 47594384 46375745 1.03
tpcds_q51/datafusion:vortex-compact 95970379 92932702 1.03
tpcds_q52/datafusion:vortex-compact 19526221 18468178 1.06
tpcds_q53/datafusion:vortex-compact 28443025 27384908 1.04
tpcds_q54/datafusion:vortex-compact 42511521 42135293 1.01
tpcds_q55/datafusion:vortex-compact 18945976 18981857 1.00
tpcds_q56/datafusion:vortex-compact 38456684 35935159 1.07
tpcds_q57/datafusion:vortex-compact 114143459 114951922 0.99
tpcds_q58/datafusion:vortex-compact 62939093 63525781 0.99
tpcds_q59/datafusion:vortex-compact 70060755 69808046 1.00
tpcds_q60/datafusion:vortex-compact 36373630 35810810 1.02
tpcds_q61/datafusion:vortex-compact 55278498 54713643 1.01
tpcds_q62/datafusion:vortex-compact 26632098 24856408 1.07
tpcds_q63/datafusion:vortex-compact 29424761 28409290 1.04
tpcds_q64/datafusion:vortex-compact 460579090 442545386 1.04
tpcds_q65/datafusion:vortex-compact 55985318 52910485 1.06
tpcds_q66/datafusion:vortex-compact 81480113 77659148 1.05
tpcds_q67/datafusion:vortex-compact 157817834 145196754 1.09
tpcds_q68/datafusion:vortex-compact 45625021 47632583 0.96
tpcds_q69/datafusion:vortex-compact 49595959 46560220 1.07
tpcds_q70/datafusion:vortex-compact 102492989 96444450 1.06
tpcds_q71/datafusion:vortex-compact 31277849 30761374 1.02
tpcds_q72/datafusion:vortex-compact 🚨 2287594818 2073335433 1.10
tpcds_q73/datafusion:vortex-compact 32145047 30757678 1.05
tpcds_q74/datafusion:vortex-compact 98212041 92276453 1.06
tpcds_q75/datafusion:vortex-compact 131100728 125994201 1.04
tpcds_q76/datafusion:vortex-compact 33257288 31837307 1.04
tpcds_q77/datafusion:vortex-compact 52765308 52239064 1.01
tpcds_q78/datafusion:vortex-compact 144241149 135334378 1.07
tpcds_q79/datafusion:vortex-compact 39122291 39713488 0.99
tpcds_q80/datafusion:vortex-compact 108623282 102013597 1.06
tpcds_q81/datafusion:vortex-compact 29006936 26888582 1.08
tpcds_q82/datafusion:vortex-compact 41376957 41890686 0.99
tpcds_q83/datafusion:vortex-compact 34296319 34305209 1.00
tpcds_q84/datafusion:vortex-compact 15501280 14463431 1.07
tpcds_q85/datafusion:vortex-compact 120376288 115850488 1.04
tpcds_q86/datafusion:vortex-compact 20298679 21959244 0.92
tpcds_q87/datafusion:vortex-compact 55385425 53270237 1.04
tpcds_q88/datafusion:vortex-compact 78859090 77957962 1.01
tpcds_q89/datafusion:vortex-compact 31534942 30722338 1.03
tpcds_q90/datafusion:vortex-compact 16138033 15250844 1.06
tpcds_q91/datafusion:vortex-compact 33677540 33870350 0.99
tpcds_q92/datafusion:vortex-compact 26000122 24425446 1.06
tpcds_q93/datafusion:vortex-compact 41058018 38163540 1.08
tpcds_q94/datafusion:vortex-compact 27744093 26380904 1.05
tpcds_q95/datafusion:vortex-compact 65038682 61442909 1.06
tpcds_q96/datafusion:vortex-compact 17650597 17143606 1.03
tpcds_q97/datafusion:vortex-compact 37078341 37012842 1.00
tpcds_q98/datafusion:vortex-compact 29803954 29538013 1.01
tpcds_q99/datafusion:vortex-compact 31744536 35106972 0.90
datafusion / parquet (1.030x ➖, 0↑ 7↓)
name PR ca6942f (ns) base 1838a7a (ns) ratio (PR/base)
tpcds_q01/datafusion:parquet 29790202 29028851 1.03
tpcds_q02/datafusion:parquet 41875504 41775359 1.00
tpcds_q03/datafusion:parquet 14372305 14168435 1.01
tpcds_q04/datafusion:parquet 263841935 262013902 1.01
tpcds_q05/datafusion:parquet 42275109 41038177 1.03
tpcds_q06/datafusion:parquet 58997566 58299593 1.01
tpcds_q07/datafusion:parquet 78592368 76995458 1.02
tpcds_q08/datafusion:parquet 26986289 26076663 1.03
tpcds_q09/datafusion:parquet 44954687 43221232 1.04
tpcds_q10/datafusion:parquet 74091741 72438534 1.02
tpcds_q11/datafusion:parquet 🚨 163119463 146404326 1.11
tpcds_q12/datafusion:parquet 18091475 17449151 1.04
tpcds_q13/datafusion:parquet 76574589 74786200 1.02
tpcds_q14/datafusion:parquet 162779809 159403405 1.02
tpcds_q15/datafusion:parquet 21000821 21059431 1.00
tpcds_q16/datafusion:parquet 24427120 24702372 0.99
tpcds_q17/datafusion:parquet 61980960 64871936 0.96
tpcds_q18/datafusion:parquet 112233798 114801570 0.98
tpcds_q19/datafusion:parquet 🚨 24870059 22006362 1.13
tpcds_q20/datafusion:parquet 16606377 16285148 1.02
tpcds_q21/datafusion:parquet 18238898 18348312 0.99
tpcds_q22/datafusion:parquet 136820349 151921070 0.90
tpcds_q23/datafusion:parquet 143491144 142078466 1.01
tpcds_q24/datafusion:parquet 90151852 91670260 0.98
tpcds_q25/datafusion:parquet 62962950 63009586 1.00
tpcds_q26/datafusion:parquet 65601201 67862561 0.97
tpcds_q27/datafusion:parquet 144885481 144051604 1.01
tpcds_q28/datafusion:parquet 44533925 45345099 0.98
tpcds_q29/datafusion:parquet 65895275 64791740 1.02
tpcds_q30/datafusion:parquet 34937969 34714618 1.01
tpcds_q31/datafusion:parquet 64264001 64859275 0.99
tpcds_q32/datafusion:parquet 18627197 18884095 0.99
tpcds_q33/datafusion:parquet 27166033 27268035 1.00
tpcds_q34/datafusion:parquet 21146990 23022000 0.92
tpcds_q35/datafusion:parquet 73594005 68813419 1.07
tpcds_q36/datafusion:parquet 55796638 55184996 1.01
tpcds_q37/datafusion:parquet 18481751 19013992 0.97
tpcds_q38/datafusion:parquet 40437925 41457391 0.98
tpcds_q39/datafusion:parquet 70534011 69587105 1.01
tpcds_q40/datafusion:parquet 23665203 23109878 1.02
tpcds_q41/datafusion:parquet 13043645 12710180 1.03
tpcds_q42/datafusion:parquet 12146154 11408707 1.06
tpcds_q43/datafusion:parquet 16382778 16219710 1.01
tpcds_q44/datafusion:parquet 33161351 33658993 0.99
tpcds_q45/datafusion:parquet 27523448 27494007 1.00
tpcds_q46/datafusion:parquet 32565603 31134452 1.05
tpcds_q47/datafusion:parquet 123730278 123900434 1.00
tpcds_q48/datafusion:parquet 68569348 68732100 1.00
tpcds_q49/datafusion:parquet 56444603 53602101 1.05
tpcds_q50/datafusion:parquet 43868999 44025941 1.00
tpcds_q51/datafusion:parquet 82190307 84915673 0.97
tpcds_q52/datafusion:parquet 11834349 11737438 1.01
tpcds_q53/datafusion:parquet 18243004 17217066 1.06
tpcds_q54/datafusion:parquet 32893761 33551801 0.98
tpcds_q55/datafusion:parquet 11595925 11170722 1.04
tpcds_q56/datafusion:parquet 28076733 26805111 1.05
tpcds_q57/datafusion:parquet 91447151 90373517 1.01
tpcds_q58/datafusion:parquet 51323660 48716551 1.05
tpcds_q59/datafusion:parquet 51878455 52534105 0.99
tpcds_q60/datafusion:parquet 27098678 27631931 0.98
tpcds_q61/datafusion:parquet 43156243 41861818 1.03
tpcds_q62/datafusion:parquet 19440966 20807832 0.93
tpcds_q63/datafusion:parquet 17962935 17177682 1.05
tpcds_q64/datafusion:parquet 515474201 506207859 1.02
tpcds_q65/datafusion:parquet 39131397 36569260 1.07
tpcds_q66/datafusion:parquet 73884896 68840004 1.07
tpcds_q67/datafusion:parquet 153081201 143235168 1.07
tpcds_q68/datafusion:parquet 33809222 31740192 1.07
tpcds_q69/datafusion:parquet 73469693 67972524 1.08
tpcds_q70/datafusion:parquet 87762639 87906975 1.00
tpcds_q71/datafusion:parquet 23897109 22269376 1.07
tpcds_q72/datafusion:parquet 635520333 584048771 1.09
tpcds_q73/datafusion:parquet 21964667 21114309 1.04
tpcds_q74/datafusion:parquet 88051813 82095013 1.07
tpcds_q75/datafusion:parquet 103653310 98147109 1.06
tpcds_q76/datafusion:parquet 30889642 28924965 1.07
tpcds_q77/datafusion:parquet 41014419 39289171 1.04
tpcds_q78/datafusion:parquet 117837002 107430749 1.10
tpcds_q79/datafusion:parquet 27331046 25826777 1.06
tpcds_q80/datafusion:parquet 83478232 77069399 1.08
tpcds_q81/datafusion:parquet 34187013 32443771 1.05
tpcds_q82/datafusion:parquet 20921248 19278678 1.09
tpcds_q83/datafusion:parquet 39136625 35866552 1.09
tpcds_q84/datafusion:parquet 41023101 38721511 1.06
tpcds_q85/datafusion:parquet 158809435 149393834 1.06
tpcds_q86/datafusion:parquet 16861775 15669038 1.08
tpcds_q87/datafusion:parquet 🚨 44914932 39733444 1.13
tpcds_q88/datafusion:parquet 60411937 58142323 1.04
tpcds_q89/datafusion:parquet 22191496 21743332 1.02
tpcds_q90/datafusion:parquet 14015289 14224836 0.99
tpcds_q91/datafusion:parquet 63450477 60060166 1.06
tpcds_q92/datafusion:parquet 🚨 19590488 17606948 1.11
tpcds_q93/datafusion:parquet 🚨 33487768 30036887 1.11
tpcds_q94/datafusion:parquet 21679248 20844373 1.04
tpcds_q95/datafusion:parquet 61823078 56600323 1.09
tpcds_q96/datafusion:parquet 13118996 12206409 1.07
tpcds_q97/datafusion:parquet 🚨 32379661 29364797 1.10
tpcds_q98/datafusion:parquet 23036607 21295757 1.08
tpcds_q99/datafusion:parquet 🚨 27463394 24488392 1.12
duckdb / vortex-file-compressed (1.098x ➖, 0↑ 45↓)
name PR ca6942f (ns) base 1838a7a (ns) ratio (PR/base)
tpcds_q01/duckdb:vortex-file-compressed 🚨 25348734 21194750 1.20
tpcds_q02/duckdb:vortex-file-compressed 🚨 35179590 30171540 1.17
tpcds_q03/duckdb:vortex-file-compressed 32913054 30393778 1.08
tpcds_q04/duckdb:vortex-file-compressed 109120003 100807631 1.08
tpcds_q05/duckdb:vortex-file-compressed 39840979 37565554 1.06
tpcds_q06/duckdb:vortex-file-compressed 🚨 36986946 30792922 1.20
tpcds_q07/duckdb:vortex-file-compressed 🚨 24996867 19056015 1.31
tpcds_q08/duckdb:vortex-file-compressed 28797945 28874573 1.00
tpcds_q09/duckdb:vortex-file-compressed 38670669 38885469 0.99
tpcds_q10/duckdb:vortex-file-compressed 42524520 39140790 1.09
tpcds_q11/duckdb:vortex-file-compressed 🚨 71489940 60904837 1.17
tpcds_q12/duckdb:vortex-file-compressed 🚨 17210548 13842980 1.24
tpcds_q13/duckdb:vortex-file-compressed 🚨 37659422 31482763 1.20
tpcds_q14/duckdb:vortex-file-compressed 105389640 100549834 1.05
tpcds_q15/duckdb:vortex-file-compressed 27182057 25972801 1.05
tpcds_q16/duckdb:vortex-file-compressed 🚨 33625199 26895287 1.25
tpcds_q17/duckdb:vortex-file-compressed 🚨 50060489 42267915 1.18
tpcds_q18/duckdb:vortex-file-compressed 🚨 52370839 46043378 1.14
tpcds_q19/duckdb:vortex-file-compressed 34029144 31999048 1.06
tpcds_q20/duckdb:vortex-file-compressed 16126259 15331498 1.05
tpcds_q21/duckdb:vortex-file-compressed 🚨 17940124 16021255 1.12
tpcds_q22/duckdb:vortex-file-compressed 🚨 83632678 71250031 1.17
tpcds_q23/duckdb:vortex-file-compressed 115752704 108715998 1.06
tpcds_q24/duckdb:vortex-file-compressed 50211517 49247171 1.02
tpcds_q25/duckdb:vortex-file-compressed 52527476 50118192 1.05
tpcds_q26/duckdb:vortex-file-compressed 🚨 45253897 40252993 1.12
tpcds_q27/duckdb:vortex-file-compressed 🚨 52726714 44138092 1.19
tpcds_q28/duckdb:vortex-file-compressed 36924718 35515399 1.04
tpcds_q29/duckdb:vortex-file-compressed 43611585 41269084 1.06
tpcds_q30/duckdb:vortex-file-compressed 🚨 28704164 23972274 1.20
tpcds_q31/duckdb:vortex-file-compressed 🚨 40103414 33955385 1.18
tpcds_q32/duckdb:vortex-file-compressed 🚨 16793850 13583741 1.24
tpcds_q33/duckdb:vortex-file-compressed 25941133 24200152 1.07
tpcds_q34/duckdb:vortex-file-compressed 23749265 23285623 1.02
tpcds_q35/duckdb:vortex-file-compressed 🚨 71170981 63809556 1.12
tpcds_q36/duckdb:vortex-file-compressed 27280927 24974153 1.09
tpcds_q37/duckdb:vortex-file-compressed 🚨 18799377 14861579 1.26
tpcds_q38/duckdb:vortex-file-compressed 40566591 37483358 1.08
tpcds_q39/duckdb:vortex-file-compressed 34582467 33378825 1.04
tpcds_q40/duckdb:vortex-file-compressed 🚨 22698848 19299185 1.18
tpcds_q41/duckdb:vortex-file-compressed 🚨 15308665 12775763 1.20
tpcds_q42/duckdb:vortex-file-compressed 13770069 13387770 1.03
tpcds_q43/duckdb:vortex-file-compressed 🚨 25930909 22945589 1.13
tpcds_q44/duckdb:vortex-file-compressed 🚨 23108726 20768132 1.11
tpcds_q45/duckdb:vortex-file-compressed 29540663 28072887 1.05
tpcds_q46/duckdb:vortex-file-compressed 55094574 51245083 1.08
tpcds_q47/duckdb:vortex-file-compressed 🚨 52007255 46644666 1.11
tpcds_q48/duckdb:vortex-file-compressed 🚨 34036500 29706257 1.15
tpcds_q49/duckdb:vortex-file-compressed 36833018 35632215 1.03
tpcds_q50/duckdb:vortex-file-compressed 33791079 34851264 0.97
tpcds_q51/duckdb:vortex-file-compressed 101856455 95784362 1.06
tpcds_q52/duckdb:vortex-file-compressed 🚨 15690419 13366565 1.17
tpcds_q53/duckdb:vortex-file-compressed 🚨 25356672 22857333 1.11
tpcds_q54/duckdb:vortex-file-compressed 28753336 28821885 1.00
tpcds_q55/duckdb:vortex-file-compressed 14015323 12793653 1.10
tpcds_q56/duckdb:vortex-file-compressed 25358391 23530207 1.08
tpcds_q57/duckdb:vortex-file-compressed 🚨 44098777 40014781 1.10
tpcds_q58/duckdb:vortex-file-compressed 🚨 33766005 30583430 1.10
tpcds_q59/duckdb:vortex-file-compressed 66501067 67119799 0.99
tpcds_q60/duckdb:vortex-file-compressed 27116301 25361891 1.07
tpcds_q61/duckdb:vortex-file-compressed 35887094 34529098 1.04
tpcds_q62/duckdb:vortex-file-compressed 🚨 20516451 18191318 1.13
tpcds_q63/duckdb:vortex-file-compressed 🚨 24118647 20923384 1.15
tpcds_q64/duckdb:vortex-file-compressed 87525418 81668271 1.07
tpcds_q65/duckdb:vortex-file-compressed 22760579 22847810 1.00
tpcds_q66/duckdb:vortex-file-compressed 🚨 33638617 29057100 1.16
tpcds_q67/duckdb:vortex-file-compressed 146726693 137910939 1.06
tpcds_q68/duckdb:vortex-file-compressed 🚨 46291974 40433576 1.14
tpcds_q69/duckdb:vortex-file-compressed 43201369 42249923 1.02
tpcds_q70/duckdb:vortex-file-compressed 🚨 28865252 25368861 1.14
tpcds_q71/duckdb:vortex-file-compressed 🚨 24791805 20422975 1.21
tpcds_q72/duckdb:vortex-file-compressed 181109418 170086681 1.06
tpcds_q73/duckdb:vortex-file-compressed 🚨 26356226 22313500 1.18
tpcds_q74/duckdb:vortex-file-compressed 75540490 71951658 1.05
tpcds_q75/duckdb:vortex-file-compressed 59410920 58091376 1.02
tpcds_q76/duckdb:vortex-file-compressed 🚨 21125137 18130396 1.17
tpcds_q77/duckdb:vortex-file-compressed 🚨 29630406 25066195 1.18
tpcds_q78/duckdb:vortex-file-compressed 77406478 76085468 1.02
tpcds_q79/duckdb:vortex-file-compressed 33030506 31664470 1.04
tpcds_q80/duckdb:vortex-file-compressed 🚨 57164967 46644510 1.23
tpcds_q81/duckdb:vortex-file-compressed 🚨 30100502 27165676 1.11
tpcds_q82/duckdb:vortex-file-compressed 17721772 16277268 1.09
tpcds_q83/duckdb:vortex-file-compressed 🚨 24799840 22229748 1.12
tpcds_q84/duckdb:vortex-file-compressed 🚨 21614740 18478626 1.17
tpcds_q85/duckdb:vortex-file-compressed 🚨 53272790 44425813 1.20
tpcds_q86/duckdb:vortex-file-compressed 17704559 16681105 1.06
tpcds_q87/duckdb:vortex-file-compressed 40838636 40784815 1.00
tpcds_q88/duckdb:vortex-file-compressed 34531146 32279739 1.07
tpcds_q89/duckdb:vortex-file-compressed 22514036 23330488 0.97
tpcds_q90/duckdb:vortex-file-compressed 🚨 12894770 11721679 1.10
tpcds_q91/duckdb:vortex-file-compressed 31819562 30695466 1.04
tpcds_q92/duckdb:vortex-file-compressed 🚨 26064466 20951975 1.24
tpcds_q93/duckdb:vortex-file-compressed 29420741 27313491 1.08
tpcds_q94/duckdb:vortex-file-compressed 25211505 24251652 1.04
tpcds_q95/duckdb:vortex-file-compressed 151344022 150734253 1.00
tpcds_q96/duckdb:vortex-file-compressed 12070605 13243719 0.91
tpcds_q97/duckdb:vortex-file-compressed 37559539 37189264 1.01
tpcds_q98/duckdb:vortex-file-compressed 18724790 17591346 1.06
tpcds_q99/duckdb:vortex-file-compressed 27766012 26250933 1.06
duckdb / vortex-compact (1.043x ➖, 0↑ 13↓)
name PR ca6942f (ns) base 1838a7a (ns) ratio (PR/base)
tpcds_q01/duckdb:vortex-compact 23595102 22518197 1.05
tpcds_q02/duckdb:vortex-compact 38927940 39223749 0.99
tpcds_q03/duckdb:vortex-compact 56862671 56713405 1.00
tpcds_q04/duckdb:vortex-compact 115268543 118323027 0.97
tpcds_q05/duckdb:vortex-compact 52491968 50125887 1.05
tpcds_q06/duckdb:vortex-compact 41420545 39812765 1.04
tpcds_q07/duckdb:vortex-compact 35463946 36670874 0.97
tpcds_q08/duckdb:vortex-compact 44858174 45478812 0.99
tpcds_q09/duckdb:vortex-compact 57602665 56501457 1.02
tpcds_q10/duckdb:vortex-compact 60773479 62672473 0.97
tpcds_q11/duckdb:vortex-compact 75089485 72129228 1.04
tpcds_q12/duckdb:vortex-compact 22929665 22476110 1.02
tpcds_q13/duckdb:vortex-compact 61149045 57163225 1.07
tpcds_q14/duckdb:vortex-compact 137171344 129267362 1.06
tpcds_q15/duckdb:vortex-compact 🚨 34135367 29857637 1.14
tpcds_q16/duckdb:vortex-compact 🚨 35537277 29794514 1.19
tpcds_q17/duckdb:vortex-compact 53988799 53757143 1.00
tpcds_q18/duckdb:vortex-compact 57461521 57762284 0.99
tpcds_q19/duckdb:vortex-compact 53629712 51232745 1.05
tpcds_q20/duckdb:vortex-compact 21069075 20323302 1.04
tpcds_q21/duckdb:vortex-compact 19818413 20464175 0.97
tpcds_q22/duckdb:vortex-compact 74124651 74420148 1.00
tpcds_q23/duckdb:vortex-compact 121753396 120232110 1.01
tpcds_q24/duckdb:vortex-compact 61804690 61707249 1.00
tpcds_q25/duckdb:vortex-compact 83746456 82856607 1.01
tpcds_q26/duckdb:vortex-compact 51379183 49643599 1.03
tpcds_q27/duckdb:vortex-compact 70774467 71036965 1.00
tpcds_q28/duckdb:vortex-compact 85683215 85372069 1.00
tpcds_q29/duckdb:vortex-compact 54797353 53196464 1.03
tpcds_q30/duckdb:vortex-compact 28261198 28587840 0.99
tpcds_q31/duckdb:vortex-compact 47253600 47131613 1.00
tpcds_q32/duckdb:vortex-compact 23632476 21717165 1.09
tpcds_q33/duckdb:vortex-compact 37513213 35218026 1.07
tpcds_q34/duckdb:vortex-compact 39845902 39843673 1.00
tpcds_q35/duckdb:vortex-compact 81775898 80228006 1.02
tpcds_q36/duckdb:vortex-compact 42798093 41138237 1.04
tpcds_q37/duckdb:vortex-compact 25800345 23699146 1.09
tpcds_q38/duckdb:vortex-compact 48433227 49460587 0.98
tpcds_q39/duckdb:vortex-compact 36366205 37162726 0.98
tpcds_q40/duckdb:vortex-compact 25555327 24480462 1.04
tpcds_q41/duckdb:vortex-compact 🚨 17894238 15886021 1.13
tpcds_q42/duckdb:vortex-compact 23770081 22245491 1.07
tpcds_q43/duckdb:vortex-compact 34967120 35187077 0.99
tpcds_q44/duckdb:vortex-compact 28483246 29980947 0.95
tpcds_q45/duckdb:vortex-compact 38625315 39017178 0.99
tpcds_q46/duckdb:vortex-compact 75976760 72755258 1.04
tpcds_q47/duckdb:vortex-compact 62971285 61846421 1.02
tpcds_q48/duckdb:vortex-compact 52858158 52725600 1.00
tpcds_q49/duckdb:vortex-compact 58287437 54892996 1.06
tpcds_q50/duckdb:vortex-compact 49056563 47198972 1.04
tpcds_q51/duckdb:vortex-compact 112009425 106628528 1.05
tpcds_q52/duckdb:vortex-compact 23685732 21902830 1.08
tpcds_q53/duckdb:vortex-compact 40592868 39394006 1.03
tpcds_q54/duckdb:vortex-compact 41019614 40500298 1.01
tpcds_q55/duckdb:vortex-compact 23629827 22034925 1.07
tpcds_q56/duckdb:vortex-compact 38911053 35500160 1.10
tpcds_q57/duckdb:vortex-compact 44548739 43474162 1.02
tpcds_q58/duckdb:vortex-compact 41697803 44788002 0.93
tpcds_q59/duckdb:vortex-compact 90055689 85198448 1.06
tpcds_q60/duckdb:vortex-compact 🚨 41491021 37712835 1.10
tpcds_q61/duckdb:vortex-compact 70689744 65025204 1.09
tpcds_q62/duckdb:vortex-compact 25659062 26131931 0.98
tpcds_q63/duckdb:vortex-compact 38534730 37006564 1.04
tpcds_q64/duckdb:vortex-compact 122529056 115132722 1.06
tpcds_q65/duckdb:vortex-compact 34240840 33390066 1.03
tpcds_q66/duckdb:vortex-compact 🚨 43673419 39388853 1.11
tpcds_q67/duckdb:vortex-compact 158615246 148016713 1.07
tpcds_q68/duckdb:vortex-compact 66025449 64296020 1.03
tpcds_q69/duckdb:vortex-compact 66396605 61426488 1.08
tpcds_q70/duckdb:vortex-compact 38143205 36956273 1.03
tpcds_q71/duckdb:vortex-compact 35561388 34976710 1.02
tpcds_q72/duckdb:vortex-compact 192666859 190535868 1.01
tpcds_q73/duckdb:vortex-compact 39119014 38603063 1.01
tpcds_q74/duckdb:vortex-compact 85052116 82673216 1.03
tpcds_q75/duckdb:vortex-compact 77669513 73614531 1.06
tpcds_q76/duckdb:vortex-compact 36869315 34625894 1.06
tpcds_q77/duckdb:vortex-compact 44093978 41510353 1.06
tpcds_q78/duckdb:vortex-compact 95975438 89647117 1.07
tpcds_q79/duckdb:vortex-compact 55710105 52012287 1.07
tpcds_q80/duckdb:vortex-compact 🚨 92891994 78003602 1.19
tpcds_q81/duckdb:vortex-compact 33681399 32241156 1.04
tpcds_q82/duckdb:vortex-compact 🚨 27529277 24624623 1.12
tpcds_q83/duckdb:vortex-compact 🚨 37900131 31919394 1.19
tpcds_q84/duckdb:vortex-compact 28568532 26275160 1.09
tpcds_q85/duckdb:vortex-compact 🚨 64218915 55855650 1.15
tpcds_q86/duckdb:vortex-compact 25120040 24132042 1.04
tpcds_q87/duckdb:vortex-compact 53836544 51246050 1.05
tpcds_q88/duckdb:vortex-compact 41355058 39024506 1.06
tpcds_q89/duckdb:vortex-compact 40510132 38076731 1.06
tpcds_q90/duckdb:vortex-compact 16412553 15222497 1.08
tpcds_q91/duckdb:vortex-compact 52372647 51247544 1.02
tpcds_q92/duckdb:vortex-compact 45688515 49164728 0.93
tpcds_q93/duckdb:vortex-compact 🚨 35117667 31805785 1.10
tpcds_q94/duckdb:vortex-compact 🚨 36561975 28508334 1.28
tpcds_q95/duckdb:vortex-compact 161565843 162821666 0.99
tpcds_q96/duckdb:vortex-compact 17722206 18451359 0.96
tpcds_q97/duckdb:vortex-compact 45766573 42964992 1.07
tpcds_q98/duckdb:vortex-compact 🚨 32996939 28271262 1.17
tpcds_q99/duckdb:vortex-compact 🚨 34968095 31694589 1.10
duckdb / parquet (1.041x ➖, 1↑ 13↓)
name PR ca6942f (ns) base 1838a7a (ns) ratio (PR/base)
tpcds_q01/duckdb:parquet 28934784 27479060 1.05
tpcds_q02/duckdb:parquet 23967585 23503373 1.02
tpcds_q03/duckdb:parquet 11789652 11214899 1.05
tpcds_q04/duckdb:parquet 161725737 164213485 0.98
tpcds_q05/duckdb:parquet 29869186 29703980 1.01
tpcds_q06/duckdb:parquet 27852742 27384517 1.02
tpcds_q07/duckdb:parquet 20405842 20862204 0.98
tpcds_q08/duckdb:parquet 26947985 26461617 1.02
tpcds_q09/duckdb:parquet 39336821 38904173 1.01
tpcds_q10/duckdb:parquet 33129675 31879976 1.04
tpcds_q11/duckdb:parquet 91168746 88905836 1.03
tpcds_q12/duckdb:parquet 15283582 13962936 1.09
tpcds_q13/duckdb:parquet 32664622 32166652 1.02
tpcds_q14/duckdb:parquet 99215560 97184013 1.02
tpcds_q15/duckdb:parquet 30735697 29893445 1.03
tpcds_q16/duckdb:parquet 21723750 20348847 1.07
tpcds_q17/duckdb:parquet 37775077 34692694 1.09
tpcds_q18/duckdb:parquet 45922174 44048228 1.04
tpcds_q19/duckdb:parquet 29079515 28399235 1.02
tpcds_q20/duckdb:parquet 15793168 14918564 1.06
tpcds_q21/duckdb:parquet 10349765 10577787 0.98
tpcds_q22/duckdb:parquet 71738434 67102586 1.07
tpcds_q23/duckdb:parquet 82371814 79391733 1.04
tpcds_q24/duckdb:parquet 44500453 43883486 1.01
tpcds_q25/duckdb:parquet 32924389 32497409 1.01
tpcds_q26/duckdb:parquet 35181858 34884517 1.01
tpcds_q27/duckdb:parquet 48441765 48646142 1.00
tpcds_q28/duckdb:parquet 38386104 37805391 1.02
tpcds_q29/duckdb:parquet 35372708 36358858 0.97
tpcds_q30/duckdb:parquet 37054896 34213848 1.08
tpcds_q31/duckdb:parquet 23400671 23898456 0.98
tpcds_q32/duckdb:parquet 🚨 12017603 10322314 1.16
tpcds_q33/duckdb:parquet 20288772 20955970 0.97
tpcds_q34/duckdb:parquet 21269663 19942935 1.07
tpcds_q35/duckdb:parquet 57022114 55752842 1.02
tpcds_q36/duckdb:parquet 19897709 19608828 1.01
tpcds_q37/duckdb:parquet 12612393 12419826 1.02
tpcds_q38/duckdb:parquet 33207173 33776705 0.98
tpcds_q39/duckdb:parquet 30392469 29212203 1.04
tpcds_q40/duckdb:parquet 17436657 17158101 1.02
tpcds_q41/duckdb:parquet 7833824 7461901 1.05
tpcds_q42/duckdb:parquet 🚨 10694321 9224083 1.16
tpcds_q43/duckdb:parquet 15287817 14689475 1.04
tpcds_q44/duckdb:parquet 22768988 21888440 1.04
tpcds_q45/duckdb:parquet 27198244 26360433 1.03
tpcds_q46/duckdb:parquet 45980137 45158129 1.02
tpcds_q47/duckdb:parquet 44417637 44561472 1.00
tpcds_q48/duckdb:parquet 29743954 29763636 1.00
tpcds_q49/duckdb:parquet 23584087 24087506 0.98
tpcds_q50/duckdb:parquet 24270205 23741562 1.02
tpcds_q51/duckdb:parquet 94908758 94399224 1.01
tpcds_q52/duckdb:parquet 10587669 10936525 0.97
tpcds_q53/duckdb:parquet 14983783 14676074 1.02
tpcds_q54/duckdb:parquet 25379098 25028681 1.01
tpcds_q55/duckdb:parquet 9674773 9586584 1.01
tpcds_q56/duckdb:parquet 19805106 20363980 0.97
tpcds_q57/duckdb:parquet 33745269 33779632 1.00
tpcds_q58/duckdb:parquet 22698174 22334310 1.02
tpcds_q59/duckdb:parquet 35646649 35029107 1.02
tpcds_q60/duckdb:parquet 21000402 21625383 0.97
tpcds_q61/duckdb:parquet 31768802 29979834 1.06
tpcds_q62/duckdb:parquet 11597890 12156486 0.95
tpcds_q63/duckdb:parquet 13630848 13767727 0.99
tpcds_q64/duckdb:parquet 73033152 74762005 0.98
tpcds_q65/duckdb:parquet 20806034 19083460 1.09
tpcds_q66/duckdb:parquet 🚀 28915020 32330393 0.89
tpcds_q67/duckdb:parquet 136076008 134348362 1.01
tpcds_q68/duckdb:parquet 36453398 36269620 1.01
tpcds_q69/duckdb:parquet 37108625 35676490 1.04
tpcds_q70/duckdb:parquet 20253344 20750789 0.98
tpcds_q71/duckdb:parquet 🚨 20525128 17881122 1.15
tpcds_q72/duckdb:parquet 173871875 163275555 1.06
tpcds_q73/duckdb:parquet 17888991 17119882 1.04
tpcds_q74/duckdb:parquet 134218812 131359939 1.02
tpcds_q75/duckdb:parquet 🚨 57519321 51008566 1.13
tpcds_q76/duckdb:parquet 20621696 19634846 1.05
tpcds_q77/duckdb:parquet 22459013 21007875 1.07
tpcds_q78/duckdb:parquet 80491485 73980728 1.09
tpcds_q79/duckdb:parquet 🚨 30064813 26980665 1.11
tpcds_q80/duckdb:parquet 42961009 40708132 1.06
tpcds_q81/duckdb:parquet 🚨 34877058 30649047 1.14
tpcds_q82/duckdb:parquet 🚨 14510852 13150122 1.10
tpcds_q83/duckdb:parquet 16773063 15315252 1.10
tpcds_q84/duckdb:parquet 19905230 19015274 1.05
tpcds_q85/duckdb:parquet 42909923 39281913 1.09
tpcds_q86/duckdb:parquet 🚨 13879667 12605628 1.10
tpcds_q87/duckdb:parquet 40648254 37523340 1.08
tpcds_q88/duckdb:parquet 49458554 47973938 1.03
tpcds_q89/duckdb:parquet 17299254 15907686 1.09
tpcds_q90/duckdb:parquet 7806172 7274280 1.07
tpcds_q91/duckdb:parquet 23636163 22142935 1.07
tpcds_q92/duckdb:parquet 🚨 12219259 11088947 1.10
tpcds_q93/duckdb:parquet 🚨 32408084 27883611 1.16
tpcds_q94/duckdb:parquet 🚨 18791471 15233063 1.23
tpcds_q95/duckdb:parquet 🚨 150138204 124942801 1.20
tpcds_q96/duckdb:parquet 8915761 8126900 1.10
tpcds_q97/duckdb:parquet 🚨 38347589 33891607 1.13
tpcds_q98/duckdb:parquet 18565567 17053374 1.09
tpcds_q99/duckdb:parquet 20355005 19189247 1.06
duckdb / duckdb (1.058x ➖, 0↑ 24↓)
name PR ca6942f (ns) base 1838a7a (ns) ratio (PR/base)
tpcds_q01/duckdb:duckdb 🚨 23036497 19826107 1.16
tpcds_q02/duckdb:duckdb 18604551 18630075 1.00
tpcds_q03/duckdb:duckdb 8585848 8847976 0.97
tpcds_q04/duckdb:duckdb 184921269 168545372 1.10
tpcds_q05/duckdb:duckdb 20943966 19369530 1.08
tpcds_q06/duckdb:duckdb 24558540 22370888 1.10
tpcds_q07/duckdb:duckdb 38807834 37151277 1.04
tpcds_q08/duckdb:duckdb 123253494 120300518 1.02
tpcds_q09/duckdb:duckdb 21197230 19667294 1.08
tpcds_q10/duckdb:duckdb 🚨 26431622 23569216 1.12
tpcds_q11/duckdb:duckdb 87243874 90867655 0.96
tpcds_q12/duckdb:duckdb 12234863 11500702 1.06
tpcds_q13/duckdb:duckdb 🚨 26379354 23715167 1.11
tpcds_q14/duckdb:duckdb 96293305 90336717 1.07
tpcds_q15/duckdb:duckdb 🚨 26909233 24252570 1.11
tpcds_q16/duckdb:duckdb 17359394 16826866 1.03
tpcds_q17/duckdb:duckdb 21096022 20698952 1.02
tpcds_q18/duckdb:duckdb 🚨 47700666 43021844 1.11
tpcds_q19/duckdb:duckdb 17888093 16655553 1.07
tpcds_q20/duckdb:duckdb 🚨 13603551 11970220 1.14
tpcds_q21/duckdb:duckdb 🚨 7521118 6612924 1.14
tpcds_q22/duckdb:duckdb 🚨 69063672 59743296 1.16
tpcds_q23/duckdb:duckdb 79083378 79307872 1.00
tpcds_q24/duckdb:duckdb 25887707 24478614 1.06
tpcds_q25/duckdb:duckdb 🚨 18696260 16645913 1.12
tpcds_q26/duckdb:duckdb 28241928 26385053 1.07
tpcds_q27/duckdb:duckdb 🚨 42479733 38595711 1.10
tpcds_q28/duckdb:duckdb 22910047 21286922 1.08
tpcds_q29/duckdb:duckdb 21865362 20131938 1.09
tpcds_q30/duckdb:duckdb 29523857 28515825 1.04
tpcds_q31/duckdb:duckdb 51363986 46868250 1.10
tpcds_q32/duckdb:duckdb 🚨 8784769 6983700 1.26
tpcds_q33/duckdb:duckdb 🚨 13776060 12511294 1.10
tpcds_q34/duckdb:duckdb 15910378 14867436 1.07
tpcds_q35/duckdb:duckdb 🚨 34208491 30675458 1.12
tpcds_q36/duckdb:duckdb 74876752 68949319 1.09
tpcds_q37/duckdb:duckdb 7454275 7535443 0.99
tpcds_q38/duckdb:duckdb 29362153 29533487 0.99
tpcds_q39/duckdb:duckdb 🚨 26606218 23898715 1.11
tpcds_q40/duckdb:duckdb 13773531 13389789 1.03
tpcds_q41/duckdb:duckdb 🚨 9104680 8244820 1.10
tpcds_q42/duckdb:duckdb 7183493 6682037 1.08
tpcds_q43/duckdb:duckdb 🚨 12410516 11054980 1.12
tpcds_q44/duckdb:duckdb 14005843 14556864 0.96
tpcds_q45/duckdb:duckdb 🚨 18509678 16595521 1.12
tpcds_q46/duckdb:duckdb 36732956 35348093 1.04
tpcds_q47/duckdb:duckdb 41289114 40555181 1.02
tpcds_q48/duckdb:duckdb 23673148 23132233 1.02
tpcds_q49/duckdb:duckdb 17720375 17029330 1.04
tpcds_q50/duckdb:duckdb 14505478 14381078 1.01
tpcds_q51/duckdb:duckdb 91939358 90324019 1.02
tpcds_q52/duckdb:duckdb 7703205 7174589 1.07
tpcds_q53/duckdb:duckdb 13976250 13164613 1.06
tpcds_q54/duckdb:duckdb 🚨 17716092 15765338 1.12
tpcds_q55/duckdb:duckdb 7221839 6803183 1.06
tpcds_q56/duckdb:duckdb 14166542 13007541 1.09
tpcds_q57/duckdb:duckdb 33035319 31921528 1.03
tpcds_q58/duckdb:duckdb 13033199 12276566 1.06
tpcds_q59/duckdb:duckdb 35301801 35049092 1.01
tpcds_q60/duckdb:duckdb 15108512 14208701 1.06
tpcds_q61/duckdb:duckdb 14711375 14358394 1.02
tpcds_q62/duckdb:duckdb 9579947 9182004 1.04
tpcds_q63/duckdb:duckdb 12621674 12190561 1.04
tpcds_q64/duckdb:duckdb 55971971 53127923 1.05
tpcds_q65/duckdb:duckdb 35566275 34506604 1.03
tpcds_q66/duckdb:duckdb 26628978 25360772 1.05
tpcds_q67/duckdb:duckdb 131713785 127496138 1.03
tpcds_q68/duckdb:duckdb 25569877 24899758 1.03
tpcds_q69/duckdb:duckdb 24796686 25310686 0.98
tpcds_q70/duckdb:duckdb 15126731 14325001 1.06
tpcds_q71/duckdb:duckdb 🚨 13068831 11412234 1.15
tpcds_q72/duckdb:duckdb 43965923 41665517 1.06
tpcds_q73/duckdb:duckdb 11192474 10743760 1.04
tpcds_q74/duckdb:duckdb 145709090 145838304 1.00
tpcds_q75/duckdb:duckdb 41855067 41061663 1.02
tpcds_q76/duckdb:duckdb 12161224 11254598 1.08
tpcds_q77/duckdb:duckdb 13022297 12664515 1.03
tpcds_q78/duckdb:duckdb 63197048 62893626 1.00
tpcds_q79/duckdb:duckdb 19010130 18630357 1.02
tpcds_q80/duckdb:duckdb 27665469 27416336 1.01
tpcds_q81/duckdb:duckdb 🚨 40029998 35543687 1.13
tpcds_q82/duckdb:duckdb 8848121 8404909 1.05
tpcds_q83/duckdb:duckdb 🚨 9844501 8808704 1.12
tpcds_q84/duckdb:duckdb 14030025 13919305 1.01
tpcds_q85/duckdb:duckdb 24711923 23810184 1.04
tpcds_q86/duckdb:duckdb 10788452 10049913 1.07
tpcds_q87/duckdb:duckdb 🚨 35183007 31380996 1.12
tpcds_q88/duckdb:duckdb 26256459 25573700 1.03
tpcds_q89/duckdb:duckdb 14359980 14208522 1.01
tpcds_q90/duckdb:duckdb 🚨 6179293 5502084 1.12
tpcds_q91/duckdb:duckdb 🚨 13607193 11566387 1.18
tpcds_q92/duckdb:duckdb 8590733 8268082 1.04
tpcds_q93/duckdb:duckdb 21916192 21898557 1.00
tpcds_q94/duckdb:duckdb 13248001 13374288 0.99
tpcds_q95/duckdb:duckdb 129237690 128070121 1.01
tpcds_q96/duckdb:duckdb 4720792 4506309 1.05
tpcds_q97/duckdb:duckdb 30427585 29580793 1.03
tpcds_q98/duckdb:duckdb 12986193 13721815 0.95
tpcds_q99/duckdb:duckdb 16761487 16253195 1.03
Full attributed analysis
Query Config Raw Δ Control Δ Attributed α Noise floor Significant?
1 datafusion:vortex-compact +1.7% +4.0% -2.1% +20.7% ➖ noise
1 datafusion:vortex-file-compressed +4.0% +4.0% +0.1% +19.2% ➖ noise
1 duckdb:duckdb +16.2% +4.0% +11.8% +21.5% ➖ noise
1 duckdb:vortex-compact +4.8% +4.0% +0.8% +21.8% ➖ noise
1 duckdb:vortex-file-compressed +19.6% +4.0% +15.1% +37.1% ➖ noise
2 datafusion:vortex-compact +5.5% +1.1% +4.4% +11.7% ➖ noise
2 datafusion:vortex-file-compressed +2.9% +1.1% +1.8% +11.3% ➖ noise
2 duckdb:duckdb -0.1% +1.1% -1.2% +13.6% ➖ noise
2 duckdb:vortex-compact -0.8% +1.1% -1.8% +30.2% ➖ noise
2 duckdb:vortex-file-compressed +16.6% +1.1% +15.3% +29.0% ➖ noise
3 datafusion:vortex-compact +6.9% +3.3% +3.5% +10.9% ➖ noise
3 datafusion:vortex-file-compressed +8.3% +3.3% +4.9% +16.7% ➖ noise
3 duckdb:duckdb -3.0% +3.3% -6.0% +17.7% ➖ noise
3 duckdb:vortex-compact +0.3% +3.3% -2.9% +10.9% ➖ noise
3 duckdb:vortex-file-compressed +8.3% +3.3% +4.9% +10.9% ➖ noise
4 datafusion:vortex-compact +5.8% -0.4% +6.3% +10.9% ➖ noise
4 datafusion:vortex-file-compressed +7.5% -0.4% +7.9% +10.9% ➖ noise
4 duckdb:duckdb +9.7% -0.4% +10.2% +10.9% ➖ noise
4 duckdb:vortex-compact -2.6% -0.4% -2.2% +10.9% ➖ noise
4 duckdb:vortex-file-compressed +8.2% -0.4% +8.7% +11.2% ➖ noise
5 datafusion:vortex-compact +12.7% +1.8% +10.7% +15.4% ➖ noise
5 datafusion:vortex-file-compressed +14.6% +1.8% +12.6% +10.9% 🚨 regression
5 duckdb:duckdb +8.1% +1.8% +6.2% +10.9% ➖ noise
5 duckdb:vortex-compact +4.7% +1.8% +2.9% +10.9% ➖ noise
5 duckdb:vortex-file-compressed +6.1% +1.8% +4.2% +10.9% ➖ noise
6 datafusion:vortex-compact -3.2% +1.5% -4.6% +10.9% ➖ noise
6 datafusion:vortex-file-compressed +1.0% +1.5% -0.4% +10.9% ➖ noise
6 duckdb:duckdb +9.8% +1.5% +8.2% +14.7% ➖ noise
6 duckdb:vortex-compact +4.0% +1.5% +2.5% +10.9% ➖ noise
6 duckdb:vortex-file-compressed +20.1% +1.5% +18.4% +10.9% 🚨 regression
7 datafusion:vortex-compact +7.0% -0.1% +7.1% +10.9% ➖ noise
7 datafusion:vortex-file-compressed +9.3% -0.1% +9.4% +10.9% ➖ noise
7 duckdb:duckdb +4.5% -0.1% +4.5% +19.1% ➖ noise
7 duckdb:vortex-compact -3.3% -0.1% -3.2% +13.0% ➖ noise
7 duckdb:vortex-file-compressed +31.2% -0.1% +31.3% +20.3% 🚨 regression
8 datafusion:vortex-compact +4.5% +2.7% +1.8% +10.9% ➖ noise
8 datafusion:vortex-file-compressed +6.1% +2.7% +3.3% +10.9% ➖ noise
8 duckdb:duckdb +2.5% +2.7% -0.2% +10.9% ➖ noise
8 duckdb:vortex-compact -1.4% +2.7% -3.9% +10.9% ➖ noise
8 duckdb:vortex-file-compressed -0.3% +2.7% -2.8% +10.9% ➖ noise
9 datafusion:vortex-compact +4.4% +2.6% +1.9% +10.9% ➖ noise
9 datafusion:vortex-file-compressed +7.7% +2.6% +5.0% +10.9% ➖ noise
9 duckdb:duckdb +7.8% +2.6% +5.1% +10.9% ➖ noise
9 duckdb:vortex-compact +1.9% +2.6% -0.6% +10.9% ➖ noise
9 duckdb:vortex-file-compressed -0.6% +2.6% -3.0% +10.9% ➖ noise
10 datafusion:vortex-compact +7.5% +3.1% +4.3% +10.9% ➖ noise
10 datafusion:vortex-file-compressed +11.7% +3.1% +8.4% +10.9% ➖ noise
10 duckdb:duckdb +12.1% +3.1% +8.8% +10.9% ➖ noise
10 duckdb:vortex-compact -3.0% +3.1% -5.9% +10.9% ➖ noise
10 duckdb:vortex-file-compressed +8.6% +3.1% +5.4% +10.9% ➖ noise
11 datafusion:vortex-compact +4.3% +6.9% -2.4% +10.9% ➖ noise
11 datafusion:vortex-file-compressed +6.4% +6.9% -0.5% +12.8% ➖ noise
11 duckdb:duckdb -4.0% +6.9% -10.2% +12.9% ➖ noise
11 duckdb:vortex-compact +4.1% +6.9% -2.6% +11.0% ➖ noise
11 duckdb:vortex-file-compressed +17.4% +6.9% +9.8% +10.9% ➖ noise
12 datafusion:vortex-compact +1.7% +6.5% -4.6% +13.9% ➖ noise
12 datafusion:vortex-file-compressed +8.9% +6.5% +2.2% +12.1% ➖ noise
12 duckdb:duckdb +6.4% +6.5% -0.1% +11.4% ➖ noise
12 duckdb:vortex-compact +2.0% +6.5% -4.2% +10.9% ➖ noise
12 duckdb:vortex-file-compressed +24.3% +6.5% +16.7% +10.9% 🚨 regression
13 datafusion:vortex-compact +3.6% +2.0% +1.6% +10.9% ➖ noise
13 datafusion:vortex-file-compressed +9.3% +2.0% +7.2% +10.9% ➖ noise
13 duckdb:duckdb +11.2% +2.0% +9.1% +10.9% ➖ noise
13 duckdb:vortex-compact +7.0% +2.0% +4.9% +10.9% ➖ noise
13 duckdb:vortex-file-compressed +19.6% +2.0% +17.3% +10.9% 🚨 regression
14 datafusion:vortex-compact +8.9% +2.1% +6.7% +10.9% ➖ noise
14 datafusion:vortex-file-compressed +8.4% +2.1% +6.1% +10.9% ➖ noise
14 duckdb:duckdb +6.6% +2.1% +4.4% +10.9% ➖ noise
14 duckdb:vortex-compact +6.1% +2.1% +3.9% +10.9% ➖ noise
14 duckdb:vortex-file-compressed +4.8% +2.1% +2.7% +11.7% ➖ noise
15 datafusion:vortex-compact +0.5% +1.3% -0.8% +11.8% ➖ noise
15 datafusion:vortex-file-compressed +12.3% +1.3% +10.9% +10.9% 🚨 regression
15 duckdb:duckdb +11.0% +1.3% +9.6% +10.9% ➖ noise
15 duckdb:vortex-compact +14.3% +1.3% +12.9% +14.3% ➖ noise
15 duckdb:vortex-file-compressed +4.7% +1.3% +3.4% +10.9% ➖ noise
16 datafusion:vortex-compact +1.7% +2.7% -1.0% +18.6% ➖ noise
16 datafusion:vortex-file-compressed +5.9% +2.7% +3.1% +11.8% ➖ noise
16 duckdb:duckdb +3.2% +2.7% +0.4% +14.1% ➖ noise
16 duckdb:vortex-compact +19.3% +2.7% +16.1% +14.3% 🚨 regression
16 duckdb:vortex-file-compressed +25.0% +2.7% +21.7% +20.6% 🚨 regression
17 datafusion:vortex-compact +5.0% +2.0% +3.0% +10.9% ➖ noise
17 datafusion:vortex-file-compressed +7.6% +2.0% +5.5% +10.9% ➖ noise
17 duckdb:duckdb +1.9% +2.0% -0.1% +10.9% ➖ noise
17 duckdb:vortex-compact +0.4% +2.0% -1.5% +10.9% ➖ noise
17 duckdb:vortex-file-compressed +18.4% +2.0% +16.1% +11.3% 🚨 regression
18 datafusion:vortex-compact +8.5% +1.0% +7.4% +10.9% ➖ noise
18 datafusion:vortex-file-compressed +9.0% +1.0% +8.0% +10.9% ➖ noise
18 duckdb:duckdb +10.9% +1.0% +9.8% +11.0% ➖ noise
18 duckdb:vortex-compact -0.5% +1.0% -1.5% +10.9% ➖ noise
18 duckdb:vortex-file-compressed +13.7% +1.0% +12.7% +10.9% 🚨 regression
19 datafusion:vortex-compact +8.3% +7.6% +0.7% +15.6% ➖ noise
19 datafusion:vortex-file-compressed +12.2% +7.6% +4.3% +10.9% ➖ noise
19 duckdb:duckdb +7.4% +7.6% -0.2% +10.9% ➖ noise
19 duckdb:vortex-compact +4.7% +7.6% -2.7% +10.9% ➖ noise
19 duckdb:vortex-file-compressed +6.3% +7.6% -1.1% +10.9% ➖ noise
20 datafusion:vortex-compact +7.5% +3.9% +3.4% +10.9% ➖ noise
20 datafusion:vortex-file-compressed +2.5% +3.9% -1.3% +11.0% ➖ noise
20 duckdb:duckdb +13.6% +3.9% +9.4% +10.9% ➖ noise
20 duckdb:vortex-compact +3.7% +3.9% -0.2% +10.9% ➖ noise
20 duckdb:vortex-file-compressed +5.2% +3.9% +1.2% +10.9% ➖ noise
21 datafusion:vortex-compact +12.1% -1.4% +13.7% +11.9% 🚨 regression
21 datafusion:vortex-file-compressed -0.1% -1.4% +1.3% +12.9% ➖ noise
21 duckdb:duckdb +13.7% -1.4% +15.3% +23.6% ➖ noise
21 duckdb:vortex-compact -3.2% -1.4% -1.8% +18.7% ➖ noise
21 duckdb:vortex-file-compressed +12.0% -1.4% +13.5% +12.3% 🚨 regression
22 datafusion:vortex-compact +8.3% -1.9% +10.3% +24.1% ➖ noise
22 datafusion:vortex-file-compressed +39.6% -1.9% +42.3% +30.6% 🚨 regression
22 duckdb:duckdb +15.6% -1.9% +17.8% +13.8% 🚨 regression
22 duckdb:vortex-compact -0.4% -1.9% +1.5% +12.1% ➖ noise
22 duckdb:vortex-file-compressed +17.4% -1.9% +19.6% +15.8% 🚨 regression
23 datafusion:vortex-compact +6.4% +2.4% +3.9% +10.9% ➖ noise
23 datafusion:vortex-file-compressed +3.8% +2.4% +1.4% +12.5% ➖ noise
23 duckdb:duckdb -0.3% +2.4% -2.6% +12.5% ➖ noise
23 duckdb:vortex-compact +1.3% +2.4% -1.1% +17.8% ➖ noise
23 duckdb:vortex-file-compressed +6.5% +2.4% +4.0% +12.7% ➖ noise
24 datafusion:vortex-compact +6.8% -0.1% +7.0% +10.9% ➖ noise
24 datafusion:vortex-file-compressed +6.8% -0.1% +6.9% +10.9% ➖ noise
24 duckdb:duckdb +5.8% -0.1% +5.9% +10.9% ➖ noise
24 duckdb:vortex-compact +0.2% -0.1% +0.3% +10.9% ➖ noise
24 duckdb:vortex-file-compressed +2.0% -0.1% +2.1% +12.2% ➖ noise
25 datafusion:vortex-compact +8.5% +0.6% +7.8% +10.9% ➖ noise
25 datafusion:vortex-file-compressed +9.3% +0.6% +8.6% +12.7% ➖ noise
25 duckdb:duckdb +12.3% +0.6% +11.6% +10.9% 🚨 regression
25 duckdb:vortex-compact +1.1% +0.6% +0.5% +15.1% ➖ noise
25 duckdb:vortex-file-compressed +4.8% +0.6% +4.2% +10.9% ➖ noise
26 datafusion:vortex-compact +6.4% -1.3% +7.7% +10.9% ➖ noise
26 datafusion:vortex-file-compressed +11.4% -1.3% +12.8% +17.3% ➖ noise
26 duckdb:duckdb +7.0% -1.3% +8.4% +13.0% ➖ noise
26 duckdb:vortex-compact +3.5% -1.3% +4.8% +15.2% ➖ noise
26 duckdb:vortex-file-compressed +12.4% -1.3% +13.9% +12.8% 🚨 regression
27 datafusion:vortex-compact +7.7% +0.1% +7.6% +10.9% ➖ noise
27 datafusion:vortex-file-compressed +12.8% +0.1% +12.7% +10.9% 🚨 regression
27 duckdb:duckdb +10.1% +0.1% +10.0% +19.0% ➖ noise
27 duckdb:vortex-compact -0.4% +0.1% -0.4% +10.9% ➖ noise
27 duckdb:vortex-file-compressed +19.5% +0.1% +19.4% +17.0% 🚨 regression
28 datafusion:vortex-compact +2.2% -0.1% +2.3% +10.9% ➖ noise
28 datafusion:vortex-file-compressed +2.5% -0.1% +2.7% +10.9% ➖ noise
28 duckdb:duckdb +7.6% -0.1% +7.8% +10.9% ➖ noise
28 duckdb:vortex-compact +0.4% -0.1% +0.5% +10.9% ➖ noise
28 duckdb:vortex-file-compressed +4.0% -0.1% +4.1% +11.5% ➖ noise
29 datafusion:vortex-compact +7.1% -0.5% +7.7% +11.0% ➖ noise
29 datafusion:vortex-file-compressed +4.3% -0.5% +4.9% +10.9% ➖ noise
29 duckdb:duckdb +8.6% -0.5% +9.2% +10.9% ➖ noise
29 duckdb:vortex-compact +3.0% -0.5% +3.6% +10.9% ➖ noise
29 duckdb:vortex-file-compressed +5.7% -0.5% +6.2% +10.9% ➖ noise
30 datafusion:vortex-compact +9.9% +4.4% +5.3% +12.5% ➖ noise
30 datafusion:vortex-file-compressed +10.1% +4.4% +5.5% +10.9% ➖ noise
30 duckdb:duckdb +3.5% +4.4% -0.8% +11.6% ➖ noise
30 duckdb:vortex-compact -1.1% +4.4% -5.3% +21.9% ➖ noise
30 duckdb:vortex-file-compressed +19.7% +4.4% +14.7% +12.4% 🚨 regression
31 datafusion:vortex-compact +8.6% -1.5% +10.3% +10.9% ➖ noise
31 datafusion:vortex-file-compressed +10.7% -1.5% +12.4% +10.9% 🚨 regression
31 duckdb:duckdb +9.6% -1.5% +11.3% +10.9% 🚨 regression
31 duckdb:vortex-compact +0.3% -1.5% +1.8% +10.9% ➖ noise
31 duckdb:vortex-file-compressed +18.1% -1.5% +19.9% +11.7% 🚨 regression
32 datafusion:vortex-compact -5.6% +7.2% -11.9% +18.7% ➖ noise
32 datafusion:vortex-file-compressed +10.0% +7.2% +2.6% +18.4% ➖ noise
32 duckdb:duckdb +25.8% +7.2% +17.4% +14.1% 🚨 regression
32 duckdb:vortex-compact +8.8% +7.2% +1.5% +10.9% ➖ noise
32 duckdb:vortex-file-compressed +23.6% +7.2% +15.4% +10.9% 🚨 regression
33 datafusion:vortex-compact -3.0% -1.8% -1.3% +10.9% ➖ noise
33 datafusion:vortex-file-compressed +9.3% -1.8% +11.3% +10.9% 🚨 regression
33 duckdb:duckdb +10.1% -1.8% +12.1% +10.9% 🚨 regression
33 duckdb:vortex-compact +6.5% -1.8% +8.5% +10.9% ➖ noise
33 duckdb:vortex-file-compressed +7.2% -1.8% +9.1% +11.5% ➖ noise
34 datafusion:vortex-compact +0.3% -1.0% +1.3% +10.9% ➖ noise
34 datafusion:vortex-file-compressed +8.7% -1.0% +9.8% +11.8% ➖ noise
34 duckdb:duckdb +7.0% -1.0% +8.1% +10.9% ➖ noise
34 duckdb:vortex-compact +0.0% -1.0% +1.0% +11.3% ➖ noise
34 duckdb:vortex-file-compressed +2.0% -1.0% +3.0% +10.9% ➖ noise
35 datafusion:vortex-compact +0.7% +4.6% -3.7% +10.9% ➖ noise
35 datafusion:vortex-file-compressed +7.1% +4.6% +2.4% +10.9% ➖ noise
35 duckdb:duckdb +11.5% +4.6% +6.6% +12.5% ➖ noise
35 duckdb:vortex-compact +1.9% +4.6% -2.5% +10.9% ➖ noise
35 duckdb:vortex-file-compressed +11.5% +4.6% +6.6% +12.0% ➖ noise
36 datafusion:vortex-compact +2.5% +1.3% +1.1% +10.9% ➖ noise
36 datafusion:vortex-file-compressed +1.4% +1.3% +0.1% +11.5% ➖ noise
36 duckdb:duckdb +8.6% +1.3% +7.2% +10.9% ➖ noise
36 duckdb:vortex-compact +4.0% +1.3% +2.7% +11.0% ➖ noise
36 duckdb:vortex-file-compressed +9.2% +1.3% +7.8% +10.9% ➖ noise
37 datafusion:vortex-compact +4.2% -0.6% +4.9% +10.9% ➖ noise
37 datafusion:vortex-file-compressed +15.3% -0.6% +16.0% +13.6% 🚨 regression
37 duckdb:duckdb -1.1% -0.6% -0.4% +14.1% ➖ noise
37 duckdb:vortex-compact +8.9% -0.6% +9.6% +14.7% ➖ noise
37 duckdb:vortex-file-compressed +26.5% -0.6% +27.3% +10.9% 🚨 regression
38 datafusion:vortex-compact +1.5% -2.1% +3.6% +10.9% ➖ noise
38 datafusion:vortex-file-compressed +13.0% -2.1% +15.4% +10.9% 🚨 regression
38 duckdb:duckdb -0.6% -2.1% +1.5% +10.9% ➖ noise
38 duckdb:vortex-compact -2.1% -2.1% -0.0% +10.9% ➖ noise
38 duckdb:vortex-file-compressed +8.2% -2.1% +10.5% +22.3% ➖ noise
39 datafusion:vortex-compact -1.4% +2.7% -3.9% +12.4% ➖ noise
39 datafusion:vortex-file-compressed +13.0% +2.7% +10.0% +11.3% ➖ noise
39 duckdb:duckdb +11.3% +2.7% +8.4% +11.3% ➖ noise
39 duckdb:vortex-compact -2.1% +2.7% -4.7% +20.4% ➖ noise
39 duckdb:vortex-file-compressed +3.6% +2.7% +0.9% +11.4% ➖ noise
40 datafusion:vortex-compact +1.0% +2.0% -1.0% +10.9% ➖ noise
40 datafusion:vortex-file-compressed +9.0% +2.0% +6.9% +10.9% ➖ noise
40 duckdb:duckdb +2.9% +2.0% +0.8% +13.1% ➖ noise
40 duckdb:vortex-compact +4.4% +2.0% +2.3% +14.6% ➖ noise
40 duckdb:vortex-file-compressed +17.6% +2.0% +15.3% +13.1% 🚨 regression
41 datafusion:vortex-compact +5.9% +3.8% +2.0% +10.9% ➖ noise
41 datafusion:vortex-file-compressed +15.2% +3.8% +11.0% +10.9% 🚨 regression
41 duckdb:duckdb +10.4% +3.8% +6.4% +12.2% ➖ noise
41 duckdb:vortex-compact +12.6% +3.8% +8.5% +10.9% ➖ noise
41 duckdb:vortex-file-compressed +19.8% +3.8% +15.4% +10.9% 🚨 regression
42 datafusion:vortex-compact -1.6% +11.1% -11.4% +13.7% ➖ noise
42 datafusion:vortex-file-compressed +11.6% +11.1% +0.4% +25.8% ➖ noise
42 duckdb:duckdb +7.5% +11.1% -3.2% +17.2% ➖ noise
42 duckdb:vortex-compact +6.9% +11.1% -3.8% +14.4% ➖ noise
42 duckdb:vortex-file-compressed +2.9% +11.1% -7.4% +14.4% ➖ noise
43 datafusion:vortex-compact +1.8% +2.5% -0.7% +10.9% ➖ noise
43 datafusion:vortex-file-compressed +3.9% +2.5% +1.3% +10.9% ➖ noise
43 duckdb:duckdb +12.3% +2.5% +9.5% +10.9% ➖ noise
43 duckdb:vortex-compact -0.6% +2.5% -3.1% +19.9% ➖ noise
43 duckdb:vortex-file-compressed +13.0% +2.5% +10.2% +10.9% ➖ noise
44 datafusion:vortex-compact +1.7% +1.2% +0.5% +10.9% ➖ noise
44 datafusion:vortex-file-compressed -2.0% +1.2% -3.2% +14.3% ➖ noise
44 duckdb:duckdb -3.8% +1.2% -5.0% +12.8% ➖ noise
44 duckdb:vortex-compact -5.0% +1.2% -6.2% +13.5% ➖ noise
44 duckdb:vortex-file-compressed +11.3% +1.2% +9.9% +10.9% ➖ noise
45 datafusion:vortex-compact +6.2% +1.6% +4.5% +10.9% ➖ noise
45 datafusion:vortex-file-compressed +0.2% +1.6% -1.5% +10.9% ➖ noise
45 duckdb:duckdb +11.5% +1.6% +9.7% +10.9% ➖ noise
45 duckdb:vortex-compact -1.0% +1.6% -2.6% +11.8% ➖ noise
45 duckdb:vortex-file-compressed +5.2% +1.6% +3.5% +15.0% ➖ noise
46 datafusion:vortex-compact +0.3% +3.2% -2.8% +12.9% ➖ noise
46 datafusion:vortex-file-compressed +2.7% +3.2% -0.5% +11.0% ➖ noise
46 duckdb:duckdb +3.9% +3.2% +0.7% +10.9% ➖ noise
46 duckdb:vortex-compact +4.4% +3.2% +1.2% +10.9% ➖ noise
46 duckdb:vortex-file-compressed +7.5% +3.2% +4.2% +12.2% ➖ noise
47 datafusion:vortex-compact +2.6% -0.2% +2.8% +10.9% ➖ noise
47 datafusion:vortex-file-compressed +10.6% -0.2% +10.8% +10.9% ➖ noise
47 duckdb:duckdb +1.8% -0.2% +2.0% +10.9% ➖ noise
47 duckdb:vortex-compact +1.8% -0.2% +2.1% +10.9% ➖ noise
47 duckdb:vortex-file-compressed +11.5% -0.2% +11.8% +10.9% 🚨 regression
48 datafusion:vortex-compact +1.3% -0.2% +1.4% +10.9% ➖ noise
48 datafusion:vortex-file-compressed +8.3% -0.2% +8.4% +10.9% ➖ noise
48 duckdb:duckdb +2.3% -0.2% +2.5% +10.9% ➖ noise
48 duckdb:vortex-compact +0.3% -0.2% +0.4% +10.9% ➖ noise
48 duckdb:vortex-file-compressed +14.6% -0.2% +14.8% +10.9% 🚨 regression
49 datafusion:vortex-compact +4.7% +1.5% +3.1% +10.9% ➖ noise
49 datafusion:vortex-file-compressed +9.6% +1.5% +7.9% +10.9% ➖ noise
49 duckdb:duckdb +4.1% +1.5% +2.5% +10.9% ➖ noise
49 duckdb:vortex-compact +6.2% +1.5% +4.6% +11.2% ➖ noise
49 duckdb:vortex-file-compressed +3.4% +1.5% +1.8% +13.5% ➖ noise
50 datafusion:vortex-compact +2.6% +0.9% +1.7% +13.1% ➖ noise
50 datafusion:vortex-file-compressed +9.6% +0.9% +8.6% +11.1% ➖ noise
50 duckdb:duckdb +0.9% +0.9% -0.1% +12.4% ➖ noise
50 duckdb:vortex-compact +3.9% +0.9% +3.0% +11.1% ➖ noise
50 duckdb:vortex-file-compressed -3.0% +0.9% -3.9% +14.0% ➖ noise
51 datafusion:vortex-compact +3.3% -1.4% +4.7% +10.9% ➖ noise
51 datafusion:vortex-file-compressed -1.0% -1.4% +0.3% +11.8% ➖ noise
51 duckdb:duckdb +1.8% -1.4% +3.2% +18.7% ➖ noise
51 duckdb:vortex-compact +5.0% -1.4% +6.5% +14.9% ➖ noise
51 duckdb:vortex-file-compressed +6.3% -1.4% +7.8% +20.8% ➖ noise
52 datafusion:vortex-compact +5.7% -1.2% +7.0% +13.8% ➖ noise
52 datafusion:vortex-file-compressed +8.1% -1.2% +9.4% +13.9% ➖ noise
52 duckdb:duckdb +7.4% -1.2% +8.7% +16.5% ➖ noise
52 duckdb:vortex-compact +8.1% -1.2% +9.5% +12.3% ➖ noise
52 duckdb:vortex-file-compressed +17.4% -1.2% +18.8% +24.8% ➖ noise
53 datafusion:vortex-compact +3.9% +4.0% -0.1% +10.9% ➖ noise
53 datafusion:vortex-file-compressed +8.8% +4.0% +4.6% +10.9% ➖ noise
53 duckdb:duckdb +6.2% +4.0% +2.1% +10.9% ➖ noise
53 duckdb:vortex-compact +3.0% +4.0% -0.9% +12.2% ➖ noise
53 duckdb:vortex-file-compressed +10.9% +4.0% +6.7% +10.9% ➖ noise
54 datafusion:vortex-compact +0.9% -0.3% +1.2% +10.9% ➖ noise
54 datafusion:vortex-file-compressed +10.7% -0.3% +11.0% +10.9% 🚨 regression
54 duckdb:duckdb +12.4% -0.3% +12.7% +13.4% ➖ noise
54 duckdb:vortex-compact +1.3% -0.3% +1.6% +11.0% ➖ noise
54 duckdb:vortex-file-compressed -0.2% -0.3% +0.1% +15.2% ➖ noise
55 datafusion:vortex-compact -0.2% +2.4% -2.5% +10.9% ➖ noise
55 datafusion:vortex-file-compressed +16.3% +2.4% +13.7% +15.0% ➖ noise
55 duckdb:duckdb +6.2% +2.4% +3.7% +14.9% ➖ noise
55 duckdb:vortex-compact +7.2% +2.4% +4.8% +10.9% ➖ noise
55 duckdb:vortex-file-compressed +9.5% +2.4% +7.0% +12.5% ➖ noise
56 datafusion:vortex-compact +7.0% +0.9% +6.0% +10.9% ➖ noise
56 datafusion:vortex-file-compressed +12.6% +0.9% +11.6% +10.9% 🚨 regression
56 duckdb:duckdb +8.9% +0.9% +7.9% +10.9% ➖ noise
56 duckdb:vortex-compact +9.6% +0.9% +8.6% +16.7% ➖ noise
56 duckdb:vortex-file-compressed +7.8% +0.9% +6.8% +10.9% ➖ noise
57 datafusion:vortex-compact -0.7% +0.5% -1.2% +12.2% ➖ noise
57 datafusion:vortex-file-compressed +3.5% +0.5% +2.9% +11.6% ➖ noise
57 duckdb:duckdb +3.5% +0.5% +2.9% +13.3% ➖ noise
57 duckdb:vortex-compact +2.5% +0.5% +1.9% +11.6% ➖ noise
57 duckdb:vortex-file-compressed +10.2% +0.5% +9.6% +14.5% ➖ noise
58 datafusion:vortex-compact -0.9% +3.5% -4.2% +10.9% ➖ noise
58 datafusion:vortex-file-compressed +3.9% +3.5% +0.4% +10.9% ➖ noise
58 duckdb:duckdb +6.2% +3.5% +2.6% +11.0% ➖ noise
58 duckdb:vortex-compact -6.9% +3.5% -10.0% +11.5% ➖ noise
58 duckdb:vortex-file-compressed +10.4% +3.5% +6.7% +19.8% ➖ noise
59 datafusion:vortex-compact +0.4% +0.2% +0.1% +10.9% ➖ noise
59 datafusion:vortex-file-compressed +6.3% +0.2% +6.1% +10.9% ➖ noise
59 duckdb:duckdb +0.7% +0.2% +0.5% +10.9% ➖ noise
59 duckdb:vortex-compact +5.7% +0.2% +5.4% +15.5% ➖ noise
59 duckdb:vortex-file-compressed -0.9% +0.2% -1.2% +10.9% ➖ noise
60 datafusion:vortex-compact +1.6% -2.4% +4.1% +12.6% ➖ noise
60 datafusion:vortex-file-compressed +8.0% -2.4% +10.7% +10.9% ➖ noise
60 duckdb:duckdb +6.3% -2.4% +9.0% +11.9% ➖ noise
60 duckdb:vortex-compact +10.0% -2.4% +12.7% +11.4% 🚨 regression
60 duckdb:vortex-file-compressed +6.9% -2.4% +9.6% +11.0% ➖ noise
61 datafusion:vortex-compact +1.0% +4.5% -3.3% +10.9% ➖ noise
61 datafusion:vortex-file-compressed +11.8% +4.5% +7.0% +10.9% ➖ noise
61 duckdb:duckdb +2.5% +4.5% -2.0% +10.9% ➖ noise
61 duckdb:vortex-compact +8.7% +4.5% +4.0% +10.9% ➖ noise
61 duckdb:vortex-file-compressed +3.9% +4.5% -0.6% +12.2% ➖ noise
62 datafusion:vortex-compact +7.1% -5.6% +13.5% +31.9% ➖ noise
62 datafusion:vortex-file-compressed +34.9% -5.6% +42.9% +25.6% 🚨 regression
62 duckdb:duckdb +4.3% -5.6% +10.5% +15.0% ➖ noise
62 duckdb:vortex-compact -1.8% -5.6% +4.0% +23.3% ➖ noise
62 duckdb:vortex-file-compressed +12.8% -5.6% +19.5% +15.7% 🚨 regression
63 datafusion:vortex-compact +3.6% +1.8% +1.8% +10.9% ➖ noise
63 datafusion:vortex-file-compressed +10.3% +1.8% +8.4% +10.9% ➖ noise
63 duckdb:duckdb +3.5% +1.8% +1.8% +10.9% ➖ noise
63 duckdb:vortex-compact +4.1% +1.8% +2.3% +10.9% ➖ noise
63 duckdb:vortex-file-compressed +15.3% +1.8% +13.3% +10.9% 🚨 regression
64 datafusion:vortex-compact +4.1% -0.3% +4.3% +10.9% ➖ noise
64 datafusion:vortex-file-compressed +8.2% -0.3% +8.5% +10.9% ➖ noise
64 duckdb:duckdb +5.4% -0.3% +5.6% +10.9% ➖ noise
64 duckdb:vortex-compact +6.4% -0.3% +6.7% +10.9% ➖ noise
64 duckdb:vortex-file-compressed +7.2% -0.3% +7.5% +10.9% ➖ noise
65 datafusion:vortex-compact +5.8% +8.0% -2.0% +10.9% ➖ noise
65 datafusion:vortex-file-compressed +8.0% +8.0% -0.0% +10.9% ➖ noise
65 duckdb:duckdb +3.1% +8.0% -4.6% +14.3% ➖ noise
65 duckdb:vortex-compact +2.5% +8.0% -5.1% +20.8% ➖ noise
65 duckdb:vortex-file-compressed -0.4% +8.0% -7.8% +11.6% ➖ noise
66 datafusion:vortex-compact +4.9% -2.0% +7.1% +10.9% ➖ noise
66 datafusion:vortex-file-compressed +11.2% -2.0% +13.5% +13.0% 🚨 regression
66 duckdb:duckdb +5.0% -2.0% +7.2% +10.9% ➖ noise
66 duckdb:vortex-compact +10.9% -2.0% +13.2% +12.0% 🚨 regression
66 duckdb:vortex-file-compressed +15.8% -2.0% +18.2% +14.3% 🚨 regression
67 datafusion:vortex-compact +8.7% +4.0% +4.5% +10.9% ➖ noise
67 datafusion:vortex-file-compressed +4.9% +4.0% +0.8% +10.9% ➖ noise
67 duckdb:duckdb +3.3% +4.0% -0.7% +10.9% ➖ noise
67 duckdb:vortex-compact +7.2% +4.0% +3.0% +10.9% ➖ noise
67 duckdb:vortex-file-compressed +6.4% +4.0% +2.3% +10.9% ➖ noise
68 datafusion:vortex-compact -4.2% +3.5% -7.4% +14.7% ➖ noise
68 datafusion:vortex-file-compressed -5.1% +3.5% -8.3% +14.2% ➖ noise
68 duckdb:duckdb +2.7% +3.5% -0.8% +10.9% ➖ noise
68 duckdb:vortex-compact +2.7% +3.5% -0.8% +10.9% ➖ noise
68 duckdb:vortex-file-compressed +14.5% +3.5% +10.7% +10.9% ➖ noise
69 datafusion:vortex-compact +6.5% +6.0% +0.5% +10.9% ➖ noise
69 datafusion:vortex-file-compressed +8.2% +6.0% +2.0% +10.9% ➖ noise
69 duckdb:duckdb -2.0% +6.0% -7.6% +14.0% ➖ noise
69 duckdb:vortex-compact +8.1% +6.0% +1.9% +10.9% ➖ noise
69 duckdb:vortex-file-compressed +2.3% +6.0% -3.6% +11.6% ➖ noise
70 datafusion:vortex-compact +6.3% -1.3% +7.7% +10.9% ➖ noise
70 datafusion:vortex-file-compressed +12.3% -1.3% +13.7% +10.9% 🚨 regression
70 duckdb:duckdb +5.6% -1.3% +7.0% +13.6% ➖ noise
70 duckdb:vortex-compact +3.2% -1.3% +4.6% +10.9% ➖ noise
70 duckdb:vortex-file-compressed +13.8% -1.3% +15.3% +12.4% 🚨 regression
71 datafusion:vortex-compact +1.7% +11.0% -8.4% +13.2% ➖ noise
71 datafusion:vortex-file-compressed +7.7% +11.0% -3.0% +15.3% ➖ noise
71 duckdb:duckdb +14.5% +11.0% +3.2% +12.9% ➖ noise
71 duckdb:vortex-compact +1.7% +11.0% -8.4% +17.6% ➖ noise
71 duckdb:vortex-file-compressed +21.4% +11.0% +9.4% +10.9% ➖ noise
72 datafusion:vortex-compact +10.3% +7.6% +2.5% +10.9% ➖ noise
72 datafusion:vortex-file-compressed +10.9% +7.6% +3.0% +10.9% ➖ noise
72 duckdb:duckdb +5.5% +7.6% -2.0% +10.9% ➖ noise
72 duckdb:vortex-compact +1.1% +7.6% -6.1% +10.9% ➖ noise
72 duckdb:vortex-file-compressed +6.5% +7.6% -1.1% +10.9% ➖ noise
73 datafusion:vortex-compact +4.5% +4.3% +0.2% +10.9% ➖ noise
73 datafusion:vortex-file-compressed +9.4% +4.3% +4.9% +10.9% ➖ noise
73 duckdb:duckdb +4.2% +4.3% -0.1% +11.3% ➖ noise
73 duckdb:vortex-compact +1.3% +4.3% -2.8% +13.6% ➖ noise
73 duckdb:vortex-file-compressed +18.1% +4.3% +13.3% +10.9% 🚨 regression
74 datafusion:vortex-compact +6.4% +4.7% +1.7% +10.9% ➖ noise
74 datafusion:vortex-file-compressed +6.4% +4.7% +1.6% +10.9% ➖ noise
74 duckdb:duckdb -0.1% +4.7% -4.6% +10.9% ➖ noise
74 duckdb:vortex-compact +2.9% +4.7% -1.7% +20.6% ➖ noise
74 duckdb:vortex-file-compressed +5.0% +4.7% +0.3% +11.5% ➖ noise
75 datafusion:vortex-compact +4.1% +9.1% -4.7% +10.9% ➖ noise
75 datafusion:vortex-file-compressed +5.9% +9.1% -3.0% +11.0% ➖ noise
75 duckdb:duckdb +1.9% +9.1% -6.6% +10.9% ➖ noise
75 duckdb:vortex-compact +5.5% +9.1% -3.3% +14.6% ➖ noise
75 duckdb:vortex-file-compressed +2.3% +9.1% -6.3% +11.2% ➖ noise
76 datafusion:vortex-compact +4.5% +5.9% -1.4% +10.9% ➖ noise
76 datafusion:vortex-file-compressed +9.8% +5.9% +3.7% +10.9% ➖ noise
76 duckdb:duckdb +8.1% +5.9% +2.0% +16.9% ➖ noise
76 duckdb:vortex-compact +6.5% +5.9% +0.5% +10.9% ➖ noise
76 duckdb:vortex-file-compressed +16.5% +5.9% +10.0% +10.9% ➖ noise
77 datafusion:vortex-compact +1.0% +5.6% -4.4% +10.9% ➖ noise
77 datafusion:vortex-file-compressed +10.0% +5.6% +4.1% +10.9% ➖ noise
77 duckdb:duckdb +2.8% +5.6% -2.7% +10.9% ➖ noise
77 duckdb:vortex-compact +6.2% +5.6% +0.6% +15.9% ➖ noise
77 duckdb:vortex-file-compressed +18.2% +5.6% +11.9% +19.5% ➖ noise
78 datafusion:vortex-compact +6.6% +9.2% -2.4% +10.9% ➖ noise
78 datafusion:vortex-file-compressed +11.4% +9.2% +2.0% +10.9% ➖ noise
78 duckdb:duckdb +0.5% +9.2% -8.0% +10.9% ➖ noise
78 duckdb:vortex-compact +7.1% +9.2% -2.0% +13.2% ➖ noise
78 duckdb:vortex-file-compressed +1.7% +9.2% -6.9% +12.6% ➖ noise
79 datafusion:vortex-compact -1.5% +8.6% -9.3% +10.9% ➖ noise
79 datafusion:vortex-file-compressed +13.8% +8.6% +4.8% +10.9% ➖ noise
79 duckdb:duckdb +2.0% +8.6% -6.0% +10.9% ➖ noise
79 duckdb:vortex-compact +7.1% +8.6% -1.4% +10.9% ➖ noise
79 duckdb:vortex-file-compressed +4.3% +8.6% -3.9% +10.9% ➖ noise
80 datafusion:vortex-compact +6.5% +6.9% -0.4% +10.9% ➖ noise
80 datafusion:vortex-file-compressed +11.8% +6.9% +4.6% +10.9% ➖ noise
80 duckdb:duckdb +0.9% +6.9% -5.6% +10.9% ➖ noise
80 duckdb:vortex-compact +19.1% +6.9% +11.4% +14.5% ➖ noise
80 duckdb:vortex-file-compressed +22.6% +6.9% +14.6% +10.9% 🚨 regression
81 datafusion:vortex-compact +7.9% +9.5% -1.5% +18.6% ➖ noise
81 datafusion:vortex-file-compressed +14.3% +9.5% +4.4% +10.9% ➖ noise
81 duckdb:duckdb +12.6% +9.5% +2.8% +10.9% ➖ noise
81 duckdb:vortex-compact +4.5% +9.5% -4.6% +11.1% ➖ noise
81 duckdb:vortex-file-compressed +10.8% +9.5% +1.2% +10.9% ➖ noise
82 datafusion:vortex-compact -1.2% +9.4% -9.7% +10.9% ➖ noise
82 datafusion:vortex-file-compressed +12.3% +9.4% +2.6% +18.1% ➖ noise
82 duckdb:duckdb +5.3% +9.4% -3.8% +12.3% ➖ noise
82 duckdb:vortex-compact +11.8% +9.4% +2.2% +19.2% ➖ noise
82 duckdb:vortex-file-compressed +8.9% +9.4% -0.5% +10.9% ➖ noise
83 datafusion:vortex-compact -0.0% +9.3% -8.5% +10.9% ➖ noise
83 datafusion:vortex-file-compressed +6.1% +9.3% -3.0% +10.9% ➖ noise
83 duckdb:duckdb +11.8% +9.3% +2.2% +10.9% ➖ noise
83 duckdb:vortex-compact +18.7% +9.3% +8.6% +18.2% ➖ noise
83 duckdb:vortex-file-compressed +11.6% +9.3% +2.1% +10.9% ➖ noise
84 datafusion:vortex-compact +7.2% +5.3% +1.8% +13.4% ➖ noise
84 datafusion:vortex-file-compressed +15.4% +5.3% +9.5% +10.9% ➖ noise
84 duckdb:duckdb +0.8% +5.3% -4.3% +10.9% ➖ noise
84 duckdb:vortex-compact +8.7% +5.3% +3.2% +10.9% ➖ noise
84 duckdb:vortex-file-compressed +17.0% +5.3% +11.1% +11.4% ➖ noise
85 datafusion:vortex-compact +3.9% +7.8% -3.6% +11.6% ➖ noise
85 datafusion:vortex-file-compressed +13.3% +7.8% +5.1% +10.9% ➖ noise
85 duckdb:duckdb +3.8% +7.8% -3.7% +10.9% ➖ noise
85 duckdb:vortex-compact +15.0% +7.8% +6.7% +10.9% ➖ noise
85 duckdb:vortex-file-compressed +19.9% +7.8% +11.3% +10.9% 🚨 regression
86 datafusion:vortex-compact -7.6% +8.9% -15.1% +19.2% ➖ noise
86 datafusion:vortex-file-compressed +18.7% +8.9% +9.0% +13.7% ➖ noise
86 duckdb:duckdb +7.3% +8.9% -1.4% +14.2% ➖ noise
86 duckdb:vortex-compact +4.1% +8.9% -4.4% +13.6% ➖ noise
86 duckdb:vortex-file-compressed +6.1% +8.9% -2.5% +14.4% ➖ noise
87 datafusion:vortex-compact +4.0% +10.7% -6.0% +10.9% ➖ noise
87 datafusion:vortex-file-compressed +0.6% +10.7% -9.1% +10.9% ➖ noise
87 duckdb:duckdb +12.1% +10.7% +1.3% +10.9% ➖ noise
87 duckdb:vortex-compact +5.1% +10.7% -5.1% +11.0% ➖ noise
87 duckdb:vortex-file-compressed +0.1% +10.7% -9.5% +10.9% ➖ noise
88 datafusion:vortex-compact +1.2% +3.5% -2.3% +10.9% ➖ noise
88 datafusion:vortex-file-compressed +7.9% +3.5% +4.2% +10.9% ➖ noise
88 duckdb:duckdb +2.7% +3.5% -0.8% +10.9% ➖ noise
88 duckdb:vortex-compact +6.0% +3.5% +2.4% +10.9% ➖ noise
88 duckdb:vortex-file-compressed +7.0% +3.5% +3.4% +10.9% ➖ noise
89 datafusion:vortex-compact +2.6% +5.4% -2.6% +10.9% ➖ noise
89 datafusion:vortex-file-compressed +9.6% +5.4% +4.0% +10.9% ➖ noise
89 duckdb:duckdb +1.1% +5.4% -4.1% +11.1% ➖ noise
89 duckdb:vortex-compact +6.4% +5.4% +1.0% +10.9% ➖ noise
89 duckdb:vortex-file-compressed -3.5% +5.4% -8.4% +18.6% ➖ noise
90 datafusion:vortex-compact +5.8% +2.8% +2.9% +11.9% ➖ noise
90 datafusion:vortex-file-compressed +5.5% +2.8% +2.6% +21.0% ➖ noise
90 duckdb:duckdb +12.3% +2.8% +9.2% +13.5% ➖ noise
90 duckdb:vortex-compact +7.8% +2.8% +4.9% +15.0% ➖ noise
90 duckdb:vortex-file-compressed +10.0% +2.8% +7.0% +10.9% ➖ noise
91 datafusion:vortex-compact -0.6% +6.2% -6.4% +10.9% ➖ noise
91 datafusion:vortex-file-compressed +17.3% +6.2% +10.4% +10.9% ➖ noise
91 duckdb:duckdb +17.6% +6.2% +10.8% +26.7% ➖ noise
91 duckdb:vortex-compact +2.2% +6.2% -3.8% +10.9% ➖ noise
91 duckdb:vortex-file-compressed +3.7% +6.2% -2.4% +10.9% ➖ noise
92 datafusion:vortex-compact +6.4% +10.7% -3.9% +14.0% ➖ noise
92 datafusion:vortex-file-compressed +19.2% +10.7% +7.7% +10.9% ➖ noise
92 duckdb:duckdb +3.9% +10.7% -6.2% +10.9% ➖ noise
92 duckdb:vortex-compact -7.1% +10.7% -16.1% +18.5% ✅ faster
92 duckdb:vortex-file-compressed +24.4% +10.7% +12.3% +14.2% ➖ noise
93 datafusion:vortex-compact +7.6% +13.8% -5.5% +10.9% ➖ noise
93 datafusion:vortex-file-compressed +16.1% +13.8% +2.0% +10.9% ➖ noise
93 duckdb:duckdb +0.1% +13.8% -12.1% +11.7% ✅ faster
93 duckdb:vortex-compact +10.4% +13.8% -3.0% +15.9% ➖ noise
93 duckdb:vortex-file-compressed +7.7% +13.8% -5.4% +13.9% ➖ noise
94 datafusion:vortex-compact +5.2% +13.3% -7.2% +11.6% ➖ noise
94 datafusion:vortex-file-compressed -2.3% +13.3% -13.7% +19.7% ➖ noise
94 duckdb:duckdb -0.9% +13.3% -12.5% +11.6% ✅ faster
94 duckdb:vortex-compact +28.3% +13.3% +13.2% +10.9% 🚨 regression
94 duckdb:vortex-file-compressed +4.0% +13.3% -8.2% +11.3% ➖ noise
95 datafusion:vortex-compact +5.9% +14.6% -7.6% +11.3% ➖ noise
95 datafusion:vortex-file-compressed +5.4% +14.6% -8.0% +13.4% ➖ noise
95 duckdb:duckdb +0.9% +14.6% -11.9% +19.1% ➖ noise
95 duckdb:vortex-compact -0.8% +14.6% -13.4% +20.5% ➖ noise
95 duckdb:vortex-file-compressed +0.4% +14.6% -12.4% +14.1% ✅ faster
96 datafusion:vortex-compact +3.0% +8.6% -5.2% +10.9% ➖ noise
96 datafusion:vortex-file-compressed +6.8% +8.6% -1.7% +10.9% ➖ noise
96 duckdb:duckdb +4.8% +8.6% -3.5% +14.5% ➖ noise
96 duckdb:vortex-compact -4.0% +8.6% -11.5% +13.1% ➖ noise
96 duckdb:vortex-file-compressed -8.9% +8.6% -16.1% +25.8% ➖ noise
97 datafusion:vortex-compact +0.2% +11.7% -10.3% +10.9% ✅ faster
97 datafusion:vortex-file-compressed +1.5% +11.7% -9.1% +12.8% ➖ noise
97 duckdb:duckdb +2.9% +11.7% -7.9% +10.9% ➖ noise
97 duckdb:vortex-compact +6.5% +11.7% -4.6% +17.5% ➖ noise
97 duckdb:vortex-file-compressed +1.0% +11.7% -9.6% +17.1% ➖ noise
98 datafusion:vortex-compact +0.9% +8.5% -7.0% +13.5% ➖ noise
98 datafusion:vortex-file-compressed -0.6% +8.5% -8.4% +10.9% ➖ noise
98 duckdb:duckdb -5.4% +8.5% -12.8% +14.4% ✅ faster
98 duckdb:vortex-compact +16.7% +8.5% +7.6% +10.9% ➖ noise
98 duckdb:vortex-file-compressed +6.4% +8.5% -1.9% +14.5% ➖ noise
99 datafusion:vortex-compact -9.6% +9.1% -17.1% +17.2% ✅ faster
99 datafusion:vortex-file-compressed -5.9% +9.1% -13.7% +20.8% ➖ noise
99 duckdb:duckdb +3.1% +9.1% -5.4% +18.8% ➖ noise
99 duckdb:vortex-compact +10.3% +9.1% +1.2% +14.8% ➖ noise
99 duckdb:vortex-file-compressed +5.8% +9.1% -3.0% +13.9% ➖ noise

@github-actions
Copy link
Copy Markdown
Contributor

File Sizes: TPC-DS SF=1 on NVME

No file size changes detected.

@github-actions
Copy link
Copy Markdown
Contributor

github-actions Bot commented Apr 25, 2026

Benchmarks: FineWeb S3

Verdict: No clear signal (environment too noisy confidence)
Attributed Vortex impact: +6.8%
Vortex (geomean): 1.000x ➖
Parquet (geomean): 0.937x ➖
Shifts: Parquet (control) -6.3% · Median polish -0.3%


datafusion / vortex-file-compressed (1.018x ➖, 0↑ 0↓)
name PR ca6942f (ns) base 1838a7a (ns) ratio (PR/base)
fineweb_q00/datafusion:vortex-file-compressed 35810915 33123049 1.08
fineweb_q01/datafusion:vortex-file-compressed 600646534 536107498 1.12
fineweb_q02/datafusion:vortex-file-compressed 417695776 440989626 0.95
fineweb_q03/datafusion:vortex-file-compressed 1477967739 1376489105 1.07
fineweb_q04/datafusion:vortex-file-compressed 1369582717 1370664092 1.00
fineweb_q05/datafusion:vortex-file-compressed 1361710335 1354760489 1.01
fineweb_q06/datafusion:vortex-file-compressed 1539984045 1514895864 1.02
fineweb_q07/datafusion:vortex-file-compressed 1359809440 1381037320 0.98
fineweb_q08/datafusion:vortex-file-compressed 533654332 564738367 0.94
datafusion / vortex-compact (0.990x ➖, 0↑ 0↓)
name PR ca6942f (ns) base 1838a7a (ns) ratio (PR/base)
fineweb_q00/datafusion:vortex-compact 33127607 35906144 0.92
fineweb_q01/datafusion:vortex-compact 522764187 472981915 1.11
fineweb_q02/datafusion:vortex-compact 548892408 563974893 0.97
fineweb_q03/datafusion:vortex-compact 1467012340 1479677060 0.99
fineweb_q04/datafusion:vortex-compact 1813935346 1725931666 1.05
fineweb_q05/datafusion:vortex-compact 1464829377 1426068576 1.03
fineweb_q06/datafusion:vortex-compact 1313926485 1361308784 0.97
fineweb_q07/datafusion:vortex-compact 1242791721 1236840465 1.00
fineweb_q08/datafusion:vortex-compact 391544297 441332048 0.89
datafusion / parquet (0.926x ➖, 1↑ 0↓)
name PR ca6942f (ns) base 1838a7a (ns) ratio (PR/base)
fineweb_q00/datafusion:parquet 🚀 1120807384 1684054582 0.67
fineweb_q01/datafusion:parquet 1687011054 1683824235 1.00
fineweb_q02/datafusion:parquet 1637310649 1698688754 0.96
fineweb_q03/datafusion:parquet 1664361629 1665250111 1.00
fineweb_q04/datafusion:parquet 1683748240 1635880200 1.03
fineweb_q05/datafusion:parquet 1611916932 1699828797 0.95
fineweb_q06/datafusion:parquet 1605639579 1748212665 0.92
fineweb_q07/datafusion:parquet 1745585020 1654085232 1.06
fineweb_q08/datafusion:parquet 1580617109 1925886280 0.82
duckdb / vortex-file-compressed (0.995x ➖, 0↑ 0↓)
name PR ca6942f (ns) base 1838a7a (ns) ratio (PR/base)
fineweb_q00/duckdb:vortex-file-compressed 80591966 85685170 0.94
fineweb_q01/duckdb:vortex-file-compressed 545058055 542207487 1.01
fineweb_q02/duckdb:vortex-file-compressed 467083602 454796844 1.03
fineweb_q03/duckdb:vortex-file-compressed 1455372481 1444070947 1.01
fineweb_q04/duckdb:vortex-file-compressed 1555245203 1519276696 1.02
fineweb_q05/duckdb:vortex-file-compressed 1509241311 1492446746 1.01
fineweb_q06/duckdb:vortex-file-compressed 1710959134 1631348263 1.05
fineweb_q07/duckdb:vortex-file-compressed 1482958939 1463942715 1.01
fineweb_q08/duckdb:vortex-file-compressed 616221412 694976938 0.89
duckdb / vortex-compact (0.999x ➖, 0↑ 0↓)
name PR ca6942f (ns) base 1838a7a (ns) ratio (PR/base)
fineweb_q00/duckdb:vortex-compact 82777984 81909873 1.01
fineweb_q01/duckdb:vortex-compact 515995307 563179911 0.92
fineweb_q02/duckdb:vortex-compact 542166524 563146996 0.96
fineweb_q03/duckdb:vortex-compact 1672569713 1709019211 0.98
fineweb_q04/duckdb:vortex-compact 1726687450 1701799856 1.01
fineweb_q05/duckdb:vortex-compact 1525434277 1498432449 1.02
fineweb_q06/duckdb:vortex-compact 1400845365 1475774479 0.95
fineweb_q07/duckdb:vortex-compact 1321833882 1296799251 1.02
fineweb_q08/duckdb:vortex-compact 521262140 458452786 1.14
duckdb / parquet (0.948x ➖, 0↑ 0↓)
name PR ca6942f (ns) base 1838a7a (ns) ratio (PR/base)
fineweb_q00/duckdb:parquet 1035895921 1106775022 0.94
fineweb_q01/duckdb:parquet 1265433572 1384474419 0.91
fineweb_q02/duckdb:parquet 1256041805 1342060595 0.94
fineweb_q03/duckdb:parquet 3409102734 3527031907 0.97
fineweb_q04/duckdb:parquet 1795211574 1821144346 0.99
fineweb_q05/duckdb:parquet 2084197414 2118776518 0.98
fineweb_q06/duckdb:parquet 4068804979 4191601542 0.97
fineweb_q07/duckdb:parquet 2446363699 2671429185 0.92
fineweb_q08/duckdb:parquet 1014342089 1089700134 0.93
Full attributed analysis
Query Config Raw Δ Control Δ Attributed α Noise floor Significant?
0 datafusion:vortex-compact -7.7% -21.1% +16.9% +197.8% ➖ noise
0 datafusion:vortex-file-compressed +8.1% -21.1% +37.0% +156.7% ➖ noise
0 duckdb:vortex-compact +1.1% -21.1% +28.0% +31.0% ➖ noise
0 duckdb:vortex-file-compressed -5.9% -21.1% +19.2% +30.0% ➖ noise
1 datafusion:vortex-compact +10.5% -4.3% +15.5% +74.5% ➖ noise
1 datafusion:vortex-file-compressed +12.0% -4.3% +17.1% +62.5% ➖ noise
1 duckdb:vortex-compact -8.4% -4.3% -4.3% +30.0% ➖ noise
1 duckdb:vortex-file-compressed +0.5% -4.3% +5.0% +30.0% ➖ noise
2 datafusion:vortex-compact -2.7% -5.0% +2.5% +30.0% ➖ noise
2 datafusion:vortex-file-compressed -5.3% -5.0% -0.3% +54.5% ➖ noise
2 duckdb:vortex-compact -3.7% -5.0% +1.4% +30.0% ➖ noise
2 duckdb:vortex-file-compressed +2.7% -5.0% +8.1% +30.4% ➖ noise
3 datafusion:vortex-compact -0.9% -1.7% +0.9% +30.0% ➖ noise
3 datafusion:vortex-file-compressed +7.4% -1.7% +9.2% +30.0% ➖ noise
3 duckdb:vortex-compact -2.1% -1.7% -0.4% +30.0% ➖ noise
3 duckdb:vortex-file-compressed +0.8% -1.7% +2.5% +30.0% ➖ noise
4 datafusion:vortex-compact +5.1% +0.7% +4.3% +30.0% ➖ noise
4 datafusion:vortex-file-compressed -0.1% +0.7% -0.8% +30.0% ➖ noise
4 duckdb:vortex-compact +1.5% +0.7% +0.7% +30.0% ➖ noise
4 duckdb:vortex-file-compressed +2.4% +0.7% +1.6% +30.0% ➖ noise
5 datafusion:vortex-compact +2.7% -3.4% +6.4% +30.0% ➖ noise
5 datafusion:vortex-file-compressed +0.5% -3.4% +4.1% +30.0% ➖ noise
5 duckdb:vortex-compact +1.8% -3.4% +5.4% +30.0% ➖ noise
5 duckdb:vortex-file-compressed +1.1% -3.4% +4.7% +30.0% ➖ noise
6 datafusion:vortex-compact -3.5% -5.6% +2.2% +30.0% ➖ noise
6 datafusion:vortex-file-compressed +1.7% -5.6% +7.7% +30.0% ➖ noise
6 duckdb:vortex-compact -5.1% -5.6% +0.5% +30.0% ➖ noise
6 duckdb:vortex-file-compressed +4.9% -5.6% +11.1% +30.0% ➖ noise
7 datafusion:vortex-compact +0.5% -1.7% +2.2% +30.0% ➖ noise
7 datafusion:vortex-file-compressed -1.5% -1.7% +0.2% +30.0% ➖ noise
7 duckdb:vortex-compact +1.9% -1.7% +3.7% +30.0% ➖ noise
7 duckdb:vortex-file-compressed +1.3% -1.7% +3.0% +30.0% ➖ noise
8 datafusion:vortex-compact -11.3% -12.6% +1.5% +30.0% ➖ noise
8 datafusion:vortex-file-compressed -5.5% -12.6% +8.1% +30.0% ➖ noise
8 duckdb:vortex-compact +13.7% -12.6% +30.1% +30.0% 🚨 regression
8 duckdb:vortex-file-compressed -11.3% -12.6% +1.4% +30.0% ➖ noise

Signed-off-by: Adam Gutglick <adam@spiraldb.com>
@AdamGS AdamGS added the action/benchmark-sql Trigger SQL benchmarks to run on this PR label Apr 25, 2026
@github-actions github-actions Bot removed the action/benchmark-sql Trigger SQL benchmarks to run on this PR label Apr 25, 2026
@github-actions
Copy link
Copy Markdown
Contributor

Benchmarks: TPC-H SF=10 on NVME

Verdict: No clear signal (low confidence)
Attributed Vortex impact: +2.7%
Vortex (geomean): 1.082x ➖
Parquet (geomean): 1.037x ➖
Shifts: Parquet (control) +3.7% · Median polish +5.7%


datafusion / vortex-file-compressed (1.058x ➖, 0↑ 1↓)
name PR ca6942f (ns) base 1838a7a (ns) ratio (PR/base)
tpch_q01/datafusion:vortex-file-compressed 423682378 389989791 1.09
tpch_q02/datafusion:vortex-file-compressed 115793668 107127362 1.08
tpch_q03/datafusion:vortex-file-compressed 221726453 212127400 1.05
tpch_q04/datafusion:vortex-file-compressed 115504869 113262382 1.02
tpch_q05/datafusion:vortex-file-compressed 381765964 364105008 1.05
tpch_q06/datafusion:vortex-file-compressed 48228412 44630646 1.08
tpch_q07/datafusion:vortex-file-compressed 519551560 494671016 1.05
tpch_q08/datafusion:vortex-file-compressed 370063365 348812428 1.06
tpch_q09/datafusion:vortex-file-compressed 654892004 619858015 1.06
tpch_q10/datafusion:vortex-file-compressed 241236739 230358631 1.05
tpch_q11/datafusion:vortex-file-compressed 83888815 82340560 1.02
tpch_q12/datafusion:vortex-file-compressed 124484383 120549051 1.03
tpch_q13/datafusion:vortex-file-compressed 230438044 211861435 1.09
tpch_q14/datafusion:vortex-file-compressed 59355126 57589046 1.03
tpch_q15/datafusion:vortex-file-compressed 107760305 108111879 1.00
tpch_q16/datafusion:vortex-file-compressed 🚨 90927700 75952347 1.20
tpch_q17/datafusion:vortex-file-compressed 668436150 614040506 1.09
tpch_q18/datafusion:vortex-file-compressed 877759468 816669242 1.07
tpch_q19/datafusion:vortex-file-compressed 96517100 91016681 1.06
tpch_q20/datafusion:vortex-file-compressed 171629032 165167054 1.04
tpch_q21/datafusion:vortex-file-compressed 660940754 636861695 1.04
tpch_q22/datafusion:vortex-file-compressed 66971920 64254133 1.04
datafusion / vortex-compact (1.084x ➖, 0↑ 8↓)
name PR ca6942f (ns) base 1838a7a (ns) ratio (PR/base)
tpch_q01/datafusion:vortex-compact 442870884 443553087 1.00
tpch_q02/datafusion:vortex-compact 108698755 105753521 1.03
tpch_q03/datafusion:vortex-compact 216391825 213609634 1.01
tpch_q04/datafusion:vortex-compact 129070058 122108001 1.06
tpch_q05/datafusion:vortex-compact 🚨 405818694 367288159 1.10
tpch_q06/datafusion:vortex-compact 69119596 64575729 1.07
tpch_q07/datafusion:vortex-compact 🚨 586440844 509680904 1.15
tpch_q08/datafusion:vortex-compact 🚨 416758895 353800943 1.18
tpch_q09/datafusion:vortex-compact 🚨 742190854 622486131 1.19
tpch_q10/datafusion:vortex-compact 🚨 285802243 246593587 1.16
tpch_q11/datafusion:vortex-compact 86218248 84707975 1.02
tpch_q12/datafusion:vortex-compact 177301388 164713636 1.08
tpch_q13/datafusion:vortex-compact 287918099 262942217 1.09
tpch_q14/datafusion:vortex-compact 🚨 87168873 73905185 1.18
tpch_q15/datafusion:vortex-compact 🚨 188289115 160015983 1.18
tpch_q16/datafusion:vortex-compact 82710100 78659389 1.05
tpch_q17/datafusion:vortex-compact 679996107 622181090 1.09
tpch_q18/datafusion:vortex-compact 853854622 824711432 1.04
tpch_q19/datafusion:vortex-compact 130690603 128006249 1.02
tpch_q20/datafusion:vortex-compact 194505327 190856100 1.02
tpch_q21/datafusion:vortex-compact 🚨 758957572 648881708 1.17
tpch_q22/datafusion:vortex-compact 75230213 74752746 1.01
datafusion / parquet (1.023x ➖, 0↑ 1↓)
name PR ca6942f (ns) base 1838a7a (ns) ratio (PR/base)
tpch_q01/datafusion:parquet 459964584 473966878 0.97
tpch_q02/datafusion:parquet 172953547 173768792 1.00
tpch_q03/datafusion:parquet 288534098 286270963 1.01
tpch_q04/datafusion:parquet 132914365 130586695 1.02
tpch_q05/datafusion:parquet 440145481 436831892 1.01
tpch_q06/datafusion:parquet 134940492 128021475 1.05
tpch_q07/datafusion:parquet 606401993 609521599 0.99
tpch_q08/datafusion:parquet 469590039 468894441 1.00
tpch_q09/datafusion:parquet 747452967 740403629 1.01
tpch_q10/datafusion:parquet 501240853 502717995 1.00
tpch_q11/datafusion:parquet 121324251 120675809 1.01
tpch_q12/datafusion:parquet 212348681 211515213 1.00
tpch_q13/datafusion:parquet 331347395 332933114 1.00
tpch_q14/datafusion:parquet 169189840 158388876 1.07
tpch_q15/datafusion:parquet 263699633 255145525 1.03
tpch_q16/datafusion:parquet 136552515 129072645 1.06
tpch_q17/datafusion:parquet 🚨 744391348 668218876 1.11
tpch_q18/datafusion:parquet 919515721 856250731 1.07
tpch_q19/datafusion:parquet 292610209 286409092 1.02
tpch_q20/datafusion:parquet 305545144 294704433 1.04
tpch_q21/datafusion:parquet 724970892 697760212 1.04
tpch_q22/datafusion:parquet 213814599 210267835 1.02
datafusion / arrow (1.012x ➖, 1↑ 0↓)
name PR ca6942f (ns) base 1838a7a (ns) ratio (PR/base)
tpch_q01/datafusion:arrow 597528676 573626058 1.04
tpch_q02/datafusion:arrow 165901150 160090881 1.04
tpch_q03/datafusion:arrow 467733860 454480482 1.03
tpch_q04/datafusion:arrow 340965104 335972786 1.01
tpch_q05/datafusion:arrow 934570949 902339333 1.04
tpch_q06/datafusion:arrow 286046561 276656793 1.03
tpch_q07/datafusion:arrow 1141631310 1139009543 1.00
tpch_q08/datafusion:arrow 1144036099 1099557724 1.04
tpch_q09/datafusion:arrow 1327642996 1316671935 1.01
tpch_q10/datafusion:arrow 589103665 588292136 1.00
tpch_q11/datafusion:arrow 135770142 135625692 1.00
tpch_q12/datafusion:arrow 🚀 671168512 766683525 0.88
tpch_q13/datafusion:arrow 491213859 482169587 1.02
tpch_q14/datafusion:arrow 323230736 310538258 1.04
tpch_q15/datafusion:arrow 708363245 677318739 1.05
tpch_q16/datafusion:arrow 103379981 102504876 1.01
tpch_q17/datafusion:arrow 1313541059 1279397984 1.03
tpch_q18/datafusion:arrow 1877641217 1821892211 1.03
tpch_q19/datafusion:arrow 481764804 480608548 1.00
tpch_q20/datafusion:arrow 481350548 486041387 0.99
tpch_q21/datafusion:arrow 2970154631 2931172009 1.01
tpch_q22/datafusion:arrow 124004589 127079305 0.98
duckdb / vortex-file-compressed (1.092x ➖, 0↑ 9↓)
name PR ca6942f (ns) base 1838a7a (ns) ratio (PR/base)
tpch_q01/duckdb:vortex-file-compressed 176777403 171380310 1.03
tpch_q02/duckdb:vortex-file-compressed 53290739 50810118 1.05
tpch_q03/duckdb:vortex-file-compressed 🚨 139188873 124033843 1.12
tpch_q04/duckdb:vortex-file-compressed 🚨 168256882 152553129 1.10
tpch_q05/duckdb:vortex-file-compressed 131600991 126206827 1.04
tpch_q06/duckdb:vortex-file-compressed 🚨 52636857 46472740 1.13
tpch_q07/duckdb:vortex-file-compressed 150968977 144230170 1.05
tpch_q08/duckdb:vortex-file-compressed 🚨 194924515 168458341 1.16
tpch_q09/duckdb:vortex-file-compressed 346976729 320216779 1.08
tpch_q10/duckdb:vortex-file-compressed 🚨 164924662 143348836 1.15
tpch_q11/duckdb:vortex-file-compressed 🚨 35921813 32423609 1.11
tpch_q12/duckdb:vortex-file-compressed 99682604 94257890 1.06
tpch_q13/duckdb:vortex-file-compressed 245379556 224411318 1.09
tpch_q14/duckdb:vortex-file-compressed 69931486 66580489 1.05
tpch_q15/duckdb:vortex-file-compressed 🚨 98545889 86554849 1.14
tpch_q16/duckdb:vortex-file-compressed 85417758 79410767 1.08
tpch_q17/duckdb:vortex-file-compressed 107093901 99629656 1.07
tpch_q18/duckdb:vortex-file-compressed 315055044 288836857 1.09
tpch_q19/duckdb:vortex-file-compressed 85677874 82468351 1.04
tpch_q20/duckdb:vortex-file-compressed 🚨 177817044 156721995 1.13
tpch_q21/duckdb:vortex-file-compressed 🚨 651206198 557383748 1.17
tpch_q22/duckdb:vortex-file-compressed 76831645 70434204 1.09
duckdb / vortex-compact (1.094x ➖, 0↑ 13↓)
name PR ca6942f (ns) base 1838a7a (ns) ratio (PR/base)
tpch_q01/duckdb:vortex-compact 236401002 228553705 1.03
tpch_q02/duckdb:vortex-compact 59414151 55851179 1.06
tpch_q03/duckdb:vortex-compact 🚨 155120195 137422716 1.13
tpch_q04/duckdb:vortex-compact 🚨 187392082 169461785 1.11
tpch_q05/duckdb:vortex-compact 🚨 158557318 142972696 1.11
tpch_q06/duckdb:vortex-compact 89441827 81905386 1.09
tpch_q07/duckdb:vortex-compact 199538606 196772633 1.01
tpch_q08/duckdb:vortex-compact 🚨 207771142 182702431 1.14
tpch_q09/duckdb:vortex-compact 🚨 385016749 349476070 1.10
tpch_q10/duckdb:vortex-compact 🚨 196261184 175177099 1.12
tpch_q11/duckdb:vortex-compact 🚨 44175627 39605886 1.12
tpch_q12/duckdb:vortex-compact 214113164 200645186 1.07
tpch_q13/duckdb:vortex-compact 🚨 303261626 274878284 1.10
tpch_q14/duckdb:vortex-compact 108644537 98968381 1.10
tpch_q15/duckdb:vortex-compact 🚨 122902307 111135171 1.11
tpch_q16/duckdb:vortex-compact 🚨 93360450 84283105 1.11
tpch_q17/duckdb:vortex-compact 🚨 124141336 112213981 1.11
tpch_q18/duckdb:vortex-compact 311866221 284783057 1.10
tpch_q19/duckdb:vortex-compact 115594814 106654995 1.08
tpch_q20/duckdb:vortex-compact 🚨 222498591 199947812 1.11
tpch_q21/duckdb:vortex-compact 🚨 682688044 609823632 1.12
tpch_q22/duckdb:vortex-compact 88818447 83818176 1.06
duckdb / parquet (1.051x ➖, 0↑ 2↓)
name PR ca6942f (ns) base 1838a7a (ns) ratio (PR/base)
tpch_q01/duckdb:parquet 265586747 255760801 1.04
tpch_q02/duckdb:parquet 🚨 108003377 97849252 1.10
tpch_q03/duckdb:parquet 221472088 203127260 1.09
tpch_q04/duckdb:parquet 142491448 130462648 1.09
tpch_q05/duckdb:parquet 236533852 218883621 1.08
tpch_q06/duckdb:parquet 70424833 65706669 1.07
tpch_q07/duckdb:parquet 183313266 175839131 1.04
tpch_q08/duckdb:parquet 261000784 255340415 1.02
tpch_q09/duckdb:parquet 515929212 478976902 1.08
tpch_q10/duckdb:parquet 638233824 606027837 1.05
tpch_q11/duckdb:parquet 🚨 59226056 52942922 1.12
tpch_q12/duckdb:parquet 131515285 124172684 1.06
tpch_q13/duckdb:parquet 456081989 451508907 1.01
tpch_q14/duckdb:parquet 180498594 173084984 1.04
tpch_q15/duckdb:parquet 99968755 95140867 1.05
tpch_q16/duckdb:parquet 166254830 161982671 1.03
tpch_q17/duckdb:parquet 181005789 178790392 1.01
tpch_q18/duckdb:parquet 363006482 348323594 1.04
tpch_q19/duckdb:parquet 294192547 285405512 1.03
tpch_q20/duckdb:parquet 237221579 232958057 1.02
tpch_q21/duckdb:parquet 581779057 561838742 1.04
tpch_q22/duckdb:parquet 294819176 291160505 1.01
duckdb / duckdb (1.053x ➖, 0↑ 3↓)
name PR ca6942f (ns) base 1838a7a (ns) ratio (PR/base)
tpch_q01/duckdb:duckdb 119983209 116825484 1.03
tpch_q02/duckdb:duckdb 🚨 50434892 44244569 1.14
tpch_q03/duckdb:duckdb 103202509 96324348 1.07
tpch_q04/duckdb:duckdb 🚨 147085849 132143707 1.11
tpch_q05/duckdb:duckdb 117640890 109780326 1.07
tpch_q06/duckdb:duckdb 39275171 37508381 1.05
tpch_q07/duckdb:duckdb 91031524 85829207 1.06
tpch_q08/duckdb:duckdb 117466439 109271577 1.07
tpch_q09/duckdb:duckdb 291293318 274550148 1.06
tpch_q10/duckdb:duckdb 221807734 202377522 1.10
tpch_q11/duckdb:duckdb 16103402 15538160 1.04
tpch_q12/duckdb:duckdb 88773205 84863674 1.05
tpch_q13/duckdb:duckdb 222201502 218672294 1.02
tpch_q14/duckdb:duckdb 70303767 69967567 1.00
tpch_q15/duckdb:duckdb 76828918 78021242 0.98
tpch_q16/duckdb:duckdb 74373552 73181838 1.02
tpch_q17/duckdb:duckdb 85135119 84764975 1.00
tpch_q18/duckdb:duckdb 214283396 211514390 1.01
tpch_q19/duckdb:duckdb 121820908 116904240 1.04
tpch_q20/duckdb:duckdb 115441114 111584026 1.03
tpch_q21/duckdb:duckdb 🚨 327576895 288342429 1.14
tpch_q22/duckdb:duckdb 71786200 66438943 1.08
Full attributed analysis
Query Config Raw Δ Control Δ Attributed α Noise floor Significant?
1 datafusion:arrow +4.2% +0.4% +3.8% +10.0% ➖ noise
1 datafusion:vortex-compact -0.2% +0.4% -0.5% +10.0% ➖ noise
1 datafusion:vortex-file-compressed +8.6% +0.4% +8.2% +10.0% ➖ noise
1 duckdb:duckdb +2.7% +0.4% +2.3% +10.0% ➖ noise
1 duckdb:vortex-compact +3.4% +0.4% +3.0% +10.0% ➖ noise
1 duckdb:vortex-file-compressed +3.1% +0.4% +2.8% +10.0% ➖ noise
2 datafusion:arrow +3.6% +4.8% -1.1% +10.0% ➖ noise
2 datafusion:vortex-compact +2.8% +4.8% -1.9% +10.0% ➖ noise
2 datafusion:vortex-file-compressed +8.1% +4.8% +3.1% +10.4% ➖ noise
2 duckdb:duckdb +14.0% +4.8% +8.8% +10.0% ➖ noise
2 duckdb:vortex-compact +6.4% +4.8% +1.5% +10.0% ➖ noise
2 duckdb:vortex-file-compressed +4.9% +4.8% +0.1% +11.6% ➖ noise
3 datafusion:arrow +2.9% +4.8% -1.8% +10.0% ➖ noise
3 datafusion:vortex-compact +1.3% +4.8% -3.4% +10.0% ➖ noise
3 datafusion:vortex-file-compressed +4.5% +4.8% -0.3% +10.0% ➖ noise
3 duckdb:duckdb +7.1% +4.8% +2.2% +10.0% ➖ noise
3 duckdb:vortex-compact +12.9% +4.8% +7.7% +10.0% ➖ noise
3 duckdb:vortex-file-compressed +12.2% +4.8% +7.0% +10.0% ➖ noise
4 datafusion:arrow +1.5% +5.4% -3.7% +10.0% ➖ noise
4 datafusion:vortex-compact +5.7% +5.4% +0.3% +10.0% ➖ noise
4 datafusion:vortex-file-compressed +2.0% +5.4% -3.3% +10.0% ➖ noise
4 duckdb:duckdb +11.3% +5.4% +5.6% +10.0% ➖ noise
4 duckdb:vortex-compact +10.6% +5.4% +4.9% +10.0% ➖ noise
4 duckdb:vortex-file-compressed +10.3% +5.4% +4.6% +10.0% ➖ noise
5 datafusion:arrow +3.6% +4.3% -0.7% +10.0% ➖ noise
5 datafusion:vortex-compact +10.5% +4.3% +5.9% +10.0% ➖ noise
5 datafusion:vortex-file-compressed +4.9% +4.3% +0.5% +10.0% ➖ noise
5 duckdb:duckdb +7.2% +4.3% +2.7% +10.0% ➖ noise
5 duckdb:vortex-compact +10.9% +4.3% +6.3% +10.0% ➖ noise
5 duckdb:vortex-file-compressed +4.3% +4.3% -0.1% +10.0% ➖ noise
6 datafusion:arrow +3.4% +6.3% -2.7% +10.0% ➖ noise
6 datafusion:vortex-compact +7.0% +6.3% +0.7% +10.0% ➖ noise
6 datafusion:vortex-file-compressed +8.1% +6.3% +1.7% +10.0% ➖ noise
6 duckdb:duckdb +4.7% +6.3% -1.5% +10.2% ➖ noise
6 duckdb:vortex-compact +9.2% +6.3% +2.7% +10.0% ➖ noise
6 duckdb:vortex-file-compressed +13.3% +6.3% +6.6% +11.5% ➖ noise
7 datafusion:arrow +0.2% +1.8% -1.6% +10.0% ➖ noise
7 datafusion:vortex-compact +15.1% +1.8% +13.0% +10.0% 🚨 regression
7 datafusion:vortex-file-compressed +5.0% +1.8% +3.1% +10.0% ➖ noise
7 duckdb:duckdb +6.1% +1.8% +4.1% +10.0% ➖ noise
7 duckdb:vortex-compact +1.4% +1.8% -0.4% +10.0% ➖ noise
7 duckdb:vortex-file-compressed +4.7% +1.8% +2.8% +10.0% ➖ noise
8 datafusion:arrow +4.0% +1.2% +2.8% +10.0% ➖ noise
8 datafusion:vortex-compact +17.8% +1.2% +16.4% +10.0% 🚨 regression
8 datafusion:vortex-file-compressed +6.1% +1.2% +4.9% +10.0% ➖ noise
8 duckdb:duckdb +7.5% +1.2% +6.2% +10.0% ➖ noise
8 duckdb:vortex-compact +13.7% +1.2% +12.4% +10.0% 🚨 regression
8 duckdb:vortex-file-compressed +15.7% +1.2% +14.4% +10.0% 🚨 regression
9 datafusion:arrow +0.8% +4.3% -3.3% +10.0% ➖ noise
9 datafusion:vortex-compact +19.2% +4.3% +14.3% +10.0% 🚨 regression
9 datafusion:vortex-file-compressed +5.7% +4.3% +1.3% +10.0% ➖ noise
9 duckdb:duckdb +6.1% +4.3% +1.7% +10.0% ➖ noise
9 duckdb:vortex-compact +10.2% +4.3% +5.6% +10.0% ➖ noise
9 duckdb:vortex-file-compressed +8.4% +4.3% +3.9% +10.0% ➖ noise
10 datafusion:arrow +0.1% +2.5% -2.3% +10.0% ➖ noise
10 datafusion:vortex-compact +15.9% +2.5% +13.1% +10.0% 🚨 regression
10 datafusion:vortex-file-compressed +4.7% +2.5% +2.2% +10.0% ➖ noise
10 duckdb:duckdb +9.6% +2.5% +7.0% +10.0% ➖ noise
10 duckdb:vortex-compact +12.0% +2.5% +9.3% +10.0% ➖ noise
10 duckdb:vortex-file-compressed +15.1% +2.5% +12.3% +10.0% 🚨 regression
11 datafusion:arrow +0.1% +6.1% -5.6% +10.0% ➖ noise
11 datafusion:vortex-compact +1.8% +6.1% -4.0% +10.9% ➖ noise
11 datafusion:vortex-file-compressed +1.9% +6.1% -3.9% +10.8% ➖ noise
11 duckdb:duckdb +3.6% +6.1% -2.3% +12.0% ➖ noise
11 duckdb:vortex-compact +11.5% +6.1% +5.2% +11.8% ➖ noise
11 duckdb:vortex-file-compressed +10.8% +6.1% +4.5% +10.9% ➖ noise
12 datafusion:arrow -12.5% +3.1% -15.1% +35.7% ➖ noise
12 datafusion:vortex-compact +7.6% +3.1% +4.4% +10.0% ➖ noise
12 datafusion:vortex-file-compressed +3.3% +3.1% +0.1% +10.0% ➖ noise
12 duckdb:duckdb +4.6% +3.1% +1.4% +10.0% ➖ noise
12 duckdb:vortex-compact +6.7% +3.1% +3.5% +10.0% ➖ noise
12 duckdb:vortex-file-compressed +5.8% +3.1% +2.6% +10.0% ➖ noise
13 datafusion:arrow +1.9% +0.3% +1.6% +10.0% ➖ noise
13 datafusion:vortex-compact +9.5% +0.3% +9.2% +10.0% ➖ noise
13 datafusion:vortex-file-compressed +8.8% +0.3% +8.5% +10.0% ➖ noise
13 duckdb:duckdb +1.6% +0.3% +1.3% +10.0% ➖ noise
13 duckdb:vortex-compact +10.3% +0.3% +10.0% +10.0% 🚨 regression
13 duckdb:vortex-file-compressed +9.3% +0.3% +9.1% +10.0% ➖ noise
14 datafusion:arrow +4.1% +5.5% -1.4% +10.0% ➖ noise
14 datafusion:vortex-compact +17.9% +5.5% +11.8% +10.0% 🚨 regression
14 datafusion:vortex-file-compressed +3.1% +5.5% -2.3% +10.0% ➖ noise
14 duckdb:duckdb +0.5% +5.5% -4.8% +10.0% ➖ noise
14 duckdb:vortex-compact +9.8% +5.5% +4.0% +10.0% ➖ noise
14 duckdb:vortex-file-compressed +5.0% +5.5% -0.5% +12.2% ➖ noise
15 datafusion:arrow +4.6% +4.2% +0.4% +10.0% ➖ noise
15 datafusion:vortex-compact +17.7% +4.2% +12.9% +10.0% 🚨 regression
15 datafusion:vortex-file-compressed -0.3% +4.2% -4.4% +10.0% ➖ noise
15 duckdb:duckdb -1.5% +4.2% -5.5% +10.0% ➖ noise
15 duckdb:vortex-compact +10.6% +4.2% +6.1% +10.0% ➖ noise
15 duckdb:vortex-file-compressed +13.9% +4.2% +9.3% +10.0% ➖ noise
16 datafusion:arrow +0.9% +4.2% -3.2% +10.0% ➖ noise
16 datafusion:vortex-compact +5.1% +4.2% +0.9% +10.0% ➖ noise
16 datafusion:vortex-file-compressed +19.7% +4.2% +14.9% +12.1% 🚨 regression
16 duckdb:duckdb +1.6% +4.2% -2.5% +10.0% ➖ noise
16 duckdb:vortex-compact +10.8% +4.2% +6.3% +10.0% ➖ noise
16 duckdb:vortex-file-compressed +7.6% +4.2% +3.2% +10.0% ➖ noise
17 datafusion:arrow +2.7% +6.2% -3.3% +10.0% ➖ noise
17 datafusion:vortex-compact +9.3% +6.2% +2.9% +10.0% ➖ noise
17 datafusion:vortex-file-compressed +8.9% +6.2% +2.5% +10.0% ➖ noise
17 duckdb:duckdb +0.4% +6.2% -5.4% +10.0% ➖ noise
17 duckdb:vortex-compact +10.6% +6.2% +4.2% +10.0% ➖ noise
17 duckdb:vortex-file-compressed +7.5% +6.2% +1.2% +11.5% ➖ noise
18 datafusion:arrow +3.1% +5.8% -2.6% +10.0% ➖ noise
18 datafusion:vortex-compact +3.5% +5.8% -2.1% +10.0% ➖ noise
18 datafusion:vortex-file-compressed +7.5% +5.8% +1.6% +10.0% ➖ noise
18 duckdb:duckdb +1.3% +5.8% -4.2% +10.0% ➖ noise
18 duckdb:vortex-compact +9.5% +5.8% +3.5% +10.0% ➖ noise
18 duckdb:vortex-file-compressed +9.1% +5.8% +3.1% +10.0% ➖ noise
19 datafusion:arrow +0.2% +2.6% -2.3% +10.0% ➖ noise
19 datafusion:vortex-compact +2.1% +2.6% -0.5% +10.0% ➖ noise
19 datafusion:vortex-file-compressed +6.0% +2.6% +3.3% +10.0% ➖ noise
19 duckdb:duckdb +4.2% +2.6% +1.5% +10.0% ➖ noise
19 duckdb:vortex-compact +8.4% +2.6% +5.6% +10.0% ➖ noise
19 duckdb:vortex-file-compressed +3.9% +2.6% +1.2% +10.0% ➖ noise
20 datafusion:arrow -1.0% +2.8% -3.6% +10.0% ➖ noise
20 datafusion:vortex-compact +1.9% +2.8% -0.8% +10.0% ➖ noise
20 datafusion:vortex-file-compressed +3.9% +2.8% +1.1% +10.0% ➖ noise
20 duckdb:duckdb +3.5% +2.8% +0.7% +10.0% ➖ noise
20 duckdb:vortex-compact +11.3% +2.8% +8.3% +10.0% ➖ noise
20 duckdb:vortex-file-compressed +13.5% +2.8% +10.4% +10.0% 🚨 regression
21 datafusion:arrow +1.3% +3.7% -2.3% +10.0% ➖ noise
21 datafusion:vortex-compact +17.0% +3.7% +12.8% +10.0% 🚨 regression
21 datafusion:vortex-file-compressed +3.8% +3.7% +0.1% +10.0% ➖ noise
21 duckdb:duckdb +13.6% +3.7% +9.5% +10.0% ➖ noise
21 duckdb:vortex-compact +11.9% +3.7% +7.9% +10.0% ➖ noise
21 duckdb:vortex-file-compressed +16.8% +3.7% +12.6% +10.0% 🚨 regression
22 datafusion:arrow -2.4% +1.5% -3.8% +10.0% ➖ noise
22 datafusion:vortex-compact +0.6% +1.5% -0.8% +10.0% ➖ noise
22 datafusion:vortex-file-compressed +4.2% +1.5% +2.7% +10.0% ➖ noise
22 duckdb:duckdb +8.0% +1.5% +6.5% +10.0% ➖ noise
22 duckdb:vortex-compact +6.0% +1.5% +4.4% +10.0% ➖ noise
22 duckdb:vortex-file-compressed +9.1% +1.5% +7.5% +10.0% ➖ noise

@github-actions
Copy link
Copy Markdown
Contributor

File Sizes: TPC-H SF=10 on NVME

No file size changes detected.

@github-actions
Copy link
Copy Markdown
Contributor

Benchmarks: Statistical and Population Genetics

Verdict: No clear signal (low confidence)
Attributed Vortex impact: -3.6%
Vortex (geomean): 1.071x ➖
Parquet (geomean): 1.111x ❌
Shifts: Parquet (control) +11.1% · Median polish +7.3%


duckdb / vortex-file-compressed (1.078x ➖, 0↑ 4↓)
name PR ca6942f (ns) base 1838a7a (ns) ratio (PR/base)
statpopgen_q00/duckdb:vortex-file-compressed 12683443 12477671 1.02
statpopgen_q01/duckdb:vortex-file-compressed 20544759 19983333 1.03
statpopgen_q02/duckdb:vortex-file-compressed 1452633353 1388313969 1.05
statpopgen_q03/duckdb:vortex-file-compressed 3226816628 3216841228 1.00
statpopgen_q04/duckdb:vortex-file-compressed 3284910951 3137340440 1.05
statpopgen_q05/duckdb:vortex-file-compressed 1507541871 1455081647 1.04
statpopgen_q06/duckdb:vortex-file-compressed 2284165342 2148879802 1.06
statpopgen_q07/duckdb:vortex-file-compressed 🚨 264293040 218991559 1.21
statpopgen_q08/duckdb:vortex-file-compressed 🚨 312982741 261885571 1.20
statpopgen_q09/duckdb:vortex-file-compressed 🚨 3288911439 2912682672 1.13
statpopgen_q10/duckdb:vortex-file-compressed 🚨 5260450776 4722051857 1.11
duckdb / vortex-compact (1.064x ➖, 0↑ 2↓)
name PR ca6942f (ns) base 1838a7a (ns) ratio (PR/base)
statpopgen_q00/duckdb:vortex-compact 🚨 12735122 11131451 1.14
statpopgen_q01/duckdb:vortex-compact 🚨 185791349 165124067 1.13
statpopgen_q02/duckdb:vortex-compact 1965371897 1795327291 1.09
statpopgen_q03/duckdb:vortex-compact 3774510947 3471208258 1.09
statpopgen_q04/duckdb:vortex-compact 3711208474 3506096022 1.06
statpopgen_q05/duckdb:vortex-compact 1882742964 1812573421 1.04
statpopgen_q06/duckdb:vortex-compact 2796705596 2687218362 1.04
statpopgen_q07/duckdb:vortex-compact 949486708 898804405 1.06
statpopgen_q08/duckdb:vortex-compact 968068743 932524338 1.04
statpopgen_q09/duckdb:vortex-compact 3396001525 3291913461 1.03
statpopgen_q10/duckdb:vortex-compact 5378043409 5387499497 1.00
duckdb / parquet (1.111x ❌, 0↑ 6↓)
name PR ca6942f (ns) base 1838a7a (ns) ratio (PR/base)
statpopgen_q00/duckdb:parquet 355229011 326182138 1.09
statpopgen_q01/duckdb:parquet 🚨 458304106 403027510 1.14
statpopgen_q02/duckdb:parquet 🚨 1148701248 989556638 1.16
statpopgen_q03/duckdb:parquet 🚨 1673048983 1496233907 1.12
statpopgen_q04/duckdb:parquet 🚨 1708206995 1483682617 1.15
statpopgen_q05/duckdb:parquet 1099205692 1001916670 1.10
statpopgen_q06/duckdb:parquet 1634213331 1499495753 1.09
statpopgen_q07/duckdb:parquet 🚨 1459818944 1298665468 1.12
statpopgen_q08/duckdb:parquet 1442370339 1323662072 1.09
statpopgen_q09/duckdb:parquet 🚨 1554031735 1355556600 1.15
statpopgen_q10/duckdb:parquet 2767385918 2707041110 1.02
Full attributed analysis
Query Config Raw Δ Control Δ Attributed α Noise floor Significant?
0 duckdb:vortex-compact +14.4% +8.9% +5.1% +11.3% ➖ noise
0 duckdb:vortex-file-compressed +1.6% +8.9% -6.7% +14.4% ➖ noise
1 duckdb:vortex-compact +12.5% +13.7% -1.1% +31.3% ➖ noise
1 duckdb:vortex-file-compressed +2.8% +13.7% -9.6% +205.9% ➖ noise
2 duckdb:vortex-compact +9.5% +16.1% -5.7% +10.0% ➖ noise
2 duckdb:vortex-file-compressed +4.6% +16.1% -9.9% +10.0% ✅ faster
3 duckdb:vortex-compact +8.7% +11.8% -2.8% +10.0% ➖ noise
3 duckdb:vortex-file-compressed +0.3% +11.8% -10.3% +10.0% ✅ faster
4 duckdb:vortex-compact +5.9% +15.1% -8.1% +10.0% ➖ noise
4 duckdb:vortex-file-compressed +4.7% +15.1% -9.1% +10.0% ➖ noise
5 duckdb:vortex-compact +3.9% +9.7% -5.3% +10.0% ➖ noise
5 duckdb:vortex-file-compressed +3.6% +9.7% -5.6% +10.0% ➖ noise
6 duckdb:vortex-compact +4.1% +9.0% -4.5% +10.0% ➖ noise
6 duckdb:vortex-file-compressed +6.3% +9.0% -2.5% +10.0% ➖ noise
7 duckdb:vortex-compact +5.6% +12.4% -6.0% +10.0% ➖ noise
7 duckdb:vortex-file-compressed +20.7% +12.4% +7.4% +10.0% ➖ noise
8 duckdb:vortex-compact +3.8% +9.0% -4.7% +10.0% ➖ noise
8 duckdb:vortex-file-compressed +19.5% +9.0% +9.7% +10.0% ➖ noise
9 duckdb:vortex-compact +3.2% +14.6% -10.0% +10.0% ✅ faster
9 duckdb:vortex-file-compressed +12.9% +14.6% -1.5% +10.0% ➖ noise
10 duckdb:vortex-compact -0.2% +2.2% -2.4% +10.0% ➖ noise
10 duckdb:vortex-file-compressed +11.4% +2.2% +9.0% +10.0% ➖ noise

@github-actions
Copy link
Copy Markdown
Contributor

File Sizes: Statistical and Population Genetics

No file size changes detected.

@github-actions
Copy link
Copy Markdown
Contributor

Benchmarks: TPC-H SF=1 on S3

Verdict: No clear signal (low confidence)
Attributed Vortex impact: -1.3%
Vortex (geomean): 0.970x ➖
Parquet (geomean): 0.983x ➖
Shifts: Parquet (control) -1.7% · Median polish -2.2%


datafusion / vortex-file-compressed (0.922x ➖, 0↑ 0↓)
name PR ca6942f (ns) base 1838a7a (ns) ratio (PR/base)
tpch_q01/datafusion:vortex-file-compressed 244603330 251895571 0.97
tpch_q02/datafusion:vortex-file-compressed 396418789 431412098 0.92
tpch_q03/datafusion:vortex-file-compressed 407669115 391817081 1.04
tpch_q04/datafusion:vortex-file-compressed 233998634 249996437 0.94
tpch_q05/datafusion:vortex-file-compressed 382478276 438561897 0.87
tpch_q06/datafusion:vortex-file-compressed 312273894 336059750 0.93
tpch_q07/datafusion:vortex-file-compressed 373250926 403907059 0.92
tpch_q08/datafusion:vortex-file-compressed 530544212 568302119 0.93
tpch_q09/datafusion:vortex-file-compressed 357613221 364776763 0.98
tpch_q10/datafusion:vortex-file-compressed 466855263 496511550 0.94
tpch_q11/datafusion:vortex-file-compressed 261120044 282429713 0.92
tpch_q12/datafusion:vortex-file-compressed 437260656 470920185 0.93
tpch_q13/datafusion:vortex-file-compressed 131605897 141887912 0.93
tpch_q14/datafusion:vortex-file-compressed 238663888 261652478 0.91
tpch_q15/datafusion:vortex-file-compressed 430131951 463447423 0.93
tpch_q16/datafusion:vortex-file-compressed 188635359 187352214 1.01
tpch_q17/datafusion:vortex-file-compressed 324654429 352019201 0.92
tpch_q18/datafusion:vortex-file-compressed 296727200 332620261 0.89
tpch_q19/datafusion:vortex-file-compressed 440266159 448018566 0.98
tpch_q20/datafusion:vortex-file-compressed 416735466 566422918 0.74
tpch_q21/datafusion:vortex-file-compressed 572484438 690088840 0.83
tpch_q22/datafusion:vortex-file-compressed 109007920 122665769 0.89
datafusion / vortex-compact (1.001x ➖, 0↑ 0↓)
name PR ca6942f (ns) base 1838a7a (ns) ratio (PR/base)
tpch_q01/datafusion:vortex-compact 255512807 245739041 1.04
tpch_q02/datafusion:vortex-compact 400515475 394158432 1.02
tpch_q03/datafusion:vortex-compact 357266375 354109911 1.01
tpch_q04/datafusion:vortex-compact 222774047 211072170 1.06
tpch_q05/datafusion:vortex-compact 364471812 400096595 0.91
tpch_q06/datafusion:vortex-compact 313347734 309742740 1.01
tpch_q07/datafusion:vortex-compact 380811732 387266332 0.98
tpch_q08/datafusion:vortex-compact 473882304 492901498 0.96
tpch_q09/datafusion:vortex-compact 388528489 388564420 1.00
tpch_q10/datafusion:vortex-compact 432732516 415194054 1.04
tpch_q11/datafusion:vortex-compact 239980420 249653484 0.96
tpch_q12/datafusion:vortex-compact 396449412 465082095 0.85
tpch_q13/datafusion:vortex-compact 138196516 122018403 1.13
tpch_q14/datafusion:vortex-compact 255322051 245270199 1.04
tpch_q15/datafusion:vortex-compact 447485628 437351540 1.02
tpch_q16/datafusion:vortex-compact 182286489 173298225 1.05
tpch_q17/datafusion:vortex-compact 342908863 349502303 0.98
tpch_q18/datafusion:vortex-compact 294989542 281442500 1.05
tpch_q19/datafusion:vortex-compact 450633016 475893304 0.95
tpch_q20/datafusion:vortex-compact 431680666 426942786 1.01
tpch_q21/datafusion:vortex-compact 497712095 522909815 0.95
tpch_q22/datafusion:vortex-compact 104260274 100809899 1.03
datafusion / parquet (0.985x ➖, 0↑ 0↓)
name PR ca6942f (ns) base 1838a7a (ns) ratio (PR/base)
tpch_q01/datafusion:parquet 196363391 219246060 0.90
tpch_q02/datafusion:parquet 416900503 465149218 0.90
tpch_q03/datafusion:parquet 299763531 300311383 1.00
tpch_q04/datafusion:parquet 135487135 138500013 0.98
tpch_q05/datafusion:parquet 448731357 439299897 1.02
tpch_q06/datafusion:parquet 132162023 135362841 0.98
tpch_q07/datafusion:parquet 477306016 454869911 1.05
tpch_q08/datafusion:parquet 553499119 573503315 0.97
tpch_q09/datafusion:parquet 481030645 484718182 0.99
tpch_q10/datafusion:parquet 532621336 508972807 1.05
tpch_q11/datafusion:parquet 336299607 366389347 0.92
tpch_q12/datafusion:parquet 238581120 252894439 0.94
tpch_q13/datafusion:parquet 466351969 424967388 1.10
tpch_q14/datafusion:parquet 167064594 176369472 0.95
tpch_q15/datafusion:parquet 281034779 289340307 0.97
tpch_q16/datafusion:parquet 178661474 167408991 1.07
tpch_q17/datafusion:parquet 383960346 351407598 1.09
tpch_q18/datafusion:parquet 451122354 443982085 1.02
tpch_q19/datafusion:parquet 328459786 334132436 0.98
tpch_q20/datafusion:parquet 306235703 320328618 0.96
tpch_q21/datafusion:parquet 513807250 536893195 0.96
tpch_q22/datafusion:parquet 114407537 123141240 0.93
duckdb / vortex-file-compressed (0.985x ➖, 0↑ 0↓)
name PR ca6942f (ns) base 1838a7a (ns) ratio (PR/base)
tpch_q01/duckdb:vortex-file-compressed 261532384 248534507 1.05
tpch_q02/duckdb:vortex-file-compressed 870477354 942969156 0.92
tpch_q03/duckdb:vortex-file-compressed 622707583 628823280 0.99
tpch_q04/duckdb:vortex-file-compressed 342320746 360470111 0.95
tpch_q05/duckdb:vortex-file-compressed 841203451 899292377 0.94
tpch_q06/duckdb:vortex-file-compressed 383768583 389746583 0.98
tpch_q07/duckdb:vortex-file-compressed 784866099 780185919 1.01
tpch_q08/duckdb:vortex-file-compressed 963804525 931441442 1.03
tpch_q09/duckdb:vortex-file-compressed 812304963 851736028 0.95
tpch_q10/duckdb:vortex-file-compressed 727348061 761825023 0.95
tpch_q11/duckdb:vortex-file-compressed 505744840 479663078 1.05
tpch_q12/duckdb:vortex-file-compressed 449750594 448079223 1.00
tpch_q13/duckdb:vortex-file-compressed 457285330 460196058 0.99
tpch_q14/duckdb:vortex-file-compressed 473137496 410215529 1.15
tpch_q15/duckdb:vortex-file-compressed 276884820 272634344 1.02
tpch_q16/duckdb:vortex-file-compressed 396827828 375137229 1.06
tpch_q17/duckdb:vortex-file-compressed 642998064 691865192 0.93
tpch_q18/duckdb:vortex-file-compressed 522073241 559679666 0.93
tpch_q19/duckdb:vortex-file-compressed 452005279 467820227 0.97
tpch_q20/duckdb:vortex-file-compressed 775103779 805640503 0.96
tpch_q21/duckdb:vortex-file-compressed 992835605 1069312787 0.93
tpch_q22/duckdb:vortex-file-compressed 346062325 373076343 0.93
duckdb / vortex-compact (0.973x ➖, 0↑ 0↓)
name PR ca6942f (ns) base 1838a7a (ns) ratio (PR/base)
tpch_q01/duckdb:vortex-compact 279720825 266704988 1.05
tpch_q02/duckdb:vortex-compact 870267867 903721381 0.96
tpch_q03/duckdb:vortex-compact 567509234 592143924 0.96
tpch_q04/duckdb:vortex-compact 331993362 336571190 0.99
tpch_q05/duckdb:vortex-compact 818018795 844255820 0.97
tpch_q06/duckdb:vortex-compact 376664233 419285485 0.90
tpch_q07/duckdb:vortex-compact 753868732 767241699 0.98
tpch_q08/duckdb:vortex-compact 866146916 964531859 0.90
tpch_q09/duckdb:vortex-compact 833157364 822550761 1.01
tpch_q10/duckdb:vortex-compact 661724452 680913973 0.97
tpch_q11/duckdb:vortex-compact 463678641 464867415 1.00
tpch_q12/duckdb:vortex-compact 449201304 446957435 1.01
tpch_q13/duckdb:vortex-compact 440579322 437829235 1.01
tpch_q14/duckdb:vortex-compact 421262116 436102315 0.97
tpch_q15/duckdb:vortex-compact 272738649 290113010 0.94
tpch_q16/duckdb:vortex-compact 345284938 350665011 0.98
tpch_q17/duckdb:vortex-compact 540125575 603137676 0.90
tpch_q18/duckdb:vortex-compact 455610365 461354651 0.99
tpch_q19/duckdb:vortex-compact 417646938 440181468 0.95
tpch_q20/duckdb:vortex-compact 712623782 751657792 0.95
tpch_q21/duckdb:vortex-compact 1013342726 1034500470 0.98
tpch_q22/duckdb:vortex-compact 347110182 320402916 1.08
duckdb / parquet (0.982x ➖, 0↑ 0↓)
name PR ca6942f (ns) base 1838a7a (ns) ratio (PR/base)
tpch_q01/duckdb:parquet 432457342 422925416 1.02
tpch_q02/duckdb:parquet 1138293179 1205018211 0.94
tpch_q03/duckdb:parquet 973989644 1014905149 0.96
tpch_q04/duckdb:parquet 629842610 628062219 1.00
tpch_q05/duckdb:parquet 1452252910 1381055544 1.05
tpch_q06/duckdb:parquet 374976121 393236452 0.95
tpch_q07/duckdb:parquet 1241032660 1174565614 1.06
tpch_q08/duckdb:parquet 1625991358 1593693707 1.02
tpch_q09/duckdb:parquet 1327080786 1369000165 0.97
tpch_q10/duckdb:parquet 1194874598 1231392836 0.97
tpch_q11/duckdb:parquet 858996574 842751351 1.02
tpch_q12/duckdb:parquet 652568664 637878425 1.02
tpch_q13/duckdb:parquet 970298009 908247215 1.07
tpch_q14/duckdb:parquet 612865536 668708545 0.92
tpch_q15/duckdb:parquet 459094908 486956688 0.94
tpch_q16/duckdb:parquet 580982151 667970481 0.87
tpch_q17/duckdb:parquet 726873084 694699534 1.05
tpch_q18/duckdb:parquet 809463539 853818574 0.95
tpch_q19/duckdb:parquet 709356876 768155277 0.92
tpch_q20/duckdb:parquet 1018750076 1134908845 0.90
tpch_q21/duckdb:parquet 1091542074 1122947830 0.97
tpch_q22/duckdb:parquet 529735564 502830402 1.05
Full attributed analysis
Query Config Raw Δ Control Δ Attributed α Noise floor Significant?
1 datafusion:vortex-compact +4.0% -4.3% +8.7% +69.7% ➖ noise
1 datafusion:vortex-file-compressed -2.9% -4.3% +1.5% +63.4% ➖ noise
1 duckdb:vortex-compact +4.9% -4.3% +9.6% +38.6% ➖ noise
1 duckdb:vortex-file-compressed +5.2% -4.3% +10.0% +30.0% ➖ noise
2 datafusion:vortex-compact +1.6% -8.0% +10.4% +30.0% ➖ noise
2 datafusion:vortex-file-compressed -8.1% -8.0% -0.1% +30.0% ➖ noise
2 duckdb:vortex-compact -3.7% -8.0% +4.7% +30.0% ➖ noise
2 duckdb:vortex-file-compressed -7.7% -8.0% +0.3% +30.0% ➖ noise
3 datafusion:vortex-compact +0.9% -2.1% +3.1% +41.0% ➖ noise
3 datafusion:vortex-file-compressed +4.0% -2.1% +6.3% +50.3% ➖ noise
3 duckdb:vortex-compact -4.2% -2.1% -2.1% +30.0% ➖ noise
3 duckdb:vortex-file-compressed -1.0% -2.1% +1.2% +30.0% ➖ noise
4 datafusion:vortex-compact +5.5% -1.0% +6.6% +36.5% ➖ noise
4 datafusion:vortex-file-compressed -6.4% -1.0% -5.5% +30.0% ➖ noise
4 duckdb:vortex-compact -1.4% -1.0% -0.4% +30.0% ➖ noise
4 duckdb:vortex-file-compressed -5.0% -1.0% -4.1% +30.0% ➖ noise
5 datafusion:vortex-compact -8.9% +3.6% -12.1% +30.0% ➖ noise
5 datafusion:vortex-file-compressed -12.8% +3.6% -15.9% +30.0% ➖ noise
5 duckdb:vortex-compact -3.1% +3.6% -6.5% +30.0% ➖ noise
5 duckdb:vortex-file-compressed -6.5% +3.6% -9.7% +30.0% ➖ noise
6 datafusion:vortex-compact +1.2% -3.5% +4.8% +34.1% ➖ noise
6 datafusion:vortex-file-compressed -7.1% -3.5% -3.7% +30.0% ➖ noise
6 duckdb:vortex-compact -10.2% -3.5% -6.9% +30.0% ➖ noise
6 duckdb:vortex-file-compressed -1.5% -3.5% +2.0% +30.0% ➖ noise
7 datafusion:vortex-compact -1.7% +5.3% -6.6% +30.0% ➖ noise
7 datafusion:vortex-file-compressed -7.6% +5.3% -12.2% +30.0% ➖ noise
7 duckdb:vortex-compact -1.7% +5.3% -6.7% +30.0% ➖ noise
7 duckdb:vortex-file-compressed +0.6% +5.3% -4.5% +30.0% ➖ noise
8 datafusion:vortex-compact -3.9% -0.8% -3.1% +30.0% ➖ noise
8 datafusion:vortex-file-compressed -6.6% -0.8% -5.9% +30.0% ➖ noise
8 duckdb:vortex-compact -10.2% -0.8% -9.5% +30.0% ➖ noise
8 duckdb:vortex-file-compressed +3.5% -0.8% +4.3% +30.0% ➖ noise
9 datafusion:vortex-compact -0.0% -1.9% +1.9% +30.0% ➖ noise
9 datafusion:vortex-file-compressed -2.0% -1.9% -0.0% +30.0% ➖ noise
9 duckdb:vortex-compact +1.3% -1.9% +3.3% +30.0% ➖ noise
9 duckdb:vortex-file-compressed -4.6% -1.9% -2.8% +30.0% ➖ noise
10 datafusion:vortex-compact +4.2% +0.8% +3.4% +30.0% ➖ noise
10 datafusion:vortex-file-compressed -6.0% +0.8% -6.7% +30.0% ➖ noise
10 duckdb:vortex-compact -2.8% +0.8% -3.6% +30.0% ➖ noise
10 duckdb:vortex-file-compressed -4.5% +0.8% -5.3% +30.0% ➖ noise
11 datafusion:vortex-compact -3.9% -3.3% -0.6% +30.0% ➖ noise
11 datafusion:vortex-file-compressed -7.5% -3.3% -4.4% +30.0% ➖ noise
11 duckdb:vortex-compact -0.3% -3.3% +3.1% +30.0% ➖ noise
11 duckdb:vortex-file-compressed +5.4% -3.3% +9.0% +30.0% ➖ noise
12 datafusion:vortex-compact -14.8% -1.8% -13.2% +30.0% ➖ noise
12 datafusion:vortex-file-compressed -7.1% -1.8% -5.5% +30.0% ➖ noise
12 duckdb:vortex-compact +0.5% -1.8% +2.3% +30.0% ➖ noise
12 duckdb:vortex-file-compressed +0.4% -1.8% +2.2% +30.0% ➖ noise
13 datafusion:vortex-compact +13.3% +8.3% +4.6% +50.6% ➖ noise
13 datafusion:vortex-file-compressed -7.2% +8.3% -14.3% +40.2% ➖ noise
13 duckdb:vortex-compact +0.6% +8.3% -7.1% +30.0% ➖ noise
13 duckdb:vortex-file-compressed -0.6% +8.3% -8.2% +30.0% ➖ noise
14 datafusion:vortex-compact +4.1% -6.8% +11.7% +30.0% ➖ noise
14 datafusion:vortex-file-compressed -8.8% -6.8% -2.1% +30.0% ➖ noise
14 duckdb:vortex-compact -3.4% -6.8% +3.7% +30.0% ➖ noise
14 duckdb:vortex-file-compressed +15.3% -6.8% +23.8% +30.0% ➖ noise
15 datafusion:vortex-compact +2.3% -4.3% +6.9% +30.0% ➖ noise
15 datafusion:vortex-file-compressed -7.2% -4.3% -3.0% +30.0% ➖ noise
15 duckdb:vortex-compact -6.0% -4.3% -1.8% +30.0% ➖ noise
15 duckdb:vortex-file-compressed +1.6% -4.3% +6.1% +30.0% ➖ noise
16 datafusion:vortex-compact +5.2% -3.7% +9.2% +30.0% ➖ noise
16 datafusion:vortex-file-compressed +0.7% -3.7% +4.5% +30.0% ➖ noise
16 duckdb:vortex-compact -1.5% -3.7% +2.2% +30.0% ➖ noise
16 duckdb:vortex-file-compressed +5.8% -3.7% +9.8% +30.0% ➖ noise
17 datafusion:vortex-compact -1.9% +6.9% -8.2% +30.0% ➖ noise
17 datafusion:vortex-file-compressed -7.8% +6.9% -13.7% +30.0% ➖ noise
17 duckdb:vortex-compact -10.4% +6.9% -16.2% +30.0% ➖ noise
17 duckdb:vortex-file-compressed -7.1% +6.9% -13.1% +30.0% ➖ noise
18 datafusion:vortex-compact +4.8% -1.9% +6.8% +30.0% ➖ noise
18 datafusion:vortex-file-compressed -10.8% -1.9% -9.1% +30.0% ➖ noise
18 duckdb:vortex-compact -1.2% -1.9% +0.6% +30.0% ➖ noise
18 duckdb:vortex-file-compressed -6.7% -1.9% -5.0% +30.0% ➖ noise
19 datafusion:vortex-compact -5.3% -4.7% -0.6% +30.0% ➖ noise
19 datafusion:vortex-file-compressed -1.7% -4.7% +3.1% +30.0% ➖ noise
19 duckdb:vortex-compact -5.1% -4.7% -0.4% +30.0% ➖ noise
19 duckdb:vortex-file-compressed -3.4% -4.7% +1.4% +30.0% ➖ noise
20 datafusion:vortex-compact +1.1% -7.4% +9.1% +30.0% ➖ noise
20 datafusion:vortex-file-compressed -26.4% -7.4% -20.6% +37.6% ➖ noise
20 duckdb:vortex-compact -5.2% -7.4% +2.3% +30.0% ➖ noise
20 duckdb:vortex-file-compressed -3.8% -7.4% +3.9% +30.0% ➖ noise
21 datafusion:vortex-compact -4.8% -3.6% -1.3% +30.0% ➖ noise
21 datafusion:vortex-file-compressed -17.0% -3.6% -14.0% +30.0% ➖ noise
21 duckdb:vortex-compact -2.0% -3.6% +1.6% +30.0% ➖ noise
21 duckdb:vortex-file-compressed -7.2% -3.6% -3.7% +30.0% ➖ noise
22 datafusion:vortex-compact +3.4% -1.1% +4.5% +30.0% ➖ noise
22 datafusion:vortex-file-compressed -11.1% -1.1% -10.2% +55.2% ➖ noise
22 duckdb:vortex-compact +8.3% -1.1% +9.5% +30.0% ➖ noise
22 duckdb:vortex-file-compressed -7.2% -1.1% -6.2% +30.0% ➖ noise

@github-actions
Copy link
Copy Markdown
Contributor

Benchmarks: Clickbench on NVME

Verdict: No clear signal (low confidence)
Attributed Vortex impact: -0.4%
Vortex (geomean): 1.001x ➖
Parquet (geomean): 0.997x ➖
Shifts: Parquet (control) -0.3% · Median polish -0.5%


datafusion / vortex-file-compressed (1.007x ➖, 1↑ 2↓)
name PR ca6942f (ns) base 1838a7a (ns) ratio (PR/base)
clickbench_q00/datafusion:vortex-file-compressed 1827598 1681220 1.09
clickbench_q01/datafusion:vortex-file-compressed 19210285 20056352 0.96
clickbench_q02/datafusion:vortex-file-compressed 37585533 38138337 0.99
clickbench_q03/datafusion:vortex-file-compressed 🚨 47449812 42555106 1.12
clickbench_q04/datafusion:vortex-file-compressed 282386983 284597522 0.99
clickbench_q05/datafusion:vortex-file-compressed 302842048 296057368 1.02
clickbench_q06/datafusion:vortex-file-compressed 1626709 1602831 1.01
clickbench_q07/datafusion:vortex-file-compressed 23440627 22882636 1.02
clickbench_q08/datafusion:vortex-file-compressed 349774263 355605323 0.98
clickbench_q09/datafusion:vortex-file-compressed 550351223 552109656 1.00
clickbench_q10/datafusion:vortex-file-compressed 75427609 74322620 1.01
clickbench_q11/datafusion:vortex-file-compressed 86507009 86725298 1.00
clickbench_q12/datafusion:vortex-file-compressed 266057661 273447045 0.97
clickbench_q13/datafusion:vortex-file-compressed 416447555 411642145 1.01
clickbench_q14/datafusion:vortex-file-compressed 251697587 258249109 0.97
clickbench_q15/datafusion:vortex-file-compressed 328061646 324772090 1.01
clickbench_q16/datafusion:vortex-file-compressed 649446370 638697954 1.02
clickbench_q17/datafusion:vortex-file-compressed 633465756 631385747 1.00
clickbench_q18/datafusion:vortex-file-compressed 1284810298 1275226022 1.01
clickbench_q19/datafusion:vortex-file-compressed 🚨 33354834 28687170 1.16
clickbench_q20/datafusion:vortex-file-compressed 340895431 335575295 1.02
clickbench_q21/datafusion:vortex-file-compressed 363794371 363803142 1.00
clickbench_q22/datafusion:vortex-file-compressed 448725227 448549573 1.00
clickbench_q23/datafusion:vortex-file-compressed 684403580 656612469 1.04
clickbench_q24/datafusion:vortex-file-compressed 48219393 45659193 1.06
clickbench_q25/datafusion:vortex-file-compressed 74570951 72180576 1.03
clickbench_q26/datafusion:vortex-file-compressed 46557597 43220356 1.08
clickbench_q27/datafusion:vortex-file-compressed 732574619 718502750 1.02
clickbench_q28/datafusion:vortex-file-compressed 6733206077 6791937805 0.99
clickbench_q29/datafusion:vortex-file-compressed 231747829 240384464 0.96
clickbench_q30/datafusion:vortex-file-compressed 220717753 221755437 1.00
clickbench_q31/datafusion:vortex-file-compressed 255870028 257332101 0.99
clickbench_q32/datafusion:vortex-file-compressed 1109047196 1094309888 1.01
clickbench_q33/datafusion:vortex-file-compressed 1296106668 1282962237 1.01
clickbench_q34/datafusion:vortex-file-compressed 1283823224 1278575698 1.00
clickbench_q35/datafusion:vortex-file-compressed 449564448 459393395 0.98
clickbench_q36/datafusion:vortex-file-compressed 72097567 71419239 1.01
clickbench_q37/datafusion:vortex-file-compressed 34709373 34720070 1.00
clickbench_q38/datafusion:vortex-file-compressed 19180248 18952547 1.01
clickbench_q39/datafusion:vortex-file-compressed 133871376 132008390 1.01
clickbench_q40/datafusion:vortex-file-compressed 16252772 17843976 0.91
clickbench_q41/datafusion:vortex-file-compressed 🚀 15000738 16796628 0.89
clickbench_q42/datafusion:vortex-file-compressed 17933103 18566203 0.97
datafusion / parquet (1.021x ➖, 0↑ 3↓)
name PR ca6942f (ns) base 1838a7a (ns) ratio (PR/base)
clickbench_q00/datafusion:parquet 1550681 1554075 1.00
clickbench_q01/datafusion:parquet 🚨 21078246 18955548 1.11
clickbench_q02/datafusion:parquet 46972692 48750918 0.96
clickbench_q03/datafusion:parquet 39039365 37931428 1.03
clickbench_q04/datafusion:parquet 298895627 296829332 1.01
clickbench_q05/datafusion:parquet 356991339 344185352 1.04
clickbench_q06/datafusion:parquet 1577243 1559977 1.01
clickbench_q07/datafusion:parquet 23399132 21967482 1.07
clickbench_q08/datafusion:parquet 369300460 368683598 1.00
clickbench_q09/datafusion:parquet 620260241 615197070 1.01
clickbench_q10/datafusion:parquet 113787264 111426655 1.02
clickbench_q11/datafusion:parquet 142908614 133207606 1.07
clickbench_q12/datafusion:parquet 362004017 348204478 1.04
clickbench_q13/datafusion:parquet 🚨 529799114 479459211 1.10
clickbench_q14/datafusion:parquet 353091914 344924591 1.02
clickbench_q15/datafusion:parquet 347949422 335617442 1.04
clickbench_q16/datafusion:parquet 703866302 654557105 1.08
clickbench_q17/datafusion:parquet 645188754 644460903 1.00
clickbench_q18/datafusion:parquet 1393940542 1294825065 1.08
clickbench_q19/datafusion:parquet 🚨 33132677 29927075 1.11
clickbench_q20/datafusion:parquet 612223016 599791310 1.02
clickbench_q21/datafusion:parquet 686865395 664288305 1.03
clickbench_q22/datafusion:parquet 1001755598 979129523 1.02
clickbench_q23/datafusion:parquet 3764004334 3680692066 1.02
clickbench_q24/datafusion:parquet 85332778 81634961 1.05
clickbench_q25/datafusion:parquet 138565705 138091230 1.00
clickbench_q26/datafusion:parquet 85606482 85143654 1.01
clickbench_q27/datafusion:parquet 1061105132 1041451051 1.02
clickbench_q28/datafusion:parquet 6721217528 6714023782 1.00
clickbench_q29/datafusion:parquet 240255891 242275692 0.99
clickbench_q30/datafusion:parquet 327235990 328021803 1.00
clickbench_q31/datafusion:parquet 354909272 366786094 0.97
clickbench_q32/datafusion:parquet 1191225256 1214650599 0.98
clickbench_q33/datafusion:parquet 1468278617 1461116107 1.00
clickbench_q34/datafusion:parquet 1496834785 1479924563 1.01
clickbench_q35/datafusion:parquet 455689814 455091744 1.00
clickbench_q36/datafusion:parquet 139844757 139598912 1.00
clickbench_q37/datafusion:parquet 57546768 59955407 0.96
clickbench_q38/datafusion:parquet 83167395 82802601 1.00
clickbench_q39/datafusion:parquet 259029355 259579579 1.00
clickbench_q40/datafusion:parquet 31970085 30077899 1.06
clickbench_q41/datafusion:parquet 26560519 27227906 0.98
clickbench_q42/datafusion:parquet 29783963 29321695 1.02
duckdb / vortex-file-compressed (0.995x ➖, 1↑ 0↓)
name PR ca6942f (ns) base 1838a7a (ns) ratio (PR/base)
clickbench_q00/duckdb:vortex-file-compressed 5920091 5808394 1.02
clickbench_q01/duckdb:vortex-file-compressed 13733049 13960036 0.98
clickbench_q02/duckdb:vortex-file-compressed 25874714 26278565 0.98
clickbench_q03/duckdb:vortex-file-compressed 29394795 30745364 0.96
clickbench_q04/duckdb:vortex-file-compressed 184334587 185715238 0.99
clickbench_q05/duckdb:vortex-file-compressed 173851496 171601678 1.01
clickbench_q06/duckdb:vortex-file-compressed 18895915 19076470 0.99
clickbench_q07/duckdb:vortex-file-compressed 14880315 16037800 0.93
clickbench_q08/duckdb:vortex-file-compressed 254022680 260777303 0.97
clickbench_q09/duckdb:vortex-file-compressed 335864193 345625705 0.97
clickbench_q10/duckdb:vortex-file-compressed 67756311 68282813 0.99
clickbench_q11/duckdb:vortex-file-compressed 77558243 77956463 0.99
clickbench_q12/duckdb:vortex-file-compressed 192798862 193315337 1.00
clickbench_q13/duckdb:vortex-file-compressed 392313198 402166479 0.98
clickbench_q14/duckdb:vortex-file-compressed 231028446 239855660 0.96
clickbench_q15/duckdb:vortex-file-compressed 239391105 237612575 1.01
clickbench_q16/duckdb:vortex-file-compressed 581315374 580911737 1.00
clickbench_q17/duckdb:vortex-file-compressed 480494948 481418708 1.00
clickbench_q18/duckdb:vortex-file-compressed 989879683 962247669 1.03
clickbench_q19/duckdb:vortex-file-compressed 21343917 22437490 0.95
clickbench_q20/duckdb:vortex-file-compressed 327463099 346988104 0.94
clickbench_q21/duckdb:vortex-file-compressed 369781422 365060357 1.01
clickbench_q22/duckdb:vortex-file-compressed 592153972 556270032 1.06
clickbench_q23/duckdb:vortex-file-compressed 🚀 1465473430 1713153784 0.86
clickbench_q24/duckdb:vortex-file-compressed 47883284 49409775 0.97
clickbench_q25/duckdb:vortex-file-compressed 81178235 85159866 0.95
clickbench_q26/duckdb:vortex-file-compressed 43200886 46166568 0.94
clickbench_q27/duckdb:vortex-file-compressed 482273332 477265045 1.01
clickbench_q28/duckdb:vortex-file-compressed 2966550692 2973053779 1.00
clickbench_q29/duckdb:vortex-file-compressed 27861547 28849581 0.97
clickbench_q30/duckdb:vortex-file-compressed 192040266 192283052 1.00
clickbench_q31/duckdb:vortex-file-compressed 282973370 275446330 1.03
clickbench_q32/duckdb:vortex-file-compressed 1298726218 1188263512 1.09
clickbench_q33/duckdb:vortex-file-compressed 1255183582 1214905099 1.03
clickbench_q34/duckdb:vortex-file-compressed 1246832182 1305766342 0.95
clickbench_q35/duckdb:vortex-file-compressed 379787857 370780281 1.02
clickbench_q36/duckdb:vortex-file-compressed 28822164 27576998 1.05
clickbench_q37/duckdb:vortex-file-compressed 22010934 20420360 1.08
clickbench_q38/duckdb:vortex-file-compressed 22256637 21961037 1.01
clickbench_q39/duckdb:vortex-file-compressed 40471856 41202534 0.98
clickbench_q40/duckdb:vortex-file-compressed 22632577 21773077 1.04
clickbench_q41/duckdb:vortex-file-compressed 21104268 20062886 1.05
clickbench_q42/duckdb:vortex-file-compressed 22218236 21350905 1.04
duckdb / parquet (0.974x ➖, 0↑ 0↓)
name PR ca6942f (ns) base 1838a7a (ns) ratio (PR/base)
clickbench_q00/duckdb:parquet 24822565 26699922 0.93
clickbench_q01/duckdb:parquet 26506945 27867163 0.95
clickbench_q02/duckdb:parquet 48207361 48190304 1.00
clickbench_q03/duckdb:parquet 38253059 38652035 0.99
clickbench_q04/duckdb:parquet 203883292 207732147 0.98
clickbench_q05/duckdb:parquet 261804272 261011745 1.00
clickbench_q06/duckdb:parquet 46058834 45843254 1.00
clickbench_q07/duckdb:parquet 28824888 29971079 0.96
clickbench_q08/duckdb:parquet 263049722 273984467 0.96
clickbench_q09/duckdb:parquet 397294083 401108046 0.99
clickbench_q10/duckdb:parquet 80947188 89154532 0.91
clickbench_q11/duckdb:parquet 97349143 107875005 0.90
clickbench_q12/duckdb:parquet 280826131 297414495 0.94
clickbench_q13/duckdb:parquet 478480853 509174417 0.94
clickbench_q14/duckdb:parquet 328390386 326420438 1.01
clickbench_q15/duckdb:parquet 254762826 274885364 0.93
clickbench_q16/duckdb:parquet 644899172 685661902 0.94
clickbench_q17/duckdb:parquet 533699443 563468748 0.95
clickbench_q18/duckdb:parquet 1082283255 1115438909 0.97
clickbench_q19/duckdb:parquet 26203365 26554804 0.99
clickbench_q20/duckdb:parquet 423914772 435790121 0.97
clickbench_q21/duckdb:parquet 544570807 564621786 0.96
clickbench_q22/duckdb:parquet 925851236 947255685 0.98
clickbench_q23/duckdb:parquet 309850288 313953311 0.99
clickbench_q24/duckdb:parquet 69372191 68138545 1.02
clickbench_q25/duckdb:parquet 157584509 156773176 1.01
clickbench_q26/duckdb:parquet 50881320 47677999 1.07
clickbench_q27/duckdb:parquet 640939277 643953872 1.00
clickbench_q28/duckdb:parquet 4831851395 4851141758 1.00
clickbench_q29/duckdb:parquet 40242494 41172903 0.98
clickbench_q30/duckdb:parquet 301434426 308616957 0.98
clickbench_q31/duckdb:parquet 359201959 367497666 0.98
clickbench_q32/duckdb:parquet 1168681909 1179880429 0.99
clickbench_q33/duckdb:parquet 1281666003 1328853610 0.96
clickbench_q34/duckdb:parquet 1324942573 1310511703 1.01
clickbench_q35/duckdb:parquet 362914675 363073082 1.00
clickbench_q36/duckdb:parquet 46746531 48335818 0.97
clickbench_q37/duckdb:parquet 31429116 32123189 0.98
clickbench_q38/duckdb:parquet 33364138 34032757 0.98
clickbench_q39/duckdb:parquet 82428907 86449559 0.95
clickbench_q40/duckdb:parquet 17825806 18864870 0.94
clickbench_q41/duckdb:parquet 17275003 17571672 0.98
clickbench_q42/duckdb:parquet 21341463 21989415 0.97
duckdb / duckdb (0.977x ➖, 3↑ 0↓)
name PR ca6942f (ns) base 1838a7a (ns) ratio (PR/base)
clickbench_q00/duckdb:duckdb 17474399 18273209 0.96
clickbench_q01/duckdb:duckdb 32023204 33411745 0.96
clickbench_q02/duckdb:duckdb 45676570 46177458 0.99
clickbench_q03/duckdb:duckdb 48086355 47223493 1.02
clickbench_q04/duckdb:duckdb 184644614 185894079 0.99
clickbench_q05/duckdb:duckdb 266648893 264892361 1.01
clickbench_q06/duckdb:duckdb 🚀 28287141 35343647 0.80
clickbench_q07/duckdb:duckdb 35292245 36045735 0.98
clickbench_q08/duckdb:duckdb 248617813 246060277 1.01
clickbench_q09/duckdb:duckdb 367730481 366084529 1.00
clickbench_q10/duckdb:duckdb 97644533 97280449 1.00
clickbench_q11/duckdb:duckdb 108036367 106548933 1.01
clickbench_q12/duckdb:duckdb 237405787 239195603 0.99
clickbench_q13/duckdb:duckdb 470112461 483187955 0.97
clickbench_q14/duckdb:duckdb 276802003 274157355 1.01
clickbench_q15/duckdb:duckdb 218984207 217490565 1.01
clickbench_q16/duckdb:duckdb 662563533 663437456 1.00
clickbench_q17/duckdb:duckdb 550658674 569583718 0.97
clickbench_q18/duckdb:duckdb 1233673272 1289304553 0.96
clickbench_q19/duckdb:duckdb 34611606 35060977 0.99
clickbench_q20/duckdb:duckdb 🚀 912518052 1039101104 0.88
clickbench_q21/duckdb:duckdb 980053857 1009271667 0.97
clickbench_q22/duckdb:duckdb 1144041208 1112545685 1.03
clickbench_q23/duckdb:duckdb 260923497 254220168 1.03
clickbench_q24/duckdb:duckdb 61163535 61875016 0.99
clickbench_q25/duckdb:duckdb 140580250 142473413 0.99
clickbench_q26/duckdb:duckdb 61191307 61274290 1.00
clickbench_q27/duckdb:duckdb 🚀 998268379 1128399809 0.88
clickbench_q28/duckdb:duckdb 4644214351 4717644185 0.98
clickbench_q29/duckdb:duckdb 47971257 48744079 0.98
clickbench_q30/duckdb:duckdb 261541984 265236711 0.99
clickbench_q31/duckdb:duckdb 424802708 427451675 0.99
clickbench_q32/duckdb:duckdb 1500858258 1563659594 0.96
clickbench_q33/duckdb:duckdb 1912153870 2044256980 0.94
clickbench_q34/duckdb:duckdb 2131892136 2158648253 0.99
clickbench_q35/duckdb:duckdb 278436923 282016828 0.99
clickbench_q36/duckdb:duckdb 40877493 39113848 1.05
clickbench_q37/duckdb:duckdb 30846440 31658786 0.97
clickbench_q38/duckdb:duckdb 30281576 31352937 0.97
clickbench_q39/duckdb:duckdb 66739664 68061047 0.98
clickbench_q40/duckdb:duckdb 31378103 32379048 0.97
clickbench_q41/duckdb:duckdb 30214393 31887791 0.95
clickbench_q42/duckdb:duckdb 31447170 31950564 0.98
Full attributed analysis
Query Config Raw Δ Control Δ Attributed α Noise floor Significant?
0 datafusion:vortex-file-compressed +8.7% -3.7% +12.9% +775.1% ➖ noise
0 duckdb:duckdb -4.4% -3.7% -0.7% +291.0% ➖ noise
0 duckdb:vortex-file-compressed +1.9% -3.7% +5.8% +484.6% ➖ noise
1 datafusion:vortex-file-compressed -4.2% +2.8% -6.9% +24.7% ➖ noise
1 duckdb:duckdb -4.2% +2.8% -6.8% +64.5% ➖ noise
1 duckdb:vortex-file-compressed -1.6% +2.8% -4.3% +29.4% ➖ noise
2 datafusion:vortex-file-compressed -1.4% -1.8% +0.4% +13.0% ➖ noise
2 duckdb:duckdb -1.1% -1.8% +0.8% +22.4% ➖ noise
2 duckdb:vortex-file-compressed -1.5% -1.8% +0.3% +13.1% ➖ noise
3 datafusion:vortex-file-compressed +11.5% +0.9% +10.5% +137.6% ➖ noise
3 duckdb:duckdb +1.8% +0.9% +0.9% +48.0% ➖ noise
3 duckdb:vortex-file-compressed -4.4% +0.9% -5.3% +30.9% ➖ noise
4 datafusion:vortex-file-compressed -0.8% -0.6% -0.2% +10.0% ➖ noise
4 duckdb:duckdb -0.7% -0.6% -0.1% +10.0% ➖ noise
4 duckdb:vortex-file-compressed -0.7% -0.6% -0.2% +10.0% ➖ noise
5 datafusion:vortex-file-compressed +2.3% +2.0% +0.3% +10.0% ➖ noise
5 duckdb:duckdb +0.7% +2.0% -1.3% +10.0% ➖ noise
5 duckdb:vortex-file-compressed +1.3% +2.0% -0.7% +10.0% ➖ noise
6 datafusion:vortex-file-compressed +1.5% +0.8% +0.7% +39.1% ➖ noise
6 duckdb:duckdb -20.0% +0.8% -20.6% +28.7% ➖ noise
6 duckdb:vortex-file-compressed -0.9% +0.8% -1.7% +22.3% ➖ noise
7 datafusion:vortex-file-compressed +2.4% +1.2% +1.2% +13.4% ➖ noise
7 duckdb:duckdb -2.1% +1.2% -3.3% +11.5% ➖ noise
7 duckdb:vortex-file-compressed -7.2% +1.2% -8.3% +10.6% ➖ noise
8 datafusion:vortex-file-compressed -1.6% -1.9% +0.3% +10.0% ➖ noise
8 duckdb:duckdb +1.0% -1.9% +3.0% +10.0% ➖ noise
8 duckdb:vortex-file-compressed -2.6% -1.9% -0.7% +10.0% ➖ noise
9 datafusion:vortex-file-compressed -0.3% -0.1% -0.3% +10.0% ➖ noise
9 duckdb:duckdb +0.4% -0.1% +0.5% +10.0% ➖ noise
9 duckdb:vortex-file-compressed -2.8% -0.1% -2.8% +10.0% ➖ noise
10 datafusion:vortex-file-compressed +1.5% -3.7% +5.4% +10.0% ➖ noise
10 duckdb:duckdb +0.4% -3.7% +4.2% +10.0% ➖ noise
10 duckdb:vortex-file-compressed -0.8% -3.7% +3.1% +10.0% ➖ noise
11 datafusion:vortex-file-compressed -0.3% -1.6% +1.4% +10.0% ➖ noise
11 duckdb:duckdb +1.4% -1.6% +3.1% +10.0% ➖ noise
11 duckdb:vortex-file-compressed -0.5% -1.6% +1.1% +10.0% ➖ noise
12 datafusion:vortex-file-compressed -2.7% -0.9% -1.8% +10.0% ➖ noise
12 duckdb:duckdb -0.7% -0.9% +0.2% +10.0% ➖ noise
12 duckdb:vortex-file-compressed -0.3% -0.9% +0.7% +10.0% ➖ noise
13 datafusion:vortex-file-compressed +1.2% +1.9% -0.7% +10.0% ➖ noise
13 duckdb:duckdb -2.7% +1.9% -4.5% +10.0% ➖ noise
13 duckdb:vortex-file-compressed -2.5% +1.9% -4.3% +10.0% ➖ noise
14 datafusion:vortex-file-compressed -2.5% +1.5% -4.0% +10.0% ➖ noise
14 duckdb:duckdb +1.0% +1.5% -0.5% +10.0% ➖ noise
14 duckdb:vortex-file-compressed -3.7% +1.5% -5.1% +10.0% ➖ noise
15 datafusion:vortex-file-compressed +1.0% -2.0% +3.1% +10.0% ➖ noise
15 duckdb:duckdb +0.7% -2.0% +2.7% +10.0% ➖ noise
15 duckdb:vortex-file-compressed +0.7% -2.0% +2.8% +10.0% ➖ noise
16 datafusion:vortex-file-compressed +1.7% +0.6% +1.1% +10.0% ➖ noise
16 duckdb:duckdb -0.1% +0.6% -0.7% +10.0% ➖ noise
16 duckdb:vortex-file-compressed +0.1% +0.6% -0.5% +10.0% ➖ noise
17 datafusion:vortex-file-compressed +0.3% -2.6% +3.0% +10.0% ➖ noise
17 duckdb:duckdb -3.3% -2.6% -0.7% +11.6% ➖ noise
17 duckdb:vortex-file-compressed -0.2% -2.6% +2.5% +10.0% ➖ noise
18 datafusion:vortex-file-compressed +0.8% +2.2% -1.4% +10.0% ➖ noise
18 duckdb:duckdb -4.3% +2.2% -6.4% +10.0% ➖ noise
18 duckdb:vortex-file-compressed +2.9% +2.2% +0.7% +10.0% ➖ noise
19 datafusion:vortex-file-compressed +16.3% +4.5% +11.2% +20.3% ➖ noise
19 duckdb:duckdb -1.3% +4.5% -5.6% +11.8% ➖ noise
19 duckdb:vortex-file-compressed -4.9% +4.5% -9.0% +12.2% ➖ noise
20 datafusion:vortex-file-compressed +1.6% -0.4% +1.9% +209.0% ➖ noise
20 duckdb:duckdb -12.2% -0.4% -11.9% +28.1% ➖ noise
20 duckdb:vortex-file-compressed -5.6% -0.4% -5.3% +48.7% ➖ noise
21 datafusion:vortex-file-compressed -0.0% -0.1% +0.1% +10.0% ➖ noise
21 duckdb:duckdb -2.9% -0.1% -2.8% +10.0% ➖ noise
21 duckdb:vortex-file-compressed +1.3% -0.1% +1.4% +10.0% ➖ noise
22 datafusion:vortex-file-compressed +0.0% -0.0% +0.0% +14.5% ➖ noise
22 duckdb:duckdb +2.8% -0.0% +2.8% +10.0% ➖ noise
22 duckdb:vortex-file-compressed +6.5% -0.0% +6.5% +19.5% ➖ noise
23 datafusion:vortex-file-compressed +4.2% +0.5% +3.8% +45.6% ➖ noise
23 duckdb:duckdb +2.6% +0.5% +2.2% +10.0% ➖ noise
23 duckdb:vortex-file-compressed -14.5% +0.5% -14.9% +12.0% ✅ faster
24 datafusion:vortex-file-compressed +5.6% +3.2% +2.4% +22.9% ➖ noise
24 duckdb:duckdb -1.1% +3.2% -4.2% +10.0% ➖ noise
24 duckdb:vortex-file-compressed -3.1% +3.2% -6.1% +32.5% ➖ noise
25 datafusion:vortex-file-compressed +3.3% +0.4% +2.9% +10.6% ➖ noise
25 duckdb:duckdb -1.3% +0.4% -1.8% +10.0% ➖ noise
25 duckdb:vortex-file-compressed -4.7% +0.4% -5.1% +13.0% ➖ noise
26 datafusion:vortex-file-compressed +7.7% +3.6% +4.0% +10.0% ➖ noise
26 duckdb:duckdb -0.1% +3.6% -3.6% +13.0% ➖ noise
26 duckdb:vortex-file-compressed -6.4% +3.6% -9.7% +19.9% ➖ noise
27 datafusion:vortex-file-compressed +2.0% +0.7% +1.2% +10.0% ➖ noise
27 duckdb:duckdb -11.5% +0.7% -12.1% +10.0% ✅ faster
27 duckdb:vortex-file-compressed +1.0% +0.7% +0.3% +10.0% ➖ noise
28 datafusion:vortex-file-compressed -0.9% -0.1% -0.7% +11.1% ➖ noise
28 duckdb:duckdb -1.6% -0.1% -1.4% +10.0% ➖ noise
28 duckdb:vortex-file-compressed -0.2% -0.1% -0.1% +10.0% ➖ noise
29 datafusion:vortex-file-compressed -3.6% -1.5% -2.1% +10.5% ➖ noise
29 duckdb:duckdb -1.6% -1.5% -0.0% +10.0% ➖ noise
29 duckdb:vortex-file-compressed -3.4% -1.5% -1.9% +16.0% ➖ noise
30 datafusion:vortex-file-compressed -0.5% -1.3% +0.8% +10.0% ➖ noise
30 duckdb:duckdb -1.4% -1.3% -0.1% +10.0% ➖ noise
30 duckdb:vortex-file-compressed -0.1% -1.3% +1.2% +10.0% ➖ noise
31 datafusion:vortex-file-compressed -0.6% -2.7% +2.2% +10.0% ➖ noise
31 duckdb:duckdb -0.6% -2.7% +2.2% +10.0% ➖ noise
31 duckdb:vortex-file-compressed +2.7% -2.7% +5.6% +10.0% ➖ noise
32 datafusion:vortex-file-compressed +1.3% -1.4% +2.8% +10.0% ➖ noise
32 duckdb:duckdb -4.0% -1.4% -2.6% +10.0% ➖ noise
32 duckdb:vortex-file-compressed +9.3% -1.4% +10.9% +10.0% 🚨 regression
33 datafusion:vortex-file-compressed +1.0% -1.6% +2.6% +10.0% ➖ noise
33 duckdb:duckdb -6.5% -1.6% -5.0% +10.0% ➖ noise
33 duckdb:vortex-file-compressed +3.3% -1.6% +4.9% +10.0% ➖ noise
34 datafusion:vortex-file-compressed +0.4% +1.1% -0.7% +10.0% ➖ noise
34 duckdb:duckdb -1.2% +1.1% -2.3% +10.4% ➖ noise
34 duckdb:vortex-file-compressed -4.5% +1.1% -5.6% +10.0% ➖ noise
35 datafusion:vortex-file-compressed -2.1% +0.0% -2.2% +10.0% ➖ noise
35 duckdb:duckdb -1.3% +0.0% -1.3% +10.0% ➖ noise
35 duckdb:vortex-file-compressed +2.4% +0.0% +2.4% +10.0% ➖ noise
36 datafusion:vortex-file-compressed +0.9% -1.6% +2.6% +10.0% ➖ noise
36 duckdb:duckdb +4.5% -1.6% +6.2% +15.4% ➖ noise
36 duckdb:vortex-file-compressed +4.5% -1.6% +6.2% +10.4% ➖ noise
37 datafusion:vortex-file-compressed -0.0% -3.1% +3.2% +10.0% ➖ noise
37 duckdb:duckdb -2.6% -3.1% +0.5% +10.0% ➖ noise
37 duckdb:vortex-file-compressed +7.8% -3.1% +11.2% +10.0% 🚨 regression
38 datafusion:vortex-file-compressed +1.2% -0.8% +2.0% +11.1% ➖ noise
38 duckdb:duckdb -3.4% -0.8% -2.7% +16.8% ➖ noise
38 duckdb:vortex-file-compressed +1.3% -0.8% +2.1% +12.8% ➖ noise
39 datafusion:vortex-file-compressed +1.4% -2.5% +4.0% +10.0% ➖ noise
39 duckdb:duckdb -1.9% -2.5% +0.5% +20.9% ➖ noise
39 duckdb:vortex-file-compressed -1.8% -2.5% +0.7% +11.3% ➖ noise
40 datafusion:vortex-file-compressed -8.9% +0.2% -9.1% +10.3% ➖ noise
40 duckdb:duckdb -3.1% +0.2% -3.3% +11.0% ➖ noise
40 duckdb:vortex-file-compressed +3.9% +0.2% +3.7% +10.2% ➖ noise
41 datafusion:vortex-file-compressed -10.7% -2.1% -8.8% +10.0% ➖ noise
41 duckdb:duckdb -5.2% -2.1% -3.2% +10.0% ➖ noise
41 duckdb:vortex-file-compressed +5.2% -2.1% +7.4% +10.0% ➖ noise
42 datafusion:vortex-file-compressed -3.4% -0.7% -2.7% +13.5% ➖ noise
42 duckdb:duckdb -1.6% -0.7% -0.9% +13.9% ➖ noise
42 duckdb:vortex-file-compressed +4.1% -0.7% +4.8% +16.0% ➖ noise

@github-actions
Copy link
Copy Markdown
Contributor

File Sizes: Clickbench on NVME

File Size Changes (1 files changed, -0.0% overall, 0↑ 1↓)
File Scale Format Base HEAD Change %
duckdb.db 1.0 vortex-compact 268.00 KB 0 B 268.00 KB -100.0%

Totals:

  • vortex-compact: 7.06 GB → 7.06 GB (-0.0%)
  • vortex-file-compressed: 14.01 GB → 14.01 GB (0.0%)

@github-actions
Copy link
Copy Markdown
Contributor

Benchmarks: TPC-H SF=10 on S3

Verdict: No clear signal (environment too noisy confidence)
Attributed Vortex impact: +0.0%
Vortex (geomean): 0.972x ➖
Parquet (geomean): 0.972x ➖
Shifts: Parquet (control) -2.8% · Median polish -3.1%


datafusion / vortex-file-compressed (0.921x ➖, 0↑ 0↓)
name PR ca6942f (ns) base 1838a7a (ns) ratio (PR/base)
tpch_q01/datafusion:vortex-file-compressed 667348568 795094826 0.84
tpch_q02/datafusion:vortex-file-compressed 659836176 813416617 0.81
tpch_q03/datafusion:vortex-file-compressed 750673906 878015227 0.85
tpch_q04/datafusion:vortex-file-compressed 582964040 582354370 1.00
tpch_q05/datafusion:vortex-file-compressed 936097169 972158545 0.96
tpch_q06/datafusion:vortex-file-compressed 643716727 613015959 1.05
tpch_q07/datafusion:vortex-file-compressed 943506163 1061941595 0.89
tpch_q08/datafusion:vortex-file-compressed 1077113005 1257126883 0.86
tpch_q09/datafusion:vortex-file-compressed 1233243867 1337656858 0.92
tpch_q10/datafusion:vortex-file-compressed 910910210 1006521814 0.91
tpch_q11/datafusion:vortex-file-compressed 461938090 466407956 0.99
tpch_q12/datafusion:vortex-file-compressed 842969602 885040093 0.95
tpch_q13/datafusion:vortex-file-compressed 428858079 460755240 0.93
tpch_q14/datafusion:vortex-file-compressed 581599986 598454153 0.97
tpch_q15/datafusion:vortex-file-compressed 1042927498 1144164110 0.91
tpch_q16/datafusion:vortex-file-compressed 317544277 388357001 0.82
tpch_q17/datafusion:vortex-file-compressed 1114981368 1226005281 0.91
tpch_q18/datafusion:vortex-file-compressed 1188137015 1210200476 0.98
tpch_q19/datafusion:vortex-file-compressed 706044453 788665757 0.90
tpch_q20/datafusion:vortex-file-compressed 915731253 963395468 0.95
tpch_q21/datafusion:vortex-file-compressed 1600153626 1656390504 0.97
tpch_q22/datafusion:vortex-file-compressed 303804042 327558527 0.93
datafusion / vortex-compact (0.946x ➖, 0↑ 0↓)
name PR ca6942f (ns) base 1838a7a (ns) ratio (PR/base)
tpch_q01/datafusion:vortex-compact 662773759 680626147 0.97
tpch_q02/datafusion:vortex-compact 630577172 599792106 1.05
tpch_q03/datafusion:vortex-compact 658949848 692278653 0.95
tpch_q04/datafusion:vortex-compact 531634033 523237791 1.02
tpch_q05/datafusion:vortex-compact 830380745 860753499 0.96
tpch_q06/datafusion:vortex-compact 526687953 576565580 0.91
tpch_q07/datafusion:vortex-compact 901395105 962620052 0.94
tpch_q08/datafusion:vortex-compact 1013514303 1095643618 0.93
tpch_q09/datafusion:vortex-compact 1127649005 1159855064 0.97
tpch_q10/datafusion:vortex-compact 814394135 1018736882 0.80
tpch_q11/datafusion:vortex-compact 372788291 514438863 0.72
tpch_q12/datafusion:vortex-compact 723216046 954401020 0.76
tpch_q13/datafusion:vortex-compact 411622559 397288183 1.04
tpch_q14/datafusion:vortex-compact 575876460 561856100 1.02
tpch_q15/datafusion:vortex-compact 1011852536 1053060658 0.96
tpch_q16/datafusion:vortex-compact 296453379 315791134 0.94
tpch_q17/datafusion:vortex-compact 1140042201 1156613602 0.99
tpch_q18/datafusion:vortex-compact 1042315126 1051447662 0.99
tpch_q19/datafusion:vortex-compact 779535356 804922346 0.97
tpch_q20/datafusion:vortex-compact 855755622 907130759 0.94
tpch_q21/datafusion:vortex-compact 1375545622 1410794774 0.98
tpch_q22/datafusion:vortex-compact 352176366 319260662 1.10
datafusion / parquet (0.984x ➖, 0↑ 0↓)
name PR ca6942f (ns) base 1838a7a (ns) ratio (PR/base)
tpch_q01/datafusion:parquet 730369259 656714178 1.11
tpch_q02/datafusion:parquet 612104044 685121370 0.89
tpch_q03/datafusion:parquet 874939398 914388639 0.96
tpch_q04/datafusion:parquet 467770073 421288789 1.11
tpch_q05/datafusion:parquet 1153725375 1127260718 1.02
tpch_q06/datafusion:parquet 535982591 500564497 1.07
tpch_q07/datafusion:parquet 1418047303 1171184611 1.21
tpch_q08/datafusion:parquet 1673341345 1473629553 1.14
tpch_q09/datafusion:parquet 1812622540 1663127792 1.09
tpch_q10/datafusion:parquet 1910825291 2026399616 0.94
tpch_q11/datafusion:parquet 457793434 472406006 0.97
tpch_q12/datafusion:parquet 591106119 586573965 1.01
tpch_q13/datafusion:parquet 687574156 707063353 0.97
tpch_q14/datafusion:parquet 767607823 760889023 1.01
tpch_q15/datafusion:parquet 1163099242 1222954151 0.95
tpch_q16/datafusion:parquet 328044799 355932629 0.92
tpch_q17/datafusion:parquet 1310808271 1434677188 0.91
tpch_q18/datafusion:parquet 1349311702 1642338492 0.82
tpch_q19/datafusion:parquet 929824276 1103543462 0.84
tpch_q20/datafusion:parquet 1066072477 1207030737 0.88
tpch_q21/datafusion:parquet 1629110960 1661748163 0.98
tpch_q22/datafusion:parquet 634447846 676003968 0.94
duckdb / vortex-file-compressed (1.015x ➖, 0↑ 0↓)
name PR ca6942f (ns) base 1838a7a (ns) ratio (PR/base)
tpch_q01/duckdb:vortex-file-compressed 618277646 618372015 1.00
tpch_q02/duckdb:vortex-file-compressed 1093645695 1150313605 0.95
tpch_q03/duckdb:vortex-file-compressed 908704443 910036922 1.00
tpch_q04/duckdb:vortex-file-compressed 638969921 621707238 1.03
tpch_q05/duckdb:vortex-file-compressed 1108638177 1040453200 1.07
tpch_q06/duckdb:vortex-file-compressed 811158123 729473164 1.11
tpch_q07/duckdb:vortex-file-compressed 1110406119 1159788081 0.96
tpch_q08/duckdb:vortex-file-compressed 1397600697 1430151445 0.98
tpch_q09/duckdb:vortex-file-compressed 1505082186 1347253570 1.12
tpch_q10/duckdb:vortex-file-compressed 1075067807 1071208144 1.00
tpch_q11/duckdb:vortex-file-compressed 621235723 607088551 1.02
tpch_q12/duckdb:vortex-file-compressed 706202602 685086780 1.03
tpch_q13/duckdb:vortex-file-compressed 859996283 867481869 0.99
tpch_q14/duckdb:vortex-file-compressed 824547558 840256743 0.98
tpch_q15/duckdb:vortex-file-compressed 528054424 526457676 1.00
tpch_q16/duckdb:vortex-file-compressed 472901825 485403419 0.97
tpch_q17/duckdb:vortex-file-compressed 988001668 971712446 1.02
tpch_q18/duckdb:vortex-file-compressed 892634027 903224818 0.99
tpch_q19/duckdb:vortex-file-compressed 791173645 750162719 1.05
tpch_q20/duckdb:vortex-file-compressed 1256381609 1193454364 1.05
tpch_q21/duckdb:vortex-file-compressed 1896563014 1860237389 1.02
tpch_q22/duckdb:vortex-file-compressed 579779076 573684182 1.01
duckdb / vortex-compact (1.011x ➖, 0↑ 0↓)
name PR ca6942f (ns) base 1838a7a (ns) ratio (PR/base)
tpch_q01/duckdb:vortex-compact 641133411 591020549 1.08
tpch_q02/duckdb:vortex-compact 976321388 977169480 1.00
tpch_q03/duckdb:vortex-compact 787265734 794711503 0.99
tpch_q04/duckdb:vortex-compact 466410805 479712006 0.97
tpch_q05/duckdb:vortex-compact 1018915018 1003598255 1.02
tpch_q06/duckdb:vortex-compact 739997248 707061618 1.05
tpch_q07/duckdb:vortex-compact 1073200658 1019674133 1.05
tpch_q08/duckdb:vortex-compact 1323499368 1288643925 1.03
tpch_q09/duckdb:vortex-compact 1260191201 1284773606 0.98
tpch_q10/duckdb:vortex-compact 943295698 1017948758 0.93
tpch_q11/duckdb:vortex-compact 637608311 620781273 1.03
tpch_q12/duckdb:vortex-compact 726006418 633591620 1.15
tpch_q13/duckdb:vortex-compact 864440236 829720085 1.04
tpch_q14/duckdb:vortex-compact 779754678 778101759 1.00
tpch_q15/duckdb:vortex-compact 521668133 519309892 1.00
tpch_q16/duckdb:vortex-compact 446923646 420468429 1.06
tpch_q17/duckdb:vortex-compact 870211845 859743107 1.01
tpch_q18/duckdb:vortex-compact 680647664 769140064 0.88
tpch_q19/duckdb:vortex-compact 712080416 693856669 1.03
tpch_q20/duckdb:vortex-compact 1110220762 1093784583 1.02
tpch_q21/duckdb:vortex-compact 1528828978 1608800073 0.95
tpch_q22/duckdb:vortex-compact 583791582 581475909 1.00
duckdb / parquet (0.960x ➖, 0↑ 0↓)
name PR ca6942f (ns) base 1838a7a (ns) ratio (PR/base)
tpch_q01/duckdb:parquet 754798737 750777245 1.01
tpch_q02/duckdb:parquet 1373412732 1519432251 0.90
tpch_q03/duckdb:parquet 1491174852 1493924879 1.00
tpch_q04/duckdb:parquet 806891472 888979807 0.91
tpch_q05/duckdb:parquet 1856524782 1989469815 0.93
tpch_q06/duckdb:parquet 658994471 729071335 0.90
tpch_q07/duckdb:parquet 1656842728 1839915401 0.90
tpch_q08/duckdb:parquet 2258212298 2315774167 0.98
tpch_q09/duckdb:parquet 2416195303 2374922690 1.02
tpch_q10/duckdb:parquet 2860818541 2994521696 0.96
tpch_q11/duckdb:parquet 946345308 1016113095 0.93
tpch_q12/duckdb:parquet 939793500 1069244619 0.88
tpch_q13/duckdb:parquet 1152073984 1177230306 0.98
tpch_q14/duckdb:parquet 1127186519 1214413475 0.93
tpch_q15/duckdb:parquet 869577600 799288466 1.09
tpch_q16/duckdb:parquet 812326261 846492235 0.96
tpch_q17/duckdb:parquet 1229606528 1299912775 0.95
tpch_q18/duckdb:parquet 1213950787 1289167636 0.94
tpch_q19/duckdb:parquet 1392290458 1434300697 0.97
tpch_q20/duckdb:parquet 1623545212 1733451780 0.94
tpch_q21/duckdb:parquet 1803897133 1779333830 1.01
tpch_q22/duckdb:parquet 1110537429 1025048687 1.08
Full attributed analysis
Query Config Raw Δ Control Δ Attributed α Noise floor Significant?
1 datafusion:vortex-compact -2.6% +5.7% -7.9% +30.8% ➖ noise
1 datafusion:vortex-file-compressed -16.1% +5.7% -20.6% +38.1% ➖ noise
1 duckdb:vortex-compact +8.5% +5.7% +2.6% +106.1% ➖ noise
1 duckdb:vortex-file-compressed -0.0% +5.7% -5.4% +30.0% ➖ noise
2 datafusion:vortex-compact +5.1% -10.1% +17.0% +42.6% ➖ noise
2 datafusion:vortex-file-compressed -18.9% -10.1% -9.7% +34.3% ➖ noise
2 duckdb:vortex-compact -0.1% -10.1% +11.2% +30.0% ➖ noise
2 duckdb:vortex-file-compressed -4.9% -10.1% +5.8% +30.0% ➖ noise
3 datafusion:vortex-compact -4.8% -2.3% -2.6% +37.2% ➖ noise
3 datafusion:vortex-file-compressed -14.5% -2.3% -12.5% +39.9% ➖ noise
3 duckdb:vortex-compact -0.9% -2.3% +1.4% +30.0% ➖ noise
3 duckdb:vortex-file-compressed -0.1% -2.3% +2.2% +32.7% ➖ noise
4 datafusion:vortex-compact +1.6% +0.4% +1.2% +30.0% ➖ noise
4 datafusion:vortex-file-compressed +0.1% +0.4% -0.3% +30.0% ➖ noise
4 duckdb:vortex-compact -2.8% +0.4% -3.1% +30.0% ➖ noise
4 duckdb:vortex-file-compressed +2.8% +0.4% +2.4% +30.0% ➖ noise
5 datafusion:vortex-compact -3.5% -2.3% -1.3% +30.0% ➖ noise
5 datafusion:vortex-file-compressed -3.7% -2.3% -1.5% +30.0% ➖ noise
5 duckdb:vortex-compact +1.5% -2.3% +3.9% +30.0% ➖ noise
5 duckdb:vortex-file-compressed +6.6% -2.3% +9.0% +30.0% ➖ noise
6 datafusion:vortex-compact -8.7% -1.6% -7.1% +30.0% ➖ noise
6 datafusion:vortex-file-compressed +5.0% -1.6% +6.7% +30.0% ➖ noise
6 duckdb:vortex-compact +4.7% -1.6% +6.4% +85.1% ➖ noise
6 duckdb:vortex-file-compressed +11.2% -1.6% +13.0% +30.0% ➖ noise
7 datafusion:vortex-compact -6.4% +4.4% -10.3% +30.0% ➖ noise
7 datafusion:vortex-file-compressed -11.2% +4.4% -14.9% +30.0% ➖ noise
7 duckdb:vortex-compact +5.2% +4.4% +0.8% +30.0% ➖ noise
7 duckdb:vortex-file-compressed -4.3% +4.4% -8.3% +30.0% ➖ noise
8 datafusion:vortex-compact -7.5% +5.2% -12.1% +30.0% ➖ noise
8 datafusion:vortex-file-compressed -14.3% +5.2% -18.6% +30.0% ➖ noise
8 duckdb:vortex-compact +2.7% +5.2% -2.4% +30.0% ➖ noise
8 duckdb:vortex-file-compressed -2.3% +5.2% -7.1% +30.0% ➖ noise
9 datafusion:vortex-compact -2.8% +5.3% -7.7% +30.0% ➖ noise
9 datafusion:vortex-file-compressed -7.8% +5.3% -12.4% +30.0% ➖ noise
9 duckdb:vortex-compact -1.9% +5.3% -6.9% +30.0% ➖ noise
9 duckdb:vortex-file-compressed +11.7% +5.3% +6.1% +30.0% ➖ noise
10 datafusion:vortex-compact -20.1% -5.1% -15.8% +30.0% ➖ noise
10 datafusion:vortex-file-compressed -9.5% -5.1% -4.6% +30.0% ➖ noise
10 duckdb:vortex-compact -7.3% -5.1% -2.4% +30.0% ➖ noise
10 duckdb:vortex-file-compressed +0.4% -5.1% +5.7% +30.0% ➖ noise
11 datafusion:vortex-compact -27.5% -5.0% -23.7% +30.0% ✅ faster
11 datafusion:vortex-file-compressed -1.0% -5.0% +4.3% +30.0% ➖ noise
11 duckdb:vortex-compact +2.7% -5.0% +8.1% +30.0% ➖ noise
11 duckdb:vortex-file-compressed +2.3% -5.0% +7.7% +30.0% ➖ noise
12 datafusion:vortex-compact -24.2% -5.9% -19.5% +30.0% ➖ noise
12 datafusion:vortex-file-compressed -4.8% -5.9% +1.2% +30.0% ➖ noise
12 duckdb:vortex-compact +14.6% -5.9% +21.8% +30.0% ➖ noise
12 duckdb:vortex-file-compressed +3.1% -5.9% +9.5% +30.0% ➖ noise
13 datafusion:vortex-compact +3.6% -2.4% +6.2% +30.0% ➖ noise
13 datafusion:vortex-file-compressed -6.9% -2.4% -4.6% +30.0% ➖ noise
13 duckdb:vortex-compact +4.2% -2.4% +6.8% +32.8% ➖ noise
13 duckdb:vortex-file-compressed -0.9% -2.4% +1.6% +38.3% ➖ noise
14 datafusion:vortex-compact +2.5% -3.2% +5.9% +30.0% ➖ noise
14 datafusion:vortex-file-compressed -2.8% -3.2% +0.4% +30.0% ➖ noise
14 duckdb:vortex-compact +0.2% -3.2% +3.6% +30.0% ➖ noise
14 duckdb:vortex-file-compressed -1.9% -3.2% +1.4% +30.0% ➖ noise
15 datafusion:vortex-compact -3.9% +1.7% -5.5% +30.0% ➖ noise
15 datafusion:vortex-file-compressed -8.8% +1.7% -10.4% +30.0% ➖ noise
15 duckdb:vortex-compact +0.5% +1.7% -1.2% +30.0% ➖ noise
15 duckdb:vortex-file-compressed +0.3% +1.7% -1.4% +108.2% ➖ noise
16 datafusion:vortex-compact -6.1% -6.0% -0.2% +30.0% ➖ noise
16 datafusion:vortex-file-compressed -18.2% -6.0% -13.1% +30.0% ➖ noise
16 duckdb:vortex-compact +6.3% -6.0% +13.0% +30.0% ➖ noise
16 duckdb:vortex-file-compressed -2.6% -6.0% +3.6% +30.0% ➖ noise
17 datafusion:vortex-compact -1.4% -7.0% +6.0% +30.0% ➖ noise
17 datafusion:vortex-file-compressed -9.1% -7.0% -2.2% +30.0% ➖ noise
17 duckdb:vortex-compact +1.2% -7.0% +8.9% +49.5% ➖ noise
17 duckdb:vortex-file-compressed +1.7% -7.0% +9.4% +30.0% ➖ noise
18 datafusion:vortex-compact -0.9% -12.0% +12.7% +30.0% ➖ noise
18 datafusion:vortex-file-compressed -1.8% -12.0% +11.6% +30.0% ➖ noise
18 duckdb:vortex-compact -11.5% -12.0% +0.6% +30.0% ➖ noise
18 duckdb:vortex-file-compressed -1.2% -12.0% +12.4% +30.0% ➖ noise
19 datafusion:vortex-compact -3.2% -9.6% +7.1% +30.0% ➖ noise
19 datafusion:vortex-file-compressed -10.5% -9.6% -1.0% +30.0% ➖ noise
19 duckdb:vortex-compact +2.6% -9.6% +13.5% +30.0% ➖ noise
19 duckdb:vortex-file-compressed +5.5% -9.6% +16.6% +30.0% ➖ noise
20 datafusion:vortex-compact -5.7% -9.0% +3.7% +30.0% ➖ noise
20 datafusion:vortex-file-compressed -4.9% -9.0% +4.5% +30.0% ➖ noise
20 duckdb:vortex-compact +1.5% -9.0% +11.6% +30.0% ➖ noise
20 duckdb:vortex-file-compressed +5.3% -9.0% +15.7% +30.0% ➖ noise
21 datafusion:vortex-compact -2.5% -0.3% -2.2% +30.0% ➖ noise
21 datafusion:vortex-file-compressed -3.4% -0.3% -3.1% +30.0% ➖ noise
21 duckdb:vortex-compact -5.0% -0.3% -4.7% +30.0% ➖ noise
21 duckdb:vortex-file-compressed +2.0% -0.3% +2.3% +30.0% ➖ noise
22 datafusion:vortex-compact +10.3% +0.8% +9.4% +30.0% ➖ noise
22 datafusion:vortex-file-compressed -7.3% +0.8% -8.0% +30.0% ➖ noise
22 duckdb:vortex-compact +0.4% +0.8% -0.4% +30.0% ➖ noise
22 duckdb:vortex-file-compressed +1.1% +0.8% +0.2% +30.0% ➖ noise

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

changelog/performance A performance improvement ext/datafusion Relates to the DataFusion integration

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant