Skip to content

feat: add builder execution path with AppendChild step#7677

Open
joseph-isaacs wants to merge 5 commits intodevelopfrom
ji/append-to-builder-iter
Open

feat: add builder execution path with AppendChild step#7677
joseph-isaacs wants to merge 5 commits intodevelopfrom
ji/append-to-builder-iter

Conversation

@joseph-isaacs
Copy link
Copy Markdown
Contributor

@joseph-isaacs joseph-isaacs commented Apr 27, 2026

Adds ExecutionStep::AppendChild and execute_into_builder to support
iterative execution that appends child arrays directly into builders,
avoiding intermediate materialization for chunked arrays.

@codspeed-hq
Copy link
Copy Markdown

codspeed-hq Bot commented Apr 27, 2026

Merging this PR will degrade performance by 24.82%

⚠️ Different runtime environments detected

Some benchmarks with significant performance changes were compared across different runtime environments,
which may affect the accuracy of the results.

Open the report in CodSpeed to investigate

⚡ 19 improved benchmarks
❌ 5 regressed benchmarks
✅ 1106 untouched benchmarks
⏩ 33 skipped benchmarks1

⚠️ Please fix the performance issues or acknowledge them on CodSpeed.

Performance Changes

Mode Benchmark BASE HEAD Efficiency
Simulation chunked_opt_bool_into_canonical[(10, 1000)] 1 ms 1.3 ms -24.82%
Simulation chunked_opt_bool_into_canonical[(100, 100)] 220 µs 256.2 µs -14.14%
Simulation chunked_varbinview_opt_into_canonical[(10, 1000)] 2.5 ms 2.8 ms -12.21%
Simulation chunked_varbinview_into_canonical[(10, 1000)] 1.7 ms 2 ms -15.53%
Simulation alp_rd_decompress_f64 2.4 ms 1.1 ms ×2.2
Simulation decompress[alp_for_bp_f64] 2.9 ms 1.8 ms +58.54%
Simulation patched_take_10k_first_chunk_only 301.9 µs 271.4 µs +11.24%
Simulation patched_take_10k_adversarial 258.4 µs 228.1 µs +13.29%
Simulation take_10k_first_chunk_only 270.4 µs 225.4 µs +19.97%
Simulation take_10k_dispersed 284.4 µs 239.3 µs +18.85%
Simulation patched_take_10k_dispersed 315.5 µs 284.9 µs +10.73%
Simulation decompress_rd[f32, (10000, 0.0)] 166.2 µs 85.4 µs +94.59%
Simulation decompress_rd[f64, (10000, 0.0)] 258.2 µs 121.9 µs ×2.1
Simulation decompress_rd[f64, (10000, 0.1)] 258.7 µs 121.8 µs ×2.1
Simulation decompress_rd[f64, (100000, 0.0)] 2,294.7 µs 978.6 µs ×2.3
Simulation decompress_rd[f32, (100000, 0.0)] 1,287 µs 495.5 µs ×2.6
Simulation decompress_rd[f64, (100000, 0.01)] 2.3 ms 1 ms ×2.3
Simulation decompress_rd[f64, (10000, 0.01)] 258.6 µs 121.7 µs ×2.1
Simulation decompress_rd[f32, (10000, 0.1)] 165.9 µs 81.7 µs ×2
Simulation decompress_rd[f64, (100000, 0.1)] 2.3 ms 1 ms ×2.3
... ... ... ... ... ...

ℹ️ Only the first 20 benchmarks are displayed. Go to the app to view all benchmarks.


Comparing ji/append-to-builder-iter (178f4a2) with develop (b13ba9c)

Open in CodSpeed

Footnotes

  1. 33 benchmarks were skipped, so the baseline results were used instead. If they were deleted from the codebase, click here and archive them to remove them from the performance reports.

@joseph-isaacs joseph-isaacs force-pushed the ji/append-to-builder-iter branch from ddfb8fb to 2bdb707 Compare April 28, 2026 12:48
Signed-off-by: Joe Isaacs <joe.isaacs@live.co.uk>
@joseph-isaacs joseph-isaacs force-pushed the ji/append-to-builder-iter branch from 2bdb707 to b70fa7e Compare April 28, 2026 14:00
@joseph-isaacs joseph-isaacs marked this pull request as ready for review April 28, 2026 14:06
@joseph-isaacs joseph-isaacs added the action/benchmark Trigger full benchmarks to run on this PR label Apr 28, 2026
@github-actions github-actions Bot removed the action/benchmark Trigger full benchmarks to run on this PR label Apr 28, 2026
@github-actions
Copy link
Copy Markdown
Contributor

github-actions Bot commented Apr 28, 2026

Benchmarks: Compression

Vortex (geomean): 0.999x ➖
Parquet (geomean): 0.999x ➖


unknown / unknown (0.999x ➖, 6↑ 4↓)
name PR f8096d6 (ns) base bcb49d4 (ns) ratio (PR/base)
compress time/Arade 1178854783 1178765140 1.00
compress time/Bimbo 6800723014 6949897435 0.98
compress time/CMSprovider 2907523064 2922026137 1.00
compress time/Euro2016 439573386 448268865 0.98
compress time/Food 404326391 403873705 1.00
compress time/HashTags 829408362 832533220 1.00
compress time/TPC-H l_comment canonical 1373805511 1320569584 1.04
compress time/TPC-H l_comment chunked 1359099935 1343870026 1.01
compress time/taxi 733307999 734077927 1.00
compress time/wide table cols=100 chunks=1 rows=1000 12512400 11503353 1.09
compress time/wide table cols=100 chunks=50 rows=1000 12696153 11901922 1.07
compress time/wide table cols=1000 chunks=1 rows=1000 127930362 128677880 0.99
compress time/wide table cols=1000 chunks=50 rows=1000 130763386 130654648 1.00
compress time/wide table cols=10000 chunks=1 rows=1000 1435385595 1428666228 1.00
compress time/wide table cols=10000 chunks=50 rows=1000 1430831992 1418561459 1.01
decompress time/Arade 🚨 31081850 27876865 1.11
decompress time/Bimbo 🚀 83824734 101244138 0.83
decompress time/CMSprovider 81424446 87597760 0.93
decompress time/Euro2016 17814485 19635736 0.91
decompress time/Food 🚀 8385738 9941610 0.84
decompress time/HashTags 74033062 71327051 1.04
decompress time/TPC-H l_comment canonical 41640568 40254027 1.03
decompress time/TPC-H l_comment chunked 41017645 41666950 0.98
decompress time/taxi 🚀 15042824 16902642 0.89
decompress time/wide table cols=100 chunks=1 rows=1000 2745006 2652355 1.03
decompress time/wide table cols=100 chunks=50 rows=1000 🚨 2825110 2500872 1.13
decompress time/wide table cols=1000 chunks=1 rows=1000 24814719 24962125 0.99
decompress time/wide table cols=1000 chunks=50 rows=1000 25274148 24436768 1.03
decompress time/wide table cols=10000 chunks=1 rows=1000 279568547 272962027 1.02
decompress time/wide table cols=10000 chunks=50 rows=1000 281702920 276494032 1.02
parquet size/Arade 258014282 258014282 1.00
parquet size/Bimbo 384517292 384517292 1.00
parquet size/CMSprovider 376885545 376885545 1.00
parquet size/Euro2016 122975499 122975499 1.00
parquet size/Food 35699500 35699500 1.00
parquet size/HashTags 133510943 133510943 1.00
parquet size/TPC-H l_comment canonical 158358238 158358238 1.00
parquet size/TPC-H l_comment chunked 158358238 158358238 1.00
parquet size/taxi 55283635 55283635 1.00
parquet size/wide table cols=100 chunks=1 rows=1000 932404 932404 1.00
parquet size/wide table cols=100 chunks=50 rows=1000 932404 932404 1.00
parquet size/wide table cols=1000 chunks=1 rows=1000 9324004 9324004 1.00
parquet size/wide table cols=1000 chunks=50 rows=1000 9324004 9324004 1.00
parquet size/wide table cols=10000 chunks=1 rows=1000 93240004 93240004 1.00
parquet size/wide table cols=10000 chunks=50 rows=1000 93240004 93240004 1.00
parquet_rs-zstd compress time/Arade 3025389362 3029969430 1.00
parquet_rs-zstd compress time/Bimbo 15206455260 15430624034 0.99
parquet_rs-zstd compress time/CMSprovider 7700684037 8086331614 0.95
parquet_rs-zstd compress time/Euro2016 1382689777 1406781038 0.98
parquet_rs-zstd compress time/Food 880020246 890627897 0.99
parquet_rs-zstd compress time/HashTags 2376450712 2428841629 0.98
parquet_rs-zstd compress time/TPC-H l_comment canonical 3220751134 3217483840 1.00
parquet_rs-zstd compress time/TPC-H l_comment chunked 3218602647 3258238314 0.99
parquet_rs-zstd compress time/taxi 1420245516 1410660241 1.01
parquet_rs-zstd compress time/wide table cols=100 chunks=1 rows=1000 7735930 7706372 1.00
parquet_rs-zstd compress time/wide table cols=100 chunks=50 rows=1000 7516790 7229537 1.04
parquet_rs-zstd compress time/wide table cols=1000 chunks=1 rows=1000 86265654 81554274 1.06
parquet_rs-zstd compress time/wide table cols=1000 chunks=50 rows=1000 86188417 84338811 1.02
parquet_rs-zstd compress time/wide table cols=10000 chunks=1 rows=1000 899844708 883462306 1.02
parquet_rs-zstd compress time/wide table cols=10000 chunks=50 rows=1000 889472107 869192953 1.02
parquet_rs-zstd decompress time/Arade 647155232 651323562 0.99
parquet_rs-zstd decompress time/Bimbo 1711406202 1735647159 0.99
parquet_rs-zstd decompress time/CMSprovider 1986083709 2058334100 0.96
parquet_rs-zstd decompress time/Euro2016 388304655 399691900 0.97
parquet_rs-zstd decompress time/Food 220229006 224677573 0.98
parquet_rs-zstd decompress time/HashTags 679999725 658882031 1.03
parquet_rs-zstd decompress time/TPC-H l_comment canonical 582938305 581342674 1.00
parquet_rs-zstd decompress time/TPC-H l_comment chunked 582268515 573282096 1.02
parquet_rs-zstd decompress time/taxi 251300739 251117720 1.00
parquet_rs-zstd decompress time/wide table cols=100 chunks=1 rows=1000 2876869 2945380 0.98
parquet_rs-zstd decompress time/wide table cols=100 chunks=50 rows=1000 2798572 2782798 1.01
parquet_rs-zstd decompress time/wide table cols=1000 chunks=1 rows=1000 32984494 33476308 0.99
parquet_rs-zstd decompress time/wide table cols=1000 chunks=50 rows=1000 33518534 32836490 1.02
parquet_rs-zstd decompress time/wide table cols=10000 chunks=1 rows=1000 344154459 351426761 0.98
parquet_rs-zstd decompress time/wide table cols=10000 chunks=50 rows=1000 344670999 348658764 0.99
vortex-file-compressed size/Arade 145363796 145363796 1.00
vortex-file-compressed size/Bimbo 468763332 468763332 1.00
vortex-file-compressed size/CMSprovider 417907812 417907812 1.00
vortex-file-compressed size/Euro2016 163497796 163586068 1.00
vortex-file-compressed size/Food 41926936 41926936 1.00
vortex-file-compressed size/HashTags 195647828 195647828 1.00
vortex-file-compressed size/TPC-H l_comment canonical 179087360 179087360 1.00
vortex-file-compressed size/TPC-H l_comment chunked 179087360 179087360 1.00
vortex-file-compressed size/taxi 52363948 52363948 1.00
vortex-file-compressed size/wide table cols=100 chunks=1 rows=1000 930848 930848 1.00
vortex-file-compressed size/wide table cols=100 chunks=50 rows=1000 930848 930848 1.00
vortex-file-compressed size/wide table cols=1000 chunks=1 rows=1000 9293648 9293648 1.00
vortex-file-compressed size/wide table cols=1000 chunks=50 rows=1000 9293648 9293648 1.00
vortex-file-compressed size/wide table cols=10000 chunks=1 rows=1000 92957648 92957648 1.00
vortex-file-compressed size/wide table cols=10000 chunks=50 rows=1000 92957648 92957648 1.00
vortex:parquet-zstd ratio compress time/Arade 0 0 1.00
vortex:parquet-zstd ratio compress time/Bimbo 0 0 0.99
vortex:parquet-zstd ratio compress time/CMSprovider 0 0 1.04
vortex:parquet-zstd ratio compress time/Euro2016 0 0 1.00
vortex:parquet-zstd ratio compress time/Food 0 0 1.01
vortex:parquet-zstd ratio compress time/HashTags 0 0 1.02
vortex:parquet-zstd ratio compress time/TPC-H l_comment canonical 0 0 1.04
vortex:parquet-zstd ratio compress time/TPC-H l_comment chunked 0 0 1.02
vortex:parquet-zstd ratio compress time/taxi 0 0 0.99
vortex:parquet-zstd ratio compress time/wide table cols=100 chunks=1 rows=1000 1 1 1.08
vortex:parquet-zstd ratio compress time/wide table cols=100 chunks=50 rows=1000 1 1 1.03
vortex:parquet-zstd ratio compress time/wide table cols=1000 chunks=1 rows=1000 1 1 0.94
vortex:parquet-zstd ratio compress time/wide table cols=1000 chunks=50 rows=1000 1 1 0.98
vortex:parquet-zstd ratio compress time/wide table cols=10000 chunks=1 rows=1000 1 1 0.99
vortex:parquet-zstd ratio compress time/wide table cols=10000 chunks=50 rows=1000 1 1 0.99
vortex:parquet-zstd ratio decompress time/Arade 🚨 0 0 1.12
vortex:parquet-zstd ratio decompress time/Bimbo 🚀 0 0 0.84
vortex:parquet-zstd ratio decompress time/CMSprovider 0 0 0.96
vortex:parquet-zstd ratio decompress time/Euro2016 0 0 0.93
vortex:parquet-zstd ratio decompress time/Food 🚀 0 0 0.86
vortex:parquet-zstd ratio decompress time/HashTags 0 0 1.01
vortex:parquet-zstd ratio decompress time/TPC-H l_comment canonical 0 0 1.03
vortex:parquet-zstd ratio decompress time/TPC-H l_comment chunked 0 0 0.97
vortex:parquet-zstd ratio decompress time/taxi 🚀 0 0 0.89
vortex:parquet-zstd ratio decompress time/wide table cols=100 chunks=1 rows=1000 0 0 1.06
vortex:parquet-zstd ratio decompress time/wide table cols=100 chunks=50 rows=1000 🚨 1 0 1.12
vortex:parquet-zstd ratio decompress time/wide table cols=1000 chunks=1 rows=1000 0 0 1.01
vortex:parquet-zstd ratio decompress time/wide table cols=1000 chunks=50 rows=1000 0 0 1.01
vortex:parquet-zstd ratio decompress time/wide table cols=10000 chunks=1 rows=1000 0 0 1.05
vortex:parquet-zstd ratio decompress time/wide table cols=10000 chunks=50 rows=1000 0 0 1.03
vortex:parquet-zstd size/Arade 0 0 1.00
vortex:parquet-zstd size/Bimbo 1 1 1.00
vortex:parquet-zstd size/CMSprovider 1 1 1.00
vortex:parquet-zstd size/Euro2016 1 1 1.00
vortex:parquet-zstd size/Food 1 1 1.00
vortex:parquet-zstd size/HashTags 1 1 1.00
vortex:parquet-zstd size/TPC-H l_comment canonical 1 1 1.00
vortex:parquet-zstd size/TPC-H l_comment chunked 1 1 1.00
vortex:parquet-zstd size/taxi 0 0 1.00
vortex:parquet-zstd size/wide table cols=100 chunks=1 rows=1000 0 0 1.00
vortex:parquet-zstd size/wide table cols=100 chunks=50 rows=1000 0 0 1.00
vortex:parquet-zstd size/wide table cols=1000 chunks=1 rows=1000 0 0 1.00
vortex:parquet-zstd size/wide table cols=1000 chunks=50 rows=1000 0 0 1.00
vortex:parquet-zstd size/wide table cols=10000 chunks=1 rows=1000 0 0 1.00
vortex:parquet-zstd size/wide table cols=10000 chunks=50 rows=1000 0 0 1.00

@github-actions
Copy link
Copy Markdown
Contributor

github-actions Bot commented Apr 28, 2026

Benchmarks: Random Access

Vortex (geomean): 0.968x ➖
Parquet (geomean): 1.008x ➖


unknown / unknown (0.986x ➖, 3↑ 0↓)
name PR f8096d6 (ns) base d036fc1 (ns) ratio (PR/base)
random-access/feature-vectors/correlated/lance-tokio-local-disk 🚀 2264691 3118193 0.73
random-access/feature-vectors/correlated/lance-tokio-local-disk-footer 1469663 1482114 0.99
random-access/feature-vectors/correlated/parquet-tokio-local-disk 8760799595 8607940354 1.02
random-access/feature-vectors/correlated/parquet-tokio-local-disk-footer 8691695428 8559427093 1.02
random-access/feature-vectors/correlated/vortex-tokio-local-disk 8264739 8392199 0.98
random-access/feature-vectors/correlated/vortex-tokio-local-disk-footer 7934131 8095214 0.98
random-access/feature-vectors/uniform/lance-tokio-local-disk 6031196 6076077 0.99
random-access/feature-vectors/uniform/lance-tokio-local-disk-footer 6686158 6808810 0.98
random-access/feature-vectors/uniform/parquet-tokio-local-disk 8764644112 8710372791 1.01
random-access/feature-vectors/uniform/parquet-tokio-local-disk-footer 8848549276 8624214859 1.03
random-access/feature-vectors/uniform/vortex-tokio-local-disk 14017682 14057195 1.00
random-access/feature-vectors/uniform/vortex-tokio-local-disk-footer 13586075 13877685 0.98
random-access/lance-tokio-local-disk 760342 755636 1.01
random-access/lance-tokio-local-disk-footer 1347891 1320590 1.02
random-access/nested-lists/correlated/lance-tokio-local-disk 258930 261293 0.99
random-access/nested-lists/correlated/lance-tokio-local-disk-footer 687402 689784 1.00
random-access/nested-lists/correlated/parquet-tokio-local-disk 138169963 134092410 1.03
random-access/nested-lists/correlated/parquet-tokio-local-disk-footer 138653273 133901230 1.04
random-access/nested-lists/correlated/vortex-tokio-local-disk 681306 673482 1.01
random-access/nested-lists/correlated/vortex-tokio-local-disk-footer 658698 692606 0.95
random-access/nested-lists/uniform/lance-tokio-local-disk 1102841 1097090 1.01
random-access/nested-lists/uniform/lance-tokio-local-disk-footer 1558948 1542423 1.01
random-access/nested-lists/uniform/parquet-tokio-local-disk 136619479 133974555 1.02
random-access/nested-lists/uniform/parquet-tokio-local-disk-footer 136202190 134312493 1.01
random-access/nested-lists/uniform/vortex-tokio-local-disk 2212773 2228412 0.99
random-access/nested-lists/uniform/vortex-tokio-local-disk-footer 2219998 2205745 1.01
random-access/nested-structs/correlated/lance-tokio-local-disk 400561 404058 0.99
random-access/nested-structs/correlated/lance-tokio-local-disk-footer 611797 624131 0.98
random-access/nested-structs/correlated/parquet-tokio-local-disk 27485622 28016163 0.98
random-access/nested-structs/correlated/parquet-tokio-local-disk-footer 27306783 27520370 0.99
random-access/nested-structs/correlated/vortex-tokio-local-disk 🚀 753080 839975 0.90
random-access/nested-structs/correlated/vortex-tokio-local-disk-footer 850055 846687 1.00
random-access/nested-structs/uniform/lance-tokio-local-disk 2729015 2724059 1.00
random-access/nested-structs/uniform/lance-tokio-local-disk-footer 2974639 2974857 1.00
random-access/nested-structs/uniform/parquet-tokio-local-disk 27138455 27344284 0.99
random-access/nested-structs/uniform/parquet-tokio-local-disk-footer 27195418 27570924 0.99
random-access/nested-structs/uniform/vortex-tokio-local-disk 1756913 1802638 0.97
random-access/nested-structs/uniform/vortex-tokio-local-disk-footer 1844072 1772339 1.04
random-access/parquet-tokio-local-disk 181117479 180224154 1.00
random-access/parquet-tokio-local-disk-footer 180346913 180695334 1.00
random-access/taxi/correlated/lance-tokio-local-disk 958527 957785 1.00
random-access/taxi/correlated/lance-tokio-local-disk-footer 1638327 1613642 1.02
random-access/taxi/correlated/parquet-tokio-local-disk 272319998 270620787 1.01
random-access/taxi/correlated/parquet-tokio-local-disk-footer 271492475 271124487 1.00
random-access/taxi/correlated/vortex-tokio-local-disk 🚀 1690010 2017222 0.84
random-access/taxi/correlated/vortex-tokio-local-disk-footer 1914671 2027790 0.94
random-access/taxi/uniform/lance-tokio-local-disk 10110913 9902803 1.02
random-access/taxi/uniform/lance-tokio-local-disk-footer 10793240 10668084 1.01
random-access/taxi/uniform/parquet-tokio-local-disk 287634356 288077806 1.00
random-access/taxi/uniform/parquet-tokio-local-disk-footer 293818837 288823148 1.02
random-access/taxi/uniform/vortex-tokio-local-disk 4886019 4951637 0.99
random-access/taxi/uniform/vortex-tokio-local-disk-footer 4856161 4911688 0.99
random-access/vortex-tokio-local-disk 1287513 1385898 0.93
random-access/vortex-tokio-local-disk-footer 1316728 1414488 0.93

@github-actions
Copy link
Copy Markdown
Contributor

github-actions Bot commented Apr 28, 2026

Benchmarks: TPC-H SF=10 on NVME

Verdict: No clear signal (low confidence)
Attributed Vortex impact: -0.7%
Vortex (geomean): 0.988x ➖
Parquet (geomean): 0.993x ➖
Shifts: Parquet (control) -0.7% · Median polish -0.9%


datafusion / vortex-file-compressed (0.985x ➖, 0↑ 0↓)
name PR f8096d6 (ns) base d036fc1 (ns) ratio (PR/base)
tpch_q01/datafusion:vortex-file-compressed 394801176 400341119 0.99
tpch_q02/datafusion:vortex-file-compressed 105487004 108367723 0.97
tpch_q03/datafusion:vortex-file-compressed 212999447 214990592 0.99
tpch_q04/datafusion:vortex-file-compressed 114922590 116544764 0.99
tpch_q05/datafusion:vortex-file-compressed 364891385 372888514 0.98
tpch_q06/datafusion:vortex-file-compressed 44657089 46342145 0.96
tpch_q07/datafusion:vortex-file-compressed 492798792 502002065 0.98
tpch_q08/datafusion:vortex-file-compressed 355077059 356704015 1.00
tpch_q09/datafusion:vortex-file-compressed 623137538 632015143 0.99
tpch_q10/datafusion:vortex-file-compressed 229725792 232735923 0.99
tpch_q11/datafusion:vortex-file-compressed 81288261 83580410 0.97
tpch_q12/datafusion:vortex-file-compressed 120705031 122638092 0.98
tpch_q13/datafusion:vortex-file-compressed 212196138 213910765 0.99
tpch_q14/datafusion:vortex-file-compressed 57870862 58522013 0.99
tpch_q15/datafusion:vortex-file-compressed 107799998 108105362 1.00
tpch_q16/datafusion:vortex-file-compressed 75893833 78357889 0.97
tpch_q17/datafusion:vortex-file-compressed 625112635 625166845 1.00
tpch_q18/datafusion:vortex-file-compressed 827881243 842032909 0.98
tpch_q19/datafusion:vortex-file-compressed 94131235 94641088 0.99
tpch_q20/datafusion:vortex-file-compressed 166085567 170020967 0.98
tpch_q21/datafusion:vortex-file-compressed 637499225 648670906 0.98
tpch_q22/datafusion:vortex-file-compressed 65022301 65067175 1.00
datafusion / vortex-compact (0.984x ➖, 0↑ 0↓)
name PR f8096d6 (ns) base d036fc1 (ns) ratio (PR/base)
tpch_q01/datafusion:vortex-compact 441578665 442892976 1.00
tpch_q02/datafusion:vortex-compact 108004600 110651942 0.98
tpch_q03/datafusion:vortex-compact 214505155 216166283 0.99
tpch_q04/datafusion:vortex-compact 121852588 121926630 1.00
tpch_q05/datafusion:vortex-compact 371336613 377764678 0.98
tpch_q06/datafusion:vortex-compact 65305082 64736482 1.01
tpch_q07/datafusion:vortex-compact 511142634 523687068 0.98
tpch_q08/datafusion:vortex-compact 358105839 362581040 0.99
tpch_q09/datafusion:vortex-compact 624199057 636153543 0.98
tpch_q10/datafusion:vortex-compact 246276404 249964595 0.99
tpch_q11/datafusion:vortex-compact 82224035 83029335 0.99
tpch_q12/datafusion:vortex-compact 166961394 167846213 0.99
tpch_q13/datafusion:vortex-compact 260356092 265897051 0.98
tpch_q14/datafusion:vortex-compact 73351946 74945935 0.98
tpch_q15/datafusion:vortex-compact 160776670 163852828 0.98
tpch_q16/datafusion:vortex-compact 77560310 79951828 0.97
tpch_q17/datafusion:vortex-compact 624858031 664192310 0.94
tpch_q18/datafusion:vortex-compact 829095927 842258570 0.98
tpch_q19/datafusion:vortex-compact 130224685 133157647 0.98
tpch_q20/datafusion:vortex-compact 188631571 190712421 0.99
tpch_q21/datafusion:vortex-compact 651050836 666825837 0.98
tpch_q22/datafusion:vortex-compact 72440394 72618533 1.00
datafusion / parquet (0.995x ➖, 0↑ 0↓)
name PR f8096d6 (ns) base d036fc1 (ns) ratio (PR/base)
tpch_q01/datafusion:parquet 478993776 448530298 1.07
tpch_q02/datafusion:parquet 171165134 174535375 0.98
tpch_q03/datafusion:parquet 287191348 288783446 0.99
tpch_q04/datafusion:parquet 131110771 132216066 0.99
tpch_q05/datafusion:parquet 432616547 444739467 0.97
tpch_q06/datafusion:parquet 131847687 133878158 0.98
tpch_q07/datafusion:parquet 607482091 612358710 0.99
tpch_q08/datafusion:parquet 466579439 467070143 1.00
tpch_q09/datafusion:parquet 742321899 748811180 0.99
tpch_q10/datafusion:parquet 494713899 500308742 0.99
tpch_q11/datafusion:parquet 122278320 119740654 1.02
tpch_q12/datafusion:parquet 204736860 217591548 0.94
tpch_q13/datafusion:parquet 331376077 330825524 1.00
tpch_q14/datafusion:parquet 160398279 166622583 0.96
tpch_q15/datafusion:parquet 256480945 247057584 1.04
tpch_q16/datafusion:parquet 129368760 131307391 0.99
tpch_q17/datafusion:parquet 675281996 685644045 0.98
tpch_q18/datafusion:parquet 853941951 881747246 0.97
tpch_q19/datafusion:parquet 294011280 284177457 1.03
tpch_q20/datafusion:parquet 291162882 297641536 0.98
tpch_q21/datafusion:parquet 698060633 704161798 0.99
tpch_q22/datafusion:parquet 213382813 208300219 1.02
datafusion / arrow (0.972x ➖, 1↑ 0↓)
name PR f8096d6 (ns) base d036fc1 (ns) ratio (PR/base)
tpch_q01/datafusion:arrow 602097678 603285191 1.00
tpch_q02/datafusion:arrow 164030427 161533608 1.02
tpch_q03/datafusion:arrow 460848968 477696887 0.96
tpch_q04/datafusion:arrow 337987204 343019946 0.99
tpch_q05/datafusion:arrow 919425612 940738208 0.98
tpch_q06/datafusion:arrow 281424024 293037027 0.96
tpch_q07/datafusion:arrow 1152474889 1186347729 0.97
tpch_q08/datafusion:arrow 1142483098 1184709029 0.96
tpch_q09/datafusion:arrow 1340188724 1340565750 1.00
tpch_q10/datafusion:arrow 580494743 597825061 0.97
tpch_q11/datafusion:arrow 135247305 137333296 0.98
tpch_q12/datafusion:arrow 🚀 674945366 795675373 0.85
tpch_q13/datafusion:arrow 498722839 505472116 0.99
tpch_q14/datafusion:arrow 309658772 327010761 0.95
tpch_q15/datafusion:arrow 681321050 697490253 0.98
tpch_q16/datafusion:arrow 103481302 103233462 1.00
tpch_q17/datafusion:arrow 1304017635 1315224563 0.99
tpch_q18/datafusion:arrow 1825913062 1894931053 0.96
tpch_q19/datafusion:arrow 483631647 495516588 0.98
tpch_q20/datafusion:arrow 486088351 493737897 0.98
tpch_q21/datafusion:arrow 2954483463 3005372727 0.98
tpch_q22/datafusion:arrow 125401844 131930166 0.95
duckdb / vortex-file-compressed (0.987x ➖, 0↑ 0↓)
name PR f8096d6 (ns) base d036fc1 (ns) ratio (PR/base)
tpch_q01/duckdb:vortex-file-compressed 170013973 170084838 1.00
tpch_q02/duckdb:vortex-file-compressed 50682850 51071779 0.99
tpch_q03/duckdb:vortex-file-compressed 122699095 128390937 0.96
tpch_q04/duckdb:vortex-file-compressed 151165406 151073516 1.00
tpch_q05/duckdb:vortex-file-compressed 125587340 127671188 0.98
tpch_q06/duckdb:vortex-file-compressed 46634882 46749210 1.00
tpch_q07/duckdb:vortex-file-compressed 145058235 145738147 1.00
tpch_q08/duckdb:vortex-file-compressed 167077320 169844697 0.98
tpch_q09/duckdb:vortex-file-compressed 322082491 321425974 1.00
tpch_q10/duckdb:vortex-file-compressed 140910266 150442995 0.94
tpch_q11/duckdb:vortex-file-compressed 31733606 32760645 0.97
tpch_q12/duckdb:vortex-file-compressed 92327330 95526141 0.97
tpch_q13/duckdb:vortex-file-compressed 225796941 225890939 1.00
tpch_q14/duckdb:vortex-file-compressed 66059182 65693288 1.01
tpch_q15/duckdb:vortex-file-compressed 86629303 88119388 0.98
tpch_q16/duckdb:vortex-file-compressed 77704200 77618310 1.00
tpch_q17/duckdb:vortex-file-compressed 99154718 99513999 1.00
tpch_q18/duckdb:vortex-file-compressed 288364839 291798032 0.99
tpch_q19/duckdb:vortex-file-compressed 82654131 84171757 0.98
tpch_q20/duckdb:vortex-file-compressed 157763050 157464330 1.00
tpch_q21/duckdb:vortex-file-compressed 561335134 566780460 0.99
tpch_q22/duckdb:vortex-file-compressed 70807881 71145906 1.00
duckdb / vortex-compact (0.995x ➖, 0↑ 0↓)
name PR f8096d6 (ns) base d036fc1 (ns) ratio (PR/base)
tpch_q01/duckdb:vortex-compact 227625612 227850419 1.00
tpch_q02/duckdb:vortex-compact 56948033 55390048 1.03
tpch_q03/duckdb:vortex-compact 138494728 138628460 1.00
tpch_q04/duckdb:vortex-compact 171676508 172561887 0.99
tpch_q05/duckdb:vortex-compact 144462632 145955247 0.99
tpch_q06/duckdb:vortex-compact 84231962 83706052 1.01
tpch_q07/duckdb:vortex-compact 196205363 198745027 0.99
tpch_q08/duckdb:vortex-compact 186927028 185653216 1.01
tpch_q09/duckdb:vortex-compact 348445899 354719337 0.98
tpch_q10/duckdb:vortex-compact 173930439 179698081 0.97
tpch_q11/duckdb:vortex-compact 39696721 39671996 1.00
tpch_q12/duckdb:vortex-compact 200248013 203425257 0.98
tpch_q13/duckdb:vortex-compact 273278305 276310348 0.99
tpch_q14/duckdb:vortex-compact 99629405 99048538 1.01
tpch_q15/duckdb:vortex-compact 112445120 111859623 1.01
tpch_q16/duckdb:vortex-compact 81305923 82436091 0.99
tpch_q17/duckdb:vortex-compact 110278689 111557107 0.99
tpch_q18/duckdb:vortex-compact 288684749 291616527 0.99
tpch_q19/duckdb:vortex-compact 107468686 106924259 1.01
tpch_q20/duckdb:vortex-compact 202412524 201810061 1.00
tpch_q21/duckdb:vortex-compact 610351222 613870965 0.99
tpch_q22/duckdb:vortex-compact 83867171 85510558 0.98
duckdb / parquet (0.991x ➖, 0↑ 0↓)
name PR f8096d6 (ns) base d036fc1 (ns) ratio (PR/base)
tpch_q01/duckdb:parquet 255594631 255947510 1.00
tpch_q02/duckdb:parquet 93856344 94487085 0.99
tpch_q03/duckdb:parquet 212422124 207589387 1.02
tpch_q04/duckdb:parquet 131854595 135327665 0.97
tpch_q05/duckdb:parquet 218131687 217421702 1.00
tpch_q06/duckdb:parquet 65560327 66572904 0.98
tpch_q07/duckdb:parquet 182519235 177852411 1.03
tpch_q08/duckdb:parquet 250379960 254765915 0.98
tpch_q09/duckdb:parquet 486713339 487129550 1.00
tpch_q10/duckdb:parquet 611648190 616246703 0.99
tpch_q11/duckdb:parquet 58136319 60438999 0.96
tpch_q12/duckdb:parquet 120700411 125066290 0.97
tpch_q13/duckdb:parquet 447319800 449573721 0.99
tpch_q14/duckdb:parquet 171586263 171548579 1.00
tpch_q15/duckdb:parquet 95747116 98312290 0.97
tpch_q16/duckdb:parquet 156210560 165057351 0.95
tpch_q17/duckdb:parquet 175018111 173893628 1.01
tpch_q18/duckdb:parquet 353631047 350677955 1.01
tpch_q19/duckdb:parquet 282586834 284342006 0.99
tpch_q20/duckdb:parquet 229308570 231149182 0.99
tpch_q21/duckdb:parquet 558041136 559913228 1.00
tpch_q22/duckdb:parquet 288840927 291218512 0.99
duckdb / duckdb (0.992x ➖, 0↑ 0↓)
name PR f8096d6 (ns) base d036fc1 (ns) ratio (PR/base)
tpch_q01/duckdb:duckdb 116849239 116864503 1.00
tpch_q02/duckdb:duckdb 44710852 45669405 0.98
tpch_q03/duckdb:duckdb 96249325 97265414 0.99
tpch_q04/duckdb:duckdb 130538428 131639342 0.99
tpch_q05/duckdb:duckdb 109229083 108971023 1.00
tpch_q06/duckdb:duckdb 37045372 37210060 1.00
tpch_q07/duckdb:duckdb 86414013 86766660 1.00
tpch_q08/duckdb:duckdb 109556802 110676815 0.99
tpch_q09/duckdb:duckdb 277522910 276843830 1.00
tpch_q10/duckdb:duckdb 203274584 205702391 0.99
tpch_q11/duckdb:duckdb 15444600 15436955 1.00
tpch_q12/duckdb:duckdb 84557756 85196885 0.99
tpch_q13/duckdb:duckdb 222764630 224098184 0.99
tpch_q14/duckdb:duckdb 70887354 72025650 0.98
tpch_q15/duckdb:duckdb 77212587 77190238 1.00
tpch_q16/duckdb:duckdb 72665276 74358927 0.98
tpch_q17/duckdb:duckdb 84484995 84869962 1.00
tpch_q18/duckdb:duckdb 211486860 214245501 0.99
tpch_q19/duckdb:duckdb 116086399 115558058 1.00
tpch_q20/duckdb:duckdb 112007423 112657172 0.99
tpch_q21/duckdb:duckdb 293504544 294865645 1.00
tpch_q22/duckdb:duckdb 66412340 68499288 0.97
Full attributed analysis
Query Config Raw Δ Control Δ Attributed α Noise floor Significant?
1 datafusion:arrow -0.2% +3.3% -3.4% +10.0% ➖ noise
1 datafusion:vortex-compact -0.3% +3.3% -3.5% +10.0% ➖ noise
1 datafusion:vortex-file-compressed -1.4% +3.3% -4.5% +10.0% ➖ noise
1 duckdb:duckdb -0.0% +3.3% -3.2% +10.0% ➖ noise
1 duckdb:vortex-compact -0.1% +3.3% -3.3% +10.0% ➖ noise
1 duckdb:vortex-file-compressed -0.0% +3.3% -3.2% +10.0% ➖ noise
2 datafusion:arrow +1.5% -1.3% +2.9% +10.0% ➖ noise
2 datafusion:vortex-compact -2.4% -1.3% -1.1% +10.0% ➖ noise
2 datafusion:vortex-file-compressed -2.7% -1.3% -1.4% +10.0% ➖ noise
2 duckdb:duckdb -2.1% -1.3% -0.8% +10.0% ➖ noise
2 duckdb:vortex-compact +2.8% -1.3% +4.2% +10.0% ➖ noise
2 duckdb:vortex-file-compressed -0.8% -1.3% +0.5% +10.0% ➖ noise
3 datafusion:arrow -3.5% +0.9% -4.4% +10.0% ➖ noise
3 datafusion:vortex-compact -0.8% +0.9% -1.6% +10.0% ➖ noise
3 datafusion:vortex-file-compressed -0.9% +0.9% -1.8% +10.0% ➖ noise
3 duckdb:duckdb -1.0% +0.9% -1.9% +10.0% ➖ noise
3 duckdb:vortex-compact -0.1% +0.9% -1.0% +10.0% ➖ noise
3 duckdb:vortex-file-compressed -4.4% +0.9% -5.3% +10.0% ➖ noise
4 datafusion:arrow -1.5% -1.7% +0.2% +10.0% ➖ noise
4 datafusion:vortex-compact -0.1% -1.7% +1.7% +10.0% ➖ noise
4 datafusion:vortex-file-compressed -1.4% -1.7% +0.3% +10.0% ➖ noise
4 duckdb:duckdb -0.8% -1.7% +0.9% +10.0% ➖ noise
4 duckdb:vortex-compact -0.5% -1.7% +1.2% +10.0% ➖ noise
4 duckdb:vortex-file-compressed +0.1% -1.7% +1.8% +10.0% ➖ noise
5 datafusion:arrow -2.3% -1.2% -1.1% +10.0% ➖ noise
5 datafusion:vortex-compact -1.7% -1.2% -0.5% +10.0% ➖ noise
5 datafusion:vortex-file-compressed -2.1% -1.2% -0.9% +10.0% ➖ noise
5 duckdb:duckdb +0.2% -1.2% +1.5% +10.0% ➖ noise
5 duckdb:vortex-compact -1.0% -1.2% +0.2% +10.0% ➖ noise
5 duckdb:vortex-file-compressed -1.6% -1.2% -0.4% +10.0% ➖ noise
6 datafusion:arrow -4.0% -1.5% -2.5% +10.0% ➖ noise
6 datafusion:vortex-compact +0.9% -1.5% +2.4% +10.0% ➖ noise
6 datafusion:vortex-file-compressed -3.6% -1.5% -2.1% +10.0% ➖ noise
6 duckdb:duckdb -0.4% -1.5% +1.1% +10.3% ➖ noise
6 duckdb:vortex-compact +0.6% -1.5% +2.2% +10.0% ➖ noise
6 duckdb:vortex-file-compressed -0.2% -1.5% +1.3% +10.0% ➖ noise
7 datafusion:arrow -2.9% +0.9% -3.7% +10.0% ➖ noise
7 datafusion:vortex-compact -2.4% +0.9% -3.3% +10.0% ➖ noise
7 datafusion:vortex-file-compressed -1.8% +0.9% -2.7% +10.0% ➖ noise
7 duckdb:duckdb -0.4% +0.9% -1.3% +10.0% ➖ noise
7 duckdb:vortex-compact -1.3% +0.9% -2.2% +10.0% ➖ noise
7 duckdb:vortex-file-compressed -0.5% +0.9% -1.4% +10.0% ➖ noise
8 datafusion:arrow -3.6% -0.9% -2.7% +10.0% ➖ noise
8 datafusion:vortex-compact -1.2% -0.9% -0.3% +10.0% ➖ noise
8 datafusion:vortex-file-compressed -0.5% -0.9% +0.5% +10.0% ➖ noise
8 duckdb:duckdb -1.0% -0.9% -0.1% +10.0% ➖ noise
8 duckdb:vortex-compact +0.7% -0.9% +1.6% +10.0% ➖ noise
8 duckdb:vortex-file-compressed -1.6% -0.9% -0.7% +10.0% ➖ noise
9 datafusion:arrow -0.0% -0.5% +0.5% +10.0% ➖ noise
9 datafusion:vortex-compact -1.9% -0.5% -1.4% +10.0% ➖ noise
9 datafusion:vortex-file-compressed -1.4% -0.5% -0.9% +10.0% ➖ noise
9 duckdb:duckdb +0.2% -0.5% +0.7% +10.0% ➖ noise
9 duckdb:vortex-compact -1.8% -0.5% -1.3% +10.0% ➖ noise
9 duckdb:vortex-file-compressed +0.2% -0.5% +0.7% +10.0% ➖ noise
10 datafusion:arrow -2.9% -0.9% -2.0% +10.0% ➖ noise
10 datafusion:vortex-compact -1.5% -0.9% -0.5% +10.0% ➖ noise
10 datafusion:vortex-file-compressed -1.3% -0.9% -0.4% +10.0% ➖ noise
10 duckdb:duckdb -1.2% -0.9% -0.3% +10.0% ➖ noise
10 duckdb:vortex-compact -3.2% -0.9% -2.3% +10.0% ➖ noise
10 duckdb:vortex-file-compressed -6.3% -0.9% -5.5% +10.0% ➖ noise
11 datafusion:arrow -1.5% -0.9% -0.6% +10.0% ➖ noise
11 datafusion:vortex-compact -1.0% -0.9% -0.1% +10.0% ➖ noise
11 datafusion:vortex-file-compressed -2.7% -0.9% -1.9% +10.0% ➖ noise
11 duckdb:duckdb +0.0% -0.9% +0.9% +10.4% ➖ noise
11 duckdb:vortex-compact +0.1% -0.9% +1.0% +10.0% ➖ noise
11 duckdb:vortex-file-compressed -3.1% -0.9% -2.3% +10.0% ➖ noise
12 datafusion:arrow -15.2% -4.7% -11.0% +37.8% ➖ noise
12 datafusion:vortex-compact -0.5% -4.7% +4.4% +10.0% ➖ noise
12 datafusion:vortex-file-compressed -1.6% -4.7% +3.3% +10.0% ➖ noise
12 duckdb:duckdb -0.8% -4.7% +4.2% +10.0% ➖ noise
12 duckdb:vortex-compact -1.6% -4.7% +3.3% +10.0% ➖ noise
12 duckdb:vortex-file-compressed -3.3% -4.7% +1.4% +10.0% ➖ noise
13 datafusion:arrow -1.3% -0.2% -1.2% +10.0% ➖ noise
13 datafusion:vortex-compact -2.1% -0.2% -1.9% +10.0% ➖ noise
13 datafusion:vortex-file-compressed -0.8% -0.2% -0.6% +10.0% ➖ noise
13 duckdb:duckdb -0.6% -0.2% -0.4% +10.0% ➖ noise
13 duckdb:vortex-compact -1.1% -0.2% -0.9% +10.0% ➖ noise
13 duckdb:vortex-file-compressed -0.0% -0.2% +0.1% +10.0% ➖ noise
14 datafusion:arrow -5.3% -1.9% -3.5% +10.0% ➖ noise
14 datafusion:vortex-compact -2.1% -1.9% -0.3% +10.0% ➖ noise
14 datafusion:vortex-file-compressed -1.1% -1.9% +0.8% +10.0% ➖ noise
14 duckdb:duckdb -1.6% -1.9% +0.3% +10.0% ➖ noise
14 duckdb:vortex-compact +0.6% -1.9% +2.5% +10.0% ➖ noise
14 duckdb:vortex-file-compressed +0.6% -1.9% +2.5% +10.0% ➖ noise
15 datafusion:arrow -2.3% +0.6% -2.9% +10.0% ➖ noise
15 datafusion:vortex-compact -1.9% +0.6% -2.4% +10.0% ➖ noise
15 datafusion:vortex-file-compressed -0.3% +0.6% -0.8% +10.0% ➖ noise
15 duckdb:duckdb +0.0% +0.6% -0.5% +10.0% ➖ noise
15 duckdb:vortex-compact +0.5% +0.6% -0.0% +10.0% ➖ noise
15 duckdb:vortex-file-compressed -1.7% +0.6% -2.2% +10.0% ➖ noise
16 datafusion:arrow +0.2% -3.4% +3.8% +10.0% ➖ noise
16 datafusion:vortex-compact -3.0% -3.4% +0.5% +10.0% ➖ noise
16 datafusion:vortex-file-compressed -3.1% -3.4% +0.3% +10.0% ➖ noise
16 duckdb:duckdb -2.3% -3.4% +1.2% +10.0% ➖ noise
16 duckdb:vortex-compact -1.4% -3.4% +2.1% +10.0% ➖ noise
16 duckdb:vortex-file-compressed +0.1% -3.4% +3.7% +10.0% ➖ noise
17 datafusion:arrow -0.9% -0.4% -0.4% +10.0% ➖ noise
17 datafusion:vortex-compact -5.9% -0.4% -5.5% +10.0% ➖ noise
17 datafusion:vortex-file-compressed -0.0% -0.4% +0.4% +10.0% ➖ noise
17 duckdb:duckdb -0.5% -0.4% -0.0% +10.0% ➖ noise
17 duckdb:vortex-compact -1.1% -0.4% -0.7% +10.0% ➖ noise
17 duckdb:vortex-file-compressed -0.4% -0.4% +0.1% +10.0% ➖ noise
18 datafusion:arrow -3.6% -1.2% -2.5% +10.0% ➖ noise
18 datafusion:vortex-compact -1.6% -1.2% -0.4% +10.0% ➖ noise
18 datafusion:vortex-file-compressed -1.7% -1.2% -0.5% +10.0% ➖ noise
18 duckdb:duckdb -1.3% -1.2% -0.1% +10.0% ➖ noise
18 duckdb:vortex-compact -1.0% -1.2% +0.2% +10.0% ➖ noise
18 duckdb:vortex-file-compressed -1.2% -1.2% -0.0% +10.0% ➖ noise
19 datafusion:arrow -2.4% +1.4% -3.7% +10.0% ➖ noise
19 datafusion:vortex-compact -2.2% +1.4% -3.6% +10.0% ➖ noise
19 datafusion:vortex-file-compressed -0.5% +1.4% -1.9% +10.0% ➖ noise
19 duckdb:duckdb +0.5% +1.4% -0.9% +10.0% ➖ noise
19 duckdb:vortex-compact +0.5% +1.4% -0.9% +10.0% ➖ noise
19 duckdb:vortex-file-compressed -1.8% +1.4% -3.2% +10.0% ➖ noise
20 datafusion:arrow -1.5% -1.5% -0.1% +10.0% ➖ noise
20 datafusion:vortex-compact -1.1% -1.5% +0.4% +10.0% ➖ noise
20 datafusion:vortex-file-compressed -2.3% -1.5% -0.8% +10.0% ➖ noise
20 duckdb:duckdb -0.6% -1.5% +0.9% +10.0% ➖ noise
20 duckdb:vortex-compact +0.3% -1.5% +1.8% +10.0% ➖ noise
20 duckdb:vortex-file-compressed +0.2% -1.5% +1.7% +10.0% ➖ noise
21 datafusion:arrow -1.7% -0.6% -1.1% +10.0% ➖ noise
21 datafusion:vortex-compact -2.4% -0.6% -1.8% +10.0% ➖ noise
21 datafusion:vortex-file-compressed -1.7% -0.6% -1.1% +10.0% ➖ noise
21 duckdb:duckdb -0.5% -0.6% +0.1% +10.0% ➖ noise
21 duckdb:vortex-compact -0.6% -0.6% +0.0% +10.0% ➖ noise
21 duckdb:vortex-file-compressed -1.0% -0.6% -0.4% +10.0% ➖ noise
22 datafusion:arrow -4.9% +0.8% -5.7% +10.0% ➖ noise
22 datafusion:vortex-compact -0.2% +0.8% -1.0% +10.0% ➖ noise
22 datafusion:vortex-file-compressed -0.1% +0.8% -0.9% +10.0% ➖ noise
22 duckdb:duckdb -3.0% +0.8% -3.8% +10.0% ➖ noise
22 duckdb:vortex-compact -1.9% +0.8% -2.7% +10.0% ➖ noise
22 duckdb:vortex-file-compressed -0.5% +0.8% -1.3% +10.0% ➖ noise

@github-actions
Copy link
Copy Markdown
Contributor

github-actions Bot commented Apr 28, 2026

Benchmarks: FineWeb NVMe

Verdict: No clear signal (low confidence)
Attributed Vortex impact: +3.4%
Vortex (geomean): 0.991x ➖
Parquet (geomean): 0.959x ➖
Shifts: Parquet (control) -4.1% · Median polish -3.4%


datafusion / vortex-file-compressed (1.055x ➖, 0↑ 2↓)
name PR f8096d6 (ns) base d036fc1 (ns) ratio (PR/base)
fineweb_q00/datafusion:vortex-file-compressed 5485768 5658561 0.97
fineweb_q01/datafusion:vortex-file-compressed 22218026 20764058 1.07
fineweb_q02/datafusion:vortex-file-compressed 21712834 21273727 1.02
fineweb_q03/datafusion:vortex-file-compressed 🚨 76040543 63815790 1.19
fineweb_q04/datafusion:vortex-file-compressed 231279620 236895460 0.98
fineweb_q05/datafusion:vortex-file-compressed 217285958 224222041 0.97
fineweb_q06/datafusion:vortex-file-compressed 53518033 55584779 0.96
fineweb_q07/datafusion:vortex-file-compressed 56256280 60451747 0.93
fineweb_q08/datafusion:vortex-file-compressed 🚨 32521351 21516522 1.51
datafusion / vortex-compact (0.942x ➖, 2↑ 0↓)
name PR f8096d6 (ns) base d036fc1 (ns) ratio (PR/base)
fineweb_q00/datafusion:vortex-compact 5552442 5780875 0.96
fineweb_q01/datafusion:vortex-compact 🚀 124091200 139848200 0.89
fineweb_q02/datafusion:vortex-compact 129593114 137889875 0.94
fineweb_q03/datafusion:vortex-compact 1030835792 1052159315 0.98
fineweb_q04/datafusion:vortex-compact 1092494244 1136998423 0.96
fineweb_q05/datafusion:vortex-compact 955453745 949868441 1.01
fineweb_q06/datafusion:vortex-compact 524077520 525674464 1.00
fineweb_q07/datafusion:vortex-compact 548530043 550788334 1.00
fineweb_q08/datafusion:vortex-compact 🚀 19400686 24920751 0.78
datafusion / parquet (0.955x ➖, 1↑ 0↓)
name PR f8096d6 (ns) base d036fc1 (ns) ratio (PR/base)
fineweb_q00/datafusion:parquet 🚀 6325244 7051710 0.90
fineweb_q01/datafusion:parquet 278501785 290258239 0.96
fineweb_q02/datafusion:parquet 279995567 294329789 0.95
fineweb_q03/datafusion:parquet 294828588 289803987 1.02
fineweb_q04/datafusion:parquet 297713714 308651501 0.96
fineweb_q05/datafusion:parquet 291985454 307301787 0.95
fineweb_q06/datafusion:parquet 283218464 301812161 0.94
fineweb_q07/datafusion:parquet 278756460 289338765 0.96
fineweb_q08/datafusion:parquet 274485269 286972741 0.96
duckdb / vortex-file-compressed (1.005x ➖, 0↑ 1↓)
name PR f8096d6 (ns) base d036fc1 (ns) ratio (PR/base)
fineweb_q00/duckdb:vortex-file-compressed 3206387 3302475 0.97
fineweb_q01/duckdb:vortex-file-compressed 22158945 23690819 0.94
fineweb_q02/duckdb:vortex-file-compressed 23502131 24007879 0.98
fineweb_q03/duckdb:vortex-file-compressed 🚨 159324981 116978949 1.36
fineweb_q04/duckdb:vortex-file-compressed 223154948 226013447 0.99
fineweb_q05/duckdb:vortex-file-compressed 208554337 214261733 0.97
fineweb_q06/duckdb:vortex-file-compressed 51469237 53531223 0.96
fineweb_q07/duckdb:vortex-file-compressed 54615167 56419308 0.97
fineweb_q08/duckdb:vortex-file-compressed 22489875 23193098 0.97
duckdb / vortex-compact (0.966x ➖, 1↑ 1↓)
name PR f8096d6 (ns) base d036fc1 (ns) ratio (PR/base)
fineweb_q00/duckdb:vortex-compact 3761769 4023403 0.93
fineweb_q01/duckdb:vortex-compact 🚀 88113127 110835703 0.79
fineweb_q02/duckdb:vortex-compact 114220517 119345778 0.96
fineweb_q03/duckdb:vortex-compact 861451487 870787233 0.99
fineweb_q04/duckdb:vortex-compact 895292954 922089126 0.97
fineweb_q05/duckdb:vortex-compact 804891890 817468712 0.98
fineweb_q06/duckdb:vortex-compact 453775168 479150163 0.95
fineweb_q07/duckdb:vortex-compact 476285680 479470784 0.99
fineweb_q08/duckdb:vortex-compact 🚨 25833924 22416205 1.15
duckdb / parquet (0.963x ➖, 1↑ 0↓)
name PR f8096d6 (ns) base d036fc1 (ns) ratio (PR/base)
fineweb_q00/duckdb:parquet 29935272 31581638 0.95
fineweb_q01/duckdb:parquet 82381926 84127135 0.98
fineweb_q02/duckdb:parquet 83173267 86087750 0.97
fineweb_q03/duckdb:parquet 307840454 313444648 0.98
fineweb_q04/duckdb:parquet 440014452 440940198 1.00
fineweb_q05/duckdb:parquet 408661518 412760244 0.99
fineweb_q06/duckdb:parquet 197031062 201379728 0.98
fineweb_q07/duckdb:parquet 208878517 211995101 0.99
fineweb_q08/duckdb:parquet 🚀 28986393 34101178 0.85
Full attributed analysis
Query Config Raw Δ Control Δ Attributed α Noise floor Significant?
0 datafusion:vortex-compact -4.0% -7.8% +4.2% +51.4% ➖ noise
0 datafusion:vortex-file-compressed -3.1% -7.8% +5.1% +49.4% ➖ noise
0 duckdb:vortex-compact -6.5% -7.8% +1.4% +47.8% ➖ noise
0 duckdb:vortex-file-compressed -2.9% -7.8% +5.3% +86.1% ➖ noise
1 datafusion:vortex-compact -11.3% -3.1% -8.5% +12.2% ➖ noise
1 datafusion:vortex-file-compressed +7.0% -3.1% +10.4% +34.9% ➖ noise
1 duckdb:vortex-compact -20.5% -3.1% -18.0% +26.0% ➖ noise
1 duckdb:vortex-file-compressed -6.5% -3.1% -3.5% +62.7% ➖ noise
2 datafusion:vortex-compact -6.0% -4.1% -2.0% +10.5% ➖ noise
2 datafusion:vortex-file-compressed +2.1% -4.1% +6.5% +10.9% ➖ noise
2 duckdb:vortex-compact -4.3% -4.1% -0.2% +17.6% ➖ noise
2 duckdb:vortex-file-compressed -2.1% -4.1% +2.1% +10.0% ➖ noise
3 datafusion:vortex-compact -2.0% -0.0% -2.0% +10.0% ➖ noise
3 datafusion:vortex-file-compressed +19.2% -0.0% +19.2% +52.9% ➖ noise
3 duckdb:vortex-compact -1.1% -0.0% -1.0% +10.0% ➖ noise
3 duckdb:vortex-file-compressed +36.2% -0.0% +36.3% +36.9% ➖ noise
4 datafusion:vortex-compact -3.9% -1.9% -2.1% +10.0% ➖ noise
4 datafusion:vortex-file-compressed -2.4% -1.9% -0.5% +10.0% ➖ noise
4 duckdb:vortex-compact -2.9% -1.9% -1.0% +10.0% ➖ noise
4 duckdb:vortex-file-compressed -1.3% -1.9% +0.6% +10.0% ➖ noise
5 datafusion:vortex-compact +0.6% -3.0% +3.7% +10.0% ➖ noise
5 datafusion:vortex-file-compressed -3.1% -3.0% -0.1% +10.0% ➖ noise
5 duckdb:vortex-compact -1.5% -3.0% +1.5% +10.0% ➖ noise
5 duckdb:vortex-file-compressed -2.7% -3.0% +0.4% +10.0% ➖ noise
6 datafusion:vortex-compact -0.3% -4.2% +4.0% +10.0% ➖ noise
6 datafusion:vortex-file-compressed -3.7% -4.2% +0.5% +15.9% ➖ noise
6 duckdb:vortex-compact -5.3% -4.2% -1.2% +10.0% ➖ noise
6 duckdb:vortex-file-compressed -3.9% -4.2% +0.3% +10.0% ➖ noise
7 datafusion:vortex-compact -0.4% -2.6% +2.2% +10.0% ➖ noise
7 datafusion:vortex-file-compressed -6.9% -2.6% -4.5% +21.7% ➖ noise
7 duckdb:vortex-compact -0.7% -2.6% +2.0% +10.0% ➖ noise
7 duckdb:vortex-file-compressed -3.2% -2.6% -0.6% +10.0% ➖ noise
8 datafusion:vortex-compact -22.2% -9.8% -13.7% +44.4% ➖ noise
8 datafusion:vortex-file-compressed +51.1% -9.8% +67.6% +36.1% 🚨 regression
8 duckdb:vortex-compact +15.2% -9.8% +27.8% +23.2% 🚨 regression
8 duckdb:vortex-file-compressed -3.0% -9.8% +7.5% +31.8% ➖ noise

@github-actions
Copy link
Copy Markdown
Contributor

github-actions Bot commented Apr 28, 2026

Benchmarks: Statistical and Population Genetics

Verdict: No clear signal (low confidence)
Attributed Vortex impact: -0.4%
Vortex (geomean): 0.993x ➖
Parquet (geomean): 0.997x ➖
Shifts: Parquet (control) -0.3% · Median polish -0.4%


duckdb / vortex-file-compressed (0.994x ➖, 0↑ 1↓)
name PR f8096d6 (ns) base d036fc1 (ns) ratio (PR/base)
statpopgen_q00/duckdb:vortex-file-compressed 12326943 12077442 1.02
statpopgen_q01/duckdb:vortex-file-compressed 🚨 22959000 20188809 1.14
statpopgen_q02/duckdb:vortex-file-compressed 1388272523 1408210058 0.99
statpopgen_q03/duckdb:vortex-file-compressed 3091971262 3181904908 0.97
statpopgen_q04/duckdb:vortex-file-compressed 3123227217 3144766057 0.99
statpopgen_q05/duckdb:vortex-file-compressed 1448904275 1496152233 0.97
statpopgen_q06/duckdb:vortex-file-compressed 2145575326 2172644057 0.99
statpopgen_q07/duckdb:vortex-file-compressed 219576369 229124327 0.96
statpopgen_q08/duckdb:vortex-file-compressed 252481599 263304551 0.96
statpopgen_q09/duckdb:vortex-file-compressed 2896567345 2976649208 0.97
statpopgen_q10/duckdb:vortex-file-compressed 4711805863 4777954713 0.99
duckdb / vortex-compact (0.993x ➖, 0↑ 0↓)
name PR f8096d6 (ns) base d036fc1 (ns) ratio (PR/base)
statpopgen_q00/duckdb:vortex-compact 11155602 11543986 0.97
statpopgen_q01/duckdb:vortex-compact 166567025 165875730 1.00
statpopgen_q02/duckdb:vortex-compact 1844520174 1843946251 1.00
statpopgen_q03/duckdb:vortex-compact 3531959542 3525806247 1.00
statpopgen_q04/duckdb:vortex-compact 3530115651 3527921471 1.00
statpopgen_q05/duckdb:vortex-compact 1864037229 1910231083 0.98
statpopgen_q06/duckdb:vortex-compact 2679845107 2688768128 1.00
statpopgen_q07/duckdb:vortex-compact 898668047 892148243 1.01
statpopgen_q08/duckdb:vortex-compact 938321544 924040784 1.02
statpopgen_q09/duckdb:vortex-compact 3258818942 3379978073 0.96
statpopgen_q10/duckdb:vortex-compact 5365992245 5425607324 0.99
duckdb / parquet (0.997x ➖, 0↑ 0↓)
name PR f8096d6 (ns) base d036fc1 (ns) ratio (PR/base)
statpopgen_q00/duckdb:parquet 325933378 333120333 0.98
statpopgen_q01/duckdb:parquet 411879471 416841037 0.99
statpopgen_q02/duckdb:parquet 1004191385 1022200347 0.98
statpopgen_q03/duckdb:parquet 1503194676 1502661234 1.00
statpopgen_q04/duckdb:parquet 1512057939 1521225414 0.99
statpopgen_q05/duckdb:parquet 1017436702 1028277288 0.99
statpopgen_q06/duckdb:parquet 1502870825 1484722279 1.01
statpopgen_q07/duckdb:parquet 1328839420 1313379274 1.01
statpopgen_q08/duckdb:parquet 1321395971 1315929014 1.00
statpopgen_q09/duckdb:parquet 1352521528 1359329723 0.99
statpopgen_q10/duckdb:parquet 2685735908 2654083675 1.01
Full attributed analysis
Query Config Raw Δ Control Δ Attributed α Noise floor Significant?
0 duckdb:vortex-compact -3.4% -2.2% -1.2% +10.0% ➖ noise
0 duckdb:vortex-file-compressed +2.1% -2.2% +4.3% +14.8% ➖ noise
1 duckdb:vortex-compact +0.4% -1.2% +1.6% +10.0% ➖ noise
1 duckdb:vortex-file-compressed +13.7% -1.2% +15.1% +202.1% ➖ noise
2 duckdb:vortex-compact +0.0% -1.8% +1.8% +10.0% ➖ noise
2 duckdb:vortex-file-compressed -1.4% -1.8% +0.4% +10.0% ➖ noise
3 duckdb:vortex-compact +0.2% +0.0% +0.1% +10.0% ➖ noise
3 duckdb:vortex-file-compressed -2.8% +0.0% -2.9% +10.0% ➖ noise
4 duckdb:vortex-compact +0.1% -0.6% +0.7% +10.0% ➖ noise
4 duckdb:vortex-file-compressed -0.7% -0.6% -0.1% +10.0% ➖ noise
5 duckdb:vortex-compact -2.4% -1.1% -1.4% +10.0% ➖ noise
5 duckdb:vortex-file-compressed -3.2% -1.1% -2.1% +10.0% ➖ noise
6 duckdb:vortex-compact -0.3% +1.2% -1.5% +10.0% ➖ noise
6 duckdb:vortex-file-compressed -1.2% +1.2% -2.4% +10.0% ➖ noise
7 duckdb:vortex-compact +0.7% +1.2% -0.4% +10.0% ➖ noise
7 duckdb:vortex-file-compressed -4.2% +1.2% -5.3% +10.0% ➖ noise
8 duckdb:vortex-compact +1.5% +0.4% +1.1% +10.0% ➖ noise
8 duckdb:vortex-file-compressed -4.1% +0.4% -4.5% +10.0% ➖ noise
9 duckdb:vortex-compact -3.6% -0.5% -3.1% +10.0% ➖ noise
9 duckdb:vortex-file-compressed -2.7% -0.5% -2.2% +10.0% ➖ noise
10 duckdb:vortex-compact -1.1% +1.2% -2.3% +10.0% ➖ noise
10 duckdb:vortex-file-compressed -1.4% +1.2% -2.5% +10.0% ➖ noise

@github-actions
Copy link
Copy Markdown
Contributor

github-actions Bot commented Apr 28, 2026

Benchmarks: TPC-H SF=1 on NVME

Verdict: No clear signal (low confidence)
Attributed Vortex impact: -2.5%
Vortex (geomean): 0.945x ➖
Parquet (geomean): 0.965x ➖
Shifts: Parquet (control) -3.5% · Median polish -5.3%


datafusion / vortex-file-compressed (0.946x ➖, 0↑ 0↓)
name PR f8096d6 (ns) base d036fc1 (ns) ratio (PR/base)
tpch_q01/datafusion:vortex-file-compressed 51226392 54090070 0.95
tpch_q02/datafusion:vortex-file-compressed 22564223 23018270 0.98
tpch_q03/datafusion:vortex-file-compressed 27717643 30079268 0.92
tpch_q04/datafusion:vortex-file-compressed 21195739 22810140 0.93
tpch_q05/datafusion:vortex-file-compressed 48352995 53263834 0.91
tpch_q06/datafusion:vortex-file-compressed 12913190 13425629 0.96
tpch_q07/datafusion:vortex-file-compressed 55379569 59089839 0.94
tpch_q08/datafusion:vortex-file-compressed 39849225 42736636 0.93
tpch_q09/datafusion:vortex-file-compressed 54085965 54352284 1.00
tpch_q10/datafusion:vortex-file-compressed 39678367 42286771 0.94
tpch_q11/datafusion:vortex-file-compressed 16207337 16738378 0.97
tpch_q12/datafusion:vortex-file-compressed 26150353 26727400 0.98
tpch_q13/datafusion:vortex-file-compressed 25284920 26628218 0.95
tpch_q14/datafusion:vortex-file-compressed 17473811 17739632 0.99
tpch_q15/datafusion:vortex-file-compressed 26913961 28681642 0.94
tpch_q16/datafusion:vortex-file-compressed 18858328 19966833 0.94
tpch_q17/datafusion:vortex-file-compressed 67281592 69707875 0.97
tpch_q18/datafusion:vortex-file-compressed 79618807 86578829 0.92
tpch_q19/datafusion:vortex-file-compressed 22960451 24174256 0.95
tpch_q20/datafusion:vortex-file-compressed 30418539 32524114 0.94
tpch_q21/datafusion:vortex-file-compressed 72768583 78999367 0.92
tpch_q22/datafusion:vortex-file-compressed 12242420 13412960 0.91
datafusion / vortex-compact (0.943x ➖, 1↑ 0↓)
name PR f8096d6 (ns) base d036fc1 (ns) ratio (PR/base)
tpch_q01/datafusion:vortex-compact 59014222 62348588 0.95
tpch_q02/datafusion:vortex-compact 25425199 26511811 0.96
tpch_q03/datafusion:vortex-compact 29877946 31443286 0.95
tpch_q04/datafusion:vortex-compact 24881925 25461389 0.98
tpch_q05/datafusion:vortex-compact 52656157 56084665 0.94
tpch_q06/datafusion:vortex-compact 14417921 15406971 0.94
tpch_q07/datafusion:vortex-compact 60424565 65175815 0.93
tpch_q08/datafusion:vortex-compact 44163233 46335215 0.95
tpch_q09/datafusion:vortex-compact 57316226 61872742 0.93
tpch_q10/datafusion:vortex-compact 47402390 49658936 0.95
tpch_q11/datafusion:vortex-compact 16764646 17877726 0.94
tpch_q12/datafusion:vortex-compact 33977230 35269046 0.96
tpch_q13/datafusion:vortex-compact 31801329 33527482 0.95
tpch_q14/datafusion:vortex-compact 21396628 21833018 0.98
tpch_q15/datafusion:vortex-compact 33372759 34797717 0.96
tpch_q16/datafusion:vortex-compact 23289723 24589436 0.95
tpch_q17/datafusion:vortex-compact 69627235 76029767 0.92
tpch_q18/datafusion:vortex-compact 🚀 85919959 96632708 0.89
tpch_q19/datafusion:vortex-compact 30949125 32902938 0.94
tpch_q20/datafusion:vortex-compact 35614023 38385281 0.93
tpch_q21/datafusion:vortex-compact 81155404 87477433 0.93
tpch_q22/datafusion:vortex-compact 12600415 13379894 0.94
datafusion / parquet (0.959x ➖, 1↑ 0↓)
name PR f8096d6 (ns) base d036fc1 (ns) ratio (PR/base)
tpch_q01/datafusion:parquet 117395782 114707964 1.02
tpch_q02/datafusion:parquet 63931173 66783267 0.96
tpch_q03/datafusion:parquet 73034212 72547750 1.01
tpch_q04/datafusion:parquet 46321367 46852624 0.99
tpch_q05/datafusion:parquet 96688176 99983369 0.97
tpch_q06/datafusion:parquet 42821785 43713870 0.98
tpch_q07/datafusion:parquet 107344316 111085787 0.97
tpch_q08/datafusion:parquet 98262669 101218138 0.97
tpch_q09/datafusion:parquet 127289104 136526044 0.93
tpch_q10/datafusion:parquet 114247226 118966978 0.96
tpch_q11/datafusion:parquet 43258793 45072810 0.96
tpch_q12/datafusion:parquet 87268868 92268621 0.95
tpch_q13/datafusion:parquet 192578525 205469959 0.94
tpch_q14/datafusion:parquet 48647697 46907855 1.04
tpch_q15/datafusion:parquet 59247257 64522889 0.92
tpch_q16/datafusion:parquet 44089194 47496752 0.93
tpch_q17/datafusion:parquet 🚀 132198333 156393854 0.85
tpch_q18/datafusion:parquet 160989516 168132801 0.96
tpch_q19/datafusion:parquet 82218632 90376267 0.91
tpch_q20/datafusion:parquet 69913731 70457682 0.99
tpch_q21/datafusion:parquet 134686762 143015432 0.94
tpch_q22/datafusion:parquet 31614191 31826716 0.99
datafusion / arrow (0.938x ➖, 3↑ 0↓)
name PR f8096d6 (ns) base d036fc1 (ns) ratio (PR/base)
tpch_q01/datafusion:arrow 56179348 58454320 0.96
tpch_q02/datafusion:arrow 18092547 19060062 0.95
tpch_q03/datafusion:arrow 30218328 33462777 0.90
tpch_q04/datafusion:arrow 27263311 28410438 0.96
tpch_q05/datafusion:arrow 80509259 78197718 1.03
tpch_q06/datafusion:arrow 20722744 21265894 0.97
tpch_q07/datafusion:arrow 102714142 107499778 0.96
tpch_q08/datafusion:arrow 44400208 46543952 0.95
tpch_q09/datafusion:arrow 🚀 62462575 74896586 0.83
tpch_q10/datafusion:arrow 47315435 52014118 0.91
tpch_q11/datafusion:arrow 9215670 9619687 0.96
tpch_q12/datafusion:arrow 52126971 56652237 0.92
tpch_q13/datafusion:arrow 48685754 49884225 0.98
tpch_q14/datafusion:arrow 21884885 23269572 0.94
tpch_q15/datafusion:arrow 🚀 42231478 47387093 0.89
tpch_q16/datafusion:arrow 18885237 19556909 0.97
tpch_q17/datafusion:arrow 68089310 74343983 0.92
tpch_q18/datafusion:arrow 135855220 146349311 0.93
tpch_q19/datafusion:arrow 36867842 39207684 0.94
tpch_q20/datafusion:arrow 🚀 33907722 38261423 0.89
tpch_q21/datafusion:arrow 148187631 158852480 0.93
tpch_q22/datafusion:arrow 17568588 18247092 0.96
duckdb / vortex-file-compressed (0.950x ➖, 3↑ 0↓)
name PR f8096d6 (ns) base d036fc1 (ns) ratio (PR/base)
tpch_q01/duckdb:vortex-file-compressed 32030165 32170684 1.00
tpch_q02/duckdb:vortex-file-compressed 26263807 26062942 1.01
tpch_q03/duckdb:vortex-file-compressed 29997191 30991522 0.97
tpch_q04/duckdb:vortex-file-compressed 29262376 31070945 0.94
tpch_q05/duckdb:vortex-file-compressed 33750306 35355411 0.95
tpch_q06/duckdb:vortex-file-compressed 11987406 11368757 1.05
tpch_q07/duckdb:vortex-file-compressed 40299815 40275153 1.00
tpch_q08/duckdb:vortex-file-compressed 36957539 40193683 0.92
tpch_q09/duckdb:vortex-file-compressed 73394269 79036483 0.93
tpch_q10/duckdb:vortex-file-compressed 34420789 36420641 0.95
tpch_q11/duckdb:vortex-file-compressed 14290446 15133820 0.94
tpch_q12/duckdb:vortex-file-compressed 20948311 22205480 0.94
tpch_q13/duckdb:vortex-file-compressed 34463894 37461375 0.92
tpch_q14/duckdb:vortex-file-compressed 21375010 22011240 0.97
tpch_q15/duckdb:vortex-file-compressed 16374824 17433183 0.94
tpch_q16/duckdb:vortex-file-compressed 27974139 29242008 0.96
tpch_q17/duckdb:vortex-file-compressed 25326679 26158020 0.97
tpch_q18/duckdb:vortex-file-compressed 49099696 53625040 0.92
tpch_q19/duckdb:vortex-file-compressed 29290391 30077744 0.97
tpch_q20/duckdb:vortex-file-compressed 🚀 33175413 37358310 0.89
tpch_q21/duckdb:vortex-file-compressed 🚀 102874935 115854620 0.89
tpch_q22/duckdb:vortex-file-compressed 🚀 16765232 18878831 0.89
duckdb / vortex-compact (0.942x ➖, 2↑ 0↓)
name PR f8096d6 (ns) base d036fc1 (ns) ratio (PR/base)
tpch_q01/duckdb:vortex-compact 38098455 39461759 0.97
tpch_q02/duckdb:vortex-compact 34283466 36792185 0.93
tpch_q03/duckdb:vortex-compact 32758155 33624295 0.97
tpch_q04/duckdb:vortex-compact 33817014 36066669 0.94
tpch_q05/duckdb:vortex-compact 37863652 39202863 0.97
tpch_q06/duckdb:vortex-compact 14796232 15658436 0.94
tpch_q07/duckdb:vortex-compact 42670670 45347350 0.94
tpch_q08/duckdb:vortex-compact 44817200 47200346 0.95
tpch_q09/duckdb:vortex-compact 83077789 88446016 0.94
tpch_q10/duckdb:vortex-compact 39134513 40459953 0.97
tpch_q11/duckdb:vortex-compact 19062716 19185368 0.99
tpch_q12/duckdb:vortex-compact 34767322 36681263 0.95
tpch_q13/duckdb:vortex-compact 44527891 47262722 0.94
tpch_q14/duckdb:vortex-compact 28970011 30984133 0.93
tpch_q15/duckdb:vortex-compact 19597514 20743524 0.94
tpch_q16/duckdb:vortex-compact 34346062 36333008 0.95
tpch_q17/duckdb:vortex-compact 30103050 31886135 0.94
tpch_q18/duckdb:vortex-compact 48928216 52961928 0.92
tpch_q19/duckdb:vortex-compact 🚀 33553907 37304903 0.90
tpch_q20/duckdb:vortex-compact 41944588 44955219 0.93
tpch_q21/duckdb:vortex-compact 107495754 118245808 0.91
tpch_q22/duckdb:vortex-compact 🚀 18990052 21199069 0.90
duckdb / parquet (0.972x ➖, 1↑ 0↓)
name PR f8096d6 (ns) base d036fc1 (ns) ratio (PR/base)
tpch_q01/duckdb:parquet 75298395 79174635 0.95
tpch_q02/duckdb:parquet 39713192 40909448 0.97
tpch_q03/duckdb:parquet 72423081 71087127 1.02
tpch_q04/duckdb:parquet 46396622 48517051 0.96
tpch_q05/duckdb:parquet 64946989 68957626 0.94
tpch_q06/duckdb:parquet 20452772 20844926 0.98
tpch_q07/duckdb:parquet 🚀 66906725 75303551 0.89
tpch_q08/duckdb:parquet 80213570 83821622 0.96
tpch_q09/duckdb:parquet 156003893 154709364 1.01
tpch_q10/duckdb:parquet 131486891 126531198 1.04
tpch_q11/duckdb:parquet 22500009 23305791 0.97
tpch_q12/duckdb:parquet 44604794 48280691 0.92
tpch_q13/duckdb:parquet 246062389 266130794 0.92
tpch_q14/duckdb:parquet 50711339 49737750 1.02
tpch_q15/duckdb:parquet 24433616 24849611 0.98
tpch_q16/duckdb:parquet 54831749 58638029 0.94
tpch_q17/duckdb:parquet 55918523 53021826 1.05
tpch_q18/duckdb:parquet 111420563 117539512 0.95
tpch_q19/duckdb:parquet 65235903 66934843 0.97
tpch_q20/duckdb:parquet 64189923 63966298 1.00
tpch_q21/duckdb:parquet 172855435 178215665 0.97
tpch_q22/duckdb:parquet 51793376 53119563 0.98
duckdb / duckdb (0.928x ➖, 5↑ 0↓)
name PR f8096d6 (ns) base d036fc1 (ns) ratio (PR/base)
tpch_q01/duckdb:duckdb 15860359 16700420 0.95
tpch_q02/duckdb:duckdb 12665346 12894046 0.98
tpch_q03/duckdb:duckdb 🚀 18531328 20702709 0.90
tpch_q04/duckdb:duckdb 18344731 19019252 0.96
tpch_q05/duckdb:duckdb 19524308 21097397 0.93
tpch_q06/duckdb:duckdb 5332128 5643005 0.94
tpch_q07/duckdb:duckdb 21757724 24046410 0.90
tpch_q08/duckdb:duckdb 20950100 22438308 0.93
tpch_q09/duckdb:duckdb 🚀 53395391 60532804 0.88
tpch_q10/duckdb:duckdb 43885878 43595198 1.01
tpch_q11/duckdb:duckdb 🚀 5756871 6414557 0.90
tpch_q12/duckdb:duckdb 13781424 14822474 0.93
tpch_q13/duckdb:duckdb 37906698 39336223 0.96
tpch_q14/duckdb:duckdb 🚀 16125452 19003635 0.85
tpch_q15/duckdb:duckdb 11836036 13130221 0.90
tpch_q16/duckdb:duckdb 23819104 24374877 0.98
tpch_q17/duckdb:duckdb 13803737 14550748 0.95
tpch_q18/duckdb:duckdb 37786799 40273440 0.94
tpch_q19/duckdb:duckdb 🚀 25996489 30353204 0.86
tpch_q20/duckdb:duckdb 22352856 24175548 0.92
tpch_q21/duckdb:duckdb 55418659 60239510 0.92
tpch_q22/duckdb:duckdb 24027597 25467025 0.94
Full attributed analysis
Query Config Raw Δ Control Δ Attributed α Noise floor Significant?
1 datafusion:arrow -3.9% -1.3% -2.6% +21.0% ➖ noise
1 datafusion:vortex-compact -5.3% -1.3% -4.1% +19.8% ➖ noise
1 datafusion:vortex-file-compressed -5.3% -1.3% -4.0% +19.5% ➖ noise
1 duckdb:duckdb -5.0% -1.3% -3.7% +19.3% ➖ noise
1 duckdb:vortex-compact -3.5% -1.3% -2.1% +19.0% ➖ noise
1 duckdb:vortex-file-compressed -0.4% -1.3% +0.9% +21.5% ➖ noise
2 datafusion:arrow -5.1% -3.6% -1.5% +11.4% ➖ noise
2 datafusion:vortex-compact -4.1% -3.6% -0.5% +10.0% ➖ noise
2 datafusion:vortex-file-compressed -2.0% -3.6% +1.7% +10.0% ➖ noise
2 duckdb:duckdb -1.8% -3.6% +1.9% +10.0% ➖ noise
2 duckdb:vortex-compact -6.8% -3.6% -3.3% +10.0% ➖ noise
2 duckdb:vortex-file-compressed +0.8% -3.6% +4.5% +10.0% ➖ noise
3 datafusion:arrow -9.7% +1.3% -10.8% +10.8% ✅ faster
3 datafusion:vortex-compact -5.0% +1.3% -6.2% +10.0% ➖ noise
3 datafusion:vortex-file-compressed -7.9% +1.3% -9.0% +10.0% ➖ noise
3 duckdb:duckdb -10.5% +1.3% -11.6% +14.6% ➖ noise
3 duckdb:vortex-compact -2.6% +1.3% -3.8% +11.0% ➖ noise
3 duckdb:vortex-file-compressed -3.2% +1.3% -4.4% +13.7% ➖ noise
4 datafusion:arrow -4.0% -2.8% -1.3% +10.0% ➖ noise
4 datafusion:vortex-compact -2.3% -2.8% +0.5% +10.0% ➖ noise
4 datafusion:vortex-file-compressed -7.1% -2.8% -4.4% +10.0% ➖ noise
4 duckdb:duckdb -3.5% -2.8% -0.8% +10.0% ➖ noise
4 duckdb:vortex-compact -6.2% -2.8% -3.6% +10.0% ➖ noise
4 duckdb:vortex-file-compressed -5.8% -2.8% -3.1% +10.0% ➖ noise
5 datafusion:arrow +3.0% -4.6% +7.9% +10.0% ➖ noise
5 datafusion:vortex-compact -6.1% -4.6% -1.6% +10.0% ➖ noise
5 datafusion:vortex-file-compressed -9.2% -4.6% -4.9% +10.0% ➖ noise
5 duckdb:duckdb -7.5% -4.6% -3.0% +10.1% ➖ noise
5 duckdb:vortex-compact -3.4% -4.6% +1.2% +10.0% ➖ noise
5 duckdb:vortex-file-compressed -4.5% -4.6% +0.0% +11.5% ➖ noise
6 datafusion:arrow -2.6% -2.0% -0.6% +16.1% ➖ noise
6 datafusion:vortex-compact -6.4% -2.0% -4.5% +14.6% ➖ noise
6 datafusion:vortex-file-compressed -3.8% -2.0% -1.9% +14.7% ➖ noise
6 duckdb:duckdb -5.5% -2.0% -3.6% +16.5% ➖ noise
6 duckdb:vortex-compact -5.5% -2.0% -3.6% +19.5% ➖ noise
6 duckdb:vortex-file-compressed +5.4% -2.0% +7.6% +16.3% ➖ noise
7 datafusion:arrow -4.5% -7.3% +3.1% +10.0% ➖ noise
7 datafusion:vortex-compact -7.3% -7.3% +0.1% +10.0% ➖ noise
7 datafusion:vortex-file-compressed -6.3% -7.3% +1.1% +10.0% ➖ noise
7 duckdb:duckdb -9.5% -7.3% -2.3% +10.0% ➖ noise
7 duckdb:vortex-compact -5.9% -7.3% +1.6% +10.7% ➖ noise
7 duckdb:vortex-file-compressed +0.1% -7.3% +8.0% +10.6% ➖ noise
8 datafusion:arrow -4.6% -3.6% -1.0% +10.0% ➖ noise
8 datafusion:vortex-compact -4.7% -3.6% -1.1% +10.6% ➖ noise
8 datafusion:vortex-file-compressed -6.8% -3.6% -3.3% +10.0% ➖ noise
8 duckdb:duckdb -6.6% -3.6% -3.1% +10.0% ➖ noise
8 duckdb:vortex-compact -5.0% -3.6% -1.5% +10.0% ➖ noise
8 duckdb:vortex-file-compressed -8.1% -3.6% -4.6% +10.0% ➖ noise
9 datafusion:arrow -16.6% -3.0% -14.0% +12.6% ✅ faster
9 datafusion:vortex-compact -7.4% -3.0% -4.5% +10.0% ➖ noise
9 datafusion:vortex-file-compressed -0.5% -3.0% +2.6% +10.0% ➖ noise
9 duckdb:duckdb -11.8% -3.0% -9.0% +10.6% ➖ noise
9 duckdb:vortex-compact -6.1% -3.0% -3.1% +10.0% ➖ noise
9 duckdb:vortex-file-compressed -7.1% -3.0% -4.2% +10.9% ➖ noise
10 datafusion:arrow -9.0% -0.1% -8.9% +10.7% ➖ noise
10 datafusion:vortex-compact -4.5% -0.1% -4.4% +10.0% ➖ noise
10 datafusion:vortex-file-compressed -6.2% -0.1% -6.1% +10.0% ➖ noise
10 duckdb:duckdb +0.7% -0.1% +0.8% +12.8% ➖ noise
10 duckdb:vortex-compact -3.3% -0.1% -3.2% +10.0% ➖ noise
10 duckdb:vortex-file-compressed -5.5% -0.1% -5.4% +10.0% ➖ noise
11 datafusion:arrow -4.2% -3.7% -0.5% +10.0% ➖ noise
11 datafusion:vortex-compact -6.2% -3.7% -2.6% +10.0% ➖ noise
11 datafusion:vortex-file-compressed -3.2% -3.7% +0.6% +10.0% ➖ noise
11 duckdb:duckdb -10.3% -3.7% -6.8% +10.0% ➖ noise
11 duckdb:vortex-compact -0.6% -3.7% +3.2% +10.0% ➖ noise
11 duckdb:vortex-file-compressed -5.6% -3.7% -1.9% +10.0% ➖ noise
12 datafusion:arrow -8.0% -6.5% -1.6% +17.6% ➖ noise
12 datafusion:vortex-compact -3.7% -6.5% +3.1% +10.4% ➖ noise
12 datafusion:vortex-file-compressed -2.2% -6.5% +4.7% +10.5% ➖ noise
12 duckdb:duckdb -7.0% -6.5% -0.5% +11.7% ➖ noise
12 duckdb:vortex-compact -5.2% -6.5% +1.4% +10.0% ➖ noise
12 duckdb:vortex-file-compressed -5.7% -6.5% +0.9% +10.0% ➖ noise
13 datafusion:arrow -2.4% -6.9% +4.8% +10.0% ➖ noise
13 datafusion:vortex-compact -5.1% -6.9% +1.9% +10.0% ➖ noise
13 datafusion:vortex-file-compressed -5.0% -6.9% +2.0% +10.0% ➖ noise
13 duckdb:duckdb -3.6% -6.9% +3.5% +10.0% ➖ noise
13 duckdb:vortex-compact -5.8% -6.9% +1.2% +10.0% ➖ noise
13 duckdb:vortex-file-compressed -8.0% -6.9% -1.2% +10.3% ➖ noise
14 datafusion:arrow -6.0% +2.8% -8.5% +11.2% ➖ noise
14 datafusion:vortex-compact -2.0% +2.8% -4.7% +10.5% ➖ noise
14 datafusion:vortex-file-compressed -1.5% +2.8% -4.2% +10.3% ➖ noise
14 duckdb:duckdb -15.1% +2.8% -17.5% +17.7% ✅ faster
14 duckdb:vortex-compact -6.5% +2.8% -9.1% +11.2% ➖ noise
14 duckdb:vortex-file-compressed -2.9% +2.8% -5.6% +10.2% ➖ noise
15 datafusion:arrow -10.9% -5.0% -6.2% +11.5% ➖ noise
15 datafusion:vortex-compact -4.1% -5.0% +0.9% +11.8% ➖ noise
15 datafusion:vortex-file-compressed -6.2% -5.0% -1.2% +13.9% ➖ noise
15 duckdb:duckdb -9.9% -5.0% -5.1% +12.7% ➖ noise
15 duckdb:vortex-compact -5.5% -5.0% -0.6% +13.7% ➖ noise
15 duckdb:vortex-file-compressed -6.1% -5.0% -1.1% +11.4% ➖ noise
16 datafusion:arrow -3.4% -6.8% +3.6% +10.0% ➖ noise
16 datafusion:vortex-compact -5.3% -6.8% +1.7% +10.0% ➖ noise
16 datafusion:vortex-file-compressed -5.6% -6.8% +1.4% +10.0% ➖ noise
16 duckdb:duckdb -2.3% -6.8% +4.9% +10.0% ➖ noise
16 duckdb:vortex-compact -5.5% -6.8% +1.5% +10.0% ➖ noise
16 duckdb:vortex-file-compressed -4.3% -6.8% +2.7% +10.0% ➖ noise
17 datafusion:arrow -8.4% -5.6% -3.0% +10.3% ➖ noise
17 datafusion:vortex-compact -8.4% -5.6% -3.0% +10.7% ➖ noise
17 datafusion:vortex-file-compressed -3.5% -5.6% +2.2% +11.2% ➖ noise
17 duckdb:duckdb -5.1% -5.6% +0.5% +10.9% ➖ noise
17 duckdb:vortex-compact -5.6% -5.6% -0.0% +11.2% ➖ noise
17 duckdb:vortex-file-compressed -3.2% -5.6% +2.5% +12.3% ➖ noise
18 datafusion:arrow -7.2% -4.7% -2.6% +10.0% ➖ noise
18 datafusion:vortex-compact -11.1% -4.7% -6.7% +10.0% ➖ noise
18 datafusion:vortex-file-compressed -8.0% -4.7% -3.5% +10.4% ➖ noise
18 duckdb:duckdb -6.2% -4.7% -1.5% +10.0% ➖ noise
18 duckdb:vortex-compact -7.6% -4.7% -3.0% +10.0% ➖ noise
18 duckdb:vortex-file-compressed -8.4% -4.7% -3.9% +10.0% ➖ noise
19 datafusion:arrow -6.0% -5.8% -0.1% +17.1% ➖ noise
19 datafusion:vortex-compact -5.9% -5.8% -0.1% +11.7% ➖ noise
19 datafusion:vortex-file-compressed -5.0% -5.8% +0.9% +14.0% ➖ noise
19 duckdb:duckdb -14.4% -5.8% -9.0% +13.9% ➖ noise
19 duckdb:vortex-compact -10.1% -5.8% -4.5% +12.1% ➖ noise
19 duckdb:vortex-file-compressed -2.6% -5.8% +3.4% +15.5% ➖ noise
20 datafusion:arrow -11.4% -0.2% -11.2% +11.6% ✅ faster
20 datafusion:vortex-compact -7.2% -0.2% -7.0% +10.1% ➖ noise
20 datafusion:vortex-file-compressed -6.5% -0.2% -6.3% +10.0% ➖ noise
20 duckdb:duckdb -7.5% -0.2% -7.3% +11.5% ➖ noise
20 duckdb:vortex-compact -6.7% -0.2% -6.5% +10.9% ➖ noise
20 duckdb:vortex-file-compressed -11.2% -0.2% -11.0% +11.0% ✅ faster
21 datafusion:arrow -6.7% -4.4% -2.4% +10.0% ➖ noise
21 datafusion:vortex-compact -7.2% -4.4% -2.9% +10.0% ➖ noise
21 datafusion:vortex-file-compressed -7.9% -4.4% -3.6% +10.0% ➖ noise
21 duckdb:duckdb -8.0% -4.4% -3.7% +10.0% ➖ noise
21 duckdb:vortex-compact -9.1% -4.4% -4.9% +10.0% ➖ noise
21 duckdb:vortex-file-compressed -11.2% -4.4% -7.1% +10.0% ➖ noise
22 datafusion:arrow -3.7% -1.6% -2.2% +10.0% ➖ noise
22 datafusion:vortex-compact -5.8% -1.6% -4.3% +10.0% ➖ noise
22 datafusion:vortex-file-compressed -8.7% -1.6% -7.3% +10.0% ➖ noise
22 duckdb:duckdb -5.7% -1.6% -4.1% +10.0% ➖ noise
22 duckdb:vortex-compact -10.4% -1.6% -9.0% +10.0% ➖ noise
22 duckdb:vortex-file-compressed -11.2% -1.6% -9.8% +13.2% ➖ noise

@github-actions
Copy link
Copy Markdown
Contributor

github-actions Bot commented Apr 28, 2026

Benchmarks: PolarSignals Profiling

Vortex (geomean): 1.095x ➖


datafusion / vortex-file-compressed (1.095x ➖, 0↑ 4↓)
name PR f8096d6 (ns) base d036fc1 (ns) ratio (PR/base)
polarsignals_q00/datafusion:vortex-file-compressed 132768410 126702340 1.05
polarsignals_q01/datafusion:vortex-file-compressed 288800175 300059208 0.96
polarsignals_q02/datafusion:vortex-file-compressed 25868049 23648184 1.09
polarsignals_q03/datafusion:vortex-file-compressed 🚨 328678914 276066887 1.19
polarsignals_q04/datafusion:vortex-file-compressed 🚨 13328082 11522602 1.16
polarsignals_q05/datafusion:vortex-file-compressed 🚨 17032009 15166927 1.12
polarsignals_q06/datafusion:vortex-file-compressed 19983427 18710921 1.07
polarsignals_q07/datafusion:vortex-file-compressed 15087025 13891856 1.09
polarsignals_q08/datafusion:vortex-file-compressed 🚨 394006038 344202663 1.14
polarsignals_q09/datafusion:vortex-file-compressed 12341241 11288434 1.09

@github-actions
Copy link
Copy Markdown
Contributor

github-actions Bot commented Apr 28, 2026

Benchmarks: TPC-DS SF=1 on NVME

Verdict: No clear signal (low confidence)
Attributed Vortex impact: +0.4%
Vortex (geomean): 1.098x ➖
Parquet (geomean): 1.094x ➖
Shifts: Parquet (control) +9.4% · Median polish +9.8%


datafusion / vortex-file-compressed (1.124x ❌, 0↑ 66↓)
name PR f8096d6 (ns) base d036fc1 (ns) ratio (PR/base)
tpcds_q01/datafusion:vortex-file-compressed 🚨 30543239 24731701 1.23
tpcds_q02/datafusion:vortex-file-compressed 50266797 47676100 1.05
tpcds_q03/datafusion:vortex-file-compressed 16554444 15270139 1.08
tpcds_q04/datafusion:vortex-file-compressed 🚨 279205679 244767061 1.14
tpcds_q05/datafusion:vortex-file-compressed 🚨 49206412 41767663 1.18
tpcds_q06/datafusion:vortex-file-compressed 60297675 59836948 1.01
tpcds_q07/datafusion:vortex-file-compressed 🚨 49103055 41014113 1.20
tpcds_q08/datafusion:vortex-file-compressed 31948565 29398507 1.09
tpcds_q09/datafusion:vortex-file-compressed 48594673 46263014 1.05
tpcds_q10/datafusion:vortex-file-compressed 🚨 43131710 37473153 1.15
tpcds_q11/datafusion:vortex-file-compressed 141856479 130913893 1.08
tpcds_q12/datafusion:vortex-file-compressed 🚨 22077839 18789101 1.18
tpcds_q13/datafusion:vortex-file-compressed 47857588 43617565 1.10
tpcds_q14/datafusion:vortex-file-compressed 190327252 174880045 1.09
tpcds_q15/datafusion:vortex-file-compressed 🚨 31728040 27339324 1.16
tpcds_q16/datafusion:vortex-file-compressed 30493481 29317387 1.04
tpcds_q17/datafusion:vortex-file-compressed 🚨 70521809 62371557 1.13
tpcds_q18/datafusion:vortex-file-compressed 73675758 67919200 1.08
tpcds_q19/datafusion:vortex-file-compressed 🚨 24627422 21700434 1.13
tpcds_q20/datafusion:vortex-file-compressed 🚨 23891306 21453395 1.11
tpcds_q21/datafusion:vortex-file-compressed 🚨 40434834 35712895 1.13
tpcds_q22/datafusion:vortex-file-compressed 129808313 118637278 1.09
tpcds_q23/datafusion:vortex-file-compressed 🚨 171261537 154534151 1.11
tpcds_q24/datafusion:vortex-file-compressed 🚨 98362020 83489695 1.18
tpcds_q25/datafusion:vortex-file-compressed 🚨 72513659 65457541 1.11
tpcds_q26/datafusion:vortex-file-compressed 36981816 33895310 1.09
tpcds_q27/datafusion:vortex-file-compressed 🚨 121497661 101797383 1.19
tpcds_q28/datafusion:vortex-file-compressed 🚨 46046521 41477906 1.11
tpcds_q29/datafusion:vortex-file-compressed 🚨 70224777 61117137 1.15
tpcds_q30/datafusion:vortex-file-compressed 🚨 27969553 23141882 1.21
tpcds_q31/datafusion:vortex-file-compressed 🚨 82889956 73431834 1.13
tpcds_q32/datafusion:vortex-file-compressed 🚨 23341610 20134032 1.16
tpcds_q33/datafusion:vortex-file-compressed 🚨 33571366 28699253 1.17
tpcds_q34/datafusion:vortex-file-compressed 🚨 27800428 24239272 1.15
tpcds_q35/datafusion:vortex-file-compressed 🚨 50506154 44008081 1.15
tpcds_q36/datafusion:vortex-file-compressed 🚨 66298490 57094595 1.16
tpcds_q37/datafusion:vortex-file-compressed 28519288 26477032 1.08
tpcds_q38/datafusion:vortex-file-compressed 48767789 46517067 1.05
tpcds_q39/datafusion:vortex-file-compressed 🚨 121645694 104534506 1.16
tpcds_q40/datafusion:vortex-file-compressed 35624275 32773215 1.09
tpcds_q41/datafusion:vortex-file-compressed 🚨 18592553 15943575 1.17
tpcds_q42/datafusion:vortex-file-compressed 🚨 16293617 13749305 1.19
tpcds_q43/datafusion:vortex-file-compressed 20339075 19153055 1.06
tpcds_q44/datafusion:vortex-file-compressed 35434842 33227705 1.07
tpcds_q45/datafusion:vortex-file-compressed 🚨 29650476 26451095 1.12
tpcds_q46/datafusion:vortex-file-compressed 🚨 39489130 34014687 1.16
tpcds_q47/datafusion:vortex-file-compressed 🚨 146116765 130264436 1.12
tpcds_q48/datafusion:vortex-file-compressed 🚨 43011301 38100785 1.13
tpcds_q49/datafusion:vortex-file-compressed 63678988 58026616 1.10
tpcds_q50/datafusion:vortex-file-compressed 🚨 43776414 37600830 1.16
tpcds_q51/datafusion:vortex-file-compressed 94958144 88580541 1.07
tpcds_q52/datafusion:vortex-file-compressed 🚨 16774484 14725314 1.14
tpcds_q53/datafusion:vortex-file-compressed 🚨 24392005 20898166 1.17
tpcds_q54/datafusion:vortex-file-compressed 🚨 39202249 34749008 1.13
tpcds_q55/datafusion:vortex-file-compressed 🚨 15949607 13990388 1.14
tpcds_q56/datafusion:vortex-file-compressed 32372996 30299000 1.07
tpcds_q57/datafusion:vortex-file-compressed 🚨 119698829 105861566 1.13
tpcds_q58/datafusion:vortex-file-compressed 🚨 60048920 53384044 1.12
tpcds_q59/datafusion:vortex-file-compressed 61154163 56799116 1.08
tpcds_q60/datafusion:vortex-file-compressed 31752364 31405327 1.01
tpcds_q61/datafusion:vortex-file-compressed 44192340 41268712 1.07
tpcds_q62/datafusion:vortex-file-compressed 24367206 23995584 1.02
tpcds_q63/datafusion:vortex-file-compressed 🚨 23599017 21342828 1.11
tpcds_q64/datafusion:vortex-file-compressed 🚨 457958296 410617502 1.12
tpcds_q65/datafusion:vortex-file-compressed 44177771 40506772 1.09
tpcds_q66/datafusion:vortex-file-compressed 77452890 72969918 1.06
tpcds_q67/datafusion:vortex-file-compressed 🚨 160962142 141784739 1.14
tpcds_q68/datafusion:vortex-file-compressed 35684103 32596020 1.09
tpcds_q69/datafusion:vortex-file-compressed 🚨 41729795 35754688 1.17
tpcds_q70/datafusion:vortex-file-compressed 93715160 86168549 1.09
tpcds_q71/datafusion:vortex-file-compressed 🚨 26146888 23192574 1.13
tpcds_q72/datafusion:vortex-file-compressed 🚨 2525268295 2104317959 1.20
tpcds_q73/datafusion:vortex-file-compressed 🚨 25789887 22754466 1.13
tpcds_q74/datafusion:vortex-file-compressed 86334199 81150753 1.06
tpcds_q75/datafusion:vortex-file-compressed 🚨 119136768 107651718 1.11
tpcds_q76/datafusion:vortex-file-compressed 26550754 24324901 1.09
tpcds_q77/datafusion:vortex-file-compressed 44735399 40982809 1.09
tpcds_q78/datafusion:vortex-file-compressed 🚨 142243881 123440974 1.15
tpcds_q79/datafusion:vortex-file-compressed 🚨 32187407 28356146 1.14
tpcds_q80/datafusion:vortex-file-compressed 🚨 108099506 95304247 1.13
tpcds_q81/datafusion:vortex-file-compressed 🚨 27247504 23890526 1.14
tpcds_q82/datafusion:vortex-file-compressed 🚨 30503009 25642856 1.19
tpcds_q83/datafusion:vortex-file-compressed 🚨 38497036 32818192 1.17
tpcds_q84/datafusion:vortex-file-compressed 🚨 14735573 12727113 1.16
tpcds_q85/datafusion:vortex-file-compressed 97658718 91235595 1.07
tpcds_q86/datafusion:vortex-file-compressed 🚨 18713694 15767606 1.19
tpcds_q87/datafusion:vortex-file-compressed 🚨 51971202 43872634 1.18
tpcds_q88/datafusion:vortex-file-compressed 🚨 66139284 55917406 1.18
tpcds_q89/datafusion:vortex-file-compressed 🚨 28601543 24947650 1.15
tpcds_q90/datafusion:vortex-file-compressed 🚨 16535664 14928172 1.11
tpcds_q91/datafusion:vortex-file-compressed 🚨 21219373 17998428 1.18
tpcds_q92/datafusion:vortex-file-compressed 🚨 21606278 19340395 1.12
tpcds_q93/datafusion:vortex-file-compressed 🚨 39306867 34273890 1.15
tpcds_q94/datafusion:vortex-file-compressed 🚨 28213701 23107999 1.22
tpcds_q95/datafusion:vortex-file-compressed 🚨 68961208 58965086 1.17
tpcds_q96/datafusion:vortex-file-compressed 🚨 15161185 13433387 1.13
tpcds_q97/datafusion:vortex-file-compressed 🚨 35913052 31561728 1.14
tpcds_q98/datafusion:vortex-file-compressed 27376406 24942337 1.10
tpcds_q99/datafusion:vortex-file-compressed 🚨 35843125 31932272 1.12
datafusion / vortex-compact (1.100x ➖, 0↑ 49↓)
name PR f8096d6 (ns) base d036fc1 (ns) ratio (PR/base)
tpcds_q01/datafusion:vortex-compact 🚨 29143454 25394837 1.15
tpcds_q02/datafusion:vortex-compact 56547765 53629829 1.05
tpcds_q03/datafusion:vortex-compact 21528748 19944446 1.08
tpcds_q04/datafusion:vortex-compact 🚨 340356309 288715241 1.18
tpcds_q05/datafusion:vortex-compact 🚨 53891592 47690018 1.13
tpcds_q06/datafusion:vortex-compact 63474648 61669139 1.03
tpcds_q07/datafusion:vortex-compact 🚨 62071181 53436214 1.16
tpcds_q08/datafusion:vortex-compact 🚨 39540345 35898079 1.10
tpcds_q09/datafusion:vortex-compact 66862641 62520089 1.07
tpcds_q10/datafusion:vortex-compact 55424915 50554929 1.10
tpcds_q11/datafusion:vortex-compact 163583698 151480731 1.08
tpcds_q12/datafusion:vortex-compact 24276671 23999714 1.01
tpcds_q13/datafusion:vortex-compact 95885328 94787528 1.01
tpcds_q14/datafusion:vortex-compact 🚨 219782070 199795339 1.10
tpcds_q15/datafusion:vortex-compact 🚨 33024259 29888570 1.10
tpcds_q16/datafusion:vortex-compact 35634469 32495148 1.10
tpcds_q17/datafusion:vortex-compact 🚨 84955199 73297868 1.16
tpcds_q18/datafusion:vortex-compact 84870039 79085387 1.07
tpcds_q19/datafusion:vortex-compact 🚨 34112904 30161238 1.13
tpcds_q20/datafusion:vortex-compact 27379978 25555968 1.07
tpcds_q21/datafusion:vortex-compact 42890295 40410700 1.06
tpcds_q22/datafusion:vortex-compact 🚨 141973439 119816930 1.18
tpcds_q23/datafusion:vortex-compact 🚨 188880219 168337736 1.12
tpcds_q24/datafusion:vortex-compact 🚨 109921673 94960990 1.16
tpcds_q25/datafusion:vortex-compact 🚨 91389208 80502980 1.14
tpcds_q26/datafusion:vortex-compact 🚨 48420928 43803408 1.11
tpcds_q27/datafusion:vortex-compact 🚨 146641927 125903293 1.16
tpcds_q28/datafusion:vortex-compact 87899078 81293008 1.08
tpcds_q29/datafusion:vortex-compact 🚨 81314106 73348920 1.11
tpcds_q30/datafusion:vortex-compact 🚨 31116490 27845542 1.12
tpcds_q31/datafusion:vortex-compact 104786625 98265222 1.07
tpcds_q32/datafusion:vortex-compact 28632538 26421455 1.08
tpcds_q33/datafusion:vortex-compact 🚨 42704098 37248552 1.15
tpcds_q34/datafusion:vortex-compact 34455901 32096533 1.07
tpcds_q35/datafusion:vortex-compact 🚨 57733718 51877488 1.11
tpcds_q36/datafusion:vortex-compact 83755921 77265733 1.08
tpcds_q37/datafusion:vortex-compact 🚨 45215152 39236813 1.15
tpcds_q38/datafusion:vortex-compact 58348755 53694796 1.09
tpcds_q39/datafusion:vortex-compact 🚨 127180075 114517754 1.11
tpcds_q40/datafusion:vortex-compact 🚨 40098984 36049257 1.11
tpcds_q41/datafusion:vortex-compact 🚨 20082928 17301758 1.16
tpcds_q42/datafusion:vortex-compact 🚨 20582972 18049345 1.14
tpcds_q43/datafusion:vortex-compact 26432062 25270143 1.05
tpcds_q44/datafusion:vortex-compact 🚨 54097226 45440226 1.19
tpcds_q45/datafusion:vortex-compact 33297612 31704789 1.05
tpcds_q46/datafusion:vortex-compact 47529466 44939205 1.06
tpcds_q47/datafusion:vortex-compact 🚨 167460875 150208194 1.11
tpcds_q48/datafusion:vortex-compact 75065996 72465287 1.04
tpcds_q49/datafusion:vortex-compact 🚨 77304608 69398796 1.11
tpcds_q50/datafusion:vortex-compact 🚨 52448515 46113921 1.14
tpcds_q51/datafusion:vortex-compact 100474157 99102643 1.01
tpcds_q52/datafusion:vortex-compact 20477227 19560442 1.05
tpcds_q53/datafusion:vortex-compact 🚨 32351646 28244776 1.15
tpcds_q54/datafusion:vortex-compact 45611354 42376107 1.08
tpcds_q55/datafusion:vortex-compact 19757870 18411447 1.07
tpcds_q56/datafusion:vortex-compact 🚨 39477696 35710687 1.11
tpcds_q57/datafusion:vortex-compact 🚨 129572547 115089806 1.13
tpcds_q58/datafusion:vortex-compact 66794112 62762512 1.06
tpcds_q59/datafusion:vortex-compact 73573971 71442358 1.03
tpcds_q60/datafusion:vortex-compact 40111115 37388319 1.07
tpcds_q61/datafusion:vortex-compact 🚨 61609141 54914714 1.12
tpcds_q62/datafusion:vortex-compact 🚨 29923387 24707610 1.21
tpcds_q63/datafusion:vortex-compact 30386148 28493678 1.07
tpcds_q64/datafusion:vortex-compact 🚨 498249735 442540822 1.13
tpcds_q65/datafusion:vortex-compact 57698095 54185708 1.06
tpcds_q66/datafusion:vortex-compact 81698045 74629698 1.09
tpcds_q67/datafusion:vortex-compact 🚨 166881598 151034940 1.10
tpcds_q68/datafusion:vortex-compact 🚨 49953932 44336520 1.13
tpcds_q69/datafusion:vortex-compact 51401203 48955945 1.05
tpcds_q70/datafusion:vortex-compact 🚨 111536905 98981983 1.13
tpcds_q71/datafusion:vortex-compact 🚨 32122467 29077205 1.10
tpcds_q72/datafusion:vortex-compact 🚨 2600410452 2111718745 1.23
tpcds_q73/datafusion:vortex-compact 32453217 31368220 1.03
tpcds_q74/datafusion:vortex-compact 96424592 90321247 1.07
tpcds_q75/datafusion:vortex-compact 140084365 130518122 1.07
tpcds_q76/datafusion:vortex-compact 34865628 32159483 1.08
tpcds_q77/datafusion:vortex-compact 🚨 55754785 49852457 1.12
tpcds_q78/datafusion:vortex-compact 🚨 156540111 136633323 1.15
tpcds_q79/datafusion:vortex-compact 41003249 37622126 1.09
tpcds_q80/datafusion:vortex-compact 🚨 120791836 104160179 1.16
tpcds_q81/datafusion:vortex-compact 30557671 28279243 1.08
tpcds_q82/datafusion:vortex-compact 44055455 40873145 1.08
tpcds_q83/datafusion:vortex-compact 🚨 38735670 32928294 1.18
tpcds_q84/datafusion:vortex-compact 🚨 16218733 14683005 1.10
tpcds_q85/datafusion:vortex-compact 137019547 127483972 1.07
tpcds_q86/datafusion:vortex-compact 🚨 24281273 20731365 1.17
tpcds_q87/datafusion:vortex-compact 🚨 59925806 54356457 1.10
tpcds_q88/datafusion:vortex-compact 83369452 80969662 1.03
tpcds_q89/datafusion:vortex-compact 33368573 31540607 1.06
tpcds_q90/datafusion:vortex-compact 🚨 17144082 15204706 1.13
tpcds_q91/datafusion:vortex-compact 🚨 37021227 33162117 1.12
tpcds_q92/datafusion:vortex-compact 26871019 25210076 1.07
tpcds_q93/datafusion:vortex-compact 42550201 38862344 1.09
tpcds_q94/datafusion:vortex-compact 31469508 29328327 1.07
tpcds_q95/datafusion:vortex-compact 69328780 63627445 1.09
tpcds_q96/datafusion:vortex-compact 19238447 17527129 1.10
tpcds_q97/datafusion:vortex-compact 40821956 37750419 1.08
tpcds_q98/datafusion:vortex-compact 🚨 33212297 29120234 1.14
tpcds_q99/datafusion:vortex-compact 33541885 31519522 1.06
datafusion / parquet (1.115x ❌, 0↑ 53↓)
name PR f8096d6 (ns) base d036fc1 (ns) ratio (PR/base)
tpcds_q01/datafusion:parquet 33806972 31530041 1.07
tpcds_q02/datafusion:parquet 44748381 41075596 1.09
tpcds_q03/datafusion:parquet 15119647 14301247 1.06
tpcds_q04/datafusion:parquet 🚨 308610796 263443429 1.17
tpcds_q05/datafusion:parquet 🚨 46149026 40557148 1.14
tpcds_q06/datafusion:parquet 59715331 59512957 1.00
tpcds_q07/datafusion:parquet 🚨 94436249 78285347 1.21
tpcds_q08/datafusion:parquet 🚨 29735973 26067387 1.14
tpcds_q09/datafusion:parquet 🚨 50703385 42589318 1.19
tpcds_q10/datafusion:parquet 80608974 73425205 1.10
tpcds_q11/datafusion:parquet 🚨 167374383 149937513 1.12
tpcds_q12/datafusion:parquet 19441914 17976491 1.08
tpcds_q13/datafusion:parquet 81717139 76368102 1.07
tpcds_q14/datafusion:parquet 178171948 162809414 1.09
tpcds_q15/datafusion:parquet 23423151 21662571 1.08
tpcds_q16/datafusion:parquet 26839942 25353936 1.06
tpcds_q17/datafusion:parquet 68754625 62809661 1.09
tpcds_q18/datafusion:parquet 121222567 114773927 1.06
tpcds_q19/datafusion:parquet 25903179 24111084 1.07
tpcds_q20/datafusion:parquet 🚨 18462885 16158997 1.14
tpcds_q21/datafusion:parquet 🚨 20818187 18055440 1.15
tpcds_q22/datafusion:parquet 145261697 138315332 1.05
tpcds_q23/datafusion:parquet 🚨 172010281 144282605 1.19
tpcds_q24/datafusion:parquet 🚨 107413483 89033185 1.21
tpcds_q25/datafusion:parquet 🚨 72769350 64261274 1.13
tpcds_q26/datafusion:parquet 🚨 75136776 67931531 1.11
tpcds_q27/datafusion:parquet 🚨 170248665 149030404 1.14
tpcds_q28/datafusion:parquet 🚨 51533886 46397185 1.11
tpcds_q29/datafusion:parquet 🚨 73630913 64756955 1.14
tpcds_q30/datafusion:parquet 🚨 38480138 34265698 1.12
tpcds_q31/datafusion:parquet 70657746 65916262 1.07
tpcds_q32/datafusion:parquet 🚨 20671926 18342818 1.13
tpcds_q33/datafusion:parquet 29327454 27627314 1.06
tpcds_q34/datafusion:parquet 23545873 21757080 1.08
tpcds_q35/datafusion:parquet 🚨 79486955 71071049 1.12
tpcds_q36/datafusion:parquet 🚨 65897358 55984854 1.18
tpcds_q37/datafusion:parquet 🚨 21955784 18925984 1.16
tpcds_q38/datafusion:parquet 45455960 41366734 1.10
tpcds_q39/datafusion:parquet 🚨 82407523 71348199 1.16
tpcds_q40/datafusion:parquet 25346425 23145132 1.10
tpcds_q41/datafusion:parquet 🚨 15305614 13281663 1.15
tpcds_q42/datafusion:parquet 12877133 12230976 1.05
tpcds_q43/datafusion:parquet 17971895 16873324 1.07
tpcds_q44/datafusion:parquet 36153913 33181914 1.09
tpcds_q45/datafusion:parquet 30611647 29015307 1.06
tpcds_q46/datafusion:parquet 🚨 35526738 32229428 1.10
tpcds_q47/datafusion:parquet 🚨 140309027 122883661 1.14
tpcds_q48/datafusion:parquet 77695174 71205753 1.09
tpcds_q49/datafusion:parquet 🚨 61912435 55531471 1.11
tpcds_q50/datafusion:parquet 🚨 49117065 43901059 1.12
tpcds_q51/datafusion:parquet 🚨 96773146 85985868 1.13
tpcds_q52/datafusion:parquet 🚨 13562215 12096692 1.12
tpcds_q53/datafusion:parquet 🚨 19661737 17687307 1.11
tpcds_q54/datafusion:parquet 🚨 37919309 33906202 1.12
tpcds_q55/datafusion:parquet 🚨 12994684 11609696 1.12
tpcds_q56/datafusion:parquet 30948053 28142784 1.10
tpcds_q57/datafusion:parquet 106530280 96970056 1.10
tpcds_q58/datafusion:parquet 🚨 55036001 49463919 1.11
tpcds_q59/datafusion:parquet 56937955 51829814 1.10
tpcds_q60/datafusion:parquet 29738307 27251833 1.09
tpcds_q61/datafusion:parquet 🚨 46402145 41860874 1.11
tpcds_q62/datafusion:parquet 🚨 26693079 19931289 1.34
tpcds_q63/datafusion:parquet 🚨 21254332 17455353 1.22
tpcds_q64/datafusion:parquet 🚨 561902190 507652337 1.11
tpcds_q65/datafusion:parquet 🚨 44542696 36797486 1.21
tpcds_q66/datafusion:parquet 🚨 74646545 67776331 1.10
tpcds_q67/datafusion:parquet 🚨 160468171 140093755 1.15
tpcds_q68/datafusion:parquet 🚨 35925172 32446665 1.11
tpcds_q69/datafusion:parquet 75210460 68884385 1.09
tpcds_q70/datafusion:parquet 93958374 86424314 1.09
tpcds_q71/datafusion:parquet 23876729 22751524 1.05
tpcds_q72/datafusion:parquet 🚨 697217263 594273804 1.17
tpcds_q73/datafusion:parquet 🚨 23116419 20478471 1.13
tpcds_q74/datafusion:parquet 90131913 84441346 1.07
tpcds_q75/datafusion:parquet 🚨 110350052 98981234 1.11
tpcds_q76/datafusion:parquet 32233823 29409199 1.10
tpcds_q77/datafusion:parquet 43241319 40312643 1.07
tpcds_q78/datafusion:parquet 🚨 127688883 109732253 1.16
tpcds_q79/datafusion:parquet 27987193 25943123 1.08
tpcds_q80/datafusion:parquet 🚨 88912987 77552010 1.15
tpcds_q81/datafusion:parquet 36321346 33166616 1.10
tpcds_q82/datafusion:parquet 🚨 21787041 19529807 1.12
tpcds_q83/datafusion:parquet 39832161 36269503 1.10
tpcds_q84/datafusion:parquet 🚨 42447773 38579566 1.10
tpcds_q85/datafusion:parquet 🚨 163031172 147647556 1.10
tpcds_q86/datafusion:parquet 15551375 14159129 1.10
tpcds_q87/datafusion:parquet 44773462 40765019 1.10
tpcds_q88/datafusion:parquet 64256781 58753184 1.09
tpcds_q89/datafusion:parquet 🚨 23797046 21617359 1.10
tpcds_q90/datafusion:parquet 🚨 17297778 14133228 1.22
tpcds_q91/datafusion:parquet 65519227 60270075 1.09
tpcds_q92/datafusion:parquet 19677311 18344966 1.07
tpcds_q93/datafusion:parquet 🚨 36443452 30727030 1.19
tpcds_q94/datafusion:parquet 21719809 20472886 1.06
tpcds_q95/datafusion:parquet 61937787 56440562 1.10
tpcds_q96/datafusion:parquet 13171619 12371162 1.06
tpcds_q97/datafusion:parquet 31464465 30659631 1.03
tpcds_q98/datafusion:parquet 🚨 24178446 21429419 1.13
tpcds_q99/datafusion:parquet 🚨 35149873 24167752 1.45
duckdb / vortex-file-compressed (1.096x ➖, 0↑ 46↓)
name PR f8096d6 (ns) base d036fc1 (ns) ratio (PR/base)
tpcds_q01/duckdb:vortex-file-compressed 🚨 23739243 21491702 1.10
tpcds_q02/duckdb:vortex-file-compressed 32148403 35217845 0.91
tpcds_q03/duckdb:vortex-file-compressed 🚨 35696643 31966547 1.12
tpcds_q04/duckdb:vortex-file-compressed 110784348 106039417 1.04
tpcds_q05/duckdb:vortex-file-compressed 39706767 36684082 1.08
tpcds_q06/duckdb:vortex-file-compressed 🚨 36018215 31767256 1.13
tpcds_q07/duckdb:vortex-file-compressed 🚨 23972520 19866718 1.21
tpcds_q08/duckdb:vortex-file-compressed 30008546 29194761 1.03
tpcds_q09/duckdb:vortex-file-compressed 40760455 38205313 1.07
tpcds_q10/duckdb:vortex-file-compressed 43901536 40375525 1.09
tpcds_q11/duckdb:vortex-file-compressed 65727133 60885440 1.08
tpcds_q12/duckdb:vortex-file-compressed 🚨 16396153 14448563 1.13
tpcds_q13/duckdb:vortex-file-compressed 35718572 33373235 1.07
tpcds_q14/duckdb:vortex-file-compressed 113591204 103842209 1.09
tpcds_q15/duckdb:vortex-file-compressed 🚨 29918641 26290668 1.14
tpcds_q16/duckdb:vortex-file-compressed 🚨 30898986 27252162 1.13
tpcds_q17/duckdb:vortex-file-compressed 🚨 47880352 42923350 1.12
tpcds_q18/duckdb:vortex-file-compressed 50297875 46971383 1.07
tpcds_q19/duckdb:vortex-file-compressed 🚨 39259477 32467650 1.21
tpcds_q20/duckdb:vortex-file-compressed 17013764 15609996 1.09
tpcds_q21/duckdb:vortex-file-compressed 18880764 17724277 1.07
tpcds_q22/duckdb:vortex-file-compressed 83919725 77524249 1.08
tpcds_q23/duckdb:vortex-file-compressed 112301392 107020163 1.05
tpcds_q24/duckdb:vortex-file-compressed 🚨 58235929 49976665 1.17
tpcds_q25/duckdb:vortex-file-compressed 🚨 53016869 47519271 1.12
tpcds_q26/duckdb:vortex-file-compressed 43093598 39688720 1.09
tpcds_q27/duckdb:vortex-file-compressed 52679954 49459471 1.07
tpcds_q28/duckdb:vortex-file-compressed 37095090 35861300 1.03
tpcds_q29/duckdb:vortex-file-compressed 🚨 45017831 39990441 1.13
tpcds_q30/duckdb:vortex-file-compressed 26490955 24856249 1.07
tpcds_q31/duckdb:vortex-file-compressed 39246848 35765124 1.10
tpcds_q32/duckdb:vortex-file-compressed 🚨 15394157 13762593 1.12
tpcds_q33/duckdb:vortex-file-compressed 26143822 24510433 1.07
tpcds_q34/duckdb:vortex-file-compressed 25067636 23208628 1.08
tpcds_q35/duckdb:vortex-file-compressed 🚨 75890839 66393821 1.14
tpcds_q36/duckdb:vortex-file-compressed 27901402 25618147 1.09
tpcds_q37/duckdb:vortex-file-compressed 🚨 17303537 15577863 1.11
tpcds_q38/duckdb:vortex-file-compressed 39960960 36750812 1.09
tpcds_q39/duckdb:vortex-file-compressed 36402333 34613583 1.05
tpcds_q40/duckdb:vortex-file-compressed 🚨 22122970 19447208 1.14
tpcds_q41/duckdb:vortex-file-compressed 14474067 13610135 1.06
tpcds_q42/duckdb:vortex-file-compressed 14047906 13534093 1.04
tpcds_q43/duckdb:vortex-file-compressed 24828084 23458720 1.06
tpcds_q44/duckdb:vortex-file-compressed 22308595 20942089 1.07
tpcds_q45/duckdb:vortex-file-compressed 🚨 33631644 29188023 1.15
tpcds_q46/duckdb:vortex-file-compressed 55033888 51653795 1.07
tpcds_q47/duckdb:vortex-file-compressed 🚨 52866248 47287482 1.12
tpcds_q48/duckdb:vortex-file-compressed 🚨 33279593 30097975 1.11
tpcds_q49/duckdb:vortex-file-compressed 34460742 33419069 1.03
tpcds_q50/duckdb:vortex-file-compressed 37129640 34089057 1.09
tpcds_q51/duckdb:vortex-file-compressed 104677380 98906994 1.06
tpcds_q52/duckdb:vortex-file-compressed 13797671 13523971 1.02
tpcds_q53/duckdb:vortex-file-compressed 🚨 25731153 22973267 1.12
tpcds_q54/duckdb:vortex-file-compressed 30135574 28716993 1.05
tpcds_q55/duckdb:vortex-file-compressed 🚨 14443409 12782592 1.13
tpcds_q56/duckdb:vortex-file-compressed 26078501 26621662 0.98
tpcds_q57/duckdb:vortex-file-compressed 🚨 42942429 38276295 1.12
tpcds_q58/duckdb:vortex-file-compressed 32390376 30972201 1.05
tpcds_q59/duckdb:vortex-file-compressed 69118590 66749326 1.04
tpcds_q60/duckdb:vortex-file-compressed 🚨 30517937 25803622 1.18
tpcds_q61/duckdb:vortex-file-compressed 34635717 36063864 0.96
tpcds_q62/duckdb:vortex-file-compressed 18608946 18060029 1.03
tpcds_q63/duckdb:vortex-file-compressed 22384458 21523128 1.04
tpcds_q64/duckdb:vortex-file-compressed 88118780 83821033 1.05
tpcds_q65/duckdb:vortex-file-compressed 🚨 25347279 21987115 1.15
tpcds_q66/duckdb:vortex-file-compressed 32553737 29701748 1.10
tpcds_q67/duckdb:vortex-file-compressed 🚨 156051416 137249633 1.14
tpcds_q68/duckdb:vortex-file-compressed 44445109 42174394 1.05
tpcds_q69/duckdb:vortex-file-compressed 🚨 46654261 41770457 1.12
tpcds_q70/duckdb:vortex-file-compressed 🚨 30450417 25732033 1.18
tpcds_q71/duckdb:vortex-file-compressed 🚨 25068944 21071450 1.19
tpcds_q72/duckdb:vortex-file-compressed 180151823 175189964 1.03
tpcds_q73/duckdb:vortex-file-compressed 🚨 25144472 22753253 1.11
tpcds_q74/duckdb:vortex-file-compressed 🚨 97671799 72144402 1.35
tpcds_q75/duckdb:vortex-file-compressed 🚨 63320383 56956052 1.11
tpcds_q76/duckdb:vortex-file-compressed 20600079 20954422 0.98
tpcds_q77/duckdb:vortex-file-compressed 🚨 28889585 25509673 1.13
tpcds_q78/duckdb:vortex-file-compressed 80933210 77093342 1.05
tpcds_q79/duckdb:vortex-file-compressed 🚨 35851401 31714905 1.13
tpcds_q80/duckdb:vortex-file-compressed 🚨 53906551 46174059 1.17
tpcds_q81/duckdb:vortex-file-compressed 🚨 32297524 28669328 1.13
tpcds_q82/duckdb:vortex-file-compressed 🚨 19327597 16617828 1.16
tpcds_q83/duckdb:vortex-file-compressed 🚨 26962410 23414011 1.15
tpcds_q84/duckdb:vortex-file-compressed 🚨 23577062 19683763 1.20
tpcds_q85/duckdb:vortex-file-compressed 🚨 51177373 45659562 1.12
tpcds_q86/duckdb:vortex-file-compressed 🚨 18547467 16682427 1.11
tpcds_q87/duckdb:vortex-file-compressed 🚨 47101523 39833867 1.18
tpcds_q88/duckdb:vortex-file-compressed 36058475 34077747 1.06
tpcds_q89/duckdb:vortex-file-compressed 24418044 22928788 1.06
tpcds_q90/duckdb:vortex-file-compressed 13703425 12528612 1.09
tpcds_q91/duckdb:vortex-file-compressed 🚨 35019220 29401097 1.19
tpcds_q92/duckdb:vortex-file-compressed 23098270 22133772 1.04
tpcds_q93/duckdb:vortex-file-compressed 🚨 31759552 26974203 1.18
tpcds_q94/duckdb:vortex-file-compressed 🚨 25475759 23076403 1.10
tpcds_q95/duckdb:vortex-file-compressed 146524864 138603091 1.06
tpcds_q96/duckdb:vortex-file-compressed 🚨 15708928 13511866 1.16
tpcds_q97/duckdb:vortex-file-compressed 🚨 44934785 39743258 1.13
tpcds_q98/duckdb:vortex-file-compressed 19890693 18169232 1.09
tpcds_q99/duckdb:vortex-file-compressed 29126177 28003236 1.04
duckdb / vortex-compact (1.075x ➖, 0↑ 26↓)
name PR f8096d6 (ns) base d036fc1 (ns) ratio (PR/base)
tpcds_q01/duckdb:vortex-compact 🚨 26289157 23100271 1.14
tpcds_q02/duckdb:vortex-compact 39356588 42140967 0.93
tpcds_q03/duckdb:vortex-compact 60624883 57714393 1.05
tpcds_q04/duckdb:vortex-compact 131038760 121631036 1.08
tpcds_q05/duckdb:vortex-compact 54976390 52903673 1.04
tpcds_q06/duckdb:vortex-compact 44236565 41637993 1.06
tpcds_q07/duckdb:vortex-compact 36875658 34571866 1.07
tpcds_q08/duckdb:vortex-compact 48514025 45100907 1.08
tpcds_q09/duckdb:vortex-compact 62975286 57355701 1.10
tpcds_q10/duckdb:vortex-compact 66235136 61284992 1.08
tpcds_q11/duckdb:vortex-compact 🚨 79293045 71003443 1.12
tpcds_q12/duckdb:vortex-compact 24346623 22463639 1.08
tpcds_q13/duckdb:vortex-compact 61087515 58685793 1.04
tpcds_q14/duckdb:vortex-compact 140912094 128769927 1.09
tpcds_q15/duckdb:vortex-compact 🚨 37025831 31198999 1.19
tpcds_q16/duckdb:vortex-compact 🚨 35339590 32015103 1.10
tpcds_q17/duckdb:vortex-compact 🚨 60395516 54013896 1.12
tpcds_q18/duckdb:vortex-compact 63147935 57547924 1.10
tpcds_q19/duckdb:vortex-compact 54860453 51606295 1.06
tpcds_q20/duckdb:vortex-compact 22536083 20622187 1.09
tpcds_q21/duckdb:vortex-compact 21844749 20525705 1.06
tpcds_q22/duckdb:vortex-compact 🚨 88579392 71979309 1.23
tpcds_q23/duckdb:vortex-compact 🚨 135130402 122129755 1.11
tpcds_q24/duckdb:vortex-compact 68383515 62861040 1.09
tpcds_q25/duckdb:vortex-compact 🚨 87059362 78053189 1.12
tpcds_q26/duckdb:vortex-compact 56018984 51052056 1.10
tpcds_q27/duckdb:vortex-compact 75461828 69407236 1.09
tpcds_q28/duckdb:vortex-compact 90284658 84022534 1.07
tpcds_q29/duckdb:vortex-compact 57748040 54246758 1.06
tpcds_q30/duckdb:vortex-compact 30725570 27936582 1.10
tpcds_q31/duckdb:vortex-compact 🚨 50131992 44768881 1.12
tpcds_q32/duckdb:vortex-compact 🚨 26517332 22640134 1.17
tpcds_q33/duckdb:vortex-compact 39607444 37506285 1.06
tpcds_q34/duckdb:vortex-compact 🚨 42173938 38158612 1.11
tpcds_q35/duckdb:vortex-compact 90430429 82415839 1.10
tpcds_q36/duckdb:vortex-compact 44683533 41250539 1.08
tpcds_q37/duckdb:vortex-compact 🚨 26366356 23301718 1.13
tpcds_q38/duckdb:vortex-compact 52343732 50107881 1.04
tpcds_q39/duckdb:vortex-compact 38133366 36946016 1.03
tpcds_q40/duckdb:vortex-compact 🚨 29106379 25415955 1.15
tpcds_q41/duckdb:vortex-compact 🚨 17621227 15619280 1.13
tpcds_q42/duckdb:vortex-compact 23950067 22170373 1.08
tpcds_q43/duckdb:vortex-compact 37198275 34413669 1.08
tpcds_q44/duckdb:vortex-compact 31088534 30340036 1.02
tpcds_q45/duckdb:vortex-compact 🚨 42602441 37335550 1.14
tpcds_q46/duckdb:vortex-compact 🚨 78628960 69466349 1.13
tpcds_q47/duckdb:vortex-compact 67613097 63013318 1.07
tpcds_q48/duckdb:vortex-compact 🚨 56753211 50619625 1.12
tpcds_q49/duckdb:vortex-compact 64719509 61725175 1.05
tpcds_q50/duckdb:vortex-compact 50045026 46733052 1.07
tpcds_q51/duckdb:vortex-compact 117952184 116085593 1.02
tpcds_q52/duckdb:vortex-compact 23162492 22093979 1.05
tpcds_q53/duckdb:vortex-compact 39334933 38141815 1.03
tpcds_q54/duckdb:vortex-compact 44718336 42639652 1.05
tpcds_q55/duckdb:vortex-compact 🚨 24884221 22445208 1.11
tpcds_q56/duckdb:vortex-compact 38344604 35500988 1.08
tpcds_q57/duckdb:vortex-compact 46908450 44811761 1.05
tpcds_q58/duckdb:vortex-compact 45546111 41553709 1.10
tpcds_q59/duckdb:vortex-compact 92530877 88002110 1.05
tpcds_q60/duckdb:vortex-compact 🚨 43193592 37665844 1.15
tpcds_q61/duckdb:vortex-compact 68159153 63043062 1.08
tpcds_q62/duckdb:vortex-compact 🚨 28607627 25556138 1.12
tpcds_q63/duckdb:vortex-compact 41146945 37576650 1.10
tpcds_q64/duckdb:vortex-compact 122453865 115727412 1.06
tpcds_q65/duckdb:vortex-compact 34688406 32470794 1.07
tpcds_q66/duckdb:vortex-compact 41301345 39215969 1.05
tpcds_q67/duckdb:vortex-compact 163258891 151027519 1.08
tpcds_q68/duckdb:vortex-compact 67140591 61544009 1.09
tpcds_q69/duckdb:vortex-compact 68083506 64188311 1.06
tpcds_q70/duckdb:vortex-compact 39883642 38007317 1.05
tpcds_q71/duckdb:vortex-compact 37630329 34760202 1.08
tpcds_q72/duckdb:vortex-compact 204471686 198242782 1.03
tpcds_q73/duckdb:vortex-compact 38481603 39521594 0.97
tpcds_q74/duckdb:vortex-compact 84825096 93149507 0.91
tpcds_q75/duckdb:vortex-compact 79253812 76221980 1.04
tpcds_q76/duckdb:vortex-compact 🚨 38889486 34491135 1.13
tpcds_q77/duckdb:vortex-compact 45223844 44186716 1.02
tpcds_q78/duckdb:vortex-compact 96040864 89076174 1.08
tpcds_q79/duckdb:vortex-compact 55610917 55115588 1.01
tpcds_q80/duckdb:vortex-compact 90561213 83212136 1.09
tpcds_q81/duckdb:vortex-compact 🚨 36927373 33560505 1.10
tpcds_q82/duckdb:vortex-compact 27551101 26033303 1.06
tpcds_q83/duckdb:vortex-compact 🚨 36021629 31806317 1.13
tpcds_q84/duckdb:vortex-compact 🚨 30249227 26350118 1.15
tpcds_q85/duckdb:vortex-compact 🚨 65190945 57114585 1.14
tpcds_q86/duckdb:vortex-compact 25362181 24005986 1.06
tpcds_q87/duckdb:vortex-compact 54452267 52736222 1.03
tpcds_q88/duckdb:vortex-compact 42224861 39165951 1.08
tpcds_q89/duckdb:vortex-compact 39660854 38247599 1.04
tpcds_q90/duckdb:vortex-compact 16215903 15080742 1.08
tpcds_q91/duckdb:vortex-compact 54343283 51797365 1.05
tpcds_q92/duckdb:vortex-compact 48712850 52157790 0.93
tpcds_q93/duckdb:vortex-compact 34132158 31543896 1.08
tpcds_q94/duckdb:vortex-compact 33893595 33348012 1.02
tpcds_q95/duckdb:vortex-compact 168902992 166936703 1.01
tpcds_q96/duckdb:vortex-compact 18753738 17712838 1.06
tpcds_q97/duckdb:vortex-compact 47890236 44619827 1.07
tpcds_q98/duckdb:vortex-compact 🚨 32271805 27921777 1.16
tpcds_q99/duckdb:vortex-compact 32668458 34557322 0.95
duckdb / parquet (1.074x ➖, 0↑ 25↓)
name PR f8096d6 (ns) base d036fc1 (ns) ratio (PR/base)
tpcds_q01/duckdb:parquet 🚨 31992867 28759538 1.11
tpcds_q02/duckdb:parquet 23497040 22689539 1.04
tpcds_q03/duckdb:parquet 🚨 12969212 11202170 1.16
tpcds_q04/duckdb:parquet 179333575 168364597 1.07
tpcds_q05/duckdb:parquet 🚨 31956500 28756245 1.11
tpcds_q06/duckdb:parquet 29415255 28293908 1.04
tpcds_q07/duckdb:parquet 21315860 20618248 1.03
tpcds_q08/duckdb:parquet 27923708 26622252 1.05
tpcds_q09/duckdb:parquet 40975357 39241538 1.04
tpcds_q10/duckdb:parquet 36011804 34939820 1.03
tpcds_q11/duckdb:parquet 94578615 89257475 1.06
tpcds_q12/duckdb:parquet 15159611 14647295 1.03
tpcds_q13/duckdb:parquet 33624364 32766100 1.03
tpcds_q14/duckdb:parquet 100156566 96944892 1.03
tpcds_q15/duckdb:parquet 32702465 30380813 1.08
tpcds_q16/duckdb:parquet 22303253 21062861 1.06
tpcds_q17/duckdb:parquet 38026782 36567054 1.04
tpcds_q18/duckdb:parquet 48438418 45536037 1.06
tpcds_q19/duckdb:parquet 31706786 29092814 1.09
tpcds_q20/duckdb:parquet 16873219 15613088 1.08
tpcds_q21/duckdb:parquet 10759854 9969233 1.08
tpcds_q22/duckdb:parquet 🚨 79150347 65588024 1.21
tpcds_q23/duckdb:parquet 🚨 88950514 78775057 1.13
tpcds_q24/duckdb:parquet 🚨 47634105 43075400 1.11
tpcds_q25/duckdb:parquet 34514088 32437801 1.06
tpcds_q26/duckdb:parquet 39404433 36130843 1.09
tpcds_q27/duckdb:parquet 🚨 51450646 46461192 1.11
tpcds_q28/duckdb:parquet 39598017 37751698 1.05
tpcds_q29/duckdb:parquet 37479724 34981247 1.07
tpcds_q30/duckdb:parquet 36563457 34583408 1.06
tpcds_q31/duckdb:parquet 23842912 23387167 1.02
tpcds_q32/duckdb:parquet 🚨 13100324 10459825 1.25
tpcds_q33/duckdb:parquet 22321705 20479318 1.09
tpcds_q34/duckdb:parquet 🚨 22418991 19925121 1.13
tpcds_q35/duckdb:parquet 61296461 57898020 1.06
tpcds_q36/duckdb:parquet 20460462 19474853 1.05
tpcds_q37/duckdb:parquet 12977695 12373679 1.05
tpcds_q38/duckdb:parquet 🚨 38231340 33164415 1.15
tpcds_q39/duckdb:parquet 30264412 28000211 1.08
tpcds_q40/duckdb:parquet 18008511 16854538 1.07
tpcds_q41/duckdb:parquet 8231631 7884738 1.04
tpcds_q42/duckdb:parquet 🚨 10691542 9206860 1.16
tpcds_q43/duckdb:parquet 15879564 15841224 1.00
tpcds_q44/duckdb:parquet 22670057 22389315 1.01
tpcds_q45/duckdb:parquet 28437766 27330207 1.04
tpcds_q46/duckdb:parquet 🚨 48510254 43236357 1.12
tpcds_q47/duckdb:parquet 46715820 44808503 1.04
tpcds_q48/duckdb:parquet 31907025 29061120 1.10
tpcds_q49/duckdb:parquet 🚨 26152393 23676736 1.10
tpcds_q50/duckdb:parquet 25064900 24388924 1.03
tpcds_q51/duckdb:parquet 101464764 95122714 1.07
tpcds_q52/duckdb:parquet 🚨 11555169 10055574 1.15
tpcds_q53/duckdb:parquet 15598695 14777207 1.06
tpcds_q54/duckdb:parquet 25916735 25450424 1.02
tpcds_q55/duckdb:parquet 10483441 9630697 1.09
tpcds_q56/duckdb:parquet 21762175 21388339 1.02
tpcds_q57/duckdb:parquet 34319487 34290795 1.00
tpcds_q58/duckdb:parquet 23903951 22399796 1.07
tpcds_q59/duckdb:parquet 36513138 35064100 1.04
tpcds_q60/duckdb:parquet 22341314 21731318 1.03
tpcds_q61/duckdb:parquet 31858562 29802481 1.07
tpcds_q62/duckdb:parquet 12413855 11865552 1.05
tpcds_q63/duckdb:parquet 14522821 13874975 1.05
tpcds_q64/duckdb:parquet 77133716 73184853 1.05
tpcds_q65/duckdb:parquet 🚨 21644144 19261052 1.12
tpcds_q66/duckdb:parquet 29326493 27321714 1.07
tpcds_q67/duckdb:parquet 🚨 152112264 132153250 1.15
tpcds_q68/duckdb:parquet 38127162 36467266 1.05
tpcds_q69/duckdb:parquet 37284765 36767557 1.01
tpcds_q70/duckdb:parquet 🚨 21097641 19091348 1.11
tpcds_q71/duckdb:parquet 19638401 18662281 1.05
tpcds_q72/duckdb:parquet 173155709 174004678 1.00
tpcds_q73/duckdb:parquet 18451259 17232520 1.07
tpcds_q74/duckdb:parquet 134304113 129092495 1.04
tpcds_q75/duckdb:parquet 56324735 52634700 1.07
tpcds_q76/duckdb:parquet 20883640 19152810 1.09
tpcds_q77/duckdb:parquet 23242903 21488670 1.08
tpcds_q78/duckdb:parquet 🚨 80924772 72592242 1.11
tpcds_q79/duckdb:parquet 28955134 26902280 1.08
tpcds_q80/duckdb:parquet 42242612 40272151 1.05
tpcds_q81/duckdb:parquet 34317449 31675989 1.08
tpcds_q82/duckdb:parquet 🚨 14756472 13323447 1.11
tpcds_q83/duckdb:parquet 17705404 16443778 1.08
tpcds_q84/duckdb:parquet 🚨 19899157 17794260 1.12
tpcds_q85/duckdb:parquet 38802713 37334637 1.04
tpcds_q86/duckdb:parquet 🚨 13241966 12033474 1.10
tpcds_q87/duckdb:parquet 39035648 35731966 1.09
tpcds_q88/duckdb:parquet 49936307 47912783 1.04
tpcds_q89/duckdb:parquet 17619836 16360218 1.08
tpcds_q90/duckdb:parquet 🚨 8646434 7638020 1.13
tpcds_q91/duckdb:parquet 24161515 22415706 1.08
tpcds_q92/duckdb:parquet 12029111 10988829 1.09
tpcds_q93/duckdb:parquet 🚨 34380222 27540504 1.25
tpcds_q94/duckdb:parquet 🚨 17866370 16050957 1.11
tpcds_q95/duckdb:parquet 140170194 131922581 1.06
tpcds_q96/duckdb:parquet 9052121 8812291 1.03
tpcds_q97/duckdb:parquet 🚨 38443279 34799345 1.10
tpcds_q98/duckdb:parquet 18021366 17581937 1.02
tpcds_q99/duckdb:parquet 20705146 19039058 1.09
duckdb / duckdb (1.102x ❌, 0↑ 40↓)
name PR f8096d6 (ns) base d036fc1 (ns) ratio (PR/base)
tpcds_q01/duckdb:duckdb 21572391 19754205 1.09
tpcds_q02/duckdb:duckdb 20535333 19676193 1.04
tpcds_q03/duckdb:duckdb 🚨 9629926 8379413 1.15
tpcds_q04/duckdb:duckdb 185183628 168797820 1.10
tpcds_q05/duckdb:duckdb 20449534 19202625 1.06
tpcds_q06/duckdb:duckdb 25005047 23122092 1.08
tpcds_q07/duckdb:duckdb 🚨 42744033 37384209 1.14
tpcds_q08/duckdb:duckdb 122681518 120855154 1.02
tpcds_q09/duckdb:duckdb 21030506 20198707 1.04
tpcds_q10/duckdb:duckdb 25770697 24625722 1.05
tpcds_q11/duckdb:duckdb 91859937 85506175 1.07
tpcds_q12/duckdb:duckdb 12241898 11701331 1.05
tpcds_q13/duckdb:duckdb 26038473 24610246 1.06
tpcds_q14/duckdb:duckdb 97711242 91461311 1.07
tpcds_q15/duckdb:duckdb 🚨 26921695 24000558 1.12
tpcds_q16/duckdb:duckdb 19624508 18074341 1.09
tpcds_q17/duckdb:duckdb 24868850 22726130 1.09
tpcds_q18/duckdb:duckdb 🚨 49379651 44308513 1.11
tpcds_q19/duckdb:duckdb 🚨 25984915 16523095 1.57
tpcds_q20/duckdb:duckdb 13199065 12465984 1.06
tpcds_q21/duckdb:duckdb 🚨 8073856 6770546 1.19
tpcds_q22/duckdb:duckdb 67738766 61619259 1.10
tpcds_q23/duckdb:duckdb 81095370 80742352 1.00
tpcds_q24/duckdb:duckdb 🚨 27474135 24333701 1.13
tpcds_q25/duckdb:duckdb 18430913 16805223 1.10
tpcds_q26/duckdb:duckdb 27622148 27043544 1.02
tpcds_q27/duckdb:duckdb 🚨 42767792 38546618 1.11
tpcds_q28/duckdb:duckdb 23448057 21644598 1.08
tpcds_q29/duckdb:duckdb 21937525 20407289 1.07
tpcds_q30/duckdb:duckdb 🚨 32527217 27587800 1.18
tpcds_q31/duckdb:duckdb 51512680 47946932 1.07
tpcds_q32/duckdb:duckdb 🚨 8505018 7117282 1.19
tpcds_q33/duckdb:duckdb 🚨 13832459 12498241 1.11
tpcds_q34/duckdb:duckdb 16029645 14585556 1.10
tpcds_q35/duckdb:duckdb 🚨 37871392 32257533 1.17
tpcds_q36/duckdb:duckdb 76326597 70906697 1.08
tpcds_q37/duckdb:duckdb 8260439 7920633 1.04
tpcds_q38/duckdb:duckdb 32546441 29839257 1.09
tpcds_q39/duckdb:duckdb 26897978 25295633 1.06
tpcds_q40/duckdb:duckdb 14841107 13967043 1.06
tpcds_q41/duckdb:duckdb 🚨 9525652 8194439 1.16
tpcds_q42/duckdb:duckdb 🚨 7255812 6318970 1.15
tpcds_q43/duckdb:duckdb 🚨 11853046 10667842 1.11
tpcds_q44/duckdb:duckdb 14460343 13581979 1.06
tpcds_q45/duckdb:duckdb 🚨 19653436 17443647 1.13
tpcds_q46/duckdb:duckdb 40025403 36513525 1.10
tpcds_q47/duckdb:duckdb 43120506 39616749 1.09
tpcds_q48/duckdb:duckdb 24263813 23778466 1.02
tpcds_q49/duckdb:duckdb 🚨 18879178 16506664 1.14
tpcds_q50/duckdb:duckdb 🚨 15898598 13979971 1.14
tpcds_q51/duckdb:duckdb 97302676 91777687 1.06
tpcds_q52/duckdb:duckdb 🚨 8179876 7221040 1.13
tpcds_q53/duckdb:duckdb 🚨 14432945 13015526 1.11
tpcds_q54/duckdb:duckdb 17692396 16187316 1.09
tpcds_q55/duckdb:duckdb 🚨 8036760 6985824 1.15
tpcds_q56/duckdb:duckdb 14990868 13968995 1.07
tpcds_q57/duckdb:duckdb 32638150 30974777 1.05
tpcds_q58/duckdb:duckdb 🚨 13949024 12540587 1.11
tpcds_q59/duckdb:duckdb 37586896 35093839 1.07
tpcds_q60/duckdb:duckdb 🚨 16192965 14558717 1.11
tpcds_q61/duckdb:duckdb 14917507 14416412 1.03
tpcds_q62/duckdb:duckdb 9979624 9355255 1.07
tpcds_q63/duckdb:duckdb 🚨 13986874 11978910 1.17
tpcds_q64/duckdb:duckdb 58780000 53608641 1.10
tpcds_q65/duckdb:duckdb 🚨 36762343 31438544 1.17
tpcds_q66/duckdb:duckdb 27413266 25365994 1.08
tpcds_q67/duckdb:duckdb 141127236 131352890 1.07
tpcds_q68/duckdb:duckdb 26645948 25327458 1.05
tpcds_q69/duckdb:duckdb 25738140 25243305 1.02
tpcds_q70/duckdb:duckdb 🚨 15993863 14533979 1.10
tpcds_q71/duckdb:duckdb 🚨 14886637 12943793 1.15
tpcds_q72/duckdb:duckdb 45577026 43504214 1.05
tpcds_q73/duckdb:duckdb 🚨 11824903 10475157 1.13
tpcds_q74/duckdb:duckdb 152900325 142610645 1.07
tpcds_q75/duckdb:duckdb 44652702 42272960 1.06
tpcds_q76/duckdb:duckdb 🚨 13440717 12173198 1.10
tpcds_q77/duckdb:duckdb 🚨 13220079 11731059 1.13
tpcds_q78/duckdb:duckdb 🚨 68244027 61995987 1.10
tpcds_q79/duckdb:duckdb 19898856 18448400 1.08
tpcds_q80/duckdb:duckdb 30244502 28041146 1.08
tpcds_q81/duckdb:duckdb 38930229 36959968 1.05
tpcds_q82/duckdb:duckdb 🚨 9712702 8086699 1.20
tpcds_q83/duckdb:duckdb 🚨 10566226 9429486 1.12
tpcds_q84/duckdb:duckdb 🚨 15987452 12655676 1.26
tpcds_q85/duckdb:duckdb 🚨 26746431 23103484 1.16
tpcds_q86/duckdb:duckdb 11428770 10405904 1.10
tpcds_q87/duckdb:duckdb 36655218 33607277 1.09
tpcds_q88/duckdb:duckdb 27536387 25805118 1.07
tpcds_q89/duckdb:duckdb 15365227 14536303 1.06
tpcds_q90/duckdb:duckdb 🚨 6337278 5513919 1.15
tpcds_q91/duckdb:duckdb 13634040 12689785 1.07
tpcds_q92/duckdb:duckdb 🚨 9815595 8308095 1.18
tpcds_q93/duckdb:duckdb 🚨 25180490 21040042 1.20
tpcds_q94/duckdb:duckdb 14720871 14226681 1.03
tpcds_q95/duckdb:duckdb 117822223 108507778 1.09
tpcds_q96/duckdb:duckdb 🚨 5437704 4279000 1.27
tpcds_q97/duckdb:duckdb 🚨 33974397 29258283 1.16
tpcds_q98/duckdb:duckdb 15657211 14598663 1.07
tpcds_q99/duckdb:duckdb 16936304 16298189 1.04
Full attributed analysis
Query Config Raw Δ Control Δ Attributed α Noise floor Significant?
1 datafusion:vortex-compact +14.8% +9.2% +5.1% +19.1% ➖ noise
1 datafusion:vortex-file-compressed +23.5% +9.2% +13.1% +19.1% ➖ noise
1 duckdb:duckdb +9.2% +9.2% -0.0% +19.9% ➖ noise
1 duckdb:vortex-compact +13.8% +9.2% +4.2% +19.5% ➖ noise
1 duckdb:vortex-file-compressed +10.5% +9.2% +1.1% +29.3% ➖ noise
2 datafusion:vortex-compact +5.4% +6.2% -0.7% +10.0% ➖ noise
2 datafusion:vortex-file-compressed +5.4% +6.2% -0.7% +10.0% ➖ noise
2 duckdb:duckdb +4.4% +6.2% -1.7% +14.7% ➖ noise
2 duckdb:vortex-compact -6.6% +6.2% -12.1% +25.1% ➖ noise
2 duckdb:vortex-file-compressed -8.7% +6.2% -14.1% +31.8% ➖ noise
3 datafusion:vortex-compact +7.9% +10.6% -2.4% +11.5% ➖ noise
3 datafusion:vortex-file-compressed +8.4% +10.6% -2.0% +10.0% ➖ noise
3 duckdb:duckdb +14.9% +10.6% +3.9% +17.3% ➖ noise
3 duckdb:vortex-compact +5.0% +10.6% -5.1% +10.0% ➖ noise
3 duckdb:vortex-file-compressed +11.7% +10.6% +0.9% +10.0% ➖ noise
4 datafusion:vortex-compact +17.9% +11.7% +5.5% +10.0% ➖ noise
4 datafusion:vortex-file-compressed +14.1% +11.7% +2.1% +10.0% ➖ noise
4 duckdb:duckdb +9.7% +11.7% -1.8% +10.0% ➖ noise
4 duckdb:vortex-compact +7.7% +11.7% -3.6% +10.0% ➖ noise
4 duckdb:vortex-file-compressed +4.5% +11.7% -6.5% +15.5% ➖ noise
5 datafusion:vortex-compact +13.0% +12.5% +0.5% +10.0% ➖ noise
5 datafusion:vortex-file-compressed +17.8% +12.5% +4.8% +11.1% ➖ noise
5 duckdb:duckdb +6.5% +12.5% -5.3% +15.9% ➖ noise
5 duckdb:vortex-compact +3.9% +12.5% -7.6% +11.5% ➖ noise
5 duckdb:vortex-file-compressed +8.2% +12.5% -3.7% +10.0% ➖ noise
6 datafusion:vortex-compact +2.9% +2.1% +0.8% +10.0% ➖ noise
6 datafusion:vortex-file-compressed +0.8% +2.1% -1.3% +10.0% ➖ noise
6 duckdb:duckdb +8.1% +2.1% +5.9% +15.4% ➖ noise
6 duckdb:vortex-compact +6.2% +2.1% +4.0% +12.8% ➖ noise
6 duckdb:vortex-file-compressed +13.4% +2.1% +11.0% +10.1% 🚨 regression
7 datafusion:vortex-compact +16.2% +11.7% +4.0% +19.1% ➖ noise
7 datafusion:vortex-file-compressed +19.7% +11.7% +7.2% +10.0% ➖ noise
7 duckdb:duckdb +14.3% +11.7% +2.4% +16.2% ➖ noise
7 duckdb:vortex-compact +6.7% +11.7% -4.5% +14.8% ➖ noise
7 duckdb:vortex-file-compressed +20.7% +11.7% +8.1% +22.6% ➖ noise
8 datafusion:vortex-compact +10.1% +9.4% +0.7% +10.0% ➖ noise
8 datafusion:vortex-file-compressed +8.7% +9.4% -0.6% +19.1% ➖ noise
8 duckdb:duckdb +1.5% +9.4% -7.2% +10.0% ➖ noise
8 duckdb:vortex-compact +7.6% +9.4% -1.7% +10.0% ➖ noise
8 duckdb:vortex-file-compressed +2.8% +9.4% -6.0% +12.5% ➖ noise
9 datafusion:vortex-compact +6.9% +11.5% -4.1% +10.0% ➖ noise
9 datafusion:vortex-file-compressed +5.0% +11.5% -5.8% +10.0% ➖ noise
9 duckdb:duckdb +4.1% +11.5% -6.6% +10.0% ➖ noise
9 duckdb:vortex-compact +9.8% +11.5% -1.5% +13.8% ➖ noise
9 duckdb:vortex-file-compressed +6.7% +11.5% -4.3% +10.0% ➖ noise
10 datafusion:vortex-compact +9.6% +6.4% +3.1% +10.0% ➖ noise
10 datafusion:vortex-file-compressed +15.1% +6.4% +8.2% +10.0% ➖ noise
10 duckdb:duckdb +4.6% +6.4% -1.6% +10.0% ➖ noise
10 duckdb:vortex-compact +8.1% +6.4% +1.6% +10.0% ➖ noise
10 duckdb:vortex-file-compressed +8.7% +6.4% +2.2% +10.0% ➖ noise
11 datafusion:vortex-compact +8.0% +8.8% -0.7% +10.0% ➖ noise
11 datafusion:vortex-file-compressed +8.4% +8.8% -0.4% +10.0% ➖ noise
11 duckdb:duckdb +7.4% +8.8% -1.2% +12.1% ➖ noise
11 duckdb:vortex-compact +11.7% +8.8% +2.7% +16.6% ➖ noise
11 duckdb:vortex-file-compressed +8.0% +8.8% -0.7% +10.0% ➖ noise
12 datafusion:vortex-compact +1.2% +5.8% -4.4% +18.4% ➖ noise
12 datafusion:vortex-file-compressed +17.5% +5.8% +11.1% +12.8% ➖ noise
12 duckdb:duckdb +4.6% +5.8% -1.1% +12.4% ➖ noise
12 duckdb:vortex-compact +8.4% +5.8% +2.4% +13.0% ➖ noise
12 duckdb:vortex-file-compressed +13.5% +5.8% +7.3% +10.0% ➖ noise
13 datafusion:vortex-compact +1.2% +4.8% -3.5% +10.0% ➖ noise
13 datafusion:vortex-file-compressed +9.7% +4.8% +4.7% +17.2% ➖ noise
13 duckdb:duckdb +5.8% +4.8% +1.0% +10.0% ➖ noise
13 duckdb:vortex-compact +4.1% +4.8% -0.7% +10.0% ➖ noise
13 duckdb:vortex-file-compressed +7.0% +4.8% +2.1% +10.0% ➖ noise
14 datafusion:vortex-compact +10.0% +6.3% +3.5% +10.0% ➖ noise
14 datafusion:vortex-file-compressed +8.8% +6.3% +2.4% +10.0% ➖ noise
14 duckdb:duckdb +6.8% +6.3% +0.5% +10.0% ➖ noise
14 duckdb:vortex-compact +9.4% +6.3% +2.9% +11.0% ➖ noise
14 duckdb:vortex-file-compressed +9.4% +6.3% +2.9% +10.0% ➖ noise
15 datafusion:vortex-compact +10.5% +7.9% +2.4% +10.8% ➖ noise
15 datafusion:vortex-file-compressed +16.1% +7.9% +7.6% +12.1% ➖ noise
15 duckdb:duckdb +12.2% +7.9% +4.0% +10.5% ➖ noise
15 duckdb:vortex-compact +18.7% +7.9% +10.0% +14.4% ➖ noise
15 duckdb:vortex-file-compressed +13.8% +7.9% +5.5% +10.0% ➖ noise
16 datafusion:vortex-compact +9.7% +5.9% +3.6% +11.6% ➖ noise
16 datafusion:vortex-file-compressed +4.0% +5.9% -1.8% +10.0% ➖ noise
16 duckdb:duckdb +8.6% +5.9% +2.6% +15.9% ➖ noise
16 duckdb:vortex-compact +10.4% +5.9% +4.3% +16.9% ➖ noise
16 duckdb:vortex-file-compressed +13.4% +5.9% +7.1% +11.8% ➖ noise
17 datafusion:vortex-compact +15.9% +6.7% +8.6% +10.0% ➖ noise
17 datafusion:vortex-file-compressed +13.1% +6.7% +6.0% +10.9% ➖ noise
17 duckdb:duckdb +9.4% +6.7% +2.6% +10.4% ➖ noise
17 duckdb:vortex-compact +11.8% +6.7% +4.8% +12.6% ➖ noise
17 duckdb:vortex-file-compressed +11.5% +6.7% +4.6% +11.2% ➖ noise
18 datafusion:vortex-compact +7.3% +6.0% +1.2% +10.0% ➖ noise
18 datafusion:vortex-file-compressed +8.5% +6.0% +2.3% +10.0% ➖ noise
18 duckdb:duckdb +11.4% +6.0% +5.1% +10.0% ➖ noise
18 duckdb:vortex-compact +9.7% +6.0% +3.5% +11.4% ➖ noise
18 duckdb:vortex-file-compressed +7.1% +6.0% +1.0% +10.2% ➖ noise
19 datafusion:vortex-compact +13.1% +8.2% +4.5% +10.0% ➖ noise
19 datafusion:vortex-file-compressed +13.5% +8.2% +4.9% +10.0% ➖ noise
19 duckdb:duckdb +57.3% +8.2% +45.3% +31.2% 🚨 regression
19 duckdb:vortex-compact +6.3% +8.2% -1.8% +10.3% ➖ noise
19 duckdb:vortex-file-compressed +20.9% +8.2% +11.7% +13.0% ➖ noise
20 datafusion:vortex-compact +7.1% +11.1% -3.6% +10.0% ➖ noise
20 datafusion:vortex-file-compressed +11.4% +11.1% +0.2% +10.0% ➖ noise
20 duckdb:duckdb +5.9% +11.1% -4.7% +12.9% ➖ noise
20 duckdb:vortex-compact +9.3% +11.1% -1.7% +10.0% ➖ noise
20 duckdb:vortex-file-compressed +9.0% +11.1% -1.9% +10.0% ➖ noise
21 datafusion:vortex-compact +6.1% +11.6% -4.9% +10.0% ➖ noise
21 datafusion:vortex-file-compressed +13.2% +11.6% +1.5% +10.0% ➖ noise
21 duckdb:duckdb +19.2% +11.6% +6.9% +15.8% ➖ noise
21 duckdb:vortex-compact +6.4% +11.6% -4.6% +20.8% ➖ noise
21 duckdb:vortex-file-compressed +6.5% +11.6% -4.5% +13.8% ➖ noise
22 datafusion:vortex-compact +18.5% +12.6% +5.3% +19.1% ➖ noise
22 datafusion:vortex-file-compressed +9.4% +12.6% -2.8% +22.8% ➖ noise
22 duckdb:duckdb +9.9% +12.6% -2.4% +12.4% ➖ noise
22 duckdb:vortex-compact +23.1% +12.6% +9.3% +12.1% ➖ noise
22 duckdb:vortex-file-compressed +8.2% +12.6% -3.8% +13.1% ➖ noise
23 datafusion:vortex-compact +12.2% +16.0% -3.3% +10.0% ➖ noise
23 datafusion:vortex-file-compressed +10.8% +16.0% -4.5% +10.0% ➖ noise
23 duckdb:duckdb +0.4% +16.0% -13.4% +14.7% ✅ faster
23 duckdb:vortex-compact +10.6% +16.0% -4.6% +15.0% ➖ noise
23 duckdb:vortex-file-compressed +4.9% +16.0% -9.6% +15.8% ➖ noise
24 datafusion:vortex-compact +15.8% +15.5% +0.2% +10.0% ➖ noise
24 datafusion:vortex-file-compressed +17.8% +15.5% +2.0% +10.0% ➖ noise
24 duckdb:duckdb +12.9% +15.5% -2.2% +11.3% ➖ noise
24 duckdb:vortex-compact +8.8% +15.5% -5.8% +10.0% ➖ noise
24 duckdb:vortex-file-compressed +16.5% +15.5% +0.9% +10.6% ➖ noise
25 datafusion:vortex-compact +13.5% +9.8% +3.4% +10.0% ➖ noise
25 datafusion:vortex-file-compressed +10.8% +9.8% +0.9% +10.0% ➖ noise
25 duckdb:duckdb +9.7% +9.8% -0.1% +10.7% ➖ noise
25 duckdb:vortex-compact +11.5% +9.8% +1.6% +10.0% ➖ noise
25 duckdb:vortex-file-compressed +11.6% +9.8% +1.6% +10.0% ➖ noise
26 datafusion:vortex-compact +10.5% +9.8% +0.6% +10.0% ➖ noise
26 datafusion:vortex-file-compressed +9.1% +9.8% -0.7% +11.8% ➖ noise
26 duckdb:duckdb +2.1% +9.8% -7.0% +16.3% ➖ noise
26 duckdb:vortex-compact +9.7% +9.8% -0.1% +13.0% ➖ noise
26 duckdb:vortex-file-compressed +8.6% +9.8% -1.1% +10.1% ➖ noise
27 datafusion:vortex-compact +16.5% +12.5% +3.6% +10.0% ➖ noise
27 datafusion:vortex-file-compressed +19.4% +12.5% +6.1% +10.9% ➖ noise
27 duckdb:duckdb +11.0% +12.5% -1.4% +19.7% ➖ noise
27 duckdb:vortex-compact +8.7% +12.5% -3.3% +11.4% ➖ noise
27 duckdb:vortex-file-compressed +6.5% +12.5% -5.3% +15.1% ➖ noise
28 datafusion:vortex-compact +8.1% +7.9% +0.2% +10.0% ➖ noise
28 datafusion:vortex-file-compressed +11.0% +7.9% +2.9% +10.0% ➖ noise
28 duckdb:duckdb +8.3% +7.9% +0.4% +10.0% ➖ noise
28 duckdb:vortex-compact +7.5% +7.9% -0.4% +10.0% ➖ noise
28 duckdb:vortex-file-compressed +3.4% +7.9% -4.2% +10.0% ➖ noise
29 datafusion:vortex-compact +10.9% +10.4% +0.4% +10.0% ➖ noise
29 datafusion:vortex-file-compressed +14.9% +10.4% +4.1% +10.0% ➖ noise
29 duckdb:duckdb +7.5% +10.4% -2.6% +10.0% ➖ noise
29 duckdb:vortex-compact +6.5% +10.4% -3.6% +10.0% ➖ noise
29 duckdb:vortex-file-compressed +12.6% +10.4% +2.0% +10.0% ➖ noise
30 datafusion:vortex-compact +11.7% +9.0% +2.6% +13.4% ➖ noise
30 datafusion:vortex-file-compressed +20.9% +9.0% +10.9% +10.0% 🚨 regression
30 duckdb:duckdb +17.9% +9.0% +8.2% +10.0% ➖ noise
30 duckdb:vortex-compact +10.0% +9.0% +0.9% +10.0% ➖ noise
30 duckdb:vortex-file-compressed +6.6% +9.0% -2.2% +14.9% ➖ noise
31 datafusion:vortex-compact +6.6% +4.5% +2.0% +10.0% ➖ noise
31 datafusion:vortex-file-compressed +12.9% +4.5% +8.0% +10.0% ➖ noise
31 duckdb:duckdb +7.4% +4.5% +2.8% +11.1% ➖ noise
31 duckdb:vortex-compact +12.0% +4.5% +7.1% +10.6% ➖ noise
31 duckdb:vortex-file-compressed +9.7% +4.5% +5.0% +18.1% ➖ noise
32 datafusion:vortex-compact +8.4% +18.8% -8.8% +10.0% ➖ noise
32 datafusion:vortex-file-compressed +15.9% +18.8% -2.4% +11.6% ➖ noise
32 duckdb:duckdb +19.5% +18.8% +0.6% +21.0% ➖ noise
32 duckdb:vortex-compact +17.1% +18.8% -1.4% +15.7% ➖ noise
32 duckdb:vortex-file-compressed +11.9% +18.8% -5.9% +10.0% ➖ noise
33 datafusion:vortex-compact +14.6% +7.6% +6.6% +10.0% ➖ noise
33 datafusion:vortex-file-compressed +17.0% +7.6% +8.7% +10.0% ➖ noise
33 duckdb:duckdb +10.7% +7.6% +2.9% +12.2% ➖ noise
33 duckdb:vortex-compact +5.6% +7.6% -1.8% +12.2% ➖ noise
33 duckdb:vortex-file-compressed +6.7% +7.6% -0.8% +10.0% ➖ noise
34 datafusion:vortex-compact +7.4% +10.3% -2.7% +10.0% ➖ noise
34 datafusion:vortex-file-compressed +14.7% +10.3% +3.9% +16.7% ➖ noise
34 duckdb:duckdb +9.9% +10.3% -0.4% +12.1% ➖ noise
34 duckdb:vortex-compact +10.5% +10.3% +0.2% +10.2% ➖ noise
34 duckdb:vortex-file-compressed +8.0% +10.3% -2.1% +10.0% ➖ noise
35 datafusion:vortex-compact +11.3% +8.8% +2.3% +11.3% ➖ noise
35 datafusion:vortex-file-compressed +14.8% +8.8% +5.5% +10.0% ➖ noise
35 duckdb:duckdb +17.4% +8.8% +7.9% +12.7% ➖ noise
35 duckdb:vortex-compact +9.7% +8.8% +0.8% +10.0% ➖ noise
35 duckdb:vortex-file-compressed +14.3% +8.8% +5.0% +14.0% ➖ noise
36 datafusion:vortex-compact +8.4% +11.2% -2.5% +10.0% ➖ noise
36 datafusion:vortex-file-compressed +16.1% +11.2% +4.4% +10.0% ➖ noise
36 duckdb:duckdb +7.6% +11.2% -3.2% +10.0% ➖ noise
36 duckdb:vortex-compact +8.3% +11.2% -2.6% +10.0% ➖ noise
36 duckdb:vortex-file-compressed +8.9% +11.2% -2.1% +10.0% ➖ noise
37 datafusion:vortex-compact +15.2% +10.3% +4.5% +11.6% ➖ noise
37 datafusion:vortex-file-compressed +7.7% +10.3% -2.3% +10.4% ➖ noise
37 duckdb:duckdb +4.3% +10.3% -5.5% +13.2% ➖ noise
37 duckdb:vortex-compact +13.2% +10.3% +2.6% +18.1% ➖ noise
37 duckdb:vortex-file-compressed +11.1% +10.3% +0.7% +10.9% ➖ noise
38 datafusion:vortex-compact +8.7% +12.5% -3.4% +12.8% ➖ noise
38 datafusion:vortex-file-compressed +4.8% +12.5% -6.9% +11.0% ➖ noise
38 duckdb:duckdb +9.1% +12.5% -3.1% +15.0% ➖ noise
38 duckdb:vortex-compact +4.5% +12.5% -7.2% +13.2% ➖ noise
38 duckdb:vortex-file-compressed +8.7% +12.5% -3.4% +15.2% ➖ noise
39 datafusion:vortex-compact +11.1% +11.7% -0.6% +10.0% ➖ noise
39 datafusion:vortex-file-compressed +16.4% +11.7% +4.2% +10.0% ➖ noise
39 duckdb:duckdb +6.3% +11.7% -4.8% +15.3% ➖ noise
39 duckdb:vortex-compact +3.2% +11.7% -7.6% +10.0% ➖ noise
39 duckdb:vortex-file-compressed +5.2% +11.7% -5.9% +10.0% ➖ noise
40 datafusion:vortex-compact +11.2% +8.2% +2.8% +10.0% ➖ noise
40 datafusion:vortex-file-compressed +8.7% +8.2% +0.5% +10.0% ➖ noise
40 duckdb:duckdb +6.3% +8.2% -1.8% +12.7% ➖ noise
40 duckdb:vortex-compact +14.5% +8.2% +5.9% +14.7% ➖ noise
40 duckdb:vortex-file-compressed +13.8% +8.2% +5.2% +10.9% ➖ noise
41 datafusion:vortex-compact +16.1% +9.7% +5.8% +10.0% ➖ noise
41 datafusion:vortex-file-compressed +16.6% +9.7% +6.3% +10.0% ➖ noise
41 duckdb:duckdb +16.2% +9.7% +6.0% +10.0% ➖ noise
41 duckdb:vortex-compact +12.8% +9.7% +2.9% +10.0% ➖ noise
41 duckdb:vortex-file-compressed +6.3% +9.7% -3.0% +10.0% ➖ noise
42 datafusion:vortex-compact +14.0% +10.6% +3.1% +15.2% ➖ noise
42 datafusion:vortex-file-compressed +18.5% +10.6% +7.2% +10.7% ➖ noise
42 duckdb:duckdb +14.8% +10.6% +3.8% +16.4% ➖ noise
42 duckdb:vortex-compact +8.0% +10.6% -2.3% +10.0% ➖ noise
42 duckdb:vortex-file-compressed +3.8% +10.6% -6.1% +10.4% ➖ noise
43 datafusion:vortex-compact +4.6% +3.3% +1.2% +10.0% ➖ noise
43 datafusion:vortex-file-compressed +6.2% +3.3% +2.8% +14.3% ➖ noise
43 duckdb:duckdb +11.1% +3.3% +7.5% +12.0% ➖ noise
43 duckdb:vortex-compact +8.1% +3.3% +4.6% +13.2% ➖ noise
43 duckdb:vortex-file-compressed +5.8% +3.3% +2.4% +20.9% ➖ noise
44 datafusion:vortex-compact +19.1% +5.0% +13.3% +10.0% 🚨 regression
44 datafusion:vortex-file-compressed +6.6% +5.0% +1.5% +12.2% ➖ noise
44 duckdb:duckdb +6.5% +5.0% +1.4% +14.3% ➖ noise
44 duckdb:vortex-compact +2.5% +5.0% -2.4% +15.9% ➖ noise
44 duckdb:vortex-file-compressed +6.5% +5.0% +1.4% +11.0% ➖ noise
45 datafusion:vortex-compact +5.0% +4.8% +0.2% +10.0% ➖ noise
45 datafusion:vortex-file-compressed +12.1% +4.8% +7.0% +10.0% ➖ noise
45 duckdb:duckdb +12.7% +4.8% +7.5% +14.8% ➖ noise
45 duckdb:vortex-compact +14.1% +4.8% +8.9% +10.0% ➖ noise
45 duckdb:vortex-file-compressed +15.2% +4.8% +10.0% +10.0% ➖ noise
46 datafusion:vortex-compact +5.8% +11.2% -4.9% +10.0% ➖ noise
46 datafusion:vortex-file-compressed +16.1% +11.2% +4.4% +10.0% ➖ noise
46 duckdb:duckdb +9.6% +11.2% -1.4% +10.0% ➖ noise
46 duckdb:vortex-compact +13.2% +11.2% +1.8% +10.0% ➖ noise
46 duckdb:vortex-file-compressed +6.5% +11.2% -4.2% +10.0% ➖ noise
47 datafusion:vortex-compact +11.5% +9.1% +2.2% +10.0% ➖ noise
47 datafusion:vortex-file-compressed +12.2% +9.1% +2.8% +10.0% ➖ noise
47 duckdb:duckdb +8.8% +9.1% -0.2% +10.0% ➖ noise
47 duckdb:vortex-compact +7.3% +9.1% -1.7% +10.0% ➖ noise
47 duckdb:vortex-file-compressed +11.8% +9.1% +2.5% +10.0% ➖ noise
48 datafusion:vortex-compact +3.6% +9.5% -5.4% +10.0% ➖ noise
48 datafusion:vortex-file-compressed +12.9% +9.5% +3.1% +10.0% ➖ noise
48 duckdb:duckdb +2.0% +9.5% -6.8% +10.4% ➖ noise
48 duckdb:vortex-compact +12.1% +9.5% +2.4% +10.0% ➖ noise
48 duckdb:vortex-file-compressed +10.6% +9.5% +1.0% +14.5% ➖ noise
49 datafusion:vortex-compact +11.4% +11.0% +0.4% +10.0% ➖ noise
49 datafusion:vortex-file-compressed +9.7% +11.0% -1.1% +10.0% ➖ noise
49 duckdb:duckdb +14.4% +11.0% +3.1% +17.1% ➖ noise
49 duckdb:vortex-compact +4.9% +11.0% -5.5% +14.6% ➖ noise
49 duckdb:vortex-file-compressed +3.1% +11.0% -7.1% +18.1% ➖ noise
50 datafusion:vortex-compact +13.7% +7.2% +6.1% +10.0% ➖ noise
50 datafusion:vortex-file-compressed +16.4% +7.2% +8.6% +14.6% ➖ noise
50 duckdb:duckdb +13.7% +7.2% +6.1% +10.0% ➖ noise
50 duckdb:vortex-compact +7.1% +7.2% -0.1% +10.0% ➖ noise
50 duckdb:vortex-file-compressed +8.9% +7.2% +1.6% +12.1% ➖ noise
51 datafusion:vortex-compact +1.4% +9.6% -7.5% +10.0% ➖ noise
51 datafusion:vortex-file-compressed +7.2% +9.6% -2.2% +10.0% ➖ noise
51 duckdb:duckdb +6.0% +9.6% -3.2% +22.2% ➖ noise
51 duckdb:vortex-compact +1.6% +9.6% -7.3% +17.3% ➖ noise
51 duckdb:vortex-file-compressed +5.8% +9.6% -3.4% +18.3% ➖ noise
52 datafusion:vortex-compact +4.7% +13.5% -7.8% +11.0% ➖ noise
52 datafusion:vortex-file-compressed +13.9% +13.5% +0.4% +12.8% ➖ noise
52 duckdb:duckdb +13.3% +13.5% -0.2% +18.1% ➖ noise
52 duckdb:vortex-compact +4.8% +13.5% -7.6% +10.0% ➖ noise
52 duckdb:vortex-file-compressed +2.0% +13.5% -10.1% +24.5% ➖ noise
53 datafusion:vortex-compact +14.5% +8.3% +5.7% +14.8% ➖ noise
53 datafusion:vortex-file-compressed +16.7% +8.3% +7.7% +10.0% ➖ noise
53 duckdb:duckdb +10.9% +8.3% +2.4% +10.0% ➖ noise
53 duckdb:vortex-compact +3.1% +8.3% -4.8% +10.0% ➖ noise
53 duckdb:vortex-file-compressed +12.0% +8.3% +3.4% +10.0% ➖ noise
54 datafusion:vortex-compact +7.6% +6.7% +0.9% +10.0% ➖ noise
54 datafusion:vortex-file-compressed +12.8% +6.7% +5.7% +10.0% ➖ noise
54 duckdb:duckdb +9.3% +6.7% +2.4% +13.4% ➖ noise
54 duckdb:vortex-compact +4.9% +6.7% -1.7% +15.2% ➖ noise
54 duckdb:vortex-file-compressed +4.9% +6.7% -1.7% +10.0% ➖ noise
55 datafusion:vortex-compact +7.3% +10.4% -2.8% +10.0% ➖ noise
55 datafusion:vortex-file-compressed +14.0% +10.4% +3.3% +12.4% ➖ noise
55 duckdb:duckdb +15.0% +10.4% +4.2% +14.5% ➖ noise
55 duckdb:vortex-compact +10.9% +10.4% +0.4% +10.3% ➖ noise
55 duckdb:vortex-file-compressed +13.0% +10.4% +2.4% +10.0% ➖ noise
56 datafusion:vortex-compact +10.5% +5.8% +4.5% +11.5% ➖ noise
56 datafusion:vortex-file-compressed +6.8% +5.8% +1.0% +11.3% ➖ noise
56 duckdb:duckdb +7.3% +5.8% +1.5% +10.8% ➖ noise
56 duckdb:vortex-compact +8.0% +5.8% +2.1% +12.4% ➖ noise
56 duckdb:vortex-file-compressed -2.0% +5.8% -7.4% +16.9% ➖ noise
57 datafusion:vortex-compact +12.6% +4.9% +7.4% +10.0% ➖ noise
57 datafusion:vortex-file-compressed +13.1% +4.9% +7.8% +10.0% ➖ noise
57 duckdb:duckdb +5.4% +4.9% +0.5% +10.0% ➖ noise
57 duckdb:vortex-compact +4.7% +4.9% -0.2% +10.5% ➖ noise
57 duckdb:vortex-file-compressed +12.2% +4.9% +7.0% +11.7% ➖ noise
58 datafusion:vortex-compact +6.4% +9.0% -2.3% +10.0% ➖ noise
58 datafusion:vortex-file-compressed +12.5% +9.0% +3.2% +10.0% ➖ noise
58 duckdb:duckdb +11.2% +9.0% +2.1% +15.6% ➖ noise
58 duckdb:vortex-compact +9.6% +9.0% +0.6% +17.0% ➖ noise
58 duckdb:vortex-file-compressed +4.6% +9.0% -4.0% +10.0% ➖ noise
59 datafusion:vortex-compact +3.0% +7.0% -3.7% +10.0% ➖ noise
59 datafusion:vortex-file-compressed +7.7% +7.0% +0.7% +10.0% ➖ noise
59 duckdb:duckdb +7.1% +7.0% +0.1% +10.0% ➖ noise
59 duckdb:vortex-compact +5.1% +7.0% -1.7% +23.5% ➖ noise
59 duckdb:vortex-file-compressed +3.5% +7.0% -3.2% +19.9% ➖ noise
60 datafusion:vortex-compact +7.3% +5.9% +1.3% +10.6% ➖ noise
60 datafusion:vortex-file-compressed +1.1% +5.9% -4.5% +10.8% ➖ noise
60 duckdb:duckdb +11.2% +5.9% +5.0% +11.8% ➖ noise
60 duckdb:vortex-compact +14.7% +5.9% +8.3% +15.7% ➖ noise
60 duckdb:vortex-file-compressed +18.3% +5.9% +11.7% +14.4% ➖ noise
61 datafusion:vortex-compact +12.2% +8.9% +3.1% +10.0% ➖ noise
61 datafusion:vortex-file-compressed +7.1% +8.9% -1.6% +10.0% ➖ noise
61 duckdb:duckdb +3.5% +8.9% -4.9% +10.0% ➖ noise
61 duckdb:vortex-compact +8.1% +8.9% -0.7% +11.9% ➖ noise
61 duckdb:vortex-file-compressed -4.0% +8.9% -11.8% +15.6% ➖ noise
62 datafusion:vortex-compact +21.1% +18.4% +2.3% +25.5% ➖ noise
62 datafusion:vortex-file-compressed +1.5% +18.4% -14.2% +18.6% ➖ noise
62 duckdb:duckdb +6.7% +18.4% -9.9% +17.8% ➖ noise
62 duckdb:vortex-compact +11.9% +18.4% -5.4% +19.5% ➖ noise
62 duckdb:vortex-file-compressed +3.0% +18.4% -13.0% +19.8% ➖ noise
63 datafusion:vortex-compact +6.6% +12.9% -5.5% +10.0% ➖ noise
63 datafusion:vortex-file-compressed +10.6% +12.9% -2.1% +12.2% ➖ noise
63 duckdb:duckdb +16.8% +12.9% +3.4% +10.0% ➖ noise
63 duckdb:vortex-compact +9.5% +12.9% -3.0% +17.6% ➖ noise
63 duckdb:vortex-file-compressed +4.0% +12.9% -7.9% +10.0% ➖ noise
64 datafusion:vortex-compact +12.6% +8.0% +4.2% +10.0% ➖ noise
64 datafusion:vortex-file-compressed +11.5% +8.0% +3.3% +10.0% ➖ noise
64 duckdb:duckdb +9.6% +8.0% +1.5% +10.0% ➖ noise
64 duckdb:vortex-compact +5.8% +8.0% -2.0% +13.5% ➖ noise
64 duckdb:vortex-file-compressed +5.1% +8.0% -2.7% +12.0% ➖ noise
65 datafusion:vortex-compact +6.5% +16.6% -8.7% +14.3% ➖ noise
65 datafusion:vortex-file-compressed +9.1% +16.6% -6.5% +10.0% ➖ noise
65 duckdb:duckdb +16.9% +16.6% +0.3% +15.7% ➖ noise
65 duckdb:vortex-compact +6.8% +16.6% -8.4% +11.2% ➖ noise
65 duckdb:vortex-file-compressed +15.3% +16.6% -1.2% +12.0% ➖ noise
66 datafusion:vortex-compact +9.5% +8.7% +0.7% +10.7% ➖ noise
66 datafusion:vortex-file-compressed +6.1% +8.7% -2.4% +12.4% ➖ noise
66 duckdb:duckdb +8.1% +8.7% -0.6% +11.8% ➖ noise
66 duckdb:vortex-compact +5.3% +8.7% -3.1% +12.4% ➖ noise
66 duckdb:vortex-file-compressed +9.6% +8.7% +0.8% +14.3% ➖ noise
67 datafusion:vortex-compact +10.5% +14.8% -3.8% +10.1% ➖ noise
67 datafusion:vortex-file-compressed +13.5% +14.8% -1.1% +10.7% ➖ noise
67 duckdb:duckdb +7.4% +14.8% -6.4% +10.0% ➖ noise
67 duckdb:vortex-compact +8.1% +14.8% -5.9% +10.0% ➖ noise
67 duckdb:vortex-file-compressed +13.7% +14.8% -1.0% +10.0% ➖ noise
68 datafusion:vortex-compact +12.7% +7.6% +4.7% +12.7% ➖ noise
68 datafusion:vortex-file-compressed +9.5% +7.6% +1.7% +18.3% ➖ noise
68 duckdb:duckdb +5.2% +7.6% -2.2% +10.0% ➖ noise
68 duckdb:vortex-compact +9.1% +7.6% +1.4% +10.0% ➖ noise
68 duckdb:vortex-file-compressed +5.4% +7.6% -2.1% +10.0% ➖ noise
69 datafusion:vortex-compact +5.0% +5.2% -0.2% +10.0% ➖ noise
69 datafusion:vortex-file-compressed +16.7% +5.2% +10.9% +10.4% 🚨 regression
69 duckdb:duckdb +2.0% +5.2% -3.1% +10.0% ➖ noise
69 duckdb:vortex-compact +6.1% +5.2% +0.8% +10.0% ➖ noise
69 duckdb:vortex-file-compressed +11.7% +5.2% +6.1% +10.0% ➖ noise
70 datafusion:vortex-compact +12.7% +9.6% +2.8% +10.6% ➖ noise
70 datafusion:vortex-file-compressed +8.8% +9.6% -0.8% +10.1% ➖ noise
70 duckdb:duckdb +10.0% +9.6% +0.4% +11.7% ➖ noise
70 duckdb:vortex-compact +4.9% +9.6% -4.3% +10.0% ➖ noise
70 duckdb:vortex-file-compressed +18.3% +9.6% +8.0% +15.5% ➖ noise
71 datafusion:vortex-compact +10.5% +5.1% +5.1% +10.4% ➖ noise
71 datafusion:vortex-file-compressed +12.7% +5.1% +7.3% +10.0% ➖ noise
71 duckdb:duckdb +15.0% +5.1% +9.4% +14.1% ➖ noise
71 duckdb:vortex-compact +8.3% +5.1% +3.0% +11.1% ➖ noise
71 duckdb:vortex-file-compressed +19.0% +5.1% +13.2% +12.0% 🚨 regression
72 datafusion:vortex-compact +23.1% +8.1% +14.0% +10.0% 🚨 regression
72 datafusion:vortex-file-compressed +20.0% +8.1% +11.1% +10.0% 🚨 regression
72 duckdb:duckdb +4.8% +8.1% -3.0% +10.8% ➖ noise
72 duckdb:vortex-compact +3.1% +8.1% -4.5% +10.0% ➖ noise
72 duckdb:vortex-file-compressed +2.8% +8.1% -4.8% +10.0% ➖ noise
73 datafusion:vortex-compact +3.5% +9.9% -5.9% +15.5% ➖ noise
73 datafusion:vortex-file-compressed +13.3% +9.9% +3.1% +10.0% ➖ noise
73 duckdb:duckdb +12.9% +9.9% +2.7% +10.9% ➖ noise
73 duckdb:vortex-compact -2.6% +9.9% -11.4% +14.0% ➖ noise
73 duckdb:vortex-file-compressed +10.5% +9.9% +0.5% +15.8% ➖ noise
74 datafusion:vortex-compact +6.8% +5.4% +1.3% +10.0% ➖ noise
74 datafusion:vortex-file-compressed +6.4% +5.4% +1.0% +10.0% ➖ noise
74 duckdb:duckdb +7.2% +5.4% +1.7% +10.0% ➖ noise
74 duckdb:vortex-compact -8.9% +5.4% -13.6% +14.0% ✅ faster
74 duckdb:vortex-file-compressed +35.4% +5.4% +28.5% +25.9% 🚨 regression
75 datafusion:vortex-compact +7.3% +9.2% -1.7% +10.8% ➖ noise
75 datafusion:vortex-file-compressed +10.7% +9.2% +1.3% +10.0% ➖ noise
75 duckdb:duckdb +5.6% +9.2% -3.3% +12.9% ➖ noise
75 duckdb:vortex-compact +4.0% +9.2% -4.8% +12.4% ➖ noise
75 duckdb:vortex-file-compressed +11.2% +9.2% +1.8% +10.0% ➖ noise
76 datafusion:vortex-compact +8.4% +9.3% -0.8% +10.6% ➖ noise
76 datafusion:vortex-file-compressed +9.2% +9.3% -0.2% +10.0% ➖ noise
76 duckdb:duckdb +10.4% +9.3% +1.0% +17.4% ➖ noise
76 duckdb:vortex-compact +12.8% +9.3% +3.1% +10.0% ➖ noise
76 duckdb:vortex-file-compressed -1.7% +9.3% -10.1% +18.0% ➖ noise
77 datafusion:vortex-compact +11.8% +7.7% +3.8% +12.4% ➖ noise
77 datafusion:vortex-file-compressed +9.2% +7.7% +1.3% +10.0% ➖ noise
77 duckdb:duckdb +12.7% +7.7% +4.6% +19.4% ➖ noise
77 duckdb:vortex-compact +2.3% +7.7% -5.0% +10.0% ➖ noise
77 duckdb:vortex-file-compressed +13.2% +7.7% +5.1% +14.4% ➖ noise
78 datafusion:vortex-compact +14.6% +13.9% +0.6% +10.0% ➖ noise
78 datafusion:vortex-file-compressed +15.2% +13.9% +1.2% +10.0% ➖ noise
78 duckdb:duckdb +10.1% +13.9% -3.4% +10.0% ➖ noise
78 duckdb:vortex-compact +7.8% +13.9% -5.3% +13.5% ➖ noise
78 duckdb:vortex-file-compressed +5.0% +13.9% -7.8% +10.0% ➖ noise
79 datafusion:vortex-compact +9.0% +7.8% +1.1% +12.2% ➖ noise
79 datafusion:vortex-file-compressed +13.5% +7.8% +5.3% +10.0% ➖ noise
79 duckdb:duckdb +7.9% +7.8% +0.1% +15.1% ➖ noise
79 duckdb:vortex-compact +0.9% +7.8% -6.4% +10.1% ➖ noise
79 duckdb:vortex-file-compressed +13.0% +7.8% +4.9% +27.5% ➖ noise
80 datafusion:vortex-compact +16.0% +9.7% +5.7% +10.0% ➖ noise
80 datafusion:vortex-file-compressed +13.4% +9.7% +3.4% +10.0% ➖ noise
80 duckdb:duckdb +7.9% +9.7% -1.6% +14.4% ➖ noise
80 duckdb:vortex-compact +8.8% +9.7% -0.8% +10.0% ➖ noise
80 duckdb:vortex-file-compressed +16.7% +9.7% +6.5% +17.7% ➖ noise
81 datafusion:vortex-compact +8.1% +8.9% -0.8% +10.0% ➖ noise
81 datafusion:vortex-file-compressed +14.1% +8.9% +4.7% +10.0% ➖ noise
81 duckdb:duckdb +5.3% +8.9% -3.3% +10.2% ➖ noise
81 duckdb:vortex-compact +10.0% +8.9% +1.0% +10.0% ➖ noise
81 duckdb:vortex-file-compressed +12.7% +8.9% +3.4% +10.0% ➖ noise
82 datafusion:vortex-compact +7.8% +11.2% -3.0% +10.0% ➖ noise
82 datafusion:vortex-file-compressed +19.0% +11.2% +7.0% +12.1% ➖ noise
82 duckdb:duckdb +20.1% +11.2% +8.1% +11.2% ➖ noise
82 duckdb:vortex-compact +5.8% +11.2% -4.8% +10.0% ➖ noise
82 duckdb:vortex-file-compressed +16.3% +11.2% +4.6% +10.0% ➖ noise
83 datafusion:vortex-compact +17.6% +8.7% +8.2% +12.1% ➖ noise
83 datafusion:vortex-file-compressed +17.3% +8.7% +7.9% +10.3% ➖ noise
83 duckdb:duckdb +12.1% +8.7% +3.0% +11.8% ➖ noise
83 duckdb:vortex-compact +13.3% +8.7% +4.1% +16.7% ➖ noise
83 duckdb:vortex-file-compressed +15.2% +8.7% +5.9% +17.2% ➖ noise
84 datafusion:vortex-compact +10.5% +10.9% -0.4% +11.4% ➖ noise
84 datafusion:vortex-file-compressed +15.8% +10.9% +4.4% +10.0% ➖ noise
84 duckdb:duckdb +26.3% +10.9% +13.9% +13.7% 🚨 regression
84 duckdb:vortex-compact +14.8% +10.9% +3.5% +10.0% ➖ noise
84 duckdb:vortex-file-compressed +19.8% +10.9% +8.0% +10.0% ➖ noise
85 datafusion:vortex-compact +7.5% +7.1% +0.3% +10.0% ➖ noise
85 datafusion:vortex-file-compressed +7.0% +7.1% -0.1% +10.0% ➖ noise
85 duckdb:duckdb +15.8% +7.1% +8.1% +11.8% ➖ noise
85 duckdb:vortex-compact +14.1% +7.1% +6.5% +13.4% ➖ noise
85 duckdb:vortex-file-compressed +12.1% +7.1% +4.6% +10.0% ➖ noise
86 datafusion:vortex-compact +17.1% +9.9% +6.5% +17.1% ➖ noise
86 datafusion:vortex-file-compressed +18.7% +9.9% +8.0% +19.0% ➖ noise
86 duckdb:duckdb +9.8% +9.9% -0.1% +12.9% ➖ noise
86 duckdb:vortex-compact +5.6% +9.9% -3.9% +18.2% ➖ noise
86 duckdb:vortex-file-compressed +11.2% +9.9% +1.1% +13.2% ➖ noise
87 datafusion:vortex-compact +10.2% +9.5% +0.6% +12.6% ➖ noise
87 datafusion:vortex-file-compressed +18.5% +9.5% +8.1% +10.0% ➖ noise
87 duckdb:duckdb +9.1% +9.5% -0.4% +12.4% ➖ noise
87 duckdb:vortex-compact +3.3% +9.5% -5.7% +10.6% ➖ noise
87 duckdb:vortex-file-compressed +18.2% +9.5% +7.9% +10.0% ➖ noise
88 datafusion:vortex-compact +3.0% +6.8% -3.6% +10.0% ➖ noise
88 datafusion:vortex-file-compressed +18.3% +6.8% +10.8% +11.4% ➖ noise
88 duckdb:duckdb +6.7% +6.8% -0.1% +10.0% ➖ noise
88 duckdb:vortex-compact +7.8% +6.8% +1.0% +10.0% ➖ noise
88 duckdb:vortex-file-compressed +5.8% +6.8% -0.9% +10.0% ➖ noise
89 datafusion:vortex-compact +5.8% +8.9% -2.8% +10.0% ➖ noise
89 datafusion:vortex-file-compressed +14.6% +8.9% +5.3% +10.0% ➖ noise
89 duckdb:duckdb +5.7% +8.9% -2.9% +10.0% ➖ noise
89 duckdb:vortex-compact +3.7% +8.9% -4.8% +11.5% ➖ noise
89 duckdb:vortex-file-compressed +6.5% +8.9% -2.2% +10.0% ➖ noise
90 datafusion:vortex-compact +12.8% +17.7% -4.2% +16.6% ➖ noise
90 datafusion:vortex-file-compressed +10.8% +17.7% -5.9% +10.0% ➖ noise
90 duckdb:duckdb +14.9% +17.7% -2.4% +11.5% ➖ noise
90 duckdb:vortex-compact +7.5% +17.7% -8.6% +16.0% ➖ noise
90 duckdb:vortex-file-compressed +9.4% +17.7% -7.1% +10.0% ➖ noise
91 datafusion:vortex-compact +11.6% +8.2% +3.1% +10.1% ➖ noise
91 datafusion:vortex-file-compressed +17.9% +8.2% +8.9% +10.0% ➖ noise
91 duckdb:duckdb +7.4% +8.2% -0.7% +12.4% ➖ noise
91 duckdb:vortex-compact +4.9% +8.2% -3.1% +10.0% ➖ noise
91 duckdb:vortex-file-compressed +19.1% +8.2% +10.0% +10.0% 🚨 regression
92 datafusion:vortex-compact +6.6% +8.4% -1.6% +11.9% ➖ noise
92 datafusion:vortex-file-compressed +11.7% +8.4% +3.1% +17.0% ➖ noise
92 duckdb:duckdb +18.1% +8.4% +9.0% +10.0% ➖ noise
92 duckdb:vortex-compact -6.6% +8.4% -13.8% +18.0% ➖ noise
92 duckdb:vortex-file-compressed +4.4% +8.4% -3.7% +17.6% ➖ noise
93 datafusion:vortex-compact +9.5% +21.7% -10.0% +10.0% ✅ faster
93 datafusion:vortex-file-compressed +14.7% +21.7% -5.7% +14.6% ➖ noise
93 duckdb:duckdb +19.7% +21.7% -1.6% +13.3% ➖ noise
93 duckdb:vortex-compact +8.2% +21.7% -11.1% +14.5% ➖ noise
93 duckdb:vortex-file-compressed +17.7% +21.7% -3.2% +10.2% ➖ noise
94 datafusion:vortex-compact +7.3% +8.7% -1.3% +15.2% ➖ noise
94 datafusion:vortex-file-compressed +22.1% +8.7% +12.4% +18.5% ➖ noise
94 duckdb:duckdb +3.5% +8.7% -4.8% +13.1% ➖ noise
94 duckdb:vortex-compact +1.6% +8.7% -6.5% +14.5% ➖ noise
94 duckdb:vortex-file-compressed +10.4% +8.7% +1.6% +10.0% ➖ noise
95 datafusion:vortex-compact +9.0% +8.0% +0.9% +15.5% ➖ noise
95 datafusion:vortex-file-compressed +17.0% +8.0% +8.3% +14.4% ➖ noise
95 duckdb:duckdb +8.6% +8.0% +0.6% +18.0% ➖ noise
95 duckdb:vortex-compact +1.2% +8.0% -6.3% +17.8% ➖ noise
95 duckdb:vortex-file-compressed +5.7% +8.0% -2.1% +20.4% ➖ noise
96 datafusion:vortex-compact +9.8% +4.6% +5.0% +16.4% ➖ noise
96 datafusion:vortex-file-compressed +12.9% +4.6% +7.9% +12.7% ➖ noise
96 duckdb:duckdb +27.1% +4.6% +21.5% +18.8% 🚨 regression
96 duckdb:vortex-compact +5.9% +4.6% +1.2% +13.7% ➖ noise
96 duckdb:vortex-file-compressed +16.3% +4.6% +11.2% +13.1% ➖ noise
97 datafusion:vortex-compact +8.1% +6.5% +1.6% +12.0% ➖ noise
97 datafusion:vortex-file-compressed +13.8% +6.5% +6.9% +10.0% ➖ noise
97 duckdb:duckdb +16.1% +6.5% +9.1% +14.0% ➖ noise
97 duckdb:vortex-compact +7.3% +6.5% +0.8% +15.1% ➖ noise
97 duckdb:vortex-file-compressed +13.1% +6.5% +6.2% +11.1% ➖ noise
98 datafusion:vortex-compact +14.1% +7.5% +6.1% +10.0% ➖ noise
98 datafusion:vortex-file-compressed +9.8% +7.5% +2.1% +15.8% ➖ noise
98 duckdb:duckdb +7.3% +7.5% -0.3% +12.8% ➖ noise
98 duckdb:vortex-compact +15.6% +7.5% +7.5% +10.2% ➖ noise
98 duckdb:vortex-file-compressed +9.5% +7.5% +1.8% +10.7% ➖ noise
99 datafusion:vortex-compact +6.4% +25.8% -15.4% +15.3% ✅ faster
99 datafusion:vortex-file-compressed +12.2% +25.8% -10.7% +16.8% ➖ noise
99 duckdb:duckdb +3.9% +25.8% -17.4% +10.5% ✅ faster
99 duckdb:vortex-compact -5.5% +25.8% -24.8% +22.9% ✅ faster
99 duckdb:vortex-file-compressed +4.0% +25.8% -17.3% +12.4% ✅ faster

@github-actions
Copy link
Copy Markdown
Contributor

github-actions Bot commented Apr 28, 2026

Benchmarks: TPC-H SF=1 on S3

Verdict: No clear signal (environment too noisy confidence)
Attributed Vortex impact: -10.3%
Vortex (geomean): 0.918x ➖
Parquet (geomean): 1.024x ➖
Shifts: Parquet (control) +2.4% · Median polish -6.5%


datafusion / vortex-file-compressed (0.862x ➖, 3↑ 1↓)
name PR f8096d6 (ns) base 2db4ab1 (ns) ratio (PR/base)
tpch_q01/datafusion:vortex-file-compressed 246199542 284943772 0.86
tpch_q02/datafusion:vortex-file-compressed 456764305 615932333 0.74
tpch_q03/datafusion:vortex-file-compressed 🚀 517896855 822319870 0.63
tpch_q04/datafusion:vortex-file-compressed 🚀 252035523 453009533 0.56
tpch_q05/datafusion:vortex-file-compressed 🚀 431674702 885645399 0.49
tpch_q06/datafusion:vortex-file-compressed 374319879 375442135 1.00
tpch_q07/datafusion:vortex-file-compressed 453199263 447037686 1.01
tpch_q08/datafusion:vortex-file-compressed 595590296 608681657 0.98
tpch_q09/datafusion:vortex-file-compressed 449175386 510432047 0.88
tpch_q10/datafusion:vortex-file-compressed 546314383 621201319 0.88
tpch_q11/datafusion:vortex-file-compressed 285884607 390562066 0.73
tpch_q12/datafusion:vortex-file-compressed 485514125 564699885 0.86
tpch_q13/datafusion:vortex-file-compressed 🚨 275094597 144921475 1.90
tpch_q14/datafusion:vortex-file-compressed 310791815 279272406 1.11
tpch_q15/datafusion:vortex-file-compressed 476194168 505782518 0.94
tpch_q16/datafusion:vortex-file-compressed 196238110 214594093 0.91
tpch_q17/datafusion:vortex-file-compressed 358578496 398661030 0.90
tpch_q18/datafusion:vortex-file-compressed 348646988 477050578 0.73
tpch_q19/datafusion:vortex-file-compressed 467632023 557021427 0.84
tpch_q20/datafusion:vortex-file-compressed 467518726 529156078 0.88
tpch_q21/datafusion:vortex-file-compressed 605814227 676551651 0.90
tpch_q22/datafusion:vortex-file-compressed 147863514 160645312 0.92
datafusion / vortex-compact (0.896x ➖, 2↑ 0↓)
name PR f8096d6 (ns) base 2db4ab1 (ns) ratio (PR/base)
tpch_q01/datafusion:vortex-compact 273866379 319896966 0.86
tpch_q02/datafusion:vortex-compact 415581504 448607530 0.93
tpch_q03/datafusion:vortex-compact 442926852 412251084 1.07
tpch_q04/datafusion:vortex-compact 🚀 223427819 364021315 0.61
tpch_q05/datafusion:vortex-compact 392162861 418497710 0.94
tpch_q06/datafusion:vortex-compact 359650278 511837547 0.70
tpch_q07/datafusion:vortex-compact 401076759 419482546 0.96
tpch_q08/datafusion:vortex-compact 536830680 672889906 0.80
tpch_q09/datafusion:vortex-compact 360495009 494930924 0.73
tpch_q10/datafusion:vortex-compact 🚀 441120054 647500791 0.68
tpch_q11/datafusion:vortex-compact 277185445 306721463 0.90
tpch_q12/datafusion:vortex-compact 545802583 509281961 1.07
tpch_q13/datafusion:vortex-compact 133447403 183037863 0.73
tpch_q14/datafusion:vortex-compact 260804236 324235636 0.80
tpch_q15/datafusion:vortex-compact 442238208 536081427 0.82
tpch_q16/datafusion:vortex-compact 180398815 194522256 0.93
tpch_q17/datafusion:vortex-compact 417285224 385903018 1.08
tpch_q18/datafusion:vortex-compact 356885182 327545410 1.09
tpch_q19/datafusion:vortex-compact 542652039 527182168 1.03
tpch_q20/datafusion:vortex-compact 532767945 488993859 1.09
tpch_q21/datafusion:vortex-compact 602950318 570463357 1.06
tpch_q22/datafusion:vortex-compact 146864225 129641140 1.13
datafusion / parquet (1.117x ➖, 0↑ 5↓)
name PR f8096d6 (ns) base 2db4ab1 (ns) ratio (PR/base)
tpch_q01/datafusion:parquet 233807901 227036206 1.03
tpch_q02/datafusion:parquet 501185003 540180305 0.93
tpch_q03/datafusion:parquet 350392659 353239964 0.99
tpch_q04/datafusion:parquet 169298782 190249795 0.89
tpch_q05/datafusion:parquet 619205834 524443857 1.18
tpch_q06/datafusion:parquet 169962633 163203074 1.04
tpch_q07/datafusion:parquet 597905879 472771881 1.26
tpch_q08/datafusion:parquet 🚨 757772580 556225665 1.36
tpch_q09/datafusion:parquet 511437796 458847835 1.11
tpch_q10/datafusion:parquet 🚨 807880199 539295614 1.50
tpch_q11/datafusion:parquet 348782841 334270028 1.04
tpch_q12/datafusion:parquet 250945595 229514987 1.09
tpch_q13/datafusion:parquet 430798693 423421192 1.02
tpch_q14/datafusion:parquet 177760170 163502039 1.09
tpch_q15/datafusion:parquet 306664618 315238955 0.97
tpch_q16/datafusion:parquet 178492249 168739341 1.06
tpch_q17/datafusion:parquet 445308758 373474298 1.19
tpch_q18/datafusion:parquet 🚨 667930174 448624345 1.49
tpch_q19/datafusion:parquet 🚨 530632845 331370851 1.60
tpch_q20/datafusion:parquet 🚨 483160181 346742629 1.39
tpch_q21/datafusion:parquet 628354307 811599046 0.77
tpch_q22/datafusion:parquet 155699330 161142739 0.97
duckdb / vortex-file-compressed (0.944x ➖, 0↑ 0↓)
name PR f8096d6 (ns) base 2db4ab1 (ns) ratio (PR/base)
tpch_q01/duckdb:vortex-file-compressed 295507511 270103035 1.09
tpch_q02/duckdb:vortex-file-compressed 957528394 984924805 0.97
tpch_q03/duckdb:vortex-file-compressed 666378599 668743316 1.00
tpch_q04/duckdb:vortex-file-compressed 414780936 436083899 0.95
tpch_q05/duckdb:vortex-file-compressed 952509053 988516053 0.96
tpch_q06/duckdb:vortex-file-compressed 393869587 439193535 0.90
tpch_q07/duckdb:vortex-file-compressed 869527817 820082471 1.06
tpch_q08/duckdb:vortex-file-compressed 935502532 1081830918 0.86
tpch_q09/duckdb:vortex-file-compressed 855910764 914920014 0.94
tpch_q10/duckdb:vortex-file-compressed 731089471 790724966 0.92
tpch_q11/duckdb:vortex-file-compressed 480165044 524583756 0.92
tpch_q12/duckdb:vortex-file-compressed 489330618 537926295 0.91
tpch_q13/duckdb:vortex-file-compressed 480486848 492975679 0.97
tpch_q14/duckdb:vortex-file-compressed 483944667 522279719 0.93
tpch_q15/duckdb:vortex-file-compressed 282928681 316602729 0.89
tpch_q16/duckdb:vortex-file-compressed 358665953 412391597 0.87
tpch_q17/duckdb:vortex-file-compressed 732103997 746741632 0.98
tpch_q18/duckdb:vortex-file-compressed 523369718 587200843 0.89
tpch_q19/duckdb:vortex-file-compressed 459483584 477545631 0.96
tpch_q20/duckdb:vortex-file-compressed 821665344 930636090 0.88
tpch_q21/duckdb:vortex-file-compressed 1060515346 1155852171 0.92
tpch_q22/duckdb:vortex-file-compressed 394480348 383260457 1.03
duckdb / vortex-compact (0.972x ➖, 0↑ 0↓)
name PR f8096d6 (ns) base 2db4ab1 (ns) ratio (PR/base)
tpch_q01/duckdb:vortex-compact 280316968 278539678 1.01
tpch_q02/duckdb:vortex-compact 894310125 947507005 0.94
tpch_q03/duckdb:vortex-compact 645281450 636737163 1.01
tpch_q04/duckdb:vortex-compact 334379174 389067768 0.86
tpch_q05/duckdb:vortex-compact 832542079 940921418 0.88
tpch_q06/duckdb:vortex-compact 414235837 421111950 0.98
tpch_q07/duckdb:vortex-compact 788385588 819463623 0.96
tpch_q08/duckdb:vortex-compact 957105198 1037296303 0.92
tpch_q09/duckdb:vortex-compact 901286103 944533178 0.95
tpch_q10/duckdb:vortex-compact 755910320 799527261 0.95
tpch_q11/duckdb:vortex-compact 487081070 529953278 0.92
tpch_q12/duckdb:vortex-compact 534016520 461508341 1.16
tpch_q13/duckdb:vortex-compact 448100850 459242560 0.98
tpch_q14/duckdb:vortex-compact 450800587 497173683 0.91
tpch_q15/duckdb:vortex-compact 296230154 301652623 0.98
tpch_q16/duckdb:vortex-compact 415379089 388158969 1.07
tpch_q17/duckdb:vortex-compact 622392071 668701576 0.93
tpch_q18/duckdb:vortex-compact 498976258 514522430 0.97
tpch_q19/duckdb:vortex-compact 493482145 488073623 1.01
tpch_q20/duckdb:vortex-compact 770586894 756613058 1.02
tpch_q21/duckdb:vortex-compact 1076878596 1143137601 0.94
tpch_q22/duckdb:vortex-compact 363812807 337774515 1.08
duckdb / parquet (0.938x ➖, 0↑ 0↓)
name PR f8096d6 (ns) base 2db4ab1 (ns) ratio (PR/base)
tpch_q01/duckdb:parquet 467972365 465831802 1.00
tpch_q02/duckdb:parquet 1153371854 1378243142 0.84
tpch_q03/duckdb:parquet 1005856353 1078689408 0.93
tpch_q04/duckdb:parquet 670490181 650346915 1.03
tpch_q05/duckdb:parquet 1506775227 1593616455 0.95
tpch_q06/duckdb:parquet 477370414 425147563 1.12
tpch_q07/duckdb:parquet 1276240465 1423527993 0.90
tpch_q08/duckdb:parquet 1666559254 1851852675 0.90
tpch_q09/duckdb:parquet 1461743485 1509626093 0.97
tpch_q10/duckdb:parquet 1154168188 1326655044 0.87
tpch_q11/duckdb:parquet 862317117 845274772 1.02
tpch_q12/duckdb:parquet 672732014 813263172 0.83
tpch_q13/duckdb:parquet 886051944 932313482 0.95
tpch_q14/duckdb:parquet 640317324 700675243 0.91
tpch_q15/duckdb:parquet 508988491 551382498 0.92
tpch_q16/duckdb:parquet 595448333 668004925 0.89
tpch_q17/duckdb:parquet 726477704 784203801 0.93
tpch_q18/duckdb:parquet 850732715 955755331 0.89
tpch_q19/duckdb:parquet 784128019 777247059 1.01
tpch_q20/duckdb:parquet 1133908708 1091590966 1.04
tpch_q21/duckdb:parquet 1123731265 1199601723 0.94
tpch_q22/duckdb:parquet 531443169 623289233 0.85
Full attributed analysis
Query Config Raw Δ Control Δ Attributed α Noise floor Significant?
1 datafusion:vortex-compact -14.4% +1.7% -15.8% +77.6% ➖ noise
1 datafusion:vortex-file-compressed -13.6% +1.7% -15.1% +70.5% ➖ noise
1 duckdb:vortex-compact +0.6% +1.7% -1.1% +49.6% ➖ noise
1 duckdb:vortex-file-compressed +9.4% +1.7% +7.6% +58.0% ➖ noise
2 datafusion:vortex-compact -7.4% -11.9% +5.1% +30.0% ➖ noise
2 datafusion:vortex-file-compressed -25.8% -11.9% -15.8% +31.0% ➖ noise
2 duckdb:vortex-compact -5.6% -11.9% +7.1% +30.0% ➖ noise
2 duckdb:vortex-file-compressed -2.8% -11.9% +10.3% +30.0% ➖ noise
3 datafusion:vortex-compact +7.4% -3.8% +11.7% +51.3% ➖ noise
3 datafusion:vortex-file-compressed -37.0% -3.8% -34.5% +61.1% ➖ noise
3 duckdb:vortex-compact +1.3% -3.8% +5.4% +30.0% ➖ noise
3 duckdb:vortex-file-compressed -0.4% -3.8% +3.6% +46.9% ➖ noise
4 datafusion:vortex-compact -38.6% -4.2% -35.9% +42.2% ✅ faster
4 datafusion:vortex-file-compressed -44.4% -4.2% -41.9% +36.5% ✅ faster
4 duckdb:vortex-compact -14.1% -4.2% -10.3% +30.0% ➖ noise
4 duckdb:vortex-file-compressed -4.9% -4.2% -0.7% +30.0% ➖ noise
5 datafusion:vortex-compact -6.3% +5.7% -11.3% +30.0% ➖ noise
5 datafusion:vortex-file-compressed -51.3% +5.7% -53.9% +30.0% ✅ faster
5 duckdb:vortex-compact -11.5% +5.7% -16.3% +30.0% ➖ noise
5 duckdb:vortex-file-compressed -3.6% +5.7% -8.8% +30.0% ➖ noise
6 datafusion:vortex-compact -29.7% +8.1% -35.0% +39.6% ✅ faster
6 datafusion:vortex-file-compressed -0.3% +8.1% -7.8% +31.5% ➖ noise
6 duckdb:vortex-compact -1.6% +8.1% -9.0% +30.0% ➖ noise
6 duckdb:vortex-file-compressed -10.3% +8.1% -17.1% +30.0% ➖ noise
7 datafusion:vortex-compact -4.4% +6.5% -10.2% +30.0% ➖ noise
7 datafusion:vortex-file-compressed +1.4% +6.5% -4.8% +30.0% ➖ noise
7 duckdb:vortex-compact -3.8% +6.5% -9.6% +30.0% ➖ noise
7 duckdb:vortex-file-compressed +6.0% +6.5% -0.4% +30.0% ➖ noise
8 datafusion:vortex-compact -20.2% +10.7% -27.9% +30.0% ✅ faster
8 datafusion:vortex-file-compressed -2.2% +10.7% -11.6% +30.1% ➖ noise
8 duckdb:vortex-compact -7.7% +10.7% -16.7% +30.0% ➖ noise
8 duckdb:vortex-file-compressed -13.5% +10.7% -21.9% +30.0% ➖ noise
9 datafusion:vortex-compact -27.2% +3.9% -29.9% +30.0% ✅ faster
9 datafusion:vortex-file-compressed -12.0% +3.9% -15.3% +30.0% ➖ noise
9 duckdb:vortex-compact -4.6% +3.9% -8.1% +30.0% ➖ noise
9 duckdb:vortex-file-compressed -6.4% +3.9% -10.0% +30.0% ➖ noise
10 datafusion:vortex-compact -31.9% +14.2% -40.3% +30.0% ✅ faster
10 datafusion:vortex-file-compressed -12.1% +14.2% -23.0% +30.0% ➖ noise
10 duckdb:vortex-compact -5.5% +14.2% -17.2% +30.0% ➖ noise
10 duckdb:vortex-file-compressed -7.5% +14.2% -19.0% +30.0% ➖ noise
11 datafusion:vortex-compact -9.6% +3.2% -12.4% +35.3% ➖ noise
11 datafusion:vortex-file-compressed -26.8% +3.2% -29.1% +30.0% ✅ faster
11 duckdb:vortex-compact -8.1% +3.2% -10.9% +30.0% ➖ noise
11 duckdb:vortex-file-compressed -8.5% +3.2% -11.3% +30.0% ➖ noise
12 datafusion:vortex-compact +7.2% -4.9% +12.7% +33.9% ➖ noise
12 datafusion:vortex-file-compressed -14.0% -4.9% -9.6% +30.0% ➖ noise
12 duckdb:vortex-compact +15.7% -4.9% +21.7% +30.0% ➖ noise
12 duckdb:vortex-file-compressed -9.0% -4.9% -4.3% +30.0% ➖ noise
13 datafusion:vortex-compact -27.1% -1.7% -25.9% +67.4% ➖ noise
13 datafusion:vortex-file-compressed +89.8% -1.7% +93.0% +73.4% 🚨 regression
13 duckdb:vortex-compact -2.4% -1.7% -0.8% +45.7% ➖ noise
13 duckdb:vortex-file-compressed -2.5% -1.7% -0.9% +30.6% ➖ noise
14 datafusion:vortex-compact -19.6% -0.3% -19.3% +30.0% ➖ noise
14 datafusion:vortex-file-compressed +11.3% -0.3% +11.6% +30.0% ➖ noise
14 duckdb:vortex-compact -9.3% -0.3% -9.0% +30.0% ➖ noise
14 duckdb:vortex-file-compressed -7.3% -0.3% -7.0% +30.0% ➖ noise
15 datafusion:vortex-compact -17.5% -5.2% -12.9% +30.0% ➖ noise
15 datafusion:vortex-file-compressed -5.9% -5.2% -0.6% +30.0% ➖ noise
15 duckdb:vortex-compact -1.8% -5.2% +3.6% +30.0% ➖ noise
15 duckdb:vortex-file-compressed -10.6% -5.2% -5.7% +30.0% ➖ noise
16 datafusion:vortex-compact -7.3% -2.9% -4.5% +30.0% ➖ noise
16 datafusion:vortex-file-compressed -8.6% -2.9% -5.8% +34.6% ➖ noise
16 duckdb:vortex-compact +7.0% -2.9% +10.2% +30.0% ➖ noise
16 duckdb:vortex-file-compressed -13.0% -2.9% -10.4% +30.0% ➖ noise
17 datafusion:vortex-compact +8.1% +5.1% +2.9% +30.0% ➖ noise
17 datafusion:vortex-file-compressed -10.1% +5.1% -14.4% +30.0% ➖ noise
17 duckdb:vortex-compact -6.9% +5.1% -11.4% +30.0% ➖ noise
17 duckdb:vortex-file-compressed -2.0% +5.1% -6.7% +30.0% ➖ noise
18 datafusion:vortex-compact +9.0% +15.1% -5.4% +30.0% ➖ noise
18 datafusion:vortex-file-compressed -26.9% +15.1% -36.5% +41.9% ✅ faster
18 duckdb:vortex-compact -3.0% +15.1% -15.8% +30.0% ➖ noise
18 duckdb:vortex-file-compressed -10.9% +15.1% -22.6% +31.4% ➖ noise
19 datafusion:vortex-compact +2.9% +27.1% -19.0% +30.0% ➖ noise
19 datafusion:vortex-file-compressed -16.0% +27.1% -33.9% +30.0% ✅ faster
19 duckdb:vortex-compact +1.1% +27.1% -20.5% +32.3% ➖ noise
19 duckdb:vortex-file-compressed -3.8% +27.1% -24.3% +30.0% ✅ faster
20 datafusion:vortex-compact +9.0% +20.3% -9.4% +30.0% ➖ noise
20 datafusion:vortex-file-compressed -11.6% +20.3% -26.6% +30.0% ✅ faster
20 duckdb:vortex-compact +1.8% +20.3% -15.3% +30.0% ➖ noise
20 duckdb:vortex-file-compressed -11.7% +20.3% -26.6% +30.0% ✅ faster
21 datafusion:vortex-compact +5.7% -14.8% +24.1% +30.0% ➖ noise
21 datafusion:vortex-file-compressed -10.5% -14.8% +5.1% +30.0% ➖ noise
21 duckdb:vortex-compact -5.8% -14.8% +10.6% +30.0% ➖ noise
21 duckdb:vortex-file-compressed -8.2% -14.8% +7.7% +30.0% ➖ noise
22 datafusion:vortex-compact +13.3% -9.2% +24.8% +31.2% ➖ noise
22 datafusion:vortex-file-compressed -8.0% -9.2% +1.4% +41.6% ➖ noise
22 duckdb:vortex-compact +7.7% -9.2% +18.7% +30.0% ➖ noise
22 duckdb:vortex-file-compressed +2.9% -9.2% +13.4% +30.0% ➖ noise

@github-actions
Copy link
Copy Markdown
Contributor

github-actions Bot commented Apr 28, 2026

Benchmarks: TPC-H SF=10 on S3

Verdict: No clear signal (environment too noisy confidence)
Attributed Vortex impact: -0.8%
Vortex (geomean): 1.001x ➖
Parquet (geomean): 1.009x ➖
Shifts: Parquet (control) +0.9% · Median polish +1.0%


datafusion / vortex-file-compressed (0.940x ➖, 1↑ 0↓)
name PR f8096d6 (ns) base bcb49d4 (ns) ratio (PR/base)
tpch_q01/datafusion:vortex-file-compressed 735500916 940619702 0.78
tpch_q02/datafusion:vortex-file-compressed 1147678795 1123601491 1.02
tpch_q03/datafusion:vortex-file-compressed 973127220 995863060 0.98
tpch_q04/datafusion:vortex-file-compressed 711530610 633243185 1.12
tpch_q05/datafusion:vortex-file-compressed 1052812162 1019856830 1.03
tpch_q06/datafusion:vortex-file-compressed 662651231 697528255 0.95
tpch_q07/datafusion:vortex-file-compressed 1025177095 1092323086 0.94
tpch_q08/datafusion:vortex-file-compressed 1239392192 1375897940 0.90
tpch_q09/datafusion:vortex-file-compressed 1463554325 1426738919 1.03
tpch_q10/datafusion:vortex-file-compressed 943320412 1023400870 0.92
tpch_q11/datafusion:vortex-file-compressed 515842677 535771036 0.96
tpch_q12/datafusion:vortex-file-compressed 876921625 987919995 0.89
tpch_q13/datafusion:vortex-file-compressed 428889541 427871470 1.00
tpch_q14/datafusion:vortex-file-compressed 666226313 740583841 0.90
tpch_q15/datafusion:vortex-file-compressed 1227273415 1370795068 0.90
tpch_q16/datafusion:vortex-file-compressed 🚀 354267852 639066167 0.55
tpch_q17/datafusion:vortex-file-compressed 1204267155 1211113137 0.99
tpch_q18/datafusion:vortex-file-compressed 1289548915 1222552669 1.05
tpch_q19/datafusion:vortex-file-compressed 819382797 851939945 0.96
tpch_q20/datafusion:vortex-file-compressed 965737920 1028070153 0.94
tpch_q21/datafusion:vortex-file-compressed 1682353548 1648572537 1.02
tpch_q22/datafusion:vortex-file-compressed 350317995 348953227 1.00
datafusion / vortex-compact (0.975x ➖, 0↑ 0↓)
name PR f8096d6 (ns) base bcb49d4 (ns) ratio (PR/base)
tpch_q01/datafusion:vortex-compact 715305610 724240156 0.99
tpch_q02/datafusion:vortex-compact 663732410 679922757 0.98
tpch_q03/datafusion:vortex-compact 769978970 806186492 0.96
tpch_q04/datafusion:vortex-compact 589863154 594816342 0.99
tpch_q05/datafusion:vortex-compact 880138861 984871270 0.89
tpch_q06/datafusion:vortex-compact 574701023 642185927 0.89
tpch_q07/datafusion:vortex-compact 966607727 997783597 0.97
tpch_q08/datafusion:vortex-compact 1123028842 1094390651 1.03
tpch_q09/datafusion:vortex-compact 1176179224 1233149587 0.95
tpch_q10/datafusion:vortex-compact 883569233 876843299 1.01
tpch_q11/datafusion:vortex-compact 385115753 396624824 0.97
tpch_q12/datafusion:vortex-compact 874897156 909856608 0.96
tpch_q13/datafusion:vortex-compact 405369044 411986417 0.98
tpch_q14/datafusion:vortex-compact 579088703 581824688 1.00
tpch_q15/datafusion:vortex-compact 1041567494 1118156856 0.93
tpch_q16/datafusion:vortex-compact 316957348 309508405 1.02
tpch_q17/datafusion:vortex-compact 1172597293 1127498536 1.04
tpch_q18/datafusion:vortex-compact 1085228731 1088175565 1.00
tpch_q19/datafusion:vortex-compact 827167662 868029636 0.95
tpch_q20/datafusion:vortex-compact 842295989 902824048 0.93
tpch_q21/datafusion:vortex-compact 1457825206 1395333456 1.04
tpch_q22/datafusion:vortex-compact 377867758 387815289 0.97
datafusion / parquet (0.977x ➖, 1↑ 2↓)
name PR f8096d6 (ns) base bcb49d4 (ns) ratio (PR/base)
tpch_q01/datafusion:parquet 710164584 827326439 0.86
tpch_q02/datafusion:parquet 🚀 770647421 1332016087 0.58
tpch_q03/datafusion:parquet 1138554215 1029310899 1.11
tpch_q04/datafusion:parquet 🚨 755446103 531951464 1.42
tpch_q05/datafusion:parquet 1399777462 1112893821 1.26
tpch_q06/datafusion:parquet 645761512 521750107 1.24
tpch_q07/datafusion:parquet 🚨 1642267525 1232437339 1.33
tpch_q08/datafusion:parquet 1608191757 1803040709 0.89
tpch_q09/datafusion:parquet 1797051571 1730234331 1.04
tpch_q10/datafusion:parquet 2049300242 2091001395 0.98
tpch_q11/datafusion:parquet 635242501 726537910 0.87
tpch_q12/datafusion:parquet 650630635 759112072 0.86
tpch_q13/datafusion:parquet 684295385 697605248 0.98
tpch_q14/datafusion:parquet 736314212 825485330 0.89
tpch_q15/datafusion:parquet 1216630515 1273089208 0.96
tpch_q16/datafusion:parquet 373520378 427601740 0.87
tpch_q17/datafusion:parquet 1425903574 1475673990 0.97
tpch_q18/datafusion:parquet 1426001051 1512759969 0.94
tpch_q19/datafusion:parquet 1101743030 971147912 1.13
tpch_q20/datafusion:parquet 1279007212 1261905090 1.01
tpch_q21/datafusion:parquet 1763897414 2097027494 0.84
tpch_q22/datafusion:parquet 635520990 750816057 0.85
duckdb / vortex-file-compressed (1.041x ➖, 0↑ 0↓)
name PR f8096d6 (ns) base bcb49d4 (ns) ratio (PR/base)
tpch_q01/duckdb:vortex-file-compressed 626560870 625500343 1.00
tpch_q02/duckdb:vortex-file-compressed 1310155848 1102356684 1.19
tpch_q03/duckdb:vortex-file-compressed 955285571 928366927 1.03
tpch_q04/duckdb:vortex-file-compressed 641203717 670034110 0.96
tpch_q05/duckdb:vortex-file-compressed 1167641268 1110615777 1.05
tpch_q06/duckdb:vortex-file-compressed 804419175 769312192 1.05
tpch_q07/duckdb:vortex-file-compressed 1121265160 1178934723 0.95
tpch_q08/duckdb:vortex-file-compressed 1392840590 1467328743 0.95
tpch_q09/duckdb:vortex-file-compressed 1568422940 1463260159 1.07
tpch_q10/duckdb:vortex-file-compressed 1220207271 1152281399 1.06
tpch_q11/duckdb:vortex-file-compressed 654831297 647312625 1.01
tpch_q12/duckdb:vortex-file-compressed 781342955 690539363 1.13
tpch_q13/duckdb:vortex-file-compressed 970856760 985266129 0.99
tpch_q14/duckdb:vortex-file-compressed 912633358 783953888 1.16
tpch_q15/duckdb:vortex-file-compressed 568332289 634468200 0.90
tpch_q16/duckdb:vortex-file-compressed 482917436 492527284 0.98
tpch_q17/duckdb:vortex-file-compressed 1022857598 996273406 1.03
tpch_q18/duckdb:vortex-file-compressed 969596611 889273946 1.09
tpch_q19/duckdb:vortex-file-compressed 800778639 766920660 1.04
tpch_q20/duckdb:vortex-file-compressed 1300534522 1156223024 1.12
tpch_q21/duckdb:vortex-file-compressed 2046167544 1847093862 1.11
tpch_q22/duckdb:vortex-file-compressed 687979661 632071261 1.09
duckdb / vortex-compact (1.053x ➖, 0↑ 0↓)
name PR f8096d6 (ns) base bcb49d4 (ns) ratio (PR/base)
tpch_q01/duckdb:vortex-compact 604793843 587396060 1.03
tpch_q02/duckdb:vortex-compact 1168131686 1024061980 1.14
tpch_q03/duckdb:vortex-compact 975098608 768449884 1.27
tpch_q04/duckdb:vortex-compact 523912110 517450392 1.01
tpch_q05/duckdb:vortex-compact 1057345505 1002822821 1.05
tpch_q06/duckdb:vortex-compact 738270389 710611647 1.04
tpch_q07/duckdb:vortex-compact 1063453786 1087240167 0.98
tpch_q08/duckdb:vortex-compact 1304891177 1445987893 0.90
tpch_q09/duckdb:vortex-compact 1421128434 1355979987 1.05
tpch_q10/duckdb:vortex-compact 1066721680 1285537747 0.83
tpch_q11/duckdb:vortex-compact 702048752 645531110 1.09
tpch_q12/duckdb:vortex-compact 667793394 693873578 0.96
tpch_q13/duckdb:vortex-compact 887247770 848874938 1.05
tpch_q14/duckdb:vortex-compact 871405940 863212140 1.01
tpch_q15/duckdb:vortex-compact 521354958 504869571 1.03
tpch_q16/duckdb:vortex-compact 480001740 452459818 1.06
tpch_q17/duckdb:vortex-compact 940122316 867517141 1.08
tpch_q18/duckdb:vortex-compact 825274520 668823376 1.23
tpch_q19/duckdb:vortex-compact 858120922 746222487 1.15
tpch_q20/duckdb:vortex-compact 1341888080 1113410805 1.21
tpch_q21/duckdb:vortex-compact 1807563439 1635255283 1.11
tpch_q22/duckdb:vortex-compact 659461557 672676521 0.98
duckdb / parquet (1.042x ➖, 0↑ 0↓)
name PR f8096d6 (ns) base bcb49d4 (ns) ratio (PR/base)
tpch_q01/duckdb:parquet 855947702 781571971 1.10
tpch_q02/duckdb:parquet 1484153457 1481014591 1.00
tpch_q03/duckdb:parquet 1660153538 1638636583 1.01
tpch_q04/duckdb:parquet 1135918998 1023987213 1.11
tpch_q05/duckdb:parquet 2143441501 2165551429 0.99
tpch_q06/duckdb:parquet 827255864 704278295 1.17
tpch_q07/duckdb:parquet 1743794909 1979152911 0.88
tpch_q08/duckdb:parquet 2313505094 2652969436 0.87
tpch_q09/duckdb:parquet 2628241878 2692148615 0.98
tpch_q10/duckdb:parquet 3123972985 3059992477 1.02
tpch_q11/duckdb:parquet 1100823567 1158689557 0.95
tpch_q12/duckdb:parquet 1426514379 1266371614 1.13
tpch_q13/duckdb:parquet 1347059841 1169946529 1.15
tpch_q14/duckdb:parquet 1263684704 1310201859 0.96
tpch_q15/duckdb:parquet 868888115 880319084 0.99
tpch_q16/duckdb:parquet 982359148 910325868 1.08
tpch_q17/duckdb:parquet 1300286952 1346523069 0.97
tpch_q18/duckdb:parquet 1784508975 1434068318 1.24
tpch_q19/duckdb:parquet 1546290285 1451232022 1.07
tpch_q20/duckdb:parquet 1914395210 1770383607 1.08
tpch_q21/duckdb:parquet 1980226002 1751015151 1.13
tpch_q22/duckdb:parquet 1156043908 1013367581 1.14
Full attributed analysis
Query Config Raw Δ Control Δ Attributed α Noise floor Significant?
1 datafusion:vortex-compact -1.2% -3.0% +1.9% +56.9% ➖ noise
1 datafusion:vortex-file-compressed -21.8% -3.0% -19.4% +58.6% ➖ noise
1 duckdb:vortex-compact +3.0% -3.0% +6.2% +38.5% ➖ noise
1 duckdb:vortex-file-compressed +0.2% -3.0% +3.3% +36.9% ➖ noise
2 datafusion:vortex-compact -2.4% -23.9% +28.2% +47.0% ➖ noise
2 datafusion:vortex-file-compressed +2.1% -23.9% +34.1% +56.5% ➖ noise
2 duckdb:vortex-compact +14.1% -23.9% +49.8% +43.0% 🚨 regression
2 duckdb:vortex-file-compressed +18.9% -23.9% +56.1% +36.5% 🚨 regression
3 datafusion:vortex-compact -4.5% +5.9% -9.8% +53.9% ➖ noise
3 datafusion:vortex-file-compressed -2.3% +5.9% -7.7% +53.5% ➖ noise
3 duckdb:vortex-compact +26.9% +5.9% +19.9% +53.1% ➖ noise
3 duckdb:vortex-file-compressed +2.9% +5.9% -2.8% +44.5% ➖ noise
4 datafusion:vortex-compact -0.8% +25.5% -21.0% +31.5% ➖ noise
4 datafusion:vortex-file-compressed +12.4% +25.5% -10.5% +31.5% ➖ noise
4 duckdb:vortex-compact +1.2% +25.5% -19.3% +36.7% ➖ noise
4 duckdb:vortex-file-compressed -4.3% +25.5% -23.8% +31.5% ➖ noise
5 datafusion:vortex-compact -10.6% +11.6% -19.9% +31.5% ➖ noise
5 datafusion:vortex-file-compressed +3.2% +11.6% -7.5% +31.5% ➖ noise
5 duckdb:vortex-compact +5.4% +11.6% -5.5% +31.5% ➖ noise
5 duckdb:vortex-file-compressed +5.1% +11.6% -5.8% +31.5% ➖ noise
6 datafusion:vortex-compact -10.5% +20.6% -25.8% +31.5% ✅ faster
6 datafusion:vortex-file-compressed -5.0% +20.6% -21.2% +31.5% ➖ noise
6 duckdb:vortex-compact +3.9% +20.6% -13.8% +31.5% ➖ noise
6 duckdb:vortex-file-compressed +4.6% +20.6% -13.3% +31.5% ➖ noise
7 datafusion:vortex-compact -3.1% +8.4% -10.6% +31.5% ➖ noise
7 datafusion:vortex-file-compressed -6.1% +8.4% -13.4% +31.5% ➖ noise
7 duckdb:vortex-compact -2.2% +8.4% -9.7% +31.5% ➖ noise
7 duckdb:vortex-file-compressed -4.9% +8.4% -12.2% +31.5% ➖ noise
8 datafusion:vortex-compact +2.6% -11.8% +16.4% +31.5% ➖ noise
8 datafusion:vortex-file-compressed -9.9% -11.8% +2.1% +31.5% ➖ noise
8 duckdb:vortex-compact -9.8% -11.8% +2.3% +31.5% ➖ noise
8 duckdb:vortex-file-compressed -5.1% -11.8% +7.6% +31.5% ➖ noise
9 datafusion:vortex-compact -4.6% +0.7% -5.3% +31.5% ➖ noise
9 datafusion:vortex-file-compressed +2.6% +0.7% +1.9% +31.5% ➖ noise
9 duckdb:vortex-compact +4.8% +0.7% +4.1% +31.5% ➖ noise
9 duckdb:vortex-file-compressed +7.2% +0.7% +6.4% +31.5% ➖ noise
10 datafusion:vortex-compact +0.8% +0.0% +0.7% +31.5% ➖ noise
10 datafusion:vortex-file-compressed -7.8% +0.0% -7.9% +31.5% ➖ noise
10 duckdb:vortex-compact -17.0% +0.0% -17.0% +31.5% ➖ noise
10 duckdb:vortex-file-compressed +5.9% +0.0% +5.9% +31.5% ➖ noise
11 datafusion:vortex-compact -2.9% -8.9% +6.5% +31.5% ➖ noise
11 datafusion:vortex-file-compressed -3.7% -8.9% +5.6% +31.5% ➖ noise
11 duckdb:vortex-compact +8.8% -8.9% +19.3% +31.5% ➖ noise
11 duckdb:vortex-file-compressed +1.2% -8.9% +11.0% +31.5% ➖ noise
12 datafusion:vortex-compact -3.8% -1.7% -2.1% +31.5% ➖ noise
12 datafusion:vortex-file-compressed -11.2% -1.7% -9.7% +31.5% ➖ noise
12 duckdb:vortex-compact -3.8% -1.7% -2.1% +31.5% ➖ noise
12 duckdb:vortex-file-compressed +13.1% -1.7% +15.2% +31.5% ➖ noise
13 datafusion:vortex-compact -1.6% +6.3% -7.4% +33.0% ➖ noise
13 datafusion:vortex-file-compressed +0.2% +6.3% -5.7% +49.5% ➖ noise
13 duckdb:vortex-compact +4.5% +6.3% -1.7% +46.3% ➖ noise
13 duckdb:vortex-file-compressed -1.5% +6.3% -7.3% +43.3% ➖ noise
14 datafusion:vortex-compact -0.5% -7.2% +7.3% +31.5% ➖ noise
14 datafusion:vortex-file-compressed -10.0% -7.2% -3.0% +31.5% ➖ noise
14 duckdb:vortex-compact +0.9% -7.2% +8.8% +31.5% ➖ noise
14 duckdb:vortex-file-compressed +16.4% -7.2% +25.5% +31.5% ➖ noise
15 datafusion:vortex-compact -6.8% -2.9% -4.1% +31.5% ➖ noise
15 datafusion:vortex-file-compressed -10.5% -2.9% -7.8% +31.5% ➖ noise
15 duckdb:vortex-compact +3.3% -2.9% +6.3% +31.5% ➖ noise
15 duckdb:vortex-file-compressed -10.4% -2.9% -7.8% +31.5% ➖ noise
16 datafusion:vortex-compact +2.4% -2.9% +5.5% +31.5% ➖ noise
16 datafusion:vortex-file-compressed -44.6% -2.9% -42.9% +34.1% ✅ faster
16 duckdb:vortex-compact +6.1% -2.9% +9.3% +31.5% ➖ noise
16 duckdb:vortex-file-compressed -2.0% -2.9% +1.0% +31.5% ➖ noise
17 datafusion:vortex-compact +4.0% -3.4% +7.7% +31.5% ➖ noise
17 datafusion:vortex-file-compressed -0.6% -3.4% +2.9% +31.5% ➖ noise
17 duckdb:vortex-compact +8.4% -3.4% +12.2% +31.5% ➖ noise
17 duckdb:vortex-file-compressed +2.7% -3.4% +6.3% +31.5% ➖ noise
18 datafusion:vortex-compact -0.3% +8.3% -7.9% +31.5% ➖ noise
18 datafusion:vortex-file-compressed +5.5% +8.3% -2.6% +31.5% ➖ noise
18 duckdb:vortex-compact +23.4% +8.3% +13.9% +31.5% ➖ noise
18 duckdb:vortex-file-compressed +9.0% +8.3% +0.7% +31.5% ➖ noise
19 datafusion:vortex-compact -4.7% +9.9% -13.3% +31.5% ➖ noise
19 datafusion:vortex-file-compressed -3.8% +9.9% -12.5% +31.5% ➖ noise
19 duckdb:vortex-compact +15.0% +9.9% +4.6% +31.5% ➖ noise
19 duckdb:vortex-file-compressed +4.4% +9.9% -5.0% +31.5% ➖ noise
20 datafusion:vortex-compact -6.7% +4.7% -10.9% +31.5% ➖ noise
20 datafusion:vortex-file-compressed -6.1% +4.7% -10.3% +31.5% ➖ noise
20 duckdb:vortex-compact +20.5% +4.7% +15.1% +31.5% ➖ noise
20 duckdb:vortex-file-compressed +12.5% +4.7% +7.4% +31.5% ➖ noise
21 datafusion:vortex-compact +4.5% -2.5% +7.1% +31.5% ➖ noise
21 datafusion:vortex-file-compressed +2.0% -2.5% +4.6% +31.5% ➖ noise
21 duckdb:vortex-compact +10.5% -2.5% +13.3% +31.5% ➖ noise
21 duckdb:vortex-file-compressed +10.8% -2.5% +13.6% +31.5% ➖ noise
22 datafusion:vortex-compact -2.6% -1.7% -0.8% +31.5% ➖ noise
22 datafusion:vortex-file-compressed +0.4% -1.7% +2.2% +31.5% ➖ noise
22 duckdb:vortex-compact -2.0% -1.7% -0.2% +31.5% ➖ noise
22 duckdb:vortex-file-compressed +8.8% -1.7% +10.8% +31.5% ➖ noise

@github-actions
Copy link
Copy Markdown
Contributor

github-actions Bot commented Apr 28, 2026

Benchmarks: FineWeb S3

Verdict: No clear signal (low confidence)
Attributed Vortex impact: -8.1%
Vortex (geomean): 0.927x ➖
Parquet (geomean): 1.009x ➖
Shifts: Parquet (control) +0.9% · Median polish -3.7%


datafusion / vortex-file-compressed (0.960x ➖, 0↑ 0↓)
name PR f8096d6 (ns) base d036fc1 (ns) ratio (PR/base)
fineweb_q00/datafusion:vortex-file-compressed 37057503 36313978 1.02
fineweb_q01/datafusion:vortex-file-compressed 571753662 558461019 1.02
fineweb_q02/datafusion:vortex-file-compressed 446785233 520070435 0.86
fineweb_q03/datafusion:vortex-file-compressed 1399491393 1404117675 1.00
fineweb_q04/datafusion:vortex-file-compressed 1369818369 1410064161 0.97
fineweb_q05/datafusion:vortex-file-compressed 1344594167 1402923263 0.96
fineweb_q06/datafusion:vortex-file-compressed 1517463451 1728177603 0.88
fineweb_q07/datafusion:vortex-file-compressed 1328356229 1357413074 0.98
fineweb_q08/datafusion:vortex-file-compressed 524079172 542620821 0.97
datafusion / vortex-compact (0.953x ➖, 0↑ 0↓)
name PR f8096d6 (ns) base d036fc1 (ns) ratio (PR/base)
fineweb_q00/datafusion:vortex-compact 35035151 36834268 0.95
fineweb_q01/datafusion:vortex-compact 468275354 525944563 0.89
fineweb_q02/datafusion:vortex-compact 598490865 565382578 1.06
fineweb_q03/datafusion:vortex-compact 1497249856 1537638326 0.97
fineweb_q04/datafusion:vortex-compact 1796099523 1887338620 0.95
fineweb_q05/datafusion:vortex-compact 1454744260 1552865910 0.94
fineweb_q06/datafusion:vortex-compact 1302595107 1364258035 0.95
fineweb_q07/datafusion:vortex-compact 1156972974 1205389866 0.96
fineweb_q08/datafusion:vortex-compact 387820379 425225342 0.91
datafusion / parquet (1.019x ➖, 0↑ 0↓)
name PR f8096d6 (ns) base d036fc1 (ns) ratio (PR/base)
fineweb_q00/datafusion:parquet 1349581126 1091649690 1.24
fineweb_q01/datafusion:parquet 1887685216 1792475899 1.05
fineweb_q02/datafusion:parquet 1823427630 1834796678 0.99
fineweb_q03/datafusion:parquet 1796866540 2007522055 0.90
fineweb_q04/datafusion:parquet 1891976217 1708760331 1.11
fineweb_q05/datafusion:parquet 1873734092 1943753808 0.96
fineweb_q06/datafusion:parquet 1957925334 1870998467 1.05
fineweb_q07/datafusion:parquet 1774244479 1902995975 0.93
fineweb_q08/datafusion:parquet 1829531053 1865823936 0.98
duckdb / vortex-file-compressed (0.897x ➖, 0↑ 0↓)
name PR f8096d6 (ns) base d036fc1 (ns) ratio (PR/base)
fineweb_q00/duckdb:vortex-file-compressed 84300478 84438298 1.00
fineweb_q01/duckdb:vortex-file-compressed 560907798 687273605 0.82
fineweb_q02/duckdb:vortex-file-compressed 439297600 520682129 0.84
fineweb_q03/duckdb:vortex-file-compressed 1460921290 1816636136 0.80
fineweb_q04/duckdb:vortex-file-compressed 1454668440 1682689164 0.86
fineweb_q05/duckdb:vortex-file-compressed 1460618890 1555331262 0.94
fineweb_q06/duckdb:vortex-file-compressed 1700047846 1764582322 0.96
fineweb_q07/duckdb:vortex-file-compressed 1443185624 1601158932 0.90
fineweb_q08/duckdb:vortex-file-compressed 628625084 649435113 0.97
duckdb / vortex-compact (0.898x ➖, 1↑ 0↓)
name PR f8096d6 (ns) base d036fc1 (ns) ratio (PR/base)
fineweb_q00/duckdb:vortex-compact 🚀 52224449 81403725 0.64
fineweb_q01/duckdb:vortex-compact 544875889 591413251 0.92
fineweb_q02/duckdb:vortex-compact 582195551 610214154 0.95
fineweb_q03/duckdb:vortex-compact 1571810909 1799548046 0.87
fineweb_q04/duckdb:vortex-compact 1733764988 1837620143 0.94
fineweb_q05/duckdb:vortex-compact 1646468366 1730123545 0.95
fineweb_q06/duckdb:vortex-compact 1510973312 1647954961 0.92
fineweb_q07/duckdb:vortex-compact 1345661900 1414250769 0.95
fineweb_q08/duckdb:vortex-compact 514754337 520547506 0.99
duckdb / parquet (0.999x ➖, 0↑ 0↓)
name PR f8096d6 (ns) base d036fc1 (ns) ratio (PR/base)
fineweb_q00/duckdb:parquet 1084259495 1117294127 0.97
fineweb_q01/duckdb:parquet 1387131747 1468418757 0.94
fineweb_q02/duckdb:parquet 1570396859 1354885298 1.16
fineweb_q03/duckdb:parquet 3799684212 3901090944 0.97
fineweb_q04/duckdb:parquet 1805683559 2058226794 0.88
fineweb_q05/duckdb:parquet 2235846366 2173311841 1.03
fineweb_q06/duckdb:parquet 4401662173 4338057064 1.01
fineweb_q07/duckdb:parquet 2755740292 2698255415 1.02
fineweb_q08/duckdb:parquet 1089070606 1061877905 1.03
Full attributed analysis
Query Config Raw Δ Control Δ Attributed α Noise floor Significant?
0 datafusion:vortex-compact -4.9% +9.5% -13.2% +237.8% ➖ noise
0 datafusion:vortex-file-compressed +2.0% +9.5% -6.8% +132.4% ➖ noise
0 duckdb:vortex-compact -35.8% +9.5% -41.4% +58.7% ✅ faster
0 duckdb:vortex-file-compressed -0.2% +9.5% -8.9% +49.4% ➖ noise
1 datafusion:vortex-compact -11.0% -0.3% -10.7% +86.5% ➖ noise
1 datafusion:vortex-file-compressed +2.4% -0.3% +2.6% +97.7% ➖ noise
1 duckdb:vortex-compact -7.9% -0.3% -7.6% +30.0% ➖ noise
1 duckdb:vortex-file-compressed -18.4% -0.3% -18.2% +44.5% ➖ noise
2 datafusion:vortex-compact +5.9% +7.3% -1.4% +46.4% ➖ noise
2 datafusion:vortex-file-compressed -14.1% +7.3% -20.0% +47.2% ➖ noise
2 duckdb:vortex-compact -4.6% +7.3% -11.1% +30.0% ➖ noise
2 duckdb:vortex-file-compressed -15.6% +7.3% -21.4% +31.3% ➖ noise
3 datafusion:vortex-compact -2.6% -6.6% +4.3% +30.0% ➖ noise
3 datafusion:vortex-file-compressed -0.3% -6.6% +6.7% +30.0% ➖ noise
3 duckdb:vortex-compact -12.7% -6.6% -6.5% +43.1% ➖ noise
3 duckdb:vortex-file-compressed -19.6% -6.6% -13.9% +30.0% ➖ noise
4 datafusion:vortex-compact -4.8% -1.4% -3.4% +30.0% ➖ noise
4 datafusion:vortex-file-compressed -2.9% -1.4% -1.4% +30.0% ➖ noise
4 duckdb:vortex-compact -5.7% -1.4% -4.3% +30.0% ➖ noise
4 duckdb:vortex-file-compressed -13.6% -1.4% -12.3% +30.0% ➖ noise
5 datafusion:vortex-compact -6.3% -0.4% -5.9% +30.0% ➖ noise
5 datafusion:vortex-file-compressed -4.2% -0.4% -3.8% +30.0% ➖ noise
5 duckdb:vortex-compact -4.8% -0.4% -4.4% +30.0% ➖ noise
5 duckdb:vortex-file-compressed -6.1% -0.4% -5.7% +30.0% ➖ noise
6 datafusion:vortex-compact -4.5% +3.0% -7.3% +30.0% ➖ noise
6 datafusion:vortex-file-compressed -12.2% +3.0% -14.8% +32.7% ➖ noise
6 duckdb:vortex-compact -8.3% +3.0% -11.0% +30.0% ➖ noise
6 duckdb:vortex-file-compressed -3.7% +3.0% -6.5% +30.0% ➖ noise
7 datafusion:vortex-compact -4.0% -2.4% -1.6% +30.0% ➖ noise
7 datafusion:vortex-file-compressed -2.1% -2.4% +0.3% +30.0% ➖ noise
7 duckdb:vortex-compact -4.8% -2.4% -2.5% +30.0% ➖ noise
7 duckdb:vortex-file-compressed -9.9% -2.4% -7.6% +30.0% ➖ noise
8 datafusion:vortex-compact -8.8% +0.3% -9.1% +30.0% ➖ noise
8 datafusion:vortex-file-compressed -3.4% +0.3% -3.7% +30.0% ➖ noise
8 duckdb:vortex-compact -1.1% +0.3% -1.4% +30.0% ➖ noise
8 duckdb:vortex-file-compressed -3.2% +0.3% -3.5% +30.0% ➖ noise

@github-actions
Copy link
Copy Markdown
Contributor

github-actions Bot commented Apr 28, 2026

Benchmarks: Clickbench on NVME

Verdict: No clear signal (low confidence)
Attributed Vortex impact: -2.4%
Vortex (geomean): 0.978x ➖
Parquet (geomean): 0.999x ➖
Shifts: Parquet (control) -0.1% · Median polish +0.2%


datafusion / vortex-file-compressed (0.994x ➖, 1↑ 0↓)
name PR f8096d6 (ns) base 2db4ab1 (ns) ratio (PR/base)
clickbench_q00/datafusion:vortex-file-compressed 1667496 1629630 1.02
clickbench_q01/datafusion:vortex-file-compressed 19122347 19603668 0.98
clickbench_q02/datafusion:vortex-file-compressed 38117244 38942309 0.98
clickbench_q03/datafusion:vortex-file-compressed 43246357 41667542 1.04
clickbench_q04/datafusion:vortex-file-compressed 281820934 285438555 0.99
clickbench_q05/datafusion:vortex-file-compressed 294793939 298659276 0.99
clickbench_q06/datafusion:vortex-file-compressed 🚀 1674383 1955857 0.86
clickbench_q07/datafusion:vortex-file-compressed 22804640 22258485 1.02
clickbench_q08/datafusion:vortex-file-compressed 349983047 347961278 1.01
clickbench_q09/datafusion:vortex-file-compressed 557277429 548317750 1.02
clickbench_q10/datafusion:vortex-file-compressed 74420042 75919424 0.98
clickbench_q11/datafusion:vortex-file-compressed 88006185 89298616 0.99
clickbench_q12/datafusion:vortex-file-compressed 261678112 270671015 0.97
clickbench_q13/datafusion:vortex-file-compressed 407126853 405460977 1.00
clickbench_q14/datafusion:vortex-file-compressed 253103433 256411725 0.99
clickbench_q15/datafusion:vortex-file-compressed 318575287 325370869 0.98
clickbench_q16/datafusion:vortex-file-compressed 636887679 632989600 1.01
clickbench_q17/datafusion:vortex-file-compressed 630805215 627579874 1.01
clickbench_q18/datafusion:vortex-file-compressed 1278475621 1284393345 1.00
clickbench_q19/datafusion:vortex-file-compressed 30319884 29243534 1.04
clickbench_q20/datafusion:vortex-file-compressed 336920980 338371845 1.00
clickbench_q21/datafusion:vortex-file-compressed 370370951 367813281 1.01
clickbench_q22/datafusion:vortex-file-compressed 444828863 446239180 1.00
clickbench_q23/datafusion:vortex-file-compressed 643000993 712101745 0.90
clickbench_q24/datafusion:vortex-file-compressed 46046791 44254820 1.04
clickbench_q25/datafusion:vortex-file-compressed 70007358 72587756 0.96
clickbench_q26/datafusion:vortex-file-compressed 45965608 45046067 1.02
clickbench_q27/datafusion:vortex-file-compressed 714286919 718900070 0.99
clickbench_q28/datafusion:vortex-file-compressed 6814722083 6797696481 1.00
clickbench_q29/datafusion:vortex-file-compressed 236708184 233165082 1.02
clickbench_q30/datafusion:vortex-file-compressed 222689713 230643451 0.97
clickbench_q31/datafusion:vortex-file-compressed 255903910 254394633 1.01
clickbench_q32/datafusion:vortex-file-compressed 1106971511 1083626492 1.02
clickbench_q33/datafusion:vortex-file-compressed 1267967642 1278874877 0.99
clickbench_q34/datafusion:vortex-file-compressed 1277615518 1267782462 1.01
clickbench_q35/datafusion:vortex-file-compressed 435372359 450619489 0.97
clickbench_q36/datafusion:vortex-file-compressed 70078908 68966241 1.02
clickbench_q37/datafusion:vortex-file-compressed 35029962 35413398 0.99
clickbench_q38/datafusion:vortex-file-compressed 18842396 18735575 1.01
clickbench_q39/datafusion:vortex-file-compressed 132133969 131622270 1.00
clickbench_q40/datafusion:vortex-file-compressed 16139220 15537842 1.04
clickbench_q41/datafusion:vortex-file-compressed 15073205 15493524 0.97
clickbench_q42/datafusion:vortex-file-compressed 17432321 17436532 1.00
datafusion / parquet (1.000x ➖, 0↑ 0↓)
name PR f8096d6 (ns) base 2db4ab1 (ns) ratio (PR/base)
clickbench_q00/datafusion:parquet 1556459 1523247 1.02
clickbench_q01/datafusion:parquet 20529300 19305572 1.06
clickbench_q02/datafusion:parquet 48245639 45760686 1.05
clickbench_q03/datafusion:parquet 37642357 38688656 0.97
clickbench_q04/datafusion:parquet 289055480 295805849 0.98
clickbench_q05/datafusion:parquet 357246075 342303224 1.04
clickbench_q06/datafusion:parquet 1597544 1557485 1.03
clickbench_q07/datafusion:parquet 22984534 22748031 1.01
clickbench_q08/datafusion:parquet 367572498 373949151 0.98
clickbench_q09/datafusion:parquet 609134735 608287589 1.00
clickbench_q10/datafusion:parquet 110820992 112153279 0.99
clickbench_q11/datafusion:parquet 133836657 136573354 0.98
clickbench_q12/datafusion:parquet 350324101 345809205 1.01
clickbench_q13/datafusion:parquet 488605357 492370860 0.99
clickbench_q14/datafusion:parquet 345256117 344152777 1.00
clickbench_q15/datafusion:parquet 333326934 333637760 1.00
clickbench_q16/datafusion:parquet 657746257 649266824 1.01
clickbench_q17/datafusion:parquet 630096688 639423270 0.99
clickbench_q18/datafusion:parquet 1300466120 1316304014 0.99
clickbench_q19/datafusion:parquet 29378047 29282628 1.00
clickbench_q20/datafusion:parquet 603810700 600478660 1.01
clickbench_q21/datafusion:parquet 667554642 676364788 0.99
clickbench_q22/datafusion:parquet 974639151 983666111 0.99
clickbench_q23/datafusion:parquet 3742828077 3726004438 1.00
clickbench_q24/datafusion:parquet 84248862 81814565 1.03
clickbench_q25/datafusion:parquet 134790934 136911446 0.98
clickbench_q26/datafusion:parquet 82004760 83361139 0.98
clickbench_q27/datafusion:parquet 1045486229 1043476161 1.00
clickbench_q28/datafusion:parquet 6639184367 6738829346 0.99
clickbench_q29/datafusion:parquet 242437746 245763875 0.99
clickbench_q30/datafusion:parquet 330741465 330756290 1.00
clickbench_q31/datafusion:parquet 360051259 357516987 1.01
clickbench_q32/datafusion:parquet 1159364223 1191931886 0.97
clickbench_q33/datafusion:parquet 1478896343 1475198002 1.00
clickbench_q34/datafusion:parquet 1467006109 1460745107 1.00
clickbench_q35/datafusion:parquet 449613170 461864293 0.97
clickbench_q36/datafusion:parquet 139778999 138688226 1.01
clickbench_q37/datafusion:parquet 56822936 55625726 1.02
clickbench_q38/datafusion:parquet 84372333 91096772 0.93
clickbench_q39/datafusion:parquet 255933067 258345736 0.99
clickbench_q40/datafusion:parquet 29728706 29509722 1.01
clickbench_q41/datafusion:parquet 27486423 27076860 1.02
clickbench_q42/datafusion:parquet 29518951 28789643 1.03
duckdb / vortex-file-compressed (0.962x ➖, 8↑ 0↓)
name PR f8096d6 (ns) base 2db4ab1 (ns) ratio (PR/base)
clickbench_q00/duckdb:vortex-file-compressed 5988133 5770331 1.04
clickbench_q01/duckdb:vortex-file-compressed 13161275 13550478 0.97
clickbench_q02/duckdb:vortex-file-compressed 25503778 25549651 1.00
clickbench_q03/duckdb:vortex-file-compressed 29407008 30457427 0.97
clickbench_q04/duckdb:vortex-file-compressed 183487407 181658423 1.01
clickbench_q05/duckdb:vortex-file-compressed 170695279 174301508 0.98
clickbench_q06/duckdb:vortex-file-compressed 18712049 18474766 1.01
clickbench_q07/duckdb:vortex-file-compressed 15520712 16481146 0.94
clickbench_q08/duckdb:vortex-file-compressed 257912702 253988842 1.02
clickbench_q09/duckdb:vortex-file-compressed 331717662 331562804 1.00
clickbench_q10/duckdb:vortex-file-compressed 67267447 69392259 0.97
clickbench_q11/duckdb:vortex-file-compressed 78112116 77697804 1.01
clickbench_q12/duckdb:vortex-file-compressed 191951941 194746606 0.99
clickbench_q13/duckdb:vortex-file-compressed 410342281 403772921 1.02
clickbench_q14/duckdb:vortex-file-compressed 230872933 228923743 1.01
clickbench_q15/duckdb:vortex-file-compressed 244683391 245833910 1.00
clickbench_q16/duckdb:vortex-file-compressed 574761634 575036295 1.00
clickbench_q17/duckdb:vortex-file-compressed 477127773 460775382 1.04
clickbench_q18/duckdb:vortex-file-compressed 1001249566 961701428 1.04
clickbench_q19/duckdb:vortex-file-compressed 20766037 21364549 0.97
clickbench_q20/duckdb:vortex-file-compressed 320753860 332965703 0.96
clickbench_q21/duckdb:vortex-file-compressed 377179986 362093852 1.04
clickbench_q22/duckdb:vortex-file-compressed 🚀 484751884 599921721 0.81
clickbench_q23/duckdb:vortex-file-compressed 860512410 943113864 0.91
clickbench_q24/duckdb:vortex-file-compressed 39895018 42409186 0.94
clickbench_q25/duckdb:vortex-file-compressed 73118320 74650332 0.98
clickbench_q26/duckdb:vortex-file-compressed 🚀 44379464 49757034 0.89
clickbench_q27/duckdb:vortex-file-compressed 463656082 464506500 1.00
clickbench_q28/duckdb:vortex-file-compressed 2968458429 2963597163 1.00
clickbench_q29/duckdb:vortex-file-compressed 28220937 28500085 0.99
clickbench_q30/duckdb:vortex-file-compressed 191917359 190989535 1.00
clickbench_q31/duckdb:vortex-file-compressed 278032713 277580550 1.00
clickbench_q32/duckdb:vortex-file-compressed 1245027982 1234751139 1.01
clickbench_q33/duckdb:vortex-file-compressed 1176222484 1200354763 0.98
clickbench_q34/duckdb:vortex-file-compressed 1209362546 1224167622 0.99
clickbench_q35/duckdb:vortex-file-compressed 370202468 377271953 0.98
clickbench_q36/duckdb:vortex-file-compressed 🚀 24857710 29485399 0.84
clickbench_q37/duckdb:vortex-file-compressed 🚀 18206729 21680343 0.84
clickbench_q38/duckdb:vortex-file-compressed 🚀 19808236 23778013 0.83
clickbench_q39/duckdb:vortex-file-compressed 38809463 41922594 0.93
clickbench_q40/duckdb:vortex-file-compressed 🚀 18013256 22198139 0.81
clickbench_q41/duckdb:vortex-file-compressed 🚀 19171725 21904081 0.88
clickbench_q42/duckdb:vortex-file-compressed 🚀 20816726 23680609 0.88
duckdb / parquet (0.998x ➖, 1↑ 0↓)
name PR f8096d6 (ns) base 2db4ab1 (ns) ratio (PR/base)
clickbench_q00/duckdb:parquet 25836282 25343271 1.02
clickbench_q01/duckdb:parquet 27378569 27256206 1.00
clickbench_q02/duckdb:parquet 48334555 48669407 0.99
clickbench_q03/duckdb:parquet 38469318 38242665 1.01
clickbench_q04/duckdb:parquet 199447716 200401376 1.00
clickbench_q05/duckdb:parquet 263638350 269666318 0.98
clickbench_q06/duckdb:parquet 45858789 45177521 1.02
clickbench_q07/duckdb:parquet 29273458 29101825 1.01
clickbench_q08/duckdb:parquet 263322707 263458078 1.00
clickbench_q09/duckdb:parquet 401395421 397494660 1.01
clickbench_q10/duckdb:parquet 81568751 81858197 1.00
clickbench_q11/duckdb:parquet 99946094 98190303 1.02
clickbench_q12/duckdb:parquet 292209941 284459497 1.03
clickbench_q13/duckdb:parquet 485264482 478674838 1.01
clickbench_q14/duckdb:parquet 326038550 329417471 0.99
clickbench_q15/duckdb:parquet 259188815 253385396 1.02
clickbench_q16/duckdb:parquet 639296587 629765751 1.02
clickbench_q17/duckdb:parquet 537573606 541995791 0.99
clickbench_q18/duckdb:parquet 1083940226 1069507502 1.01
clickbench_q19/duckdb:parquet 25566535 25046935 1.02
clickbench_q20/duckdb:parquet 423522533 427728515 0.99
clickbench_q21/duckdb:parquet 549656925 546629549 1.01
clickbench_q22/duckdb:parquet 941194548 930595209 1.01
clickbench_q23/duckdb:parquet 311798543 311452181 1.00
clickbench_q24/duckdb:parquet 68765834 72035387 0.95
clickbench_q25/duckdb:parquet 157847505 156520852 1.01
clickbench_q26/duckdb:parquet 48453745 47789941 1.01
clickbench_q27/duckdb:parquet 645408897 641389845 1.01
clickbench_q28/duckdb:parquet 4834662539 4843865219 1.00
clickbench_q29/duckdb:parquet 40782838 41509122 0.98
clickbench_q30/duckdb:parquet 305025326 298930099 1.02
clickbench_q31/duckdb:parquet 363062978 359897873 1.01
clickbench_q32/duckdb:parquet 1137779709 1123179356 1.01
clickbench_q33/duckdb:parquet 1220912429 1277993201 0.96
clickbench_q34/duckdb:parquet 1231251915 1274405497 0.97
clickbench_q35/duckdb:parquet 364461086 361814899 1.01
clickbench_q36/duckdb:parquet 47419480 51962616 0.91
clickbench_q37/duckdb:parquet 33201064 31812602 1.04
clickbench_q38/duckdb:parquet 34407345 32576101 1.06
clickbench_q39/duckdb:parquet 🚀 74941676 90485350 0.83
clickbench_q40/duckdb:parquet 19041329 18304636 1.04
clickbench_q41/duckdb:parquet 17560271 17357927 1.01
clickbench_q42/duckdb:parquet 21368099 21516330 0.99
duckdb / duckdb (0.972x ➖, 5↑ 0↓)
name PR f8096d6 (ns) base 2db4ab1 (ns) ratio (PR/base)
clickbench_q00/duckdb:duckdb 17890999 17350495 1.03
clickbench_q01/duckdb:duckdb 32806683 32357816 1.01
clickbench_q02/duckdb:duckdb 44698358 45133133 0.99
clickbench_q03/duckdb:duckdb 46489082 46200839 1.01
clickbench_q04/duckdb:duckdb 187425685 189809004 0.99
clickbench_q05/duckdb:duckdb 261936128 267958526 0.98
clickbench_q06/duckdb:duckdb 🚀 27813714 35934642 0.77
clickbench_q07/duckdb:duckdb 35161087 34975370 1.01
clickbench_q08/duckdb:duckdb 248043720 248263824 1.00
clickbench_q09/duckdb:duckdb 366664385 361239524 1.02
clickbench_q10/duckdb:duckdb 97597178 97409611 1.00
clickbench_q11/duckdb:duckdb 107929679 107101277 1.01
clickbench_q12/duckdb:duckdb 237737798 234999240 1.01
clickbench_q13/duckdb:duckdb 463280364 500826656 0.93
clickbench_q14/duckdb:duckdb 276620333 270791795 1.02
clickbench_q15/duckdb:duckdb 218765770 215647556 1.01
clickbench_q16/duckdb:duckdb 631861698 660729531 0.96
clickbench_q17/duckdb:duckdb 549724010 553501948 0.99
clickbench_q18/duckdb:duckdb 1208328256 1271115119 0.95
clickbench_q19/duckdb:duckdb 34206064 34671379 0.99
clickbench_q20/duckdb:duckdb 🚀 823545891 1141986040 0.72
clickbench_q21/duckdb:duckdb 🚀 947861377 1066443546 0.89
clickbench_q22/duckdb:duckdb 🚀 991901878 1134151216 0.87
clickbench_q23/duckdb:duckdb 255451207 258419190 0.99
clickbench_q24/duckdb:duckdb 60470707 62423987 0.97
clickbench_q25/duckdb:duckdb 141320685 141066388 1.00
clickbench_q26/duckdb:duckdb 59069199 59639797 0.99
clickbench_q27/duckdb:duckdb 🚀 950117219 1138361090 0.83
clickbench_q28/duckdb:duckdb 4634304157 4715082642 0.98
clickbench_q29/duckdb:duckdb 48008197 47539341 1.01
clickbench_q30/duckdb:duckdb 258807341 266278879 0.97
clickbench_q31/duckdb:duckdb 413673565 448513245 0.92
clickbench_q32/duckdb:duckdb 1504112776 1595537380 0.94
clickbench_q33/duckdb:duckdb 1970814416 1931685418 1.02
clickbench_q34/duckdb:duckdb 2256115749 2142615275 1.05
clickbench_q35/duckdb:duckdb 277559445 272314655 1.02
clickbench_q36/duckdb:duckdb 41520728 40329082 1.03
clickbench_q37/duckdb:duckdb 31093437 30963313 1.00
clickbench_q38/duckdb:duckdb 30721329 30538387 1.01
clickbench_q39/duckdb:duckdb 62779241 61183686 1.03
clickbench_q40/duckdb:duckdb 31219288 30807003 1.01
clickbench_q41/duckdb:duckdb 29859271 31128102 0.96
clickbench_q42/duckdb:duckdb 31468003 31419498 1.00
Full attributed analysis
Query Config Raw Δ Control Δ Attributed α Noise floor Significant?
0 datafusion:vortex-file-compressed +2.3% +2.1% +0.3% +795.7% ➖ noise
0 duckdb:duckdb +3.1% +2.1% +1.0% +294.3% ➖ noise
0 duckdb:vortex-file-compressed +3.8% +2.1% +1.7% +492.3% ➖ noise
1 datafusion:vortex-file-compressed -2.5% +3.4% -5.6% +21.8% ➖ noise
1 duckdb:duckdb +1.4% +3.4% -1.9% +58.0% ➖ noise
1 duckdb:vortex-file-compressed -2.9% +3.4% -6.0% +22.2% ➖ noise
2 datafusion:vortex-file-compressed -2.1% +2.3% -4.3% +10.0% ➖ noise
2 duckdb:duckdb -1.0% +2.3% -3.2% +21.2% ➖ noise
2 duckdb:vortex-file-compressed -0.2% +2.3% -2.4% +10.5% ➖ noise
3 datafusion:vortex-file-compressed +3.8% -1.1% +4.9% +142.9% ➖ noise
3 duckdb:duckdb +0.6% -1.1% +1.7% +44.9% ➖ noise
3 duckdb:vortex-file-compressed -3.4% -1.1% -2.4% +26.6% ➖ noise
4 datafusion:vortex-file-compressed -1.3% -1.4% +0.1% +10.0% ➖ noise
4 duckdb:duckdb -1.3% -1.4% +0.1% +10.0% ➖ noise
4 duckdb:vortex-file-compressed +1.0% -1.4% +2.4% +10.0% ➖ noise
5 datafusion:vortex-file-compressed -1.3% +1.0% -2.3% +10.0% ➖ noise
5 duckdb:duckdb -2.2% +1.0% -3.2% +10.0% ➖ noise
5 duckdb:vortex-file-compressed -2.1% +1.0% -3.0% +10.0% ➖ noise
6 datafusion:vortex-file-compressed -14.4% +2.0% -16.1% +129.0% ➖ noise
6 duckdb:duckdb -22.6% +2.0% -24.1% +29.4% ✅ faster
6 duckdb:vortex-file-compressed +1.3% +2.0% -0.7% +25.2% ➖ noise
7 datafusion:vortex-file-compressed +2.5% +0.8% +1.6% +10.0% ➖ noise
7 duckdb:duckdb +0.5% +0.8% -0.3% +10.0% ➖ noise
7 duckdb:vortex-file-compressed -5.8% +0.8% -6.6% +10.0% ➖ noise
8 datafusion:vortex-file-compressed +0.6% -0.9% +1.5% +10.0% ➖ noise
8 duckdb:duckdb -0.1% -0.9% +0.8% +10.0% ➖ noise
8 duckdb:vortex-file-compressed +1.5% -0.9% +2.4% +10.0% ➖ noise
9 datafusion:vortex-file-compressed +1.6% +0.6% +1.1% +10.0% ➖ noise
9 duckdb:duckdb +1.5% +0.6% +0.9% +10.0% ➖ noise
9 duckdb:vortex-file-compressed +0.0% +0.6% -0.5% +10.0% ➖ noise
10 datafusion:vortex-file-compressed -2.0% -0.8% -1.2% +10.0% ➖ noise
10 duckdb:duckdb +0.2% -0.8% +1.0% +10.0% ➖ noise
10 duckdb:vortex-file-compressed -3.1% -0.8% -2.3% +10.0% ➖ noise
11 datafusion:vortex-file-compressed -1.4% -0.1% -1.3% +10.0% ➖ noise
11 duckdb:duckdb +0.8% -0.1% +0.9% +10.0% ➖ noise
11 duckdb:vortex-file-compressed +0.5% -0.1% +0.7% +10.0% ➖ noise
12 datafusion:vortex-file-compressed -3.3% +2.0% -5.2% +10.0% ➖ noise
12 duckdb:duckdb +1.2% +2.0% -0.8% +10.0% ➖ noise
12 duckdb:vortex-file-compressed -1.4% +2.0% -3.4% +10.0% ➖ noise
13 datafusion:vortex-file-compressed +0.4% +0.3% +0.1% +10.0% ➖ noise
13 duckdb:duckdb -7.5% +0.3% -7.8% +10.0% ➖ noise
13 duckdb:vortex-file-compressed +1.6% +0.3% +1.3% +10.0% ➖ noise
14 datafusion:vortex-file-compressed -1.3% -0.4% -0.9% +10.0% ➖ noise
14 duckdb:duckdb +2.2% -0.4% +2.5% +10.0% ➖ noise
14 duckdb:vortex-file-compressed +0.9% -0.4% +1.2% +10.0% ➖ noise
15 datafusion:vortex-file-compressed -2.1% +1.1% -3.1% +10.0% ➖ noise
15 duckdb:duckdb +1.4% +1.1% +0.4% +10.0% ➖ noise
15 duckdb:vortex-file-compressed -0.5% +1.1% -1.5% +10.0% ➖ noise
16 datafusion:vortex-file-compressed +0.6% +1.4% -0.8% +10.0% ➖ noise
16 duckdb:duckdb -4.4% +1.4% -5.7% +10.0% ➖ noise
16 duckdb:vortex-file-compressed -0.0% +1.4% -1.4% +10.0% ➖ noise
17 datafusion:vortex-file-compressed +0.5% -1.1% +1.7% +10.0% ➖ noise
17 duckdb:duckdb -0.7% -1.1% +0.5% +10.0% ➖ noise
17 duckdb:vortex-file-compressed +3.5% -1.1% +4.7% +10.0% ➖ noise
18 datafusion:vortex-file-compressed -0.5% +0.1% -0.5% +10.0% ➖ noise
18 duckdb:duckdb -4.9% +0.1% -5.0% +10.0% ➖ noise
18 duckdb:vortex-file-compressed +4.1% +0.1% +4.0% +10.0% ➖ noise
19 datafusion:vortex-file-compressed +3.7% +1.2% +2.5% +22.4% ➖ noise
19 duckdb:duckdb -1.3% +1.2% -2.5% +13.0% ➖ noise
19 duckdb:vortex-file-compressed -2.8% +1.2% -4.0% +12.8% ➖ noise
20 datafusion:vortex-file-compressed -0.4% -0.2% -0.2% +209.7% ➖ noise
20 duckdb:duckdb -27.9% -0.2% -27.7% +23.7% ✅ faster
20 duckdb:vortex-file-compressed -3.7% -0.2% -3.5% +48.4% ➖ noise
21 datafusion:vortex-file-compressed +0.7% -0.4% +1.1% +10.0% ➖ noise
21 duckdb:duckdb -11.1% -0.4% -10.8% +10.0% ✅ faster
21 duckdb:vortex-file-compressed +4.2% -0.4% +4.6% +10.0% ➖ noise
22 datafusion:vortex-file-compressed -0.3% +0.1% -0.4% +15.6% ➖ noise
22 duckdb:duckdb -12.5% +0.1% -12.6% +11.9% ✅ faster
22 duckdb:vortex-file-compressed -19.2% +0.1% -19.3% +20.3% ✅ faster
23 datafusion:vortex-file-compressed -9.7% +0.3% -10.0% +41.5% ➖ noise
23 duckdb:duckdb -1.1% +0.3% -1.4% +10.0% ➖ noise
23 duckdb:vortex-file-compressed -8.8% +0.3% -9.0% +52.7% ➖ noise
24 datafusion:vortex-file-compressed +4.0% -0.9% +4.9% +10.8% ➖ noise
24 duckdb:duckdb -3.1% -0.9% -2.3% +10.0% ➖ noise
24 duckdb:vortex-file-compressed -5.9% -0.9% -5.1% +21.3% ➖ noise
25 datafusion:vortex-file-compressed -3.6% -0.4% -3.2% +10.0% ➖ noise
25 duckdb:duckdb +0.2% -0.4% +0.5% +10.0% ➖ noise
25 duckdb:vortex-file-compressed -2.1% -0.4% -1.7% +10.0% ➖ noise
26 datafusion:vortex-file-compressed +2.0% -0.1% +2.2% +10.0% ➖ noise
26 duckdb:duckdb -1.0% -0.1% -0.8% +11.6% ➖ noise
26 duckdb:vortex-file-compressed -10.8% -0.1% -10.7% +17.7% ➖ noise
27 datafusion:vortex-file-compressed -0.6% +0.4% -1.0% +10.0% ➖ noise
27 duckdb:duckdb -16.5% +0.4% -16.9% +13.4% ✅ faster
27 duckdb:vortex-file-compressed -0.2% +0.4% -0.6% +10.0% ➖ noise
28 datafusion:vortex-file-compressed +0.3% -0.8% +1.1% +10.0% ➖ noise
28 duckdb:duckdb -1.7% -0.8% -0.9% +10.0% ➖ noise
28 duckdb:vortex-file-compressed +0.2% -0.8% +1.0% +10.0% ➖ noise
29 datafusion:vortex-file-compressed +1.5% -1.6% +3.1% +10.0% ➖ noise
29 duckdb:duckdb +1.0% -1.6% +2.6% +10.0% ➖ noise
29 duckdb:vortex-file-compressed -1.0% -1.6% +0.6% +17.3% ➖ noise
30 datafusion:vortex-file-compressed -3.4% +1.0% -4.4% +10.0% ➖ noise
30 duckdb:duckdb -2.8% +1.0% -3.8% +10.0% ➖ noise
30 duckdb:vortex-file-compressed +0.5% +1.0% -0.5% +10.0% ➖ noise
31 datafusion:vortex-file-compressed +0.6% +0.8% -0.2% +10.0% ➖ noise
31 duckdb:duckdb -7.8% +0.8% -8.5% +10.0% ➖ noise
31 duckdb:vortex-file-compressed +0.2% +0.8% -0.6% +10.0% ➖ noise
32 datafusion:vortex-file-compressed +2.2% -0.7% +2.9% +10.0% ➖ noise
32 duckdb:duckdb -5.7% -0.7% -5.0% +10.0% ➖ noise
32 duckdb:vortex-file-compressed +0.8% -0.7% +1.6% +10.0% ➖ noise
33 datafusion:vortex-file-compressed -0.9% -2.1% +1.3% +10.0% ➖ noise
33 duckdb:duckdb +2.0% -2.1% +4.3% +10.0% ➖ noise
33 duckdb:vortex-file-compressed -2.0% -2.1% +0.1% +10.0% ➖ noise
34 datafusion:vortex-file-compressed +0.8% -1.5% +2.3% +10.0% ➖ noise
34 duckdb:duckdb +5.3% -1.5% +6.9% +10.0% ➖ noise
34 duckdb:vortex-file-compressed -1.2% -1.5% +0.3% +10.0% ➖ noise
35 datafusion:vortex-file-compressed -3.4% -1.0% -2.4% +10.0% ➖ noise
35 duckdb:duckdb +1.9% -1.0% +2.9% +10.0% ➖ noise
35 duckdb:vortex-file-compressed -1.9% -1.0% -0.9% +10.0% ➖ noise
36 datafusion:vortex-file-compressed +1.6% -4.1% +6.0% +12.2% ➖ noise
36 duckdb:duckdb +3.0% -4.1% +7.4% +15.5% ➖ noise
36 duckdb:vortex-file-compressed -15.7% -4.1% -12.1% +14.7% ➖ noise
37 datafusion:vortex-file-compressed -1.1% +3.3% -4.2% +10.0% ➖ noise
37 duckdb:duckdb +0.4% +3.3% -2.7% +10.0% ➖ noise
37 duckdb:vortex-file-compressed -16.0% +3.3% -18.7% +10.0% ✅ faster
38 datafusion:vortex-file-compressed +0.6% -1.1% +1.7% +14.6% ➖ noise
38 duckdb:duckdb +0.6% -1.1% +1.7% +12.3% ➖ noise
38 duckdb:vortex-file-compressed -16.7% -1.1% -15.8% +13.1% ✅ faster
39 datafusion:vortex-file-compressed +0.4% -9.4% +10.8% +10.0% 🚨 regression
39 duckdb:duckdb +2.6% -9.4% +13.3% +19.0% ➖ noise
39 duckdb:vortex-file-compressed -7.4% -9.4% +2.2% +10.0% ➖ noise
40 datafusion:vortex-file-compressed +3.9% +2.4% +1.5% +10.0% ➖ noise
40 duckdb:duckdb +1.3% +2.4% -1.0% +10.0% ➖ noise
40 duckdb:vortex-file-compressed -18.9% +2.4% -20.7% +12.3% ✅ faster
41 datafusion:vortex-file-compressed -2.7% +1.3% -4.0% +12.0% ➖ noise
41 duckdb:duckdb -4.1% +1.3% -5.3% +12.1% ➖ noise
41 duckdb:vortex-file-compressed -12.5% +1.3% -13.6% +19.3% ➖ noise
42 datafusion:vortex-file-compressed -0.0% +0.9% -0.9% +10.0% ➖ noise
42 duckdb:duckdb +0.2% +0.9% -0.7% +10.0% ➖ noise
42 duckdb:vortex-file-compressed -12.1% +0.9% -12.9% +21.6% ➖ noise

Signed-off-by: Joe Isaacs <joe.isaacs@live.co.uk>
Signed-off-by: Joe Isaacs <joe.isaacs@live.co.uk>
Signed-off-by: Joe Isaacs <joe.isaacs@live.co.uk>
@joseph-isaacs joseph-isaacs added changelog/feature A new feature action/benchmark Trigger full benchmarks to run on this PR labels Apr 28, 2026
@github-actions github-actions Bot removed the action/benchmark Trigger full benchmarks to run on this PR label Apr 28, 2026
@github-actions
Copy link
Copy Markdown
Contributor

github-actions Bot commented Apr 28, 2026

Polar Signals Profiling Results

Latest Run

Status Commit Job Attempt Link
🟢 Done f8096d6 1 Explore Profiling Data

Powered by Polar Signals Cloud

@github-actions
Copy link
Copy Markdown
Contributor

File Sizes: PolarSignals Profiling

No file size changes detected.

@github-actions
Copy link
Copy Markdown
Contributor

File Sizes: FineWeb NVMe

No file size changes detected.

@github-actions
Copy link
Copy Markdown
Contributor

File Sizes: TPC-H SF=1 on NVME

No file size changes detected.

@github-actions
Copy link
Copy Markdown
Contributor

File Sizes: TPC-DS SF=1 on NVME

No file size changes detected.

@github-actions
Copy link
Copy Markdown
Contributor

File Sizes: TPC-H SF=10 on NVME

No file size changes detected.

@github-actions
Copy link
Copy Markdown
Contributor

File Sizes: Statistical and Population Genetics

No file size changes detected.

@github-actions
Copy link
Copy Markdown
Contributor

File Sizes: Clickbench on NVME

File Size Changes (1 files changed, -0.0% overall, 0↑ 1↓)
File Scale Format Base HEAD Change %
duckdb.db 1.0 vortex-compact 268.00 KB 0 B 268.00 KB -100.0%

Totals:

  • vortex-compact: 7.06 GB → 7.06 GB (-0.0%)
  • vortex-file-compressed: 14.01 GB → 14.01 GB (0.0%)

Signed-off-by: Joe Isaacs <joe.isaacs@live.co.uk>
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

changelog/feature A new feature

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant