Skip to content

alp_rd: speedup#7064

Open
joseph-isaacs wants to merge 4 commits intodevelopfrom
ji/alp-rd-speedup
Open

alp_rd: speedup#7064
joseph-isaacs wants to merge 4 commits intodevelopfrom
ji/alp-rd-speedup

Conversation

@joseph-isaacs
Copy link
Contributor

Summary

Closes: #000

Testing

Signed-off-by: Joe Isaacs <joe.isaacs@live.co.uk>
@joseph-isaacs joseph-isaacs changed the title fix alp_rd: speedup Mar 19, 2026
@joseph-isaacs joseph-isaacs added the changelog/performance A performance improvement label Mar 19, 2026
@codspeed-hq
Copy link

codspeed-hq bot commented Mar 19, 2026

Merging this PR will improve performance by 93.56%

⚡ 3 improved benchmarks
✅ 1005 untouched benchmarks
🆕 24 new benchmarks
⏩ 1530 skipped benchmarks1

Performance Changes

Mode Benchmark BASE HEAD Efficiency
Simulation alp_rd_decompress_f64 2.3 ms 1.2 ms +93.56%
Simulation bitwise_not_vortex_buffer_mut[128] 376.1 ns 317.8 ns +18.36%
Simulation bitwise_not_vortex_buffer_mut[1024] 535.6 ns 477.2 ns +12.22%
🆕 Simulation compress_rd[f64, (10000, 0.01)] N/A 490 µs N/A
🆕 Simulation compress_rd[f64, (10000, 0.1)] N/A 491.4 µs N/A
🆕 Simulation compress_rd[f64, (100000, 0.0)] N/A 4.5 ms N/A
🆕 Simulation compress_rd[f32, (10000, 0.0)] N/A 380.2 µs N/A
🆕 Simulation compress_rd[f32, (100000, 0.0)] N/A 3.5 ms N/A
🆕 Simulation compress_rd[f64, (100000, 0.1)] N/A 4.5 ms N/A
🆕 Simulation compress_rd[f32, (100000, 0.01)] N/A 3.5 ms N/A
🆕 Simulation compress_rd[f32, (10000, 0.1)] N/A 381.1 µs N/A
🆕 Simulation compress_rd[f32, (10000, 0.01)] N/A 379.2 µs N/A
🆕 Simulation compress_rd[f64, (10000, 0.0)] N/A 489.8 µs N/A
🆕 Simulation compress_rd[f32, (100000, 0.1)] N/A 3.6 ms N/A
🆕 Simulation compress_rd[f64, (100000, 0.01)] N/A 4.5 ms N/A
🆕 Simulation decompress_rd[f32, (10000, 0.0)] N/A 139.5 µs N/A
🆕 Simulation decompress_rd[f32, (10000, 0.01)] N/A 98.3 µs N/A
🆕 Simulation decompress_rd[f32, (10000, 0.1)] N/A 97.9 µs N/A
🆕 Simulation decompress_rd[f32, (100000, 0.01)] N/A 614.5 µs N/A
🆕 Simulation decompress_rd[f64, (10000, 0.0)] N/A 144.8 µs N/A
... ... ... ... ... ...

ℹ️ Only the first 20 benchmarks are displayed. Go to the app to view all benchmarks.


Comparing ji/alp-rd-speedup (f391bbf) with develop (cf1c050)

Open in CodSpeed

Footnotes

  1. 1530 benchmarks were skipped, so the baseline results were used instead. If they were deleted from the codebase, click here and archive them to remove them from the performance reports.

@joseph-isaacs joseph-isaacs added the action/benchmark Trigger full benchmarks to run on this PR label Mar 19, 2026
@github-actions github-actions bot removed the action/benchmark Trigger full benchmarks to run on this PR label Mar 19, 2026
@github-actions
Copy link
Contributor

github-actions bot commented Mar 19, 2026

Polar Signals Profiling Results

Latest Run

Status Commit Job Attempt Link
🟢 Done d2668cf 1 Explore Profiling Data

Powered by Polar Signals Cloud

@github-actions
Copy link
Contributor

Benchmarks: PolarSignals Profiling

Vortex (geomean): 1.009x ➖


datafusion / vortex-file-compressed (1.009x ➖, 0↑ 0↓)
name PR d2668cf (ns) base 8efe1dc (ns) ratio (PR/base)
polarsignals_q00/datafusion:vortex-file-compressed 113738483 114161179 1.00
polarsignals_q01/datafusion:vortex-file-compressed 339459859 337473660 1.01
polarsignals_q02/datafusion:vortex-file-compressed 21279959 21400031 0.99
polarsignals_q03/datafusion:vortex-file-compressed 346683917 342260130 1.01
polarsignals_q04/datafusion:vortex-file-compressed 11360356 11796300 0.96
polarsignals_q05/datafusion:vortex-file-compressed 16191560 15329907 1.06
polarsignals_q06/datafusion:vortex-file-compressed 19211769 19618797 0.98
polarsignals_q07/datafusion:vortex-file-compressed 12083194 12058926 1.00
polarsignals_q08/datafusion:vortex-file-compressed 424811340 428175655 0.99
polarsignals_q09/datafusion:vortex-file-compressed 11743613 10781993 1.09

@github-actions
Copy link
Contributor

Benchmarks: TPC-H SF=1 on NVME

Verdict: No clear signal (environment too noisy confidence)
Attributed Vortex impact: +2.3%
Vortex (geomean): 1.070x ➖
Parquet (geomean): 1.057x ➖
Shifts: Parquet (control) +5.7% · Median polish +7.8%


datafusion / vortex-file-compressed (1.082x ➖, 0↑ 9↓)
name PR d2668cf (ns) base 8efe1dc (ns) ratio (PR/base)
tpch_q01/datafusion:vortex-file-compressed 55590255 53481592 1.04
tpch_q02/datafusion:vortex-file-compressed 🚨 55543394 50050710 1.11
tpch_q03/datafusion:vortex-file-compressed 🚨 31306801 27817138 1.13
tpch_q04/datafusion:vortex-file-compressed 19746783 18932571 1.04
tpch_q05/datafusion:vortex-file-compressed 🚨 84541855 74803461 1.13
tpch_q06/datafusion:vortex-file-compressed 🚨 11006019 9985911 1.10
tpch_q07/datafusion:vortex-file-compressed 🚨 98610471 87775885 1.12
tpch_q08/datafusion:vortex-file-compressed 🚨 71971073 65361675 1.10
tpch_q09/datafusion:vortex-file-compressed 🚨 94475892 85784270 1.10
tpch_q10/datafusion:vortex-file-compressed 82583476 76512074 1.08
tpch_q11/datafusion:vortex-file-compressed 21751348 19839592 1.10
tpch_q12/datafusion:vortex-file-compressed 35439536 34564976 1.03
tpch_q13/datafusion:vortex-file-compressed 🚨 30068790 27296727 1.10
tpch_q14/datafusion:vortex-file-compressed 🚨 30103536 27047693 1.11
tpch_q15/datafusion:vortex-file-compressed 27297992 24970326 1.09
tpch_q16/datafusion:vortex-file-compressed 36494074 33495415 1.09
tpch_q17/datafusion:vortex-file-compressed 83249859 77087283 1.08
tpch_q18/datafusion:vortex-file-compressed 108295754 104513541 1.04
tpch_q19/datafusion:vortex-file-compressed 37816066 35428219 1.07
tpch_q20/datafusion:vortex-file-compressed 51962855 49253702 1.06
tpch_q21/datafusion:vortex-file-compressed 100952990 95061992 1.06
tpch_q22/datafusion:vortex-file-compressed 15772327 15131037 1.04
datafusion / vortex-compact (1.088x ➖, 0↑ 9↓)
name PR d2668cf (ns) base 8efe1dc (ns) ratio (PR/base)
tpch_q01/datafusion:vortex-compact 63822290 60620243 1.05
tpch_q02/datafusion:vortex-compact 55679627 53078806 1.05
tpch_q03/datafusion:vortex-compact 35105734 32322107 1.09
tpch_q04/datafusion:vortex-compact 24752252 23094920 1.07
tpch_q05/datafusion:vortex-compact 89354752 83413154 1.07
tpch_q06/datafusion:vortex-compact 14635411 13400729 1.09
tpch_q07/datafusion:vortex-compact 🚨 104362686 94857421 1.10
tpch_q08/datafusion:vortex-compact 🚨 80898849 72323753 1.12
tpch_q09/datafusion:vortex-compact 🚨 104418179 91298723 1.14
tpch_q10/datafusion:vortex-compact 🚨 88264357 78105813 1.13
tpch_q11/datafusion:vortex-compact 🚨 22757235 20506881 1.11
tpch_q12/datafusion:vortex-compact 47561216 44449828 1.07
tpch_q13/datafusion:vortex-compact 39640608 36207840 1.09
tpch_q14/datafusion:vortex-compact 33742458 31217218 1.08
tpch_q15/datafusion:vortex-compact 🚨 35663225 32093449 1.11
tpch_q16/datafusion:vortex-compact 🚨 44220075 38550468 1.15
tpch_q17/datafusion:vortex-compact 🚨 89438535 79658887 1.12
tpch_q18/datafusion:vortex-compact 🚨 121454496 107237552 1.13
tpch_q19/datafusion:vortex-compact 46915700 44301830 1.06
tpch_q20/datafusion:vortex-compact 58252006 55739739 1.05
tpch_q21/datafusion:vortex-compact 112553019 106543208 1.06
tpch_q22/datafusion:vortex-compact 16285434 16335330 1.00
datafusion / parquet (1.065x ➖, 1↑ 4↓)
name PR d2668cf (ns) base 8efe1dc (ns) ratio (PR/base)
tpch_q01/datafusion:parquet 151043400 138242270 1.09
tpch_q02/datafusion:parquet 89043747 82075848 1.08
tpch_q03/datafusion:parquet 92056231 86370868 1.07
tpch_q04/datafusion:parquet 56993393 53875496 1.06
tpch_q05/datafusion:parquet 174878321 163483250 1.07
tpch_q06/datafusion:parquet 45766225 47299169 0.97
tpch_q07/datafusion:parquet 187717916 182856013 1.03
tpch_q08/datafusion:parquet 169325725 158113604 1.07
tpch_q09/datafusion:parquet 223967044 215323073 1.04
tpch_q10/datafusion:parquet 200435933 187769870 1.07
tpch_q11/datafusion:parquet 65971952 60488659 1.09
tpch_q12/datafusion:parquet 124001124 123546879 1.00
tpch_q13/datafusion:parquet 🚨 221990385 196759730 1.13
tpch_q14/datafusion:parquet 83597759 80089771 1.04
tpch_q15/datafusion:parquet 🚨 81297572 67386050 1.21
tpch_q16/datafusion:parquet 🚨 62853978 54655245 1.15
tpch_q17/datafusion:parquet 🚨 197061190 169716217 1.16
tpch_q18/datafusion:parquet 245443252 229383726 1.07
tpch_q19/datafusion:parquet 🚀 86619195 103820957 0.83
tpch_q20/datafusion:parquet 128252349 117724669 1.09
tpch_q21/datafusion:parquet 200514109 186241082 1.08
tpch_q22/datafusion:parquet 42527489 39371503 1.08
datafusion / arrow (1.124x ❌, 0↑ 16↓)
name PR d2668cf (ns) base 8efe1dc (ns) ratio (PR/base)
tpch_q01/datafusion:arrow 66682683 69490624 0.96
tpch_q02/datafusion:arrow 24281214 23288373 1.04
tpch_q03/datafusion:arrow 🚨 42151219 37664441 1.12
tpch_q04/datafusion:arrow 🚨 35217236 31090653 1.13
tpch_q05/datafusion:arrow 🚨 101134938 91635964 1.10
tpch_q06/datafusion:arrow 🚨 23516786 21330605 1.10
tpch_q07/datafusion:arrow 🚨 213610147 166417041 1.28
tpch_q08/datafusion:arrow 🚨 53998244 45866137 1.18
tpch_q09/datafusion:arrow 🚨 87411807 74882876 1.17
tpch_q10/datafusion:arrow 🚨 64113380 56443448 1.14
tpch_q11/datafusion:arrow 🚨 13394316 11591752 1.16
tpch_q12/datafusion:arrow 🚨 64002854 57191107 1.12
tpch_q13/datafusion:arrow 53036902 50243608 1.06
tpch_q14/datafusion:arrow 27951107 25825836 1.08
tpch_q15/datafusion:arrow 🚨 57450740 49863137 1.15
tpch_q16/datafusion:arrow 25664389 23611130 1.09
tpch_q17/datafusion:arrow 90721759 85802305 1.06
tpch_q18/datafusion:arrow 🚨 178329935 161805273 1.10
tpch_q19/datafusion:arrow 🚨 48321880 40656850 1.19
tpch_q20/datafusion:arrow 🚨 46963842 41313433 1.14
tpch_q21/datafusion:arrow 🚨 302008595 231421870 1.31
tpch_q22/datafusion:arrow 🚨 23491317 20993990 1.12
duckdb / vortex-file-compressed (1.050x ➖, 0↑ 3↓)
name PR d2668cf (ns) base 8efe1dc (ns) ratio (PR/base)
tpch_q01/duckdb:vortex-file-compressed 33233989 33511655 0.99
tpch_q02/duckdb:vortex-file-compressed 29578110 28147748 1.05
tpch_q03/duckdb:vortex-file-compressed 30571036 30525823 1.00
tpch_q04/duckdb:vortex-file-compressed 30192879 28800604 1.05
tpch_q05/duckdb:vortex-file-compressed 35561163 33448026 1.06
tpch_q06/duckdb:vortex-file-compressed 🚨 11853402 10520795 1.13
tpch_q07/duckdb:vortex-file-compressed 39188938 36118642 1.09
tpch_q08/duckdb:vortex-file-compressed 44931651 41538107 1.08
tpch_q09/duckdb:vortex-file-compressed 80273626 83957896 0.96
tpch_q10/duckdb:vortex-file-compressed 39192399 36271905 1.08
tpch_q11/duckdb:vortex-file-compressed 16404760 16029753 1.02
tpch_q12/duckdb:vortex-file-compressed 🚨 26033076 23217556 1.12
tpch_q13/duckdb:vortex-file-compressed 39028071 37309484 1.05
tpch_q14/duckdb:vortex-file-compressed 21631345 21640659 1.00
tpch_q15/duckdb:vortex-file-compressed 16313035 15871989 1.03
tpch_q16/duckdb:vortex-file-compressed 31050317 29759789 1.04
tpch_q17/duckdb:vortex-file-compressed 25647855 25540154 1.00
tpch_q18/duckdb:vortex-file-compressed 51173765 47781561 1.07
tpch_q19/duckdb:vortex-file-compressed 🚨 35945996 32411168 1.11
tpch_q20/duckdb:vortex-file-compressed 35719249 34172483 1.05
tpch_q21/duckdb:vortex-file-compressed 109301111 101126292 1.08
tpch_q22/duckdb:vortex-file-compressed 19832531 18560283 1.07
duckdb / vortex-compact (1.060x ➖, 0↑ 2↓)
name PR d2668cf (ns) base 8efe1dc (ns) ratio (PR/base)
tpch_q01/duckdb:vortex-compact 41315752 40135706 1.03
tpch_q02/duckdb:vortex-compact 39699305 36738692 1.08
tpch_q03/duckdb:vortex-compact 34698037 33256815 1.04
tpch_q04/duckdb:vortex-compact 36312360 35401774 1.03
tpch_q05/duckdb:vortex-compact 38917788 37908804 1.03
tpch_q06/duckdb:vortex-compact 15543663 15182909 1.02
tpch_q07/duckdb:vortex-compact 🚨 46238114 41749701 1.11
tpch_q08/duckdb:vortex-compact 49504881 45074880 1.10
tpch_q09/duckdb:vortex-compact 93088831 89981178 1.03
tpch_q10/duckdb:vortex-compact 42634811 40448579 1.05
tpch_q11/duckdb:vortex-compact 20892621 19699427 1.06
tpch_q12/duckdb:vortex-compact 39254886 35904334 1.09
tpch_q13/duckdb:vortex-compact 49689100 47004332 1.06
tpch_q14/duckdb:vortex-compact 31877597 29472414 1.08
tpch_q15/duckdb:vortex-compact 20940220 19673283 1.06
tpch_q16/duckdb:vortex-compact 37301940 36397323 1.02
tpch_q17/duckdb:vortex-compact 31641386 30596685 1.03
tpch_q18/duckdb:vortex-compact 52792277 50403980 1.05
tpch_q19/duckdb:vortex-compact 🚨 42500381 37328227 1.14
tpch_q20/duckdb:vortex-compact 47065031 45567557 1.03
tpch_q21/duckdb:vortex-compact 119655684 110099789 1.09
tpch_q22/duckdb:vortex-compact 22387884 20479099 1.09
duckdb / parquet (1.049x ➖, 2↑ 5↓)
name PR d2668cf (ns) base 8efe1dc (ns) ratio (PR/base)
tpch_q01/duckdb:parquet 🚨 102748681 76613317 1.34
tpch_q02/duckdb:parquet 40791330 39629091 1.03
tpch_q03/duckdb:parquet 71146221 68999793 1.03
tpch_q04/duckdb:parquet 48769428 48337642 1.01
tpch_q05/duckdb:parquet 69599792 67167116 1.04
tpch_q06/duckdb:parquet 21055136 21300817 0.99
tpch_q07/duckdb:parquet 🚨 86652085 67604848 1.28
tpch_q08/duckdb:parquet 🚨 101745323 87085230 1.17
tpch_q09/duckdb:parquet 159986467 155075043 1.03
tpch_q10/duckdb:parquet 146097411 136227829 1.07
tpch_q11/duckdb:parquet 24045400 23263354 1.03
tpch_q12/duckdb:parquet 56314902 56255805 1.00
tpch_q13/duckdb:parquet 🚨 293945607 259608842 1.13
tpch_q14/duckdb:parquet 51828227 48831629 1.06
tpch_q15/duckdb:parquet 🚀 25045289 32686795 0.77
tpch_q16/duckdb:parquet 57326088 54530618 1.05
tpch_q17/duckdb:parquet 59154879 54992794 1.08
tpch_q18/duckdb:parquet 117942664 117449728 1.00
tpch_q19/duckdb:parquet 🚀 73468018 86067232 0.85
tpch_q20/duckdb:parquet 64879862 62327642 1.04
tpch_q21/duckdb:parquet 🚨 188708744 161224862 1.17
tpch_q22/duckdb:parquet 54215615 52372787 1.04
duckdb / duckdb (1.082x ➖, 0↑ 7↓)
name PR d2668cf (ns) base 8efe1dc (ns) ratio (PR/base)
tpch_q01/duckdb:duckdb 16539296 16543750 1.00
tpch_q02/duckdb:duckdb 🚨 13628382 12084645 1.13
tpch_q03/duckdb:duckdb 19525098 19563130 1.00
tpch_q04/duckdb:duckdb 🚨 20517866 18372403 1.12
tpch_q05/duckdb:duckdb 🚨 22134533 19321918 1.15
tpch_q06/duckdb:duckdb 5839913 5437366 1.07
tpch_q07/duckdb:duckdb 24255761 22238014 1.09
tpch_q08/duckdb:duckdb 21978229 20610153 1.07
tpch_q09/duckdb:duckdb 🚨 60596510 54260673 1.12
tpch_q10/duckdb:duckdb 🚨 49958014 42549536 1.17
tpch_q11/duckdb:duckdb 🚨 6459625 5762030 1.12
tpch_q12/duckdb:duckdb 14577271 13441672 1.08
tpch_q13/duckdb:duckdb 41036143 37372084 1.10
tpch_q14/duckdb:duckdb 18256352 16767945 1.09
tpch_q15/duckdb:duckdb 12319303 11848099 1.04
tpch_q16/duckdb:duckdb 23870948 22950032 1.04
tpch_q17/duckdb:duckdb 14745476 13507378 1.09
tpch_q18/duckdb:duckdb 41023037 37776800 1.09
tpch_q19/duckdb:duckdb 🚨 30562036 26886835 1.14
tpch_q20/duckdb:duckdb 23463060 23219946 1.01
tpch_q21/duckdb:duckdb 61640042 56236623 1.10
tpch_q22/duckdb:duckdb 25320541 24518744 1.03
Full attributed analysis
Query Config Raw Δ Control Δ Attributed α Noise floor Significant?
1 datafusion:arrow -4.0% +21.1% -20.7% +29.4% ➖ noise
1 datafusion:vortex-compact +5.3% +21.1% -13.0% +26.9% ➖ noise
1 datafusion:vortex-file-compressed +3.9% +21.1% -14.1% +27.8% ➖ noise
1 duckdb:duckdb -0.0% +21.1% -17.4% +26.9% ➖ noise
1 duckdb:vortex-compact +2.9% +21.1% -15.0% +27.4% ➖ noise
1 duckdb:vortex-file-compressed -0.8% +21.1% -18.1% +26.4% ➖ noise
2 datafusion:arrow +4.3% +5.7% -1.3% +20.6% ➖ noise
2 datafusion:vortex-compact +4.9% +5.7% -0.7% +20.6% ➖ noise
2 datafusion:vortex-file-compressed +11.0% +5.7% +5.0% +20.6% ➖ noise
2 duckdb:duckdb +12.8% +5.7% +6.7% +20.6% ➖ noise
2 duckdb:vortex-compact +8.1% +5.7% +2.3% +20.6% ➖ noise
2 duckdb:vortex-file-compressed +5.1% +5.7% -0.6% +20.6% ➖ noise
3 datafusion:arrow +11.9% +4.8% +6.8% +20.6% ➖ noise
3 datafusion:vortex-compact +8.6% +4.8% +3.6% +20.6% ➖ noise
3 datafusion:vortex-file-compressed +12.5% +4.8% +7.4% +20.6% ➖ noise
3 duckdb:duckdb -0.2% +4.8% -4.8% +20.6% ➖ noise
3 duckdb:vortex-compact +4.3% +4.8% -0.5% +20.6% ➖ noise
3 duckdb:vortex-file-compressed +0.1% +4.8% -4.5% +20.6% ➖ noise
4 datafusion:arrow +13.3% +3.3% +9.6% +20.6% ➖ noise
4 datafusion:vortex-compact +7.2% +3.3% +3.7% +20.6% ➖ noise
4 datafusion:vortex-file-compressed +4.3% +3.3% +1.0% +20.6% ➖ noise
4 duckdb:duckdb +11.7% +3.3% +8.1% +20.6% ➖ noise
4 duckdb:vortex-compact +2.6% +3.3% -0.7% +20.6% ➖ noise
4 duckdb:vortex-file-compressed +4.8% +3.3% +1.5% +20.6% ➖ noise
5 datafusion:arrow +10.4% +5.3% +4.8% +20.6% ➖ noise
5 datafusion:vortex-compact +7.1% +5.3% +1.7% +20.6% ➖ noise
5 datafusion:vortex-file-compressed +13.0% +5.3% +7.3% +20.6% ➖ noise
5 duckdb:duckdb +14.6% +5.3% +8.8% +20.6% ➖ noise
5 duckdb:vortex-compact +2.7% +5.3% -2.5% +20.6% ➖ noise
5 duckdb:vortex-file-compressed +6.3% +5.3% +1.0% +20.6% ➖ noise
6 datafusion:arrow +10.2% -2.2% +12.7% +22.6% ➖ noise
6 datafusion:vortex-compact +9.2% -2.2% +11.7% +22.5% ➖ noise
6 datafusion:vortex-file-compressed +10.2% -2.2% +12.7% +24.4% ➖ noise
6 duckdb:duckdb +7.4% -2.2% +9.8% +26.6% ➖ noise
6 duckdb:vortex-compact +2.4% -2.2% +4.7% +21.6% ➖ noise
6 duckdb:vortex-file-compressed +12.7% -2.2% +15.2% +24.5% ➖ noise
7 datafusion:arrow +28.4% +14.7% +11.9% +20.6% ➖ noise
7 datafusion:vortex-compact +10.0% +14.7% -4.1% +20.6% ➖ noise
7 datafusion:vortex-file-compressed +12.3% +14.7% -2.1% +20.6% ➖ noise
7 duckdb:duckdb +9.1% +14.7% -4.9% +20.6% ➖ noise
7 duckdb:vortex-compact +10.8% +14.7% -3.5% +20.6% ➖ noise
7 duckdb:vortex-file-compressed +8.5% +14.7% -5.4% +20.6% ➖ noise
8 datafusion:arrow +17.7% +11.9% +5.3% +20.6% ➖ noise
8 datafusion:vortex-compact +11.9% +11.9% -0.0% +20.6% ➖ noise
8 datafusion:vortex-file-compressed +10.1% +11.9% -1.6% +20.6% ➖ noise
8 duckdb:duckdb +6.6% +11.9% -4.7% +24.0% ➖ noise
8 duckdb:vortex-compact +9.8% +11.9% -1.8% +20.6% ➖ noise
8 duckdb:vortex-file-compressed +8.2% +11.9% -3.3% +20.6% ➖ noise
9 datafusion:arrow +16.7% +3.6% +12.7% +20.6% ➖ noise
9 datafusion:vortex-compact +14.4% +3.6% +10.4% +20.6% ➖ noise
9 datafusion:vortex-file-compressed +10.1% +3.6% +6.3% +20.6% ➖ noise
9 duckdb:duckdb +11.7% +3.6% +7.8% +20.6% ➖ noise
9 duckdb:vortex-compact +3.5% +3.6% -0.1% +20.6% ➖ noise
9 duckdb:vortex-file-compressed -4.4% +3.6% -7.7% +20.6% ➖ noise
10 datafusion:arrow +13.6% +7.0% +6.2% +20.6% ➖ noise
10 datafusion:vortex-compact +13.0% +7.0% +5.6% +20.6% ➖ noise
10 datafusion:vortex-file-compressed +7.9% +7.0% +0.9% +20.6% ➖ noise
10 duckdb:duckdb +17.4% +7.0% +9.7% +20.6% ➖ noise
10 duckdb:vortex-compact +5.4% +7.0% -1.5% +20.6% ➖ noise
10 duckdb:vortex-file-compressed +8.1% +7.0% +1.0% +20.6% ➖ noise
11 datafusion:arrow +15.6% +6.2% +8.8% +20.6% ➖ noise
11 datafusion:vortex-compact +11.0% +6.2% +4.5% +20.6% ➖ noise
11 datafusion:vortex-file-compressed +9.6% +6.2% +3.3% +20.6% ➖ noise
11 duckdb:duckdb +12.1% +6.2% +5.6% +20.6% ➖ noise
11 duckdb:vortex-compact +6.1% +6.2% -0.1% +20.6% ➖ noise
11 duckdb:vortex-file-compressed +2.3% +6.2% -3.6% +20.6% ➖ noise
12 datafusion:arrow +11.9% +0.2% +11.6% +20.6% ➖ noise
12 datafusion:vortex-compact +7.0% +0.2% +6.7% +20.6% ➖ noise
12 datafusion:vortex-file-compressed +2.5% +0.2% +2.3% +20.6% ➖ noise
12 duckdb:duckdb +8.4% +0.2% +8.2% +20.6% ➖ noise
12 duckdb:vortex-compact +9.3% +0.2% +9.1% +20.6% ➖ noise
12 duckdb:vortex-file-compressed +12.1% +0.2% +11.9% +20.6% ➖ noise
13 datafusion:arrow +5.6% +13.0% -6.6% +20.6% ➖ noise
13 datafusion:vortex-compact +9.5% +13.0% -3.1% +20.6% ➖ noise
13 datafusion:vortex-file-compressed +10.2% +13.0% -2.5% +20.6% ➖ noise
13 duckdb:duckdb +9.8% +13.0% -2.8% +20.6% ➖ noise
13 duckdb:vortex-compact +5.7% +13.0% -6.5% +20.6% ➖ noise
13 duckdb:vortex-file-compressed +4.6% +13.0% -7.4% +20.6% ➖ noise
14 datafusion:arrow +8.2% +5.3% +2.8% +20.6% ➖ noise
14 datafusion:vortex-compact +8.1% +5.3% +2.7% +20.6% ➖ noise
14 datafusion:vortex-file-compressed +11.3% +5.3% +5.7% +20.6% ➖ noise
14 duckdb:duckdb +8.9% +5.3% +3.4% +20.6% ➖ noise
14 duckdb:vortex-compact +8.2% +5.3% +2.8% +20.6% ➖ noise
14 duckdb:vortex-file-compressed -0.0% +5.3% -5.0% +20.6% ➖ noise
15 datafusion:arrow +15.2% -3.9% +19.8% +20.6% ➖ noise
15 datafusion:vortex-compact +11.1% -3.9% +15.6% +20.6% ➖ noise
15 datafusion:vortex-file-compressed +9.3% -3.9% +13.7% +20.6% ➖ noise
15 duckdb:duckdb +4.0% -3.9% +8.1% +22.7% ➖ noise
15 duckdb:vortex-compact +6.4% -3.9% +10.7% +20.6% ➖ noise
15 duckdb:vortex-file-compressed +2.8% -3.9% +6.9% +20.6% ➖ noise
16 datafusion:arrow +8.7% +10.0% -1.1% +20.6% ➖ noise
16 datafusion:vortex-compact +14.7% +10.0% +4.3% +20.6% ➖ noise
16 datafusion:vortex-file-compressed +9.0% +10.0% -0.9% +20.6% ➖ noise
16 duckdb:duckdb +4.0% +10.0% -5.4% +20.6% ➖ noise
16 duckdb:vortex-compact +2.5% +10.0% -6.8% +20.6% ➖ noise
16 duckdb:vortex-file-compressed +4.3% +10.0% -5.1% +20.6% ➖ noise
17 datafusion:arrow +5.7% +11.8% -5.4% +20.6% ➖ noise
17 datafusion:vortex-compact +12.3% +11.8% +0.5% +20.6% ➖ noise
17 datafusion:vortex-file-compressed +8.0% +11.8% -3.4% +20.6% ➖ noise
17 duckdb:duckdb +9.2% +11.8% -2.3% +20.6% ➖ noise
17 duckdb:vortex-compact +3.4% +11.8% -7.5% +20.6% ➖ noise
17 duckdb:vortex-file-compressed +0.4% +11.8% -10.1% +20.6% ➖ noise
18 datafusion:arrow +10.2% +3.7% +6.3% +20.6% ➖ noise
18 datafusion:vortex-compact +13.3% +3.7% +9.3% +20.6% ➖ noise
18 datafusion:vortex-file-compressed +3.6% +3.7% -0.0% +20.6% ➖ noise
18 duckdb:duckdb +8.6% +3.7% +4.8% +20.6% ➖ noise
18 duckdb:vortex-compact +4.7% +3.7% +1.0% +20.6% ➖ noise
18 duckdb:vortex-file-compressed +7.1% +3.7% +3.3% +20.6% ➖ noise
19 datafusion:arrow +18.9% -15.6% +40.8% +20.6% 🚨 regression
19 datafusion:vortex-compact +5.9% -15.6% +25.5% +20.6% 🚨 regression
19 datafusion:vortex-file-compressed +6.7% -15.6% +26.5% +20.6% 🚨 regression
19 duckdb:duckdb +13.7% -15.6% +34.7% +20.6% 🚨 regression
19 duckdb:vortex-compact +13.9% -15.6% +34.9% +20.6% 🚨 regression
19 duckdb:vortex-file-compressed +10.9% -15.6% +31.4% +20.6% 🚨 regression
20 datafusion:arrow +13.7% +6.5% +6.7% +20.6% ➖ noise
20 datafusion:vortex-compact +4.5% +6.5% -1.9% +20.6% ➖ noise
20 datafusion:vortex-file-compressed +5.5% +6.5% -0.9% +20.6% ➖ noise
20 duckdb:duckdb +1.0% +6.5% -5.1% +20.6% ➖ noise
20 duckdb:vortex-compact +3.3% +6.5% -3.0% +20.6% ➖ noise
20 duckdb:vortex-file-compressed +4.5% +6.5% -1.8% +20.6% ➖ noise
21 datafusion:arrow +30.5% +12.3% +16.3% +20.6% ➖ noise
21 datafusion:vortex-compact +5.6% +12.3% -5.9% +20.6% ➖ noise
21 datafusion:vortex-file-compressed +6.2% +12.3% -5.4% +20.6% ➖ noise
21 duckdb:duckdb +9.6% +12.3% -2.4% +20.6% ➖ noise
21 duckdb:vortex-compact +8.7% +12.3% -3.2% +20.6% ➖ noise
21 duckdb:vortex-file-compressed +8.1% +12.3% -3.7% +20.6% ➖ noise
22 datafusion:arrow +11.9% +5.7% +5.8% +20.7% ➖ noise
22 datafusion:vortex-compact -0.3% +5.7% -5.7% +20.6% ➖ noise
22 datafusion:vortex-file-compressed +4.2% +5.7% -1.4% +20.6% ➖ noise
22 duckdb:duckdb +3.3% +5.7% -2.3% +20.6% ➖ noise
22 duckdb:vortex-compact +9.3% +5.7% +3.4% +20.6% ➖ noise
22 duckdb:vortex-file-compressed +6.9% +5.7% +1.1% +20.6% ➖ noise

@github-actions
Copy link
Contributor

Benchmarks: FineWeb NVMe

Verdict: No clear signal (low confidence)
Attributed Vortex impact: +3.5%
Vortex (geomean): 1.052x ➖
Parquet (geomean): 1.017x ➖
Shifts: Parquet (control) +1.7% · Median polish +3.9%


datafusion / vortex-file-compressed (1.064x ➖, 0↑ 1↓)
name PR d2668cf (ns) base 8efe1dc (ns) ratio (PR/base)
fineweb_q00/datafusion:vortex-file-compressed 4490310 4612190 0.97
fineweb_q01/datafusion:vortex-file-compressed 26062219 24069752 1.08
fineweb_q02/datafusion:vortex-file-compressed 🚨 30681562 25724811 1.19
fineweb_q03/datafusion:vortex-file-compressed 81982066 75179896 1.09
fineweb_q04/datafusion:vortex-file-compressed 206847608 201953057 1.02
fineweb_q05/datafusion:vortex-file-compressed 194245904 185547695 1.05
fineweb_q06/datafusion:vortex-file-compressed 74206885 69076673 1.07
fineweb_q07/datafusion:vortex-file-compressed 69969049 64387251 1.09
fineweb_q08/datafusion:vortex-file-compressed 24625123 24121226 1.02
datafusion / vortex-compact (1.035x ➖, 0↑ 0↓)
name PR d2668cf (ns) base 8efe1dc (ns) ratio (PR/base)
fineweb_q00/datafusion:vortex-compact 4422041 4198383 1.05
fineweb_q01/datafusion:vortex-compact 167141030 162662211 1.03
fineweb_q02/datafusion:vortex-compact 166065326 164431318 1.01
fineweb_q03/datafusion:vortex-compact 1489849632 1449071498 1.03
fineweb_q04/datafusion:vortex-compact 1584808445 1543930083 1.03
fineweb_q05/datafusion:vortex-compact 1238750012 1223589116 1.01
fineweb_q06/datafusion:vortex-compact 732318456 692484784 1.06
fineweb_q07/datafusion:vortex-compact 750889839 728590320 1.03
fineweb_q08/datafusion:vortex-compact 23239864 21756625 1.07
datafusion / parquet (1.000x ➖, 0↑ 0↓)
name PR d2668cf (ns) base 8efe1dc (ns) ratio (PR/base)
fineweb_q00/datafusion:parquet 6233061 6115106 1.02
fineweb_q01/datafusion:parquet 272188737 273564264 0.99
fineweb_q02/datafusion:parquet 275584050 276369174 1.00
fineweb_q03/datafusion:parquet 275308218 272199647 1.01
fineweb_q04/datafusion:parquet 293040253 286575704 1.02
fineweb_q05/datafusion:parquet 285419578 284468254 1.00
fineweb_q06/datafusion:parquet 273722439 285610972 0.96
fineweb_q07/datafusion:parquet 270743295 270600669 1.00
fineweb_q08/datafusion:parquet 267580456 268250155 1.00
duckdb / vortex-file-compressed (1.033x ➖, 0↑ 1↓)
name PR d2668cf (ns) base 8efe1dc (ns) ratio (PR/base)
fineweb_q00/duckdb:vortex-file-compressed 3582955 3283228 1.09
fineweb_q01/duckdb:vortex-file-compressed 30230113 29263899 1.03
fineweb_q02/duckdb:vortex-file-compressed 26334377 26597556 0.99
fineweb_q03/duckdb:vortex-file-compressed 122890540 129378177 0.95
fineweb_q04/duckdb:vortex-file-compressed 185585714 195241188 0.95
fineweb_q05/duckdb:vortex-file-compressed 170365439 165264920 1.03
fineweb_q06/duckdb:vortex-file-compressed 70784485 66032672 1.07
fineweb_q07/duckdb:vortex-file-compressed 71632709 65662920 1.09
fineweb_q08/duckdb:vortex-file-compressed 🚨 27524326 24985609 1.10
duckdb / vortex-compact (1.078x ➖, 0↑ 2↓)
name PR d2668cf (ns) base 8efe1dc (ns) ratio (PR/base)
fineweb_q00/duckdb:vortex-compact 🚨 4575540 3813773 1.20
fineweb_q01/duckdb:vortex-compact 🚨 112064539 101627571 1.10
fineweb_q02/duckdb:vortex-compact 119782265 113995758 1.05
fineweb_q03/duckdb:vortex-compact 900758696 864133661 1.04
fineweb_q04/duckdb:vortex-compact 947190544 900981424 1.05
fineweb_q05/duckdb:vortex-compact 846841856 808061846 1.05
fineweb_q06/duckdb:vortex-compact 483567095 464287230 1.04
fineweb_q07/duckdb:vortex-compact 511126162 475729761 1.07
fineweb_q08/duckdb:vortex-compact 25909157 23619607 1.10
duckdb / parquet (1.034x ➖, 0↑ 0↓)
name PR d2668cf (ns) base 8efe1dc (ns) ratio (PR/base)
fineweb_q00/duckdb:parquet 37608726 36870964 1.02
fineweb_q01/duckdb:parquet 97491694 93625400 1.04
fineweb_q02/duckdb:parquet 100368386 95529280 1.05
fineweb_q03/duckdb:parquet 319092611 309149320 1.03
fineweb_q04/duckdb:parquet 449135055 436514097 1.03
fineweb_q05/duckdb:parquet 413704909 409255150 1.01
fineweb_q06/duckdb:parquet 200178773 197083514 1.02
fineweb_q07/duckdb:parquet 213214914 208261067 1.02
fineweb_q08/duckdb:parquet 61286452 56519859 1.08
Full attributed analysis
Query Config Raw Δ Control Δ Attributed α Noise floor Significant?
0 datafusion:vortex-compact +5.3% +2.0% +3.3% +52.5% ➖ noise
0 datafusion:vortex-file-compressed -2.6% +2.0% -4.5% +74.8% ➖ noise
0 duckdb:vortex-compact +20.0% +2.0% +17.7% +40.0% ➖ noise
0 duckdb:vortex-file-compressed +9.1% +2.0% +7.0% +53.3% ➖ noise
1 datafusion:vortex-compact +2.8% +1.8% +0.9% +13.0% ➖ noise
1 datafusion:vortex-file-compressed +8.3% +1.8% +6.4% +19.0% ➖ noise
1 duckdb:vortex-compact +10.3% +1.8% +8.3% +22.6% ➖ noise
1 duckdb:vortex-file-compressed +3.3% +1.8% +1.5% +39.4% ➖ noise
2 datafusion:vortex-compact +1.0% +2.4% -1.3% +10.0% ➖ noise
2 datafusion:vortex-file-compressed +19.3% +2.4% +16.5% +13.6% 🚨 regression
2 duckdb:vortex-compact +5.1% +2.4% +2.7% +10.3% ➖ noise
2 duckdb:vortex-file-compressed -1.0% +2.4% -3.3% +10.0% ➖ noise
3 datafusion:vortex-compact +2.8% +2.2% +0.6% +10.0% ➖ noise
3 datafusion:vortex-file-compressed +9.0% +2.2% +6.7% +23.9% ➖ noise
3 duckdb:vortex-compact +4.2% +2.2% +2.0% +10.0% ➖ noise
3 duckdb:vortex-file-compressed -5.0% +2.2% -7.0% +25.0% ➖ noise
4 datafusion:vortex-compact +2.6% +2.6% +0.1% +10.0% ➖ noise
4 datafusion:vortex-file-compressed +2.4% +2.6% -0.1% +10.0% ➖ noise
4 duckdb:vortex-compact +5.1% +2.6% +2.5% +10.0% ➖ noise
4 duckdb:vortex-file-compressed -4.9% +2.6% -7.3% +10.0% ➖ noise
5 datafusion:vortex-compact +1.2% +0.7% +0.5% +10.0% ➖ noise
5 datafusion:vortex-file-compressed +4.7% +0.7% +3.9% +10.0% ➖ noise
5 duckdb:vortex-compact +4.8% +0.7% +4.1% +10.0% ➖ noise
5 duckdb:vortex-file-compressed +3.1% +0.7% +2.4% +10.0% ➖ noise
6 datafusion:vortex-compact +5.8% -1.3% +7.2% +10.0% ➖ noise
6 datafusion:vortex-file-compressed +7.4% -1.3% +8.9% +15.4% ➖ noise
6 duckdb:vortex-compact +4.2% -1.3% +5.6% +10.0% ➖ noise
6 duckdb:vortex-file-compressed +7.2% -1.3% +8.6% +15.1% ➖ noise
7 datafusion:vortex-compact +3.1% +1.2% +1.8% +10.0% ➖ noise
7 datafusion:vortex-file-compressed +8.7% +1.2% +7.4% +10.5% ➖ noise
7 duckdb:vortex-compact +7.4% +1.2% +6.2% +10.0% ➖ noise
7 duckdb:vortex-file-compressed +9.1% +1.2% +7.8% +12.4% ➖ noise
8 datafusion:vortex-compact +6.8% +4.0% +2.7% +13.7% ➖ noise
8 datafusion:vortex-file-compressed +2.1% +4.0% -1.8% +16.2% ➖ noise
8 duckdb:vortex-compact +9.7% +4.0% +5.5% +14.4% ➖ noise
8 duckdb:vortex-file-compressed +10.2% +4.0% +5.9% +20.1% ➖ noise

@github-actions
Copy link
Contributor

Benchmarks: TPC-DS SF=1 on NVME

Verdict: No clear signal (low confidence)
Attributed Vortex impact: -0.7%
Vortex (geomean): 0.951x ➖
Parquet (geomean): 0.960x ➖
Shifts: Parquet (control) -4.0% · Median polish -4.4%


datafusion / vortex-file-compressed (0.951x ➖, 5↑ 0↓)
name PR d2668cf (ns) base 8efe1dc (ns) ratio (PR/base)
tpcds_q01/datafusion:vortex-file-compressed 27425229 28896465 0.95
tpcds_q02/datafusion:vortex-file-compressed 75821529 76135123 1.00
tpcds_q03/datafusion:vortex-file-compressed 27299654 28877888 0.95
tpcds_q04/datafusion:vortex-file-compressed 389824348 401537673 0.97
tpcds_q05/datafusion:vortex-file-compressed 70386309 75655774 0.93
tpcds_q06/datafusion:vortex-file-compressed 73400062 76694706 0.96
tpcds_q07/datafusion:vortex-file-compressed 75386588 75848493 0.99
tpcds_q08/datafusion:vortex-file-compressed 39317443 38840288 1.01
tpcds_q09/datafusion:vortex-file-compressed 45870749 48881905 0.94
tpcds_q10/datafusion:vortex-file-compressed 49621951 49007145 1.01
tpcds_q11/datafusion:vortex-file-compressed 230660345 239586487 0.96
tpcds_q12/datafusion:vortex-file-compressed 35287201 35599480 0.99
tpcds_q13/datafusion:vortex-file-compressed 79766074 80046675 1.00
tpcds_q14/datafusion:vortex-file-compressed 218754474 221358599 0.99
tpcds_q15/datafusion:vortex-file-compressed 49841993 50822488 0.98
tpcds_q16/datafusion:vortex-file-compressed 29389663 31658533 0.93
tpcds_q17/datafusion:vortex-file-compressed 109006853 112388390 0.97
tpcds_q18/datafusion:vortex-file-compressed 99256713 102606191 0.97
tpcds_q19/datafusion:vortex-file-compressed 47374808 49041351 0.97
tpcds_q20/datafusion:vortex-file-compressed 39473395 42203454 0.94
tpcds_q21/datafusion:vortex-file-compressed 170138505 176573317 0.96
tpcds_q22/datafusion:vortex-file-compressed 70103169 72518633 0.97
tpcds_q23/datafusion:vortex-file-compressed 184469885 195550134 0.94
tpcds_q24/datafusion:vortex-file-compressed 171784164 176720670 0.97
tpcds_q25/datafusion:vortex-file-compressed 107499750 113071364 0.95
tpcds_q26/datafusion:vortex-file-compressed 59733031 62558282 0.95
tpcds_q27/datafusion:vortex-file-compressed 165264744 171769934 0.96
tpcds_q28/datafusion:vortex-file-compressed 49323102 52148738 0.95
tpcds_q29/datafusion:vortex-file-compressed 107577203 109914565 0.98
tpcds_q30/datafusion:vortex-file-compressed 29554654 30332171 0.97
tpcds_q31/datafusion:vortex-file-compressed 174296403 182663496 0.95
tpcds_q32/datafusion:vortex-file-compressed 🚀 22639742 25677822 0.88
tpcds_q33/datafusion:vortex-file-compressed 36089759 39967593 0.90
tpcds_q34/datafusion:vortex-file-compressed 36697615 38774996 0.95
tpcds_q35/datafusion:vortex-file-compressed 58547358 62640824 0.93
tpcds_q36/datafusion:vortex-file-compressed 104193478 106553048 0.98
tpcds_q37/datafusion:vortex-file-compressed 36509424 36085667 1.01
tpcds_q38/datafusion:vortex-file-compressed 84890585 87475716 0.97
tpcds_q39/datafusion:vortex-file-compressed 207964341 211227583 0.98
tpcds_q40/datafusion:vortex-file-compressed 56146074 60562137 0.93
tpcds_q41/datafusion:vortex-file-compressed 🚀 13949434 16313474 0.86
tpcds_q42/datafusion:vortex-file-compressed 29193281 32048083 0.91
tpcds_q43/datafusion:vortex-file-compressed 47498496 51547642 0.92
tpcds_q44/datafusion:vortex-file-compressed 40880354 43849242 0.93
tpcds_q45/datafusion:vortex-file-compressed 47411836 49897399 0.95
tpcds_q46/datafusion:vortex-file-compressed 64110186 68123442 0.94
tpcds_q47/datafusion:vortex-file-compressed 264107718 283413187 0.93
tpcds_q48/datafusion:vortex-file-compressed 65424740 69443550 0.94
tpcds_q49/datafusion:vortex-file-compressed 71004614 74327156 0.96
tpcds_q50/datafusion:vortex-file-compressed 70963906 74948182 0.95
tpcds_q51/datafusion:vortex-file-compressed 93415356 100212908 0.93
tpcds_q52/datafusion:vortex-file-compressed 30749828 30306406 1.01
tpcds_q53/datafusion:vortex-file-compressed 28748332 31229880 0.92
tpcds_q54/datafusion:vortex-file-compressed 47757633 51095115 0.93
tpcds_q55/datafusion:vortex-file-compressed 30098188 31443197 0.96
tpcds_q56/datafusion:vortex-file-compressed 45050058 46634282 0.97
tpcds_q57/datafusion:vortex-file-compressed 179163397 187131701 0.96
tpcds_q58/datafusion:vortex-file-compressed 104439577 114516187 0.91
tpcds_q59/datafusion:vortex-file-compressed 91006542 96975125 0.94
tpcds_q60/datafusion:vortex-file-compressed 44009024 45324230 0.97
tpcds_q61/datafusion:vortex-file-compressed 56944721 57976084 0.98
tpcds_q62/datafusion:vortex-file-compressed 42904460 45995977 0.93
tpcds_q63/datafusion:vortex-file-compressed 28892383 29796314 0.97
tpcds_q64/datafusion:vortex-file-compressed 698620533 734694130 0.95
tpcds_q65/datafusion:vortex-file-compressed 51328414 52285534 0.98
tpcds_q66/datafusion:vortex-file-compressed 100672693 105303020 0.96
tpcds_q67/datafusion:vortex-file-compressed 144336863 146111038 0.99
tpcds_q68/datafusion:vortex-file-compressed 61999642 65566917 0.95
tpcds_q69/datafusion:vortex-file-compressed 46119556 46588533 0.99
tpcds_q70/datafusion:vortex-file-compressed 128578137 131664617 0.98
tpcds_q71/datafusion:vortex-file-compressed 30516562 30717885 0.99
tpcds_q72/datafusion:vortex-file-compressed 3259882444 3585664853 0.91
tpcds_q73/datafusion:vortex-file-compressed 39452764 41163581 0.96
tpcds_q74/datafusion:vortex-file-compressed 161637529 170441790 0.95
tpcds_q75/datafusion:vortex-file-compressed 132184349 138526778 0.95
tpcds_q76/datafusion:vortex-file-compressed 61421230 63887706 0.96
tpcds_q77/datafusion:vortex-file-compressed 52559669 57342967 0.92
tpcds_q78/datafusion:vortex-file-compressed 178161810 185657259 0.96
tpcds_q79/datafusion:vortex-file-compressed 42623578 44889026 0.95
tpcds_q80/datafusion:vortex-file-compressed 114583289 125933401 0.91
tpcds_q81/datafusion:vortex-file-compressed 37952641 39178489 0.97
tpcds_q82/datafusion:vortex-file-compressed 37447677 41422030 0.90
tpcds_q83/datafusion:vortex-file-compressed 63373296 67158567 0.94
tpcds_q84/datafusion:vortex-file-compressed 15378178 15937588 0.96
tpcds_q85/datafusion:vortex-file-compressed 131224486 133873082 0.98
tpcds_q86/datafusion:vortex-file-compressed 30023927 31424073 0.96
tpcds_q87/datafusion:vortex-file-compressed 85928180 88650933 0.97
tpcds_q88/datafusion:vortex-file-compressed 80342174 83211575 0.97
tpcds_q89/datafusion:vortex-file-compressed 56188647 57734941 0.97
tpcds_q90/datafusion:vortex-file-compressed 🚀 15517169 17841173 0.87
tpcds_q91/datafusion:vortex-file-compressed 25896659 27774208 0.93
tpcds_q92/datafusion:vortex-file-compressed 18800923 20214809 0.93
tpcds_q93/datafusion:vortex-file-compressed 🚀 34256941 38380692 0.89
tpcds_q94/datafusion:vortex-file-compressed 27109042 27122649 1.00
tpcds_q95/datafusion:vortex-file-compressed 86144120 93766128 0.92
tpcds_q96/datafusion:vortex-file-compressed 15180488 15832510 0.96
tpcds_q97/datafusion:vortex-file-compressed 31540010 34896948 0.90
tpcds_q98/datafusion:vortex-file-compressed 46920397 51487994 0.91
tpcds_q99/datafusion:vortex-file-compressed 🚀 57419785 65038798 0.88
datafusion / vortex-compact (0.950x ➖, 3↑ 0↓)
name PR d2668cf (ns) base 8efe1dc (ns) ratio (PR/base)
tpcds_q01/datafusion:vortex-compact 33493281 36033509 0.93
tpcds_q02/datafusion:vortex-compact 81311015 83580959 0.97
tpcds_q03/datafusion:vortex-compact 32594483 33060862 0.99
tpcds_q04/datafusion:vortex-compact 422902437 438560698 0.96
tpcds_q05/datafusion:vortex-compact 82493814 84244752 0.98
tpcds_q06/datafusion:vortex-compact 80419501 84208196 0.96
tpcds_q07/datafusion:vortex-compact 93249119 93421578 1.00
tpcds_q08/datafusion:vortex-compact 47126274 49110454 0.96
tpcds_q09/datafusion:vortex-compact 94557127 98089004 0.96
tpcds_q10/datafusion:vortex-compact 65915639 69162491 0.95
tpcds_q11/datafusion:vortex-compact 252277143 259663806 0.97
tpcds_q12/datafusion:vortex-compact 38643189 39453012 0.98
tpcds_q13/datafusion:vortex-compact 141978671 146401101 0.97
tpcds_q14/datafusion:vortex-compact 262404443 280424049 0.94
tpcds_q15/datafusion:vortex-compact 53208927 55505322 0.96
tpcds_q16/datafusion:vortex-compact 40563558 41222917 0.98
tpcds_q17/datafusion:vortex-compact 121828563 130482807 0.93
tpcds_q18/datafusion:vortex-compact 114045820 120094084 0.95
tpcds_q19/datafusion:vortex-compact 60155213 64477257 0.93
tpcds_q20/datafusion:vortex-compact 42932800 45817219 0.94
tpcds_q21/datafusion:vortex-compact 169908266 183711190 0.92
tpcds_q22/datafusion:vortex-compact 75812356 81150453 0.93
tpcds_q23/datafusion:vortex-compact 222026295 230174416 0.96
tpcds_q24/datafusion:vortex-compact 204944039 223260756 0.92
tpcds_q25/datafusion:vortex-compact 126441540 129863817 0.97
tpcds_q26/datafusion:vortex-compact 71218837 72659134 0.98
tpcds_q27/datafusion:vortex-compact 206095891 213235397 0.97
tpcds_q28/datafusion:vortex-compact 100221291 106037051 0.95
tpcds_q29/datafusion:vortex-compact 127754685 134613032 0.95
tpcds_q30/datafusion:vortex-compact 34265928 34433051 1.00
tpcds_q31/datafusion:vortex-compact 208697580 216092824 0.97
tpcds_q32/datafusion:vortex-compact 🚀 26634066 29988528 0.89
tpcds_q33/datafusion:vortex-compact 51222819 55199143 0.93
tpcds_q34/datafusion:vortex-compact 54502813 58534709 0.93
tpcds_q35/datafusion:vortex-compact 69586924 76981252 0.90
tpcds_q36/datafusion:vortex-compact 126653039 128464625 0.99
tpcds_q37/datafusion:vortex-compact 48553308 52201869 0.93
tpcds_q38/datafusion:vortex-compact 97549987 102616308 0.95
tpcds_q39/datafusion:vortex-compact 197316861 200440457 0.98
tpcds_q40/datafusion:vortex-compact 59348919 63881796 0.93
tpcds_q41/datafusion:vortex-compact 15616698 16843066 0.93
tpcds_q42/datafusion:vortex-compact 34608557 37428513 0.92
tpcds_q43/datafusion:vortex-compact 53957957 54874068 0.98
tpcds_q44/datafusion:vortex-compact 71205255 72790092 0.98
tpcds_q45/datafusion:vortex-compact 50580794 54847499 0.92
tpcds_q46/datafusion:vortex-compact 86913156 90498228 0.96
tpcds_q47/datafusion:vortex-compact 293088730 308567308 0.95
tpcds_q48/datafusion:vortex-compact 106035309 110419534 0.96
tpcds_q49/datafusion:vortex-compact 98792290 101840723 0.97
tpcds_q50/datafusion:vortex-compact 91483246 93946818 0.97
tpcds_q51/datafusion:vortex-compact 96237070 105233712 0.91
tpcds_q52/datafusion:vortex-compact 34110133 37677794 0.91
tpcds_q53/datafusion:vortex-compact 37653340 40913808 0.92
tpcds_q54/datafusion:vortex-compact 61937075 66155220 0.94
tpcds_q55/datafusion:vortex-compact 36166380 37054452 0.98
tpcds_q56/datafusion:vortex-compact 57639578 60789662 0.95
tpcds_q57/datafusion:vortex-compact 189760636 202875250 0.94
tpcds_q58/datafusion:vortex-compact 114400877 122794789 0.93
tpcds_q59/datafusion:vortex-compact 105960309 111503484 0.95
tpcds_q60/datafusion:vortex-compact 🚀 56084225 62553353 0.90
tpcds_q61/datafusion:vortex-compact 81813030 86499831 0.95
tpcds_q62/datafusion:vortex-compact 44737019 47683197 0.94
tpcds_q63/datafusion:vortex-compact 38168353 41435359 0.92
tpcds_q64/datafusion:vortex-compact 775663090 821610592 0.94
tpcds_q65/datafusion:vortex-compact 70988778 73953186 0.96
tpcds_q66/datafusion:vortex-compact 109428881 114944481 0.95
tpcds_q67/datafusion:vortex-compact 150101955 152094825 0.99
tpcds_q68/datafusion:vortex-compact 88154305 93591534 0.94
tpcds_q69/datafusion:vortex-compact 61522173 65916247 0.93
tpcds_q70/datafusion:vortex-compact 140749333 143179035 0.98
tpcds_q71/datafusion:vortex-compact 46677764 46612155 1.00
tpcds_q72/datafusion:vortex-compact 3302569426 3640248747 0.91
tpcds_q73/datafusion:vortex-compact 58758506 57830557 1.02
tpcds_q74/datafusion:vortex-compact 182495015 191513546 0.95
tpcds_q75/datafusion:vortex-compact 182420658 186835689 0.98
tpcds_q76/datafusion:vortex-compact 76198096 78152716 0.97
tpcds_q77/datafusion:vortex-compact 64724884 70206576 0.92
tpcds_q78/datafusion:vortex-compact 198721372 213829227 0.93
tpcds_q79/datafusion:vortex-compact 67289567 69566676 0.97
tpcds_q80/datafusion:vortex-compact 134610546 144813189 0.93
tpcds_q81/datafusion:vortex-compact 41895759 43415355 0.96
tpcds_q82/datafusion:vortex-compact 51389059 55623725 0.92
tpcds_q83/datafusion:vortex-compact 63821350 66764341 0.96
tpcds_q84/datafusion:vortex-compact 🚀 17560672 21109790 0.83
tpcds_q85/datafusion:vortex-compact 154775759 158855921 0.97
tpcds_q86/datafusion:vortex-compact 31371050 32407790 0.97
tpcds_q87/datafusion:vortex-compact 101693246 107292521 0.95
tpcds_q88/datafusion:vortex-compact 130094834 134282986 0.97
tpcds_q89/datafusion:vortex-compact 65754446 66877278 0.98
tpcds_q90/datafusion:vortex-compact 20973460 22616051 0.93
tpcds_q91/datafusion:vortex-compact 41218668 42621249 0.97
tpcds_q92/datafusion:vortex-compact 21070600 22824117 0.92
tpcds_q93/datafusion:vortex-compact 51691331 54036902 0.96
tpcds_q94/datafusion:vortex-compact 32797488 33585425 0.98
tpcds_q95/datafusion:vortex-compact 95210959 100011929 0.95
tpcds_q96/datafusion:vortex-compact 24152921 25664661 0.94
tpcds_q97/datafusion:vortex-compact 43276935 45785387 0.95
tpcds_q98/datafusion:vortex-compact 56424168 58494536 0.96
tpcds_q99/datafusion:vortex-compact 61658421 66261289 0.93
datafusion / parquet (0.955x ➖, 5↑ 0↓)
name PR d2668cf (ns) base 8efe1dc (ns) ratio (PR/base)
tpcds_q01/datafusion:parquet 39861255 38383933 1.04
tpcds_q02/datafusion:parquet 49377533 53511302 0.92
tpcds_q03/datafusion:parquet 17026827 17621093 0.97
tpcds_q04/datafusion:parquet 347052871 384895967 0.90
tpcds_q05/datafusion:parquet 88153701 92158061 0.96
tpcds_q06/datafusion:parquet 90085922 95384822 0.94
tpcds_q07/datafusion:parquet 134883623 139064999 0.97
tpcds_q08/datafusion:parquet 39154545 41147517 0.95
tpcds_q09/datafusion:parquet 54208763 55086105 0.98
tpcds_q10/datafusion:parquet 99991195 106796242 0.94
tpcds_q11/datafusion:parquet 225595102 244852123 0.92
tpcds_q12/datafusion:parquet 28801596 31192189 0.92
tpcds_q13/datafusion:parquet 135332293 142274987 0.95
tpcds_q14/datafusion:parquet 211000707 224815728 0.94
tpcds_q15/datafusion:parquet 56069901 55882157 1.00
tpcds_q16/datafusion:parquet 32429627 34215548 0.95
tpcds_q17/datafusion:parquet 165855641 177088841 0.94
tpcds_q18/datafusion:parquet 173887806 188179597 0.92
tpcds_q19/datafusion:parquet 35069160 36203574 0.97
tpcds_q20/datafusion:parquet 🚀 23373811 26502965 0.88
tpcds_q21/datafusion:parquet 28369903 29686187 0.96
tpcds_q22/datafusion:parquet 🚀 137274979 161844996 0.85
tpcds_q23/datafusion:parquet 178572822 192076868 0.93
tpcds_q24/datafusion:parquet 213452510 217348660 0.98
tpcds_q25/datafusion:parquet 175774091 185445271 0.95
tpcds_q26/datafusion:parquet 115807681 118435196 0.98
tpcds_q27/datafusion:parquet 257436374 267748001 0.96
tpcds_q28/datafusion:parquet 52108422 55145970 0.94
tpcds_q29/datafusion:parquet 177518855 184427284 0.96
tpcds_q30/datafusion:parquet 46327777 47256059 0.98
tpcds_q31/datafusion:parquet 105462205 107847773 0.98
tpcds_q32/datafusion:parquet 29362633 29157875 1.01
tpcds_q33/datafusion:parquet 37387413 40249502 0.93
tpcds_q34/datafusion:parquet 35661684 37521622 0.95
tpcds_q35/datafusion:parquet 94333031 101093502 0.93
tpcds_q36/datafusion:parquet 80963123 85793956 0.94
tpcds_q37/datafusion:parquet 25891560 26153005 0.99
tpcds_q38/datafusion:parquet 62375056 65820547 0.95
tpcds_q39/datafusion:parquet 97467630 102639715 0.95
tpcds_q40/datafusion:parquet 35944879 37169045 0.97
tpcds_q41/datafusion:parquet 12350403 13239430 0.93
tpcds_q42/datafusion:parquet 15798385 16169879 0.98
tpcds_q43/datafusion:parquet 25728730 27469777 0.94
tpcds_q44/datafusion:parquet 39605127 41390590 0.96
tpcds_q45/datafusion:parquet 67905112 67169258 1.01
tpcds_q46/datafusion:parquet 49024178 54397544 0.90
tpcds_q47/datafusion:parquet 186008952 194239165 0.96
tpcds_q48/datafusion:parquet 132332672 133719393 0.99
tpcds_q49/datafusion:parquet 74530021 79810134 0.93
tpcds_q50/datafusion:parquet 107401008 108683061 0.99
tpcds_q51/datafusion:parquet 96354420 105083376 0.92
tpcds_q52/datafusion:parquet 15893687 16801810 0.95
tpcds_q53/datafusion:parquet 30378481 31104789 0.98
tpcds_q54/datafusion:parquet 46861665 49090555 0.95
tpcds_q55/datafusion:parquet 15361103 16343096 0.94
tpcds_q56/datafusion:parquet 36640799 37463922 0.98
tpcds_q57/datafusion:parquet 130102964 143554073 0.91
tpcds_q58/datafusion:parquet 72309874 78415776 0.92
tpcds_q59/datafusion:parquet 66298543 68010061 0.97
tpcds_q60/datafusion:parquet 36796854 38804550 0.95
tpcds_q61/datafusion:parquet 66649037 66749848 1.00
tpcds_q62/datafusion:parquet 🚀 39878130 45050176 0.89
tpcds_q63/datafusion:parquet 31255471 33507129 0.93
tpcds_q64/datafusion:parquet 983197451 1019609684 0.96
tpcds_q65/datafusion:parquet 49357861 52018237 0.95
tpcds_q66/datafusion:parquet 88353934 93140759 0.95
tpcds_q67/datafusion:parquet 181327843 177997469 1.02
tpcds_q68/datafusion:parquet 52578820 54038431 0.97
tpcds_q69/datafusion:parquet 92782482 98087759 0.95
tpcds_q70/datafusion:parquet 107560456 112946590 0.95
tpcds_q71/datafusion:parquet 27884213 30291832 0.92
tpcds_q72/datafusion:parquet 836605402 900050318 0.93
tpcds_q73/datafusion:parquet 39341286 36587876 1.08
tpcds_q74/datafusion:parquet 127722191 130424646 0.98
tpcds_q75/datafusion:parquet 133093946 136257470 0.98
tpcds_q76/datafusion:parquet 94248005 93736322 1.01
tpcds_q77/datafusion:parquet 59463274 59170549 1.00
tpcds_q78/datafusion:parquet 179989070 190040944 0.95
tpcds_q79/datafusion:parquet 41758987 42470167 0.98
tpcds_q80/datafusion:parquet 112937580 117923777 0.96
tpcds_q81/datafusion:parquet 41733246 44399259 0.94
tpcds_q82/datafusion:parquet 28415227 28979930 0.98
tpcds_q83/datafusion:parquet 53169757 57665669 0.92
tpcds_q84/datafusion:parquet 46634257 50637891 0.92
tpcds_q85/datafusion:parquet 239941740 248462873 0.97
tpcds_q86/datafusion:parquet 20731329 22014505 0.94
tpcds_q87/datafusion:parquet 63904517 69082916 0.93
tpcds_q88/datafusion:parquet 77847870 80807119 0.96
tpcds_q89/datafusion:parquet 37352986 38429422 0.97
tpcds_q90/datafusion:parquet 19502790 19528692 1.00
tpcds_q91/datafusion:parquet 78533799 80537757 0.98
tpcds_q92/datafusion:parquet 25149009 26527901 0.95
tpcds_q93/datafusion:parquet 38152385 40319636 0.95
tpcds_q94/datafusion:parquet 27635186 29209383 0.95
tpcds_q95/datafusion:parquet 131826371 134132614 0.98
tpcds_q96/datafusion:parquet 🚀 14302126 16047937 0.89
tpcds_q97/datafusion:parquet 37192267 37505362 0.99
tpcds_q98/datafusion:parquet 🚀 33329113 38214748 0.87
tpcds_q99/datafusion:parquet 49606893 46413041 1.07
duckdb / vortex-file-compressed (0.948x ➖, 12↑ 0↓)
name PR d2668cf (ns) base 8efe1dc (ns) ratio (PR/base)
tpcds_q01/duckdb:vortex-file-compressed 25992265 27547650 0.94
tpcds_q02/duckdb:vortex-file-compressed 81835603 85864915 0.95
tpcds_q03/duckdb:vortex-file-compressed 22558541 23076927 0.98
tpcds_q04/duckdb:vortex-file-compressed 110701589 109875995 1.01
tpcds_q05/duckdb:vortex-file-compressed 100673358 102299788 0.98
tpcds_q06/duckdb:vortex-file-compressed 34721053 36728284 0.95
tpcds_q07/duckdb:vortex-file-compressed 23363340 24080618 0.97
tpcds_q08/duckdb:vortex-file-compressed 23158198 24184392 0.96
tpcds_q09/duckdb:vortex-file-compressed 39458713 42537561 0.93
tpcds_q10/duckdb:vortex-file-compressed 36504091 38456124 0.95
tpcds_q11/duckdb:vortex-file-compressed 63073821 63346868 1.00
tpcds_q12/duckdb:vortex-file-compressed 14410656 15384901 0.94
tpcds_q13/duckdb:vortex-file-compressed 31656249 33963898 0.93
tpcds_q14/duckdb:vortex-file-compressed 199599551 197918841 1.01
tpcds_q15/duckdb:vortex-file-compressed 40665890 42639742 0.95
tpcds_q16/duckdb:vortex-file-compressed 30257759 32210738 0.94
tpcds_q17/duckdb:vortex-file-compressed 36208470 39650708 0.91
tpcds_q18/duckdb:vortex-file-compressed 43895666 48052686 0.91
tpcds_q19/duckdb:vortex-file-compressed 33287232 33650581 0.99
tpcds_q20/duckdb:vortex-file-compressed 15820662 16494727 0.96
tpcds_q21/duckdb:vortex-file-compressed 20392623 19975976 1.02
tpcds_q22/duckdb:vortex-file-compressed 108822739 114759487 0.95
tpcds_q23/duckdb:vortex-file-compressed 🚀 123649211 139216061 0.89
tpcds_q24/duckdb:vortex-file-compressed 55466974 58178456 0.95
tpcds_q25/duckdb:vortex-file-compressed 36416813 38281097 0.95
tpcds_q26/duckdb:vortex-file-compressed 38697333 42618330 0.91
tpcds_q27/duckdb:vortex-file-compressed 84495955 89797437 0.94
tpcds_q28/duckdb:vortex-file-compressed 37464186 37862484 0.99
tpcds_q29/duckdb:vortex-file-compressed 37711687 38876575 0.97
tpcds_q30/duckdb:vortex-file-compressed 29772519 28653433 1.04
tpcds_q31/duckdb:vortex-file-compressed 26265672 28660230 0.92
tpcds_q32/duckdb:vortex-file-compressed 16789456 16815625 1.00
tpcds_q33/duckdb:vortex-file-compressed 🚀 64957022 72833272 0.89
tpcds_q34/duckdb:vortex-file-compressed 19482487 19186366 1.02
tpcds_q35/duckdb:vortex-file-compressed 🚀 60900799 68351071 0.89
tpcds_q36/duckdb:vortex-file-compressed 2722283 27618506 0.99
tpcds_q37/duckdb:vortex-file-compressed 22871488 22414720 1.02
tpcds_q38/duckdb:vortex-file-compressed 39579182 38074527 1.04
tpcds_q39/duckdb:vortex-file-compressed 46134321 46247099 1.00
tpcds_q40/duckdb:vortex-file-compressed 🚀 23740693 26496274 0.90
tpcds_q41/duckdb:vortex-file-compressed 13227578 13834946 0.96
tpcds_q42/duckdb:vortex-file-compressed 11227311 12252312 0.92
tpcds_q43/duckdb:vortex-file-compressed 20305637 21810141 0.93
tpcds_q44/duckdb:vortex-file-compressed 24116949 26499822 0.91
tpcds_q45/duckdb:vortex-file-compressed 26871336 27882386 0.96
tpcds_q46/duckdb:vortex-file-compressed 45737778 48621085 0.94
tpcds_q47/duckdb:vortex-file-compressed 49673376 52139758 0.95
tpcds_q48/duckdb:vortex-file-compressed 29995669 30081130 1.00
tpcds_q49/duckdb:vortex-file-compressed 🚀 29001556 33454294 0.87
tpcds_q50/duckdb:vortex-file-compressed 33880749 35518962 0.95
tpcds_q51/duckdb:vortex-file-compressed 🚀 97722816 109194295 0.89
tpcds_q52/duckdb:vortex-file-compressed 12315452 13672669 0.90
tpcds_q53/duckdb:vortex-file-compressed 17317796 18439117 0.94
tpcds_q54/duckdb:vortex-file-compressed 47787947 49079571 0.97
tpcds_q55/duckdb:vortex-file-compressed 12799300 11936996 1.07
tpcds_q56/duckdb:vortex-file-compressed 🚀 62508046 69736840 0.90
tpcds_q57/duckdb:vortex-file-compressed 44729743 47660058 0.94
tpcds_q58/duckdb:vortex-file-compressed 33877673 36029509 0.94
tpcds_q59/duckdb:vortex-file-compressed 57096086 58460806 0.98
tpcds_q60/duckdb:vortex-file-compressed 66389019 71672226 0.93
tpcds_q61/duckdb:vortex-file-compressed 40350319 37990767 1.06
tpcds_q62/duckdb:vortex-file-compressed 🚀 18814332 21581944 0.87
tpcds_q63/duckdb:vortex-file-compressed 17781111 18523803 0.96
tpcds_q64/duckdb:vortex-file-compressed 78630076 84699066 0.93
tpcds_q65/duckdb:vortex-file-compressed 23553129 24339939 0.97
tpcds_q66/duckdb:vortex-file-compressed 56591301 59201660 0.96
tpcds_q67/duckdb:vortex-file-compressed 144678239 149212597 0.97
tpcds_q68/duckdb:vortex-file-compressed 39192942 41093296 0.95
tpcds_q69/duckdb:vortex-file-compressed 37621776 40061832 0.94
tpcds_q70/duckdb:vortex-file-compressed 23885862 25407282 0.94
tpcds_q71/duckdb:vortex-file-compressed 20608730 22327388 0.92
tpcds_q72/duckdb:vortex-file-compressed 177416980 183489444 0.97
tpcds_q73/duckdb:vortex-file-compressed 19818875 20970750 0.95
tpcds_q74/duckdb:vortex-file-compressed 50229891 54273615 0.93
tpcds_q75/duckdb:vortex-file-compressed 60731418 66515366 0.91
tpcds_q76/duckdb:vortex-file-compressed 60388250 62318830 0.97
tpcds_q77/duckdb:vortex-file-compressed 🚀 63562731 72895500 0.87
tpcds_q78/duckdb:vortex-file-compressed 79520543 83668498 0.95
tpcds_q79/duckdb:vortex-file-compressed 34359526 37908799 0.91
tpcds_q80/duckdb:vortex-file-compressed 🚀 86900628 102387427 0.85
tpcds_q81/duckdb:vortex-file-compressed 33215953 33999670 0.98
tpcds_q82/duckdb:vortex-file-compressed 21174191 23500851 0.90
tpcds_q83/duckdb:vortex-file-compressed 🚀 26162415 30763947 0.85
tpcds_q84/duckdb:vortex-file-compressed 16992962 18208170 0.93
tpcds_q85/duckdb:vortex-file-compressed 44889283 46873890 0.96
tpcds_q86/duckdb:vortex-file-compressed 16183192 16691077 0.97
tpcds_q87/duckdb:vortex-file-compressed 38268641 41349038 0.93
tpcds_q88/duckdb:vortex-file-compressed 41854911 44681945 0.94
tpcds_q89/duckdb:vortex-file-compressed 17723126 18672666 0.95
tpcds_q90/duckdb:vortex-file-compressed 15192406 15660756 0.97
tpcds_q91/duckdb:vortex-file-compressed 26956154 28554317 0.94
tpcds_q92/duckdb:vortex-file-compressed 🚀 14012361 15771156 0.89
tpcds_q93/duckdb:vortex-file-compressed 30893551 32437684 0.95
tpcds_q94/duckdb:vortex-file-compressed 22004836 24014346 0.92
tpcds_q95/duckdb:vortex-file-compressed 153642503 158965678 0.97
tpcds_q96/duckdb:vortex-file-compressed 17383376 18722584 0.93
tpcds_q97/duckdb:vortex-file-compressed 39730726 39854929 1.00
tpcds_q98/duckdb:vortex-file-compressed 18060564 19686493 0.92
tpcds_q99/duckdb:vortex-file-compressed 32521509 33055614 0.98
duckdb / vortex-compact (0.953x ➖, 9↑ 0↓)
name PR d2668cf (ns) base 8efe1dc (ns) ratio (PR/base)
tpcds_q01/duckdb:vortex-compact 33823393 36480821 0.93
tpcds_q02/duckdb:vortex-compact 122555153 128854799 0.95
tpcds_q03/duckdb:vortex-compact 50046773 52312347 0.96
tpcds_q04/duckdb:vortex-compact 122302962 127817181 0.96
tpcds_q05/duckdb:vortex-compact 🚀 157112431 179453280 0.88
tpcds_q06/duckdb:vortex-compact 39437786 42011568 0.94
tpcds_q07/duckdb:vortex-compact 39841566 41329117 0.96
tpcds_q08/duckdb:vortex-compact 28722124 30571788 0.94
tpcds_q09/duckdb:vortex-compact 111391996 117182961 0.95
tpcds_q10/duckdb:vortex-compact 46358094 50441325 0.92
tpcds_q11/duckdb:vortex-compact 77548730 82485811 0.94
tpcds_q12/duckdb:vortex-compact 🚀 18699212 21801505 0.86
tpcds_q13/duckdb:vortex-compact 52417028 55015716 0.95
tpcds_q14/duckdb:vortex-compact 282646778 307598391 0.92
tpcds_q15/duckdb:vortex-compact 45464353 47284487 0.96
tpcds_q16/duckdb:vortex-compact 36854722 39799983 0.93
tpcds_q17/duckdb:vortex-compact 54634551 54068868 1.01
tpcds_q18/duckdb:vortex-compact 65165803 70781406 0.92
tpcds_q19/duckdb:vortex-compact 40506577 41570351 0.97
tpcds_q20/duckdb:vortex-compact 🚀 19234876 21460148 0.90
tpcds_q21/duckdb:vortex-compact 26706492 28831093 0.93
tpcds_q22/duckdb:vortex-compact 116347409 124820627 0.93
tpcds_q23/duckdb:vortex-compact 🚀 159757688 183942887 0.87
tpcds_q24/duckdb:vortex-compact 76838724 78996834 0.97
tpcds_q25/duckdb:vortex-compact 50477957 53131658 0.95
tpcds_q26/duckdb:vortex-compact 52055280 55292529 0.94
tpcds_q27/duckdb:vortex-compact 140225951 146283215 0.96
tpcds_q28/duckdb:vortex-compact 107856511 110039630 0.98
tpcds_q29/duckdb:vortex-compact 51071571 55395339 0.92
tpcds_q30/duckdb:vortex-compact 34193334 37113665 0.92
tpcds_q31/duckdb:vortex-compact 30893129 32531147 0.95
tpcds_q32/duckdb:vortex-compact 24344275 24686463 0.99
tpcds_q33/duckdb:vortex-compact 141918040 150980547 0.94
tpcds_q34/duckdb:vortex-compact 29861028 30399806 0.98
tpcds_q35/duckdb:vortex-compact 73141239 74644709 0.98
tpcds_q36/duckdb:vortex-compact 35389151 35630148 0.99
tpcds_q37/duckdb:vortex-compact 31043353 32381986 0.96
tpcds_q38/duckdb:vortex-compact 40608915 42206504 0.96
tpcds_q39/duckdb:vortex-compact 58218736 55904698 1.04
tpcds_q40/duckdb:vortex-compact 32829645 32770187 1.00
tpcds_q41/duckdb:vortex-compact 16705922 16897233 0.99
tpcds_q42/duckdb:vortex-compact 15491036 15590955 0.99
tpcds_q43/duckdb:vortex-compact 25211387 25375529 0.99
tpcds_q44/duckdb:vortex-compact 35620774 35721279 1.00
tpcds_q45/duckdb:vortex-compact 36466915 34206031 1.07
tpcds_q46/duckdb:vortex-compact 61697590 63094998 0.98
tpcds_q47/duckdb:vortex-compact 56262668 57849663 0.97
tpcds_q48/duckdb:vortex-compact 46512978 45657555 1.02
tpcds_q49/duckdb:vortex-compact 47720014 48498489 0.98
tpcds_q50/duckdb:vortex-compact 55659347 57300375 0.97
tpcds_q51/duckdb:vortex-compact 106153425 108393450 0.98
tpcds_q52/duckdb:vortex-compact 15506176 16565939 0.94
tpcds_q53/duckdb:vortex-compact 21968555 23820127 0.92
tpcds_q54/duckdb:vortex-compact 83485633 90464054 0.92
tpcds_q55/duckdb:vortex-compact 15177678 16624530 0.91
tpcds_q56/duckdb:vortex-compact 142904746 149330147 0.96
tpcds_q57/duckdb:vortex-compact 49291353 49855209 0.99
tpcds_q58/duckdb:vortex-compact 🚀 37741303 43832717 0.86
tpcds_q59/duckdb:vortex-compact 68974194 68281817 1.01
tpcds_q60/duckdb:vortex-compact 149607573 159096464 0.94
tpcds_q61/duckdb:vortex-compact 55099132 55842159 0.99
tpcds_q62/duckdb:vortex-compact 23370064 23881095 0.98
tpcds_q63/duckdb:vortex-compact 22838347 23987637 0.95
tpcds_q64/duckdb:vortex-compact 106016549 116194174 0.91
tpcds_q65/duckdb:vortex-compact 29257850 30241792 0.97
tpcds_q66/duckdb:vortex-compact 100743765 107920133 0.93
tpcds_q67/duckdb:vortex-compact 154884528 161374857 0.96
tpcds_q68/duckdb:vortex-compact 56180880 58886277 0.95
tpcds_q69/duckdb:vortex-compact 50432289 52885220 0.95
tpcds_q70/duckdb:vortex-compact 30544083 30747649 0.99
tpcds_q71/duckdb:vortex-compact 28534373 28885395 0.99
tpcds_q72/duckdb:vortex-compact 200748647 205540630 0.98
tpcds_q73/duckdb:vortex-compact 29699304 29826382 1.00
tpcds_q74/duckdb:vortex-compact 59004139 63352575 0.93
tpcds_q75/duckdb:vortex-compact 76249021 76698194 0.99
tpcds_q76/duckdb:vortex-compact 🚀 130881467 149875313 0.87
tpcds_q77/duckdb:vortex-compact 133045819 140617947 0.95
tpcds_q78/duckdb:vortex-compact 84777565 90752292 0.93
tpcds_q79/duckdb:vortex-compact 60457650 63461494 0.95
tpcds_q80/duckdb:vortex-compact 🚀 165309968 184842508 0.89
tpcds_q81/duckdb:vortex-compact 🚀 37981908 43377040 0.88
tpcds_q82/duckdb:vortex-compact 32572995 32476616 1.00
tpcds_q83/duckdb:vortex-compact 44673352 47395150 0.94
tpcds_q84/duckdb:vortex-compact 21705366 23074793 0.94
tpcds_q85/duckdb:vortex-compact 63531781 63799730 1.00
tpcds_q86/duckdb:vortex-compact 20359084 21471752 0.95
tpcds_q87/duckdb:vortex-compact 46107910 43654013 1.06
tpcds_q88/duckdb:vortex-compact 44259043 46096068 0.96
tpcds_q89/duckdb:vortex-compact 24666789 24112335 1.02
tpcds_q90/duckdb:vortex-compact 16712313 16535323 1.01
tpcds_q91/duckdb:vortex-compact 43482320 47882506 0.91
tpcds_q92/duckdb:vortex-compact 20712643 21381700 0.97
tpcds_q93/duckdb:vortex-compact 37726051 41048306 0.92
tpcds_q94/duckdb:vortex-compact 27151958 29662932 0.92
tpcds_q95/duckdb:vortex-compact 🚀 140172692 163707113 0.86
tpcds_q96/duckdb:vortex-compact 18139567 19904808 0.91
tpcds_q97/duckdb:vortex-compact 43456155 46874321 0.93
tpcds_q98/duckdb:vortex-compact 23147263 24386253 0.95
tpcds_q99/duckdb:vortex-compact 36860511 37719469 0.98
duckdb / parquet (0.965x ➖, 6↑ 0↓)
name PR d2668cf (ns) base 8efe1dc (ns) ratio (PR/base)
tpcds_q01/duckdb:parquet 43979428 45531705 0.97
tpcds_q02/duckdb:parquet 58574441 63679952 0.92
tpcds_q03/duckdb:parquet 11787841 12450660 0.95
tpcds_q04/duckdb:parquet 123847170 127768178 0.97
tpcds_q05/duckdb:parquet 74405542 77166581 0.96
tpcds_q06/duckdb:parquet 27928238 29389156 0.95
tpcds_q07/duckdb:parquet 22850667 23776336 0.96
tpcds_q08/duckdb:parquet 28736045 28458009 1.01
tpcds_q09/duckdb:parquet 39391824 40142953 0.98
tpcds_q10/duckdb:parquet 33773358 35981840 0.94
tpcds_q11/duckdb:parquet 89146395 90590649 0.98
tpcds_q12/duckdb:parquet 14384234 15178806 0.95
tpcds_q13/duckdb:parquet 34456800 35873383 0.96
tpcds_q14/duckdb:parquet 158870044 162674434 0.98
tpcds_q15/duckdb:parquet 29387624 31561995 0.93
tpcds_q16/duckdb:parquet 21057357 22115393 0.95
tpcds_q17/duckdb:parquet 37861063 39593696 0.96
tpcds_q18/duckdb:parquet 46155926 46303569 1.00
tpcds_q19/duckdb:parquet 30250801 30921519 0.98
tpcds_q20/duckdb:parquet 15382449 15110844 1.02
tpcds_q21/duckdb:parquet 10971937 11313382 0.97
tpcds_q22/duckdb:parquet 🚀 65508449 72843131 0.90
tpcds_q23/duckdb:parquet 110441211 116144293 0.95
tpcds_q24/duckdb:parquet 44454608 46756904 0.95
tpcds_q25/duckdb:parquet 31878364 33431411 0.95
tpcds_q26/duckdb:parquet 🚀 34110437 38504071 0.89
tpcds_q27/duckdb:parquet 87171023 90476824 0.96
tpcds_q28/duckdb:parquet 37648090 38052725 0.99
tpcds_q29/duckdb:parquet 33600256 36388013 0.92
tpcds_q30/duckdb:parquet 39452946 41718501 0.95
tpcds_q31/duckdb:parquet 22018682 23388519 0.94
tpcds_q32/duckdb:parquet 10420496 11325938 0.92
tpcds_q33/duckdb:parquet 70387568 70495748 1.00
tpcds_q34/duckdb:parquet 20734875 20868307 0.99
tpcds_q35/duckdb:parquet 58906396 59841214 0.98
tpcds_q36/duckdb:parquet 20921171 20492844 1.02
tpcds_q37/duckdb:parquet 🚀 12441640 13899909 0.90
tpcds_q38/duckdb:parquet 34003575 33965794 1.00
tpcds_q39/duckdb:parquet 32666030 33332064 0.98
tpcds_q40/duckdb:parquet 17196699 18403666 0.93
tpcds_q41/duckdb:parquet 7545291 7646849 0.99
tpcds_q42/duckdb:parquet 9820481 10433206 0.94
tpcds_q43/duckdb:parquet 15472886 16787921 0.92
tpcds_q44/duckdb:parquet 21441987 21542763 1.00
tpcds_q45/duckdb:parquet 26304492 26091391 1.01
tpcds_q46/duckdb:parquet 44434932 44838529 0.99
tpcds_q47/duckdb:parquet 45018775 45712251 0.98
tpcds_q48/duckdb:parquet 29930303 30572907 0.98
tpcds_q49/duckdb:parquet 23673842 23410372 1.01
tpcds_q50/duckdb:parquet 24406005 24577156 0.99
tpcds_q51/duckdb:parquet 93853919 102178864 0.92
tpcds_q52/duckdb:parquet 🚀 10412551 11804516 0.88
tpcds_q53/duckdb:parquet 16040899 16725975 0.96
tpcds_q54/duckdb:parquet 39236951 40148740 0.98
tpcds_q55/duckdb:parquet 10482750 10808707 0.97
tpcds_q56/duckdb:parquet 66841894 70185593 0.95
tpcds_q57/duckdb:parquet 34023210 34759835 0.98
tpcds_q58/duckdb:parquet 21669768 21557600 1.01
tpcds_q59/duckdb:parquet 36105016 36626484 0.99
tpcds_q60/duckdb:parquet 69329609 71302897 0.97
tpcds_q61/duckdb:parquet 29998577 30372813 0.99
tpcds_q62/duckdb:parquet 11556903 11517801 1.00
tpcds_q63/duckdb:parquet 14902257 15836724 0.94
tpcds_q64/duckdb:parquet 73015223 75346619 0.97
tpcds_q65/duckdb:parquet 🚀 20161834 22424062 0.90
tpcds_q66/duckdb:parquet 56434582 56860175 0.99
tpcds_q67/duckdb:parquet 130204915 137503377 0.95
tpcds_q68/duckdb:parquet 37641949 37686792 1.00
tpcds_q69/duckdb:parquet 37485120 38491009 0.97
tpcds_q70/duckdb:parquet 19191859 19831406 0.97
tpcds_q71/duckdb:parquet 18398477 18325607 1.00
tpcds_q72/duckdb:parquet 165363869 166107894 1.00
tpcds_q73/duckdb:parquet 17926407 18953684 0.95
tpcds_q74/duckdb:parquet 50655310 51392347 0.99
tpcds_q75/duckdb:parquet 53183080 55051340 0.97
tpcds_q76/duckdb:parquet 67192846 72243876 0.93
tpcds_q77/duckdb:parquet 59878549 64638649 0.93
tpcds_q78/duckdb:parquet 75238409 76672840 0.98
tpcds_q79/duckdb:parquet 27621512 27877184 0.99
tpcds_q80/duckdb:parquet 78366722 87073444 0.90
tpcds_q81/duckdb:parquet 47441065 48564826 0.98
tpcds_q82/duckdb:parquet 15052322 15763445 0.95
tpcds_q83/duckdb:parquet 16034737 17143337 0.94
tpcds_q84/duckdb:parquet 19570010 20237656 0.97
tpcds_q85/duckdb:parquet 39128882 40784981 0.96
tpcds_q86/duckdb:parquet 12979705 12884262 1.01
tpcds_q87/duckdb:parquet 36401694 37772796 0.96
tpcds_q88/duckdb:parquet 28513009 29691356 0.96
tpcds_q89/duckdb:parquet 17213482 17761847 0.97
tpcds_q90/duckdb:parquet 7959890 7687069 1.04
tpcds_q91/duckdb:parquet 23698428 22739778 1.04
tpcds_q92/duckdb:parquet 11792047 12889462 0.91
tpcds_q93/duckdb:parquet 28932421 30722154 0.94
tpcds_q94/duckdb:parquet 15507928 16461261 0.94
tpcds_q95/duckdb:parquet 139671149 130369436 1.07
tpcds_q96/duckdb:parquet 🚀 9332254 10418860 0.90
tpcds_q97/duckdb:parquet 33897806 36443479 0.93
tpcds_q98/duckdb:parquet 17840120 18263105 0.98
tpcds_q99/duckdb:parquet 19874008 20119202 0.99
duckdb / duckdb (0.961x ➖, 6↑ 0↓)
name PR d2668cf (ns) base 8efe1dc (ns) ratio (PR/base)
tpcds_q01/duckdb:duckdb 19856184 21659030 0.92
tpcds_q02/duckdb:duckdb 17836414 18634259 0.96
tpcds_q03/duckdb:duckdb 8082398 8789024 0.92
tpcds_q04/duckdb:duckdb 160512747 166566565 0.96
tpcds_q05/duckdb:duckdb 18298050 18868043 0.97
tpcds_q06/duckdb:duckdb 23359278 23101346 1.01
tpcds_q07/duckdb:duckdb 38386848 39426485 0.97
tpcds_q08/duckdb:duckdb 119780622 120724023 0.99
tpcds_q09/duckdb:duckdb 19607984 20239914 0.97
tpcds_q10/duckdb:duckdb 23570957 24044915 0.98
tpcds_q11/duckdb:duckdb 140201342 140097879 1.00
tpcds_q12/duckdb:duckdb 12098684 11688475 1.04
tpcds_q13/duckdb:duckdb 24326873 24674519 0.99
tpcds_q14/duckdb:duckdb 92506078 95362907 0.97
tpcds_q15/duckdb:duckdb 24702398 25919478 0.95
tpcds_q16/duckdb:duckdb 18227607 18229522 1.00
tpcds_q17/duckdb:duckdb 21497761 22561395 0.95
tpcds_q18/duckdb:duckdb 43158164 45913154 0.94
tpcds_q19/duckdb:duckdb 15981124 16551661 0.97
tpcds_q20/duckdb:duckdb 12106778 12129253 1.00
tpcds_q21/duckdb:duckdb 🚀 6643802 8193441 0.81
tpcds_q22/duckdb:duckdb 🚀 59066928 67338318 0.88
tpcds_q23/duckdb:duckdb 🚀 73269371 82189425 0.89
tpcds_q24/duckdb:duckdb 23555587 24941833 0.94
tpcds_q25/duckdb:duckdb 16573256 16695360 0.99
tpcds_q26/duckdb:duckdb 25716490 25944494 0.99
tpcds_q27/duckdb:duckdb 40057046 41404946 0.97
tpcds_q28/duckdb:duckdb 21040657 21543883 0.98
tpcds_q29/duckdb:duckdb 20120865 20878066 0.96
tpcds_q30/duckdb:duckdb 29609366 31021053 0.95
tpcds_q31/duckdb:duckdb 19926714 20996911 0.95
tpcds_q32/duckdb:duckdb 7117051 7570847 0.94
tpcds_q33/duckdb:duckdb 12478899 12755949 0.98
tpcds_q34/duckdb:duckdb 14965764 15602349 0.96
tpcds_q35/duckdb:duckdb 31251748 32891673 0.95
tpcds_q36/duckdb:duckdb 70522982 74123465 0.95
tpcds_q37/duckdb:duckdb 7820450 7915042 0.99
tpcds_q38/duckdb:duckdb 31713065 30818168 1.03
tpcds_q39/duckdb:duckdb 26959263 26893643 1.00
tpcds_q40/duckdb:duckdb 13854545 14118703 0.98
tpcds_q41/duckdb:duckdb 8084086 8806462 0.92
tpcds_q42/duckdb:duckdb 🚀 5867012 6767842 0.87
tpcds_q43/duckdb:duckdb 11326191 11520972 0.98
tpcds_q44/duckdb:duckdb 13055687 13601476 0.96
tpcds_q45/duckdb:duckdb 17096011 17633069 0.97
tpcds_q46/duckdb:duckdb 36188664 38171412 0.95
tpcds_q47/duckdb:duckdb 40360814 40982366 0.98
tpcds_q48/duckdb:duckdb 22083093 23445449 0.94
tpcds_q49/duckdb:duckdb 16136868 17471734 0.92
tpcds_q50/duckdb:duckdb 13825798 14928510 0.93
tpcds_q51/duckdb:duckdb 92350823 93387716 0.99
tpcds_q52/duckdb:duckdb 7139092 7284977 0.98
tpcds_q53/duckdb:duckdb 11579807 11963640 0.97
tpcds_q54/duckdb:duckdb 16379307 17206147 0.95
tpcds_q55/duckdb:duckdb 7025925 7215346 0.97
tpcds_q56/duckdb:duckdb 13385756 14207647 0.94
tpcds_q57/duckdb:duckdb 30837907 31352883 0.98
tpcds_q58/duckdb:duckdb 🚀 11578479 13532318 0.86
tpcds_q59/duckdb:duckdb 34284662 35073727 0.98
tpcds_q60/duckdb:duckdb 14424349 15096432 0.96
tpcds_q61/duckdb:duckdb 14422712 14296110 1.01
tpcds_q62/duckdb:duckdb 9164547 9102032 1.01
tpcds_q63/duckdb:duckdb 11064019 11654759 0.95
tpcds_q64/duckdb:duckdb 50983371 54893724 0.93
tpcds_q65/duckdb:duckdb 34243774 32741434 1.05
tpcds_q66/duckdb:duckdb 23671084 24463354 0.97
tpcds_q67/duckdb:duckdb 127067481 134250938 0.95
tpcds_q68/duckdb:duckdb 24197776 25279222 0.96
tpcds_q69/duckdb:duckdb 22464409 24213837 0.93
tpcds_q70/duckdb:duckdb 14021367 14210359 0.99
tpcds_q71/duckdb:duckdb 12207292 12977693 0.94
tpcds_q72/duckdb:duckdb 42288525 43757582 0.97
tpcds_q73/duckdb:duckdb 10239325 10485023 0.98
tpcds_q74/duckdb:duckdb 99652869 100721178 0.99
tpcds_q75/duckdb:duckdb 42776700 43511534 0.98
tpcds_q76/duckdb:duckdb 11166184 11860588 0.94
tpcds_q77/duckdb:duckdb 11925607 12346247 0.97
tpcds_q78/duckdb:duckdb 63058456 65969114 0.96
tpcds_q79/duckdb:duckdb 18125847 18972154 0.96
tpcds_q80/duckdb:duckdb 27353792 29871555 0.92
tpcds_q81/duckdb:duckdb 36749577 37987871 0.97
tpcds_q82/duckdb:duckdb 🚀 8118403 9034159 0.90
tpcds_q83/duckdb:duckdb 8999145 9269125 0.97
tpcds_q84/duckdb:duckdb 13422470 13656276 0.98
tpcds_q85/duckdb:duckdb 24048623 25655594 0.94
tpcds_q86/duckdb:duckdb 10312554 10470246 0.98
tpcds_q87/duckdb:duckdb 31451563 32234709 0.98
tpcds_q88/duckdb:duckdb 23982740 24581795 0.98
tpcds_q89/duckdb:duckdb 12826281 13807281 0.93
tpcds_q90/duckdb:duckdb 5794694 5864776 0.99
tpcds_q91/duckdb:duckdb 12518005 12398451 1.01
tpcds_q92/duckdb:duckdb 9053095 8984865 1.01
tpcds_q93/duckdb:duckdb 22468523 23604486 0.95
tpcds_q94/duckdb:duckdb 12648290 13448959 0.94
tpcds_q95/duckdb:duckdb 125119466 131896308 0.95
tpcds_q96/duckdb:duckdb 4411356 4644392 0.95
tpcds_q97/duckdb:duckdb 30746394 30948748 0.99
tpcds_q98/duckdb:duckdb 13232167 14053522 0.94
tpcds_q99/duckdb:duckdb 16061269 16536705 0.97
Full attributed analysis
Query Config Raw Δ Control Δ Attributed α Noise floor Significant?
1 datafusion:vortex-compact -7.0% +0.2% -7.2% +11.8% ➖ noise
1 datafusion:vortex-file-compressed -5.1% +0.2% -5.2% +14.8% ➖ noise
1 duckdb:duckdb -8.3% +0.2% -8.5% +12.2% ➖ noise
1 duckdb:vortex-compact -7.3% +0.2% -7.4% +12.4% ➖ noise
1 duckdb:vortex-file-compressed -5.6% +0.2% -5.8% +13.1% ➖ noise
2 datafusion:vortex-compact -2.7% -7.9% +5.6% +10.0% ➖ noise
2 datafusion:vortex-file-compressed -0.4% -7.9% +8.1% +10.1% ➖ noise
2 duckdb:duckdb -4.3% -7.9% +3.9% +12.0% ➖ noise
2 duckdb:vortex-compact -4.9% -7.9% +3.2% +10.0% ➖ noise
2 duckdb:vortex-file-compressed -4.7% -7.9% +3.5% +11.0% ➖ noise
3 datafusion:vortex-compact -1.4% -4.4% +3.1% +12.4% ➖ noise
3 datafusion:vortex-file-compressed -5.5% -4.4% -1.2% +12.1% ➖ noise
3 duckdb:duckdb -8.0% -4.4% -3.9% +18.4% ➖ noise
3 duckdb:vortex-compact -4.3% -4.4% +0.0% +14.7% ➖ noise
3 duckdb:vortex-file-compressed -2.2% -4.4% +2.2% +13.7% ➖ noise
4 datafusion:vortex-compact -3.6% -6.5% +3.1% +10.0% ➖ noise
4 datafusion:vortex-file-compressed -2.9% -6.5% +3.8% +10.0% ➖ noise
4 duckdb:duckdb -3.6% -6.5% +3.1% +10.0% ➖ noise
4 duckdb:vortex-compact -4.3% -6.5% +2.4% +10.0% ➖ noise
4 duckdb:vortex-file-compressed +0.8% -6.5% +7.8% +10.0% ➖ noise
5 datafusion:vortex-compact -2.1% -4.0% +2.0% +10.9% ➖ noise
5 datafusion:vortex-file-compressed -7.0% -4.0% -3.1% +10.8% ➖ noise
5 duckdb:duckdb -3.0% -4.0% +1.0% +12.4% ➖ noise
5 duckdb:vortex-compact -12.4% -4.0% -8.8% +13.8% ➖ noise
5 duckdb:vortex-file-compressed -1.6% -4.0% +2.5% +10.0% ➖ noise
6 datafusion:vortex-compact -4.5% -5.3% +0.8% +10.0% ➖ noise
6 datafusion:vortex-file-compressed -4.3% -5.3% +1.0% +10.0% ➖ noise
6 duckdb:duckdb +1.1% -5.3% +6.7% +12.7% ➖ noise
6 duckdb:vortex-compact -6.1% -5.3% -0.9% +10.0% ➖ noise
6 duckdb:vortex-file-compressed -5.5% -5.3% -0.2% +10.0% ➖ noise
7 datafusion:vortex-compact -0.2% -3.5% +3.4% +10.0% ➖ noise
7 datafusion:vortex-file-compressed -0.6% -3.5% +2.9% +10.0% ➖ noise
7 duckdb:duckdb -2.6% -3.5% +0.8% +18.4% ➖ noise
7 duckdb:vortex-compact -3.6% -3.5% -0.2% +10.7% ➖ noise
7 duckdb:vortex-file-compressed -3.0% -3.5% +0.5% +11.7% ➖ noise
8 datafusion:vortex-compact -4.0% -2.0% -2.1% +10.0% ➖ noise
8 datafusion:vortex-file-compressed +1.2% -2.0% +3.3% +10.0% ➖ noise
8 duckdb:duckdb -0.8% -2.0% +1.2% +10.0% ➖ noise
8 duckdb:vortex-compact -6.1% -2.0% -4.2% +10.0% ➖ noise
8 duckdb:vortex-file-compressed -4.2% -2.0% -2.3% +10.0% ➖ noise
9 datafusion:vortex-compact -3.6% -1.7% -1.9% +10.0% ➖ noise
9 datafusion:vortex-file-compressed -6.2% -1.7% -4.5% +10.0% ➖ noise
9 duckdb:duckdb -3.1% -1.7% -1.4% +10.0% ➖ noise
9 duckdb:vortex-compact -4.9% -1.7% -3.3% +10.0% ➖ noise
9 duckdb:vortex-file-compressed -7.2% -1.7% -5.6% +11.2% ➖ noise
10 datafusion:vortex-compact -4.7% -6.3% +1.7% +10.0% ➖ noise
10 datafusion:vortex-file-compressed +1.3% -6.3% +8.0% +10.0% ➖ noise
10 duckdb:duckdb -2.0% -6.3% +4.6% +10.0% ➖ noise
10 duckdb:vortex-compact -8.1% -6.3% -2.0% +10.0% ➖ noise
10 duckdb:vortex-file-compressed -5.1% -6.3% +1.3% +10.0% ➖ noise
11 datafusion:vortex-compact -2.8% -4.8% +2.0% +10.0% ➖ noise
11 datafusion:vortex-file-compressed -3.7% -4.8% +1.1% +10.0% ➖ noise
11 duckdb:duckdb +0.1% -4.8% +5.1% +10.0% ➖ noise
11 duckdb:vortex-compact -6.0% -4.8% -1.3% +10.0% ➖ noise
11 duckdb:vortex-file-compressed -0.4% -4.8% +4.6% +10.0% ➖ noise
12 datafusion:vortex-compact -2.1% -6.5% +4.7% +10.1% ➖ noise
12 datafusion:vortex-file-compressed -0.9% -6.5% +6.0% +24.4% ➖ noise
12 duckdb:duckdb +3.5% -6.5% +10.7% +12.4% ➖ noise
12 duckdb:vortex-compact -14.2% -6.5% -8.3% +13.4% ➖ noise
12 duckdb:vortex-file-compressed -6.3% -6.5% +0.1% +12.1% ➖ noise
13 datafusion:vortex-compact -3.0% -4.4% +1.5% +10.0% ➖ noise
13 datafusion:vortex-file-compressed -0.4% -4.4% +4.3% +10.0% ➖ noise
13 duckdb:duckdb -1.4% -4.4% +3.1% +10.0% ➖ noise
13 duckdb:vortex-compact -4.7% -4.4% -0.3% +10.0% ➖ noise
13 duckdb:vortex-file-compressed -6.8% -4.4% -2.5% +10.9% ➖ noise
14 datafusion:vortex-compact -6.4% -4.3% -2.3% +10.0% ➖ noise
14 datafusion:vortex-file-compressed -1.2% -4.3% +3.2% +10.0% ➖ noise
14 duckdb:duckdb -3.0% -4.3% +1.3% +10.0% ➖ noise
14 duckdb:vortex-compact -8.1% -4.3% -4.0% +11.9% ➖ noise
14 duckdb:vortex-file-compressed +0.8% -4.3% +5.3% +10.0% ➖ noise
15 datafusion:vortex-compact -4.1% -3.3% -0.8% +10.0% ➖ noise
15 datafusion:vortex-file-compressed -1.9% -3.3% +1.5% +10.0% ➖ noise
15 duckdb:duckdb -4.7% -3.3% -1.4% +12.2% ➖ noise
15 duckdb:vortex-compact -3.8% -3.3% -0.5% +10.0% ➖ noise
15 duckdb:vortex-file-compressed -4.6% -3.3% -1.3% +10.0% ➖ noise
16 datafusion:vortex-compact -1.6% -5.0% +3.6% +10.5% ➖ noise
16 datafusion:vortex-file-compressed -7.2% -5.0% -2.3% +10.9% ➖ noise
16 duckdb:duckdb -0.0% -5.0% +5.3% +22.2% ➖ noise
16 duckdb:vortex-compact -7.4% -5.0% -2.5% +14.9% ➖ noise
16 duckdb:vortex-file-compressed -6.1% -5.0% -1.1% +12.3% ➖ noise
17 datafusion:vortex-compact -6.6% -5.4% -1.3% +10.0% ➖ noise
17 datafusion:vortex-file-compressed -3.0% -5.4% +2.5% +10.0% ➖ noise
17 duckdb:duckdb -4.7% -5.4% +0.7% +10.0% ➖ noise
17 duckdb:vortex-compact +1.0% -5.4% +6.8% +10.0% ➖ noise
17 duckdb:vortex-file-compressed -8.7% -5.4% -3.5% +10.6% ➖ noise
18 datafusion:vortex-compact -5.0% -4.0% -1.1% +10.0% ➖ noise
18 datafusion:vortex-file-compressed -3.3% -4.0% +0.8% +10.0% ➖ noise
18 duckdb:duckdb -6.0% -4.0% -2.1% +10.0% ➖ noise
18 duckdb:vortex-compact -7.9% -4.0% -4.1% +10.0% ➖ noise
18 duckdb:vortex-file-compressed -8.7% -4.0% -4.8% +10.0% ➖ noise
19 datafusion:vortex-compact -6.7% -2.7% -4.2% +10.0% ➖ noise
19 datafusion:vortex-file-compressed -3.4% -2.7% -0.8% +10.5% ➖ noise
19 duckdb:duckdb -3.4% -2.7% -0.8% +10.5% ➖ noise
19 duckdb:vortex-compact -2.6% -2.7% +0.1% +10.0% ➖ noise
19 duckdb:vortex-file-compressed -1.1% -2.7% +1.6% +14.5% ➖ noise
20 datafusion:vortex-compact -6.3% -5.2% -1.1% +10.0% ➖ noise
20 datafusion:vortex-file-compressed -6.5% -5.2% -1.3% +10.0% ➖ noise
20 duckdb:duckdb -0.2% -5.2% +5.3% +10.1% ➖ noise
20 duckdb:vortex-compact -10.4% -5.2% -5.4% +15.9% ➖ noise
20 duckdb:vortex-file-compressed -4.1% -5.2% +1.2% +10.0% ➖ noise
21 datafusion:vortex-compact -7.5% -3.7% -3.9% +10.0% ➖ noise
21 datafusion:vortex-file-compressed -3.6% -3.7% +0.1% +10.0% ➖ noise
21 duckdb:duckdb -18.9% -3.7% -15.8% +16.3% ✅ faster
21 duckdb:vortex-compact -7.4% -3.7% -3.8% +10.8% ➖ noise
21 duckdb:vortex-file-compressed +2.1% -3.7% +6.0% +15.6% ➖ noise
22 datafusion:vortex-compact -6.6% -12.7% +7.0% +10.7% ➖ noise
22 datafusion:vortex-file-compressed -3.3% -12.7% +10.7% +12.8% ➖ noise
22 duckdb:duckdb -12.3% -12.7% +0.4% +11.7% ➖ noise
22 duckdb:vortex-compact -6.8% -12.7% +6.7% +11.0% ➖ noise
22 duckdb:vortex-file-compressed -5.2% -12.7% +8.6% +10.5% ➖ noise
23 datafusion:vortex-compact -3.5% -6.0% +2.6% +10.0% ➖ noise
23 datafusion:vortex-file-compressed -5.7% -6.0% +0.3% +10.0% ➖ noise
23 duckdb:duckdb -10.9% -6.0% -5.2% +15.8% ➖ noise
23 duckdb:vortex-compact -13.1% -6.0% -7.6% +11.3% ➖ noise
23 duckdb:vortex-file-compressed -11.2% -6.0% -5.5% +10.0% ➖ noise
24 datafusion:vortex-compact -8.2% -3.4% -5.0% +10.0% ➖ noise
24 datafusion:vortex-file-compressed -2.8% -3.4% +0.6% +10.0% ➖ noise
24 duckdb:duckdb -5.6% -3.4% -2.3% +10.4% ➖ noise
24 duckdb:vortex-compact -2.7% -3.4% +0.7% +10.0% ➖ noise
24 duckdb:vortex-file-compressed -4.7% -3.4% -1.3% +12.1% ➖ noise
25 datafusion:vortex-compact -2.6% -4.9% +2.4% +10.0% ➖ noise
25 datafusion:vortex-file-compressed -4.9% -4.9% +0.0% +10.0% ➖ noise
25 duckdb:duckdb -0.7% -4.9% +4.4% +10.0% ➖ noise
25 duckdb:vortex-compact -5.0% -4.9% -0.1% +10.0% ➖ noise
25 duckdb:vortex-file-compressed -4.9% -4.9% +0.1% +10.4% ➖ noise
26 datafusion:vortex-compact -2.0% -6.9% +5.3% +14.8% ➖ noise
26 datafusion:vortex-file-compressed -4.5% -6.9% +2.6% +10.2% ➖ noise
26 duckdb:duckdb -0.9% -6.9% +6.5% +15.4% ➖ noise
26 duckdb:vortex-compact -5.9% -6.9% +1.2% +16.4% ➖ noise
26 duckdb:vortex-file-compressed -9.2% -6.9% -2.4% +13.8% ➖ noise
27 datafusion:vortex-compact -3.3% -3.8% +0.4% +10.0% ➖ noise
27 datafusion:vortex-file-compressed -3.8% -3.8% -0.0% +10.0% ➖ noise
27 duckdb:duckdb -3.3% -3.8% +0.5% +13.3% ➖ noise
27 duckdb:vortex-compact -4.1% -3.8% -0.4% +10.0% ➖ noise
27 duckdb:vortex-file-compressed -5.9% -3.8% -2.2% +10.0% ➖ noise
28 datafusion:vortex-compact -5.5% -3.3% -2.2% +10.0% ➖ noise
28 datafusion:vortex-file-compressed -5.4% -3.3% -2.2% +10.0% ➖ noise
28 duckdb:duckdb -2.3% -3.3% +1.0% +10.0% ➖ noise
28 duckdb:vortex-compact -2.0% -3.3% +1.4% +10.0% ➖ noise
28 duckdb:vortex-file-compressed -1.1% -3.3% +2.3% +10.0% ➖ noise
29 datafusion:vortex-compact -5.1% -5.7% +0.7% +10.0% ➖ noise
29 datafusion:vortex-file-compressed -2.1% -5.7% +3.8% +10.0% ➖ noise
29 duckdb:duckdb -3.6% -5.7% +2.2% +10.0% ➖ noise
29 duckdb:vortex-compact -7.8% -5.7% -2.2% +12.3% ➖ noise
29 duckdb:vortex-file-compressed -3.0% -5.7% +2.9% +10.3% ➖ noise
30 datafusion:vortex-compact -0.5% -3.7% +3.4% +10.4% ➖ noise
30 datafusion:vortex-file-compressed -2.6% -3.7% +1.2% +11.2% ➖ noise
30 duckdb:duckdb -4.6% -3.7% -0.9% +10.0% ➖ noise
30 duckdb:vortex-compact -7.9% -3.7% -4.3% +10.0% ➖ noise
30 duckdb:vortex-file-compressed +3.9% -3.7% +7.9% +11.3% ➖ noise
31 datafusion:vortex-compact -3.4% -4.1% +0.7% +10.0% ➖ noise
31 datafusion:vortex-file-compressed -4.6% -4.1% -0.6% +10.0% ➖ noise
31 duckdb:duckdb -5.1% -4.1% -1.1% +14.5% ➖ noise
31 duckdb:vortex-compact -5.0% -4.1% -1.0% +17.7% ➖ noise
31 duckdb:vortex-file-compressed -8.4% -4.1% -4.5% +10.9% ➖ noise
32 datafusion:vortex-compact -11.2% -3.7% -7.7% +10.9% ➖ noise
32 datafusion:vortex-file-compressed -11.8% -3.7% -8.4% +11.9% ➖ noise
32 duckdb:duckdb -6.0% -3.7% -2.3% +18.6% ➖ noise
32 duckdb:vortex-compact -1.4% -3.7% +2.4% +10.0% ➖ noise
32 duckdb:vortex-file-compressed -0.2% -3.7% +3.7% +16.9% ➖ noise
33 datafusion:vortex-compact -7.2% -3.7% -3.6% +10.0% ➖ noise
33 datafusion:vortex-file-compressed -9.7% -3.7% -6.2% +11.0% ➖ noise
33 duckdb:duckdb -2.2% -3.7% +1.6% +11.7% ➖ noise
33 duckdb:vortex-compact -6.0% -3.7% -2.4% +10.0% ➖ noise
33 duckdb:vortex-file-compressed -10.8% -3.7% -7.4% +13.2% ➖ noise
34 datafusion:vortex-compact -6.9% -2.8% -4.2% +10.4% ➖ noise
34 datafusion:vortex-file-compressed -5.4% -2.8% -2.6% +10.0% ➖ noise
34 duckdb:duckdb -4.1% -2.8% -1.3% +10.7% ➖ noise
34 duckdb:vortex-compact -1.8% -2.8% +1.1% +10.0% ➖ noise
34 duckdb:vortex-file-compressed +1.5% -2.8% +4.5% +10.8% ➖ noise
35 datafusion:vortex-compact -9.6% -4.2% -5.7% +10.0% ➖ noise
35 datafusion:vortex-file-compressed -6.5% -4.2% -2.5% +10.0% ➖ noise
35 duckdb:duckdb -5.0% -4.2% -0.9% +17.0% ➖ noise
35 duckdb:vortex-compact -2.0% -4.2% +2.2% +10.0% ➖ noise
35 duckdb:vortex-file-compressed -10.9% -4.2% -7.0% +10.0% ➖ noise
36 datafusion:vortex-compact -1.4% -1.8% +0.4% +10.0% ➖ noise
36 datafusion:vortex-file-compressed -2.2% -1.8% -0.4% +10.0% ➖ noise
36 duckdb:duckdb -4.9% -1.8% -3.1% +10.0% ➖ noise
36 duckdb:vortex-compact -0.7% -1.8% +1.2% +10.0% ➖ noise
36 duckdb:vortex-file-compressed -1.4% -1.8% +0.4% +15.0% ➖ noise
37 datafusion:vortex-compact -7.0% -5.9% -1.2% +10.0% ➖ noise
37 datafusion:vortex-file-compressed +1.2% -5.9% +7.5% +12.9% ➖ noise
37 duckdb:duckdb -1.2% -5.9% +5.0% +11.2% ➖ noise
37 duckdb:vortex-compact -4.1% -5.9% +1.8% +16.0% ➖ noise
37 duckdb:vortex-file-compressed +2.0% -5.9% +8.4% +13.8% ➖ noise
38 datafusion:vortex-compact -4.9% -2.6% -2.4% +10.0% ➖ noise
38 datafusion:vortex-file-compressed -3.0% -2.6% -0.4% +10.0% ➖ noise
38 duckdb:duckdb +2.9% -2.6% +5.6% +10.0% ➖ noise
38 duckdb:vortex-compact -3.8% -2.6% -1.2% +11.3% ➖ noise
38 duckdb:vortex-file-compressed +4.0% -2.6% +6.7% +10.0% ➖ noise
39 datafusion:vortex-compact -1.6% -3.5% +2.0% +20.4% ➖ noise
39 datafusion:vortex-file-compressed -1.5% -3.5% +2.1% +19.4% ➖ noise
39 duckdb:duckdb +0.2% -3.5% +3.9% +16.1% ➖ noise
39 duckdb:vortex-compact +4.1% -3.5% +8.0% +20.3% ➖ noise
39 duckdb:vortex-file-compressed -0.2% -3.5% +3.4% +19.8% ➖ noise
40 datafusion:vortex-compact -7.1% -4.9% -2.3% +12.7% ➖ noise
40 datafusion:vortex-file-compressed -7.3% -4.9% -2.5% +13.3% ➖ noise
40 duckdb:duckdb -1.9% -4.9% +3.2% +17.5% ➖ noise
40 duckdb:vortex-compact +0.2% -4.9% +5.4% +14.2% ➖ noise
40 duckdb:vortex-file-compressed -10.4% -4.9% -5.7% +13.9% ➖ noise
41 datafusion:vortex-compact -7.3% -4.1% -3.4% +14.2% ➖ noise
41 datafusion:vortex-file-compressed -14.5% -4.1% -10.9% +13.6% ➖ noise
41 duckdb:duckdb -8.2% -4.1% -4.3% +10.0% ➖ noise
41 duckdb:vortex-compact -1.1% -4.1% +3.1% +10.0% ➖ noise
41 duckdb:vortex-file-compressed -4.4% -4.1% -0.3% +10.0% ➖ noise
42 datafusion:vortex-compact -7.5% -4.1% -3.6% +13.4% ➖ noise
42 datafusion:vortex-file-compressed -8.9% -4.1% -5.0% +10.0% ➖ noise
42 duckdb:duckdb -13.3% -4.1% -9.6% +16.8% ➖ noise
42 duckdb:vortex-compact -0.6% -4.1% +3.6% +11.5% ➖ noise
42 duckdb:vortex-file-compressed -8.4% -4.1% -4.4% +14.9% ➖ noise
43 datafusion:vortex-compact -1.7% -7.1% +5.8% +10.0% ➖ noise
43 datafusion:vortex-file-compressed -7.9% -7.1% -0.8% +10.0% ➖ noise
43 duckdb:duckdb -1.7% -7.1% +5.8% +10.4% ➖ noise
43 duckdb:vortex-compact -0.6% -7.1% +6.9% +10.0% ➖ noise
43 duckdb:vortex-file-compressed -6.9% -7.1% +0.2% +10.0% ➖ noise
44 datafusion:vortex-compact -2.2% -2.4% +0.2% +10.0% ➖ noise
44 datafusion:vortex-file-compressed -6.8% -2.4% -4.5% +10.0% ➖ noise
44 duckdb:duckdb -4.0% -2.4% -1.6% +10.8% ➖ noise
44 duckdb:vortex-compact -0.3% -2.4% +2.2% +10.0% ➖ noise
44 duckdb:vortex-file-compressed -9.0% -2.4% -6.7% +13.5% ➖ noise
45 datafusion:vortex-compact -7.8% +1.0% -8.7% +10.0% ➖ noise
45 datafusion:vortex-file-compressed -5.0% +1.0% -5.9% +10.0% ➖ noise
45 duckdb:duckdb -3.0% +1.0% -4.0% +12.6% ➖ noise
45 duckdb:vortex-compact +6.6% +1.0% +5.6% +11.8% ➖ noise
45 duckdb:vortex-file-compressed -3.6% +1.0% -4.5% +12.6% ➖ noise
46 datafusion:vortex-compact -4.0% -5.5% +1.6% +10.0% ➖ noise
46 datafusion:vortex-file-compressed -5.9% -5.5% -0.4% +10.0% ➖ noise
46 duckdb:duckdb -5.2% -5.5% +0.3% +10.0% ➖ noise
46 duckdb:vortex-compact -2.2% -5.5% +3.5% +10.0% ➖ noise
46 duckdb:vortex-file-compressed -5.9% -5.5% -0.5% +10.0% ➖ noise
47 datafusion:vortex-compact -5.0% -2.9% -2.2% +10.0% ➖ noise
47 datafusion:vortex-file-compressed -6.8% -2.9% -4.0% +10.0% ➖ noise
47 duckdb:duckdb -1.5% -2.9% +1.4% +10.0% ➖ noise
47 duckdb:vortex-compact -2.7% -2.9% +0.1% +10.0% ➖ noise
47 duckdb:vortex-file-compressed -4.7% -2.9% -1.9% +14.3% ➖ noise
48 datafusion:vortex-compact -4.0% -1.6% -2.4% +11.3% ➖ noise
48 datafusion:vortex-file-compressed -5.8% -1.6% -4.3% +10.0% ➖ noise
48 duckdb:duckdb -5.8% -1.6% -4.3% +10.5% ➖ noise
48 duckdb:vortex-compact +1.9% -1.6% +3.5% +10.0% ➖ noise
48 duckdb:vortex-file-compressed -0.3% -1.6% +1.3% +12.0% ➖ noise
49 datafusion:vortex-compact -3.0% -2.8% -0.2% +11.5% ➖ noise
49 datafusion:vortex-file-compressed -4.5% -2.8% -1.7% +14.1% ➖ noise
49 duckdb:duckdb -7.6% -2.8% -5.0% +16.7% ➖ noise
49 duckdb:vortex-compact -1.6% -2.8% +1.3% +11.6% ➖ noise
49 duckdb:vortex-file-compressed -13.3% -2.8% -10.8% +19.2% ➖ noise
50 datafusion:vortex-compact -2.6% -0.9% -1.7% +10.0% ➖ noise
50 datafusion:vortex-file-compressed -5.3% -0.9% -4.4% +10.0% ➖ noise
50 duckdb:duckdb -7.4% -0.9% -6.5% +10.0% ➖ noise
50 duckdb:vortex-compact -2.9% -0.9% -1.9% +10.0% ➖ noise
50 duckdb:vortex-file-compressed -4.6% -0.9% -3.7% +10.0% ➖ noise
51 datafusion:vortex-compact -8.5% -8.2% -0.4% +13.4% ➖ noise
51 datafusion:vortex-file-compressed -6.8% -8.2% +1.6% +14.6% ➖ noise
51 duckdb:duckdb -1.1% -8.2% +7.8% +10.7% ➖ noise
51 duckdb:vortex-compact -2.1% -8.2% +6.7% +21.7% ➖ noise
51 duckdb:vortex-file-compressed -10.5% -8.2% -2.5% +16.9% ➖ noise
52 datafusion:vortex-compact -9.5% -8.7% -0.9% +12.4% ➖ noise
52 datafusion:vortex-file-compressed +1.5% -8.7% +11.1% +12.2% ➖ noise
52 duckdb:duckdb -2.0% -8.7% +7.3% +15.1% ➖ noise
52 duckdb:vortex-compact -6.4% -8.7% +2.5% +19.2% ➖ noise
52 duckdb:vortex-file-compressed -9.9% -8.7% -1.4% +18.6% ➖ noise
53 datafusion:vortex-compact -8.0% -3.2% -4.9% +10.8% ➖ noise
53 datafusion:vortex-file-compressed -7.9% -3.2% -4.9% +10.0% ➖ noise
53 duckdb:duckdb -3.2% -3.2% +0.0% +11.6% ➖ noise
53 duckdb:vortex-compact -7.8% -3.2% -4.7% +10.6% ➖ noise
53 duckdb:vortex-file-compressed -6.1% -3.2% -3.0% +11.8% ➖ noise
54 datafusion:vortex-compact -6.4% -3.4% -3.1% +10.0% ➖ noise
54 datafusion:vortex-file-compressed -6.5% -3.4% -3.2% +10.0% ➖ noise
54 duckdb:duckdb -4.8% -3.4% -1.4% +14.6% ➖ noise
54 duckdb:vortex-compact -7.7% -3.4% -4.5% +10.0% ➖ noise
54 duckdb:vortex-file-compressed -2.6% -3.4% +0.8% +10.6% ➖ noise
55 datafusion:vortex-compact -2.4% -4.5% +2.2% +12.9% ➖ noise
55 datafusion:vortex-file-compressed -4.3% -4.5% +0.3% +12.6% ➖ noise
55 duckdb:duckdb -2.6% -4.5% +2.0% +15.4% ➖ noise
55 duckdb:vortex-compact -8.7% -4.5% -4.4% +12.9% ➖ noise
55 duckdb:vortex-file-compressed +7.2% -4.5% +12.3% +15.7% ➖ noise
56 datafusion:vortex-compact -5.2% -3.5% -1.8% +10.0% ➖ noise
56 datafusion:vortex-file-compressed -3.4% -3.5% +0.1% +10.0% ➖ noise
56 duckdb:duckdb -5.8% -3.5% -2.4% +10.0% ➖ noise
56 duckdb:vortex-compact -4.3% -3.5% -0.8% +10.0% ➖ noise
56 duckdb:vortex-file-compressed -10.4% -3.5% -7.1% +10.8% ➖ noise
57 datafusion:vortex-compact -6.5% -5.8% -0.7% +10.0% ➖ noise
57 datafusion:vortex-file-compressed -4.3% -5.8% +1.7% +10.0% ➖ noise
57 duckdb:duckdb -1.6% -5.8% +4.4% +12.4% ➖ noise
57 duckdb:vortex-compact -1.1% -5.8% +5.0% +20.9% ➖ noise
57 duckdb:vortex-file-compressed -6.1% -5.8% -0.4% +17.4% ➖ noise
58 datafusion:vortex-compact -6.8% -3.7% -3.2% +10.0% ➖ noise
58 datafusion:vortex-file-compressed -8.8% -3.7% -5.3% +10.0% ➖ noise
58 duckdb:duckdb -14.4% -3.7% -11.1% +18.4% ➖ noise
58 duckdb:vortex-compact -13.9% -3.7% -10.6% +21.8% ➖ noise
58 duckdb:vortex-file-compressed -6.0% -3.7% -2.3% +13.1% ➖ noise
59 datafusion:vortex-compact -5.0% -2.0% -3.1% +10.0% ➖ noise
59 datafusion:vortex-file-compressed -6.2% -2.0% -4.3% +10.0% ➖ noise
59 duckdb:duckdb -2.2% -2.0% -0.3% +10.0% ➖ noise
59 duckdb:vortex-compact +1.0% -2.0% +3.0% +10.0% ➖ noise
59 duckdb:vortex-file-compressed -2.3% -2.0% -0.4% +10.0% ➖ noise
60 datafusion:vortex-compact -10.3% -4.0% -6.6% +10.0% ➖ noise
60 datafusion:vortex-file-compressed -2.9% -4.0% +1.1% +10.0% ➖ noise
60 duckdb:duckdb -4.5% -4.0% -0.5% +17.9% ➖ noise
60 duckdb:vortex-compact -6.0% -4.0% -2.1% +10.0% ➖ noise
60 duckdb:vortex-file-compressed -7.4% -4.0% -3.5% +10.1% ➖ noise
61 datafusion:vortex-compact -5.4% -0.7% -4.8% +10.0% ➖ noise
61 datafusion:vortex-file-compressed -1.8% -0.7% -1.1% +10.0% ➖ noise
61 duckdb:duckdb +0.9% -0.7% +1.6% +10.4% ➖ noise
61 duckdb:vortex-compact -1.3% -0.7% -0.6% +10.0% ➖ noise
61 duckdb:vortex-file-compressed +6.2% -0.7% +7.0% +11.2% ➖ noise
62 datafusion:vortex-compact -6.2% -5.8% -0.4% +11.9% ➖ noise
62 datafusion:vortex-file-compressed -6.7% -5.8% -1.0% +11.5% ➖ noise
62 duckdb:duckdb +0.7% -5.8% +6.8% +12.3% ➖ noise
62 duckdb:vortex-compact -2.1% -5.8% +3.8% +27.4% ➖ noise
62 duckdb:vortex-file-compressed -12.8% -5.8% -7.5% +19.0% ➖ noise
63 datafusion:vortex-compact -7.9% -6.3% -1.7% +10.0% ➖ noise
63 datafusion:vortex-file-compressed -3.0% -6.3% +3.5% +10.0% ➖ noise
63 duckdb:duckdb -5.1% -6.3% +1.3% +10.0% ➖ noise
63 duckdb:vortex-compact -4.8% -6.3% +1.6% +10.0% ➖ noise
63 duckdb:vortex-file-compressed -4.0% -6.3% +2.5% +11.9% ➖ noise
64 datafusion:vortex-compact -5.6% -3.3% -2.3% +10.0% ➖ noise
64 datafusion:vortex-file-compressed -4.9% -3.3% -1.6% +10.0% ➖ noise
64 duckdb:duckdb -7.1% -3.3% -3.9% +10.0% ➖ noise
64 duckdb:vortex-compact -8.8% -3.3% -5.6% +10.0% ➖ noise
64 duckdb:vortex-file-compressed -7.2% -3.3% -4.0% +10.0% ➖ noise
65 datafusion:vortex-compact -4.0% -7.6% +3.9% +11.7% ➖ noise
65 datafusion:vortex-file-compressed -1.8% -7.6% +6.3% +15.8% ➖ noise
65 duckdb:duckdb +4.6% -7.6% +13.2% +15.6% ➖ noise
65 duckdb:vortex-compact -3.3% -7.6% +4.7% +10.8% ➖ noise
65 duckdb:vortex-file-compressed -3.2% -7.6% +4.8% +10.3% ➖ noise
66 datafusion:vortex-compact -4.8% -3.0% -1.9% +11.2% ➖ noise
66 datafusion:vortex-file-compressed -4.4% -3.0% -1.5% +13.2% ➖ noise
66 duckdb:duckdb -3.2% -3.0% -0.3% +12.7% ➖ noise
66 duckdb:vortex-compact -6.6% -3.0% -3.8% +12.2% ➖ noise
66 duckdb:vortex-file-compressed -4.4% -3.0% -1.5% +16.3% ➖ noise
67 datafusion:vortex-compact -1.3% -1.8% +0.5% +10.0% ➖ noise
67 datafusion:vortex-file-compressed -1.2% -1.8% +0.6% +10.0% ➖ noise
67 duckdb:duckdb -5.4% -1.8% -3.6% +10.0% ➖ noise
67 duckdb:vortex-compact -4.0% -1.8% -2.3% +10.0% ➖ noise
67 duckdb:vortex-file-compressed -3.0% -1.8% -1.3% +10.0% ➖ noise
68 datafusion:vortex-compact -5.8% -1.4% -4.5% +10.0% ➖ noise
68 datafusion:vortex-file-compressed -5.4% -1.4% -4.1% +10.0% ➖ noise
68 duckdb:duckdb -4.3% -1.4% -2.9% +10.0% ➖ noise
68 duckdb:vortex-compact -4.6% -1.4% -3.2% +10.0% ➖ noise
68 duckdb:vortex-file-compressed -4.6% -1.4% -3.3% +10.0% ➖ noise
69 datafusion:vortex-compact -6.7% -4.0% -2.8% +10.0% ➖ noise
69 datafusion:vortex-file-compressed -1.0% -4.0% +3.1% +10.0% ➖ noise
69 duckdb:duckdb -7.2% -4.0% -3.3% +10.1% ➖ noise
69 duckdb:vortex-compact -4.6% -4.0% -0.6% +13.8% ➖ noise
69 duckdb:vortex-file-compressed -6.1% -4.0% -2.2% +10.0% ➖ noise
70 datafusion:vortex-compact -1.7% -4.0% +2.4% +10.0% ➖ noise
70 datafusion:vortex-file-compressed -2.3% -4.0% +1.7% +10.0% ➖ noise
70 duckdb:duckdb -1.3% -4.0% +2.8% +13.5% ➖ noise
70 duckdb:vortex-compact -0.7% -4.0% +3.5% +13.5% ➖ noise
70 duckdb:vortex-file-compressed -6.0% -4.0% -2.1% +10.0% ➖ noise
71 datafusion:vortex-compact +0.1% -3.9% +4.2% +16.9% ➖ noise
71 datafusion:vortex-file-compressed -0.7% -3.9% +3.3% +16.2% ➖ noise
71 duckdb:duckdb -5.9% -3.9% -2.2% +20.0% ➖ noise
71 duckdb:vortex-compact -1.2% -3.9% +2.8% +16.3% ➖ noise
71 duckdb:vortex-file-compressed -7.7% -3.9% -4.0% +19.1% ➖ noise
72 datafusion:vortex-compact -9.3% -3.8% -5.7% +10.0% ➖ noise
72 datafusion:vortex-file-compressed -9.1% -3.8% -5.5% +10.0% ➖ noise
72 duckdb:duckdb -3.4% -3.8% +0.5% +10.0% ➖ noise
72 duckdb:vortex-compact -2.3% -3.8% +1.5% +10.0% ➖ noise
72 duckdb:vortex-file-compressed -3.3% -3.8% +0.5% +10.0% ➖ noise
73 datafusion:vortex-compact +1.6% +0.8% +0.8% +12.1% ➖ noise
73 datafusion:vortex-file-compressed -4.2% +0.8% -5.0% +23.9% ➖ noise
73 duckdb:duckdb -2.3% +0.8% -3.2% +12.2% ➖ noise
73 duckdb:vortex-compact -0.4% +0.8% -1.3% +13.6% ➖ noise
73 duckdb:vortex-file-compressed -5.5% +0.8% -6.3% +25.2% ➖ noise
74 datafusion:vortex-compact -4.7% -1.8% -3.0% +10.0% ➖ noise
74 datafusion:vortex-file-compressed -5.2% -1.8% -3.5% +10.0% ➖ noise
74 duckdb:duckdb -1.1% -1.8% +0.7% +10.0% ➖ noise
74 duckdb:vortex-compact -6.9% -1.8% -5.2% +10.0% ➖ noise
74 duckdb:vortex-file-compressed -7.5% -1.8% -5.8% +10.0% ➖ noise
75 datafusion:vortex-compact -2.4% -2.9% +0.5% +10.0% ➖ noise
75 datafusion:vortex-file-compressed -4.6% -2.9% -1.8% +10.0% ➖ noise
75 duckdb:duckdb -1.7% -2.9% +1.2% +13.4% ➖ noise
75 duckdb:vortex-compact -0.6% -2.9% +2.3% +11.8% ➖ noise
75 duckdb:vortex-file-compressed -8.7% -2.9% -6.0% +10.0% ➖ noise
76 datafusion:vortex-compact -2.5% -3.3% +0.8% +12.5% ➖ noise
76 datafusion:vortex-file-compressed -3.9% -3.3% -0.6% +10.0% ➖ noise
76 duckdb:duckdb -5.9% -3.3% -2.6% +15.6% ➖ noise
76 duckdb:vortex-compact -12.7% -3.3% -9.7% +15.6% ➖ noise
76 duckdb:vortex-file-compressed -3.1% -3.3% +0.2% +17.8% ➖ noise
77 datafusion:vortex-compact -7.8% -3.5% -4.4% +10.0% ➖ noise
77 datafusion:vortex-file-compressed -8.3% -3.5% -5.0% +10.0% ➖ noise
77 duckdb:duckdb -3.4% -3.5% +0.1% +10.8% ➖ noise
77 duckdb:vortex-compact -5.4% -3.5% -1.9% +10.0% ➖ noise
77 duckdb:vortex-file-compressed -12.8% -3.5% -9.6% +12.7% ➖ noise
78 datafusion:vortex-compact -7.1% -3.6% -3.6% +10.0% ➖ noise
78 datafusion:vortex-file-compressed -4.0% -3.6% -0.5% +10.0% ➖ noise
78 duckdb:duckdb -4.4% -3.6% -0.8% +10.2% ➖ noise
78 duckdb:vortex-compact -6.6% -3.6% -3.1% +10.0% ➖ noise
78 duckdb:vortex-file-compressed -5.0% -3.6% -1.4% +11.6% ➖ noise
79 datafusion:vortex-compact -3.3% -1.3% -2.0% +10.0% ➖ noise
79 datafusion:vortex-file-compressed -5.0% -1.3% -3.8% +21.0% ➖ noise
79 duckdb:duckdb -4.5% -1.3% -3.2% +12.0% ➖ noise
79 duckdb:vortex-compact -4.7% -1.3% -3.5% +11.0% ➖ noise
79 duckdb:vortex-file-compressed -9.4% -1.3% -8.2% +11.3% ➖ noise
80 datafusion:vortex-compact -7.0% -7.2% +0.1% +10.0% ➖ noise
80 datafusion:vortex-file-compressed -9.0% -7.2% -2.0% +10.0% ➖ noise
80 duckdb:duckdb -8.4% -7.2% -1.4% +17.2% ➖ noise
80 duckdb:vortex-compact -10.6% -7.2% -3.7% +10.0% ➖ noise
80 duckdb:vortex-file-compressed -15.1% -7.2% -8.6% +10.0% ➖ noise
81 datafusion:vortex-compact -3.5% -4.2% +0.7% +15.0% ➖ noise
81 datafusion:vortex-file-compressed -3.1% -4.2% +1.1% +10.5% ➖ noise
81 duckdb:duckdb -3.3% -4.2% +1.0% +10.0% ➖ noise
81 duckdb:vortex-compact -12.4% -4.2% -8.6% +14.2% ➖ noise
81 duckdb:vortex-file-compressed -2.3% -4.2% +2.0% +10.0% ➖ noise
82 datafusion:vortex-compact -7.6% -3.2% -4.5% +10.0% ➖ noise
82 datafusion:vortex-file-compressed -9.6% -3.2% -6.6% +10.0% ➖ noise
82 duckdb:duckdb -10.1% -3.2% -7.1% +19.9% ➖ noise
82 duckdb:vortex-compact +0.3% -3.2% +3.7% +10.0% ➖ noise
82 duckdb:vortex-file-compressed -9.9% -3.2% -6.9% +10.8% ➖ noise
83 datafusion:vortex-compact -4.4% -7.1% +2.9% +10.0% ➖ noise
83 datafusion:vortex-file-compressed -5.6% -7.1% +1.6% +10.0% ➖ noise
83 duckdb:duckdb -2.9% -7.1% +4.5% +13.2% ➖ noise
83 duckdb:vortex-compact -5.7% -7.1% +1.5% +10.8% ➖ noise
83 duckdb:vortex-file-compressed -15.0% -7.1% -8.4% +11.6% ➖ noise
84 datafusion:vortex-compact -16.8% -5.6% -11.8% +11.0% ✅ faster
84 datafusion:vortex-file-compressed -3.5% -5.6% +2.2% +18.1% ➖ noise
84 duckdb:duckdb -1.7% -5.6% +4.2% +11.3% ➖ noise
84 duckdb:vortex-compact -5.9% -5.6% -0.3% +10.0% ➖ noise
84 duckdb:vortex-file-compressed -6.7% -5.6% -1.1% +10.0% ➖ noise
85 datafusion:vortex-compact -2.6% -3.7% +1.2% +10.0% ➖ noise
85 datafusion:vortex-file-compressed -2.0% -3.7% +1.8% +10.0% ➖ noise
85 duckdb:duckdb -6.3% -3.7% -2.6% +10.0% ➖ noise
85 duckdb:vortex-compact -0.4% -3.7% +3.5% +10.0% ➖ noise
85 duckdb:vortex-file-compressed -4.2% -3.7% -0.5% +10.0% ➖ noise
86 datafusion:vortex-compact -3.2% -2.6% -0.6% +11.8% ➖ noise
86 datafusion:vortex-file-compressed -4.5% -2.6% -1.9% +19.2% ➖ noise
86 duckdb:duckdb -1.5% -2.6% +1.1% +11.0% ➖ noise
86 duckdb:vortex-compact -5.2% -2.6% -2.7% +19.0% ➖ noise
86 duckdb:vortex-file-compressed -3.0% -2.6% -0.5% +11.3% ➖ noise
87 datafusion:vortex-compact -5.2% -5.6% +0.4% +10.0% ➖ noise
87 datafusion:vortex-file-compressed -3.1% -5.6% +2.7% +10.0% ➖ noise
87 duckdb:duckdb -2.4% -5.6% +3.3% +10.2% ➖ noise
87 duckdb:vortex-compact +5.6% -5.6% +11.9% +10.5% 🚨 regression
87 duckdb:vortex-file-compressed -7.4% -5.6% -2.0% +12.6% ➖ noise
88 datafusion:vortex-compact -3.1% -3.8% +0.7% +10.0% ➖ noise
88 datafusion:vortex-file-compressed -3.4% -3.8% +0.4% +10.0% ➖ noise
88 duckdb:duckdb -2.4% -3.8% +1.4% +10.0% ➖ noise
88 duckdb:vortex-compact -4.0% -3.8% -0.2% +10.0% ➖ noise
88 duckdb:vortex-file-compressed -6.3% -3.8% -2.6% +10.0% ➖ noise
89 datafusion:vortex-compact -1.7% -2.9% +1.3% +10.0% ➖ noise
89 datafusion:vortex-file-compressed -2.7% -2.9% +0.3% +10.0% ➖ noise
89 duckdb:duckdb -7.1% -2.9% -4.3% +13.6% ➖ noise
89 duckdb:vortex-compact +2.3% -2.9% +5.4% +11.7% ➖ noise
89 duckdb:vortex-file-compressed -5.1% -2.9% -2.2% +11.9% ➖ noise
90 datafusion:vortex-compact -7.3% +1.7% -8.8% +11.1% ➖ noise
90 datafusion:vortex-file-compressed -13.0% +1.7% -14.5% +11.5% ✅ faster
90 duckdb:duckdb -1.2% +1.7% -2.8% +12.3% ➖ noise
90 duckdb:vortex-compact +1.1% +1.7% -0.6% +11.8% ➖ noise
90 duckdb:vortex-file-compressed -3.0% +1.7% -4.6% +12.7% ➖ noise
91 datafusion:vortex-compact -3.3% +0.8% -4.1% +10.0% ➖ noise
91 datafusion:vortex-file-compressed -6.8% +0.8% -7.5% +10.0% ➖ noise
91 duckdb:duckdb +1.0% +0.8% +0.2% +16.7% ➖ noise
91 duckdb:vortex-compact -9.2% +0.8% -9.9% +10.0% ✅ faster
91 duckdb:vortex-file-compressed -5.6% +0.8% -6.4% +11.1% ➖ noise
92 datafusion:vortex-compact -7.7% -6.9% -0.9% +10.0% ➖ noise
92 datafusion:vortex-file-compressed -7.0% -6.9% -0.1% +10.1% ➖ noise
92 duckdb:duckdb +0.8% -6.9% +8.2% +14.8% ➖ noise
92 duckdb:vortex-compact -3.1% -6.9% +4.0% +14.4% ➖ noise
92 duckdb:vortex-file-compressed -11.2% -6.9% -4.6% +11.7% ➖ noise
93 datafusion:vortex-compact -4.3% -5.6% +1.3% +11.5% ➖ noise
93 datafusion:vortex-file-compressed -10.7% -5.6% -5.4% +10.4% ➖ noise
93 duckdb:duckdb -4.8% -5.6% +0.8% +11.9% ➖ noise
93 duckdb:vortex-compact -8.1% -5.6% -2.6% +11.4% ➖ noise
93 duckdb:vortex-file-compressed -4.8% -5.6% +0.9% +16.4% ➖ noise
94 datafusion:vortex-compact -2.3% -5.6% +3.4% +10.0% ➖ noise
94 datafusion:vortex-file-compressed -0.1% -5.6% +5.9% +11.4% ➖ noise
94 duckdb:duckdb -6.0% -5.6% -0.4% +10.4% ➖ noise
94 duckdb:vortex-compact -8.5% -5.6% -3.0% +10.7% ➖ noise
94 duckdb:vortex-file-compressed -8.4% -5.6% -2.9% +12.8% ➖ noise
95 datafusion:vortex-compact -4.8% +2.6% -7.2% +10.8% ➖ noise
95 datafusion:vortex-file-compressed -8.1% +2.6% -10.5% +10.0% ✅ faster
95 duckdb:duckdb -5.1% +2.6% -7.6% +16.7% ➖ noise
95 duckdb:vortex-compact -14.4% +2.6% -16.6% +16.3% ✅ faster
95 duckdb:vortex-file-compressed -3.3% +2.6% -5.8% +18.5% ➖ noise
96 datafusion:vortex-compact -5.9% -10.7% +5.3% +10.6% ➖ noise
96 datafusion:vortex-file-compressed -4.1% -10.7% +7.3% +10.7% ➖ noise
96 duckdb:duckdb -5.0% -10.7% +6.3% +12.2% ➖ noise
96 duckdb:vortex-compact -8.9% -10.7% +2.0% +23.7% ➖ noise
96 duckdb:vortex-file-compressed -7.2% -10.7% +3.9% +15.5% ➖ noise
97 datafusion:vortex-compact -5.5% -4.0% -1.6% +10.9% ➖ noise
97 datafusion:vortex-file-compressed -9.6% -4.0% -5.9% +10.0% ➖ noise
97 duckdb:duckdb -0.7% -4.0% +3.4% +10.8% ➖ noise
97 duckdb:vortex-compact -7.3% -4.0% -3.5% +14.6% ➖ noise
97 duckdb:vortex-file-compressed -0.3% -4.0% +3.8% +11.0% ➖ noise
98 datafusion:vortex-compact -3.5% -7.7% +4.5% +11.9% ➖ noise
98 datafusion:vortex-file-compressed -8.9% -7.7% -1.3% +10.0% ➖ noise
98 duckdb:duckdb -5.8% -7.7% +2.0% +14.2% ➖ noise
98 duckdb:vortex-compact -5.1% -7.7% +2.8% +13.2% ➖ noise
98 duckdb:vortex-file-compressed -8.3% -7.7% -0.6% +11.9% ➖ noise
99 datafusion:vortex-compact -6.9% +2.8% -9.4% +15.4% ➖ noise
99 datafusion:vortex-file-compressed -11.7% +2.8% -14.1% +14.8% ✅ faster
99 duckdb:duckdb -2.9% +2.8% -5.5% +23.8% ➖ noise
99 duckdb:vortex-compact -2.3% +2.8% -4.9% +14.6% ➖ noise
99 duckdb:vortex-file-compressed -1.6% +2.8% -4.3% +14.6% ➖ noise

@github-actions
Copy link
Contributor

Benchmarks: TPC-H SF=10 on NVME

Verdict: No clear signal (low confidence)
Attributed Vortex impact: -0.3%
Vortex (geomean): 1.017x ➖
Parquet (geomean): 1.021x ➖
Shifts: Parquet (control) +2.1% · Median polish +2.0%


datafusion / vortex-file-compressed (1.015x ➖, 0↑ 0↓)
name PR d2668cf (ns) base 8efe1dc (ns) ratio (PR/base)
tpch_q01/datafusion:vortex-file-compressed 429925593 444955826 0.97
tpch_q02/datafusion:vortex-file-compressed 160812414 157140686 1.02
tpch_q03/datafusion:vortex-file-compressed 250598986 249918957 1.00
tpch_q04/datafusion:vortex-file-compressed 110140761 107169503 1.03
tpch_q05/datafusion:vortex-file-compressed 464620670 459054485 1.01
tpch_q06/datafusion:vortex-file-compressed 42802918 40790092 1.05
tpch_q07/datafusion:vortex-file-compressed 652801433 648189948 1.01
tpch_q08/datafusion:vortex-file-compressed 474399386 465055786 1.02
tpch_q09/datafusion:vortex-file-compressed 823142564 808937920 1.02
tpch_q10/datafusion:vortex-file-compressed 300206772 286350095 1.05
tpch_q11/datafusion:vortex-file-compressed 118905550 117257839 1.01
tpch_q12/datafusion:vortex-file-compressed 129247470 127526823 1.01
tpch_q13/datafusion:vortex-file-compressed 228167768 225530508 1.01
tpch_q14/datafusion:vortex-file-compressed 75165982 71754519 1.05
tpch_q15/datafusion:vortex-file-compressed 109208972 108829447 1.00
tpch_q16/datafusion:vortex-file-compressed 93446574 93698468 1.00
tpch_q17/datafusion:vortex-file-compressed 751376259 743778518 1.01
tpch_q18/datafusion:vortex-file-compressed 986783236 967049833 1.02
tpch_q19/datafusion:vortex-file-compressed 133021120 131859377 1.01
tpch_q20/datafusion:vortex-file-compressed 203280529 200406244 1.01
tpch_q21/datafusion:vortex-file-compressed 793305205 762899176 1.04
tpch_q22/datafusion:vortex-file-compressed 61551674 62614020 0.98
datafusion / vortex-compact (1.017x ➖, 0↑ 0↓)
name PR d2668cf (ns) base 8efe1dc (ns) ratio (PR/base)
tpch_q01/datafusion:vortex-compact 477885789 478888741 1.00
tpch_q02/datafusion:vortex-compact 166878041 165421824 1.01
tpch_q03/datafusion:vortex-compact 272681451 267224994 1.02
tpch_q04/datafusion:vortex-compact 126169463 125498115 1.01
tpch_q05/datafusion:vortex-compact 479718801 470076870 1.02
tpch_q06/datafusion:vortex-compact 65340146 63018495 1.04
tpch_q07/datafusion:vortex-compact 686243734 672703560 1.02
tpch_q08/datafusion:vortex-compact 490848517 475738508 1.03
tpch_q09/datafusion:vortex-compact 829473637 825696781 1.00
tpch_q10/datafusion:vortex-compact 335662906 327041334 1.03
tpch_q11/datafusion:vortex-compact 125754290 125025202 1.01
tpch_q12/datafusion:vortex-compact 186284527 186723980 1.00
tpch_q13/datafusion:vortex-compact 283408312 275243958 1.03
tpch_q14/datafusion:vortex-compact 92683017 89129559 1.04
tpch_q15/datafusion:vortex-compact 168004005 165758690 1.01
tpch_q16/datafusion:vortex-compact 98630449 99406439 0.99
tpch_q17/datafusion:vortex-compact 767450867 740021574 1.04
tpch_q18/datafusion:vortex-compact 1003424127 981289763 1.02
tpch_q19/datafusion:vortex-compact 235680962 231955393 1.02
tpch_q20/datafusion:vortex-compact 233032123 230521599 1.01
tpch_q21/datafusion:vortex-compact 823085501 806071260 1.02
tpch_q22/datafusion:vortex-compact 73018433 71358168 1.02
datafusion / parquet (1.023x ➖, 0↑ 0↓)
name PR d2668cf (ns) base 8efe1dc (ns) ratio (PR/base)
tpch_q01/datafusion:parquet 494699521 449751652 1.10
tpch_q02/datafusion:parquet 267289351 257348941 1.04
tpch_q03/datafusion:parquet 394159269 395767150 1.00
tpch_q04/datafusion:parquet 153996123 151512498 1.02
tpch_q05/datafusion:parquet 583412169 580386833 1.01
tpch_q06/datafusion:parquet 125184175 124801877 1.00
tpch_q07/datafusion:parquet 808369900 788135124 1.03
tpch_q08/datafusion:parquet 651021005 645806623 1.01
tpch_q09/datafusion:parquet 979849901 956248814 1.02
tpch_q10/datafusion:parquet 614997114 598107006 1.03
tpch_q11/datafusion:parquet 196953716 190112720 1.04
tpch_q12/datafusion:parquet 255019483 248866013 1.02
tpch_q13/datafusion:parquet 336165523 340683419 0.99
tpch_q14/datafusion:parquet 202812100 202080731 1.00
tpch_q15/datafusion:parquet 268533075 257406224 1.04
tpch_q16/datafusion:parquet 184837817 184542885 1.00
tpch_q17/datafusion:parquet 875108707 840881622 1.04
tpch_q18/datafusion:parquet 1047977695 1018465199 1.03
tpch_q19/datafusion:parquet 345594636 329066665 1.05
tpch_q20/datafusion:parquet 379926368 373648319 1.02
tpch_q21/datafusion:parquet 903487519 888790838 1.02
tpch_q22/datafusion:parquet 224916932 222110849 1.01
datafusion / arrow (1.037x ➖, 0↑ 1↓)
name PR d2668cf (ns) base 8efe1dc (ns) ratio (PR/base)
tpch_q01/datafusion:arrow 743436077 736000521 1.01
tpch_q02/datafusion:arrow 202098883 195320921 1.03
tpch_q03/datafusion:arrow 568677792 546312286 1.04
tpch_q04/datafusion:arrow 417626722 387691274 1.08
tpch_q05/datafusion:arrow 1083341895 1046455342 1.04
tpch_q06/datafusion:arrow 328678591 316330977 1.04
tpch_q07/datafusion:arrow 1382316285 1355492904 1.02
tpch_q08/datafusion:arrow 1349996676 1304084291 1.04
tpch_q09/datafusion:arrow 1609701740 1546321644 1.04
tpch_q10/datafusion:arrow 702105653 666957191 1.05
tpch_q11/datafusion:arrow 182189166 174862521 1.04
tpch_q12/datafusion:arrow 🚨 862964525 760408019 1.13
tpch_q13/datafusion:arrow 532096622 532112399 1.00
tpch_q14/datafusion:arrow 375135246 356035268 1.05
tpch_q15/datafusion:arrow 810947063 773211650 1.05
tpch_q16/datafusion:arrow 122715500 126789782 0.97
tpch_q17/datafusion:arrow 1608604396 1569230925 1.03
tpch_q18/datafusion:arrow 2138507020 2095024146 1.02
tpch_q19/datafusion:arrow 593621348 579138241 1.03
tpch_q20/datafusion:arrow 588359235 558950656 1.05
tpch_q21/datafusion:arrow 4060565338 3912612034 1.04
tpch_q22/datafusion:arrow 185741246 178679301 1.04
duckdb / vortex-file-compressed (1.019x ➖, 0↑ 0↓)
name PR d2668cf (ns) base 8efe1dc (ns) ratio (PR/base)
tpch_q01/duckdb:vortex-file-compressed 179027757 178367109 1.00
tpch_q02/duckdb:vortex-file-compressed 52854283 55057660 0.96
tpch_q03/duckdb:vortex-file-compressed 132492843 130359220 1.02
tpch_q04/duckdb:vortex-file-compressed 157036224 149873367 1.05
tpch_q05/duckdb:vortex-file-compressed 133495441 132103245 1.01
tpch_q06/duckdb:vortex-file-compressed 49076901 48051777 1.02
tpch_q07/duckdb:vortex-file-compressed 150169348 146939221 1.02
tpch_q08/duckdb:vortex-file-compressed 177451121 176194716 1.01
tpch_q09/duckdb:vortex-file-compressed 344075455 338691326 1.02
tpch_q10/duckdb:vortex-file-compressed 162562440 154005627 1.06
tpch_q11/duckdb:vortex-file-compressed 36884339 37231324 0.99
tpch_q12/duckdb:vortex-file-compressed 95639603 96044283 1.00
tpch_q13/duckdb:vortex-file-compressed 257453035 244717779 1.05
tpch_q14/duckdb:vortex-file-compressed 72089152 69230295 1.04
tpch_q15/duckdb:vortex-file-compressed 96579569 96803310 1.00
tpch_q16/duckdb:vortex-file-compressed 79557974 77890140 1.02
tpch_q17/duckdb:vortex-file-compressed 103980122 103332802 1.01
tpch_q18/duckdb:vortex-file-compressed 286354158 277076884 1.03
tpch_q19/duckdb:vortex-file-compressed 92918370 92422825 1.01
tpch_q20/duckdb:vortex-file-compressed 168984816 163416975 1.03
tpch_q21/duckdb:vortex-file-compressed 568914692 553842187 1.03
tpch_q22/duckdb:vortex-file-compressed 80324456 76293644 1.05
duckdb / vortex-compact (1.016x ➖, 0↑ 0↓)
name PR d2668cf (ns) base 8efe1dc (ns) ratio (PR/base)
tpch_q01/duckdb:vortex-compact 232373166 228353559 1.02
tpch_q02/duckdb:vortex-compact 57976448 59605967 0.97
tpch_q03/duckdb:vortex-compact 147496549 141891030 1.04
tpch_q04/duckdb:vortex-compact 178487027 178168003 1.00
tpch_q05/duckdb:vortex-compact 153390225 149065707 1.03
tpch_q06/duckdb:vortex-compact 87441682 85004420 1.03
tpch_q07/duckdb:vortex-compact 208442137 206810130 1.01
tpch_q08/duckdb:vortex-compact 196630432 194399850 1.01
tpch_q09/duckdb:vortex-compact 370966572 363376152 1.02
tpch_q10/duckdb:vortex-compact 191605384 188572315 1.02
tpch_q11/duckdb:vortex-compact 42441782 42379120 1.00
tpch_q12/duckdb:vortex-compact 208464826 207488171 1.00
tpch_q13/duckdb:vortex-compact 303554413 294312273 1.03
tpch_q14/duckdb:vortex-compact 103752719 104219465 1.00
tpch_q15/duckdb:vortex-compact 120145294 120347860 1.00
tpch_q16/duckdb:vortex-compact 88102078 85941968 1.03
tpch_q17/duckdb:vortex-compact 121607682 116200128 1.05
tpch_q18/duckdb:vortex-compact 300841209 290714213 1.03
tpch_q19/duckdb:vortex-compact 117540920 115773693 1.02
tpch_q20/duckdb:vortex-compact 212631859 208677853 1.02
tpch_q21/duckdb:vortex-compact 652160530 636332808 1.02
tpch_q22/duckdb:vortex-compact 91580511 90214196 1.02
duckdb / parquet (1.018x ➖, 0↑ 1↓)
name PR d2668cf (ns) base 8efe1dc (ns) ratio (PR/base)
tpch_q01/duckdb:parquet 258522306 258013092 1.00
tpch_q02/duckdb:parquet 106584141 103202903 1.03
tpch_q03/duckdb:parquet 213034209 209380266 1.02
tpch_q04/duckdb:parquet 139073126 135277250 1.03
tpch_q05/duckdb:parquet 223924149 217364613 1.03
tpch_q06/duckdb:parquet 65837032 69484022 0.95
tpch_q07/duckdb:parquet 183258817 180510606 1.02
tpch_q08/duckdb:parquet 254703884 255117463 1.00
tpch_q09/duckdb:parquet 468473891 465435666 1.01
tpch_q10/duckdb:parquet 611534119 606196294 1.01
tpch_q11/duckdb:parquet 🚨 45510533 39195832 1.16
tpch_q12/duckdb:parquet 129000807 127253260 1.01
tpch_q13/duckdb:parquet 402369009 398069268 1.01
tpch_q14/duckdb:parquet 174009213 171818534 1.01
tpch_q15/duckdb:parquet 97213496 97077157 1.00
tpch_q16/duckdb:parquet 166203323 163067867 1.02
tpch_q17/duckdb:parquet 184081465 176731998 1.04
tpch_q18/duckdb:parquet 355810205 347622141 1.02
tpch_q19/duckdb:parquet 284722522 277803323 1.02
tpch_q20/duckdb:parquet 230141775 230014242 1.00
tpch_q21/duckdb:parquet 574176144 569852327 1.01
tpch_q22/duckdb:parquet 294239491 290912870 1.01
duckdb / duckdb (1.003x ➖, 0↑ 0↓)
name PR d2668cf (ns) base 8efe1dc (ns) ratio (PR/base)
tpch_q01/duckdb:duckdb 117333881 116833331 1.00
tpch_q02/duckdb:duckdb 46719285 45847919 1.02
tpch_q03/duckdb:duckdb 97973008 96575711 1.01
tpch_q04/duckdb:duckdb 134009425 133192711 1.01
tpch_q05/duckdb:duckdb 111490145 108119082 1.03
tpch_q06/duckdb:duckdb 38749726 39172091 0.99
tpch_q07/duckdb:duckdb 86545236 86813180 1.00
tpch_q08/duckdb:duckdb 111631479 111347006 1.00
tpch_q09/duckdb:duckdb 278941097 278728671 1.00
tpch_q10/duckdb:duckdb 204225205 204914949 1.00
tpch_q11/duckdb:duckdb 15457130 14967880 1.03
tpch_q12/duckdb:duckdb 84320785 83615385 1.01
tpch_q13/duckdb:duckdb 261524288 252080774 1.04
tpch_q14/duckdb:duckdb 70695936 71128838 0.99
tpch_q15/duckdb:duckdb 77861683 78805868 0.99
tpch_q16/duckdb:duckdb 74210827 73799070 1.01
tpch_q17/duckdb:duckdb 85003734 85177261 1.00
tpch_q18/duckdb:duckdb 216470980 213020759 1.02
tpch_q19/duckdb:duckdb 114997441 115918913 0.99
tpch_q20/duckdb:duckdb 111189762 111855411 0.99
tpch_q21/duckdb:duckdb 300596738 308843267 0.97
tpch_q22/duckdb:duckdb 66557198 69466353 0.96
Full attributed analysis
Query Config Raw Δ Control Δ Attributed α Noise floor Significant?
1 datafusion:arrow +1.0% +5.0% -3.8% +12.6% ➖ noise
1 datafusion:vortex-compact -0.2% +5.0% -4.9% +15.2% ➖ noise
1 datafusion:vortex-file-compressed -3.4% +5.0% -8.0% +14.6% ➖ noise
1 duckdb:duckdb +0.4% +5.0% -4.3% +13.0% ➖ noise
1 duckdb:vortex-compact +1.8% +5.0% -3.1% +12.4% ➖ noise
1 duckdb:vortex-file-compressed +0.4% +5.0% -4.4% +13.1% ➖ noise
2 datafusion:arrow +3.5% +3.6% -0.1% +10.0% ➖ noise
2 datafusion:vortex-compact +0.9% +3.6% -2.6% +10.0% ➖ noise
2 datafusion:vortex-file-compressed +2.3% +3.6% -1.2% +10.0% ➖ noise
2 duckdb:duckdb +1.9% +3.6% -1.6% +10.0% ➖ noise
2 duckdb:vortex-compact -2.7% +3.6% -6.1% +10.0% ➖ noise
2 duckdb:vortex-file-compressed -4.0% +3.6% -7.3% +10.5% ➖ noise
3 datafusion:arrow +4.1% +0.7% +3.4% +10.0% ➖ noise
3 datafusion:vortex-compact +2.0% +0.7% +1.4% +10.0% ➖ noise
3 datafusion:vortex-file-compressed +0.3% +0.7% -0.4% +10.0% ➖ noise
3 duckdb:duckdb +1.4% +0.7% +0.8% +10.0% ➖ noise
3 duckdb:vortex-compact +4.0% +0.7% +3.3% +10.0% ➖ noise
3 duckdb:vortex-file-compressed +1.6% +0.7% +1.0% +10.0% ➖ noise
4 datafusion:arrow +7.7% +2.2% +5.4% +10.0% ➖ noise
4 datafusion:vortex-compact +0.5% +2.2% -1.6% +10.0% ➖ noise
4 datafusion:vortex-file-compressed +2.8% +2.2% +0.5% +10.0% ➖ noise
4 duckdb:duckdb +0.6% +2.2% -1.6% +10.0% ➖ noise
4 duckdb:vortex-compact +0.2% +2.2% -2.0% +10.0% ➖ noise
4 duckdb:vortex-file-compressed +4.8% +2.2% +2.5% +10.0% ➖ noise
5 datafusion:arrow +3.5% +1.8% +1.7% +10.0% ➖ noise
5 datafusion:vortex-compact +2.1% +1.8% +0.3% +10.0% ➖ noise
5 datafusion:vortex-file-compressed +1.2% +1.8% -0.5% +10.0% ➖ noise
5 duckdb:duckdb +3.1% +1.8% +1.3% +10.0% ➖ noise
5 duckdb:vortex-compact +2.9% +1.8% +1.1% +10.0% ➖ noise
5 duckdb:vortex-file-compressed +1.1% +1.8% -0.7% +10.0% ➖ noise
6 datafusion:arrow +3.9% -2.5% +6.6% +10.0% ➖ noise
6 datafusion:vortex-compact +3.7% -2.5% +6.4% +10.0% ➖ noise
6 datafusion:vortex-file-compressed +4.9% -2.5% +7.6% +10.3% ➖ noise
6 duckdb:duckdb -1.1% -2.5% +1.5% +14.2% ➖ noise
6 duckdb:vortex-compact +2.9% -2.5% +5.5% +10.0% ➖ noise
6 duckdb:vortex-file-compressed +2.1% -2.5% +4.8% +10.0% ➖ noise
7 datafusion:arrow +2.0% +2.0% -0.1% +10.0% ➖ noise
7 datafusion:vortex-compact +2.0% +2.0% -0.0% +10.0% ➖ noise
7 datafusion:vortex-file-compressed +0.7% +2.0% -1.3% +10.0% ➖ noise
7 duckdb:duckdb -0.3% +2.0% -2.3% +11.4% ➖ noise
7 duckdb:vortex-compact +0.8% +2.0% -1.2% +10.0% ➖ noise
7 duckdb:vortex-file-compressed +2.2% +2.0% +0.2% +10.0% ➖ noise
8 datafusion:arrow +3.5% +0.3% +3.2% +10.0% ➖ noise
8 datafusion:vortex-compact +3.2% +0.3% +2.8% +10.0% ➖ noise
8 datafusion:vortex-file-compressed +2.0% +0.3% +1.7% +10.0% ➖ noise
8 duckdb:duckdb +0.3% +0.3% -0.1% +10.0% ➖ noise
8 duckdb:vortex-compact +1.1% +0.3% +0.8% +10.0% ➖ noise
8 duckdb:vortex-file-compressed +0.7% +0.3% +0.4% +10.0% ➖ noise
9 datafusion:arrow +4.1% +1.6% +2.5% +10.0% ➖ noise
9 datafusion:vortex-compact +0.5% +1.6% -1.1% +10.0% ➖ noise
9 datafusion:vortex-file-compressed +1.8% +1.6% +0.2% +10.0% ➖ noise
9 duckdb:duckdb +0.1% +1.6% -1.5% +10.0% ➖ noise
9 duckdb:vortex-compact +2.1% +1.6% +0.5% +10.0% ➖ noise
9 duckdb:vortex-file-compressed +1.6% +1.6% +0.0% +10.0% ➖ noise
10 datafusion:arrow +5.3% +1.8% +3.4% +10.0% ➖ noise
10 datafusion:vortex-compact +2.6% +1.8% +0.8% +10.0% ➖ noise
10 datafusion:vortex-file-compressed +4.8% +1.8% +2.9% +10.0% ➖ noise
10 duckdb:duckdb -0.3% +1.8% -2.1% +10.0% ➖ noise
10 duckdb:vortex-compact +1.6% +1.8% -0.2% +10.0% ➖ noise
10 duckdb:vortex-file-compressed +5.6% +1.8% +3.6% +10.0% ➖ noise
11 datafusion:arrow +4.2% +9.7% -5.0% +10.0% ➖ noise
11 datafusion:vortex-compact +0.6% +9.7% -8.3% +10.0% ➖ noise
11 datafusion:vortex-file-compressed +1.4% +9.7% -7.5% +10.0% ➖ noise
11 duckdb:duckdb +3.3% +9.7% -5.8% +19.9% ➖ noise
11 duckdb:vortex-compact +0.1% +9.7% -8.7% +12.0% ➖ noise
11 duckdb:vortex-file-compressed -0.9% +9.7% -9.7% +11.3% ➖ noise
12 datafusion:arrow +13.5% +1.9% +11.3% +43.5% ➖ noise
12 datafusion:vortex-compact -0.2% +1.9% -2.1% +10.0% ➖ noise
12 datafusion:vortex-file-compressed +1.3% +1.9% -0.6% +10.0% ➖ noise
12 duckdb:duckdb +0.8% +1.9% -1.1% +10.0% ➖ noise
12 duckdb:vortex-compact +0.5% +1.9% -1.4% +10.0% ➖ noise
12 duckdb:vortex-file-compressed -0.4% +1.9% -2.3% +10.0% ➖ noise
13 datafusion:arrow -0.0% -0.1% +0.1% +12.6% ➖ noise
13 datafusion:vortex-compact +3.0% -0.1% +3.1% +10.0% ➖ noise
13 datafusion:vortex-file-compressed +1.2% -0.1% +1.3% +10.0% ➖ noise
13 duckdb:duckdb +3.7% -0.1% +3.9% +10.0% ➖ noise
13 duckdb:vortex-compact +3.1% -0.1% +3.3% +10.0% ➖ noise
13 duckdb:vortex-file-compressed +5.2% -0.1% +5.3% +10.0% ➖ noise
14 datafusion:arrow +5.4% +0.8% +4.5% +10.0% ➖ noise
14 datafusion:vortex-compact +4.0% +0.8% +3.1% +10.0% ➖ noise
14 datafusion:vortex-file-compressed +4.8% +0.8% +3.9% +10.0% ➖ noise
14 duckdb:duckdb -0.6% +0.8% -1.4% +10.0% ➖ noise
14 duckdb:vortex-compact -0.4% +0.8% -1.3% +10.0% ➖ noise
14 duckdb:vortex-file-compressed +4.1% +0.8% +3.3% +10.0% ➖ noise
15 datafusion:arrow +4.9% +2.2% +2.6% +10.0% ➖ noise
15 datafusion:vortex-compact +1.4% +2.2% -0.8% +10.0% ➖ noise
15 datafusion:vortex-file-compressed +0.3% +2.2% -1.8% +10.0% ➖ noise
15 duckdb:duckdb -1.2% +2.2% -3.3% +10.0% ➖ noise
15 duckdb:vortex-compact -0.2% +2.2% -2.3% +10.0% ➖ noise
15 duckdb:vortex-file-compressed -0.2% +2.2% -2.4% +10.0% ➖ noise
16 datafusion:arrow -3.2% +1.0% -4.2% +10.9% ➖ noise
16 datafusion:vortex-compact -0.8% +1.0% -1.8% +10.3% ➖ noise
16 datafusion:vortex-file-compressed -0.3% +1.0% -1.3% +10.0% ➖ noise
16 duckdb:duckdb +0.6% +1.0% -0.5% +10.1% ➖ noise
16 duckdb:vortex-compact +2.5% +1.0% +1.5% +10.4% ➖ noise
16 duckdb:vortex-file-compressed +2.1% +1.0% +1.1% +10.0% ➖ noise
17 datafusion:arrow +2.5% +4.1% -1.5% +10.0% ➖ noise
17 datafusion:vortex-compact +3.7% +4.1% -0.4% +10.0% ➖ noise
17 datafusion:vortex-file-compressed +1.0% +4.1% -3.0% +10.0% ➖ noise
17 duckdb:duckdb -0.2% +4.1% -4.1% +10.0% ➖ noise
17 duckdb:vortex-compact +4.7% +4.1% +0.5% +10.0% ➖ noise
17 duckdb:vortex-file-compressed +0.6% +4.1% -3.4% +10.0% ➖ noise
18 datafusion:arrow +2.1% +2.6% -0.5% +10.0% ➖ noise
18 datafusion:vortex-compact +2.3% +2.6% -0.4% +10.0% ➖ noise
18 datafusion:vortex-file-compressed +2.0% +2.6% -0.6% +10.0% ➖ noise
18 duckdb:duckdb +1.6% +2.6% -1.0% +10.0% ➖ noise
18 duckdb:vortex-compact +3.5% +2.6% +0.8% +10.0% ➖ noise
18 duckdb:vortex-file-compressed +3.3% +2.6% +0.7% +10.0% ➖ noise
19 datafusion:arrow +2.5% +3.7% -1.2% +10.0% ➖ noise
19 datafusion:vortex-compact +1.6% +3.7% -2.1% +10.0% ➖ noise
19 datafusion:vortex-file-compressed +0.9% +3.7% -2.8% +10.0% ➖ noise
19 duckdb:duckdb -0.8% +3.7% -4.4% +10.0% ➖ noise
19 duckdb:vortex-compact +1.5% +3.7% -2.1% +10.0% ➖ noise
19 duckdb:vortex-file-compressed +0.5% +3.7% -3.1% +10.0% ➖ noise
20 datafusion:arrow +5.3% +0.9% +4.4% +10.0% ➖ noise
20 datafusion:vortex-compact +1.1% +0.9% +0.2% +10.0% ➖ noise
20 datafusion:vortex-file-compressed +1.4% +0.9% +0.6% +10.0% ➖ noise
20 duckdb:duckdb -0.6% +0.9% -1.4% +10.0% ➖ noise
20 duckdb:vortex-compact +1.9% +0.9% +1.0% +10.0% ➖ noise
20 duckdb:vortex-file-compressed +3.4% +0.9% +2.5% +10.0% ➖ noise
21 datafusion:arrow +3.8% +1.2% +2.5% +10.0% ➖ noise
21 datafusion:vortex-compact +2.1% +1.2% +0.9% +10.0% ➖ noise
21 datafusion:vortex-file-compressed +4.0% +1.2% +2.7% +10.0% ➖ noise
21 duckdb:duckdb -2.7% +1.2% -3.8% +10.0% ➖ noise
21 duckdb:vortex-compact +2.5% +1.2% +1.3% +10.0% ➖ noise
21 duckdb:vortex-file-compressed +2.7% +1.2% +1.5% +10.0% ➖ noise
22 datafusion:arrow +4.0% +1.2% +2.7% +10.0% ➖ noise
22 datafusion:vortex-compact +2.3% +1.2% +1.1% +10.0% ➖ noise
22 datafusion:vortex-file-compressed -1.7% +1.2% -2.9% +10.0% ➖ noise
22 duckdb:duckdb -4.2% +1.2% -5.3% +10.8% ➖ noise
22 duckdb:vortex-compact +1.5% +1.2% +0.3% +10.0% ➖ noise
22 duckdb:vortex-file-compressed +5.3% +1.2% +4.0% +10.0% ➖ noise

@github-actions
Copy link
Contributor

Benchmarks: TPC-H SF=1 on S3

Verdict: No clear signal (environment too noisy confidence)
Attributed Vortex impact: +13.8%
Vortex (geomean): 1.077x ➖
Parquet (geomean): 0.947x ➖
Shifts: Parquet (control) -5.3% · Median polish +3.5%


datafusion / vortex-file-compressed (1.165x ➖, 1↑ 6↓)
name PR d2668cf (ns) base 8efe1dc (ns) ratio (PR/base)
tpch_q01/datafusion:vortex-file-compressed 213686948 183699536 1.16
tpch_q02/datafusion:vortex-file-compressed 678024089 555080062 1.22
tpch_q03/datafusion:vortex-file-compressed 484011090 420821914 1.15
tpch_q04/datafusion:vortex-file-compressed 337510277 289424987 1.17
tpch_q05/datafusion:vortex-file-compressed 🚨 712704176 468365859 1.52
tpch_q06/datafusion:vortex-file-compressed 🚨 606636678 290199045 2.09
tpch_q07/datafusion:vortex-file-compressed 603615822 473326111 1.28
tpch_q08/datafusion:vortex-file-compressed 851225443 661434298 1.29
tpch_q09/datafusion:vortex-file-compressed 579487947 563150724 1.03
tpch_q10/datafusion:vortex-file-compressed 🚨 803879644 555787729 1.45
tpch_q11/datafusion:vortex-file-compressed 🚨 544171117 276013121 1.97
tpch_q12/datafusion:vortex-file-compressed 583281412 523419495 1.11
tpch_q13/datafusion:vortex-file-compressed 232295350 268737657 0.86
tpch_q14/datafusion:vortex-file-compressed 🚨 293830894 183327996 1.60
tpch_q15/datafusion:vortex-file-compressed 🚨 476151807 362607049 1.31
tpch_q16/datafusion:vortex-file-compressed 225409310 216294521 1.04
tpch_q17/datafusion:vortex-file-compressed 360724387 346407821 1.04
tpch_q18/datafusion:vortex-file-compressed 385190704 367807919 1.05
tpch_q19/datafusion:vortex-file-compressed 428128827 486066321 0.88
tpch_q20/datafusion:vortex-file-compressed 🚀 370315407 540312352 0.69
tpch_q21/datafusion:vortex-file-compressed 546063706 602936449 0.91
tpch_q22/datafusion:vortex-file-compressed 171897595 220547679 0.78
datafusion / vortex-compact (1.074x ➖, 0↑ 5↓)
name PR d2668cf (ns) base 8efe1dc (ns) ratio (PR/base)
tpch_q01/datafusion:vortex-compact 286953112 273354219 1.05
tpch_q02/datafusion:vortex-compact 479727995 548315374 0.87
tpch_q03/datafusion:vortex-compact 342100159 306611572 1.12
tpch_q04/datafusion:vortex-compact 🚨 357797247 266357748 1.34
tpch_q05/datafusion:vortex-compact 428584581 504006885 0.85
tpch_q06/datafusion:vortex-compact 343870337 452975187 0.76
tpch_q07/datafusion:vortex-compact 475090883 485361906 0.98
tpch_q08/datafusion:vortex-compact 676404322 742595601 0.91
tpch_q09/datafusion:vortex-compact 534627821 553702946 0.97
tpch_q10/datafusion:vortex-compact 495288283 465169118 1.06
tpch_q11/datafusion:vortex-compact 333441692 333380292 1.00
tpch_q12/datafusion:vortex-compact 616232760 643052590 0.96
tpch_q13/datafusion:vortex-compact 🚨 311646969 231458505 1.35
tpch_q14/datafusion:vortex-compact 338100518 421398085 0.80
tpch_q15/datafusion:vortex-compact 544601273 525694624 1.04
tpch_q16/datafusion:vortex-compact 🚨 239095735 182944766 1.31
tpch_q17/datafusion:vortex-compact 408620400 330437673 1.24
tpch_q18/datafusion:vortex-compact 🚨 375909315 278965983 1.35
tpch_q19/datafusion:vortex-compact 🚨 630750594 361961173 1.74
tpch_q20/datafusion:vortex-compact 519955485 446403786 1.16
tpch_q21/datafusion:vortex-compact 586651056 576384740 1.02
tpch_q22/datafusion:vortex-compact 149784984 121535380 1.23
datafusion / parquet (0.892x ➖, 3↑ 0↓)
name PR d2668cf (ns) base 8efe1dc (ns) ratio (PR/base)
tpch_q01/datafusion:parquet 229754294 271846228 0.85
tpch_q02/datafusion:parquet 538747513 694977979 0.78
tpch_q03/datafusion:parquet 310157252 341851826 0.91
tpch_q04/datafusion:parquet 142066791 152883535 0.93
tpch_q05/datafusion:parquet 503625492 534326488 0.94
tpch_q06/datafusion:parquet 136907094 163536448 0.84
tpch_q07/datafusion:parquet 553290685 539771453 1.03
tpch_q08/datafusion:parquet 🚀 611345987 1024645372 0.60
tpch_q09/datafusion:parquet 🚀 526979240 910594082 0.58
tpch_q10/datafusion:parquet 572016770 624043562 0.92
tpch_q11/datafusion:parquet 🚀 345141992 530776651 0.65
tpch_q12/datafusion:parquet 268692581 271064962 0.99
tpch_q13/datafusion:parquet 429101320 428237712 1.00
tpch_q14/datafusion:parquet 227165401 226460813 1.00
tpch_q15/datafusion:parquet 374574816 289630743 1.29
tpch_q16/datafusion:parquet 180283868 199008855 0.91
tpch_q17/datafusion:parquet 456970142 401773539 1.14
tpch_q18/datafusion:parquet 618620159 509071266 1.22
tpch_q19/datafusion:parquet 367422430 379309134 0.97
tpch_q20/datafusion:parquet 385594655 475191905 0.81
tpch_q21/datafusion:parquet 718752151 756640362 0.95
tpch_q22/datafusion:parquet 162002496 224294694 0.72
duckdb / vortex-file-compressed (1.003x ➖, 0↑ 1↓)
name PR d2668cf (ns) base 8efe1dc (ns) ratio (PR/base)
tpch_q01/duckdb:vortex-file-compressed 🚨 393998066 270315316 1.46
tpch_q02/duckdb:vortex-file-compressed 905200436 893408729 1.01
tpch_q03/duckdb:vortex-file-compressed 605246228 637019612 0.95
tpch_q04/duckdb:vortex-file-compressed 368289016 523806016 0.70
tpch_q05/duckdb:vortex-file-compressed 825326732 943655380 0.87
tpch_q06/duckdb:vortex-file-compressed 341569334 442657198 0.77
tpch_q07/duckdb:vortex-file-compressed 731695940 711661667 1.03
tpch_q08/duckdb:vortex-file-compressed 993723315 828751615 1.20
tpch_q09/duckdb:vortex-file-compressed 830738428 870106634 0.95
tpch_q10/duckdb:vortex-file-compressed 762058505 751706910 1.01
tpch_q11/duckdb:vortex-file-compressed 514419050 524153949 0.98
tpch_q12/duckdb:vortex-file-compressed 591513610 561072364 1.05
tpch_q13/duckdb:vortex-file-compressed 451396354 442017862 1.02
tpch_q14/duckdb:vortex-file-compressed 512782433 429781400 1.19
tpch_q15/duckdb:vortex-file-compressed 229881069 306156819 0.75
tpch_q16/duckdb:vortex-file-compressed 325526861 318961531 1.02
tpch_q17/duckdb:vortex-file-compressed 627887821 551294161 1.14
tpch_q18/duckdb:vortex-file-compressed 614793716 703067700 0.87
tpch_q19/duckdb:vortex-file-compressed 476432329 485618783 0.98
tpch_q20/duckdb:vortex-file-compressed 834334225 739467431 1.13
tpch_q21/duckdb:vortex-file-compressed 1141215364 1049119450 1.09
tpch_q22/duckdb:vortex-file-compressed 396107924 341453341 1.16
duckdb / vortex-compact (1.071x ➖, 0↑ 1↓)
name PR d2668cf (ns) base 8efe1dc (ns) ratio (PR/base)
tpch_q01/duckdb:vortex-compact 296332324 282009861 1.05
tpch_q02/duckdb:vortex-compact 963889686 888139199 1.09
tpch_q03/duckdb:vortex-compact 587123946 482730636 1.22
tpch_q04/duckdb:vortex-compact 365202406 374319007 0.98
tpch_q05/duckdb:vortex-compact 923227976 853810542 1.08
tpch_q06/duckdb:vortex-compact 397859383 350934462 1.13
tpch_q07/duckdb:vortex-compact 699569114 587693621 1.19
tpch_q08/duckdb:vortex-compact 824824673 722268698 1.14
tpch_q09/duckdb:vortex-compact 887949363 787620244 1.13
tpch_q10/duckdb:vortex-compact 649156901 590380813 1.10
tpch_q11/duckdb:vortex-compact 530484473 434225730 1.22
tpch_q12/duckdb:vortex-compact 426079840 383637313 1.11
tpch_q13/duckdb:vortex-compact 🚨 572120778 419125679 1.37
tpch_q14/duckdb:vortex-compact 439090297 531206634 0.83
tpch_q15/duckdb:vortex-compact 282889163 278743219 1.01
tpch_q16/duckdb:vortex-compact 305997099 333889974 0.92
tpch_q17/duckdb:vortex-compact 625809844 646456480 0.97
tpch_q18/duckdb:vortex-compact 487393440 515405559 0.95
tpch_q19/duckdb:vortex-compact 440404468 415609413 1.06
tpch_q20/duckdb:vortex-compact 761844999 776206262 0.98
tpch_q21/duckdb:vortex-compact 1011689350 989271318 1.02
tpch_q22/duckdb:vortex-compact 373376120 317493662 1.18
duckdb / parquet (1.005x ➖, 0↑ 0↓)
name PR d2668cf (ns) base 8efe1dc (ns) ratio (PR/base)
tpch_q01/duckdb:parquet 516920367 473826216 1.09
tpch_q02/duckdb:parquet 1378154809 1238835087 1.11
tpch_q03/duckdb:parquet 1075431917 933119689 1.15
tpch_q04/duckdb:parquet 675623592 628243959 1.08
tpch_q05/duckdb:parquet 1512345113 1495271330 1.01
tpch_q06/duckdb:parquet 363386062 362547409 1.00
tpch_q07/duckdb:parquet 1123091068 1275414509 0.88
tpch_q08/duckdb:parquet 1603932600 1652759710 0.97
tpch_q09/duckdb:parquet 1420226253 1333384276 1.07
tpch_q10/duckdb:parquet 1373514799 1409107316 0.97
tpch_q11/duckdb:parquet 885681453 792585606 1.12
tpch_q12/duckdb:parquet 593777020 584961001 1.02
tpch_q13/duckdb:parquet 900443581 893094969 1.01
tpch_q14/duckdb:parquet 662595251 738272841 0.90
tpch_q15/duckdb:parquet 522177443 602216628 0.87
tpch_q16/duckdb:parquet 585853120 594681856 0.99
tpch_q17/duckdb:parquet 701031920 779897223 0.90
tpch_q18/duckdb:parquet 833058944 938851313 0.89
tpch_q19/duckdb:parquet 868209494 750976566 1.16
tpch_q20/duckdb:parquet 1097225008 1068057140 1.03
tpch_q21/duckdb:parquet 1214286701 1150786492 1.06
tpch_q22/duckdb:parquet 505629525 536357204 0.94
Full attributed analysis
Query Config Raw Δ Control Δ Attributed α Noise floor Significant?
1 datafusion:vortex-compact +5.0% -4.0% +9.3% +132.5% ➖ noise
1 datafusion:vortex-file-compressed +16.3% -4.0% +21.1% +170.5% ➖ noise
1 duckdb:vortex-compact +5.1% -4.0% +9.4% +43.4% ➖ noise
1 duckdb:vortex-file-compressed +45.8% -4.0% +51.8% +56.8% ➖ noise
2 datafusion:vortex-compact -12.5% -7.1% -5.8% +67.4% ➖ noise
2 datafusion:vortex-file-compressed +22.1% -7.1% +31.5% +54.4% ➖ noise
2 duckdb:vortex-compact +8.5% -7.1% +16.9% +30.0% ➖ noise
2 duckdb:vortex-file-compressed +1.3% -7.1% +9.1% +30.0% ➖ noise
3 datafusion:vortex-compact +11.6% +2.3% +9.1% +118.5% ➖ noise
3 datafusion:vortex-file-compressed +15.0% +2.3% +12.5% +104.4% ➖ noise
3 duckdb:vortex-compact +21.6% +2.3% +18.9% +52.0% ➖ noise
3 duckdb:vortex-file-compressed -5.0% +2.3% -7.1% +66.9% ➖ noise
4 datafusion:vortex-compact +34.3% -0.0% +34.4% +62.4% ➖ noise
4 datafusion:vortex-file-compressed +16.6% -0.0% +16.7% +37.9% ➖ noise
4 duckdb:vortex-compact -2.4% -0.0% -2.4% +38.9% ➖ noise
4 duckdb:vortex-file-compressed -29.7% -0.0% -29.7% +47.4% ➖ noise
5 datafusion:vortex-compact -15.0% -2.4% -12.9% +48.4% ➖ noise
5 datafusion:vortex-file-compressed +52.2% -2.4% +55.9% +30.0% 🚨 regression
5 duckdb:vortex-compact +8.1% -2.4% +10.7% +30.0% ➖ noise
5 duckdb:vortex-file-compressed -12.5% -2.4% -10.4% +30.0% ➖ noise
6 datafusion:vortex-compact -24.1% -8.4% -17.1% +60.8% ➖ noise
6 datafusion:vortex-file-compressed +109.0% -8.4% +128.2% +35.3% 🚨 regression
6 duckdb:vortex-compact +13.4% -8.4% +23.8% +32.5% ➖ noise
6 duckdb:vortex-file-compressed -22.8% -8.4% -15.8% +37.6% ➖ noise
7 datafusion:vortex-compact -2.1% -5.0% +3.0% +46.1% ➖ noise
7 datafusion:vortex-file-compressed +27.5% -5.0% +34.2% +30.0% 🚨 regression
7 duckdb:vortex-compact +19.0% -5.0% +25.3% +30.0% ➖ noise
7 duckdb:vortex-file-compressed +2.8% -5.0% +8.2% +30.0% ➖ noise
8 datafusion:vortex-compact -8.9% -23.9% +19.7% +46.5% ➖ noise
8 datafusion:vortex-file-compressed +28.7% -23.9% +69.1% +32.6% 🚨 regression
8 duckdb:vortex-compact +14.2% -23.9% +50.1% +30.0% 🚨 regression
8 duckdb:vortex-file-compressed +19.9% -23.9% +57.6% +30.0% 🚨 regression
9 datafusion:vortex-compact -3.4% -21.5% +23.0% +33.3% ➖ noise
9 datafusion:vortex-file-compressed +2.9% -21.5% +31.1% +30.0% 🚨 regression
9 duckdb:vortex-compact +12.7% -21.5% +43.6% +30.0% 🚨 regression
9 duckdb:vortex-file-compressed -4.5% -21.5% +21.6% +30.0% ➖ noise
10 datafusion:vortex-compact +6.5% -5.5% +12.6% +45.9% ➖ noise
10 datafusion:vortex-file-compressed +44.6% -5.5% +53.0% +41.0% 🚨 regression
10 duckdb:vortex-compact +10.0% -5.5% +16.3% +30.0% ➖ noise
10 duckdb:vortex-file-compressed +1.4% -5.5% +7.3% +30.5% ➖ noise
11 datafusion:vortex-compact +0.0% -14.8% +17.3% +46.0% ➖ noise
11 datafusion:vortex-file-compressed +97.2% -14.8% +131.3% +30.0% 🚨 regression
11 duckdb:vortex-compact +22.2% -14.8% +43.3% +30.0% 🚨 regression
11 duckdb:vortex-file-compressed -1.9% -14.8% +15.1% +30.0% ➖ noise
12 datafusion:vortex-compact -4.2% +0.3% -4.5% +64.8% ➖ noise
12 datafusion:vortex-file-compressed +11.4% +0.3% +11.1% +36.5% ➖ noise
12 duckdb:vortex-compact +11.1% +0.3% +10.7% +35.9% ➖ noise
12 duckdb:vortex-file-compressed +5.4% +0.3% +5.1% +66.3% ➖ noise
13 datafusion:vortex-compact +34.6% +0.5% +34.0% +105.0% ➖ noise
13 datafusion:vortex-file-compressed -13.6% +0.5% -14.0% +30.0% ➖ noise
13 duckdb:vortex-compact +36.5% +0.5% +35.8% +38.1% ➖ noise
13 duckdb:vortex-file-compressed +2.1% +0.5% +1.6% +30.0% ➖ noise
14 datafusion:vortex-compact -19.8% -5.1% -15.4% +30.3% ➖ noise
14 datafusion:vortex-file-compressed +60.3% -5.1% +68.9% +30.0% 🚨 regression
14 duckdb:vortex-compact -17.3% -5.1% -12.9% +35.5% ➖ noise
14 duckdb:vortex-file-compressed +19.3% -5.1% +25.7% +34.9% ➖ noise
15 datafusion:vortex-compact +3.6% +5.9% -2.2% +40.8% ➖ noise
15 datafusion:vortex-file-compressed +31.3% +5.9% +24.0% +30.0% ➖ noise
15 duckdb:vortex-compact +1.5% +5.9% -4.2% +34.2% ➖ noise
15 duckdb:vortex-file-compressed -24.9% +5.9% -29.1% +33.4% ✅ faster
16 datafusion:vortex-compact +30.7% -5.5% +38.3% +30.0% 🚨 regression
16 datafusion:vortex-file-compressed +4.2% -5.5% +10.3% +55.3% ➖ noise
16 duckdb:vortex-compact -8.4% -5.5% -3.0% +30.0% ➖ noise
16 duckdb:vortex-file-compressed +2.1% -5.5% +8.0% +30.0% ➖ noise
17 datafusion:vortex-compact +23.7% +1.1% +22.3% +63.3% ➖ noise
17 datafusion:vortex-file-compressed +4.1% +1.1% +3.0% +30.0% ➖ noise
17 duckdb:vortex-compact -3.2% +1.1% -4.3% +30.0% ➖ noise
17 duckdb:vortex-file-compressed +13.9% +1.1% +12.6% +30.0% ➖ noise
18 datafusion:vortex-compact +34.8% +3.8% +29.8% +47.7% ➖ noise
18 datafusion:vortex-file-compressed +4.7% +3.8% +0.9% +30.0% ➖ noise
18 duckdb:vortex-compact -5.4% +3.8% -8.9% +30.0% ➖ noise
18 duckdb:vortex-file-compressed -12.6% +3.8% -15.8% +37.4% ➖ noise
19 datafusion:vortex-compact +74.3% +5.8% +64.7% +30.0% 🚨 regression
19 datafusion:vortex-file-compressed -11.9% +5.8% -16.8% +30.9% ➖ noise
19 duckdb:vortex-compact +6.0% +5.8% +0.1% +30.0% ➖ noise
19 duckdb:vortex-file-compressed -1.9% +5.8% -7.3% +30.0% ➖ noise
20 datafusion:vortex-compact +16.5% -8.7% +27.6% +44.5% ➖ noise
20 datafusion:vortex-file-compressed -31.5% -8.7% -24.9% +30.0% ✅ faster
20 duckdb:vortex-compact -1.9% -8.7% +7.5% +30.0% ➖ noise
20 duckdb:vortex-file-compressed +12.8% -8.7% +23.6% +40.5% ➖ noise
21 datafusion:vortex-compact +1.8% +0.1% +1.7% +30.0% ➖ noise
21 datafusion:vortex-file-compressed -9.4% +0.1% -9.5% +30.0% ➖ noise
21 duckdb:vortex-compact +2.3% +0.1% +2.1% +30.2% ➖ noise
21 duckdb:vortex-file-compressed +8.8% +0.1% +8.7% +30.0% ➖ noise
22 datafusion:vortex-compact +23.2% -17.5% +49.4% +30.0% 🚨 regression
22 datafusion:vortex-file-compressed -22.1% -17.5% -5.5% +40.1% ➖ noise
22 duckdb:vortex-compact +17.6% -17.5% +42.5% +30.0% 🚨 regression
22 duckdb:vortex-file-compressed +16.0% -17.5% +40.6% +64.9% ➖ noise

@github-actions
Copy link
Contributor

Benchmarks: FineWeb S3

Verdict: No clear signal (environment too noisy confidence)
Attributed Vortex impact: +3.2%
Vortex (geomean): 1.019x ➖
Parquet (geomean): 0.987x ➖
Shifts: Parquet (control) -1.3% · Median polish +1.8%


datafusion / vortex-file-compressed (1.038x ➖, 0↑ 1↓)
name PR d2668cf (ns) base 8efe1dc (ns) ratio (PR/base)
fineweb_q00/datafusion:vortex-file-compressed 🚨 53424614 31029504 1.72
fineweb_q01/datafusion:vortex-file-compressed 543538847 589120404 0.92
fineweb_q02/datafusion:vortex-file-compressed 551961871 543957012 1.01
fineweb_q03/datafusion:vortex-file-compressed 1432072486 1370400520 1.05
fineweb_q04/datafusion:vortex-file-compressed 1359819413 1360977531 1.00
fineweb_q05/datafusion:vortex-file-compressed 1330795800 1415047602 0.94
fineweb_q06/datafusion:vortex-file-compressed 1465793844 1627916874 0.90
fineweb_q07/datafusion:vortex-file-compressed 1341058731 1346814519 1.00
fineweb_q08/datafusion:vortex-file-compressed 540998171 549210657 0.99
datafusion / vortex-compact (0.900x ➖, 2↑ 1↓)
name PR d2668cf (ns) base 8efe1dc (ns) ratio (PR/base)
fineweb_q00/datafusion:vortex-compact 🚨 42175073 31146983 1.35
fineweb_q01/datafusion:vortex-compact 🚀 535104129 893540344 0.60
fineweb_q02/datafusion:vortex-compact 🚀 677702965 1011330245 0.67
fineweb_q03/datafusion:vortex-compact 1887442564 1842606507 1.02
fineweb_q04/datafusion:vortex-compact 2241171302 2200587319 1.02
fineweb_q05/datafusion:vortex-compact 1755487154 1704393846 1.03
fineweb_q06/datafusion:vortex-compact 1482128027 2000023916 0.74
fineweb_q07/datafusion:vortex-compact 1339371669 1431597510 0.94
fineweb_q08/datafusion:vortex-compact 397950742 414441224 0.96
datafusion / parquet (0.976x ➖, 0↑ 1↓)
name PR d2668cf (ns) base 8efe1dc (ns) ratio (PR/base)
fineweb_q00/datafusion:parquet 🚨 1606607090 1078955506 1.49
fineweb_q01/datafusion:parquet 1981540160 1959978760 1.01
fineweb_q02/datafusion:parquet 1901398760 1798185346 1.06
fineweb_q03/datafusion:parquet 1977313275 2019717468 0.98
fineweb_q04/datafusion:parquet 1806840853 2201400420 0.82
fineweb_q05/datafusion:parquet 1802960060 2211123867 0.82
fineweb_q06/datafusion:parquet 2104004887 2262045954 0.93
fineweb_q07/datafusion:parquet 2109386185 1912882016 1.10
fineweb_q08/datafusion:parquet 1777548245 2372380969 0.75
duckdb / vortex-file-compressed (1.058x ➖, 0↑ 0↓)
name PR d2668cf (ns) base 8efe1dc (ns) ratio (PR/base)
fineweb_q00/duckdb:vortex-file-compressed 103534706 106081581 0.98
fineweb_q01/duckdb:vortex-file-compressed 740130478 683594547 1.08
fineweb_q02/duckdb:vortex-file-compressed 482378632 513628391 0.94
fineweb_q03/duckdb:vortex-file-compressed 1588915667 1451268285 1.09
fineweb_q04/duckdb:vortex-file-compressed 1693719371 1495106542 1.13
fineweb_q05/duckdb:vortex-file-compressed 1563244738 1487403818 1.05
fineweb_q06/duckdb:vortex-file-compressed 1721206123 1626348612 1.06
fineweb_q07/duckdb:vortex-file-compressed 1530985344 1416946913 1.08
fineweb_q08/duckdb:vortex-file-compressed 692837407 616646417 1.12
duckdb / vortex-compact (1.092x ➖, 0↑ 0↓)
name PR d2668cf (ns) base 8efe1dc (ns) ratio (PR/base)
fineweb_q00/duckdb:vortex-compact 120256351 109966437 1.09
fineweb_q01/duckdb:vortex-compact 633738901 679200696 0.93
fineweb_q02/duckdb:vortex-compact 590893170 578648597 1.02
fineweb_q03/duckdb:vortex-compact 1776201227 1617446935 1.10
fineweb_q04/duckdb:vortex-compact 1859713862 1578858991 1.18
fineweb_q05/duckdb:vortex-compact 1643492524 1466023568 1.12
fineweb_q06/duckdb:vortex-compact 1678037250 1609114432 1.04
fineweb_q07/duckdb:vortex-compact 1679910188 1296127383 1.30
fineweb_q08/duckdb:vortex-compact 507559965 469889352 1.08
duckdb / parquet (0.999x ➖, 0↑ 0↓)
name PR d2668cf (ns) base 8efe1dc (ns) ratio (PR/base)
fineweb_q00/duckdb:parquet 1145059358 1175413122 0.97
fineweb_q01/duckdb:parquet 1647158622 1661297264 0.99
fineweb_q02/duckdb:parquet 1748338500 1706418599 1.02
fineweb_q03/duckdb:parquet 4180469338 4073424982 1.03
fineweb_q04/duckdb:parquet 1935834223 1961275918 0.99
fineweb_q05/duckdb:parquet 2681410449 2604993516 1.03
fineweb_q06/duckdb:parquet 3266174177 3732604951 0.88
fineweb_q07/duckdb:parquet 4198918517 4155317970 1.01
fineweb_q08/duckdb:parquet 1134186770 1042973835 1.09
Full attributed analysis
Query Config Raw Δ Control Δ Attributed α Noise floor Significant?
0 datafusion:vortex-compact +35.4% +20.4% +12.4% +182.7% ➖ noise
0 datafusion:vortex-file-compressed +72.2% +20.4% +43.0% +214.3% ➖ noise
0 duckdb:vortex-compact +9.4% +20.4% -9.2% +40.0% ➖ noise
0 duckdb:vortex-file-compressed -2.4% +20.4% -19.0% +70.0% ➖ noise
1 datafusion:vortex-compact -40.1% +0.1% -40.2% +68.5% ➖ noise
1 datafusion:vortex-file-compressed -7.7% +0.1% -7.8% +82.5% ➖ noise
1 duckdb:vortex-compact -6.7% +0.1% -6.8% +50.1% ➖ noise
1 duckdb:vortex-file-compressed +8.3% +0.1% +8.1% +30.0% ➖ noise
2 datafusion:vortex-compact -33.0% +4.1% -35.6% +30.0% ✅ faster
2 datafusion:vortex-file-compressed +1.5% +4.1% -2.5% +30.0% ➖ noise
2 duckdb:vortex-compact +2.1% +4.1% -1.9% +30.0% ➖ noise
2 duckdb:vortex-file-compressed -6.1% +4.1% -9.8% +30.0% ➖ noise
3 datafusion:vortex-compact +2.4% +0.2% +2.2% +30.0% ➖ noise
3 datafusion:vortex-file-compressed +4.5% +0.2% +4.3% +30.0% ➖ noise
3 duckdb:vortex-compact +9.8% +0.2% +9.6% +30.0% ➖ noise
3 duckdb:vortex-file-compressed +9.5% +0.2% +9.2% +30.0% ➖ noise
4 datafusion:vortex-compact +1.8% -10.0% +13.2% +30.0% ➖ noise
4 datafusion:vortex-file-compressed -0.1% -10.0% +11.0% +30.0% ➖ noise
4 duckdb:vortex-compact +17.8% -10.0% +30.9% +30.0% 🚨 regression
4 duckdb:vortex-file-compressed +13.3% -10.0% +25.9% +30.0% ➖ noise
5 datafusion:vortex-compact +3.0% -8.4% +12.4% +30.0% ➖ noise
5 datafusion:vortex-file-compressed -6.0% -8.4% +2.7% +30.0% ➖ noise
5 duckdb:vortex-compact +12.1% -8.4% +22.4% +30.0% ➖ noise
5 duckdb:vortex-file-compressed +5.1% -8.4% +14.7% +30.0% ➖ noise
6 datafusion:vortex-compact -25.9% -9.8% -17.9% +30.0% ➖ noise
6 datafusion:vortex-file-compressed -10.0% -9.8% -0.2% +30.0% ➖ noise
6 duckdb:vortex-compact +4.3% -9.8% +15.6% +30.0% ➖ noise
6 duckdb:vortex-file-compressed +5.8% -9.8% +17.3% +30.0% ➖ noise
7 datafusion:vortex-compact -6.4% +5.6% -11.4% +34.4% ➖ noise
7 datafusion:vortex-file-compressed -0.4% +5.6% -5.7% +30.0% ➖ noise
7 duckdb:vortex-compact +29.6% +5.6% +22.8% +30.0% ➖ noise
7 duckdb:vortex-file-compressed +8.0% +5.6% +2.4% +30.0% ➖ noise
8 datafusion:vortex-compact -4.0% -9.7% +6.4% +30.0% ➖ noise
8 datafusion:vortex-file-compressed -1.5% -9.7% +9.1% +30.0% ➖ noise
8 duckdb:vortex-compact +8.0% -9.7% +19.7% +30.0% ➖ noise
8 duckdb:vortex-file-compressed +12.4% -9.7% +24.5% +30.0% ➖ noise

@github-actions
Copy link
Contributor

Benchmarks: Random Access

Vortex (geomean): 0.971x ➖
Parquet (geomean): 1.060x ➖


unknown / unknown (1.043x ➖, 5↑ 11↓)
name PR d2668cf (ns) base 8efe1dc (ns) ratio (PR/base)
random-access/feature-vectors/correlated/lance-tokio-local-disk 🚨 3060496 2290957 1.34
random-access/feature-vectors/correlated/lance-tokio-local-disk-footer 🚨 1451024 1265947 1.15
random-access/feature-vectors/correlated/parquet-tokio-local-disk 14158071734 13926391014 1.02
random-access/feature-vectors/correlated/parquet-tokio-local-disk-footer 13720922907 13418168156 1.02
random-access/feature-vectors/correlated/vortex-tokio-local-disk 8256394 7767430 1.06
random-access/feature-vectors/correlated/vortex-tokio-local-disk-footer 6356349 6490267 0.98
random-access/feature-vectors/uniform/lance-tokio-local-disk 🚨 1759597 1456752 1.21
random-access/feature-vectors/uniform/lance-tokio-local-disk-footer 🚨 2744118 2355981 1.16
random-access/feature-vectors/uniform/parquet-tokio-local-disk 14691187693 13380216051 1.10
random-access/feature-vectors/uniform/parquet-tokio-local-disk-footer 14002320385 13505502279 1.04
random-access/feature-vectors/uniform/vortex-tokio-local-disk 13857286 13884939 1.00
random-access/feature-vectors/uniform/vortex-tokio-local-disk-footer 14135324 13911643 1.02
random-access/lance-tokio-local-disk 🚨 826666 738018 1.12
random-access/lance-tokio-local-disk-footer 1460340 1338915 1.09
random-access/nested-lists/correlated/lance-tokio-local-disk 281749 267458 1.05
random-access/nested-lists/correlated/lance-tokio-local-disk-footer 778143 716915 1.09
random-access/nested-lists/correlated/parquet-tokio-local-disk 167719154 159831348 1.05
random-access/nested-lists/correlated/parquet-tokio-local-disk-footer 166553620 158399478 1.05
random-access/nested-lists/correlated/vortex-tokio-local-disk 🚨 869481 695147 1.25
random-access/nested-lists/correlated/vortex-tokio-local-disk-footer 🚨 781223 708641 1.10
random-access/nested-lists/uniform/lance-tokio-local-disk 1237057 1172607 1.05
random-access/nested-lists/uniform/lance-tokio-local-disk-footer 1750647 1662491 1.05
random-access/nested-lists/uniform/parquet-tokio-local-disk 164135004 159154654 1.03
random-access/nested-lists/uniform/parquet-tokio-local-disk-footer 163730275 161219123 1.02
random-access/nested-lists/uniform/vortex-tokio-local-disk 2547360 2479656 1.03
random-access/nested-lists/uniform/vortex-tokio-local-disk-footer 2599995 2680851 0.97
random-access/nested-structs/correlated/lance-tokio-local-disk 454634 433529 1.05
random-access/nested-structs/correlated/lance-tokio-local-disk-footer 669274 634431 1.05
random-access/nested-structs/correlated/parquet-tokio-local-disk 🚨 30358045 26066257 1.16
random-access/nested-structs/correlated/parquet-tokio-local-disk-footer 28854448 27110693 1.06
random-access/nested-structs/correlated/vortex-tokio-local-disk 894608 869438 1.03
random-access/nested-structs/correlated/vortex-tokio-local-disk-footer 985003 904410 1.09
random-access/nested-structs/uniform/lance-tokio-local-disk 2962330 2847684 1.04
random-access/nested-structs/uniform/lance-tokio-local-disk-footer 3329439 3104025 1.07
random-access/nested-structs/uniform/parquet-tokio-local-disk 🚨 30632298 26579146 1.15
random-access/nested-structs/uniform/parquet-tokio-local-disk-footer 🚨 30523910 25931652 1.18
random-access/nested-structs/uniform/vortex-tokio-local-disk 1897663 1726699 1.10
random-access/nested-structs/uniform/vortex-tokio-local-disk-footer 1823427 1750704 1.04
random-access/parquet-tokio-local-disk 185701437 185655697 1.00
random-access/parquet-tokio-local-disk-footer 186148105 186995940 1.00
random-access/taxi/correlated/lance-tokio-local-disk 🚨 1067081 958396 1.11
random-access/taxi/correlated/lance-tokio-local-disk-footer 1755964 1640197 1.07
random-access/taxi/correlated/parquet-tokio-local-disk 283774880 271952459 1.04
random-access/taxi/correlated/parquet-tokio-local-disk-footer 293428627 275795227 1.06
random-access/taxi/correlated/vortex-tokio-local-disk 🚀 1798152 2564086 0.70
random-access/taxi/correlated/vortex-tokio-local-disk-footer 🚀 1876206 2240046 0.84
random-access/taxi/uniform/lance-tokio-local-disk 9211972 8484366 1.09
random-access/taxi/uniform/lance-tokio-local-disk-footer 9968966 9156630 1.09
random-access/taxi/uniform/parquet-tokio-local-disk 302392833 289211191 1.05
random-access/taxi/uniform/parquet-tokio-local-disk-footer 315429239 291876232 1.08
random-access/taxi/uniform/vortex-tokio-local-disk 🚀 4566741 5268355 0.87
random-access/taxi/uniform/vortex-tokio-local-disk-footer 5104560 5185606 0.98
random-access/vortex-tokio-local-disk 🚀 1322606 1721374 0.77
random-access/vortex-tokio-local-disk-footer 🚀 1265741 1550049 0.82

@github-actions
Copy link
Contributor

Benchmarks: Statistical and Population Genetics

Verdict: No clear signal (low confidence)
Attributed Vortex impact: +0.3%
Vortex (geomean): 1.045x ➖
Parquet (geomean): 1.043x ➖
Shifts: Parquet (control) +4.3% · Median polish +3.9%


duckdb / vortex-file-compressed (1.041x ➖, 0↑ 0↓)
name PR d2668cf (ns) base 8efe1dc (ns) ratio (PR/base)
statpopgen_q00/duckdb:vortex-file-compressed 11493387 10832844 1.06
statpopgen_q01/duckdb:vortex-file-compressed 28509629 27486951 1.04
statpopgen_q02/duckdb:vortex-file-compressed 1348627450 1301565991 1.04
statpopgen_q03/duckdb:vortex-file-compressed 3098188527 3040691752 1.02
statpopgen_q04/duckdb:vortex-file-compressed 3096659898 3021023961 1.03
statpopgen_q05/duckdb:vortex-file-compressed 1402759565 1378523856 1.02
statpopgen_q06/duckdb:vortex-file-compressed 2099302109 2036853858 1.03
statpopgen_q07/duckdb:vortex-file-compressed 203959027 191043904 1.07
statpopgen_q08/duckdb:vortex-file-compressed 217453829 200618752 1.08
statpopgen_q09/duckdb:vortex-file-compressed 2920842957 2808453041 1.04
statpopgen_q10/duckdb:vortex-file-compressed 4679780839 4504921691 1.04
duckdb / vortex-compact (1.050x ➖, 0↑ 0↓)
name PR d2668cf (ns) base 8efe1dc (ns) ratio (PR/base)
statpopgen_q00/duckdb:vortex-compact 11357193 10618639 1.07
statpopgen_q01/duckdb:vortex-compact 170632188 164339448 1.04
statpopgen_q02/duckdb:vortex-compact 1875784594 1805533811 1.04
statpopgen_q03/duckdb:vortex-compact 3622220806 3428706239 1.06
statpopgen_q04/duckdb:vortex-compact 3689014006 3493524145 1.06
statpopgen_q05/duckdb:vortex-compact 1900376453 1825048250 1.04
statpopgen_q06/duckdb:vortex-compact 2758488783 2656699194 1.04
statpopgen_q07/duckdb:vortex-compact 963598064 944812200 1.02
statpopgen_q08/duckdb:vortex-compact 1013724667 977426789 1.04
statpopgen_q09/duckdb:vortex-compact 3566103042 3323965162 1.07
statpopgen_q10/duckdb:vortex-compact 5759195220 5336965044 1.08
duckdb / parquet (1.043x ➖, 0↑ 0↓)
name PR d2668cf (ns) base 8efe1dc (ns) ratio (PR/base)
statpopgen_q00/duckdb:parquet 326052260 312512853 1.04
statpopgen_q01/duckdb:parquet 419005444 389784083 1.07
statpopgen_q02/duckdb:parquet 1027379350 988659279 1.04
statpopgen_q03/duckdb:parquet 1528136063 1482799213 1.03
statpopgen_q04/duckdb:parquet 1553696140 1516264882 1.02
statpopgen_q05/duckdb:parquet 1039459031 995274963 1.04
statpopgen_q06/duckdb:parquet 1568512684 1483071958 1.06
statpopgen_q07/duckdb:parquet 1943295038 1874289835 1.04
statpopgen_q08/duckdb:parquet 1929107055 1886555879 1.02
statpopgen_q09/duckdb:parquet 1428118954 1367897448 1.04
statpopgen_q10/duckdb:parquet 2820060980 2681679413 1.05
Full attributed analysis
Query Config Raw Δ Control Δ Attributed α Noise floor Significant?
0 duckdb:vortex-compact +7.0% +4.3% +2.5% +10.0% ➖ noise
0 duckdb:vortex-file-compressed +6.1% +4.3% +1.7% +10.0% ➖ noise
1 duckdb:vortex-compact +3.8% +7.5% -3.4% +39.8% ➖ noise
1 duckdb:vortex-file-compressed +3.7% +7.5% -3.5% +288.4% ➖ noise
2 duckdb:vortex-compact +3.9% +3.9% -0.0% +10.0% ➖ noise
2 duckdb:vortex-file-compressed +3.6% +3.9% -0.3% +10.0% ➖ noise
3 duckdb:vortex-compact +5.6% +3.1% +2.5% +10.0% ➖ noise
3 duckdb:vortex-file-compressed +1.9% +3.1% -1.1% +10.0% ➖ noise
4 duckdb:vortex-compact +5.6% +2.5% +3.1% +10.0% ➖ noise
4 duckdb:vortex-file-compressed +2.5% +2.5% +0.0% +10.0% ➖ noise
5 duckdb:vortex-compact +4.1% +4.4% -0.3% +10.0% ➖ noise
5 duckdb:vortex-file-compressed +1.8% +4.4% -2.6% +10.0% ➖ noise
6 duckdb:vortex-compact +3.8% +5.8% -1.8% +10.0% ➖ noise
6 duckdb:vortex-file-compressed +3.1% +5.8% -2.5% +10.0% ➖ noise
7 duckdb:vortex-compact +2.0% +3.7% -1.6% +10.0% ➖ noise
7 duckdb:vortex-file-compressed +6.8% +3.7% +3.0% +10.0% ➖ noise
8 duckdb:vortex-compact +3.7% +2.3% +1.4% +10.0% ➖ noise
8 duckdb:vortex-file-compressed +8.4% +2.3% +6.0% +10.0% ➖ noise
9 duckdb:vortex-compact +7.3% +4.4% +2.8% +10.0% ➖ noise
9 duckdb:vortex-file-compressed +4.0% +4.4% -0.4% +10.0% ➖ noise
10 duckdb:vortex-compact +7.9% +5.2% +2.6% +10.0% ➖ noise
10 duckdb:vortex-file-compressed +3.9% +5.2% -1.2% +10.0% ➖ noise

@github-actions
Copy link
Contributor

Benchmarks: Clickbench on NVME

Verdict: No clear signal (low confidence)
Attributed Vortex impact: +0.2%
Vortex (geomean): 1.039x ➖
Parquet (geomean): 1.028x ➖
Shifts: Parquet (control) +2.8% · Median polish +1.6%


datafusion / vortex-file-compressed (1.060x ➖, 0↑ 9↓)
name PR d2668cf (ns) base 8efe1dc (ns) ratio (PR/base)
clickbench_q00/datafusion:vortex-file-compressed 🚨 2351337 1735579 1.35
clickbench_q01/datafusion:vortex-file-compressed 🚨 15813861 13926622 1.14
clickbench_q02/datafusion:vortex-file-compressed 🚨 38973024 31983645 1.22
clickbench_q03/datafusion:vortex-file-compressed 🚨 44281365 37046042 1.20
clickbench_q04/datafusion:vortex-file-compressed 335801060 321981520 1.04
clickbench_q05/datafusion:vortex-file-compressed 🚨 400584749 313708230 1.28
clickbench_q06/datafusion:vortex-file-compressed 🚨 2323851 1746164 1.33
clickbench_q07/datafusion:vortex-file-compressed 🚨 21591119 17376676 1.24
clickbench_q08/datafusion:vortex-file-compressed 🚨 486860454 394102077 1.24
clickbench_q09/datafusion:vortex-file-compressed 607774958 569415184 1.07
clickbench_q10/datafusion:vortex-file-compressed 72952188 73939748 0.99
clickbench_q11/datafusion:vortex-file-compressed 82821626 80824107 1.02
clickbench_q12/datafusion:vortex-file-compressed 281547685 279180799 1.01
clickbench_q13/datafusion:vortex-file-compressed 425943390 411437221 1.04
clickbench_q14/datafusion:vortex-file-compressed 256124836 254113922 1.01
clickbench_q15/datafusion:vortex-file-compressed 383240788 373375808 1.03
clickbench_q16/datafusion:vortex-file-compressed 743868818 726666243 1.02
clickbench_q17/datafusion:vortex-file-compressed 736481345 713834660 1.03
clickbench_q18/datafusion:vortex-file-compressed 1565683674 1464635784 1.07
clickbench_q19/datafusion:vortex-file-compressed 23801903 23812597 1.00
clickbench_q20/datafusion:vortex-file-compressed 352455249 338450718 1.04
clickbench_q21/datafusion:vortex-file-compressed 406876818 399160084 1.02
clickbench_q22/datafusion:vortex-file-compressed 548744624 523050889 1.05
clickbench_q23/datafusion:vortex-file-compressed 657270165 642165066 1.02
clickbench_q24/datafusion:vortex-file-compressed 47494126 49479095 0.96
clickbench_q25/datafusion:vortex-file-compressed 68365695 70861863 0.96
clickbench_q26/datafusion:vortex-file-compressed 48231168 47176424 1.02
clickbench_q27/datafusion:vortex-file-compressed 801862762 789841795 1.02
clickbench_q28/datafusion:vortex-file-compressed 6715128283 6699644697 1.00
clickbench_q29/datafusion:vortex-file-compressed 233099042 237428011 0.98
clickbench_q30/datafusion:vortex-file-compressed 260451011 256001436 1.02
clickbench_q31/datafusion:vortex-file-compressed 301052385 294849259 1.02
clickbench_q32/datafusion:vortex-file-compressed 🚨 1436611716 1297558834 1.11
clickbench_q33/datafusion:vortex-file-compressed 1441515702 1449625967 0.99
clickbench_q34/datafusion:vortex-file-compressed 1438023631 1456588037 0.99
clickbench_q35/datafusion:vortex-file-compressed 537539323 534552086 1.01
clickbench_q36/datafusion:vortex-file-compressed 82852526 80524119 1.03
clickbench_q37/datafusion:vortex-file-compressed 38069834 35948556 1.06
clickbench_q38/datafusion:vortex-file-compressed 25544815 23974992 1.07
clickbench_q39/datafusion:vortex-file-compressed 152622451 149589012 1.02
clickbench_q40/datafusion:vortex-file-compressed 21310864 20887161 1.02
clickbench_q41/datafusion:vortex-file-compressed 19317267 18975745 1.02
clickbench_q42/datafusion:vortex-file-compressed 22165651 21658640 1.02
datafusion / parquet (1.043x ➖, 0↑ 8↓)
name PR d2668cf (ns) base 8efe1dc (ns) ratio (PR/base)
clickbench_q00/datafusion:parquet 🚨 1715083 1551869 1.11
clickbench_q01/datafusion:parquet 21259092 21407819 0.99
clickbench_q02/datafusion:parquet 48515671 49332333 0.98
clickbench_q03/datafusion:parquet 40151575 41120330 0.98
clickbench_q04/datafusion:parquet 348191704 348819254 1.00
clickbench_q05/datafusion:parquet 386179721 368253845 1.05
clickbench_q06/datafusion:parquet 1591338 1590658 1.00
clickbench_q07/datafusion:parquet 25872048 25735479 1.01
clickbench_q08/datafusion:parquet 420738345 419539212 1.00
clickbench_q09/datafusion:parquet 660403926 650472976 1.02
clickbench_q10/datafusion:parquet 120987949 122715112 0.99
clickbench_q11/datafusion:parquet 147481028 145917838 1.01
clickbench_q12/datafusion:parquet 373438378 367694476 1.02
clickbench_q13/datafusion:parquet 522702382 520456725 1.00
clickbench_q14/datafusion:parquet 370457720 362863550 1.02
clickbench_q15/datafusion:parquet 400062139 387406852 1.03
clickbench_q16/datafusion:parquet 774699721 736588514 1.05
clickbench_q17/datafusion:parquet 750653136 722343034 1.04
clickbench_q18/datafusion:parquet 1566043248 1576145684 0.99
clickbench_q19/datafusion:parquet 35374486 32680991 1.08
clickbench_q20/datafusion:parquet 617596730 587198577 1.05
clickbench_q21/datafusion:parquet 681603239 681752327 1.00
clickbench_q22/datafusion:parquet 1015445998 993840212 1.02
clickbench_q23/datafusion:parquet 3803481237 3772510137 1.01
clickbench_q24/datafusion:parquet 94732565 100183969 0.95
clickbench_q25/datafusion:parquet 152692304 150358649 1.02
clickbench_q26/datafusion:parquet 97097134 97920427 0.99
clickbench_q27/datafusion:parquet 1075591976 1058480461 1.02
clickbench_q28/datafusion:parquet 6673126915 6577474407 1.01
clickbench_q29/datafusion:parquet 241578672 235614338 1.03
clickbench_q30/datafusion:parquet 377496406 376181625 1.00
clickbench_q31/datafusion:parquet 415165322 406388096 1.02
clickbench_q32/datafusion:parquet 🚨 1418051098 1274796585 1.11
clickbench_q33/datafusion:parquet 1578260507 1546942283 1.02
clickbench_q34/datafusion:parquet 1582240951 1529716789 1.03
clickbench_q35/datafusion:parquet 577044830 535451074 1.08
clickbench_q36/datafusion:parquet 🚨 157883087 137366109 1.15
clickbench_q37/datafusion:parquet 61530109 59036207 1.04
clickbench_q38/datafusion:parquet 🚨 106421480 92641024 1.15
clickbench_q39/datafusion:parquet 🚨 344481111 276098736 1.25
clickbench_q40/datafusion:parquet 🚨 42168063 34279813 1.23
clickbench_q41/datafusion:parquet 🚨 37535966 30869086 1.22
clickbench_q42/datafusion:parquet 🚨 37840685 31613528 1.20
duckdb / vortex-file-compressed (1.018x ➖, 3↑ 5↓)
name PR d2668cf (ns) base 8efe1dc (ns) ratio (PR/base)
clickbench_q00/duckdb:vortex-file-compressed 6356270 5932911 1.07
clickbench_q01/duckdb:vortex-file-compressed 13822097 13504964 1.02
clickbench_q02/duckdb:vortex-file-compressed 24795310 23692505 1.05
clickbench_q03/duckdb:vortex-file-compressed 30899225 30077718 1.03
clickbench_q04/duckdb:vortex-file-compressed 170817462 168454605 1.01
clickbench_q05/duckdb:vortex-file-compressed 198926758 193062771 1.03
clickbench_q06/duckdb:vortex-file-compressed 19725144 18788524 1.05
clickbench_q07/duckdb:vortex-file-compressed 🚨 16922181 15318520 1.10
clickbench_q08/duckdb:vortex-file-compressed 268390816 259922919 1.03
clickbench_q09/duckdb:vortex-file-compressed 386816247 370759396 1.04
clickbench_q10/duckdb:vortex-file-compressed 74618569 73324633 1.02
clickbench_q11/duckdb:vortex-file-compressed 83310299 80577193 1.03
clickbench_q12/duckdb:vortex-file-compressed 219992033 215081370 1.02
clickbench_q13/duckdb:vortex-file-compressed 439156501 426225006 1.03
clickbench_q14/duckdb:vortex-file-compressed 244308399 236784219 1.03
clickbench_q15/duckdb:vortex-file-compressed 212233439 208606884 1.02
clickbench_q16/duckdb:vortex-file-compressed 765218368 741191497 1.03
clickbench_q17/duckdb:vortex-file-compressed 612212458 639649280 0.96
clickbench_q18/duckdb:vortex-file-compressed 1250249226 1261286175 0.99
clickbench_q19/duckdb:vortex-file-compressed 21578887 21828368 0.99
clickbench_q20/duckdb:vortex-file-compressed 379239134 407358483 0.93
clickbench_q21/duckdb:vortex-file-compressed 415621788 404031025 1.03
clickbench_q22/duckdb:vortex-file-compressed 🚀 603186873 700855048 0.86
clickbench_q23/duckdb:vortex-file-compressed 🚀 1527974950 1932260288 0.79
clickbench_q24/duckdb:vortex-file-compressed 49726740 49879100 1.00
clickbench_q25/duckdb:vortex-file-compressed 73098415 76172716 0.96
clickbench_q26/duckdb:vortex-file-compressed 41817967 46310202 0.90
clickbench_q27/duckdb:vortex-file-compressed 577794034 543026979 1.06
clickbench_q28/duckdb:vortex-file-compressed 3019541748 3012646348 1.00
clickbench_q29/duckdb:vortex-file-compressed 28387516 27460183 1.03
clickbench_q30/duckdb:vortex-file-compressed 195531808 195155659 1.00
clickbench_q31/duckdb:vortex-file-compressed 276805180 271845117 1.02
clickbench_q32/duckdb:vortex-file-compressed 1387430337 1339660855 1.04
clickbench_q33/duckdb:vortex-file-compressed 🚀 1556409942 1744879268 0.89
clickbench_q34/duckdb:vortex-file-compressed 1627050762 1735345942 0.94
clickbench_q35/duckdb:vortex-file-compressed 375523348 369163673 1.02
clickbench_q36/duckdb:vortex-file-compressed 🚨 33733154 30349152 1.11
clickbench_q37/duckdb:vortex-file-compressed 🚨 27117170 21521834 1.26
clickbench_q38/duckdb:vortex-file-compressed 25357776 23852022 1.06
clickbench_q39/duckdb:vortex-file-compressed 47419770 45300740 1.05
clickbench_q40/duckdb:vortex-file-compressed 26140981 23788785 1.10
clickbench_q41/duckdb:vortex-file-compressed 🚨 25119235 21467862 1.17
clickbench_q42/duckdb:vortex-file-compressed 🚨 26046681 23229794 1.12
duckdb / parquet (1.012x ➖, 0↑ 0↓)
name PR d2668cf (ns) base 8efe1dc (ns) ratio (PR/base)
clickbench_q00/duckdb:parquet 235003361 217864812 1.08
clickbench_q01/duckdb:parquet 50654865 51108362 0.99
clickbench_q02/duckdb:parquet 66160932 66508278 0.99
clickbench_q03/duckdb:parquet 64380902 63654125 1.01
clickbench_q04/duckdb:parquet 212682342 203416379 1.05
clickbench_q05/duckdb:parquet 284912701 276318360 1.03
clickbench_q06/duckdb:parquet 60814005 60181506 1.01
clickbench_q07/duckdb:parquet 52910536 53545185 0.99
clickbench_q08/duckdb:parquet 271462077 266952568 1.02
clickbench_q09/duckdb:parquet 398335765 398255248 1.00
clickbench_q10/duckdb:parquet 97605143 94280498 1.04
clickbench_q11/duckdb:parquet 109329080 107603484 1.02
clickbench_q12/duckdb:parquet 299354861 300005946 1.00
clickbench_q13/duckdb:parquet 517214898 520957674 0.99
clickbench_q14/duckdb:parquet 329105568 325325624 1.01
clickbench_q15/duckdb:parquet 244733203 242557839 1.01
clickbench_q16/duckdb:parquet 618932957 620047186 1.00
clickbench_q17/duckdb:parquet 513496692 511603108 1.00
clickbench_q18/duckdb:parquet 1068516923 1049380186 1.02
clickbench_q19/duckdb:parquet 50006875 49556621 1.01
clickbench_q20/duckdb:parquet 440468898 435510800 1.01
clickbench_q21/duckdb:parquet 564048290 558029163 1.01
clickbench_q22/duckdb:parquet 944412010 940321780 1.00
clickbench_q23/duckdb:parquet 315055172 323781234 0.97
clickbench_q24/duckdb:parquet 77321306 77926883 0.99
clickbench_q25/duckdb:parquet 140996619 142151874 0.99
clickbench_q26/duckdb:parquet 53613107 52659435 1.02
clickbench_q27/duckdb:parquet 658671626 640135496 1.03
clickbench_q28/duckdb:parquet 4847489694 4830322101 1.00
clickbench_q29/duckdb:parquet 62612795 60918252 1.03
clickbench_q30/duckdb:parquet 305797332 305536991 1.00
clickbench_q31/duckdb:parquet 353536720 349730929 1.01
clickbench_q32/duckdb:parquet 1191466465 1140561170 1.04
clickbench_q33/duckdb:parquet 1249446359 1255810756 0.99
clickbench_q34/duckdb:parquet 1303037529 1274439748 1.02
clickbench_q35/duckdb:parquet 355126899 352256082 1.01
clickbench_q36/duckdb:parquet 65926597 62658998 1.05
clickbench_q37/duckdb:parquet 53537965 53894066 0.99
clickbench_q38/duckdb:parquet 59145614 57674969 1.03
clickbench_q39/duckdb:parquet 97390367 96722954 1.01
clickbench_q40/duckdb:parquet 54859176 56097778 0.98
clickbench_q41/duckdb:parquet 58863551 59169598 0.99
clickbench_q42/duckdb:parquet 53832568 50229958 1.07
duckdb / duckdb (1.009x ➖, 0↑ 0↓)
name PR d2668cf (ns) base 8efe1dc (ns) ratio (PR/base)
clickbench_q00/duckdb:duckdb 17465755 17835014 0.98
clickbench_q01/duckdb:duckdb 32736400 33222922 0.99
clickbench_q02/duckdb:duckdb 45772106 45069168 1.02
clickbench_q03/duckdb:duckdb 46942458 46896841 1.00
clickbench_q04/duckdb:duckdb 232575665 219638609 1.06
clickbench_q05/duckdb:duckdb 327473888 338302294 0.97
clickbench_q06/duckdb:duckdb 35661825 35253186 1.01
clickbench_q07/duckdb:duckdb 35727534 35242887 1.01
clickbench_q08/duckdb:duckdb 321444078 341683459 0.94
clickbench_q09/duckdb:duckdb 488696541 510258723 0.96
clickbench_q10/duckdb:duckdb 103758719 96853141 1.07
clickbench_q11/duckdb:duckdb 114228177 106072378 1.08
clickbench_q12/duckdb:duckdb 320429427 325529568 0.98
clickbench_q13/duckdb:duckdb 552383196 556269888 0.99
clickbench_q14/duckdb:duckdb 366257367 364658755 1.00
clickbench_q15/duckdb:duckdb 275195913 271090749 1.02
clickbench_q16/duckdb:duckdb 707762921 692683488 1.02
clickbench_q17/duckdb:duckdb 593420728 578484508 1.03
clickbench_q18/duckdb:duckdb 1287854579 1257487949 1.02
clickbench_q19/duckdb:duckdb 34590108 33829456 1.02
clickbench_q20/duckdb:duckdb 995930195 958010011 1.04
clickbench_q21/duckdb:duckdb 1010259703 1107431625 0.91
clickbench_q22/duckdb:duckdb 1065349496 1139465362 0.93
clickbench_q23/duckdb:duckdb 254604240 244247284 1.04
clickbench_q24/duckdb:duckdb 61835582 61112167 1.01
clickbench_q25/duckdb:duckdb 125069692 124458603 1.00
clickbench_q26/duckdb:duckdb 51598996 53711042 0.96
clickbench_q27/duckdb:duckdb 1043156512 1039339909 1.00
clickbench_q28/duckdb:duckdb 4713957781 4645432661 1.01
clickbench_q29/duckdb:duckdb 48228268 48061313 1.00
clickbench_q30/duckdb:duckdb 295977752 290462284 1.02
clickbench_q31/duckdb:duckdb 425143468 413553978 1.03
clickbench_q32/duckdb:duckdb 1479746050 1466788123 1.01
clickbench_q33/duckdb:duckdb 2010204893 1909006417 1.05
clickbench_q34/duckdb:duckdb 2117905667 2009509824 1.05
clickbench_q35/duckdb:duckdb 266857942 264129985 1.01
clickbench_q36/duckdb:duckdb 41516283 40823412 1.02
clickbench_q37/duckdb:duckdb 31482248 31321298 1.01
clickbench_q38/duckdb:duckdb 32877816 30303438 1.08
clickbench_q39/duckdb:duckdb 66189695 65565523 1.01
clickbench_q40/duckdb:duckdb 31581255 31178649 1.01
clickbench_q41/duckdb:duckdb 31133382 30266965 1.03
clickbench_q42/duckdb:duckdb 31536688 31409082 1.00
Full attributed analysis
Query Config Raw Δ Control Δ Attributed α Noise floor Significant?
0 datafusion:vortex-file-compressed +35.5% +9.2% +24.1% +625.6% ➖ noise
0 duckdb:duckdb -2.1% +9.2% -10.3% +305.7% ➖ noise
0 duckdb:vortex-file-compressed +7.1% +9.2% -1.9% +357.2% ➖ noise
1 datafusion:vortex-file-compressed +13.6% -0.8% +14.5% +40.9% ➖ noise
1 duckdb:duckdb -1.5% -0.8% -0.7% +54.9% ➖ noise
1 duckdb:vortex-file-compressed +2.3% -0.8% +3.2% +17.0% ➖ noise
2 datafusion:vortex-file-compressed +21.9% -1.1% +23.2% +33.0% ➖ noise
2 duckdb:duckdb +1.6% -1.1% +2.7% +23.2% ➖ noise
2 duckdb:vortex-file-compressed +4.7% -1.1% +5.8% +15.2% ➖ noise
3 datafusion:vortex-file-compressed +19.5% -0.6% +20.3% +154.8% ➖ noise
3 duckdb:duckdb +0.1% -0.6% +0.7% +55.6% ➖ noise
3 duckdb:vortex-file-compressed +2.7% -0.6% +3.4% +33.4% ➖ noise
4 datafusion:vortex-file-compressed +4.3% +2.2% +2.1% +14.4% ➖ noise
4 duckdb:duckdb +5.9% +2.2% +3.7% +10.0% ➖ noise
4 duckdb:vortex-file-compressed +1.4% +2.2% -0.7% +10.0% ➖ noise
5 datafusion:vortex-file-compressed +27.7% +4.0% +22.8% +10.0% 🚨 regression
5 duckdb:duckdb -3.2% +4.0% -6.9% +10.0% ➖ noise
5 duckdb:vortex-file-compressed +3.0% +4.0% -0.9% +10.0% ➖ noise
6 datafusion:vortex-file-compressed +33.1% +0.5% +32.4% +39.7% ➖ noise
6 duckdb:duckdb +1.2% +0.5% +0.6% +29.8% ➖ noise
6 duckdb:vortex-file-compressed +5.0% +0.5% +4.4% +20.5% ➖ noise
7 datafusion:vortex-file-compressed +24.3% -0.3% +24.7% +13.7% 🚨 regression
7 duckdb:duckdb +1.4% -0.3% +1.7% +10.8% ➖ noise
7 duckdb:vortex-file-compressed +10.5% -0.3% +10.8% +10.0% 🚨 regression
8 datafusion:vortex-file-compressed +23.5% +1.0% +22.3% +10.0% 🚨 regression
8 duckdb:duckdb -5.9% +1.0% -6.8% +10.0% ➖ noise
8 duckdb:vortex-file-compressed +3.3% +1.0% +2.3% +10.0% ➖ noise
9 datafusion:vortex-file-compressed +6.7% +0.8% +5.9% +10.0% ➖ noise
9 duckdb:duckdb -4.2% +0.8% -5.0% +10.0% ➖ noise
9 duckdb:vortex-file-compressed +4.3% +0.8% +3.5% +10.0% ➖ noise
10 datafusion:vortex-file-compressed -1.3% +1.0% -2.3% +10.0% ➖ noise
10 duckdb:duckdb +7.1% +1.0% +6.0% +10.0% ➖ noise
10 duckdb:vortex-file-compressed +1.8% +1.0% +0.7% +10.0% ➖ noise
11 datafusion:vortex-file-compressed +2.5% +1.3% +1.1% +10.0% ➖ noise
11 duckdb:duckdb +7.7% +1.3% +6.3% +10.0% ➖ noise
11 duckdb:vortex-file-compressed +3.4% +1.3% +2.0% +10.0% ➖ noise
12 datafusion:vortex-file-compressed +0.8% +0.7% +0.2% +10.0% ➖ noise
12 duckdb:duckdb -1.6% +0.7% -2.2% +11.0% ➖ noise
12 duckdb:vortex-file-compressed +2.3% +0.7% +1.6% +10.0% ➖ noise
13 datafusion:vortex-file-compressed +3.5% -0.1% +3.7% +10.0% ➖ noise
13 duckdb:duckdb -0.7% -0.1% -0.6% +10.0% ➖ noise
13 duckdb:vortex-file-compressed +3.0% -0.1% +3.2% +10.0% ➖ noise
14 datafusion:vortex-file-compressed +0.8% +1.6% -0.8% +10.0% ➖ noise
14 duckdb:duckdb +0.4% +1.6% -1.2% +10.0% ➖ noise
14 duckdb:vortex-file-compressed +3.2% +1.6% +1.5% +10.0% ➖ noise
15 datafusion:vortex-file-compressed +2.6% +2.1% +0.6% +10.0% ➖ noise
15 duckdb:duckdb +1.5% +2.1% -0.5% +10.0% ➖ noise
15 duckdb:vortex-file-compressed +1.7% +2.1% -0.3% +10.0% ➖ noise
16 datafusion:vortex-file-compressed +2.4% +2.5% -0.1% +10.0% ➖ noise
16 duckdb:duckdb +2.2% +2.5% -0.3% +10.0% ➖ noise
16 duckdb:vortex-file-compressed +3.2% +2.5% +0.8% +17.1% ➖ noise
17 datafusion:vortex-file-compressed +3.2% +2.1% +1.0% +10.0% ➖ noise
17 duckdb:duckdb +2.6% +2.1% +0.4% +10.0% ➖ noise
17 duckdb:vortex-file-compressed -4.3% +2.1% -6.3% +15.9% ➖ noise
18 datafusion:vortex-file-compressed +6.9% +0.6% +6.3% +10.0% ➖ noise
18 duckdb:duckdb +2.4% +0.6% +1.8% +10.0% ➖ noise
18 duckdb:vortex-file-compressed -0.9% +0.6% -1.5% +11.9% ➖ noise
19 datafusion:vortex-file-compressed -0.0% +4.5% -4.4% +12.1% ➖ noise
19 duckdb:duckdb +2.2% +4.5% -2.2% +11.8% ➖ noise
19 duckdb:vortex-file-compressed -1.1% +4.5% -5.4% +29.7% ➖ noise
20 datafusion:vortex-file-compressed +4.1% +3.1% +1.0% +185.2% ➖ noise
20 duckdb:duckdb +4.0% +3.1% +0.8% +23.6% ➖ noise
20 duckdb:vortex-file-compressed -6.9% +3.1% -9.7% +10.0% ✅ faster
21 datafusion:vortex-file-compressed +1.9% +0.5% +1.4% +10.0% ➖ noise
21 duckdb:duckdb -8.8% +0.5% -9.3% +11.3% ➖ noise
21 duckdb:vortex-file-compressed +2.9% +0.5% +2.3% +10.0% ➖ noise
22 datafusion:vortex-file-compressed +4.9% +1.3% +3.6% +10.0% ➖ noise
22 duckdb:duckdb -6.5% +1.3% -7.7% +13.9% ➖ noise
22 duckdb:vortex-file-compressed -13.9% +1.3% -15.0% +12.7% ✅ faster
23 datafusion:vortex-file-compressed +2.4% -1.0% +3.3% +56.0% ➖ noise
23 duckdb:duckdb +4.2% -1.0% +5.2% +10.0% ➖ noise
23 duckdb:vortex-file-compressed -20.9% -1.0% -20.2% +10.0% ✅ faster
24 datafusion:vortex-file-compressed -4.0% -3.1% -0.9% +21.6% ➖ noise
24 duckdb:duckdb +1.2% -3.1% +4.5% +10.0% ➖ noise
24 duckdb:vortex-file-compressed -0.3% -3.1% +2.9% +29.4% ➖ noise
25 datafusion:vortex-file-compressed -3.5% +0.4% -3.9% +20.0% ➖ noise
25 duckdb:duckdb +0.5% +0.4% +0.1% +10.0% ➖ noise
25 duckdb:vortex-file-compressed -4.0% +0.4% -4.4% +14.8% ➖ noise
26 datafusion:vortex-file-compressed +2.2% +0.5% +1.8% +10.0% ➖ noise
26 duckdb:duckdb -3.9% +0.5% -4.4% +13.2% ➖ noise
26 duckdb:vortex-file-compressed -9.7% +0.5% -10.1% +29.7% ➖ noise
27 datafusion:vortex-file-compressed +1.5% +2.3% -0.7% +10.0% ➖ noise
27 duckdb:duckdb +0.4% +2.3% -1.8% +10.0% ➖ noise
27 duckdb:vortex-file-compressed +6.4% +2.3% +4.1% +10.0% ➖ noise
28 datafusion:vortex-file-compressed +0.2% +0.9% -0.7% +10.0% ➖ noise
28 duckdb:duckdb +1.5% +0.9% +0.6% +10.0% ➖ noise
28 duckdb:vortex-file-compressed +0.2% +0.9% -0.7% +10.0% ➖ noise
29 datafusion:vortex-file-compressed -1.8% +2.7% -4.4% +11.8% ➖ noise
29 duckdb:duckdb +0.3% +2.7% -2.2% +10.0% ➖ noise
29 duckdb:vortex-file-compressed +3.4% +2.7% +0.7% +14.9% ➖ noise
30 datafusion:vortex-file-compressed +1.7% +0.2% +1.5% +10.0% ➖ noise
30 duckdb:duckdb +1.9% +0.2% +1.7% +10.0% ➖ noise
30 duckdb:vortex-file-compressed +0.2% +0.2% -0.0% +10.0% ➖ noise
31 datafusion:vortex-file-compressed +2.1% +1.6% +0.5% +10.0% ➖ noise
31 duckdb:duckdb +2.8% +1.6% +1.2% +10.0% ➖ noise
31 duckdb:vortex-file-compressed +1.8% +1.6% +0.2% +10.0% ➖ noise
32 datafusion:vortex-file-compressed +10.7% +7.8% +2.7% +19.5% ➖ noise
32 duckdb:duckdb +0.9% +7.8% -6.4% +10.0% ➖ noise
32 duckdb:vortex-file-compressed +3.6% +7.8% -3.9% +10.0% ➖ noise
33 datafusion:vortex-file-compressed -0.6% +0.8% -1.3% +13.7% ➖ noise
33 duckdb:duckdb +5.3% +0.8% +4.5% +10.0% ➖ noise
33 duckdb:vortex-file-compressed -10.8% +0.8% -11.5% +10.0% ✅ faster
34 datafusion:vortex-file-compressed -1.3% +2.8% -4.0% +10.0% ➖ noise
34 duckdb:duckdb +5.4% +2.8% +2.5% +10.0% ➖ noise
34 duckdb:vortex-file-compressed -6.2% +2.8% -8.8% +10.0% ➖ noise
35 datafusion:vortex-file-compressed +0.6% +4.2% -3.5% +10.0% ➖ noise
35 duckdb:duckdb +1.0% +4.2% -3.1% +10.0% ➖ noise
35 duckdb:vortex-file-compressed +1.7% +4.2% -2.4% +10.0% ➖ noise
36 datafusion:vortex-file-compressed +2.9% +10.0% -6.4% +10.0% ➖ noise
36 duckdb:duckdb +1.7% +10.0% -7.5% +11.4% ➖ noise
36 duckdb:vortex-file-compressed +11.2% +10.0% +1.1% +10.0% ➖ noise
37 datafusion:vortex-file-compressed +5.9% +1.8% +4.1% +10.0% ➖ noise
37 duckdb:duckdb +0.5% +1.8% -1.2% +10.0% ➖ noise
37 duckdb:vortex-file-compressed +26.0% +1.8% +23.8% +10.0% 🚨 regression
38 datafusion:vortex-file-compressed +6.5% +8.5% -1.8% +10.4% ➖ noise
38 duckdb:duckdb +8.5% +8.5% -0.0% +11.9% ➖ noise
38 duckdb:vortex-file-compressed +6.3% +8.5% -2.0% +10.0% ➖ noise
39 datafusion:vortex-file-compressed +2.0% +12.1% -9.0% +10.0% ➖ noise
39 duckdb:duckdb +1.0% +12.1% -9.9% +18.7% ➖ noise
39 duckdb:vortex-file-compressed +4.7% +12.1% -6.6% +10.0% ➖ noise
40 datafusion:vortex-file-compressed +2.0% +9.7% -7.0% +10.0% ➖ noise
40 duckdb:duckdb +1.3% +9.7% -7.6% +10.0% ➖ noise
40 duckdb:vortex-file-compressed +9.9% +9.7% +0.2% +10.0% ➖ noise
41 datafusion:vortex-file-compressed +1.8% +10.0% -7.4% +10.0% ➖ noise
41 duckdb:duckdb +2.9% +10.0% -6.5% +10.0% ➖ noise
41 duckdb:vortex-file-compressed +17.0% +10.0% +6.4% +10.0% ➖ noise
42 datafusion:vortex-file-compressed +2.3% +13.3% -9.6% +10.0% ✅ faster
42 duckdb:duckdb +0.4% +13.3% -11.4% +10.0% ✅ faster
42 duckdb:vortex-file-compressed +12.1% +13.3% -1.0% +13.2% ➖ noise

@github-actions
Copy link
Contributor

Benchmarks: TPC-H SF=10 on S3

Verdict: No clear signal (environment too noisy confidence)
Attributed Vortex impact: -3.0%
Vortex (geomean): 0.996x ➖
Parquet (geomean): 1.027x ➖
Shifts: Parquet (control) +2.7% · Median polish -1.9%


datafusion / vortex-file-compressed (1.019x ➖, 0↑ 0↓)
name PR d2668cf (ns) base 8efe1dc (ns) ratio (PR/base)
tpch_q01/datafusion:vortex-file-compressed 733686467 764285106 0.96
tpch_q02/datafusion:vortex-file-compressed 747164273 783424605 0.95
tpch_q03/datafusion:vortex-file-compressed 825943977 758194183 1.09
tpch_q04/datafusion:vortex-file-compressed 733195187 573126768 1.28
tpch_q05/datafusion:vortex-file-compressed 1167143441 1016718415 1.15
tpch_q06/datafusion:vortex-file-compressed 649956614 611177633 1.06
tpch_q07/datafusion:vortex-file-compressed 1292474171 1132699752 1.14
tpch_q08/datafusion:vortex-file-compressed 1438302430 1358743244 1.06
tpch_q09/datafusion:vortex-file-compressed 1453906830 1520818513 0.96
tpch_q10/datafusion:vortex-file-compressed 1055558491 1162272543 0.91
tpch_q11/datafusion:vortex-file-compressed 592446042 641802494 0.92
tpch_q12/datafusion:vortex-file-compressed 1085314807 1015472319 1.07
tpch_q13/datafusion:vortex-file-compressed 482712958 453388092 1.06
tpch_q14/datafusion:vortex-file-compressed 634196067 575988037 1.10
tpch_q15/datafusion:vortex-file-compressed 1149343423 1093174387 1.05
tpch_q16/datafusion:vortex-file-compressed 393413294 407191552 0.97
tpch_q17/datafusion:vortex-file-compressed 1222853253 1175325208 1.04
tpch_q18/datafusion:vortex-file-compressed 1360530454 1382688303 0.98
tpch_q19/datafusion:vortex-file-compressed 774584609 775287812 1.00
tpch_q20/datafusion:vortex-file-compressed 1048580255 1205118088 0.87
tpch_q21/datafusion:vortex-file-compressed 1826203944 1799316059 1.01
tpch_q22/datafusion:vortex-file-compressed 425803453 489494079 0.87
datafusion / vortex-compact (0.997x ➖, 1↑ 3↓)
name PR d2668cf (ns) base 8efe1dc (ns) ratio (PR/base)
tpch_q01/datafusion:vortex-compact 801037563 737092169 1.09
tpch_q02/datafusion:vortex-compact 973295267 778780690 1.25
tpch_q03/datafusion:vortex-compact 867497017 876167534 0.99
tpch_q04/datafusion:vortex-compact 521982637 641418999 0.81
tpch_q05/datafusion:vortex-compact 1014084279 953115571 1.06
tpch_q06/datafusion:vortex-compact 🚀 609889215 909001498 0.67
tpch_q07/datafusion:vortex-compact 1160439215 1644143481 0.71
tpch_q08/datafusion:vortex-compact 1340886854 1816360176 0.74
tpch_q09/datafusion:vortex-compact 1419283770 1598659661 0.89
tpch_q10/datafusion:vortex-compact 1145255933 1272967499 0.90
tpch_q11/datafusion:vortex-compact 508932838 539401534 0.94
tpch_q12/datafusion:vortex-compact 894479673 906838912 0.99
tpch_q13/datafusion:vortex-compact 454241741 409459825 1.11
tpch_q14/datafusion:vortex-compact 670641222 699000437 0.96
tpch_q15/datafusion:vortex-compact 1061322890 1088977765 0.97
tpch_q16/datafusion:vortex-compact 383743120 380710937 1.01
tpch_q17/datafusion:vortex-compact 1255800052 1210264045 1.04
tpch_q18/datafusion:vortex-compact 1246211113 1218708961 1.02
tpch_q19/datafusion:vortex-compact 🚨 1097475203 628653291 1.75
tpch_q20/datafusion:vortex-compact 🚨 1278849192 893038023 1.43
tpch_q21/datafusion:vortex-compact 🚨 2050302343 1492523618 1.37
tpch_q22/datafusion:vortex-compact 459245958 559744420 0.82
datafusion / parquet (0.954x ➖, 0↑ 1↓)
name PR d2668cf (ns) base 8efe1dc (ns) ratio (PR/base)
tpch_q01/datafusion:parquet 901113506 910306632 0.99
tpch_q02/datafusion:parquet 🚨 1398904421 894634894 1.56
tpch_q03/datafusion:parquet 979238027 1035717297 0.95
tpch_q04/datafusion:parquet 575044159 497988008 1.15
tpch_q05/datafusion:parquet 1399685918 1416552120 0.99
tpch_q06/datafusion:parquet 666459936 568406970 1.17
tpch_q07/datafusion:parquet 1465315099 1594331258 0.92
tpch_q08/datafusion:parquet 1674500380 2196933888 0.76
tpch_q09/datafusion:parquet 1967231082 1884210925 1.04
tpch_q10/datafusion:parquet 2113888877 2277318885 0.93
tpch_q11/datafusion:parquet 568087230 773472204 0.73
tpch_q12/datafusion:parquet 766520217 780721202 0.98
tpch_q13/datafusion:parquet 778367463 790843061 0.98
tpch_q14/datafusion:parquet 817469052 929688204 0.88
tpch_q15/datafusion:parquet 1233703713 1419175572 0.87
tpch_q16/datafusion:parquet 440305670 572203811 0.77
tpch_q17/datafusion:parquet 1587929913 1592948277 1.00
tpch_q18/datafusion:parquet 1664530066 1828278685 0.91
tpch_q19/datafusion:parquet 1111595514 1012735392 1.10
tpch_q20/datafusion:parquet 1292892636 1378775890 0.94
tpch_q21/datafusion:parquet 1745384283 2001843835 0.87
tpch_q22/datafusion:parquet 654073839 838358956 0.78
duckdb / vortex-file-compressed (0.994x ➖, 0↑ 0↓)
name PR d2668cf (ns) base 8efe1dc (ns) ratio (PR/base)
tpch_q01/duckdb:vortex-file-compressed 643643998 680958976 0.95
tpch_q02/duckdb:vortex-file-compressed 1264820280 1186799904 1.07
tpch_q03/duckdb:vortex-file-compressed 863480737 897951726 0.96
tpch_q04/duckdb:vortex-file-compressed 664118735 725297373 0.92
tpch_q05/duckdb:vortex-file-compressed 1153065402 1129571072 1.02
tpch_q06/duckdb:vortex-file-compressed 896395736 878232472 1.02
tpch_q07/duckdb:vortex-file-compressed 1130798562 1297459851 0.87
tpch_q08/duckdb:vortex-file-compressed 1498751211 1509014599 0.99
tpch_q09/duckdb:vortex-file-compressed 1660753378 1536225282 1.08
tpch_q10/duckdb:vortex-file-compressed 1153446546 1219078335 0.95
tpch_q11/duckdb:vortex-file-compressed 740580988 664315318 1.11
tpch_q12/duckdb:vortex-file-compressed 774868974 827452152 0.94
tpch_q13/duckdb:vortex-file-compressed 1068868477 963829787 1.11
tpch_q14/duckdb:vortex-file-compressed 806201222 854723250 0.94
tpch_q15/duckdb:vortex-file-compressed 586932137 582737474 1.01
tpch_q16/duckdb:vortex-file-compressed 456098021 416705084 1.09
tpch_q17/duckdb:vortex-file-compressed 1046837387 1025636391 1.02
tpch_q18/duckdb:vortex-file-compressed 870955493 965001137 0.90
tpch_q19/duckdb:vortex-file-compressed 822247604 777729475 1.06
tpch_q20/duckdb:vortex-file-compressed 1305219297 1346389101 0.97
tpch_q21/duckdb:vortex-file-compressed 1889316684 2073926962 0.91
tpch_q22/duckdb:vortex-file-compressed 732475375 704382223 1.04
duckdb / vortex-compact (0.973x ➖, 0↑ 0↓)
name PR d2668cf (ns) base 8efe1dc (ns) ratio (PR/base)
tpch_q01/duckdb:vortex-compact 659936991 696992813 0.95
tpch_q02/duckdb:vortex-compact 1241297187 999242597 1.24
tpch_q03/duckdb:vortex-compact 858554465 987625258 0.87
tpch_q04/duckdb:vortex-compact 504287282 561280977 0.90
tpch_q05/duckdb:vortex-compact 1183184278 1114741611 1.06
tpch_q06/duckdb:vortex-compact 702005585 705781260 0.99
tpch_q07/duckdb:vortex-compact 908948425 1148402136 0.79
tpch_q08/duckdb:vortex-compact 1477403290 1360453633 1.09
tpch_q09/duckdb:vortex-compact 1319826182 1379653390 0.96
tpch_q10/duckdb:vortex-compact 997177583 1087932619 0.92
tpch_q11/duckdb:vortex-compact 751328901 788642777 0.95
tpch_q12/duckdb:vortex-compact 708973406 658518942 1.08
tpch_q13/duckdb:vortex-compact 886624738 930350050 0.95
tpch_q14/duckdb:vortex-compact 829354153 909934538 0.91
tpch_q15/duckdb:vortex-compact 679436911 545851553 1.24
tpch_q16/duckdb:vortex-compact 391027416 347983204 1.12
tpch_q17/duckdb:vortex-compact 876649765 933679533 0.94
tpch_q18/duckdb:vortex-compact 767870496 740560939 1.04
tpch_q19/duckdb:vortex-compact 726525860 759911814 0.96
tpch_q20/duckdb:vortex-compact 1170195352 1516127536 0.77
tpch_q21/duckdb:vortex-compact 1650706880 1812033180 0.91
tpch_q22/duckdb:vortex-compact 605434587 660161774 0.92
duckdb / parquet (1.105x ➖, 0↑ 2↓)
name PR d2668cf (ns) base 8efe1dc (ns) ratio (PR/base)
tpch_q01/duckdb:parquet 1198335431 926112497 1.29
tpch_q02/duckdb:parquet 🚨 1835826462 1406688530 1.31
tpch_q03/duckdb:parquet 1751834668 1888318201 0.93
tpch_q04/duckdb:parquet 1203731199 1308552460 0.92
tpch_q05/duckdb:parquet 2483672476 2246575076 1.11
tpch_q06/duckdb:parquet 979399071 844644732 1.16
tpch_q07/duckdb:parquet 2280635049 2152569105 1.06
tpch_q08/duckdb:parquet 2567641207 2661559224 0.96
tpch_q09/duckdb:parquet 2803941187 2310017326 1.21
tpch_q10/duckdb:parquet 3986975222 3085913042 1.29
tpch_q11/duckdb:parquet 1071270228 924964496 1.16
tpch_q12/duckdb:parquet 1087398891 1078974314 1.01
tpch_q13/duckdb:parquet 🚨 1520017273 1150007669 1.32
tpch_q14/duckdb:parquet 1321341498 1415437929 0.93
tpch_q15/duckdb:parquet 981459297 1049993136 0.93
tpch_q16/duckdb:parquet 964891829 786781833 1.23
tpch_q17/duckdb:parquet 1220174194 1307782766 0.93
tpch_q18/duckdb:parquet 1631598712 1475350530 1.11
tpch_q19/duckdb:parquet 1739288166 1627033138 1.07
tpch_q20/duckdb:parquet 2132203237 1646406990 1.30
tpch_q21/duckdb:parquet 2135090305 1799614266 1.19
tpch_q22/duckdb:parquet 1067212637 984555830 1.08
Full attributed analysis
Query Config Raw Δ Control Δ Attributed α Noise floor Significant?
1 datafusion:vortex-compact +8.7% +13.2% -4.0% +58.7% ➖ noise
1 datafusion:vortex-file-compressed -4.0% +13.2% -15.2% +85.0% ➖ noise
1 duckdb:vortex-compact -5.3% +13.2% -16.3% +64.9% ➖ noise
1 duckdb:vortex-file-compressed -5.5% +13.2% -16.5% +34.2% ➖ noise
2 datafusion:vortex-compact +25.0% +42.9% -12.5% +48.9% ➖ noise
2 datafusion:vortex-file-compressed -4.6% +42.9% -33.2% +62.3% ➖ noise
2 duckdb:vortex-compact +24.2% +42.9% -13.0% +34.2% ➖ noise
2 duckdb:vortex-file-compressed +6.6% +42.9% -25.4% +48.9% ➖ noise
3 datafusion:vortex-compact -1.0% -6.3% +5.7% +68.1% ➖ noise
3 datafusion:vortex-file-compressed +8.9% -6.3% +16.3% +92.1% ➖ noise
3 duckdb:vortex-compact -13.1% -6.3% -7.2% +58.2% ➖ noise
3 duckdb:vortex-file-compressed -3.8% -6.3% +2.7% +54.4% ➖ noise
4 datafusion:vortex-compact -18.6% +3.1% -21.0% +44.4% ➖ noise
4 datafusion:vortex-file-compressed +27.9% +3.1% +24.1% +34.5% ➖ noise
4 duckdb:vortex-compact -10.2% +3.1% -12.8% +43.6% ➖ noise
4 duckdb:vortex-file-compressed -8.4% +3.1% -11.2% +48.3% ➖ noise
5 datafusion:vortex-compact +6.4% +4.5% +1.8% +34.2% ➖ noise
5 datafusion:vortex-file-compressed +14.8% +4.5% +9.8% +34.2% ➖ noise
5 duckdb:vortex-compact +6.1% +4.5% +1.6% +34.2% ➖ noise
5 duckdb:vortex-file-compressed +2.1% +4.5% -2.3% +34.2% ➖ noise
6 datafusion:vortex-compact -32.9% +16.6% -42.5% +64.7% ✅ faster
6 datafusion:vortex-file-compressed +6.3% +16.6% -8.8% +41.0% ➖ noise
6 duckdb:vortex-compact -0.5% +16.6% -14.7% +51.6% ➖ noise
6 duckdb:vortex-file-compressed +2.1% +16.6% -12.5% +43.8% ➖ noise
7 datafusion:vortex-compact -29.4% -1.3% -28.5% +34.2% ✅ faster
7 datafusion:vortex-file-compressed +14.1% -1.3% +15.6% +34.2% ➖ noise
7 duckdb:vortex-compact -20.9% -1.3% -19.8% +34.2% ➖ noise
7 duckdb:vortex-file-compressed -12.8% -1.3% -11.7% +34.2% ➖ noise
8 datafusion:vortex-compact -26.2% -14.3% -13.9% +34.7% ➖ noise
8 datafusion:vortex-file-compressed +5.9% -14.3% +23.4% +34.2% ➖ noise
8 duckdb:vortex-compact +8.6% -14.3% +26.6% +34.2% ➖ noise
8 duckdb:vortex-file-compressed -0.7% -14.3% +15.8% +34.2% ➖ noise
9 datafusion:vortex-compact -11.2% +12.6% -21.1% +34.2% ➖ noise
9 datafusion:vortex-file-compressed -4.4% +12.6% -15.1% +34.2% ➖ noise
9 duckdb:vortex-compact -4.3% +12.6% -15.0% +34.2% ➖ noise
9 duckdb:vortex-file-compressed +8.1% +12.6% -4.0% +34.2% ➖ noise
10 datafusion:vortex-compact -10.0% +9.5% -17.8% +41.6% ➖ noise
10 datafusion:vortex-file-compressed -9.2% +9.5% -17.1% +36.3% ➖ noise
10 duckdb:vortex-compact -8.3% +9.5% -16.3% +35.8% ➖ noise
10 duckdb:vortex-file-compressed -5.4% +9.5% -13.6% +34.6% ➖ noise
11 datafusion:vortex-compact -5.6% -7.8% +2.3% +34.2% ➖ noise
11 datafusion:vortex-file-compressed -7.7% -7.8% +0.1% +34.2% ➖ noise
11 duckdb:vortex-compact -4.7% -7.8% +3.3% +34.2% ➖ noise
11 duckdb:vortex-file-compressed +11.5% -7.8% +20.9% +35.9% ➖ noise
12 datafusion:vortex-compact -1.4% -0.5% -0.8% +39.3% ➖ noise
12 datafusion:vortex-file-compressed +6.9% -0.5% +7.4% +34.2% ➖ noise
12 duckdb:vortex-compact +7.7% -0.5% +8.2% +42.3% ➖ noise
12 duckdb:vortex-file-compressed -6.4% -0.5% -5.9% +54.1% ➖ noise
13 datafusion:vortex-compact +10.9% +14.1% -2.7% +57.0% ➖ noise
13 datafusion:vortex-file-compressed +6.5% +14.1% -6.7% +47.6% ➖ noise
13 duckdb:vortex-compact -4.7% +14.1% -16.4% +79.2% ➖ noise
13 duckdb:vortex-file-compressed +10.9% +14.1% -2.8% +88.0% ➖ noise
14 datafusion:vortex-compact -4.1% -9.4% +5.9% +34.2% ➖ noise
14 datafusion:vortex-file-compressed +10.1% -9.4% +21.5% +34.2% ➖ noise
14 duckdb:vortex-compact -8.9% -9.4% +0.6% +34.2% ➖ noise
14 duckdb:vortex-file-compressed -5.7% -9.4% +4.1% +34.2% ➖ noise
15 datafusion:vortex-compact -2.5% -9.9% +8.1% +34.2% ➖ noise
15 datafusion:vortex-file-compressed +5.1% -9.9% +16.6% +34.2% ➖ noise
15 duckdb:vortex-compact +24.5% -9.9% +38.1% +34.2% 🚨 regression
15 duckdb:vortex-file-compressed +0.7% -9.9% +11.7% +34.2% ➖ noise
16 datafusion:vortex-compact +0.8% -2.9% +3.8% +55.4% ➖ noise
16 datafusion:vortex-file-compressed -3.4% -2.9% -0.5% +36.0% ➖ noise
16 duckdb:vortex-compact +12.4% -2.9% +15.7% +34.2% ➖ noise
16 duckdb:vortex-file-compressed +9.5% -2.9% +12.7% +36.9% ➖ noise
17 datafusion:vortex-compact +3.8% -3.6% +7.6% +34.2% ➖ noise
17 datafusion:vortex-file-compressed +4.0% -3.6% +7.9% +34.2% ➖ noise
17 duckdb:vortex-compact -6.1% -3.6% -2.6% +34.2% ➖ noise
17 duckdb:vortex-file-compressed +2.1% -3.6% +5.8% +34.2% ➖ noise
18 datafusion:vortex-compact +2.3% +0.3% +1.9% +34.2% ➖ noise
18 datafusion:vortex-file-compressed -1.6% +0.3% -1.9% +34.2% ➖ noise
18 duckdb:vortex-compact +3.7% +0.3% +3.3% +34.2% ➖ noise
18 duckdb:vortex-file-compressed -9.7% +0.3% -10.1% +34.2% ➖ noise
19 datafusion:vortex-compact +74.6% +8.3% +61.2% +39.9% 🚨 regression
19 datafusion:vortex-file-compressed -0.1% +8.3% -7.8% +34.2% ➖ noise
19 duckdb:vortex-compact -4.4% +8.3% -11.7% +34.2% ➖ noise
19 duckdb:vortex-file-compressed +5.7% +8.3% -2.4% +34.2% ➖ noise
20 datafusion:vortex-compact +43.2% +10.2% +29.9% +43.5% ➖ noise
20 datafusion:vortex-file-compressed -13.0% +10.2% -21.0% +34.2% ➖ noise
20 duckdb:vortex-compact -22.8% +10.2% -30.0% +34.2% ✅ faster
20 duckdb:vortex-file-compressed -3.1% +10.2% -12.0% +34.2% ➖ noise
21 datafusion:vortex-compact +37.4% +1.7% +35.1% +37.5% ➖ noise
21 datafusion:vortex-file-compressed +1.5% +1.7% -0.2% +34.2% ➖ noise
21 duckdb:vortex-compact -8.9% +1.7% -10.4% +34.2% ➖ noise
21 duckdb:vortex-file-compressed -8.9% +1.7% -10.4% +34.2% ➖ noise
22 datafusion:vortex-compact -18.0% -8.0% -10.8% +36.0% ➖ noise
22 datafusion:vortex-file-compressed -13.0% -8.0% -5.4% +34.2% ➖ noise
22 duckdb:vortex-compact -8.3% -8.0% -0.3% +34.2% ➖ noise
22 duckdb:vortex-file-compressed +4.0% -8.0% +13.1% +36.3% ➖ noise

@github-actions
Copy link
Contributor

Benchmarks: Compression

Vortex (geomean): 1.007x ➖
Parquet (geomean): 1.003x ➖


unknown / unknown (1.004x ➖, 0↑ 0↓)
name PR d2668cf (ns) base 8efe1dc (ns) ratio (PR/base)
compress time/Arade 1148338480 1111833187 1.03
compress time/Bimbo 7193112946 7195006811 1.00
compress time/CMSprovider 3032415457 2930090626 1.03
compress time/Euro2016 440337109 416165768 1.06
compress time/Food 394505497 389326561 1.01
compress time/HashTags 915486282 947243543 0.97
compress time/TPC-H l_comment canonical 1304874568 1269498736 1.03
compress time/TPC-H l_comment chunked 1343649700 1311460225 1.02
compress time/taxi 756502416 724112888 1.04
compress time/wide table cols=100 chunks=1 rows=1000 15378228 15066932 1.02
compress time/wide table cols=100 chunks=50 rows=1000 15886479 16004026 0.99
compress time/wide table cols=1000 chunks=1 rows=1000 153760994 154708228 0.99
compress time/wide table cols=1000 chunks=50 rows=1000 155671668 154250585 1.01
compress time/wide table cols=10000 chunks=1 rows=1000 1507280314 1539949243 0.98
compress time/wide table cols=10000 chunks=50 rows=1000 1530611081 1522414835 1.01
decompress time/Arade 32418419 31313918 1.04
decompress time/Bimbo 97273143 98497604 0.99
decompress time/CMSprovider 87431634 82836097 1.06
decompress time/Euro2016 22358480 21494626 1.04
decompress time/Food 8314934 9097660 0.91
decompress time/HashTags 80075350 77770934 1.03
decompress time/TPC-H l_comment canonical 42857347 40931538 1.05
decompress time/TPC-H l_comment chunked 42310873 41871949 1.01
decompress time/taxi 18732449 19258212 0.97
decompress time/wide table cols=100 chunks=1 rows=1000 2497050 2559469 0.98
decompress time/wide table cols=100 chunks=50 rows=1000 2435975 2505651 0.97
decompress time/wide table cols=1000 chunks=1 rows=1000 22508802 22546434 1.00
decompress time/wide table cols=1000 chunks=50 rows=1000 22488389 22315036 1.01
decompress time/wide table cols=10000 chunks=1 rows=1000 235135910 228791295 1.03
decompress time/wide table cols=10000 chunks=50 rows=1000 230161991 228496944 1.01
parquet size/Arade 305282152 305282152 1.00
parquet size/Bimbo 388935055 388935055 1.00
parquet size/CMSprovider 384634824 384634824 1.00
parquet size/Euro2016 123042700 123042700 1.00
parquet size/Food 36177631 36177631 1.00
parquet size/HashTags 133854962 133854962 1.00
parquet size/TPC-H l_comment canonical 158411391 158411391 1.00
parquet size/TPC-H l_comment chunked 158411391 158411391 1.00
parquet size/taxi 55879185 55879185 1.00
parquet size/wide table cols=100 chunks=1 rows=1000 932204 932204 1.00
parquet size/wide table cols=100 chunks=50 rows=1000 932204 932204 1.00
parquet size/wide table cols=1000 chunks=1 rows=1000 9322004 9322004 1.00
parquet size/wide table cols=1000 chunks=50 rows=1000 9322004 9322004 1.00
parquet size/wide table cols=10000 chunks=1 rows=1000 93220004 93220004 1.00
parquet size/wide table cols=10000 chunks=50 rows=1000 93220004 93220004 1.00
parquet_rs-zstd compress time/Arade 2481235380 2491364798 1.00
parquet_rs-zstd compress time/Bimbo 15678860167 15644508888 1.00
parquet_rs-zstd compress time/CMSprovider 7837206027 7772350774 1.01
parquet_rs-zstd compress time/Euro2016 1449361357 1446593133 1.00
parquet_rs-zstd compress time/Food 924101694 926550003 1.00
parquet_rs-zstd compress time/HashTags 2576376504 2508098294 1.03
parquet_rs-zstd compress time/TPC-H l_comment canonical 3163715014 3193990109 0.99
parquet_rs-zstd compress time/TPC-H l_comment chunked 3173682923 3179874483 1.00
parquet_rs-zstd compress time/taxi 1375926065 1378719525 1.00
parquet_rs-zstd compress time/wide table cols=100 chunks=1 rows=1000 6562747 6491906 1.01
parquet_rs-zstd compress time/wide table cols=100 chunks=50 rows=1000 6461935 6564381 0.98
parquet_rs-zstd compress time/wide table cols=1000 chunks=1 rows=1000 85147691 90282177 0.94
parquet_rs-zstd compress time/wide table cols=1000 chunks=50 rows=1000 85740137 88176268 0.97
parquet_rs-zstd compress time/wide table cols=10000 chunks=1 rows=1000 879957375 892389508 0.99
parquet_rs-zstd compress time/wide table cols=10000 chunks=50 rows=1000 848109991 902971839 0.94
parquet_rs-zstd decompress time/Arade 664192875 664199700 1.00
parquet_rs-zstd decompress time/Bimbo 2300907692 2253140392 1.02
parquet_rs-zstd decompress time/CMSprovider 2128481451 2114038591 1.01
parquet_rs-zstd decompress time/Euro2016 415337300 418618096 0.99
parquet_rs-zstd decompress time/Food 239304347 238804982 1.00
parquet_rs-zstd decompress time/HashTags 680203030 675354355 1.01
parquet_rs-zstd decompress time/TPC-H l_comment canonical 709099326 705555088 1.01
parquet_rs-zstd decompress time/TPC-H l_comment chunked 711795169 710155422 1.00
parquet_rs-zstd decompress time/taxi 285078138 290032926 0.98
parquet_rs-zstd decompress time/wide table cols=100 chunks=1 rows=1000 2580175 2535505 1.02
parquet_rs-zstd decompress time/wide table cols=100 chunks=50 rows=1000 2564072 2541463 1.01
parquet_rs-zstd decompress time/wide table cols=1000 chunks=1 rows=1000 28986963 29434394 0.98
parquet_rs-zstd decompress time/wide table cols=1000 chunks=50 rows=1000 28806074 29652059 0.97
parquet_rs-zstd decompress time/wide table cols=10000 chunks=1 rows=1000 335474250 342396771 0.98
parquet_rs-zstd decompress time/wide table cols=10000 chunks=50 rows=1000 336323154 337934660 1.00
vortex-file-compressed size/Arade 143320276 143320276 1.00
vortex-file-compressed size/Bimbo 526057964 526057964 1.00
vortex-file-compressed size/CMSprovider 448071556 448071556 1.00
vortex-file-compressed size/Euro2016 164653484 164656676 1.00
vortex-file-compressed size/Food 44159616 44159616 1.00
vortex-file-compressed size/HashTags 195365036 195365036 1.00
vortex-file-compressed size/TPC-H l_comment canonical 179476200 179476200 1.00
vortex-file-compressed size/TPC-H l_comment chunked 179476200 179476200 1.00
vortex-file-compressed size/taxi 51449348 51449348 1.00
vortex-file-compressed size/wide table cols=100 chunks=1 rows=1000 884384 884384 1.00
vortex-file-compressed size/wide table cols=100 chunks=50 rows=1000 884384 884384 1.00
vortex-file-compressed size/wide table cols=1000 chunks=1 rows=1000 8829584 8829584 1.00
vortex-file-compressed size/wide table cols=1000 chunks=50 rows=1000 8829584 8829584 1.00
vortex-file-compressed size/wide table cols=10000 chunks=1 rows=1000 88317584 88317584 1.00
vortex-file-compressed size/wide table cols=10000 chunks=50 rows=1000 88317584 88317584 1.00
vortex:parquet-zstd ratio compress time/Arade 0 0 1.04
vortex:parquet-zstd ratio compress time/Bimbo 0 0 1.00
vortex:parquet-zstd ratio compress time/CMSprovider 0 0 1.03
vortex:parquet-zstd ratio compress time/Euro2016 0 0 1.06
vortex:parquet-zstd ratio compress time/Food 0 0 1.02
vortex:parquet-zstd ratio compress time/HashTags 0 0 0.94
vortex:parquet-zstd ratio compress time/TPC-H l_comment canonical 0 0 1.04
vortex:parquet-zstd ratio compress time/TPC-H l_comment chunked 0 0 1.03
vortex:parquet-zstd ratio compress time/taxi 0 0 1.05
vortex:parquet-zstd ratio compress time/wide table cols=100 chunks=1 rows=1000 2 2 1.01
vortex:parquet-zstd ratio compress time/wide table cols=100 chunks=50 rows=1000 2 2 1.01
vortex:parquet-zstd ratio compress time/wide table cols=1000 chunks=1 rows=1000 1 1 1.05
vortex:parquet-zstd ratio compress time/wide table cols=1000 chunks=50 rows=1000 1 1 1.04
vortex:parquet-zstd ratio compress time/wide table cols=10000 chunks=1 rows=1000 1 1 0.99
vortex:parquet-zstd ratio compress time/wide table cols=10000 chunks=50 rows=1000 1 1 1.07
vortex:parquet-zstd ratio decompress time/Arade 0 0 1.04
vortex:parquet-zstd ratio decompress time/Bimbo 0 0 0.97
vortex:parquet-zstd ratio decompress time/CMSprovider 0 0 1.05
vortex:parquet-zstd ratio decompress time/Euro2016 0 0 1.05
vortex:parquet-zstd ratio decompress time/Food 0 0 0.91
vortex:parquet-zstd ratio decompress time/HashTags 0 0 1.02
vortex:parquet-zstd ratio decompress time/TPC-H l_comment canonical 0 0 1.04
vortex:parquet-zstd ratio decompress time/TPC-H l_comment chunked 0 0 1.01
vortex:parquet-zstd ratio decompress time/taxi 0 0 0.99
vortex:parquet-zstd ratio decompress time/wide table cols=100 chunks=1 rows=1000 0 1 0.96
vortex:parquet-zstd ratio decompress time/wide table cols=100 chunks=50 rows=1000 0 0 0.96
vortex:parquet-zstd ratio decompress time/wide table cols=1000 chunks=1 rows=1000 0 0 1.01
vortex:parquet-zstd ratio decompress time/wide table cols=1000 chunks=50 rows=1000 0 0 1.04
vortex:parquet-zstd ratio decompress time/wide table cols=10000 chunks=1 rows=1000 0 0 1.05
vortex:parquet-zstd ratio decompress time/wide table cols=10000 chunks=50 rows=1000 0 0 1.01
vortex:parquet-zstd size/Arade 0 0 1.00
vortex:parquet-zstd size/Bimbo 1 1 1.00
vortex:parquet-zstd size/CMSprovider 1 1 1.00
vortex:parquet-zstd size/Euro2016 1 1 1.00
vortex:parquet-zstd size/Food 1 1 1.00
vortex:parquet-zstd size/HashTags 1 1 1.00
vortex:parquet-zstd size/TPC-H l_comment canonical 1 1 1.00
vortex:parquet-zstd size/TPC-H l_comment chunked 1 1 1.00
vortex:parquet-zstd size/taxi 0 0 1.00
vortex:parquet-zstd size/wide table cols=100 chunks=1 rows=1000 0 0 1.00
vortex:parquet-zstd size/wide table cols=100 chunks=50 rows=1000 0 0 1.00
vortex:parquet-zstd size/wide table cols=1000 chunks=1 rows=1000 0 0 1.00
vortex:parquet-zstd size/wide table cols=1000 chunks=50 rows=1000 0 0 1.00
vortex:parquet-zstd size/wide table cols=10000 chunks=1 rows=1000 0 0 1.00
vortex:parquet-zstd size/wide table cols=10000 chunks=50 rows=1000 0 0 1.00

Signed-off-by: Joe Isaacs <joe.isaacs@live.co.uk>
Signed-off-by: Joe Isaacs <joe.isaacs@live.co.uk>
@joseph-isaacs joseph-isaacs marked this pull request as ready for review March 19, 2026 16:15
Signed-off-by: Joe Isaacs <joe.isaacs@live.co.uk>
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

changelog/performance A performance improvement

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant