| ================================================================================================ |
| parsing large select expressions |
| ================================================================================================ |
| |
| OpenJDK 64-Bit Server VM 17.0.16+8-LTS on Linux 6.11.0-1018-azure |
| AMD EPYC 7763 64-Core Processor |
| parsing large select: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative |
| ------------------------------------------------------------------------------------------------------------------------ |
| 1 select expressions 1 1 0 0.0 650133.0 1.0X |
| 100 select expressions 3 3 0 0.0 3239833.0 0.2X |
| 2500 select expressions 71 73 2 0.0 70970829.0 0.0X |
| |
| |
| ================================================================================================ |
| optimize large select expressions |
| ================================================================================================ |
| |
| OpenJDK 64-Bit Server VM 17.0.16+8-LTS on Linux 6.11.0-1018-azure |
| AMD EPYC 7763 64-Core Processor |
| optimize large select: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative |
| ------------------------------------------------------------------------------------------------------------------------ |
| 100 columns 3 4 1 0.0 3227010.0 1.0X |
| 1000 columns 18 20 2 0.0 18320597.0 0.2X |
| 10000 columns 182 198 18 0.0 182328011.0 0.0X |
| |
| |
| ================================================================================================ |
| many column field read and write |
| ================================================================================================ |
| |
| OpenJDK 64-Bit Server VM 17.0.16+8-LTS on Linux 6.11.0-1018-azure |
| AMD EPYC 7763 64-Core Processor |
| many column field r/w: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative |
| ------------------------------------------------------------------------------------------------------------------------ |
| 1 cols x 100000 rows (read in-mem) 18 24 3 5.5 180.9 1.0X |
| 1 cols x 100000 rows (exec in-mem) 17 22 3 5.9 170.1 1.1X |
| 1 cols x 100000 rows (read parquet) 31 37 5 3.3 306.0 0.6X |
| 1 cols x 100000 rows (write parquet) 93 100 6 1.1 926.7 0.2X |
| 100 cols x 1000 rows (read in-mem) 13 17 3 7.4 134.3 1.3X |
| 100 cols x 1000 rows (exec in-mem) 16 19 3 6.3 160.0 1.1X |
| 100 cols x 1000 rows (read parquet) 25 30 5 3.9 253.6 0.7X |
| 100 cols x 1000 rows (write parquet) 88 94 6 1.1 884.9 0.2X |
| 2500 cols x 40 rows (read in-mem) 49 51 6 2.0 489.9 0.4X |
| 2500 cols x 40 rows (exec in-mem) 75 82 11 1.3 747.3 0.2X |
| 2500 cols x 40 rows (read parquet) 284 292 9 0.4 2843.7 0.1X |
| 2500 cols x 40 rows (write parquet) 125 135 8 0.8 1248.2 0.1X |
| |
| |
| ================================================================================================ |
| wide shallowly nested struct field read and write |
| ================================================================================================ |
| |
| OpenJDK 64-Bit Server VM 17.0.16+8-LTS on Linux 6.11.0-1018-azure |
| AMD EPYC 7763 64-Core Processor |
| wide shallowly nested struct field r/w: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative |
| ------------------------------------------------------------------------------------------------------------------------ |
| 1 wide x 100000 rows (read in-mem) 21 27 5 4.8 209.3 1.0X |
| 1 wide x 100000 rows (exec in-mem) 23 27 3 4.3 232.4 0.9X |
| 1 wide x 100000 rows (read parquet) 24 29 6 4.2 235.5 0.9X |
| 1 wide x 100000 rows (write parquet) 96 104 7 1.0 956.0 0.2X |
| 100 wide x 1000 rows (read in-mem) 16 19 3 6.3 159.5 1.3X |
| 100 wide x 1000 rows (exec in-mem) 17 20 3 5.9 169.9 1.2X |
| 100 wide x 1000 rows (read parquet) 22 25 3 4.5 224.4 0.9X |
| 100 wide x 1000 rows (write parquet) 89 95 5 1.1 894.0 0.2X |
| 2500 wide x 40 rows (read in-mem) 22 24 3 4.6 216.2 1.0X |
| 2500 wide x 40 rows (exec in-mem) 23 26 4 4.4 229.5 0.9X |
| 2500 wide x 40 rows (read parquet) 66 69 4 1.5 661.6 0.3X |
| 2500 wide x 40 rows (write parquet) 96 103 8 1.0 964.4 0.2X |
| |
| |
| ================================================================================================ |
| deeply nested struct field read and write |
| ================================================================================================ |
| |
| OpenJDK 64-Bit Server VM 17.0.16+8-LTS on Linux 6.11.0-1018-azure |
| AMD EPYC 7763 64-Core Processor |
| deeply nested struct field r/w: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative |
| ------------------------------------------------------------------------------------------------------------------------ |
| 1 deep x 100000 rows (read in-mem) 16 19 4 6.1 163.9 1.0X |
| 1 deep x 100000 rows (exec in-mem) 18 22 4 5.5 182.9 0.9X |
| 1 deep x 100000 rows (read parquet) 19 22 4 5.4 185.2 0.9X |
| 1 deep x 100000 rows (write parquet) 89 95 7 1.1 889.2 0.2X |
| 100 deep x 1000 rows (read in-mem) 30 31 3 3.4 297.8 0.6X |
| 100 deep x 1000 rows (exec in-mem) 404 410 8 0.2 4042.1 0.0X |
| 100 deep x 1000 rows (read parquet) 418 434 23 0.2 4178.6 0.0X |
| 100 deep x 1000 rows (write parquet) 103 108 5 1.0 1025.2 0.2X |
| 250 deep x 400 rows (read in-mem) 105 110 5 1.0 1050.3 0.2X |
| 250 deep x 400 rows (exec in-mem) 2463 2480 23 0.0 24634.0 0.0X |
| 250 deep x 400 rows (read parquet) 2537 2539 2 0.0 25372.5 0.0X |
| 250 deep x 400 rows (write parquet) 177 182 4 0.6 1765.6 0.1X |
| |
| |
| ================================================================================================ |
| bushy struct field read and write |
| ================================================================================================ |
| |
| OpenJDK 64-Bit Server VM 17.0.16+8-LTS on Linux 6.11.0-1018-azure |
| AMD EPYC 7763 64-Core Processor |
| bushy struct field r/w: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative |
| ------------------------------------------------------------------------------------------------------------------------- |
| 1 x 1 deep x 100000 rows (read in-mem) 14 16 4 7.2 138.9 1.0X |
| 1 x 1 deep x 100000 rows (exec in-mem) 16 18 3 6.4 156.5 0.9X |
| 1 x 1 deep x 100000 rows (read parquet) 18 20 3 5.5 181.8 0.8X |
| 1 x 1 deep x 100000 rows (write parquet) 87 92 5 1.1 874.0 0.2X |
| 128 x 8 deep x 1000 rows (read in-mem) 13 15 3 7.6 132.4 1.0X |
| 128 x 8 deep x 1000 rows (exec in-mem) 15 16 3 6.8 147.2 0.9X |
| 128 x 8 deep x 1000 rows (read parquet) 21 23 4 4.9 205.7 0.7X |
| 128 x 8 deep x 1000 rows (write parquet) 85 89 4 1.2 854.3 0.2X |
| 1024 x 11 deep x 100 rows (read in-mem) 18 20 3 5.7 176.0 0.8X |
| 1024 x 11 deep x 100 rows (exec in-mem) 19 22 4 5.3 190.1 0.7X |
| 1024 x 11 deep x 100 rows (read parquet) 35 37 4 2.9 346.4 0.4X |
| 1024 x 11 deep x 100 rows (write parquet) 91 95 5 1.1 909.0 0.2X |
| |
| |
| ================================================================================================ |
| wide array field read and write |
| ================================================================================================ |
| |
| OpenJDK 64-Bit Server VM 17.0.16+8-LTS on Linux 6.11.0-1018-azure |
| AMD EPYC 7763 64-Core Processor |
| wide array field r/w: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative |
| ------------------------------------------------------------------------------------------------------------------------ |
| 1 wide x 100000 rows (read in-mem) 15 18 3 6.5 154.1 1.0X |
| 1 wide x 100000 rows (exec in-mem) 18 21 4 5.4 185.0 0.8X |
| 1 wide x 100000 rows (read parquet) 18 20 3 5.7 175.5 0.9X |
| 1 wide x 100000 rows (write parquet) 87 92 5 1.2 866.2 0.2X |
| 100 wide x 1000 rows (read in-mem) 12 13 3 8.6 116.8 1.3X |
| 100 wide x 1000 rows (exec in-mem) 13 15 3 7.5 133.2 1.2X |
| 100 wide x 1000 rows (read parquet) 17 20 3 5.9 169.6 0.9X |
| 100 wide x 1000 rows (write parquet) 85 88 4 1.2 851.1 0.2X |
| 2500 wide x 40 rows (read in-mem) 12 14 3 8.5 117.8 1.3X |
| 2500 wide x 40 rows (exec in-mem) 13 15 3 7.5 133.7 1.2X |
| 2500 wide x 40 rows (read parquet) 17 20 3 5.7 174.8 0.9X |
| 2500 wide x 40 rows (write parquet) 84 88 6 1.2 835.1 0.2X |
| |
| |
| ================================================================================================ |
| wide map field read and write |
| ================================================================================================ |
| |
| OpenJDK 64-Bit Server VM 17.0.16+8-LTS on Linux 6.11.0-1018-azure |
| AMD EPYC 7763 64-Core Processor |
| wide map field r/w: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative |
| ------------------------------------------------------------------------------------------------------------------------ |
| 1 wide x 100000 rows (read in-mem) 14 16 2 7.1 140.8 1.0X |
| 1 wide x 100000 rows (exec in-mem) 18 20 2 5.5 180.9 0.8X |
| 1 wide x 100000 rows (read parquet) 21 23 4 4.8 208.7 0.7X |
| 1 wide x 100000 rows (write parquet) 85 89 3 1.2 851.5 0.2X |
| 100 wide x 1000 rows (read in-mem) 8 10 2 13.3 75.3 1.9X |
| 100 wide x 1000 rows (exec in-mem) 9 11 2 10.7 93.0 1.5X |
| 100 wide x 1000 rows (read parquet) 18 21 3 5.5 182.0 0.8X |
| 100 wide x 1000 rows (write parquet) 79 84 4 1.3 793.4 0.2X |
| 2500 wide x 40 rows (read in-mem) 10 11 2 10.3 97.4 1.4X |
| 2500 wide x 40 rows (exec in-mem) 11 13 2 8.7 114.6 1.2X |
| 2500 wide x 40 rows (read parquet) 19 21 3 5.3 188.5 0.7X |
| 2500 wide x 40 rows (write parquet) 80 86 6 1.2 804.0 0.2X |
| |
| |
