| ================================================================================================ |
| Benchmark for performance of JSON parsing |
| ================================================================================================ |
| |
| Preparing data for benchmarking ... |
| OpenJDK 64-Bit Server VM 1.8.0_252-8u252-b09-1~18.04-b09 on Linux 4.15.0-1063-aws |
| Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz |
| JSON schema inferring: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative |
| ------------------------------------------------------------------------------------------------------------------------ |
| No encoding 78058 78116 76 1.3 780.6 1.0X |
| UTF-8 is set 125709 126521 1367 0.8 1257.1 0.6X |
| |
| Preparing data for benchmarking ... |
| OpenJDK 64-Bit Server VM 1.8.0_252-8u252-b09-1~18.04-b09 on Linux 4.15.0-1063-aws |
| Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz |
| count a short column: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative |
| ------------------------------------------------------------------------------------------------------------------------ |
| No encoding 60424 60567 188 1.7 604.2 1.0X |
| UTF-8 is set 92714 92864 140 1.1 927.1 0.7X |
| |
| Preparing data for benchmarking ... |
| OpenJDK 64-Bit Server VM 1.8.0_252-8u252-b09-1~18.04-b09 on Linux 4.15.0-1063-aws |
| Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz |
| count a wide column: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative |
| ------------------------------------------------------------------------------------------------------------------------ |
| No encoding 65047 65761 662 0.2 6504.7 1.0X |
| UTF-8 is set 101823 101918 113 0.1 10182.3 0.6X |
| |
| Preparing data for benchmarking ... |
| OpenJDK 64-Bit Server VM 1.8.0_252-8u252-b09-1~18.04-b09 on Linux 4.15.0-1063-aws |
| Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz |
| select wide row: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative |
| ------------------------------------------------------------------------------------------------------------------------ |
| No encoding 145471 146067 601 0.0 290941.4 1.0X |
| UTF-8 is set 158504 159237 635 0.0 317008.4 0.9X |
| |
| Preparing data for benchmarking ... |
| OpenJDK 64-Bit Server VM 1.8.0_252-8u252-b09-1~18.04-b09 on Linux 4.15.0-1063-aws |
| Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz |
| Select a subset of 10 columns: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative |
| ------------------------------------------------------------------------------------------------------------------------ |
| Select 10 columns 21386 21451 112 0.5 2138.6 1.0X |
| Select 1 column 27172 27214 58 0.4 2717.2 0.8X |
| |
| Preparing data for benchmarking ... |
| OpenJDK 64-Bit Server VM 1.8.0_252-8u252-b09-1~18.04-b09 on Linux 4.15.0-1063-aws |
| Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz |
| creation of JSON parser per line: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative |
| ------------------------------------------------------------------------------------------------------------------------ |
| Short column without encoding 9283 9363 69 1.1 928.3 1.0X |
| Short column with UTF-8 15330 15369 61 0.7 1533.0 0.6X |
| Wide column without encoding 138885 139153 239 0.1 13888.5 0.1X |
| Wide column with UTF-8 177201 177650 501 0.1 17720.1 0.1X |
| |
| Preparing data for benchmarking ... |
| OpenJDK 64-Bit Server VM 1.8.0_252-8u252-b09-1~18.04-b09 on Linux 4.15.0-1063-aws |
| Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz |
| JSON functions: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative |
| ------------------------------------------------------------------------------------------------------------------------ |
| Text read 1224 1243 17 8.2 122.4 1.0X |
| from_json 25191 25327 214 0.4 2519.1 0.0X |
| json_tuple 30333 30380 42 0.3 3033.3 0.0X |
| get_json_object 21611 21739 112 0.5 2161.1 0.1X |
| |
| Preparing data for benchmarking ... |
| OpenJDK 64-Bit Server VM 1.8.0_252-8u252-b09-1~18.04-b09 on Linux 4.15.0-1063-aws |
| Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz |
| Dataset of json strings: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative |
| ------------------------------------------------------------------------------------------------------------------------ |
| Text read 5923 5941 32 8.4 118.5 1.0X |
| schema inferring 34089 34238 135 1.5 681.8 0.2X |
| parsing 44699 45952 1108 1.1 894.0 0.1X |
| |
| Preparing data for benchmarking ... |
| OpenJDK 64-Bit Server VM 1.8.0_252-8u252-b09-1~18.04-b09 on Linux 4.15.0-1063-aws |
| Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz |
| Json files in the per-line mode: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative |
| ------------------------------------------------------------------------------------------------------------------------ |
| Text read 9727 9776 50 5.1 194.5 1.0X |
| Schema inferring 52529 52643 98 1.0 1050.6 0.2X |
| Parsing without charset 44563 44692 132 1.1 891.3 0.2X |
| Parsing with UTF-8 55558 55755 218 0.9 1111.2 0.2X |
| |
| OpenJDK 64-Bit Server VM 1.8.0_252-8u252-b09-1~18.04-b09 on Linux 4.15.0-1063-aws |
| Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz |
| Write dates and timestamps: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative |
| ------------------------------------------------------------------------------------------------------------------------ |
| Create a dataset of timestamps 1945 1964 22 5.1 194.5 1.0X |
| to_json(timestamp) 17990 18135 249 0.6 1799.0 0.1X |
| write timestamps to files 13198 13234 45 0.8 1319.8 0.1X |
| Create a dataset of dates 2202 2213 11 4.5 220.2 0.9X |
| to_json(date) 11219 11240 29 0.9 1121.9 0.2X |
| write dates to files 6932 6966 32 1.4 693.2 0.3X |
| |
| OpenJDK 64-Bit Server VM 1.8.0_252-8u252-b09-1~18.04-b09 on Linux 4.15.0-1063-aws |
| Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz |
| Read dates and timestamps: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative |
| ------------------------------------------------------------------------------------------------------------------------ |
| read timestamp text from files 2354 2368 12 4.2 235.4 1.0X |
| read timestamps from files 43681 43771 100 0.2 4368.1 0.1X |
| infer timestamps from files 90608 90771 161 0.1 9060.8 0.0X |
| read date text from files 2121 2129 9 4.7 212.1 1.1X |
| read date from files 19069 19103 32 0.5 1906.9 0.1X |
| timestamp strings 3943 3967 24 2.5 394.3 0.6X |
| parse timestamps from Dataset[String] 55239 55324 74 0.2 5523.9 0.0X |
| infer timestamps from Dataset[String] 106155 106258 99 0.1 10615.5 0.0X |
| date strings 4567 4572 5 2.2 456.7 0.5X |
| parse dates from Dataset[String] 31258 31461 321 0.3 3125.8 0.1X |
| from_json(timestamp) 76499 77031 504 0.1 7649.9 0.0X |
| from_json(date) 44188 44199 9 0.2 4418.8 0.1X |
| |
| OpenJDK 64-Bit Server VM 1.8.0_252-8u252-b09-1~18.04-b09 on Linux 4.15.0-1063-aws |
| Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz |
| Filters pushdown: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative |
| ------------------------------------------------------------------------------------------------------------------------ |
| w/o filters 30314 30334 28 0.0 303139.1 1.0X |
| pushdown disabled 30394 30429 54 0.0 303944.7 1.0X |
| w/ filters 906 913 8 0.1 9059.1 33.5X |
| |
| |
