blob: e857bd592152cf9bc0c50e8d9e929ce5e63e1aec [file]
================================================================================================
Build HighlyCompressedMapStatus, skewed block sizes
================================================================================================
OpenJDK 64-Bit Server VM 21.0.13.0.3+1-LTS on Linux 7.0.0-1019-azure
AMD EPYC 7763 64-Core Processor
2048 shuffle partitions: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative
------------------------------------------------------------------------------------------------------------------------
skewed block sizes not recorded 0 0 0 0.5 1984.0 1.0X
skewed block sizes recorded accurately 0 0 0 0.0 34704.0 0.1X
OpenJDK 64-Bit Server VM 21.0.13.0.3+1-LTS on Linux 7.0.0-1019-azure
AMD EPYC 7763 64-Core Processor
10000 shuffle partitions: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative
------------------------------------------------------------------------------------------------------------------------
skewed block sizes not recorded 0 0 0 0.0 26279.0 1.0X
skewed block sizes recorded accurately 0 0 0 0.0 91360.0 0.3X
OpenJDK 64-Bit Server VM 21.0.13.0.3+1-LTS on Linux 7.0.0-1019-azure
AMD EPYC 7763 64-Core Processor
50000 shuffle partitions: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative
------------------------------------------------------------------------------------------------------------------------
skewed block sizes not recorded 0 0 0 0.0 120805.0 1.0X
skewed block sizes recorded accurately 1 1 0 0.0 775355.0 0.2X
================================================================================================
Build HighlyCompressedMapStatus, organ pipe block sizes
================================================================================================
OpenJDK 64-Bit Server VM 21.0.13.0.3+1-LTS on Linux 7.0.0-1019-azure
AMD EPYC 7763 64-Core Processor
2048 shuffle partitions: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative
------------------------------------------------------------------------------------------------------------------------
skewed block sizes not recorded 0 0 0 0.1 6953.0 1.0X
skewed block sizes recorded accurately 0 0 0 0.0 31278.0 0.2X
OpenJDK 64-Bit Server VM 21.0.13.0.3+1-LTS on Linux 7.0.0-1019-azure
AMD EPYC 7763 64-Core Processor
10000 shuffle partitions: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative
------------------------------------------------------------------------------------------------------------------------
skewed block sizes not recorded 0 0 0 0.0 23303.0 1.0X
skewed block sizes recorded accurately 0 0 0 0.0 160969.0 0.1X
OpenJDK 64-Bit Server VM 21.0.13.0.3+1-LTS on Linux 7.0.0-1019-azure
AMD EPYC 7763 64-Core Processor
50000 shuffle partitions: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative
------------------------------------------------------------------------------------------------------------------------
skewed block sizes not recorded 0 0 0 0.0 122308.0 1.0X
skewed block sizes recorded accurately 1 1 0 0.0 895539.0 0.1X
================================================================================================
Read block sizes out of HighlyCompressedMapStatus
================================================================================================
OpenJDK 64-Bit Server VM 21.0.13.0.3+1-LTS on Linux 7.0.0-1019-azure
AMD EPYC 7763 64-Core Processor
2048 shuffle partitions: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative
--------------------------------------------------------------------------------------------------------------------------
sum every block size over the map statuses 2 2 0 123.3 8.1 1.0X
OpenJDK 64-Bit Server VM 21.0.13.0.3+1-LTS on Linux 7.0.0-1019-azure
AMD EPYC 7763 64-Core Processor
50000 shuffle partitions: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative
--------------------------------------------------------------------------------------------------------------------------
sum every block size over the map statuses 37 37 0 133.8 7.5 1.0X
================================================================================================
Driver heap retained by MapOutputTracker
================================================================================================
2001 partitions, 10000 map tasks retained MiB bytes per task serialized KiB
------------------------------------------------------------------------------------------
skewed block sizes not recorded 1 172 15
skewed block sizes recorded accurately 2 308 15