tree a16997918c74ca2b26a435ea5b9d0517188dc791
parent cd72f7e04280627c9a517dcc8a8ad8504c22569e
author Steve Loughran <stevel@cloudera.com> 1660827186 +0100
committer GitHub <noreply@github.com> 1660827186 +0100
gpgsig -----BEGIN PGP SIGNATURE-----
 
 wsBcBAABCAAQBQJi/jYyCRBK7hj4Ov3rIwAAqzcIAKmHdfHsUY0PQduhaxYRcwY2
 47q3WU/75WCiM57kMewx/jSidmKp1oe8yRBMeWtR0bxmNmZ+ydmt8w8C58cNr+RD
 Wqq6bS9rZtjQOy4leeXhJbXPp/8vVOROlF9LshVdUflRdRYpFxiJT+bTBXfJgDNN
 unKY4d4GvqsxIChNc+HF4SlMPYy26nAxb8wXuCXw84KD3RHnRmk/6aTKuGoRlN2Y
 NFrba45UQm+Q65eBJcBev0frItSiX7uGSj9b14wuLocNMokGEGxDPdtqjxCDyVXh
 ggI2svHqsQwbe/IcONGx3yXh+SgJCauWZBWhDjje5sldHFVm7xnyL21NmJU7AJY=
 =pFor
 -----END PGP SIGNATURE-----
 

HADOOP-18028. High performance S3A input stream (#4752)


This is the the preview release of the HADOOP-18028 S3A performance input stream.
It is still stabilizing, but ready to test.

Contains

HADOOP-18028. High performance S3A input stream (#4109)
	Contributed by Bhalchandra Pandit.

HADOOP-18180. Replace use of twitter util-core with java futures (#4115)
	Contributed by PJ Fanning.

HADOOP-18177. Document prefetching architecture. (#4205)
	Contributed by Ahmar Suhail

HADOOP-18175. fix test failures with prefetching s3a input stream (#4212)
 Contributed by Monthon Klongklaew

HADOOP-18231.  S3A prefetching: fix failing tests & drain stream async.  (#4386)

	* adds in new test for prefetching input stream
	* creates streamStats before opening stream
	* updates numBlocks calculation method
	* fixes ITestS3AOpenCost.testOpenFileLongerLength
	* drains stream async
	* fixes failing unit test

	Contributed by Ahmar Suhail

HADOOP-18254. Disable S3A prefetching by default. (#4469)
	Contributed by Ahmar Suhail

HADOOP-18190. Collect IOStatistics during S3A prefetching (#4458)

	This adds iOStatisticsConnection to the S3PrefetchingInputStream class, with
	new statistic names in StreamStatistics.

	This stream is not (yet) IOStatisticsContext aware.

	Contributed by Ahmar Suhail

HADOOP-18379 rebase feature/HADOOP-18028-s3a-prefetch to trunk
HADOOP-18187. Convert s3a prefetching to use JavaDoc for fields and enums.
HADOOP-18318. Update class names to be clear they belong to S3A prefetching
	Contributed by Steve Loughran