Apache Tez Change Log
=====================

INCOMPATIBLE CHANGES:

ALL CHANGES:
  TEZ-3726. Clean up DeletionTracker's reflection instantiation and provide ContainerLauncher with dagComplete() functionality
  TEZ-3725. Cleanup http connections and other unnecessary fields in DAG Deletion tracker classes.
  TEZ-3705. Modify DeletionTracker and deletion threads to be initialized only if enabled for tez_shuffle
  TEZ-3685. ShuffleHandler completedInputSet off-by-one error
  TEZ-3684. Incorporate first pass non-essential TEZ-3334 pre-merge feedback
  TEZ-3683. LocalContainerLauncher#shouldDelete member variable is not used
  TEZ-3682. Pass parameters instead of configuration for changes to support tez shuffle handler
  TEZ-3628. Give Tez shuffle handler threads custom names
  TEZ-3621. Optimize the Shuffle Handler content length calculation for keep alive
  TEZ-3620. UnorderedPartitionedKVOutput is missing the shuffle service config in the confKeys set
  TEZ-3618. Shuffle Handler Loading cache equality tests always results is false
  TEZ-3612. Tez Shuffle Handler Content length does not match actual
  TEZ-3608. Fetcher can hang if copyMapOutput/fetchInputs returns early
  TEZ-3606. Fix debug log for empty partitions to the expanded partitionId in the Composite case
  TEZ-3604. Remove the compositeInputAttemptIdentifier from remaining list upon fetch completion in the Ordered case
  TEZ-3599. Unordered Fetcher can hang if empty partitions are present
  TEZ-3596. Number of Empty DME logged for Composite fetch is too high
  TEZ-3597. Composite Fetch hangs on certain DME empty events.
  TEZ-3595. Composite Fetch account error for disk direct
  TEZ-3590. Remove google.protobuf from the tez-auxservices shaded jar
  TEZ-3587. Fetcher fetchInputs() can NPE on srcAttempt due to missing entry in pathToAttemptMap
  TEZ-3586. Remove fusesource.leveldbjni from the tez-auxservices shaded jar
  TEZ-3532. Backport MAPREDUCE-6808. Log map attempts as part of shuffle handler audit log
  TEZ-3563. Tez Shuffle Handler logging fails to initialize
  TEZ-3564. TezConfiguration#TEZ_DELETION_TRACKER_CLASS has the wrong config key-name
  TEZ-3557. TEZ-3362 causes TestContainerLauncherWrapper#testDelegation to fail
  TEZ-3361. Fetch Multiple Partitions from the Shuffle Handler
  TEZ-3360. Tez Custom Shuffle Handler Documentation
  TEZ-3411. TestShuffleHandler#testSendMapCount should not used hard coded ShuffleHandler port
  TEZ-3412. Modify ShuffleHandler to use Constants.DAG_PREFIX and fix AttemptPathIdentifier#toString()
  TEZ-3410. ShuffleHandler should use Path.SEPARATOR instead "/"
  TEZ-3408. Allow Task Output Files to reside in DAG specific directories for Custom Shuffle Handler
  TEZ-3238. Shuffle service name should be configureable and should not be hardcoded to ‘mapreduce_shuffle’
  TEZ-3390. Package Shuffle Handler as a shaded uber-jar
  TEZ-3378. Move Shuffle Handler configuration into the Tez namespace
  TEZ-3377. Remove ShuffleHandler dependency on mapred.FadvisedChunkedFile and mapred.FadvisedFileRegion
  TEZ-3380. Shuffle Handler: Replace primitive wrapper's valueOf method with parse* method to avoid unnecessary boxing/unboxing
  TEZ-3355. Tez Custom Shuffle Handler POC
  TEZ-3393. Remove extra jetty dependency from Shuffle Handler