Merge pull request #895 from NLGithubWP/update-distributed-benchmarks-dev

Add comments for device synchronization during the distributed training