| commit | ce9aaa3a532a56ea52a698fcc259c2c3d5a21a6c | [log] [tgz] |
|---|---|---|
| author | Xavier Talpe <xaviert@ngdata.com> | Thu Apr 13 07:52:43 2017 +0200 |
| committer | Josh Wills <jwills@apache.org> | Wed Apr 12 23:13:55 2017 -0700 |
| tree | 5b7899e83bbf898da5784af78b9e747f803149aa | |
| parent | afc171fb7ad06a8c0a12fb00811874a99bf8d310 [diff] |
CRUNCH-642 Enable GroupingOptions for Distinct operations. This fixes the existing call for numReducers as it was not working as intended for non-memory PCollections due to using an invalid amount of numReducers. To increase flexibility when using the API, another call was added that allow to directly pass the GroupingOptions. Signed-off-by: Josh Wills <jwills@apache.org>