tree 1b03a0756c0eb95dd8b26cb0f2693c1129d6c410
parent 369278e9514e4788964e2e69c3a9bb07b173c754
author Yunze Xu <xyzinfernity@163.com> 1597186244 +0800
committer GitHub <noreply@github.com> 1597186244 -0700

[pulsar-io-hdfs2] Add config to create subdirectory from current time (#7771)

### Motivation

Adding a subdirectory associated with current time willmake it easier to process HDFS files in batch.

For example, user can create multiple running sink instances with `yyyy-MM-dd-hh` pattern. Then stop all instances at next hour. Eventually, files of the subdirectory will contain all messages consumed during this hour.

### Modifications

- Add a `subdirectoryPattern` field to `HdfsSinkConfig`
- Update some simple tests for `HdfsSinkConfig`
- Update the doc of HDFS2 sink

### Documentation

  - Does this pull request introduce a new feature? (yes)
  - If yes, how is the feature documented? (docs)