Description

Writes Avro records to Avro data files on Hadoop file systems.

Usage

writer.builder.class=org.apache.gobblin.writer.AvroDataWriterBuilder
writer.destination.type=HDFS

For more info, see AvroHdfsDataWriter

Configuration

KeyTypeDescriptionDefault Value
writer.codec.typeOne of null,deflate,snappy,bzip2,xzType of the compression codecdeflate
writer.deflate.level1-9The compression level for the “deflate” codec9