commit | 1ffdbcc571371a650ca347be166a482feba03b98 | [log] [tgz] |
---|---|---|
author | julien <julien@twitter.com> | Fri May 24 16:51:08 2013 -0700 |
committer | julien <julien@twitter.com> | Fri May 24 16:51:08 2013 -0700 |
tree | 5b9d9164e111c5991866c9f0855dcfbec161106d | |
parent | 96997b6d9f7d7c4739379712a312cf4020a1ca54 [diff] |
[maven-release-plugin] prepare for next development iteration
Parquet-mr is the java implementation of the Parquet format to be used in Hadoop. It uses the record shredding and assembly algorithm described in the Dremel paper. Integration with Pig and Map/Reduce are provided.
A Loader and a Storer are provided to read and write Parquet files with Apache Pig
Thrift mapping to the parquet schema is provided using a TBase extending class. You can read and write parquet files using Thrift generated classes.
See the APIs:
to run the unit tests: mvn test
to build the jars: mvn package
The build runs in Travis CI:
<repositories> <repository> <id>sonatype-nexus-snapshots</id> <url>https://oss.sonatype.org/content/repositories/snapshots</url> <releases> <enabled>false</enabled> </releases> <snapshots> <enabled>true</enabled> </snapshots> </repository> </repositories> <dependencies> <dependency> <groupId>com.twitter</groupId> <artifactId>parquet-column</artifactId> <version>1.0.0-SNAPSHOT</version> </dependency> <dependency> <groupId>com.twitter</groupId> <artifactId>parquet-hadoop</artifactId> <version>1.0.0-SNAPSHOT</version> </dependency> </dependencies>
We haven't published a 1.0.0 yet
Copyright 2012 Twitter, Inc.
Licensed under the Apache License, Version 2.0: http://www.apache.org/licenses/LICENSE-2.0