| commit | 41bb7210c509231b40a80e04f507fd15c53221b8 | [log] [tgz] |
|---|---|---|
| author | Prerna Manaktala <prerna@datatorrent.com> | Fri Feb 20 14:34:10 2015 -0800 |
| committer | Prerna Manaktala <prerna@datatorrent.com> | Fri Feb 20 14:34:10 2015 -0800 |
| tree | ad9fe0600f201fb7586f0f9371bf45e81310aa65 | |
| parent | d70a00741b56350a06b4ec2500757b04d37d0b7c [diff] |
Squashed commit of the following:
commit bca3457071fd5229e0f76998e98cb7ceb600a1eb
Merge: d7b8842 d70a007
Author: Prerna Manaktala <prerna@datatorrent.com>
Date: Fri Feb 20 12:26:33 2015 -0800
Merge branch 'dt-dev' into HiveFinal
commit d7b8842353f5a536b3726f26b12aadc4341bfe0f
Author: Prerna Manaktala <prerna@datatorrent.com>
Date: Fri Feb 20 12:25:20 2015 -0800
changes for code review.
commit 92ddd295ee3bbe4619596a8788f2bb1443880d33
Author: Prerna Manaktala <prerna@datatorrent.com>
Date: Thu Feb 19 00:24:48 2015 -0800
Netbeans was not showing any difference, hence changed the file in vi.
commit 150ecccdec26fa6eb19fdb7fcdc60da49f6207f0
Author: Prerna Manaktala <prerna@datatorrent.com>
Date: Thu Feb 19 00:12:46 2015 -0800
copyright year changed to 2015,remove referencesd to morado nodes,localhost,username,password in dt-site-hive.xml
and properties.xml.
commit cb804a15e370032029db51711c23a1a98221aa8f
Author: Prerna Manaktala <prerna@node0.morado.com>
Date: Wed Feb 18 14:16:58 2015 -0800
Squashed commit of the following:
commit c667891599668cae37da07088549ec01ef53668e
Author: Prerna Manaktala <prerna@datatorrent.com>
Date: Wed Feb 18 14:14:07 2015 -0800
changes for merge.
commit 733fe44d7fb775ecc1c07a46ed9592bfda2489d6
Author: Prerna Manaktala <prerna@node0.morado.com>
Date: Wed Feb 18 13:35:59 2015 -0800
unnecessary changes
commit 9119c30f16fb4ebcd6f5cebe7cf321ed03faa32a
Author: Prerna Manaktala <prerna@node0.morado.com>
Date: Wed Feb 18 13:31:53 2015 -0800
resolving merge
commit 8561b1cd6993f7e6c3f85a6055755b1171bc40ef
Author: Prerna Manaktala <prerna@datatorrent.com>
Date: Wed Feb 18 11:55:43 2015 -0800
Squashed commit of the following:
commit 84de0652e501889825ecf2806195f1c66fbeb185
Author: Prerna Manaktala <prerna@datatorrent.com>
Date: Wed Feb 18 11:45:15 2015 -0800
removed not needed file
commit 697f47adfde81d603d0ba4f24d643b7d57256456
Author: Prerna Manaktala <prerna@datatorrent.com>
Date: Wed Feb 18 11:41:34 2015 -0800
removed unnecessary pom changes.
commit 09f3551fa460ff2561460463fba46f75c441221c
Author: Prerna Manaktala <prerna@datatorrent.com>
Date: Wed Feb 18 11:33:00 2015 -0800
Merge
commit 54f700d5099037e8b3a92669f1e035bccf25c4c3
Author: Prerna Manaktala <prerna@datatorrent.com>
Date: Tue Feb 17 14:12:35 2015 -0800
removed not needed values in property.xml.
commit d3cc4432327fd670a2fb80a5284c939dd0af7b86
Merge: fba9144 04d4d04
Author: Prerna Manaktala <prerna@datatorrent.com>
Date: Tue Feb 17 14:02:41 2015 -0800
merge conflicts
commit fba91445ef310f1295efd1a6f83b7d93cb952dd0
Author: Prerna Manaktala <prerna@datatorrent.com>
Date: Tue Feb 17 13:41:29 2015 -0800
changes for adding more specific tests and counters to measure performance.
commit 04d4d04c1c3a406d4d33661f5f559091dc3677a1
Author: Prerna Manaktala <prerna@datatorrent.com>
Date: Tue Feb 17 12:40:33 2015 -0800
Excluded hadoop jars already provided by platform.
commit 212762129187f403c706ef08375927eef893d8a9
Author: Prerna Manaktala <prerna@datatorrent.com>
Date: Mon Feb 16 16:08:05 2015 -0800
changes for adding more unit tests to mock.
commit 11edfdbb1c03f3e25c07fdafb791d38f0229c6d8
Merge: c371760 ec53b85
Author: Prerna Manaktala <prerna@datatorrent.com>
Date: Thu Feb 5 15:26:53 2015 -0800
Resolved conflicts
commit c371760082e35a4c3fb65404b9a585e0ce51c05a
Author: Prerna Manaktala <prerna@datatorrent.com>
Date: Thu Feb 5 15:23:00 2015 -0800
changes.
commit ec53b852d95af749e826fea7da3c1c017e0b790d
Author: Prerna Manaktala <prerna@node0.morado.com>
Date: Thu Feb 5 15:16:41 2015 -0800
changing properties according to cluster.
commit e63323ef253c9e6d6911bab7d3bd86e645a8368b
Merge: 26d8aef 9c36fdd
Author: Prerna Manaktala <prerna@node0.morado.com>
Date: Thu Feb 5 14:20:40 2015 -0800
Merge branch 'Hive' of github.com:DataTorrent/Malhar into Hive
commit 9c36fdd8046513b1222118ea02e3b38461d69223
Author: Prerna Manaktala <prerna@datatorrent.com>
Date: Thu Feb 5 13:48:06 2015 -0800
Added javadoc where needed.
commit f0ad19d939502aa66f5e0eff5c7c5d31d4bbdc39
Author: Prerna Manaktala <prerna@datatorrent.com>
Date: Thu Feb 5 11:37:58 2015 -0800
changes for tests.
commit 54378e825a1a02fbd4ff0442be937e9679ab7ed5
Merge: f00b0eb 0320854
Author: Prerna Manaktala <prerna@datatorrent.com>
Date: Thu Feb 5 11:05:44 2015 -0800
Merge branch 'dt-dev' of github.com:DataTorrent/Malhar into HEAD
commit f00b0eb5ec2d1a571e6bedf6f46437ab9294fba8
Author: Prerna Manaktala <prerna@datatorrent.com>
Date: Thu Feb 5 11:01:03 2015 -0800
changes after recent review.
commit 91c9c096b741da1f5d2548ac3a8086ccd6452b21
Author: Prerna Manaktala <prerna@datatorrent.com>
Date: Mon Feb 2 16:22:47 2015 -0800
Squashed commit of the following:
commit 2af99e5c8cf1a55508ab224503fd9737e097b5a5
Merge: 6dcfbf5 3a37801
Author: Prerna Manaktala <prerna@datatorrent.com>
Date: Mon Feb 2 16:20:17 2015 -0800
Merge remote-tracking branch 'upstream/dt-dev' into HiveNew
commit 6dcfbf5978704fd68a746b171bceb1069ec13843
Merge: 2440556 3f0ab99
Author: Prerna Manaktala <prerna@datatorrent.com>
Date: Mon Feb 2 16:13:33 2015 -0800
final commit
commit 244055640c375e524d54cdc54832908ba18e1571
Author: Prerna Manaktala <prerna@datatorrent.com>
Date: Mon Feb 2 14:58:48 2015 -0800
formatting.
commit 3a37801c1a48a7325eb32467a9a731f1f71567a1
Merge: 3f0ab99 9a888ee
Author: tweise <thomas.weise@gmail.com>
Date: Mon Feb 2 14:51:31 2015 -0800
Merge pull request #1265 from sashadt/dt-dev
SPOI-3940 #resolve Updating demo app versions to sync with release
commit 9a888ee50380880578ccccb40bb4f8ff691cd76f
Author: sashadt <sasha@datatorrent.com>
Date: Mon Feb 2 14:46:54 2015 -0800
SPOI-3940 #resolve Updating demo app versions to sync with release
commit 3647160c7545a5a6f2f4b2ee7a3968bcfc3dc840
Author: Prerna Manaktala <prerna@datatorrent.com>
Date: Mon Feb 2 14:39:11 2015 -0800
changes for having application properties.
commit aabed8914cdb8b493ab8ba532f780d0a0c16236a
Author: Prerna Manaktala <prerna@datatorrent.com>
Date: Mon Feb 2 11:21:28 2015 -0800
changes to remove RandomWordGenerator output port, added a new operator for testing date input.
commit 81b2d9a3e0d58096c5fe1dc61dc838d667a6eabb
Merge: c043e97 f325e4a
Author: Prerna Manaktala <prerna@datatorrent.com>
Date: Mon Feb 2 11:20:35 2015 -0800
merge
commit c043e973c9d3b419d64c88f5b6219525097514bc
Author: Prerna Manaktala <prerna@datatorrent.com>
Date: Mon Feb 2 10:15:10 2015 -0800
changes for removing original stream codec implementation.
commit 828a50a327ddb2303d30f8b6f5913e4bbe5f406f
Merge: b06c7ad 372c87d
Author: Prerna Manaktala <prerna@datatorrent.com>
Date: Thu Jan 29 16:18:59 2015 -0800
Merge branch 'dt-dev' into HiveNew
commit b06c7ad6434ddaa9b6c04cc743368a2028eb0de5
Merge: 3f956e2 bf4fbb9
Author: Prerna Manaktala <prerna@datatorrent.com>
Date: Thu Jan 29 12:13:54 2015 -0800
Merge branch 'dt-dev' of github.com:DataTorrent/Malhar into HiveNew
commit 3f956e27b3866ed9ad3628aed360dfa89019124c
Author: Prerna Manaktala <prerna@datatorrent.com>
Date: Thu Jan 29 00:37:36 2015 -0800
change to add hivepath in property.xml
commit d3ca3ac36381f1db30dc6d67fdf85c685e814426
Author: Prerna Manaktala <prerna@datatorrent.com>
Date: Wed Jan 28 18:17:14 2015 -0800
changes.
commit c713ffdd97ee391cccd26ed85c95d89df9ec8ad1
Author: Prerna Manaktala <prerna@datatorrent.com>
Date: Wed Jan 28 18:16:41 2015 -0800
changes.
commit 3afcdbfa35314b42e7ccfefbb68fd9a308a98e74
Author: Prerna Manaktala <prerna@datatorrent.com>
Date: Wed Jan 28 16:17:40 2015 -0800
changes to remove returning arraylist/string array from gethivepartitions.
commit 9fc5434d85f45569fdc5b3a2f66cd8592f58d47f
Merge: 6926706 1f0ce46
Author: Prerna Manaktala <prerna@datatorrent.com>
Date: Wed Jan 28 15:11:51 2015 -0800
Merge branch 'dt-dev' into MLHR-final-1544
commit 69267069fc3e48cdcb6ff4d2bd0b568297b3267e
Author: Prerna Manaktala <prerna@datatorrent.com>
Date: Wed Jan 28 15:05:12 2015 -0800
changes.
commit da73cd7a57bd3e97a7abe18c436384f66c9571ee
Author: Prerna Manaktala <prerna@datatorrent.com>
Date: Wed Jan 28 14:18:04 2015 -0800
changes for introducing override option in hive tables.
commit 6098a6f33f14060b92dd55eac4bc3663ea0336e0
Author: Prerna Manaktala <prerna@datatorrent.com>
Date: Tue Jan 27 11:17:42 2015 -0800
changes before final review,code verified with partitions.
commit c927c82228101179e869e43e6bc1632d0e0bcbaf
Author: Prerna Manaktala <prerna@datatorrent.com>
Date: Mon Jan 26 13:06:53 2015 -0800
changes after code review.
commit 294f5d329fa89ccf8194cba224bfe479a5473d2a
Author: Prerna Manaktala <prerna@datatorrent.com>
Date: Sat Jan 24 15:06:49 2015 -0800
changes for adding back partition in file path.
commit 96489eba7177ef5533483c1431c0a91bf1d4f04a
Author: Prerna Manaktala <prerna@datatorrent.com>
Date: Fri Jan 23 21:42:32 2015 -0800
added back the getPartition function.
commit 4235868238a1efb7100adb5c1ba517ab75baa34d
Author: Prerna Manaktala <prerna@datatorrent.com>
Date: Fri Jan 23 16:25:39 2015 -0800
new map partition for test.
commit 7b94832116605e147717f715bf518014c87800ed
Author: Prerna Manaktala <prerna@datatorrent.com>
Date: Fri Jan 23 16:13:08 2015 -0800
changed unit tests accordingly.
commit a9deb34ebcd282d550dcfde6f22d85e1ab56588c
Merge: c20978a 10fbe4e
Author: Prerna Manaktala <prerna@datatorrent.com>
Date: Fri Jan 23 00:14:32 2015 -0800
Merge branch 'dt-dev' of github.com:DataTorrent/Malhar into MLHR-final-1544
commit c20978a8a1f36754227cf626fe4f24358f09dbae
Author: Prerna Manaktala <prerna@datatorrent.com>
Date: Thu Jan 22 23:48:40 2015 -0800
changes after code review.
commit 61eb3585aebbe5fcd365bd99bf07eb25270e7fdf
Author: Prerna Manaktala <prerna@datatorrent.com>
Date: Thu Jan 22 13:25:33 2015 -0800
changes in converter.
commit 7ff4889d20af4f14ea0c9a919c7836ea25e2ef92
Author: Prerna Manaktala <prerna@datatorrent.com>
Date: Thu Jan 22 00:11:45 2015 -0800
changes for adding converter as field.
commit 832674479d029dba4976b8a78da2c6b515f138f8
Author: Prerna Manaktala <prerna@datatorrent.com>
Date: Wed Jan 21 16:40:55 2015 -0800
changes for code review of separation of hive from fswriter and changing log.info to log.debug.
commit cf48b90cb6f636c1578ad724bb19a417b517d510
Merge: 267f50d ffb4df1
Author: Prerna Manaktala <prerna@datatorrent.com>
Date: Wed Jan 21 16:03:51 2015 -0800
Merge branch 'dt-dev' of github.com:pm48/Malhar into MLHR-1544
commit 267f50daa1acfe98598da640868c05b29661059b
Author: Prerna Manaktala <prerna@datatorrent.com>
Date: Wed Jan 21 15:43:10 2015 -0800
changes for permission.
commit 89d8b1ce475a9e5636bd30e5dd8b313afa90a278
Author: Prerna Manaktala <prerna@datatorrent.com>
Date: Wed Jan 21 13:58:15 2015 -0800
changes to be seen later.
commit 9ce53b69577e47e97aed6fb77df849d40f94bb05
Merge: 2444731 525b732
Author: Prerna Manaktala <prerna@datatorrent.com>
Date: Wed Jan 21 13:57:33 2015 -0800
Merge remote-tracking branch 'upstream/dt-dev' into MLHR-1544
Conflicts:
benchmark/pom.xml
commit 2444731980beb44e2220713126ef944be98c6bbf
Author: Prerna Manaktala <prerna@datatorrent.com>
Date: Wed Jan 21 13:14:22 2015 -0800
changes to run on cluster.
commit 3edc3f8b12ea7bbc8d0d23fd5b604f4977f32e14
Author: Prerna Manaktala <prerna@datatorrent.com>
Date: Tue Jan 20 23:15:35 2015 -0800
changes to run on cluster.
commit e1cd90b800810cae24d58946fc74c5a9079fb31d
Merge: db401b4 50de382
Author: Prerna Manaktala <prerna@datatorrent.com>
Date: Tue Jan 20 16:40:05 2015 -0800
Merge branch 'dt-dev' into MLHR-1544
Conflicts:
benchmark/pom.xml
contrib/pom.xml
library/src/main/java/com/datatorrent/lib/io/fs/AbstractFSWriter.java
library/src/main/java/com/datatorrent/lib/testbench/RandomWordGenerator.java
commit db401b4140df4f208e5fee125c97fb729e677053
Author: Prerna Manaktala <prerna@datatorrent.com>
Date: Tue Jan 20 16:30:44 2015 -0800
changes for separting hive from hdfs.
commit f60f8b95f4614534e57b191b87e8cca33824f659
Author: Prerna Manaktala <prerna@datatorrent.com>
Date: Tue Jan 20 11:27:44 2015 -0800
changes for separating hive from abstractfswriter impl.
commit 109cafa81e7054300467144de36b73d274060898
Author: Prerna Manaktala <prerna@datatorrent.com>
Date: Mon Dec 22 14:39:19 2014 -0800
changed back pom.xml to default values.
commit 1c595c5accbf173bc88337850323086ce6449f4f
Author: Prerna Manaktala <prerna@datatorrent.com>
Date: Mon Dec 22 14:20:59 2014 -0800
Squashed commit of the following:
commit 91684d8096ca5b2e1cb44f79581a501c06bd6549
Author: Prerna Manaktala <prerna@datatorrent.com>
Date: Mon Dec 22 14:01:57 2014 -0800
changes to remove codec from benchmark app.
commit df56c13fe590e0a333b5e5aea91ebc0ca6a0a99f
Author: Prerna Manaktala <prerna@datatorrent.com>
Date: Mon Dec 22 12:49:38 2014 -0800
removed connection to stream codec, and changed back the implementation.
commit d7b1046f74e8a66420e906a7191b37af4461b613
Author: Prerna Manaktala <prerna@datatorrent.com>
Date: Mon Dec 22 11:14:56 2014 -0800
changes.
commit 9d2495434dfa056985f6351a48cf84789e050a90
Author: Prerna Manaktala <prerna@datatorrent.com>
Date: Sun Dec 21 17:15:58 2014 -0800
changes to make streamcodec use tuple.hash and not a complex algo.
commit 0b84063e09b2dd67444fce99297e883837a17982
Author: Prerna Manaktala <prerna@datatorrent.com>
Date: Fri Dec 19 12:45:01 2014 -0800
modifications for giving user the option to load data.
commit 50aa62877802417791dde28e34f873161740027e
Author: Prerna Manaktala <prerna@datatorrent.com>
Date: Wed Dec 17 15:08:29 2014 -0800
changes before pull request.
commit 74f2fd305d22f2376875d311fb7a14ab76e5f9ad
Author: Prerna Manaktala <prerna@datatorrent.com>
Date: Wed Dec 17 14:39:12 2014 -0800
changed to dt-site
commit 20b717c53f40ffeb0485e8640e3ffd432fa3c462
Author: Prerna Manaktala <prerna@datatorrent.com>
Date: Wed Dec 17 14:35:31 2014 -0800
changes before pull request.
commit d286cf4380c4dc7102d022f07a6cd506ac135550
Author: Prerna Manaktala <prerna@datatorrent.com>
Date: Wed Dec 17 14:27:37 2014 -0800
test modified
commit 005660de3f71811788d822b97105434d9abde104
Author: Prerna Manaktala <prerna@datatorrent.com>
Date: Wed Dec 17 14:26:49 2014 -0800
modifications done before pull request.
commit 61770ecc0b8adcc4040ec45221af73c95da1189f
Author: Prerna Manaktala <prerna@datatorrent.com>
Date: Tue Dec 16 14:30:13 2014 -0800
adding streamcodec serialization.
commit 8ef2a9b6c0c4d472d0b628f6d0cbdbd9398537ac
Author: Prerna Manaktala <prerna@datatorrent.com>
Date: Tue Dec 16 13:24:48 2014 -0800
removed serializer interface.
commit 2f37fe81a3908d3bb17f7207f2d0607523453fed
Author: Prerna Manaktala <prerna@datatorrent.com>
Date: Tue Dec 16 12:29:11 2014 -0800
changes for adding stream codec.
commit af373c80b50889537d7b84b28990929a0bd2eb07
Author: Prerna Manaktala <prerna@datatorrent.com>
Date: Mon Dec 15 17:47:12 2014 -0800
changes for partition without codec.
commit 8df9c17ed27dbeda94e2b6530838f361bad595a6
Author: Prerna Manaktala <prerna@datatorrent.com>
Date: Mon Dec 15 15:14:22 2014 -0800
changes to remove codec.
commit 0a651e006a75e7ffcee1125841943fa7eb6a3efc
Merge: 7fb1d7e d51d7b4
Author: Prerna Manaktala <prerna@datatorrent.com>
Date: Mon Dec 15 13:50:38 2014 -0800
Merge branch 'dt-dev' of github.com:DataTorrent/Malhar into Hive-HDFS
Conflicts:
library/src/main/java/com/datatorrent/lib/io/fs/AbstractFSWriter.java
commit 7fb1d7eb8ec739aacf83afd5c88f2125653dfbab
Author: Prerna Manaktala <prerna@datatorrent.com>
Date: Mon Dec 15 13:47:04 2014 -0800
changes at 1:47
commit d4d3b6e4eccb7872434667f8ae6596e970611e81
Author: Prerna Manaktala <prerna@datatorrent.com>
Date: Mon Dec 15 10:47:55 2014 -0800
changed debug to info level
commit 632da87aef5aa057efabb3abd370b3d2290ead62
Merge: 06661cb 81a34f3
Author: Prerna Manaktala <prerna@datatorrent.com>
Date: Mon Dec 15 10:45:53 2014 -0800
Merge branch 'dt-dev' of github.com:DataTorrent/Malhar into Hive-HDFS
commit 06661cb09fabbd745c2c4fcdd33c4cc894ffd088
Author: Prerna Manaktala <prerna@datatorrent.com>
Date: Sun Dec 14 17:03:10 2014 -0800
removed comments.
commit 96ced63caa8232c7407f48fa1f34016ee97d8730
Author: Prerna Manaktala <prerna@datatorrent.com>
Date: Fri Dec 12 14:54:32 2014 -0800
changes to attach stream codec to input port.
commit c49007651489b851a8732bb71253d4b95af04078
Author: Prerna Manaktala <prerna@datatorrent.com>
Date: Fri Dec 12 14:17:26 2014 -0800
adding
commit acfd6f6fc2d2274313ddd2e8fdb5558d1a10eb1b
Author: Prerna Manaktala <prerna@datatorrent.com>
Date: Fri Dec 12 11:48:36 2014 -0800
adding partitioning support.
commit 69ee734fdb342f29871fee7e5b3c1695094e53ac
Merge: e751d33 3b25d13
Author: Prerna Manaktala <prerna@datatorrent.com>
Date: Fri Dec 12 10:30:02 2014 -0800
Merge branch 'dt-dev' of github.com:DataTorrent/Malhar into Hive-HDFS
commit e751d33d15d31293eb60d6e9686e668f0c6c5a07
Author: Prerna Manaktala <prerna@datatorrent.com>
Date: Fri Dec 12 10:29:34 2014 -0800
changes for partition.
commit 547c36eabf2b85ab6e3df98222c9cb59b7a26112
Author: Prerna Manaktala <prerna@datatorrent.com>
Date: Thu Dec 11 16:53:24 2014 -0800
changes for partition.
commit 4fa907ca0c5e6920c2ac9207d141a01c7ba75723
Author: Prerna Manaktala <prerna@datatorrent.com>
Date: Thu Dec 11 11:37:42 2014 -0800
i
commit c6788c05f9e18418d948d3f7286f265867742b83
Author: Prerna Manaktala <prerna@datatorrent.com>
Date: Thu Dec 11 11:36:59 2014 -0800
paritions change
commit 6f1a1d4460c9eba0913e522e7ccda3c5c75e5b91
Author: Prerna Manaktala <prerna@datatorrent.com>
Date: Wed Dec 10 15:12:46 2014 -0800
adding partition.
commit 9a4109d5ff3c0b37d94e4cb251bde0a2171b69bb
Author: Prerna Manaktala <prerna@datatorrent.com>
Date: Wed Dec 10 12:29:17 2014 -0800
adding partitions to hive.
commit f0ec7ed297ef7830e5b42d9c8d5dbfc8d26db216
Author: Prerna Manaktala <prerna@datatorrent.com>
Date: Fri Dec 5 16:39:29 2014 -0800
support added for string.
commit 9f8861f9fffb530e095f82c7f9e641ffbd6a0347
Author: Prerna Manaktala <prerna@datatorrent.com>
Date: Fri Dec 5 16:26:13 2014 -0800
changed benchmark app to not to drop table when we restart the app and removing mac based comments in pom.xml
commit 9a807b880d8d0a5f9bc06f58b332dd50565f9858
Author: Prerna Manaktala <prerna@datatorrent.com>
Date: Fri Dec 5 15:27:19 2014 -0800
changes for benchmark tests
commit bda81497376626ceef7a6cf08fbcecf95ef78206
Merge: e17998e 7fdb94d
Author: Prerna Manaktala <prerna@datatorrent.com>
Date: Thu Dec 4 18:11:25 2014 -0800
Merge branch 'dt-dev' of github.com:DataTorrent/Malhar into Hive-HDFS
commit e17998e1213333864783a9194cb0a94f8dfd91d8
Author: Prerna Manaktala <prerna@datatorrent.com>
Date: Thu Dec 4 18:10:50 2014 -0800
changes for pull request.
commit fd7a3b9d130a86fb46e67e3594bbd99c2dc16569
Author: Prerna Manaktala <prerna@datatorrent.com>
Date: Thu Dec 4 12:05:02 2014 -0800
modified back.
commit 5247e4ccd5815bc674f5475668dd514a81df510d
Author: Prerna Manaktala <prerna@datatorrent.com>
Date: Thu Dec 4 11:47:27 2014 -0800
changes made to modify tests.
commit 4e2f39fa9dc662cf7f3acbee372f1a00c8f530ef
Author: Prerna Manaktala <prerna@datatorrent.com>
Date: Thu Dec 4 10:19:36 2014 -0800
adding partitioning.
commit 1d29cbb0a3eb5f437990177a14b2a68d2940770d
Author: Prerna Manaktala <prerna@datatorrent.com>
Date: Wed Dec 3 18:12:15 2014 -0800
more modifications.
commit 0bd4632bd0ac5fa31e061246315ee64c79545836
Author: Prerna Manaktala <prerna@datatorrent.com>
Date: Wed Dec 3 17:42:16 2014 -0800
changes for parameters
commit 4afb7c63d02800df435fefc3d153b320397669ad
Author: Prerna Manaktala <prerna@datatorrent.com>
Date: Wed Dec 3 17:01:13 2014 -0800
removed unnecessary files and made changes based on review of pull request.
commit 38270a9ecfb196d3e04e6f8605fe42627ff2c8e5
Author: Prerna Manaktala <prerna@datatorrent.com>
Date: Wed Dec 3 14:28:17 2014 -0800
changes for pull request.
commit b08c9a29602ac3db6bb7e6dc3a728bddfe15307c
Merge: 103a030 c86e5c1
Author: Prerna Manaktala <prerna@datatorrent.com>
Date: Wed Dec 3 11:16:09 2014 -0800
commit
commit 103a03034b39247432d22b3c018325d38ee9ad21
Author: Prerna Manaktala <prerna@datatorrent.com>
Date: Wed Dec 3 11:05:15 2014 -0800
removed test from AbstractFSWriterTest and created a separate test case
commit 643c653feb10964457a91872d1529de935fc5934
Author: Prerna Manaktala <prerna@datatorrent.com>
Date: Tue Dec 2 14:42:34 2014 -0800
changes made based on comments in pull request
commit 9f3e704e7084f02dc4fa9c5c608c2c020a544bf9
Author: Prerna Manaktala <prerna@datatorrent.com>
Date: Tue Dec 2 14:10:25 2014 -0800
changes added for comments on pull request.
commit 28a8d74ab25aa957e81614190e16b5fce4394813
Author: Prerna Manaktala <prerna@datatorrent.com>
Date: Wed Nov 26 15:08:53 2014 -0800
merged upstream dt-dev and made changes accordingly.
commit c19cdbb6a50877cac98f8ec288de1aba0c1fca70
Author: Prerna Manaktala <prerna@datatorrent.com>
Date: Wed Nov 26 14:59:23 2014 -0800
resolved Conflicts:
benchmark/pom.xml
contrib/pom.xml
library/src/main/java/com/datatorrent/lib/io/fs/AbstractFSWriter.java
Malhar repository contains open source operator and codec library that can be used with the DataTorrent platform to build Realtime streaming applications. In addition to the library there are benchmark, contrib, demos, webdemos and samples folders available. Demos contain demo applications built using the library operators. Webdemos contain webpages for the demos. Benchmark contains performance testing applications. Contrib contains additional operators that interface with third party softwares. Samples contain some sample code that shows how to use the library operators.
This project welcomes new contributors. If you would like to help make Malhar better by adding new features, enhancing existing features, or fixing bugs, here is how to do it.
You acknowledge that your submissions to DataTorrent on this repository are made pursuant the terms of the Apache License, Version 2.0 (http://www.apache.org/licenses/LICENSE-2.0.html) and constitute “Contributions,” as defined therein, and you represent and warrant that you have the right and authority to do so.
The submitted code must follow certain prescribed conventions and it is also recommended that it follow the prescribed style. The conventions and style are described in the Coding Conventions and Style document.
When adding new files, please include the following Apache v2.0 license header at the top of the file, with the fields enclosed by brackets “[]” replaced with your own identifying information. (Don't include the brackets!):
/* * Copyright (c) [XXXX] [NAME OF COPYRIGHT OWNER] * * Licensed under the Apache License, Version 2.0 (the "License"); * you may not use this file except in compliance with the License. * You may obtain a copy of the License at * * http://www.apache.org/licenses/LICENSE-2.0 * * Unless required by applicable law or agreed to in writing, software * distributed under the License is distributed on an "AS IS" BASIS, * WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied. * See the License for the specific language governing permissions and * limitations under the License. */
Thanks for contributing!
The documentation for Operators, Widgets, Demos, and Apps is available at Malhar Javadocs. Documentation for the platform itself can be found at Resources.
Please use the Malhar discussion group for support. Subscription to the group is open and postings are welcome. You can post anything about the operators, discuss new operator ideas or report issues and get answers from experts. You can signup by going to the following url https://groups.google.com/forum/#!forum/malhar-users
The Malhar repository is on github.com. You can download or clone it using the GitHub links. If you already have a GitHub account you can fork the DataTorrent/Malhar repository and contribute with pull requests. See Contributing section below.
The project uses maven to build the code. To build the code run mvn install at the top level. The code also has a dependency to the DataTorrent API. The API releases are available in the DataTorrent maven repository and the Malhar pom.xml is configured with it. Individual modules such as library can be built independently by changing directory to the module and running maven there.
To run the code DataTorrent platform is needed. The developer version or an evaluation version, both of which are free, can be downloaded from
https://www.datatorrent.com/download/
Please follow the instructions in the software README on how to run the application.
For an easer setup, sandbox virtual machine provides pre-configured DataTorrent platform with all necessary dependencies, and can be found in the download section.
Multiple demos are provided with the DataTorrent platform to showcase the platform and provide application development examples. Demos can be executed after downloading and installing DataTorrent platform or the sandbox with pre-configured DataTorrent platform environment. See demos source code for application development examples.
Web interface for the following demos is available:
Web apps run on Node.js. Please see webapps for more information.
Malhar JIRA issue tracking system is used for this project. You can monitor the state of existing issues and their track their progress at https://malhar.atlassian.net
When working with JIRA to submit pull requests, please use smart commits feature by specifying MLHR-XXXX in the commit messages. It helps us link commits with issues being tracked for easy reference. And example commit might look like this:
git commit -am "MLHR-12345 #comment Task completed ahead of schedule #resolve"
Licensed under the Apache License, Version 2.0 (the “License”); you may not use this file except in compliance with the License. You may obtain a copy of the License at
http://www.apache.org/licenses/LICENSE-2.0
Unless required by applicable law or agreed to in writing, software distributed under the License is distributed on an “AS IS” BASIS, WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied. See the License for the specific language governing permissions and limitations under the License.