| <?xml-stylesheet type="text/xsl" href="./xdoc.xsl"?> |
| <!-- |
| Licensed to the Apache Software Foundation (ASF) under one or more |
| contributor license agreements. See the NOTICE file distributed with |
| this work for additional information regarding copyright ownership. |
| The ASF licenses this file to You under the Apache License, Version 2.0 |
| (the "License"); you may not use this file except in compliance with |
| the License. You may obtain a copy of the License at |
| |
| http://www.apache.org/licenses/LICENSE-2.0 |
| |
| Unless required by applicable law or agreed to in writing, software |
| distributed under the License is distributed on an "AS IS" BASIS, |
| WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied. |
| See the License for the specific language governing permissions and |
| limitations under the License. |
| --> |
| |
| <document> |
| |
| <properties> |
| <title>Bigtop Project Release Notes</title> |
| </properties> |
| <body> |
| <!-- Paste release notes from https://issues.apache.org/jira/browse/BIGTOP here. --> |
| <h1>Release Notes - Bigtop - Version 0.5.0</h1> |
| <h2> Sub-task |
| </h2> |
| <ul> |
| <li>[<a href='https://issues.apache.org/jira/browse/BIGTOP-39'>BIGTOP-39</a>] - Include Apache Avro in Bigtop |
| </li> |
| <li>[<a href='https://issues.apache.org/jira/browse/BIGTOP-41'>BIGTOP-41</a>] - Add Apache Thrift to Bigtop |
| </li> |
| <li>[<a href='https://issues.apache.org/jira/browse/BIGTOP-65'>BIGTOP-65</a>] - Package Apache Forrest |
| </li> |
| <li>[<a href='https://issues.apache.org/jira/browse/BIGTOP-225'>BIGTOP-225</a>] - Exit consistently in init scripts for stop on stopped service |
| </li> |
| <li>[<a href='https://issues.apache.org/jira/browse/BIGTOP-232'>BIGTOP-232</a>] - create an example .ks file for Bigtop |
| </li> |
| <li>[<a href='https://issues.apache.org/jira/browse/BIGTOP-237'>BIGTOP-237</a>] - Oozie init scripts are way too verbose |
| </li> |
| <li>[<a href='https://issues.apache.org/jira/browse/BIGTOP-239'>BIGTOP-239</a>] - HBase init scripts are shut down in the wrong order |
| </li> |
| <li>[<a href='https://issues.apache.org/jira/browse/BIGTOP-240'>BIGTOP-240</a>] - hbase initscripts should be more explicit |
| </li> |
| <li>[<a href='https://issues.apache.org/jira/browse/BIGTOP-302'>BIGTOP-302</a>] - 1. Start a separate Wiki page on Installing Bigtop in VMs (VirtualBox) (make sure to record the fact that one needs >> 2GB of RAM) 2. Record the experience with 32bit OSes |
| </li> |
| <li>[<a href='https://issues.apache.org/jira/browse/BIGTOP-380'>BIGTOP-380</a>] - Initscripts have misleading messages |
| </li> |
| <li>[<a href='https://issues.apache.org/jira/browse/BIGTOP-533'>BIGTOP-533</a>] - BigTop Hama Integration Tests |
| </li> |
| <li>[<a href='https://issues.apache.org/jira/browse/BIGTOP-551'>BIGTOP-551</a>] - Updates for packaging manifest |
| </li> |
| <li>[<a href='https://issues.apache.org/jira/browse/BIGTOP-612'>BIGTOP-612</a>] - Add Crunch to Bigtop |
| </li> |
| <li>[<a href='https://issues.apache.org/jira/browse/BIGTOP-692'>BIGTOP-692</a>] - Bump Whirr to 0.8.1 |
| </li> |
| <li>[<a href='https://issues.apache.org/jira/browse/BIGTOP-695'>BIGTOP-695</a>] - Make variables used in flume build/install scripts consistent |
| </li> |
| <li>[<a href='https://issues.apache.org/jira/browse/BIGTOP-696'>BIGTOP-696</a>] - Make variables used in oozie build/install scripts consistent |
| </li> |
| <li>[<a href='https://issues.apache.org/jira/browse/BIGTOP-697'>BIGTOP-697</a>] - Make variables used in zookeeper build/install scripts consistent |
| </li> |
| <li>[<a href='https://issues.apache.org/jira/browse/BIGTOP-700'>BIGTOP-700</a>] - Make variables used in whirr build/install scripts consistent |
| </li> |
| <li>[<a href='https://issues.apache.org/jira/browse/BIGTOP-702'>BIGTOP-702</a>] - Make variables used in datafu build/install scripts consistent |
| </li> |
| <li>[<a href='https://issues.apache.org/jira/browse/BIGTOP-703'>BIGTOP-703</a>] - Make variables used in jsvc build/install scripts consistent |
| </li> |
| <li>[<a href='https://issues.apache.org/jira/browse/BIGTOP-704'>BIGTOP-704</a>] - Make variables used in pig build/install scripts consistent |
| </li> |
| <li>[<a href='https://issues.apache.org/jira/browse/BIGTOP-705'>BIGTOP-705</a>] - Make variables used in giraph build/install scripts consistent |
| </li> |
| <li>[<a href='https://issues.apache.org/jira/browse/BIGTOP-706'>BIGTOP-706</a>] - Make variables used in hive build/install scripts consistent |
| </li> |
| <li>[<a href='https://issues.apache.org/jira/browse/BIGTOP-707'>BIGTOP-707</a>] - Make variables used in tomcat build/install scripts consistent |
| </li> |
| <li>[<a href='https://issues.apache.org/jira/browse/BIGTOP-711'>BIGTOP-711</a>] - update hadoop version to 2.0.2-alpha |
| </li> |
| <li>[<a href='https://issues.apache.org/jira/browse/BIGTOP-714'>BIGTOP-714</a>] - HDFS Fuse build broken for 0.23.3 |
| </li> |
| <li>[<a href='https://issues.apache.org/jira/browse/BIGTOP-733'>BIGTOP-733</a>] - Bump Hue to 2.1.0 |
| </li> |
| <li>[<a href='https://issues.apache.org/jira/browse/BIGTOP-735'>BIGTOP-735</a>] - Upgrade to pull Solr 4.0 when it's officially released |
| </li> |
| <li>[<a href='https://issues.apache.org/jira/browse/BIGTOP-736'>BIGTOP-736</a>] - When Solr is integrated, we'll need some tests. |
| </li> |
| <li>[<a href='https://issues.apache.org/jira/browse/BIGTOP-744'>BIGTOP-744</a>] - add package test for Solr |
| </li> |
| <li>[<a href='https://issues.apache.org/jira/browse/BIGTOP-750'>BIGTOP-750</a>] - Bump Zookeeper to 3.4.5 |
| </li> |
| <li>[<a href='https://issues.apache.org/jira/browse/BIGTOP-751'>BIGTOP-751</a>] - Bump HBase to 0.94.2 |
| </li> |
| <li>[<a href='https://issues.apache.org/jira/browse/BIGTOP-752'>BIGTOP-752</a>] - Bump Sqoop to 1.4.2 |
| </li> |
| <li>[<a href='https://issues.apache.org/jira/browse/BIGTOP-753'>BIGTOP-753</a>] - Bump Flume to 1.3.0 |
| </li> |
| <li>[<a href='https://issues.apache.org/jira/browse/BIGTOP-765'>BIGTOP-765</a>] - Create deployment code for Solr |
| </li> |
| <li>[<a href='https://issues.apache.org/jira/browse/BIGTOP-791'>BIGTOP-791</a>] - Bump Oozie to 3.3.0 |
| </li> |
| </ul> |
| |
| <h2> Bug |
| </h2> |
| <ul> |
| <li>[<a href='https://issues.apache.org/jira/browse/BIGTOP-51'>BIGTOP-51</a>] - Layout of Bigtop repository can be optimized |
| </li> |
| <li>[<a href='https://issues.apache.org/jira/browse/BIGTOP-79'>BIGTOP-79</a>] - Audit RPM package dependencies for programs invoked from install/uninstall scripts |
| </li> |
| <li>[<a href='https://issues.apache.org/jira/browse/BIGTOP-98'>BIGTOP-98</a>] - Ability to force ivy/maven version inter-dependency needs to be implemented |
| </li> |
| <li>[<a href='https://issues.apache.org/jira/browse/BIGTOP-105'>BIGTOP-105</a>] - hadoop services can not be started with the default configs in place |
| </li> |
| <li>[<a href='https://issues.apache.org/jira/browse/BIGTOP-106'>BIGTOP-106</a>] - review and cleanup install/unistall/upgrade time dependencies |
| </li> |
| <li>[<a href='https://issues.apache.org/jira/browse/BIGTOP-107'>BIGTOP-107</a>] - make Bigtop packaging work in kick-start environment |
| </li> |
| <li>[<a href='https://issues.apache.org/jira/browse/BIGTOP-135'>BIGTOP-135</a>] - make jsvc use detection more robust on SLES |
| </li> |
| <li>[<a href='https://issues.apache.org/jira/browse/BIGTOP-168'>BIGTOP-168</a>] - all of the packages that link to hadoop-core need to also link commons-configuration-1.6.jar |
| </li> |
| <li>[<a href='https://issues.apache.org/jira/browse/BIGTOP-172'>BIGTOP-172</a>] - Hadoop init.d scripts are flaky on stop |
| </li> |
| <li>[<a href='https://issues.apache.org/jira/browse/BIGTOP-177'>BIGTOP-177</a>] - Remove or fix versioned dependencies between packages of Bigtop |
| </li> |
| <li>[<a href='https://issues.apache.org/jira/browse/BIGTOP-187'>BIGTOP-187</a>] - some packages ship log files |
| </li> |
| <li>[<a href='https://issues.apache.org/jira/browse/BIGTOP-200'>BIGTOP-200</a>] - /var/lib/hadoop is set to 777 on installation it should just be group writable |
| </li> |
| <li>[<a href='https://issues.apache.org/jira/browse/BIGTOP-213'>BIGTOP-213</a>] - We should use another group than hadoop for system groups |
| </li> |
| <li>[<a href='https://issues.apache.org/jira/browse/BIGTOP-218'>BIGTOP-218</a>] - we need to figure out which compressors/codecs need to be pulled into Bigtop |
| </li> |
| <li>[<a href='https://issues.apache.org/jira/browse/BIGTOP-219'>BIGTOP-219</a>] - Pig/HBase integration is not working |
| </li> |
| <li>[<a href='https://issues.apache.org/jira/browse/BIGTOP-222'>BIGTOP-222</a>] - some man pages in /usr/share/doc/flume |
| </li> |
| <li>[<a href='https://issues.apache.org/jira/browse/BIGTOP-223'>BIGTOP-223</a>] - install/ initscripts fixes |
| </li> |
| <li>[<a href='https://issues.apache.org/jira/browse/BIGTOP-224'>BIGTOP-224</a>] - Some configuration files have their permissions set to 755 |
| </li> |
| <li>[<a href='https://issues.apache.org/jira/browse/BIGTOP-226'>BIGTOP-226</a>] - everything in /usr/lib/pig is set to 755. Non executable files should just be 644 |
| </li> |
| <li>[<a href='https://issues.apache.org/jira/browse/BIGTOP-227'>BIGTOP-227</a>] - whirr has all its files (except its man page) set as 755 |
| </li> |
| <li>[<a href='https://issues.apache.org/jira/browse/BIGTOP-228'>BIGTOP-228</a>] - Whirr should have a symlink to the hadoop's jars it needs |
| </li> |
| <li>[<a href='https://issues.apache.org/jira/browse/BIGTOP-229'>BIGTOP-229</a>] - pig package install an alternative with an inconsitent name |
| </li> |
| <li>[<a href='https://issues.apache.org/jira/browse/BIGTOP-230'>BIGTOP-230</a>] - removing packages displays the following extraneous messages |
| </li> |
| <li>[<a href='https://issues.apache.org/jira/browse/BIGTOP-256'>BIGTOP-256</a>] - Lintian Errors/Warnings - Hadoop Package |
| </li> |
| <li>[<a href='https://issues.apache.org/jira/browse/BIGTOP-275'>BIGTOP-275</a>] - scoping of variable in puppet code is incorrect |
| </li> |
| <li>[<a href='https://issues.apache.org/jira/browse/BIGTOP-279'>BIGTOP-279</a>] - we shouldn't be using properties that have been deprecated in config/puppet |
| </li> |
| <li>[<a href='https://issues.apache.org/jira/browse/BIGTOP-282'>BIGTOP-282</a>] - the licensing status of the MovieLens data files needs to be cleared up |
| </li> |
| <li>[<a href='https://issues.apache.org/jira/browse/BIGTOP-292'>BIGTOP-292</a>] - BIgtop SRPMs can not be rebuilt |
| </li> |
| <li>[<a href='https://issues.apache.org/jira/browse/BIGTOP-307'>BIGTOP-307</a>] - README documentation is inaccurate |
| </li> |
| <li>[<a href='https://issues.apache.org/jira/browse/BIGTOP-311'>BIGTOP-311</a>] - hadoop does not build in off-line mode |
| </li> |
| <li>[<a href='https://issues.apache.org/jira/browse/BIGTOP-326'>BIGTOP-326</a>] - puppet modules need to be renamed to align with renaming that happens on the package front |
| </li> |
| <li>[<a href='https://issues.apache.org/jira/browse/BIGTOP-330'>BIGTOP-330</a>] - hadoop 0.23 pseudo conf needs to set more properties to avoid using /tmp as its datadir |
| </li> |
| <li>[<a href='https://issues.apache.org/jira/browse/BIGTOP-335'>BIGTOP-335</a>] - sqoop-metastore service fails to start because it ends up using /usr/lib/hadoop/bin/hadoop |
| </li> |
| <li>[<a href='https://issues.apache.org/jira/browse/BIGTOP-340'>BIGTOP-340</a>] - wrapper scripts would benefit from being explicit |
| </li> |
| <li>[<a href='https://issues.apache.org/jira/browse/BIGTOP-347'>BIGTOP-347</a>] - we need to get rid of workaround for HDFS-1943 in hadoop init.d scripts |
| </li> |
| <li>[<a href='https://issues.apache.org/jira/browse/BIGTOP-358'>BIGTOP-358</a>] - now that hadoop packages have been split we have to update the dependencies on the downstream packages |
| </li> |
| <li>[<a href='https://issues.apache.org/jira/browse/BIGTOP-368'>BIGTOP-368</a>] - /usr/bin/hadoop sources /etc/default/yarn unconditionally |
| </li> |
| <li>[<a href='https://issues.apache.org/jira/browse/BIGTOP-377'>BIGTOP-377</a>] - Clean up packages |
| </li> |
| <li>[<a href='https://issues.apache.org/jira/browse/BIGTOP-379'>BIGTOP-379</a>] - Package testing for Bigtop 0.5.0 release |
| </li> |
| <li>[<a href='https://issues.apache.org/jira/browse/BIGTOP-385'>BIGTOP-385</a>] - new artifacts in Hadoop 0.23 need to be properly packaged |
| </li> |
| <li>[<a href='https://issues.apache.org/jira/browse/BIGTOP-395'>BIGTOP-395</a>] - flume-ng init.d scripts seem to be unhappy on Debian |
| </li> |
| <li>[<a href='https://issues.apache.org/jira/browse/BIGTOP-425'>BIGTOP-425</a>] - HMaster dies from RemoteException: Server IPC version 5 cannot communicate with client version 4 |
| </li> |
| <li>[<a href='https://issues.apache.org/jira/browse/BIGTOP-436'>BIGTOP-436</a>] - flume-node stop seems to mistarget some other java process on lucid |
| </li> |
| <li>[<a href='https://issues.apache.org/jira/browse/BIGTOP-445'>BIGTOP-445</a>] - yarn default file has the wrong name |
| </li> |
| <li>[<a href='https://issues.apache.org/jira/browse/BIGTOP-463'>BIGTOP-463</a>] - should we reconsider /usr/lib vs. /usr/libexec decision? |
| </li> |
| <li>[<a href='https://issues.apache.org/jira/browse/BIGTOP-471'>BIGTOP-471</a>] - hive server setup after installation fails on creating /var/lock/subsys directory |
| </li> |
| <li>[<a href='https://issues.apache.org/jira/browse/BIGTOP-483'>BIGTOP-483</a>] - Smoke test of Hadoop fails with clitest missing testConf.xml file |
| </li> |
| <li>[<a href='https://issues.apache.org/jira/browse/BIGTOP-486'>BIGTOP-486</a>] - separate principals from keytabs in our kerberos module |
| </li> |
| <li>[<a href='https://issues.apache.org/jira/browse/BIGTOP-489'>BIGTOP-489</a>] - TestCLI with two test cases fails ID - 146 and 147 related to refreshServiceAcl |
| </li> |
| <li>[<a href='https://issues.apache.org/jira/browse/BIGTOP-490'>BIGTOP-490</a>] - SmokeTest-Mahout test failures |
| </li> |
| <li>[<a href='https://issues.apache.org/jira/browse/BIGTOP-492'>BIGTOP-492</a>] - make our launcher scripts recognize cascading defaults |
| </li> |
| <li>[<a href='https://issues.apache.org/jira/browse/BIGTOP-504'>BIGTOP-504</a>] - provide a functionality for detecting libjvm.so in bigtop-utils |
| </li> |
| <li>[<a href='https://issues.apache.org/jira/browse/BIGTOP-511'>BIGTOP-511</a>] - Add debian repo to bigtop puppet |
| </li> |
| <li>[<a href='https://issues.apache.org/jira/browse/BIGTOP-520'>BIGTOP-520</a>] - HBase Debian builds run do-component-build twice |
| </li> |
| <li>[<a href='https://issues.apache.org/jira/browse/BIGTOP-525'>BIGTOP-525</a>] - make sure yarn.dispatcher.exit-on-error is set to true |
| </li> |
| <li>[<a href='https://issues.apache.org/jira/browse/BIGTOP-531'>BIGTOP-531</a>] - package metadata check error: when description is empty, the summary will append text "description" at the end of summary |
| </li> |
| <li>[<a href='https://issues.apache.org/jira/browse/BIGTOP-542'>BIGTOP-542</a>] - Issue when installing the new zkfc |
| </li> |
| <li>[<a href='https://issues.apache.org/jira/browse/BIGTOP-545'>BIGTOP-545</a>] - package testing manifest in trunk needs to be updated |
| </li> |
| <li>[<a href='https://issues.apache.org/jira/browse/BIGTOP-549'>BIGTOP-549</a>] - update puppet code for the latest state of HA in Hadoop |
| </li> |
| <li>[<a href='https://issues.apache.org/jira/browse/BIGTOP-553'>BIGTOP-553</a>] - Metadata for packages needs to be harmonized between RPM and Debain |
| </li> |
| <li>[<a href='https://issues.apache.org/jira/browse/BIGTOP-566'>BIGTOP-566</a>] - Flume NG pkg init script should allow user to customize the location of the conf dir |
| </li> |
| <li>[<a href='https://issues.apache.org/jira/browse/BIGTOP-581'>BIGTOP-581</a>] - Need to move iTest website to a correct location |
| </li> |
| <li>[<a href='https://issues.apache.org/jira/browse/BIGTOP-584'>BIGTOP-584</a>] - Fix hive smoke test failures in trunk |
| </li> |
| <li>[<a href='https://issues.apache.org/jira/browse/BIGTOP-591'>BIGTOP-591</a>] - libhdfs0-dev is missing files |
| </li> |
| <li>[<a href='https://issues.apache.org/jira/browse/BIGTOP-615'>BIGTOP-615</a>] - Add support for Ambrose Pig job visualization |
| </li> |
| <li>[<a href='https://issues.apache.org/jira/browse/BIGTOP-624'>BIGTOP-624</a>] - running start on a service already running should return success |
| </li> |
| <li>[<a href='https://issues.apache.org/jira/browse/BIGTOP-634'>BIGTOP-634</a>] - Weird output when doing an init action on oozie when it is already running |
| </li> |
| <li>[<a href='https://issues.apache.org/jira/browse/BIGTOP-637'>BIGTOP-637</a>] - Update boxgrinder appliance for the coming release |
| </li> |
| <li>[<a href='https://issues.apache.org/jira/browse/BIGTOP-644'>BIGTOP-644</a>] - fix the runlevels for a few packages in yum/apt/zypper |
| </li> |
| <li>[<a href='https://issues.apache.org/jira/browse/BIGTOP-648'>BIGTOP-648</a>] - hbase-thrift cannot be started properly |
| </li> |
| <li>[<a href='https://issues.apache.org/jira/browse/BIGTOP-654'>BIGTOP-654</a>] - Set nproc for HDFS user |
| </li> |
| <li>[<a href='https://issues.apache.org/jira/browse/BIGTOP-658'>BIGTOP-658</a>] - Move hbase dependency in hive out of the main package |
| </li> |
| <li>[<a href='https://issues.apache.org/jira/browse/BIGTOP-662'>BIGTOP-662</a>] - cannot start hue-server |
| </li> |
| <li>[<a href='https://issues.apache.org/jira/browse/BIGTOP-663'>BIGTOP-663</a>] - cannot start sqoop-metastore in Ubuntu precise |
| </li> |
| <li>[<a href='https://issues.apache.org/jira/browse/BIGTOP-664'>BIGTOP-664</a>] - hive-metastore script has error when execute 'service hive-metastore status' in Ubuntu precise |
| </li> |
| <li>[<a href='https://issues.apache.org/jira/browse/BIGTOP-667'>BIGTOP-667</a>] - start hadoop-httpfs in SLES return 3 instead of 0 |
| </li> |
| <li>[<a href='https://issues.apache.org/jira/browse/BIGTOP-669'>BIGTOP-669</a>] - Add DataFu to Bigtop distribution |
| </li> |
| <li>[<a href='https://issues.apache.org/jira/browse/BIGTOP-676'>BIGTOP-676</a>] - Update HBase version to 0.94.1-rc0 |
| </li> |
| <li>[<a href='https://issues.apache.org/jira/browse/BIGTOP-679'>BIGTOP-679</a>] - fuse_dfs binary has moved due to HDFS-3537 |
| </li> |
| <li>[<a href='https://issues.apache.org/jira/browse/BIGTOP-684'>BIGTOP-684</a>] - copyright header in bigtop-packages/src/common/hadoop/conf.secure/core-site.xml is in wrong place |
| </li> |
| <li>[<a href='https://issues.apache.org/jira/browse/BIGTOP-686'>BIGTOP-686</a>] - Apache Flume 1.2.0 went out so we should upgrade to it |
| </li> |
| <li>[<a href='https://issues.apache.org/jira/browse/BIGTOP-689'>BIGTOP-689</a>] - Oozie use of /var/tmp in some CentOS versions create issues |
| </li> |
| <li>[<a href='https://issues.apache.org/jira/browse/BIGTOP-691'>BIGTOP-691</a>] - flume gets killed too fast when the service is asked to stop |
| </li> |
| <li>[<a href='https://issues.apache.org/jira/browse/BIGTOP-694'>BIGTOP-694</a>] - Some HBase Scripts Need To Be Excluded From Packaging |
| </li> |
| <li>[<a href='https://issues.apache.org/jira/browse/BIGTOP-699'>BIGTOP-699</a>] - hadoop-fuse-dfs fails to find libjvm.so when JAVA_HOME happens to be a symlink |
| </li> |
| <li>[<a href='https://issues.apache.org/jira/browse/BIGTOP-701'>BIGTOP-701</a>] - Bigtop Hadoop package does not include bash tab completion |
| </li> |
| <li>[<a href='https://issues.apache.org/jira/browse/BIGTOP-708'>BIGTOP-708</a>] - modify Hive integration test to depends on the correct jar file |
| </li> |
| <li>[<a href='https://issues.apache.org/jira/browse/BIGTOP-721'>BIGTOP-721</a>] - improve the package daemon status check, check twice by some delay if status doesn't match expected value |
| </li> |
| <li>[<a href='https://issues.apache.org/jira/browse/BIGTOP-725'>BIGTOP-725</a>] - package service test TestServices should only do config once for a group of services |
| </li> |
| <li>[<a href='https://issues.apache.org/jira/browse/BIGTOP-729'>BIGTOP-729</a>] - zookeeper initd script status doesn't work |
| </li> |
| <li>[<a href='https://issues.apache.org/jira/browse/BIGTOP-734'>BIGTOP-734</a>] - Proposed fixes to Hive logging configuration |
| </li> |
| <li>[<a href='https://issues.apache.org/jira/browse/BIGTOP-740'>BIGTOP-740</a>] - improve the package file content tests to ignore platform specific file names |
| </li> |
| <li>[<a href='https://issues.apache.org/jira/browse/BIGTOP-745'>BIGTOP-745</a>] - fix incorrect javadocs in test framework |
| </li> |
| <li>[<a href='https://issues.apache.org/jira/browse/BIGTOP-754'>BIGTOP-754</a>] - libhdfs0-dev package is empty |
| </li> |
| <li>[<a href='https://issues.apache.org/jira/browse/BIGTOP-755'>BIGTOP-755</a>] - YARN_HOME is now HADOOP_YARN_HOME |
| </li> |
| <li>[<a href='https://issues.apache.org/jira/browse/BIGTOP-758'>BIGTOP-758</a>] - [Pig] Override hadoop-core and hadoop-test artifact versions only if Hadoop < 2.x |
| </li> |
| <li>[<a href='https://issues.apache.org/jira/browse/BIGTOP-759'>BIGTOP-759</a>] - Flume do-component-build should set hbase.version according to BOM |
| </li> |
| <li>[<a href='https://issues.apache.org/jira/browse/BIGTOP-762'>BIGTOP-762</a>] - Updates for building Flume versions >= 1.2 |
| </li> |
| <li>[<a href='https://issues.apache.org/jira/browse/BIGTOP-766'>BIGTOP-766</a>] - Make it possible to override Apache URLs for the builds that require them |
| </li> |
| <li>[<a href='https://issues.apache.org/jira/browse/BIGTOP-768'>BIGTOP-768</a>] - Bump the version of Groovy to 1.8 |
| </li> |
| <li>[<a href='https://issues.apache.org/jira/browse/BIGTOP-774'>BIGTOP-774</a>] - solr build fails on Debian |
| </li> |
| <li>[<a href='https://issues.apache.org/jira/browse/BIGTOP-775'>BIGTOP-775</a>] - In Groovy 1.8 the behavior of a getters of static fields changed slightly |
| </li> |
| <li>[<a href='https://issues.apache.org/jira/browse/BIGTOP-776'>BIGTOP-776</a>] - A few updates to Oozie related packaging code to accomodate Oozie's TLP status |
| </li> |
| <li>[<a href='https://issues.apache.org/jira/browse/BIGTOP-778'>BIGTOP-778</a>] - move Solr app to under /solr in Tomcat deployment and provide more knobs |
| </li> |
| <li>[<a href='https://issues.apache.org/jira/browse/BIGTOP-780'>BIGTOP-780</a>] - cannot install hive-server in SLES |
| </li> |
| <li>[<a href='https://issues.apache.org/jira/browse/BIGTOP-781'>BIGTOP-781</a>] - Bigtop packages seem to have a bunch of parasitic provides |
| </li> |
| <li>[<a href='https://issues.apache.org/jira/browse/BIGTOP-782'>BIGTOP-782</a>] - 'service hue status' still show 'failed' after hue is started in SLES |
| </li> |
| <li>[<a href='https://issues.apache.org/jira/browse/BIGTOP-783'>BIGTOP-783</a>] - 'service hue stop' cannot stop the hue service in SLES |
| </li> |
| <li>[<a href='https://issues.apache.org/jira/browse/BIGTOP-785'>BIGTOP-785</a>] - clean up build-time dependencies in our packages |
| </li> |
| <li>[<a href='https://issues.apache.org/jira/browse/BIGTOP-788'>BIGTOP-788</a>] - Oozie RPM build error due to lack of usr/lib/oozie/{libserver,oozie-server,libext} |
| </li> |
| <li>[<a href='https://issues.apache.org/jira/browse/BIGTOP-789'>BIGTOP-789</a>] - remove shadow-utils dependency from zookeeper |
| </li> |
| <li>[<a href='https://issues.apache.org/jira/browse/BIGTOP-793'>BIGTOP-793</a>] - add crunch integration tests |
| </li> |
| <li>[<a href='https://issues.apache.org/jira/browse/BIGTOP-794'>BIGTOP-794</a>] - puppet code around hadoop_head_node breaks on newer puppets |
| </li> |
| <li>[<a href='https://issues.apache.org/jira/browse/BIGTOP-795'>BIGTOP-795</a>] - need to abstract away the notion of Bigtop puppet repo |
| </li> |
| <li>[<a href='https://issues.apache.org/jira/browse/BIGTOP-796'>BIGTOP-796</a>] - hive install tries to tickle HDFS and it shouldn't |
| </li> |
| <li>[<a href='https://issues.apache.org/jira/browse/BIGTOP-797'>BIGTOP-797</a>] - provide a way to 'rsync' files into HDFS during puppet deployment |
| </li> |
| <li>[<a href='https://issues.apache.org/jira/browse/BIGTOP-798'>BIGTOP-798</a>] - introduce a fatjar collection of all the Bigtop integration tests and all their dependencies |
| </li> |
| <li>[<a href='https://issues.apache.org/jira/browse/BIGTOP-800'>BIGTOP-800</a>] - BIGTOP_JSVC is lacking ARCHIVE designation |
| </li> |
| <li>[<a href='https://issues.apache.org/jira/browse/BIGTOP-801'>BIGTOP-801</a>] - prioritize jdk over jre in bigtop-utils javadetection |
| </li> |
| <li>[<a href='https://issues.apache.org/jira/browse/BIGTOP-803'>BIGTOP-803</a>] - somehow puppet gets confused by the hadoop fs output |
| </li> |
| </ul> |
| |
| <h2> Improvement |
| </h2> |
| <ul> |
| <li>[<a href='https://issues.apache.org/jira/browse/BIGTOP-12'>BIGTOP-12</a>] - Add HCatalog to Bigtop |
| </li> |
| <li>[<a href='https://issues.apache.org/jira/browse/BIGTOP-22'>BIGTOP-22</a>] - Unify init scripts |
| </li> |
| <li>[<a href='https://issues.apache.org/jira/browse/BIGTOP-58'>BIGTOP-58</a>] - Add man page for Mahout |
| </li> |
| <li>[<a href='https://issues.apache.org/jira/browse/BIGTOP-60'>BIGTOP-60</a>] - Add normal rpmbuild options for make rpm |
| </li> |
| <li>[<a href='https://issues.apache.org/jira/browse/BIGTOP-78'>BIGTOP-78</a>] - Misc improvments |
| </li> |
| <li>[<a href='https://issues.apache.org/jira/browse/BIGTOP-117'>BIGTOP-117</a>] - Document incompatible API changes between releases |
| </li> |
| <li>[<a href='https://issues.apache.org/jira/browse/BIGTOP-153'>BIGTOP-153</a>] - Build should detect invalid archives in the dl directory |
| </li> |
| <li>[<a href='https://issues.apache.org/jira/browse/BIGTOP-204'>BIGTOP-204</a>] - Add information about supported projects and criteria for support to Apache Bigtop website |
| </li> |
| <li>[<a href='https://issues.apache.org/jira/browse/BIGTOP-233'>BIGTOP-233</a>] - Ubuntu integration: ufw application profiles |
| </li> |
| <li>[<a href='https://issues.apache.org/jira/browse/BIGTOP-245'>BIGTOP-245</a>] - Improve Bigtop layout |
| </li> |
| <li>[<a href='https://issues.apache.org/jira/browse/BIGTOP-263'>BIGTOP-263</a>] - we need a way to provide supervision for long running daemon applications |
| </li> |
| <li>[<a href='https://issues.apache.org/jira/browse/BIGTOP-284'>BIGTOP-284</a>] - It would be nice to integrate Nutch crawling as one of the MR (and perhaps HBase) tests for Bigtop |
| </li> |
| <li>[<a href='https://issues.apache.org/jira/browse/BIGTOP-304'>BIGTOP-304</a>] - document test creation and test execution steps in Bigtop |
| </li> |
| <li>[<a href='https://issues.apache.org/jira/browse/BIGTOP-351'>BIGTOP-351</a>] - Make HBASE_HEAPSIZE manageable via puppet |
| </li> |
| <li>[<a href='https://issues.apache.org/jira/browse/BIGTOP-375'>BIGTOP-375</a>] - Publish a table of component dependency versions |
| </li> |
| <li>[<a href='https://issues.apache.org/jira/browse/BIGTOP-410'>BIGTOP-410</a>] - Build secure version of HBase |
| </li> |
| <li>[<a href='https://issues.apache.org/jira/browse/BIGTOP-433'>BIGTOP-433</a>] - Make variables used in build/install scripts consistent |
| </li> |
| <li>[<a href='https://issues.apache.org/jira/browse/BIGTOP-451'>BIGTOP-451</a>] - ooziedb.sh script should run as the unix user that runs oozie server |
| </li> |
| <li>[<a href='https://issues.apache.org/jira/browse/BIGTOP-452'>BIGTOP-452</a>] - oozie installation should offer to run ooziedb.sh |
| </li> |
| <li>[<a href='https://issues.apache.org/jira/browse/BIGTOP-456'>BIGTOP-456</a>] - Consider splitting homedir between mapred and hdfs users? |
| </li> |
| <li>[<a href='https://issues.apache.org/jira/browse/BIGTOP-476'>BIGTOP-476</a>] - Improvement of BigTop iTest framework |
| </li> |
| <li>[<a href='https://issues.apache.org/jira/browse/BIGTOP-497'>BIGTOP-497</a>] - add bash tab completion to our hadoop packages |
| </li> |
| <li>[<a href='https://issues.apache.org/jira/browse/BIGTOP-517'>BIGTOP-517</a>] - Flume packaging should use the term "agent" instead of "node". |
| </li> |
| <li>[<a href='https://issues.apache.org/jira/browse/BIGTOP-536'>BIGTOP-536</a>] - provide suitable title in the <title> tag of the main home page for bigtop-incubating |
| </li> |
| <li>[<a href='https://issues.apache.org/jira/browse/BIGTOP-547'>BIGTOP-547</a>] - create an HDFS setup helper script |
| </li> |
| <li>[<a href='https://issues.apache.org/jira/browse/BIGTOP-550'>BIGTOP-550</a>] - Add ability to have multiple zookeeper servers to puppet |
| </li> |
| <li>[<a href='https://issues.apache.org/jira/browse/BIGTOP-571'>BIGTOP-571</a>] - we might need to guard against direct use of the upstream launcher scripts |
| </li> |
| <li>[<a href='https://issues.apache.org/jira/browse/BIGTOP-575'>BIGTOP-575</a>] - [Pseudo-dist config] Should yarn.nodemanager.remote-app-log-dir really be set? |
| </li> |
| <li>[<a href='https://issues.apache.org/jira/browse/BIGTOP-576'>BIGTOP-576</a>] - Minor discrepancy in naming of logs/users vs. base log directories |
| </li> |
| <li>[<a href='https://issues.apache.org/jira/browse/BIGTOP-640'>BIGTOP-640</a>] - Sync up dependency library versions automatically |
| </li> |
| <li>[<a href='https://issues.apache.org/jira/browse/BIGTOP-670'>BIGTOP-670</a>] - provide a link to our Jenkins server from the Bigtop's project page |
| </li> |
| <li>[<a href='https://issues.apache.org/jira/browse/BIGTOP-680'>BIGTOP-680</a>] - Write util function to capture test input parameters |
| </li> |
| <li>[<a href='https://issues.apache.org/jira/browse/BIGTOP-688'>BIGTOP-688</a>] - improve hue packaging via making virtual env relocatable and moving DB files into /var/lib/hue |
| </li> |
| <li>[<a href='https://issues.apache.org/jira/browse/BIGTOP-710'>BIGTOP-710</a>] - Create a higher level orchestration deployment framework |
| </li> |
| <li>[<a href='https://issues.apache.org/jira/browse/BIGTOP-712'>BIGTOP-712</a>] - Bigtop 0.5.0 release |
| </li> |
| <li>[<a href='https://issues.apache.org/jira/browse/BIGTOP-713'>BIGTOP-713</a>] - use newer debhelper and source format 3.0 (quilt) for Debian and Ubuntu packaging |
| </li> |
| <li>[<a href='https://issues.apache.org/jira/browse/BIGTOP-716'>BIGTOP-716</a>] - standardize on bash as a shell of choice |
| </li> |
| <li>[<a href='https://issues.apache.org/jira/browse/BIGTOP-718'>BIGTOP-718</a>] - Update wiki for component requirements |
| </li> |
| <li>[<a href='https://issues.apache.org/jira/browse/BIGTOP-726'>BIGTOP-726</a>] - make it possible to run HiveBulkScriptExecutor scripts selectively |
| </li> |
| <li>[<a href='https://issues.apache.org/jira/browse/BIGTOP-731'>BIGTOP-731</a>] - Reorganize Hadoop tests |
| </li> |
| <li>[<a href='https://issues.apache.org/jira/browse/BIGTOP-742'>BIGTOP-742</a>] - tighten permissions on hadoop services home directories |
| </li> |
| <li>[<a href='https://issues.apache.org/jira/browse/BIGTOP-756'>BIGTOP-756</a>] - Provide the thrift API interface file in the HBase packages |
| </li> |
| <li>[<a href='https://issues.apache.org/jira/browse/BIGTOP-757'>BIGTOP-757</a>] - Install ZooKeeper jars into the local Maven cache |
| </li> |
| <li>[<a href='https://issues.apache.org/jira/browse/BIGTOP-769'>BIGTOP-769</a>] - Create a generic shell executor iTest driver |
| </li> |
| <li>[<a href='https://issues.apache.org/jira/browse/BIGTOP-772'>BIGTOP-772</a>] - Remove all references to the incubation from the trunk of Bigtop |
| </li> |
| <li>[<a href='https://issues.apache.org/jira/browse/BIGTOP-777'>BIGTOP-777</a>] - separate the Package Tests into service tests, file content tests, and dependency tests |
| </li> |
| <li>[<a href='https://issues.apache.org/jira/browse/BIGTOP-779'>BIGTOP-779</a>] - create a config management utility for SolrCloud |
| </li> |
| <li>[<a href='https://issues.apache.org/jira/browse/BIGTOP-784'>BIGTOP-784</a>] - test deployment code on all of the supported platforms (using OpenJDK7 where available) |
| </li> |
| <li>[<a href='https://issues.apache.org/jira/browse/BIGTOP-787'>BIGTOP-787</a>] - Surface all possible options in /etc/default/flume-node |
| </li> |
| <li>[<a href='https://issues.apache.org/jira/browse/BIGTOP-792'>BIGTOP-792</a>] - org.apache.bigtop.itest.posix.Service needs to be updated to accomodate upstart/systemd |
| </li> |
| <li>[<a href='https://issues.apache.org/jira/browse/BIGTOP-799'>BIGTOP-799</a>] - create an itest method for unpacking all the resources into the HDFS or local filesystem |
| </li> |
| <li>[<a href='https://issues.apache.org/jira/browse/BIGTOP-802'>BIGTOP-802</a>] - Add rollback option to DataNode service script |
| </li> |
| <li>[<a href='https://issues.apache.org/jira/browse/BIGTOP-806'>BIGTOP-806</a>] - now that MAPREDUCE-3916 is fixed we should enable webproxy |
| </li> |
| </ul> |
| |
| <h2> New Feature |
| </h2> |
| <ul> |
| <li>[<a href='https://issues.apache.org/jira/browse/BIGTOP-42'>BIGTOP-42</a>] - Start doing testpatch-like patch validation |
| </li> |
| <li>[<a href='https://issues.apache.org/jira/browse/BIGTOP-64'>BIGTOP-64</a>] - Package Apache tools used in Bigtop builds |
| </li> |
| <li>[<a href='https://issues.apache.org/jira/browse/BIGTOP-101'>BIGTOP-101</a>] - Need to come up with a strategy for dealing with soft dependencies between packages |
| </li> |
| <li>[<a href='https://issues.apache.org/jira/browse/BIGTOP-103'>BIGTOP-103</a>] - add support for upstart service management facility |
| </li> |
| <li>[<a href='https://issues.apache.org/jira/browse/BIGTOP-116'>BIGTOP-116</a>] - Add support for systemd |
| </li> |
| <li>[<a href='https://issues.apache.org/jira/browse/BIGTOP-220'>BIGTOP-220</a>] - Add mrunit to Bigtop |
| </li> |
| <li>[<a href='https://issues.apache.org/jira/browse/BIGTOP-246'>BIGTOP-246</a>] - Provide more verbose output at artifact build time |
| </li> |
| <li>[<a href='https://issues.apache.org/jira/browse/BIGTOP-276'>BIGTOP-276</a>] - Standardize how clients create classpaths and java.library.paths |
| </li> |
| <li>[<a href='https://issues.apache.org/jira/browse/BIGTOP-350'>BIGTOP-350</a>] - Some sort of system expert would be useful for manifests reviews |
| </li> |
| <li>[<a href='https://issues.apache.org/jira/browse/BIGTOP-399'>BIGTOP-399</a>] - Provide a one-click install package for seamless deployment of Bigtop from the release/nightly repos |
| </li> |
| <li>[<a href='https://issues.apache.org/jira/browse/BIGTOP-458'>BIGTOP-458</a>] - Create some builds/tests jobs for openJDK 6 and 7 on bigtop01 jenkins |
| </li> |
| <li>[<a href='https://issues.apache.org/jira/browse/BIGTOP-460'>BIGTOP-460</a>] - Add support for daemontools-encore |
| </li> |
| <li>[<a href='https://issues.apache.org/jira/browse/BIGTOP-524'>BIGTOP-524</a>] - Add tests to verify that our init scripts conform to the LSB specification |
| </li> |
| <li>[<a href='https://issues.apache.org/jira/browse/BIGTOP-594'>BIGTOP-594</a>] - Introduce git-style bigtop command line and BIGTOP_HOME environment variable |
| </li> |
| <li>[<a href='https://issues.apache.org/jira/browse/BIGTOP-601'>BIGTOP-601</a>] - introduce bigtop-build packages for packaging build-time dependencies |
| </li> |
| <li>[<a href='https://issues.apache.org/jira/browse/BIGTOP-635'>BIGTOP-635</a>] - Implement a cluster-abstraction, discovery and manipulation framework for iTest |
| </li> |
| <li>[<a href='https://issues.apache.org/jira/browse/BIGTOP-685'>BIGTOP-685</a>] - provide a way to specify the parameters expected by a test |
| </li> |
| <li>[<a href='https://issues.apache.org/jira/browse/BIGTOP-687'>BIGTOP-687</a>] - Support YARN as a subproject of Hadoop |
| </li> |
| <li>[<a href='https://issues.apache.org/jira/browse/BIGTOP-730'>BIGTOP-730</a>] - add tarball driver into Bigtop |
| </li> |
| </ul> |
| |
| <h2> Task |
| </h2> |
| <ul> |
| <li>[<a href='https://issues.apache.org/jira/browse/BIGTOP-236'>BIGTOP-236</a>] - The user installed by hbase gets an incorrect home directory |
| </li> |
| <li>[<a href='https://issues.apache.org/jira/browse/BIGTOP-314'>BIGTOP-314</a>] - add ZooKeeper systest to Bigtop testing regime |
| </li> |
| <li>[<a href='https://issues.apache.org/jira/browse/BIGTOP-406'>BIGTOP-406</a>] - Enable openSuse VM on bigtop01 |
| </li> |
| <li>[<a href='https://issues.apache.org/jira/browse/BIGTOP-439'>BIGTOP-439</a>] - we need to review package test manifest for the Bigtop 0.4.0 release |
| </li> |
| <li>[<a href='https://issues.apache.org/jira/browse/BIGTOP-681'>BIGTOP-681</a>] - Package tests needed for new DataFu package |
| </li> |
| <li>[<a href='https://issues.apache.org/jira/browse/BIGTOP-715'>BIGTOP-715</a>] - Add Spark packaging |
| </li> |
| <li>[<a href='https://issues.apache.org/jira/browse/BIGTOP-720'>BIGTOP-720</a>] - Build environment automation |
| </li> |
| <li>[<a href='https://issues.apache.org/jira/browse/BIGTOP-760'>BIGTOP-760</a>] - Push artifacts from non-Maven projects into local Maven cache |
| </li> |
| </ul> |
| |
| <h2> Test |
| </h2> |
| <ul> |
| <li>[<a href='https://issues.apache.org/jira/browse/BIGTOP-614'>BIGTOP-614</a>] - Add HDFS HA tests |
| </li> |
| <li>[<a href='https://issues.apache.org/jira/browse/BIGTOP-621'>BIGTOP-621</a>] - Add test for distcp - intra cluster |
| </li> |
| <li>[<a href='https://issues.apache.org/jira/browse/BIGTOP-625'>BIGTOP-625</a>] - Add HDFS Append Test |
| </li> |
| <li>[<a href='https://issues.apache.org/jira/browse/BIGTOP-629'>BIGTOP-629</a>] - Adding Automated HA Tests |
| </li> |
| <li>[<a href='https://issues.apache.org/jira/browse/BIGTOP-693'>BIGTOP-693</a>] - Add hadoop-fuse-dfs test |
| </li> |
| <li>[<a href='https://issues.apache.org/jira/browse/BIGTOP-719'>BIGTOP-719</a>] - Add TestTextSnappy to test hadoop fs -text with snappy compressed files |
| </li> |
| <li>[<a href='https://issues.apache.org/jira/browse/BIGTOP-728'>BIGTOP-728</a>] - add datafu integration test |
| </li> |
| </ul> |
| |
| <h2> Wish |
| </h2> |
| <ul> |
| <li>[<a href='https://issues.apache.org/jira/browse/BIGTOP-67'>BIGTOP-67</a>] - Resize bigtop logo in header of website |
| </li> |
| </ul> |
| |
| |
| <h1>Release Notes - Bigtop - Version 0.4.0</h1> |
| <h2> Sub-task |
| </h2> |
| <ul> |
| <li>[<a href='https://issues.apache.org/jira/browse/BIGTOP-249'>BIGTOP-249</a>] - Fix namenode webapp |
| </li> |
| <li>[<a href='https://issues.apache.org/jira/browse/BIGTOP-250'>BIGTOP-250</a>] - Build contrib modules |
| </li> |
| <li>[<a href='https://issues.apache.org/jira/browse/BIGTOP-251'>BIGTOP-251</a>] - Making sure security works with the new packages for hadoop 0.23 |
| </li> |
| <li>[<a href='https://issues.apache.org/jira/browse/BIGTOP-254'>BIGTOP-254</a>] - Write init scripts for the new yarn services |
| </li> |
| <li>[<a href='https://issues.apache.org/jira/browse/BIGTOP-268'>BIGTOP-268</a>] - Examples do not run |
| </li> |
| <li>[<a href='https://issues.apache.org/jira/browse/BIGTOP-270'>BIGTOP-270</a>] - Need to create versionless jars for integration point with other projects |
| </li> |
| <li>[<a href='https://issues.apache.org/jira/browse/BIGTOP-271'>BIGTOP-271</a>] - Kill the sbin package for hadoop 0.23 |
| </li> |
| <li>[<a href='https://issues.apache.org/jira/browse/BIGTOP-299'>BIGTOP-299</a>] - Recording the fact that Java needs to be installed *before* installing Bigtop (at least on Ubuntu) |
| </li> |
| <li>[<a href='https://issues.apache.org/jira/browse/BIGTOP-300'>BIGTOP-300</a>] - Record the information on slow mirrors |
| </li> |
| <li>[<a href='https://issues.apache.org/jira/browse/BIGTOP-387'>BIGTOP-387</a>] - Zookeeper version needs to be updated to 3.4.3 |
| </li> |
| <li>[<a href='https://issues.apache.org/jira/browse/BIGTOP-424'>BIGTOP-424</a>] - Bump version of Oozie to 3.1.3 |
| </li> |
| <li>[<a href='https://issues.apache.org/jira/browse/BIGTOP-527'>BIGTOP-527</a>] - Integrate Hue 2.0.0 into Bigtop |
| </li> |
| <li>[<a href='https://issues.apache.org/jira/browse/BIGTOP-538'>BIGTOP-538</a>] - update puppet code for BIGTOP-535 |
| </li> |
| <li>[<a href='https://issues.apache.org/jira/browse/BIGTOP-539'>BIGTOP-539</a>] - update puppet code for BIGTOP-534 |
| </li> |
| <li>[<a href='https://issues.apache.org/jira/browse/BIGTOP-603'>BIGTOP-603</a>] - Bump version of Pig to 0.10.0 |
| </li> |
| <li>[<a href='https://issues.apache.org/jira/browse/BIGTOP-604'>BIGTOP-604</a>] - Bump version of Hive to 0.9.0 |
| </li> |
| <li>[<a href='https://issues.apache.org/jira/browse/BIGTOP-605'>BIGTOP-605</a>] - Create How To Release document |
| </li> |
| <li>[<a href='https://issues.apache.org/jira/browse/BIGTOP-606'>BIGTOP-606</a>] - Bump version of HBase to 0.94.0 |
| </li> |
| <li>[<a href='https://issues.apache.org/jira/browse/BIGTOP-617'>BIGTOP-617</a>] - Bump version of Oozie to 3.2.0 |
| </li> |
| <li>[<a href='https://issues.apache.org/jira/browse/BIGTOP-628'>BIGTOP-628</a>] - bump version of Mahout to 0.7.0 |
| </li> |
| </ul> |
| |
| <h2> Bug |
| </h2> |
| <ul> |
| <li>[<a href='https://issues.apache.org/jira/browse/BIGTOP-96'>BIGTOP-96</a>] - Mahout examples try to write to /usr/lib/mahout/examples/bin/work |
| </li> |
| <li>[<a href='https://issues.apache.org/jira/browse/BIGTOP-162'>BIGTOP-162</a>] - downstream components need to be patched to be compatible with MR2 |
| </li> |
| <li>[<a href='https://issues.apache.org/jira/browse/BIGTOP-186'>BIGTOP-186</a>] - whirr package ships source code and needs some permissions fixes |
| </li> |
| <li>[<a href='https://issues.apache.org/jira/browse/BIGTOP-264'>BIGTOP-264</a>] - Hadoop 23 upstream tarball put some of its hadoop jars in the same directory as some of the dependencies |
| </li> |
| <li>[<a href='https://issues.apache.org/jira/browse/BIGTOP-269'>BIGTOP-269</a>] - in .23 HBase need to link to a much wider set of hadoop jars |
| </li> |
| <li>[<a href='https://issues.apache.org/jira/browse/BIGTOP-272'>BIGTOP-272</a>] - small cleanup for hadoop 0.23 |
| </li> |
| <li>[<a href='https://issues.apache.org/jira/browse/BIGTOP-274'>BIGTOP-274</a>] - yarn-site.xml needs to be addedd to the Hadoop client classpath |
| </li> |
| <li>[<a href='https://issues.apache.org/jira/browse/BIGTOP-277'>BIGTOP-277</a>] - hive package in hadoop-0.23 branch is hopelessly broken |
| </li> |
| <li>[<a href='https://issues.apache.org/jira/browse/BIGTOP-283'>BIGTOP-283</a>] - in hadoop-0.23 the sha for Hadoop needs to be bumped to the 23.1-SNAPSHOT cut off point |
| </li> |
| <li>[<a href='https://issues.apache.org/jira/browse/BIGTOP-285'>BIGTOP-285</a>] - Remove source jars from hadoop-0.23 |
| </li> |
| <li>[<a href='https://issues.apache.org/jira/browse/BIGTOP-286'>BIGTOP-286</a>] - hadoop-0.23: hadoop-mapreduce-examples.jar is empty |
| </li> |
| <li>[<a href='https://issues.apache.org/jira/browse/BIGTOP-288'>BIGTOP-288</a>] - hadoop-0.23: pig contrib should have jars |
| </li> |
| <li>[<a href='https://issues.apache.org/jira/browse/BIGTOP-289'>BIGTOP-289</a>] - hadoop-0.23: need to package native libraries for compression |
| </li> |
| <li>[<a href='https://issues.apache.org/jira/browse/BIGTOP-291'>BIGTOP-291</a>] - __id_u RPM macro seems to be disabled in newer versions of RPMs |
| </li> |
| <li>[<a href='https://issues.apache.org/jira/browse/BIGTOP-294'>BIGTOP-294</a>] - brp-repack-jars chokes on guice-2.0.jar because of the directories without any read permission |
| </li> |
| <li>[<a href='https://issues.apache.org/jira/browse/BIGTOP-308'>BIGTOP-308</a>] - hadoop-0.23 branch doesn't provide .so links to hadoop native libraries |
| </li> |
| <li>[<a href='https://issues.apache.org/jira/browse/BIGTOP-309'>BIGTOP-309</a>] - hadoop-0.23 puppet code needs to deploy history server |
| </li> |
| <li>[<a href='https://issues.apache.org/jira/browse/BIGTOP-312'>BIGTOP-312</a>] - Puppet resource dependency syntax used in hadoop/manifests/init.pp doesn't always work |
| </li> |
| <li>[<a href='https://issues.apache.org/jira/browse/BIGTOP-316'>BIGTOP-316</a>] - split up hadoop packages into common, hdfs, mapreduce (and yarn) |
| </li> |
| <li>[<a href='https://issues.apache.org/jira/browse/BIGTOP-325'>BIGTOP-325</a>] - bump version of Zookeeper to 3.4.2 |
| </li> |
| <li>[<a href='https://issues.apache.org/jira/browse/BIGTOP-331'>BIGTOP-331</a>] - our init scripts fail to detect a failed history server in hadoop 0.23 |
| </li> |
| <li>[<a href='https://issues.apache.org/jira/browse/BIGTOP-333'>BIGTOP-333</a>] - heed to start properly packaging httpfs |
| </li> |
| <li>[<a href='https://issues.apache.org/jira/browse/BIGTOP-338'>BIGTOP-338</a>] - hadoop 0.23 doc package does not contain generated documentation |
| </li> |
| <li>[<a href='https://issues.apache.org/jira/browse/BIGTOP-339'>BIGTOP-339</a>] - zookeeper init.d script has a typo in PID file location |
| </li> |
| <li>[<a href='https://issues.apache.org/jira/browse/BIGTOP-341'>BIGTOP-341</a>] - hadoop streaming is not available in hadoop-0.23 branch |
| </li> |
| <li>[<a href='https://issues.apache.org/jira/browse/BIGTOP-344'>BIGTOP-344</a>] - puppet code needs to be updated to be able to deploy Hadoop 0.23 YARN in a secure fashion |
| </li> |
| <li>[<a href='https://issues.apache.org/jira/browse/BIGTOP-345'>BIGTOP-345</a>] - container-executor.conf.dir needs to be set to /etc/hadoop/conf |
| </li> |
| <li>[<a href='https://issues.apache.org/jira/browse/BIGTOP-346'>BIGTOP-346</a>] - container-executor needs to be owned by root:yarn and have permissions of 6050 |
| </li> |
| <li>[<a href='https://issues.apache.org/jira/browse/BIGTOP-348'>BIGTOP-348</a>] - jsvc location needs to be updated in init.d datanode script |
| </li> |
| <li>[<a href='https://issues.apache.org/jira/browse/BIGTOP-349'>BIGTOP-349</a>] - jsvc from hadoop build fails on some of the Linux systems that Bigtop has to support |
| </li> |
| <li>[<a href='https://issues.apache.org/jira/browse/BIGTOP-355'>BIGTOP-355</a>] - missed yarn.nodemanager.local-dirs, yarn.nodemanager.log-dirs and yarn.nodemanager.remote-app-log-dir in our puppet code |
| </li> |
| <li>[<a href='https://issues.apache.org/jira/browse/BIGTOP-357'>BIGTOP-357</a>] - libjvm.so dependency on CentOS can only be satisfied by libgcj in some cases |
| </li> |
| <li>[<a href='https://issues.apache.org/jira/browse/BIGTOP-359'>BIGTOP-359</a>] - documentation build is picked from the wrong place |
| </li> |
| <li>[<a href='https://issues.apache.org/jira/browse/BIGTOP-367'>BIGTOP-367</a>] - Upgrade sequencing issue |
| </li> |
| <li>[<a href='https://issues.apache.org/jira/browse/BIGTOP-369'>BIGTOP-369</a>] - pig package has license files in the wrong location |
| </li> |
| <li>[<a href='https://issues.apache.org/jira/browse/BIGTOP-372'>BIGTOP-372</a>] - hive can't be started without setting HADOOP_HOME |
| </li> |
| <li>[<a href='https://issues.apache.org/jira/browse/BIGTOP-373'>BIGTOP-373</a>] - bigtop-detect-javahome not customizable |
| </li> |
| <li>[<a href='https://issues.apache.org/jira/browse/BIGTOP-376'>BIGTOP-376</a>] - Remove unused obsolete statement in hadoop packaging |
| </li> |
| <li>[<a href='https://issues.apache.org/jira/browse/BIGTOP-378'>BIGTOP-378</a>] - history server security configs are missing |
| </li> |
| <li>[<a href='https://issues.apache.org/jira/browse/BIGTOP-381'>BIGTOP-381</a>] - need to catch up with the HEAD of hadoop-common in hadoop-0.23 |
| </li> |
| <li>[<a href='https://issues.apache.org/jira/browse/BIGTOP-383'>BIGTOP-383</a>] - bigtop-detect-javahome installed at location unexpected by scripts on SLES |
| </li> |
| <li>[<a href='https://issues.apache.org/jira/browse/BIGTOP-389'>BIGTOP-389</a>] - need to start packaging apache commons daemon jsvc |
| </li> |
| <li>[<a href='https://issues.apache.org/jira/browse/BIGTOP-392'>BIGTOP-392</a>] - zookeeper package needs to be updated for 3.4 series |
| </li> |
| <li>[<a href='https://issues.apache.org/jira/browse/BIGTOP-393'>BIGTOP-393</a>] - hadoop packages don't set nproc |
| </li> |
| <li>[<a href='https://issues.apache.org/jira/browse/BIGTOP-396'>BIGTOP-396</a>] - Missing resource dependencies in puppet for secure clusters |
| </li> |
| <li>[<a href='https://issues.apache.org/jira/browse/BIGTOP-397'>BIGTOP-397</a>] - hbase, sqoop and oozie don't use alternatives for managing configuration |
| </li> |
| <li>[<a href='https://issues.apache.org/jira/browse/BIGTOP-402'>BIGTOP-402</a>] - manifests for package testing contain way too many duplicate data |
| </li> |
| <li>[<a href='https://issues.apache.org/jira/browse/BIGTOP-407'>BIGTOP-407</a>] - hadoop package can't be installed on debian |
| </li> |
| <li>[<a href='https://issues.apache.org/jira/browse/BIGTOP-408'>BIGTOP-408</a>] - HBase build needs to be worked around in hadoop-0.23 branch |
| </li> |
| <li>[<a href='https://issues.apache.org/jira/browse/BIGTOP-409'>BIGTOP-409</a>] - sqoop build fails on SLES |
| </li> |
| <li>[<a href='https://issues.apache.org/jira/browse/BIGTOP-415'>BIGTOP-415</a>] - need to workaround MAPREDUCE-3890 |
| </li> |
| <li>[<a href='https://issues.apache.org/jira/browse/BIGTOP-416'>BIGTOP-416</a>] - run levels for init.d scripts need to be harmonized |
| </li> |
| <li>[<a href='https://issues.apache.org/jira/browse/BIGTOP-417'>BIGTOP-417</a>] - webapps shipped by bigtop components should be using a system-provided Tomcat |
| </li> |
| <li>[<a href='https://issues.apache.org/jira/browse/BIGTOP-418'>BIGTOP-418</a>] - Package MAPREDUCE-2858 (MRv2 WebApp Security) |
| </li> |
| <li>[<a href='https://issues.apache.org/jira/browse/BIGTOP-420'>BIGTOP-420</a>] - bigtop-detect-javahome installed at location unexpected by scripts on SLES |
| </li> |
| <li>[<a href='https://issues.apache.org/jira/browse/BIGTOP-421'>BIGTOP-421</a>] - Sign every single file from the convenience artefact in the releases |
| </li> |
| <li>[<a href='https://issues.apache.org/jira/browse/BIGTOP-422'>BIGTOP-422</a>] - need to start packaging fuse for Hadoop 0.23 |
| </li> |
| <li>[<a href='https://issues.apache.org/jira/browse/BIGTOP-423'>BIGTOP-423</a>] - hadoop package needs to be split into hadoop-client and hadoop-server packages |
| </li> |
| <li>[<a href='https://issues.apache.org/jira/browse/BIGTOP-426'>BIGTOP-426</a>] - build failures in hadoop-0.23 branch |
| </li> |
| <li>[<a href='https://issues.apache.org/jira/browse/BIGTOP-428'>BIGTOP-428</a>] - sqoop build needs to be forced to depend on HBase 0.92.0 artifacts |
| </li> |
| <li>[<a href='https://issues.apache.org/jira/browse/BIGTOP-429'>BIGTOP-429</a>] - CATALINA_PID needs to be updated in hadoop-httpfs.default to correspond to the calculated value |
| </li> |
| <li>[<a href='https://issues.apache.org/jira/browse/BIGTOP-430'>BIGTOP-430</a>] - oozie examples are missing |
| </li> |
| <li>[<a href='https://issues.apache.org/jira/browse/BIGTOP-434'>BIGTOP-434</a>] - Potential issue in the way Bigtop test infrastructure deal with arch in packages |
| </li> |
| <li>[<a href='https://issues.apache.org/jira/browse/BIGTOP-435'>BIGTOP-435</a>] - need to split hadoop subpackages even further for hadoop-0.23 |
| </li> |
| <li>[<a href='https://issues.apache.org/jira/browse/BIGTOP-438'>BIGTOP-438</a>] - need to bump the version of hadoop .23 to hadoop-0.23.3-SNAPSHOT |
| </li> |
| <li>[<a href='https://issues.apache.org/jira/browse/BIGTOP-443'>BIGTOP-443</a>] - deb/oozie/oozie-client.postinst installs an alternative for a path that isn't there |
| </li> |
| <li>[<a href='https://issues.apache.org/jira/browse/BIGTOP-448'>BIGTOP-448</a>] - Cannot install flume-ng-node pkg |
| </li> |
| <li>[<a href='https://issues.apache.org/jira/browse/BIGTOP-449'>BIGTOP-449</a>] - hadoop package cleanup for hadoop-0.23 |
| </li> |
| <li>[<a href='https://issues.apache.org/jira/browse/BIGTOP-450'>BIGTOP-450</a>] - repackage Oozie as a true webapp |
| </li> |
| <li>[<a href='https://issues.apache.org/jira/browse/BIGTOP-453'>BIGTOP-453</a>] - hadoop needs to depend on Zookeeper |
| </li> |
| <li>[<a href='https://issues.apache.org/jira/browse/BIGTOP-455'>BIGTOP-455</a>] - we still need at HADOOP_LIBEXEC_DIR=/usr/lib/hadoop/libexec to be present in our launcher scrtips |
| </li> |
| <li>[<a href='https://issues.apache.org/jira/browse/BIGTOP-461'>BIGTOP-461</a>] - hadoop-httpfs unconditionally removes the alternative |
| </li> |
| <li>[<a href='https://issues.apache.org/jira/browse/BIGTOP-462'>BIGTOP-462</a>] - JSVC_HOME location can be both /usr/lib/bigtop-utils and /usr/libexec/bigtop-utils |
| </li> |
| <li>[<a href='https://issues.apache.org/jira/browse/BIGTOP-464'>BIGTOP-464</a>] - There's currently a commented block in puppet/modules/hadoop/templates/yarn-site.xml that fails to render in some cases |
| </li> |
| <li>[<a href='https://issues.apache.org/jira/browse/BIGTOP-467'>BIGTOP-467</a>] - [puppet] yarn historyserver currently doesn't depend on the mapreduce keytab as it should |
| </li> |
| <li>[<a href='https://issues.apache.org/jira/browse/BIGTOP-468'>BIGTOP-468</a>] - [puppet] Fix httpfs dependencies and give it its own keytab |
| </li> |
| <li>[<a href='https://issues.apache.org/jira/browse/BIGTOP-469'>BIGTOP-469</a>] - [puppet] web authentication principal missing from hdfs-site.xml |
| </li> |
| <li>[<a href='https://issues.apache.org/jira/browse/BIGTOP-472'>BIGTOP-472</a>] - make deb fails when building Whirr - OutOfMemoryError: PermGen space |
| </li> |
| <li>[<a href='https://issues.apache.org/jira/browse/BIGTOP-473'>BIGTOP-473</a>] - zookeeper man page needs to be updated |
| </li> |
| <li>[<a href='https://issues.apache.org/jira/browse/BIGTOP-474'>BIGTOP-474</a>] - improve Oozie integration with Hadoop 0.23 |
| </li> |
| <li>[<a href='https://issues.apache.org/jira/browse/BIGTOP-477'>BIGTOP-477</a>] - launcher script for pig, hive, sqoop and mahout should not source /etc/default/hadoop anymore |
| </li> |
| <li>[<a href='https://issues.apache.org/jira/browse/BIGTOP-478'>BIGTOP-478</a>] - perhaps we should go back to mapred as a user name for mapreduce daemons in Hadoop 0.23 |
| </li> |
| <li>[<a href='https://issues.apache.org/jira/browse/BIGTOP-479'>BIGTOP-479</a>] - init.d scripts should provide an option for initializing persistent state of the services that require it |
| </li> |
| <li>[<a href='https://issues.apache.org/jira/browse/BIGTOP-480'>BIGTOP-480</a>] - log aggregation knob is now yarn.log-aggregation-enable and needs to be enabled |
| </li> |
| <li>[<a href='https://issues.apache.org/jira/browse/BIGTOP-481'>BIGTOP-481</a>] - fix the way to handle repo key for Debian like system |
| </li> |
| <li>[<a href='https://issues.apache.org/jira/browse/BIGTOP-482'>BIGTOP-482</a>] - HTTPFS puppet code needs to be updated |
| </li> |
| <li>[<a href='https://issues.apache.org/jira/browse/BIGTOP-484'>BIGTOP-484</a>] - Fix typo error ('alredy' -> 'already') |
| </li> |
| <li>[<a href='https://issues.apache.org/jira/browse/BIGTOP-485'>BIGTOP-485</a>] - transition package dependencies to hadoop-client package |
| </li> |
| <li>[<a href='https://issues.apache.org/jira/browse/BIGTOP-487'>BIGTOP-487</a>] - oozie security configuration needs to be updated |
| </li> |
| <li>[<a href='https://issues.apache.org/jira/browse/BIGTOP-488'>BIGTOP-488</a>] - TestCLI missing dependency |
| </li> |
| <li>[<a href='https://issues.apache.org/jira/browse/BIGTOP-493'>BIGTOP-493</a>] - [puppet] core-site.xml and httpfs-site.xml end up changing every few times puppet is run |
| </li> |
| <li>[<a href='https://issues.apache.org/jira/browse/BIGTOP-496'>BIGTOP-496</a>] - Hive ships some source code in the package. |
| </li> |
| <li>[<a href='https://issues.apache.org/jira/browse/BIGTOP-498'>BIGTOP-498</a>] - Oozie's home dir is currently set to /var/run/oozie but should be /var/lib/oozie |
| </li> |
| <li>[<a href='https://issues.apache.org/jira/browse/BIGTOP-500'>BIGTOP-500</a>] - Oozie hive workflows are broken because of the HADOOP_HOME being deprecated |
| </li> |
| <li>[<a href='https://issues.apache.org/jira/browse/BIGTOP-501'>BIGTOP-501</a>] - it would help to have libext point to /var/lib/oozie in Oozie packaging |
| </li> |
| <li>[<a href='https://issues.apache.org/jira/browse/BIGTOP-502'>BIGTOP-502</a>] - Flume NG init script should pass --name "agent" instead of --name "<hostname>" |
| </li> |
| <li>[<a href='https://issues.apache.org/jira/browse/BIGTOP-503'>BIGTOP-503</a>] - remove unsupported upstream launcher scripts from packaging |
| </li> |
| <li>[<a href='https://issues.apache.org/jira/browse/BIGTOP-505'>BIGTOP-505</a>] - Flume should exit 0 when trying to stop a non-running service |
| </li> |
| <li>[<a href='https://issues.apache.org/jira/browse/BIGTOP-506'>BIGTOP-506</a>] - Flume should exit 0 when trying to start an already running service |
| </li> |
| <li>[<a href='https://issues.apache.org/jira/browse/BIGTOP-507'>BIGTOP-507</a>] - sqoop deb package is empty |
| </li> |
| <li>[<a href='https://issues.apache.org/jira/browse/BIGTOP-509'>BIGTOP-509</a>] - make all is failing because flume-1.0.0-incubating.tar.gz does not exist in APACHE_MIRROR |
| </li> |
| <li>[<a href='https://issues.apache.org/jira/browse/BIGTOP-510'>BIGTOP-510</a>] - log4j property must be set with property in for Flume NG pkg |
| </li> |
| <li>[<a href='https://issues.apache.org/jira/browse/BIGTOP-512'>BIGTOP-512</a>] - oozie can't be installed on debian |
| </li> |
| <li>[<a href='https://issues.apache.org/jira/browse/BIGTOP-513'>BIGTOP-513</a>] - Pig Packaging Cleanup |
| </li> |
| <li>[<a href='https://issues.apache.org/jira/browse/BIGTOP-516'>BIGTOP-516</a>] - it would be cleaner to get rid of mapreduce entries in limits.d/mapreduce.conf now that we consolidated the user back to mapred |
| </li> |
| <li>[<a href='https://issues.apache.org/jira/browse/BIGTOP-519'>BIGTOP-519</a>] - /etc/default files are not marked as configs by various hadoop packages |
| </li> |
| <li>[<a href='https://issues.apache.org/jira/browse/BIGTOP-521'>BIGTOP-521</a>] - Hadoop Pseudo-conf files have wrong permissions |
| </li> |
| <li>[<a href='https://issues.apache.org/jira/browse/BIGTOP-526'>BIGTOP-526</a>] - it could be useful to have dfs.permissions.enabled set to true in our configs |
| </li> |
| <li>[<a href='https://issues.apache.org/jira/browse/BIGTOP-528'>BIGTOP-528</a>] - A small patch to give better return codes which can be understood by chef and pupper among others. |
| </li> |
| <li>[<a href='https://issues.apache.org/jira/browse/BIGTOP-529'>BIGTOP-529</a>] - [puppet] We don't currently format zookeeper nodes on first run |
| </li> |
| <li>[<a href='https://issues.apache.org/jira/browse/BIGTOP-530'>BIGTOP-530</a>] - [puppet] We currently xst the HTTP principal multiple times, each time invalidating the previous one |
| </li> |
| <li>[<a href='https://issues.apache.org/jira/browse/BIGTOP-537'>BIGTOP-537</a>] - provide a workaround for non-LSB compliant catalina.sh handling of a stop action |
| </li> |
| <li>[<a href='https://issues.apache.org/jira/browse/BIGTOP-540'>BIGTOP-540</a>] - hadoop package on debian is missing JSVC_HOME specification |
| </li> |
| <li>[<a href='https://issues.apache.org/jira/browse/BIGTOP-541'>BIGTOP-541</a>] - Build issue for hadoop RPM |
| </li> |
| <li>[<a href='https://issues.apache.org/jira/browse/BIGTOP-543'>BIGTOP-543</a>] - fuse_dfs_wrapper.sh should not be provided |
| </li> |
| <li>[<a href='https://issues.apache.org/jira/browse/BIGTOP-544'>BIGTOP-544</a>] - zookeeper-server init doesn't work |
| </li> |
| <li>[<a href='https://issues.apache.org/jira/browse/BIGTOP-546'>BIGTOP-546</a>] - Hadoop rpm is missing fuse default file |
| </li> |
| <li>[<a href='https://issues.apache.org/jira/browse/BIGTOP-548'>BIGTOP-548</a>] - we should consider moving the creation of the hive user into the hive package |
| </li> |
| <li>[<a href='https://issues.apache.org/jira/browse/BIGTOP-552'>BIGTOP-552</a>] - Enable HDFS durable sync |
| </li> |
| <li>[<a href='https://issues.apache.org/jira/browse/BIGTOP-554'>BIGTOP-554</a>] - rat is complaining again |
| </li> |
| <li>[<a href='https://issues.apache.org/jira/browse/BIGTOP-556'>BIGTOP-556</a>] - hbase, yarn and hdfs users are getting incorrect home directories on Debian |
| </li> |
| <li>[<a href='https://issues.apache.org/jira/browse/BIGTOP-557'>BIGTOP-557</a>] - /etc/oozie/conf and oozie-conf alternative should belong to oozie instead of oozie-client |
| </li> |
| <li>[<a href='https://issues.apache.org/jira/browse/BIGTOP-558'>BIGTOP-558</a>] - debian description can't have the following set of characters ${VAR} |
| </li> |
| <li>[<a href='https://issues.apache.org/jira/browse/BIGTOP-559'>BIGTOP-559</a>] - HttpFS fails to load Hadoop configuration after installation. |
| </li> |
| <li>[<a href='https://issues.apache.org/jira/browse/BIGTOP-560'>BIGTOP-560</a>] - Flume-ng does not depend on ant or xml-commons anymore |
| </li> |
| <li>[<a href='https://issues.apache.org/jira/browse/BIGTOP-561'>BIGTOP-561</a>] - HBase packaging has dangling symlinks |
| </li> |
| <li>[<a href='https://issues.apache.org/jira/browse/BIGTOP-562'>BIGTOP-562</a>] - fix Mahout smoke test in trunk branch |
| </li> |
| <li>[<a href='https://issues.apache.org/jira/browse/BIGTOP-563'>BIGTOP-563</a>] - Build behind proxy fails |
| </li> |
| <li>[<a href='https://issues.apache.org/jira/browse/BIGTOP-564'>BIGTOP-564</a>] - Build failure for big-top trunk for pig, oozie, and whirr |
| </li> |
| <li>[<a href='https://issues.apache.org/jira/browse/BIGTOP-565'>BIGTOP-565</a>] - catalina-based services should be really careful with catalina stop |
| </li> |
| <li>[<a href='https://issues.apache.org/jira/browse/BIGTOP-568'>BIGTOP-568</a>] - Move the configuration directory for hadoop to /etc/hadoop |
| </li> |
| <li>[<a href='https://issues.apache.org/jira/browse/BIGTOP-574'>BIGTOP-574</a>] - Add netcat and fuser as dependencies for some of the Bigtop stack. |
| </li> |
| <li>[<a href='https://issues.apache.org/jira/browse/BIGTOP-579'>BIGTOP-579</a>] - hadoop-yarn creates log files with inconsistent ownership on Debian/Ubuntu |
| </li> |
| <li>[<a href='https://issues.apache.org/jira/browse/BIGTOP-580'>BIGTOP-580</a>] - a wrapper for the ZooKeeper cleanup script is missing |
| </li> |
| <li>[<a href='https://issues.apache.org/jira/browse/BIGTOP-582'>BIGTOP-582</a>] - when running Hadoop daemons pidofproc is mistakenly looking for 'su' instead of 'java' |
| </li> |
| <li>[<a href='https://issues.apache.org/jira/browse/BIGTOP-583'>BIGTOP-583</a>] - "Class path contains multiple SLF4J bindings" warnings |
| </li> |
| <li>[<a href='https://issues.apache.org/jira/browse/BIGTOP-585'>BIGTOP-585</a>] - hbase package has dangling symlinks |
| </li> |
| <li>[<a href='https://issues.apache.org/jira/browse/BIGTOP-586'>BIGTOP-586</a>] - HBase package should provide a versionless symlink to a jar for other projects to depend upon |
| </li> |
| <li>[<a href='https://issues.apache.org/jira/browse/BIGTOP-587'>BIGTOP-587</a>] - Hive package needs to depend on Zookeper and HBase |
| </li> |
| <li>[<a href='https://issues.apache.org/jira/browse/BIGTOP-588'>BIGTOP-588</a>] - Oozie puppet code needs to take care of initializing the DB |
| </li> |
| <li>[<a href='https://issues.apache.org/jira/browse/BIGTOP-589'>BIGTOP-589</a>] - TestLoadAndVerify's HBase scanner caching setting too high |
| </li> |
| <li>[<a href='https://issues.apache.org/jira/browse/BIGTOP-590'>BIGTOP-590</a>] - hadoop man page needs to be updated |
| </li> |
| <li>[<a href='https://issues.apache.org/jira/browse/BIGTOP-592'>BIGTOP-592</a>] - clean up content of conf.empty and conf.pseudo config files |
| </li> |
| <li>[<a href='https://issues.apache.org/jira/browse/BIGTOP-593'>BIGTOP-593</a>] - improve the package test to handle [arch=xx] in the repo file |
| </li> |
| <li>[<a href='https://issues.apache.org/jira/browse/BIGTOP-595'>BIGTOP-595</a>] - flume-ng agent should honor /etc/default settings |
| </li> |
| <li>[<a href='https://issues.apache.org/jira/browse/BIGTOP-596'>BIGTOP-596</a>] - move service configuration from groovy code to package xml manifest file |
| </li> |
| <li>[<a href='https://issues.apache.org/jira/browse/BIGTOP-597'>BIGTOP-597</a>] - Flume init scripts should not create the log and lock directories. |
| </li> |
| <li>[<a href='https://issues.apache.org/jira/browse/BIGTOP-598'>BIGTOP-598</a>] - missing zookeeper init on debian |
| </li> |
| <li>[<a href='https://issues.apache.org/jira/browse/BIGTOP-599'>BIGTOP-599</a>] - /var/lock/subsys may not exist on some distributions and this create some issues in Apache Hadoop |
| </li> |
| <li>[<a href='https://issues.apache.org/jira/browse/BIGTOP-600'>BIGTOP-600</a>] - hbase init script should not source hbase-config |
| </li> |
| <li>[<a href='https://issues.apache.org/jira/browse/BIGTOP-607'>BIGTOP-607</a>] - remove python build dependency from Hive package |
| </li> |
| <li>[<a href='https://issues.apache.org/jira/browse/BIGTOP-608'>BIGTOP-608</a>] - remove source/build artifacts from the Pig package |
| </li> |
| <li>[<a href='https://issues.apache.org/jira/browse/BIGTOP-609'>BIGTOP-609</a>] - add support for openjdk 1.7 |
| </li> |
| <li>[<a href='https://issues.apache.org/jira/browse/BIGTOP-616'>BIGTOP-616</a>] - Fix TestHadoopSmoke and TestHadoopExamples: tests look for streaming and examples jar in wrong directory |
| </li> |
| <li>[<a href='https://issues.apache.org/jira/browse/BIGTOP-626'>BIGTOP-626</a>] - small misc. issues with the newly introduced Giraph package |
| </li> |
| <li>[<a href='https://issues.apache.org/jira/browse/BIGTOP-630'>BIGTOP-630</a>] - Fix services priorities |
| </li> |
| <li>[<a href='https://issues.apache.org/jira/browse/BIGTOP-633'>BIGTOP-633</a>] - bigtop-utils packages should depend on 'which' |
| </li> |
| <li>[<a href='https://issues.apache.org/jira/browse/BIGTOP-636'>BIGTOP-636</a>] - a few minor tweaks to the Hue deployment code |
| </li> |
| <li>[<a href='https://issues.apache.org/jira/browse/BIGTOP-638'>BIGTOP-638</a>] - move <services> block from common package_date.xml to each platform's (yum, apt, zypper) package_data.xml |
| </li> |
| <li>[<a href='https://issues.apache.org/jira/browse/BIGTOP-639'>BIGTOP-639</a>] - sqoop-metastore cannot stop because "Could not load db driver class: org.hsqldb.jdbcDriver" |
| </li> |
| <li>[<a href='https://issues.apache.org/jira/browse/BIGTOP-642'>BIGTOP-642</a>] - Suse does not have a package named which |
| </li> |
| <li>[<a href='https://issues.apache.org/jira/browse/BIGTOP-643'>BIGTOP-643</a>] - Fix package statement in TestHDFSQuota |
| </li> |
| <li>[<a href='https://issues.apache.org/jira/browse/BIGTOP-646'>BIGTOP-646</a>] - update metadata for Hue in the package testing manifest |
| </li> |
| <li>[<a href='https://issues.apache.org/jira/browse/BIGTOP-647'>BIGTOP-647</a>] - service flume-node fail to start |
| </li> |
| <li>[<a href='https://issues.apache.org/jira/browse/BIGTOP-648'>BIGTOP-648</a>] - hbase-thrift cannot be started properly |
| </li> |
| <li>[<a href='https://issues.apache.org/jira/browse/BIGTOP-649'>BIGTOP-649</a>] - PackageTestCommon.checkRemoval() is broken |
| </li> |
| <li>[<a href='https://issues.apache.org/jira/browse/BIGTOP-650'>BIGTOP-650</a>] - Override libexecdir for bigtop-utils on mageia |
| </li> |
| </ul> |
| |
| <h2> Improvement |
| </h2> |
| <ul> |
| <li>[<a href='https://issues.apache.org/jira/browse/BIGTOP-266'>BIGTOP-266</a>] - Need to override default yarn task classpath |
| </li> |
| <li>[<a href='https://issues.apache.org/jira/browse/BIGTOP-273'>BIGTOP-273</a>] - Need to update puppet recipies for Hadoop 0.23 deployment |
| </li> |
| <li>[<a href='https://issues.apache.org/jira/browse/BIGTOP-313'>BIGTOP-313</a>] - Move puppet configuration out of manifest and into extlookup() CSV |
| </li> |
| <li>[<a href='https://issues.apache.org/jira/browse/BIGTOP-322'>BIGTOP-322</a>] - update .gitignore to ignore backup files and eclipse generated files. |
| </li> |
| <li>[<a href='https://issues.apache.org/jira/browse/BIGTOP-332'>BIGTOP-332</a>] - it would be nice to bump hadoop version to 0.23.1-SNAPSHOT across the stack |
| </li> |
| <li>[<a href='https://issues.apache.org/jira/browse/BIGTOP-366'>BIGTOP-366</a>] - Set some minimum versions for ZK + Flume |
| </li> |
| <li>[<a href='https://issues.apache.org/jira/browse/BIGTOP-371'>BIGTOP-371</a>] - Update bigtop repository url for the applance |
| </li> |
| <li>[<a href='https://issues.apache.org/jira/browse/BIGTOP-454'>BIGTOP-454</a>] - update oozie man page |
| </li> |
| <li>[<a href='https://issues.apache.org/jira/browse/BIGTOP-465'>BIGTOP-465</a>] - webhdfs isn't in the puppeted hadoop configuration |
| </li> |
| <li>[<a href='https://issues.apache.org/jira/browse/BIGTOP-466'>BIGTOP-466</a>] - Secure zookeeper support missing from puppet |
| </li> |
| <li>[<a href='https://issues.apache.org/jira/browse/BIGTOP-470'>BIGTOP-470</a>] - [puppet] Improve secure configuration for zk and hbase |
| </li> |
| <li>[<a href='https://issues.apache.org/jira/browse/BIGTOP-475'>BIGTOP-475</a>] - Provides initscript for the REST HBase gateway |
| </li> |
| <li>[<a href='https://issues.apache.org/jira/browse/BIGTOP-522'>BIGTOP-522</a>] - Minor Hive Packaging Cleanup |
| </li> |
| <li>[<a href='https://issues.apache.org/jira/browse/BIGTOP-534'>BIGTOP-534</a>] - Need init.d script for zkfc |
| </li> |
| <li>[<a href='https://issues.apache.org/jira/browse/BIGTOP-535'>BIGTOP-535</a>] - add httpfs config property pointing to hadoop conf dir |
| </li> |
| <li>[<a href='https://issues.apache.org/jira/browse/BIGTOP-555'>BIGTOP-555</a>] - Bump version of HBase to 0.92.1 |
| </li> |
| <li>[<a href='https://issues.apache.org/jira/browse/BIGTOP-567'>BIGTOP-567</a>] - Make sure we can detect the JAVA_HOME for java-package built JDK package |
| </li> |
| <li>[<a href='https://issues.apache.org/jira/browse/BIGTOP-572'>BIGTOP-572</a>] - Fix HDFS directory values in pseudo-conf hdfs-site.xml for 0.23+ NN/DN/SNN |
| </li> |
| <li>[<a href='https://issues.apache.org/jira/browse/BIGTOP-573'>BIGTOP-573</a>] - we no longer have to override container-executor.conf.dir |
| </li> |
| <li>[<a href='https://issues.apache.org/jira/browse/BIGTOP-577'>BIGTOP-577</a>] - [base conf] There's no hadoop-metrics2.properties present in the configs that are shipped. |
| </li> |
| </ul> |
| |
| <h2> New Feature |
| </h2> |
| <ul> |
| <li>[<a href='https://issues.apache.org/jira/browse/BIGTOP-248'>BIGTOP-248</a>] - Update packages for Hadoop 0.23 |
| </li> |
| <li>[<a href='https://issues.apache.org/jira/browse/BIGTOP-267'>BIGTOP-267</a>] - Need to implement implement makefiles logic for tarball builds |
| </li> |
| <li>[<a href='https://issues.apache.org/jira/browse/BIGTOP-306'>BIGTOP-306</a>] - Make a boxgrinder appliance |
| </li> |
| <li>[<a href='https://issues.apache.org/jira/browse/BIGTOP-405'>BIGTOP-405</a>] - Create a bootable ISO |
| </li> |
| <li>[<a href='https://issues.apache.org/jira/browse/BIGTOP-495'>BIGTOP-495</a>] - [puppet] Add support for HA namenodes |
| </li> |
| <li>[<a href='https://issues.apache.org/jira/browse/BIGTOP-570'>BIGTOP-570</a>] - Build package for Apache Giraph |
| </li> |
| <li>[<a href='https://issues.apache.org/jira/browse/BIGTOP-578'>BIGTOP-578</a>] - Integrate Hue 2.0.0 into Bigtop |
| </li> |
| <li>[<a href='https://issues.apache.org/jira/browse/BIGTOP-602'>BIGTOP-602</a>] - Bigtop 0.4.0 release |
| </li> |
| </ul> |
| |
| <h2> Task |
| </h2> |
| <ul> |
| <li>[<a href='https://issues.apache.org/jira/browse/BIGTOP-298'>BIGTOP-298</a>] - Upgrade to ZooKeeper 3.4.1 |
| </li> |
| <li>[<a href='https://issues.apache.org/jira/browse/BIGTOP-319'>BIGTOP-319</a>] - update to Mahout 0.6 |
| </li> |
| <li>[<a href='https://issues.apache.org/jira/browse/BIGTOP-494'>BIGTOP-494</a>] - Create Flume 1.1.0 packages in Bigtop |
| </li> |
| </ul> |
| |
| <h2> Test |
| </h2> |
| <ul> |
| <li>[<a href='https://issues.apache.org/jira/browse/BIGTOP-321'>BIGTOP-321</a>] - Make TestLoadAndVerify parameterizable and runnable from command line |
| </li> |
| <li>[<a href='https://issues.apache.org/jira/browse/BIGTOP-444'>BIGTOP-444</a>] - Add sqoop smoke tests |
| </li> |
| <li>[<a href='https://issues.apache.org/jira/browse/BIGTOP-569'>BIGTOP-569</a>] - fix for TestCLI failures due to change in behavior of hadoop fs -put |
| </li> |
| <li>[<a href='https://issues.apache.org/jira/browse/BIGTOP-610'>BIGTOP-610</a>] - Add basic hdfs fsck test and move logError helper to bigtop-test-framework |
| </li> |
| <li>[<a href='https://issues.apache.org/jira/browse/BIGTOP-611'>BIGTOP-611</a>] - Add HBase TestImportTsv |
| </li> |
| <li>[<a href='https://issues.apache.org/jira/browse/BIGTOP-618'>BIGTOP-618</a>] - Add HBase hbck test |
| </li> |
| <li>[<a href='https://issues.apache.org/jira/browse/BIGTOP-619'>BIGTOP-619</a>] - Add HBase CopyTable test |
| </li> |
| <li>[<a href='https://issues.apache.org/jira/browse/BIGTOP-620'>BIGTOP-620</a>] - Add test for dfsadmin commands |
| </li> |
| <li>[<a href='https://issues.apache.org/jira/browse/BIGTOP-622'>BIGTOP-622</a>] - Add test for HDFS Balancer |
| </li> |
| <li>[<a href='https://issues.apache.org/jira/browse/BIGTOP-623'>BIGTOP-623</a>] - Add test for HDFS Quota Testing |
| </li> |
| <li>[<a href='https://issues.apache.org/jira/browse/BIGTOP-627'>BIGTOP-627</a>] - Add HBase balancer test |
| </li> |
| <li>[<a href='https://issues.apache.org/jira/browse/BIGTOP-631'>BIGTOP-631</a>] - Add HBase Import/Export test |
| </li> |
| <li>[<a href='https://issues.apache.org/jira/browse/BIGTOP-641'>BIGTOP-641</a>] - Add hdfs fsck options in TestFsck |
| </li> |
| </ul> |
| |
| <h1>Release Notes - Bigtop - Version 0.2.0</h1> |
| <h2> Sub-task |
| </h2> |
| <ul> |
| <li>[<a href='https://issues.apache.org/jira/browse/BIGTOP-54'>BIGTOP-54</a>] - Bump version of oozie to 2.3.2 |
| </li> |
| <li>[<a href='https://issues.apache.org/jira/browse/BIGTOP-55'>BIGTOP-55</a>] - Bump version of sqoop to sqoop-1.3.0 |
| </li> |
| <li>[<a href='https://issues.apache.org/jira/browse/BIGTOP-56'>BIGTOP-56</a>] - Bump version of hive to hive-0.7.1 |
| </li> |
| <li>[<a href='https://issues.apache.org/jira/browse/BIGTOP-80'>BIGTOP-80</a>] - Add package dependencies to Zookeeper RPM for programs invoked from install/uninstall scripts |
| </li> |
| <li>[<a href='https://issues.apache.org/jira/browse/BIGTOP-120'>BIGTOP-120</a>] - Bump version of pig to 0.9.1 |
| </li> |
| <li>[<a href='https://issues.apache.org/jira/browse/BIGTOP-121'>BIGTOP-121</a>] - Bump version of HBase to 0.90.4 |
| </li> |
| <li>[<a href='https://issues.apache.org/jira/browse/BIGTOP-167'>BIGTOP-167</a>] - All of Hadoop wrapper scripts and init.d scripts need to start include find-java code from bigtop-utils |
| </li> |
| <li>[<a href='https://issues.apache.org/jira/browse/BIGTOP-171'>BIGTOP-171</a>] - All of Pig wrapper scripts and init.d scripts need to start include find-java code from bigtop-utils |
| </li> |
| <li>[<a href='https://issues.apache.org/jira/browse/BIGTOP-175'>BIGTOP-175</a>] - All of HBase wrapper scripts and init.d scripts need to start include find-java code from bigtop-utils |
| </li> |
| <li>[<a href='https://issues.apache.org/jira/browse/BIGTOP-178'>BIGTOP-178</a>] - All of Flume wrapper scripts and init.d scripts need to start include find-java code from bigtop-utils |
| </li> |
| <li>[<a href='https://issues.apache.org/jira/browse/BIGTOP-179'>BIGTOP-179</a>] - All of Hive wrapper scripts and init.d scripts need to start include find-java code from bigtop-utils |
| </li> |
| <li>[<a href='https://issues.apache.org/jira/browse/BIGTOP-180'>BIGTOP-180</a>] - All of Mahout wrapper scripts and init.d scripts need to start include find-java code from bigtop-utils |
| </li> |
| <li>[<a href='https://issues.apache.org/jira/browse/BIGTOP-182'>BIGTOP-182</a>] - All of Oozie wrapper scripts and init.d scripts need to start include find-java code from bigtop-utils |
| </li> |
| <li>[<a href='https://issues.apache.org/jira/browse/BIGTOP-184'>BIGTOP-184</a>] - All of Sqoop wrapper scripts and init.d scripts need to start include find-java code from bigtop-utils |
| </li> |
| <li>[<a href='https://issues.apache.org/jira/browse/BIGTOP-188'>BIGTOP-188</a>] - All of Whirr wrapper scripts and init.d scripts need to start include find-java code from bigtop-utils |
| </li> |
| <li>[<a href='https://issues.apache.org/jira/browse/BIGTOP-190'>BIGTOP-190</a>] - All of Zookeeper wrapper scripts and init.d scripts need to start include find-java code from bigtop-utils |
| </li> |
| </ul> |
| |
| <h2> Bug |
| </h2> |
| <ul> |
| <li>[<a href='https://issues.apache.org/jira/browse/BIGTOP-3'>BIGTOP-3</a>] - gitignore files need to be removed from SVN |
| </li> |
| <li>[<a href='https://issues.apache.org/jira/browse/BIGTOP-4'>BIGTOP-4</a>] - Remove references to Cloudera's internal infrastructure |
| </li> |
| <li>[<a href='https://issues.apache.org/jira/browse/BIGTOP-15'>BIGTOP-15</a>] - hadoop ubuntu packages need to have libssl-dev as a build dependency |
| </li> |
| <li>[<a href='https://issues.apache.org/jira/browse/BIGTOP-20'>BIGTOP-20</a>] - hard-coded pid location in Hadoop init.d scripts |
| </li> |
| <li>[<a href='https://issues.apache.org/jira/browse/BIGTOP-25'>BIGTOP-25</a>] - Standardize JAVA_HOME detection |
| </li> |
| <li>[<a href='https://issues.apache.org/jira/browse/BIGTOP-27'>BIGTOP-27</a>] - Add disclaimer text |
| </li> |
| <li>[<a href='https://issues.apache.org/jira/browse/BIGTOP-35'>BIGTOP-35</a>] - /usr/share/doc/flume and /etc/flume are owned by flume:flume |
| </li> |
| <li>[<a href='https://issues.apache.org/jira/browse/BIGTOP-37'>BIGTOP-37</a>] - The following config files are not marked as %config on RPM systems |
| </li> |
| <li>[<a href='https://issues.apache.org/jira/browse/BIGTOP-40'>BIGTOP-40</a>] - iTest package names/groupIds need to be moved to org.apache rather than com.cloudera |
| </li> |
| <li>[<a href='https://issues.apache.org/jira/browse/BIGTOP-43'>BIGTOP-43</a>] - Whirr and HBase aren't actually building from source in Debian packages |
| </li> |
| <li>[<a href='https://issues.apache.org/jira/browse/BIGTOP-45'>BIGTOP-45</a>] - Fix build issue for Mageia and openSUSE |
| </li> |
| <li>[<a href='https://issues.apache.org/jira/browse/BIGTOP-46'>BIGTOP-46</a>] - hadoop-native Debian package lists libz1 as Depends, libz-dev as Build-Depends |
| </li> |
| <li>[<a href='https://issues.apache.org/jira/browse/BIGTOP-47'>BIGTOP-47</a>] - Invalid download URL for whirr |
| </li> |
| <li>[<a href='https://issues.apache.org/jira/browse/BIGTOP-48'>BIGTOP-48</a>] - Fix pig for Mageia |
| </li> |
| <li>[<a href='https://issues.apache.org/jira/browse/BIGTOP-50'>BIGTOP-50</a>] - Flume init script's dependency on syslog needs to be removed |
| </li> |
| <li>[<a href='https://issues.apache.org/jira/browse/BIGTOP-57'>BIGTOP-57</a>] - Apt repo creation fails due to invalid distributions file |
| </li> |
| <li>[<a href='https://issues.apache.org/jira/browse/BIGTOP-61'>BIGTOP-61</a>] - HBase fails to add HADOOP_CONF_DIR to its classpath |
| </li> |
| <li>[<a href='https://issues.apache.org/jira/browse/BIGTOP-62'>BIGTOP-62</a>] - /usr/lib/hbase and everything within is owned by hbase:hbase |
| </li> |
| <li>[<a href='https://issues.apache.org/jira/browse/BIGTOP-63'>BIGTOP-63</a>] - Hbase leaves some unnecessary directories and symlinks when being uninstalled |
| </li> |
| <li>[<a href='https://issues.apache.org/jira/browse/BIGTOP-66'>BIGTOP-66</a>] - Packages need "Bigtop" identifier in version string |
| </li> |
| <li>[<a href='https://issues.apache.org/jira/browse/BIGTOP-68'>BIGTOP-68</a>] - bigtop-tests/test-artifacts have all their code in src/test, but those aren't tests to be run in that context |
| </li> |
| <li>[<a href='https://issues.apache.org/jira/browse/BIGTOP-69'>BIGTOP-69</a>] - Certain tests in iTest common require extraneous dependencies and should be @Ignored for now |
| </li> |
| <li>[<a href='https://issues.apache.org/jira/browse/BIGTOP-71'>BIGTOP-71</a>] - Unit test failures in bigtop-test-framework due to multiple Ant versions on classpath |
| </li> |
| <li>[<a href='https://issues.apache.org/jira/browse/BIGTOP-72'>BIGTOP-72</a>] - Gmaven plugin needs to be explicitly bound to compilation goals |
| </li> |
| <li>[<a href='https://issues.apache.org/jira/browse/BIGTOP-73'>BIGTOP-73</a>] - oozie-client can't be safely removed on Debian |
| </li> |
| <li>[<a href='https://issues.apache.org/jira/browse/BIGTOP-74'>BIGTOP-74</a>] - Add Mahout to package readiness tests |
| </li> |
| <li>[<a href='https://issues.apache.org/jira/browse/BIGTOP-75'>BIGTOP-75</a>] - Mahout package is broken |
| </li> |
| <li>[<a href='https://issues.apache.org/jira/browse/BIGTOP-77'>BIGTOP-77</a>] - All of our config files should be marked %config and (noreplace) |
| </li> |
| <li>[<a href='https://issues.apache.org/jira/browse/BIGTOP-81'>BIGTOP-81</a>] - oozie-setup.sh script fails if Oozie has not been started once |
| </li> |
| <li>[<a href='https://issues.apache.org/jira/browse/BIGTOP-83'>BIGTOP-83</a>] - Advanced checks in checkRemoval need to be moved out |
| </li> |
| <li>[<a href='https://issues.apache.org/jira/browse/BIGTOP-84'>BIGTOP-84</a>] - Package removal fails in case alternatives are deleted or damaged |
| </li> |
| <li>[<a href='https://issues.apache.org/jira/browse/BIGTOP-85'>BIGTOP-85</a>] - hadoop package ships native files |
| </li> |
| <li>[<a href='https://issues.apache.org/jira/browse/BIGTOP-86'>BIGTOP-86</a>] - Misc. issues with Oozie package |
| </li> |
| <li>[<a href='https://issues.apache.org/jira/browse/BIGTOP-87'>BIGTOP-87</a>] - The following packages don't remove alternatives: flume, hadoop-pig, hadoop-hive, hadoop-hbase |
| </li> |
| <li>[<a href='https://issues.apache.org/jira/browse/BIGTOP-88'>BIGTOP-88</a>] - Mahout package contains actual Hadoop jar, rather than symlinking to it |
| </li> |
| <li>[<a href='https://issues.apache.org/jira/browse/BIGTOP-91'>BIGTOP-91</a>] - Docs should be in %{_docdir}/<PACKAGE_NAME>-<PACKAGE_VERSION> |
| </li> |
| <li>[<a href='https://issues.apache.org/jira/browse/BIGTOP-92'>BIGTOP-92</a>] - Flume's dependency on ZK needs to be the same for DEB as it is for RPM |
| </li> |
| <li>[<a href='https://issues.apache.org/jira/browse/BIGTOP-93'>BIGTOP-93</a>] - ZK dependencies can not be satisfied on SUSE |
| </li> |
| <li>[<a href='https://issues.apache.org/jira/browse/BIGTOP-94'>BIGTOP-94</a>] - chkconfig startup priorities need to be normalized |
| </li> |
| <li>[<a href='https://issues.apache.org/jira/browse/BIGTOP-97'>BIGTOP-97</a>] - default files need to be normalized and moved to common |
| </li> |
| <li>[<a href='https://issues.apache.org/jira/browse/BIGTOP-99'>BIGTOP-99</a>] - Fix Sqoop for Mageia |
| </li> |
| <li>[<a href='https://issues.apache.org/jira/browse/BIGTOP-102'>BIGTOP-102</a>] - daemons need to be taken care of when packages are installed/upgraded/uninstalled |
| </li> |
| <li>[<a href='https://issues.apache.org/jira/browse/BIGTOP-104'>BIGTOP-104</a>] - hadoop daemons can not be started because hadoop-config.sh resets HADOOP_HOME |
| </li> |
| <li>[<a href='https://issues.apache.org/jira/browse/BIGTOP-108'>BIGTOP-108</a>] - oozie docs are installed at the incorrect location |
| </li> |
| <li>[<a href='https://issues.apache.org/jira/browse/BIGTOP-109'>BIGTOP-109</a>] - Hadoop should not format the namenode on installation |
| </li> |
| <li>[<a href='https://issues.apache.org/jira/browse/BIGTOP-110'>BIGTOP-110</a>] - DN can't be started in secure configuration on SLES |
| </li> |
| <li>[<a href='https://issues.apache.org/jira/browse/BIGTOP-113'>BIGTOP-113</a>] - redhat-lsb is obviously not available on Mageia |
| </li> |
| <li>[<a href='https://issues.apache.org/jira/browse/BIGTOP-114'>BIGTOP-114</a>] - Pig RPM package contains more files than it should |
| </li> |
| <li>[<a href='https://issues.apache.org/jira/browse/BIGTOP-115'>BIGTOP-115</a>] - Pig do-component-build hardcodes dist.dir as debian/tmp |
| </li> |
| <li>[<a href='https://issues.apache.org/jira/browse/BIGTOP-119'>BIGTOP-119</a>] - Create version-less symlinks of hadoop jars |
| </li> |
| <li>[<a href='https://issues.apache.org/jira/browse/BIGTOP-122'>BIGTOP-122</a>] - enable hadoop-sbin package |
| </li> |
| <li>[<a href='https://issues.apache.org/jira/browse/BIGTOP-123'>BIGTOP-123</a>] - enable hadoop-fuse package |
| </li> |
| <li>[<a href='https://issues.apache.org/jira/browse/BIGTOP-124'>BIGTOP-124</a>] - documentation on SLES is not supposed to have package version embedded in the directory name |
| </li> |
| <li>[<a href='https://issues.apache.org/jira/browse/BIGTOP-125'>BIGTOP-125</a>] - whir package is full of build artifacts |
| </li> |
| <li>[<a href='https://issues.apache.org/jira/browse/BIGTOP-126'>BIGTOP-126</a>] - zookeeper rpm should require groupadd/useradd |
| </li> |
| <li>[<a href='https://issues.apache.org/jira/browse/BIGTOP-127'>BIGTOP-127</a>] - BIGTOP-120 broke build on at least Fedora (and Mageia) |
| </li> |
| <li>[<a href='https://issues.apache.org/jira/browse/BIGTOP-128'>BIGTOP-128</a>] - BIGTOP-90 broke hadoop on Mageia |
| </li> |
| <li>[<a href='https://issues.apache.org/jira/browse/BIGTOP-129'>BIGTOP-129</a>] - oozie init.d scripts should transition to using oozied.sh from upstream |
| </li> |
| <li>[<a href='https://issues.apache.org/jira/browse/BIGTOP-130'>BIGTOP-130</a>] - Mahout package has an unneeded dependency on chkconfig |
| </li> |
| <li>[<a href='https://issues.apache.org/jira/browse/BIGTOP-131'>BIGTOP-131</a>] - RPM dependencies for flume need to be optimized |
| </li> |
| <li>[<a href='https://issues.apache.org/jira/browse/BIGTOP-132'>BIGTOP-132</a>] - hadoop datanode on SLES returns an incorrect code on stop/start |
| </li> |
| <li>[<a href='https://issues.apache.org/jira/browse/BIGTOP-133'>BIGTOP-133</a>] - hadoop packages should set up nofile limits automatically |
| </li> |
| <li>[<a href='https://issues.apache.org/jira/browse/BIGTOP-134'>BIGTOP-134</a>] - hbase packages should set up nofile limits automatically |
| </li> |
| <li>[<a href='https://issues.apache.org/jira/browse/BIGTOP-136'>BIGTOP-136</a>] - hadoop package still leaves binary files in /usr/lib/hadoop/lib |
| </li> |
| <li>[<a href='https://issues.apache.org/jira/browse/BIGTOP-137'>BIGTOP-137</a>] - task-controller needs to be rebuilt |
| </li> |
| <li>[<a href='https://issues.apache.org/jira/browse/BIGTOP-138'>BIGTOP-138</a>] - task-controller binary needs to be root:mapred with 4750 permissions |
| </li> |
| <li>[<a href='https://issues.apache.org/jira/browse/BIGTOP-139'>BIGTOP-139</a>] - links to jsvc and task-controller need to be provided in order to make hard-coded values work |
| </li> |
| <li>[<a href='https://issues.apache.org/jira/browse/BIGTOP-140'>BIGTOP-140</a>] - need to workaround HDFS-1943 |
| </li> |
| <li>[<a href='https://issues.apache.org/jira/browse/BIGTOP-141'>BIGTOP-141</a>] - hadoop now requires an explicit declaration of a HADOOP_SECURE_DN_USER in order to run a secure datanode |
| </li> |
| <li>[<a href='https://issues.apache.org/jira/browse/BIGTOP-142'>BIGTOP-142</a>] - need to update zookeeper manifest to the state of packages |
| </li> |
| <li>[<a href='https://issues.apache.org/jira/browse/BIGTOP-143'>BIGTOP-143</a>] - need to update hadoop manifest to the state of packages |
| </li> |
| <li>[<a href='https://issues.apache.org/jira/browse/BIGTOP-144'>BIGTOP-144</a>] - kerberos deployment needs to be made compatible with default JRE crypto setup |
| </li> |
| <li>[<a href='https://issues.apache.org/jira/browse/BIGTOP-145'>BIGTOP-145</a>] - make cluster.pp be able to handle secure and unsecure deployments |
| </li> |
| <li>[<a href='https://issues.apache.org/jira/browse/BIGTOP-148'>BIGTOP-148</a>] - Hadoop fuse man page does not have the right permission and RPMs should not specify its extension |
| </li> |
| <li>[<a href='https://issues.apache.org/jira/browse/BIGTOP-149'>BIGTOP-149</a>] - HBase now requires commons-configuration jar to be in its classpath |
| </li> |
| <li>[<a href='https://issues.apache.org/jira/browse/BIGTOP-150'>BIGTOP-150</a>] - hadoop puppet deployment needs to install hadoop-sbin on datanodes when security is turned on |
| </li> |
| <li>[<a href='https://issues.apache.org/jira/browse/BIGTOP-151'>BIGTOP-151</a>] - need to provide more test coverage for HBase testing |
| </li> |
| <li>[<a href='https://issues.apache.org/jira/browse/BIGTOP-152'>BIGTOP-152</a>] - TestHadoopExamples needs refactoring into a parameterized test |
| </li> |
| <li>[<a href='https://issues.apache.org/jira/browse/BIGTOP-154'>BIGTOP-154</a>] - all of our /usr/bin wrapper scripts and init.d scripts need to start include find-java code from bigtop-utils |
| </li> |
| <li>[<a href='https://issues.apache.org/jira/browse/BIGTOP-155'>BIGTOP-155</a>] - need to implement a uniform way of versioning dependencies for test artifacts |
| </li> |
| <li>[<a href='https://issues.apache.org/jira/browse/BIGTOP-156'>BIGTOP-156</a>] - We should only run autoreconf when there is a compatible autotools installed |
| </li> |
| <li>[<a href='https://issues.apache.org/jira/browse/BIGTOP-158'>BIGTOP-158</a>] - oozie build pulls into oozie.war incorrect version of hadoop-core jar file |
| </li> |
| <li>[<a href='https://issues.apache.org/jira/browse/BIGTOP-159'>BIGTOP-159</a>] - oozie init.d script is not executable |
| </li> |
| <li>[<a href='https://issues.apache.org/jira/browse/BIGTOP-160'>BIGTOP-160</a>] - hadoop has deprecated HADOOP_HOME |
| </li> |
| <li>[<a href='https://issues.apache.org/jira/browse/BIGTOP-161'>BIGTOP-161</a>] - the new layout that Pig script adopted needs to be worked around |
| </li> |
| <li>[<a href='https://issues.apache.org/jira/browse/BIGTOP-163'>BIGTOP-163</a>] - stock hadoop doesn't support wildcards in proxy users |
| </li> |
| <li>[<a href='https://issues.apache.org/jira/browse/BIGTOP-164'>BIGTOP-164</a>] - lzo codecs need to be disabled everywhere in Bigtop |
| </li> |
| <li>[<a href='https://issues.apache.org/jira/browse/BIGTOP-165'>BIGTOP-165</a>] - oozie manifest includes functionality (sqoop and hive actions) that is not in oozie |
| </li> |
| <li>[<a href='https://issues.apache.org/jira/browse/BIGTOP-166'>BIGTOP-166</a>] - docs are missing from the mahout package |
| </li> |
| <li>[<a href='https://issues.apache.org/jira/browse/BIGTOP-169'>BIGTOP-169</a>] - Hadoop should buildrequire openssl-devel for centos builds |
| </li> |
| <li>[<a href='https://issues.apache.org/jira/browse/BIGTOP-170'>BIGTOP-170</a>] - bigtop-utils does not look for openJDK |
| </li> |
| <li>[<a href='https://issues.apache.org/jira/browse/BIGTOP-173'>BIGTOP-173</a>] - we still have references to hadoop-0.20 in our puppet code |
| </li> |
| <li>[<a href='https://issues.apache.org/jira/browse/BIGTOP-174'>BIGTOP-174</a>] - Does pig really requires git to build? |
| </li> |
| <li>[<a href='https://issues.apache.org/jira/browse/BIGTOP-176'>BIGTOP-176</a>] - Packages should set their mainteners to bigtop dev mailing list |
| </li> |
| <li>[<a href='https://issues.apache.org/jira/browse/BIGTOP-181'>BIGTOP-181</a>] - puppeted hadoop doesn't place PID files into /var/run/hadoop |
| </li> |
| <li>[<a href='https://issues.apache.org/jira/browse/BIGTOP-183'>BIGTOP-183</a>] - hadoop fuse manpage set to 755 instead of 644 |
| </li> |
| <li>[<a href='https://issues.apache.org/jira/browse/BIGTOP-185'>BIGTOP-185</a>] - Running 'sudo /sbin/start flume-master start' on SLES11 doesn't have $USER variable. |
| </li> |
| <li>[<a href='https://issues.apache.org/jira/browse/BIGTOP-189'>BIGTOP-189</a>] - hadoop daemons do not run under the dedicated users (hdfs, mapred) |
| </li> |
| <li>[<a href='https://issues.apache.org/jira/browse/BIGTOP-192'>BIGTOP-192</a>] - oozie package needs to depend on unzip |
| </li> |
| <li>[<a href='https://issues.apache.org/jira/browse/BIGTOP-193'>BIGTOP-193</a>] - zookeeper doesn't generate any logs |
| </li> |
| <li>[<a href='https://issues.apache.org/jira/browse/BIGTOP-194'>BIGTOP-194</a>] - source is not a sh(1) command |
| </li> |
| <li>[<a href='https://issues.apache.org/jira/browse/BIGTOP-196'>BIGTOP-196</a>] - point Bigtop at the correct version of HBase inside |
| </li> |
| <li>[<a href='https://issues.apache.org/jira/browse/BIGTOP-197'>BIGTOP-197</a>] - Package testing artifact needs to be refactored |
| </li> |
| <li>[<a href='https://issues.apache.org/jira/browse/BIGTOP-198'>BIGTOP-198</a>] - hadoop-daemon.sh owned by many packages |
| </li> |
| <li>[<a href='https://issues.apache.org/jira/browse/BIGTOP-199'>BIGTOP-199</a>] - whirr docs are installed in the incorrect location |
| </li> |
| <li>[<a href='https://issues.apache.org/jira/browse/BIGTOP-201'>BIGTOP-201</a>] - bigtop package has an incorrect dependency on libhdfs.so |
| </li> |
| <li>[<a href='https://issues.apache.org/jira/browse/BIGTOP-202'>BIGTOP-202</a>] - zookeeper package is missing zoo.cfg |
| </li> |
| <li>[<a href='https://issues.apache.org/jira/browse/BIGTOP-203'>BIGTOP-203</a>] - sqoop needs to have access to hadoop .jars in its lib |
| </li> |
| <li>[<a href='https://issues.apache.org/jira/browse/BIGTOP-205'>BIGTOP-205</a>] - zookeeper-server doesn't do nohup before launching a damon |
| </li> |
| <li>[<a href='https://issues.apache.org/jira/browse/BIGTOP-206'>BIGTOP-206</a>] - during deployment time hdfs/mapred dir creation should be managed by hadoop module |
| </li> |
| <li>[<a href='https://issues.apache.org/jira/browse/BIGTOP-207'>BIGTOP-207</a>] - zookeeper doesn't allow for overriding the location of the PID file |
| </li> |
| <li>[<a href='https://issues.apache.org/jira/browse/BIGTOP-208'>BIGTOP-208</a>] - zookeeper does not depend on git or subversion |
| </li> |
| <li>[<a href='https://issues.apache.org/jira/browse/BIGTOP-211'>BIGTOP-211</a>] - Remove packaging code that will transition hadoop user/group to hdfs/mapred |
| </li> |
| <li>[<a href='https://issues.apache.org/jira/browse/BIGTOP-212'>BIGTOP-212</a>] - need to disable tests for features missing from Bigtop 0.2.0 |
| </li> |
| <li>[<a href='https://issues.apache.org/jira/browse/BIGTOP-214'>BIGTOP-214</a>] - sequencing in puppet module for Hadoop needs to be imporved |
| </li> |
| <li>[<a href='https://issues.apache.org/jira/browse/BIGTOP-215'>BIGTOP-215</a>] - make site.pp a bit more friendly to how we start up cluster in Bigtop jenkins |
| </li> |
| <li>[<a href='https://issues.apache.org/jira/browse/BIGTOP-216'>BIGTOP-216</a>] - make oozie tests more robust in finding oozie-examples.tar.gz |
| </li> |
| <li>[<a href='https://issues.apache.org/jira/browse/BIGTOP-217'>BIGTOP-217</a>] - workaround Hive SQL parser in headers for our tests |
| </li> |
| </ul> |
| |
| <h2> Improvement |
| </h2> |
| <ul> |
| <li>[<a href='https://issues.apache.org/jira/browse/BIGTOP-11'>BIGTOP-11</a>] - Add Mahout to Bigtop |
| </li> |
| <li>[<a href='https://issues.apache.org/jira/browse/BIGTOP-100'>BIGTOP-100</a>] - Abstract component build logic from deb/rpm into common script |
| </li> |
| <li>[<a href='https://issues.apache.org/jira/browse/BIGTOP-112'>BIGTOP-112</a>] - Remove or replace textutils by coreutils dependency |
| </li> |
| <li>[<a href='https://issues.apache.org/jira/browse/BIGTOP-195'>BIGTOP-195</a>] - Document openSUSE 11.4 dependencies |
| </li> |
| </ul> |
| |
| <h2> New Feature |
| </h2> |
| <ul> |
| <li>[<a href='https://issues.apache.org/jira/browse/BIGTOP-28'>BIGTOP-28</a>] - Need to bump upstream version dependencies for the next release of Bigtop for hive, flume and sqoop |
| </li> |
| <li>[<a href='https://issues.apache.org/jira/browse/BIGTOP-29'>BIGTOP-29</a>] - Remove java dependency from all os types |
| </li> |
| <li>[<a href='https://issues.apache.org/jira/browse/BIGTOP-30'>BIGTOP-30</a>] - flume-master and flume-node packages should not own /usr/lib/flume/bin/flume-daemon.sh |
| </li> |
| <li>[<a href='https://issues.apache.org/jira/browse/BIGTOP-31'>BIGTOP-31</a>] - remove /usr/lib/whirr/cli/whirr.log from packaging |
| </li> |
| <li>[<a href='https://issues.apache.org/jira/browse/BIGTOP-32'>BIGTOP-32</a>] - Hadoop fuse package should include a file with defaults |
| </li> |
| <li>[<a href='https://issues.apache.org/jira/browse/BIGTOP-34'>BIGTOP-34</a>] - Add Hive server package |
| </li> |
| <li>[<a href='https://issues.apache.org/jira/browse/BIGTOP-44'>BIGTOP-44</a>] - Add a FAQ |
| </li> |
| <li>[<a href='https://issues.apache.org/jira/browse/BIGTOP-95'>BIGTOP-95</a>] - Puppet-based deployment infrastructure needs to be added to bigtop |
| </li> |
| <li>[<a href='https://issues.apache.org/jira/browse/BIGTOP-111'>BIGTOP-111</a>] - Add support for Mageia in the test framework |
| </li> |
| </ul> |
| |
| <h2> Task |
| </h2> |
| <ul> |
| <li>[<a href='https://issues.apache.org/jira/browse/BIGTOP-59'>BIGTOP-59</a>] - Reorganize source repo in a more self-explanatory manner |
| </li> |
| </ul> |
| |
| |
| <h1>Release Notes - Bigtop - Version 0.1.0</h1> |
| |
| <h2> Bug |
| </h2> |
| <ul> |
| <li>[<a href='https://issues.apache.org/jira/browse/BIGTOP-2'>BIGTOP-2</a>] - License headers need to be added |
| </li> |
| <li>[<a href='https://issues.apache.org/jira/browse/BIGTOP-7'>BIGTOP-7</a>] - Some components are pulling tarballs from archive.cloudera.com/tarballs rather than Apache |
| </li> |
| <li>[<a href='https://issues.apache.org/jira/browse/BIGTOP-8'>BIGTOP-8</a>] - Debian copyright files need to be updated for ASF in the right format |
| </li> |
| <li>[<a href='https://issues.apache.org/jira/browse/BIGTOP-10'>BIGTOP-10</a>] - Fix NOTICE file |
| </li> |
| <li>[<a href='https://issues.apache.org/jira/browse/BIGTOP-13'>BIGTOP-13</a>] - BIGTOP-7 introduced a version mismatch for Hive |
| </li> |
| <li>[<a href='https://issues.apache.org/jira/browse/BIGTOP-18'>BIGTOP-18</a>] - OrderedParameterized.java is not ASL-compatbile |
| </li> |
| <li>[<a href='https://issues.apache.org/jira/browse/BIGTOP-23'>BIGTOP-23</a>] - Out of heap errors when building pig |
| </li> |
| <li>[<a href='https://issues.apache.org/jira/browse/BIGTOP-24'>BIGTOP-24</a>] - Errors downloading tarballs from dist.apache.org via curl |
| </li> |
| </ul> |
| |
| <h2> Task |
| </h2> |
| <ul> |
| <li>[<a href='https://issues.apache.org/jira/browse/BIGTOP-5'>BIGTOP-5</a>] - Remove Cloudera references in packaging and test source. |
| </li> |
| <li>[<a href='https://issues.apache.org/jira/browse/BIGTOP-6'>BIGTOP-6</a>] - Add tarball target to top-level makefile |
| </li> |
| <li>[<a href='https://issues.apache.org/jira/browse/BIGTOP-9'>BIGTOP-9</a>] - Set up Bigtop podling website |
| </li> |
| <li>[<a href='https://issues.apache.org/jira/browse/BIGTOP-14'>BIGTOP-14</a>] - Add CHANGES.txt generation to Makefile |
| </li> |
| </ul> |
| |
| </body> |
| </document> |
