blob: dbd9eb7d19b5deda22aa48f8ed8b2aa6f07cd6ba [file] [log] [blame]
From common-dev-return-77583-apmail-hadoop-common-dev-archive=hadoop.apache.org@hadoop.apache.org Wed Feb 1 00:23:25 2012
Return-Path: <common-dev-return-77583-apmail-hadoop-common-dev-archive=hadoop.apache.org@hadoop.apache.org>
X-Original-To: apmail-hadoop-common-dev-archive@www.apache.org
Delivered-To: apmail-hadoop-common-dev-archive@www.apache.org
Received: from mail.apache.org (hermes.apache.org [140.211.11.3])
by minotaur.apache.org (Postfix) with SMTP id 04D6296E1
for <apmail-hadoop-common-dev-archive@www.apache.org>; Wed, 1 Feb 2012 00:23:25 +0000 (UTC)
Received: (qmail 97997 invoked by uid 500); 1 Feb 2012 00:23:21 -0000
Delivered-To: apmail-hadoop-common-dev-archive@hadoop.apache.org
Received: (qmail 97504 invoked by uid 500); 1 Feb 2012 00:23:20 -0000
Mailing-List: contact common-dev-help@hadoop.apache.org; run by ezmlm
Precedence: bulk
List-Help: <mailto:common-dev-help@hadoop.apache.org>
List-Unsubscribe: <mailto:common-dev-unsubscribe@hadoop.apache.org>
List-Post: <mailto:common-dev@hadoop.apache.org>
List-Id: <common-dev.hadoop.apache.org>
Reply-To: common-dev@hadoop.apache.org
Delivered-To: mailing list common-dev@hadoop.apache.org
Received: (qmail 97483 invoked by uid 99); 1 Feb 2012 00:23:20 -0000
Received: from nike.apache.org (HELO nike.apache.org) (192.87.106.230)
by apache.org (qpsmtpd/0.29) with ESMTP; Wed, 01 Feb 2012 00:23:20 +0000
X-ASF-Spam-Status: No, hits=-2000.0 required=5.0
tests=ALL_TRUSTED,T_RP_MATCHES_RCVD
X-Spam-Check-By: apache.org
Received: from [140.211.11.116] (HELO hel.zones.apache.org) (140.211.11.116)
by apache.org (qpsmtpd/0.29) with ESMTP; Wed, 01 Feb 2012 00:23:17 +0000
Received: from hel.zones.apache.org (hel.zones.apache.org [140.211.11.116])
by hel.zones.apache.org (Postfix) with ESMTP id CF2F31679FA
for <common-dev@hadoop.apache.org>; Wed, 1 Feb 2012 00:22:56 +0000 (UTC)
Date: Wed, 1 Feb 2012 00:22:56 +0000 (UTC)
From: "Roman Shaposhnik (Created) (JIRA)" <jira@apache.org>
To: common-dev@hadoop.apache.org
Message-ID: <250130243.649.1328055776849.JavaMail.tomcat@hel.zones.apache.org>
Subject: [jira] [Created] (HADOOP-8010) hadoop-config.sh spews error message
when HADOOP_HOME_WARN_SUPPRESS is set to true and HADOOP_HOME is present
MIME-Version: 1.0
Content-Type: text/plain; charset=utf-8
Content-Transfer-Encoding: 7bit
X-JIRA-FingerPrint: 30527f35849b9dde25b450d4833f0394
X-Virus-Checked: Checked by ClamAV on apache.org
hadoop-config.sh spews error message when HADOOP_HOME_WARN_SUPPRESS is set to true and HADOOP_HOME is present
-------------------------------------------------------------------------------------------------------------
Key: HADOOP-8010
URL: https://issues.apache.org/jira/browse/HADOOP-8010
Project: Hadoop Common
Issue Type: Bug
Components: scripts
Affects Versions: 1.0.0
Reporter: Roman Shaposhnik
Assignee: Roman Shaposhnik
Priority: Minor
Fix For: 1.0.1
Running hadoop daemon commands when HADOOP_HOME_WARN_SUPPRESS is set to true and HADOOP_HOME is present produces:
{noformat}
[: 76: true: unexpected operator
{noformat}
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
From common-dev-return-77584-apmail-hadoop-common-dev-archive=hadoop.apache.org@hadoop.apache.org Wed Feb 1 03:40:24 2012
Return-Path: <common-dev-return-77584-apmail-hadoop-common-dev-archive=hadoop.apache.org@hadoop.apache.org>
X-Original-To: apmail-hadoop-common-dev-archive@www.apache.org
Delivered-To: apmail-hadoop-common-dev-archive@www.apache.org
Received: from mail.apache.org (hermes.apache.org [140.211.11.3])
by minotaur.apache.org (Postfix) with SMTP id 8A2FF9635
for <apmail-hadoop-common-dev-archive@www.apache.org>; Wed, 1 Feb 2012 03:40:24 +0000 (UTC)
Received: (qmail 36963 invoked by uid 500); 1 Feb 2012 03:39:39 -0000
Delivered-To: apmail-hadoop-common-dev-archive@hadoop.apache.org
Received: (qmail 35839 invoked by uid 500); 1 Feb 2012 03:39:28 -0000
Mailing-List: contact common-dev-help@hadoop.apache.org; run by ezmlm
Precedence: bulk
List-Help: <mailto:common-dev-help@hadoop.apache.org>
List-Unsubscribe: <mailto:common-dev-unsubscribe@hadoop.apache.org>
List-Post: <mailto:common-dev@hadoop.apache.org>
List-Id: <common-dev.hadoop.apache.org>
Reply-To: common-dev@hadoop.apache.org
Delivered-To: mailing list common-dev@hadoop.apache.org
Received: (qmail 35766 invoked by uid 99); 1 Feb 2012 03:39:22 -0000
Received: from nike.apache.org (HELO nike.apache.org) (192.87.106.230)
by apache.org (qpsmtpd/0.29) with ESMTP; Wed, 01 Feb 2012 03:39:22 +0000
X-ASF-Spam-Status: No, hits=-2000.0 required=5.0
tests=ALL_TRUSTED,T_RP_MATCHES_RCVD
X-Spam-Check-By: apache.org
Received: from [140.211.11.116] (HELO hel.zones.apache.org) (140.211.11.116)
by apache.org (qpsmtpd/0.29) with ESMTP; Wed, 01 Feb 2012 03:39:19 +0000
Received: from hel.zones.apache.org (hel.zones.apache.org [140.211.11.116])
by hel.zones.apache.org (Postfix) with ESMTP id 86822182298
for <common-dev@hadoop.apache.org>; Wed, 1 Feb 2012 03:38:58 +0000 (UTC)
Date: Wed, 1 Feb 2012 03:38:58 +0000 (UTC)
From: "cldoltd (Created) (JIRA)" <jira@apache.org>
To: common-dev@hadoop.apache.org
Message-ID: <1847965659.1359.1328067538552.JavaMail.tomcat@hel.zones.apache.org>
Subject: [jira] [Created] (HADOOP-8011) How to use distcp command betwen 2
cluster that different version
MIME-Version: 1.0
Content-Type: text/plain; charset=utf-8
Content-Transfer-Encoding: 7bit
X-JIRA-FingerPrint: 30527f35849b9dde25b450d4833f0394
X-Virus-Checked: Checked by ClamAV on apache.org
How to use distcp command betwen 2 cluster that different version
-----------------------------------------------------------------
Key: HADOOP-8011
URL: https://issues.apache.org/jira/browse/HADOOP-8011
Project: Hadoop Common
Issue Type: New Feature
Reporter: cldoltd
I have tow cluster 1.0 and 0.2
how to use distcp to copy betwen 2 cluster
this is error:
Copy failed: java.io.IOException: Call to cluster1 failed on local exception: java.io.EOFException
at org.apache.hadoop.ipc.Client.wrapException(Client.java:1103)
at org.apache.hadoop.ipc.Client.call(Client.java:1071)
at org.apache.hadoop.ipc.RPC$Invoker.invoke(RPC.java:225)
at $Proxy1.getProtocolVersion(Unknown Source)
at org.apache.hadoop.ipc.RPC.getProxy(RPC.java:396)
at org.apache.hadoop.ipc.RPC.getProxy(RPC.java:379)
at org.apache.hadoop.hdfs.DFSClient.createRPCNamenode(DFSClient.java:119)
at org.apache.hadoop.hdfs.DFSClient.<init>(DFSClient.java:238)
at org.apache.hadoop.hdfs.DFSClient.<init>(DFSClient.java:203)
at org.apache.hadoop.hdfs.DistributedFileSystem.initialize(DistributedFileSystem.java:89)
at org.apache.hadoop.fs.FileSystem.createFileSystem(FileSystem.java:1386)
at org.apache.hadoop.fs.FileSystem.access$200(FileSystem.java:66)
at org.apache.hadoop.fs.FileSystem$Cache.get(FileSystem.java:1404)
at org.apache.hadoop.fs.FileSystem.get(FileSystem.java:254)
at org.apache.hadoop.fs.Path.getFileSystem(Path.java:187)
at org.apache.hadoop.tools.DistCp.checkSrcPath(DistCp.java:635)
at org.apache.hadoop.tools.DistCp.copy(DistCp.java:656)
at org.apache.hadoop.tools.DistCp.run(DistCp.java:881)
at org.apache.hadoop.util.ToolRunner.run(ToolRunner.java:65)
at org.apache.hadoop.util.ToolRunner.run(ToolRunner.java:79)
at org.apache.hadoop.tools.DistCp.main(DistCp.java:908)
Caused by: java.io.EOFException
at java.io.DataInputStream.readInt(DataInputStream.java:375)
at org.apache.hadoop.ipc.Client$Connection.receiveResponse(Client.java:800)
at org.apache.hadoop.ipc.Client$Connection.run(Client.java:745)
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
From common-dev-return-77585-apmail-hadoop-common-dev-archive=hadoop.apache.org@hadoop.apache.org Wed Feb 1 05:21:56 2012
Return-Path: <common-dev-return-77585-apmail-hadoop-common-dev-archive=hadoop.apache.org@hadoop.apache.org>
X-Original-To: apmail-hadoop-common-dev-archive@www.apache.org
Delivered-To: apmail-hadoop-common-dev-archive@www.apache.org
Received: from mail.apache.org (hermes.apache.org [140.211.11.3])
by minotaur.apache.org (Postfix) with SMTP id 8494B9191
for <apmail-hadoop-common-dev-archive@www.apache.org>; Wed, 1 Feb 2012 05:21:56 +0000 (UTC)
Received: (qmail 31497 invoked by uid 500); 1 Feb 2012 05:21:44 -0000
Delivered-To: apmail-hadoop-common-dev-archive@hadoop.apache.org
Received: (qmail 27673 invoked by uid 500); 1 Feb 2012 05:21:23 -0000
Mailing-List: contact common-dev-help@hadoop.apache.org; run by ezmlm
Precedence: bulk
List-Help: <mailto:common-dev-help@hadoop.apache.org>
List-Unsubscribe: <mailto:common-dev-unsubscribe@hadoop.apache.org>
List-Post: <mailto:common-dev@hadoop.apache.org>
List-Id: <common-dev.hadoop.apache.org>
Reply-To: common-dev@hadoop.apache.org
Delivered-To: mailing list common-dev@hadoop.apache.org
Received: (qmail 27626 invoked by uid 99); 1 Feb 2012 05:21:14 -0000
Received: from nike.apache.org (HELO nike.apache.org) (192.87.106.230)
by apache.org (qpsmtpd/0.29) with ESMTP; Wed, 01 Feb 2012 05:21:14 +0000
X-ASF-Spam-Status: No, hits=2.5 required=5.0
tests=FREEMAIL_ENVFROM_END_DIGIT,FREEMAIL_REPLYTO_END_DIGIT,RCVD_IN_BL_SPAMCOP_NET,RCVD_IN_DNSWL_NONE,SPF_PASS
X-Spam-Check-By: apache.org
Received-SPF: pass (nike.apache.org: local policy)
Received: from [98.138.229.132] (HELO nm37-vm4.bullet.mail.ne1.yahoo.com) (98.138.229.132)
by apache.org (qpsmtpd/0.29) with SMTP; Wed, 01 Feb 2012 05:21:02 +0000
Received: from [98.138.90.51] by nm37.bullet.mail.ne1.yahoo.com with NNFMP; 01 Feb 2012 05:20:41 -0000
Received: from [98.138.88.232] by tm4.bullet.mail.ne1.yahoo.com with NNFMP; 01 Feb 2012 05:20:41 -0000
Received: from [127.0.0.1] by omp1032.mail.ne1.yahoo.com with NNFMP; 01 Feb 2012 05:20:41 -0000
X-Yahoo-Newman-Property: ymail-3
X-Yahoo-Newman-Id: 426368.36577.bm@omp1032.mail.ne1.yahoo.com
Received: (qmail 27740 invoked by uid 60001); 1 Feb 2012 05:20:41 -0000
DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=yahoo.com; s=s1024; t=1328073641; bh=PJ3hZCJIKdn5p+GIrfK8F19kujPBIG6MK1bAXn/UxMc=; h=X-YMail-OSG:Received:X-Mailer:References:Message-ID:Date:From:Reply-To:Subject:To:Cc:In-Reply-To:MIME-Version:Content-Type:Content-Transfer-Encoding; b=OUP+UYB4NCeqWg4ZzWmksnpdnMGUqPRtgqt9UgnvVBUlaL+mXeqQ7qQFQ8Et6YBubyoQWNw14E/lXSjoP9IKAOkhN7W2gdBTCWrC5Y8wC5xAN7tO3rADMTmAIKJeoLQTnmo+uWS2riZ8QdgIuFwYPwyjLDeS/POOrivzcfB3Ab8=
DomainKey-Signature:a=rsa-sha1; q=dns; c=nofws;
s=s1024; d=yahoo.com;
h=X-YMail-OSG:Received:X-Mailer:References:Message-ID:Date:From:Reply-To:Subject:To:Cc:In-Reply-To:MIME-Version:Content-Type:Content-Transfer-Encoding;
b=HGCePDRpZ8KAxiRRNU3RG3LWt+g7XrgcpuAmRy/hPnPqTRLII0pTuTWr58B7eOYQJ8KsUr6P5uklj4tFNfj+Fk3VWgx082WtCiDDTrSopQIVvBt7QCJW4IewHr8pCL5c32yyq7SCEaByc2/UKcOaKQns2/XdjZow9c0nL3/UspU=;
X-YMail-OSG: URp8pOkVM1k.RyR9YDCjyDIW.AdBdmRaWzW_d2.5hyh07Ek
4PGvJdIDQVwx2yF.I3enFUugEW_EkkiV2fG3iDyVsQ6kOvivuSGhi2ie6Ahl
a6YOM8LGVR4S4hsKrbggKf8_BtZEAKUV9ej6TTYO81PMg4YF.HCyj7FCcZAt
NJVkqcZdc7enQWiBPFdeufyuRk_iyCo7lJ7Sw8gv3yAB6AH1UfG4voMch4V0
X1sHvGUOeBevYpTPkLczQ9Xdnryko_dZ.KytPLl3L0oS95C.q85XflHASJPU
xW5gOGohkhzeeGxBf.UpyySllTGNNPiYo4vLhwCuZtXpmD8ryAOBcSAbD3uQ
XPP3aKleEzMlvdM6NIA4U0nLSGl0pkfK9P4c6WJdWeVB2e3EwH1ICtb2O4lG
UoLxGCts4JohEFppELAItdg--
Received: from [174.113.144.83] by web121206.mail.ne1.yahoo.com via HTTP; Tue, 31 Jan 2012 21:20:41 PST
X-Mailer: YahooMailWebService/0.8.116.331537
References: <1327880657.10233.YahooMailNeo@web121206.mail.ne1.yahoo.com> <CA+mbt7ibsx=cmKhfriK9ysZnfsT8UXtkwKnqrsTotY1E_MxeTA@mail.gmail.com> <1327900607.12815.YahooMailNeo@web121201.mail.ne1.yahoo.com> <CA+mbt7iyW5KTqbCg2wn6rGOq8o93703cTgmzkFszybgauJ2zSQ@mail.gmail.com>
Message-ID: <1328073641.78427.YahooMailNeo@web121206.mail.ne1.yahoo.com>
Date: Tue, 31 Jan 2012 21:20:41 -0800 (PST)
From: Hai Huang <hhuang2012@yahoo.com>
Reply-To: Hai Huang <hhuang2012@yahoo.com>
Subject: Re: Issue on building hadoop native
To: Ronald Petty <ronald.petty@gmail.com>
Cc: "common-dev@hadoop.apache.org" <common-dev@hadoop.apache.org>
In-Reply-To: <CA+mbt7iyW5KTqbCg2wn6rGOq8o93703cTgmzkFszybgauJ2zSQ@mail.gmail.com>
MIME-Version: 1.0
Content-Type: text/plain; charset=iso-8859-1
Content-Transfer-Encoding: quoted-printable
X-Virus-Checked: Checked by ClamAV on apache.org
Thanks, Ronald.=0A=0AAfter tried couple=A0of the times, the build=A0is work=
ing=A0now.=0A=A0=0AHai=A0=0A=0A=0A________________________________=0AFrom: =
Ronald Petty <ronald.petty@gmail.com>=0ATo: Hai Huang <hhuang2012@yahoo.com=
> =0ACc: "common-dev@hadoop.apache.org" <common-dev@hadoop.apache.org> =0AS=
ent: Monday, January 30, 2012 12:59:57 AM=0ASubject: Re: Issue on building =
hadoop native=0A=0A=0AHai,=0A=0AI don't know the 'official' reason, but it =
is bad practice to use user ids under 1000. =A0I presume you are using root=
or some typical user account to build this. =A0The fix for me was to creat=
e a new user with an id that is greater than 1000. =0A=0AHere is an example=
=0A=0Auseradd --id 1001 hadoopuser=0A=0AI hope that works!=0A=0AKindest reg=
ards.=0A=0ARon=0A=0A=0AOn Sun, Jan 29, 2012 at 9:16 PM, Hai Huang <hhuang20=
12@yahoo.com> wrote:=0A=0AHi Ronald,=0A>=0A>=0A>I just tried to use=A0=0A>=
=0A>=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=0A>=0A>mvn -Pnative compile=0A>=
=0A>=0A>and it passed.=A0=0A>=0A>So I used command =A0"mvn -e =A0package -P=
dist,native,docs -DskipTests -Dtargc" again, checked the log and found one =
issue message below=A0=0A>=0A>=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=0A>=
=0A>[INFO] --- make-maven-plugin:1.0-beta-1:test (test) @ hadoop-yarn-serve=
r-nodemanager ---=0A>[INFO] make =A0test-container-executor=0A>[INFO] make[=
1]: Entering directory `/home/hhf/hadoop-common/hadoop-mapreduce-project/ha=
doop-yarn/hadoop-yarn-server/hadoop-yarn-server-nodemanager/target/native/c=
ontainer-executor'=0A>[INFO] make[1]: `test-container-executor' is up to da=
te.=0A>[INFO] make[1]: Leaving directory `/home/hhf/hadoop-common/hadoop-ma=
preduce-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-nodemanag=
er/target/native/container-executor'=0A>[INFO] make =A0check-TESTS=0A>[INFO=
] make[1]: Entering directory `/home/hhf/hadoop-common/hadoop-mapreduce-pro=
ject/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-nodemanager/target/n=
ative/container-executor'=0A>[INFO] Requested user hhuang has id 500, which=
is below the minimum allowed 1000=0A>[INFO] FAIL: test-container-executor=
=0A>[INFO] =3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=
=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=
=3D=3D=0A>[INFO] 1 of 1 test failed=0A>[INFO] Please report to=A0mapreduce-=
dev@hadoop.apache.org=0A>[INFO] =3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=
=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=
=3D=3D=3D=3D=3D=3D=3D=3D=3D=0A>=0A>It seemed the issue was from "test-conta=
iner-executor" , and the issue message is =A0"... has id 500 , which=A0=A0i=
s below the minimum allowed 1000 ..." ?=0A>=0A>=0A>Best,=0A>=0A>Hai=A0=0A>=
=0A>=0A>=0A>----- Original Message -----=0A>=0A>From: Ronald Petty <ronald.=
petty@gmail.com>=0A>To: common-dev@hadoop.apache.org; Hai Huang <hhuang2012=
@yahoo.com>=0A>Cc:=0A>=0A>Sent: Sunday, January 29, 2012 11:42:30 PM=0A>Sub=
ject: Re: Issue on building hadoop native=0A>=0A>Hai,=0A>=0A>Can you rerun =
with "-e -X" and the native setting as well?=A0 Also, can you=0A>send paste=
bin the entire build output and send the link to it?=0A>=0A>Kindest regards=
.=0A>=0A>Ron=0A>=0A>On Sun, Jan 29, 2012 at 3:44 PM, Hai Huang <hhuang2012@=
yahoo.com> wrote:=0A>=0A>> Hi,=0A>>=0A>> I got the hadoop hadoop source via=
Git and buit it using the command=0A>>=0A>> =3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=
=3D=3D=3D=3D=3D=3D=3D=0A>> mvn package -Pdist,native,docs -DskipTests -Dtar=
=0A>>=0A>> =3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=0A>>=0A>>=0A=
>> Does anyone the below compilation issue I got ?=0A>>=0A>> =3D=3D=3D=3D=
=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=0A>>=0A>> [ERROR] Failed to exec=
ute goal=0A>> org.codehaus.mojo:make-maven-plugin:1.0-beta-1:test (test) on=
project=0A>> hadoop-yarn-server-nodemanager: make returned an exit value !=
=3D 0. Aborting=0A>> build; see command output above for more information. =
-> [Help 1]=0A>> [ERROR]=0A>> [ERROR] To see the full stack trace of the er=
rors, re-run Maven with the=0A>> -e switch.=0A>> [ERROR] Re-run Maven using=
the -X switch to enable full debug logging.=0A>> [ERROR]=0A>> [ERROR] For =
more information about the errors and possible solutions,=0A>> please read =
the following articles:=0A>> [ERROR] [Help 1]=0A>> http://cwiki.apache.org/=
confluence/display/MAVEN/MojoExecutionException=0A>> [ERROR]=0A>> [ERROR] A=
fter correcting the problems, you can resume the build with the=0A>> comman=
d=0A>> [ERROR]=A0 =A0mvn <goals> -rf :hadoop-yarn-server-nodemanager=0A>>=
=0A>> =3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=0A>>=0A>> I am us=
ing the CentOs=A0 6.2 and gcc 4.4.6. It looks like that the issue is=0A>> d=
ue to=A0 build native code. If I just used the command=0A>>=0A>> =3D=3D=3D=
=3D=3D=3D=3D=3D=3D=3D=3D=3D=0A>>=0A>> mvn package -Pdist -DskipTests -Dtar=
=0A>>=0A>> =3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=0A>>=0A>> The build was OK.=
=0A>>=0A>>=0A>> Best,=0A>>=0A>> Hai=0A>>=0A>>=0A>=0A>=A0=A0=A0=A0
From common-dev-return-77586-apmail-hadoop-common-dev-archive=hadoop.apache.org@hadoop.apache.org Wed Feb 1 10:52:21 2012
Return-Path: <common-dev-return-77586-apmail-hadoop-common-dev-archive=hadoop.apache.org@hadoop.apache.org>
X-Original-To: apmail-hadoop-common-dev-archive@www.apache.org
Delivered-To: apmail-hadoop-common-dev-archive@www.apache.org
Received: from mail.apache.org (hermes.apache.org [140.211.11.3])
by minotaur.apache.org (Postfix) with SMTP id AA3679AEB
for <apmail-hadoop-common-dev-archive@www.apache.org>; Wed, 1 Feb 2012 10:52:21 +0000 (UTC)
Received: (qmail 96377 invoked by uid 500); 1 Feb 2012 10:52:20 -0000
Delivered-To: apmail-hadoop-common-dev-archive@hadoop.apache.org
Received: (qmail 95745 invoked by uid 500); 1 Feb 2012 10:52:08 -0000
Mailing-List: contact common-dev-help@hadoop.apache.org; run by ezmlm
Precedence: bulk
List-Help: <mailto:common-dev-help@hadoop.apache.org>
List-Unsubscribe: <mailto:common-dev-unsubscribe@hadoop.apache.org>
List-Post: <mailto:common-dev@hadoop.apache.org>
List-Id: <common-dev.hadoop.apache.org>
Reply-To: common-dev@hadoop.apache.org
Delivered-To: mailing list common-dev@hadoop.apache.org
Received: (qmail 95734 invoked by uid 99); 1 Feb 2012 10:52:05 -0000
Received: from athena.apache.org (HELO athena.apache.org) (140.211.11.136)
by apache.org (qpsmtpd/0.29) with ESMTP; Wed, 01 Feb 2012 10:52:05 +0000
X-ASF-Spam-Status: No, hits=-0.7 required=5.0
tests=RCVD_IN_DNSWL_LOW,SPF_PASS
X-Spam-Check-By: apache.org
Received-SPF: pass (athena.apache.org: domain of harsh@cloudera.com designates 209.85.160.48 as permitted sender)
Received: from [209.85.160.48] (HELO mail-pw0-f48.google.com) (209.85.160.48)
by apache.org (qpsmtpd/0.29) with ESMTP; Wed, 01 Feb 2012 10:52:00 +0000
Received: by pbcc11 with SMTP id c11so1234616pbc.35
for <common-dev@hadoop.apache.org>; Wed, 01 Feb 2012 02:51:40 -0800 (PST)
Received: by 10.68.212.130 with SMTP id nk2mr58359882pbc.69.1328093500166;
Wed, 01 Feb 2012 02:51:40 -0800 (PST)
MIME-Version: 1.0
Received: by 10.142.72.17 with HTTP; Wed, 1 Feb 2012 02:51:20 -0800 (PST)
In-Reply-To: <FCA91A92EE52B041906A0358FC28FCC38F667B5DFF@FRE1EXCH02.hq.exar.com>
References: <AQHM3vGFH2Mvri7mdUeyZZ/mtgemZA==> <FCA91A92EE52B041906A0358FC28FCC38F667B5DFF@FRE1EXCH02.hq.exar.com>
From: Harsh J <harsh@cloudera.com>
Date: Wed, 1 Feb 2012 16:21:20 +0530
Message-ID: <CAOcnVr2NvHqRJbdMc0OphuzQ-RidbDhvnCFzxoPOVL9v3Zjx+g@mail.gmail.com>
Subject: Re: Debugging 1.0.0 with jdb
To: common-dev@hadoop.apache.org
Content-Type: text/plain; charset=ISO-8859-1
Content-Transfer-Encoding: quoted-printable
I've not used jdb since I almost always use Eclipse to do this, but to
have ant run javac with debug info on, you'll need to find the
relevant <javac> elements and add the attribute 'debug=3D"on"' to them,
to have the javac produce files with debug info. You can then pick up
the generated test jar and run it via jdb?
On Mon, Jan 30, 2012 at 7:17 AM, Tim Broberg <Tim.Broberg@exar.com> wrote:
> I'd like to be able to step through unit tests with jdb to debug my class=
es.
>
> Is there a quick-and-easy way to rebuild with ant such that debug informa=
tion is included?
>
> Thanks,
> =A0 =A0- Tim.
>
> The information and any attached documents contained in this message
> may be confidential and/or legally privileged. =A0The message is
> intended solely for the addressee(s). =A0If you are not the intended
> recipient, you are hereby notified that any use, dissemination, or
> reproduction is strictly prohibited and may be unlawful. =A0If you are
> not the intended recipient, please contact the sender immediately by
> return e-mail and destroy all copies of the original message.
--=20
Harsh J
Customer Ops. Engineer
Cloudera | http://tiny.cloudera.com/about
From common-dev-return-77587-apmail-hadoop-common-dev-archive=hadoop.apache.org@hadoop.apache.org Wed Feb 1 16:09:24 2012
Return-Path: <common-dev-return-77587-apmail-hadoop-common-dev-archive=hadoop.apache.org@hadoop.apache.org>
X-Original-To: apmail-hadoop-common-dev-archive@www.apache.org
Delivered-To: apmail-hadoop-common-dev-archive@www.apache.org
Received: from mail.apache.org (hermes.apache.org [140.211.11.3])
by minotaur.apache.org (Postfix) with SMTP id ED278996D
for <apmail-hadoop-common-dev-archive@www.apache.org>; Wed, 1 Feb 2012 16:09:23 +0000 (UTC)
Received: (qmail 66757 invoked by uid 500); 1 Feb 2012 16:09:22 -0000
Delivered-To: apmail-hadoop-common-dev-archive@hadoop.apache.org
Received: (qmail 66526 invoked by uid 500); 1 Feb 2012 16:09:21 -0000
Mailing-List: contact common-dev-help@hadoop.apache.org; run by ezmlm
Precedence: bulk
List-Help: <mailto:common-dev-help@hadoop.apache.org>
List-Unsubscribe: <mailto:common-dev-unsubscribe@hadoop.apache.org>
List-Post: <mailto:common-dev@hadoop.apache.org>
List-Id: <common-dev.hadoop.apache.org>
Reply-To: common-dev@hadoop.apache.org
Delivered-To: mailing list common-dev@hadoop.apache.org
Received: (qmail 66515 invoked by uid 99); 1 Feb 2012 16:09:20 -0000
Received: from athena.apache.org (HELO athena.apache.org) (140.211.11.136)
by apache.org (qpsmtpd/0.29) with ESMTP; Wed, 01 Feb 2012 16:09:20 +0000
X-ASF-Spam-Status: No, hits=-2000.0 required=5.0
tests=ALL_TRUSTED,T_RP_MATCHES_RCVD
X-Spam-Check-By: apache.org
Received: from [140.211.11.116] (HELO hel.zones.apache.org) (140.211.11.116)
by apache.org (qpsmtpd/0.29) with ESMTP; Wed, 01 Feb 2012 16:09:19 +0000
Received: from hel.zones.apache.org (hel.zones.apache.org [140.211.11.116])
by hel.zones.apache.org (Postfix) with ESMTP id 763C1184035
for <common-dev@hadoop.apache.org>; Wed, 1 Feb 2012 16:08:59 +0000 (UTC)
Date: Wed, 1 Feb 2012 16:08:59 +0000 (UTC)
From: "Brian Bloniarz (Resolved) (JIRA)" <jira@apache.org>
To: common-dev@hadoop.apache.org
Message-ID: <986373591.3056.1328112539485.JavaMail.tomcat@hel.zones.apache.org>
In-Reply-To: <1847965659.1359.1328067538552.JavaMail.tomcat@hel.zones.apache.org>
Subject: [jira] [Resolved] (HADOOP-8011) How to use distcp command betwen 2
cluster that different version
MIME-Version: 1.0
Content-Type: text/plain; charset=utf-8
Content-Transfer-Encoding: 7bit
X-JIRA-FingerPrint: 30527f35849b9dde25b450d4833f0394
[ https://issues.apache.org/jira/browse/HADOOP-8011?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Brian Bloniarz resolved HADOOP-8011.
------------------------------------
Resolution: Not A Problem
> How to use distcp command betwen 2 cluster that different version
> -----------------------------------------------------------------
>
> Key: HADOOP-8011
> URL: https://issues.apache.org/jira/browse/HADOOP-8011
> Project: Hadoop Common
> Issue Type: New Feature
> Reporter: cldoltd
>
> I have tow cluster 1.0 and 0.2
> how to use distcp to copy betwen 2 cluster
> this is error:
> Copy failed: java.io.IOException: Call to cluster1 failed on local exception: java.io.EOFException
> at org.apache.hadoop.ipc.Client.wrapException(Client.java:1103)
> at org.apache.hadoop.ipc.Client.call(Client.java:1071)
> at org.apache.hadoop.ipc.RPC$Invoker.invoke(RPC.java:225)
> at $Proxy1.getProtocolVersion(Unknown Source)
> at org.apache.hadoop.ipc.RPC.getProxy(RPC.java:396)
> at org.apache.hadoop.ipc.RPC.getProxy(RPC.java:379)
> at org.apache.hadoop.hdfs.DFSClient.createRPCNamenode(DFSClient.java:119)
> at org.apache.hadoop.hdfs.DFSClient.<init>(DFSClient.java:238)
> at org.apache.hadoop.hdfs.DFSClient.<init>(DFSClient.java:203)
> at org.apache.hadoop.hdfs.DistributedFileSystem.initialize(DistributedFileSystem.java:89)
> at org.apache.hadoop.fs.FileSystem.createFileSystem(FileSystem.java:1386)
> at org.apache.hadoop.fs.FileSystem.access$200(FileSystem.java:66)
> at org.apache.hadoop.fs.FileSystem$Cache.get(FileSystem.java:1404)
> at org.apache.hadoop.fs.FileSystem.get(FileSystem.java:254)
> at org.apache.hadoop.fs.Path.getFileSystem(Path.java:187)
> at org.apache.hadoop.tools.DistCp.checkSrcPath(DistCp.java:635)
> at org.apache.hadoop.tools.DistCp.copy(DistCp.java:656)
> at org.apache.hadoop.tools.DistCp.run(DistCp.java:881)
> at org.apache.hadoop.util.ToolRunner.run(ToolRunner.java:65)
> at org.apache.hadoop.util.ToolRunner.run(ToolRunner.java:79)
> at org.apache.hadoop.tools.DistCp.main(DistCp.java:908)
> Caused by: java.io.EOFException
> at java.io.DataInputStream.readInt(DataInputStream.java:375)
> at org.apache.hadoop.ipc.Client$Connection.receiveResponse(Client.java:800)
> at org.apache.hadoop.ipc.Client$Connection.run(Client.java:745)
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
From common-dev-return-77588-apmail-hadoop-common-dev-archive=hadoop.apache.org@hadoop.apache.org Wed Feb 1 16:38:02 2012
Return-Path: <common-dev-return-77588-apmail-hadoop-common-dev-archive=hadoop.apache.org@hadoop.apache.org>
X-Original-To: apmail-hadoop-common-dev-archive@www.apache.org
Delivered-To: apmail-hadoop-common-dev-archive@www.apache.org
Received: from mail.apache.org (hermes.apache.org [140.211.11.3])
by minotaur.apache.org (Postfix) with SMTP id 5F0479EDE
for <apmail-hadoop-common-dev-archive@www.apache.org>; Wed, 1 Feb 2012 16:38:02 +0000 (UTC)
Received: (qmail 28582 invoked by uid 500); 1 Feb 2012 16:37:59 -0000
Delivered-To: apmail-hadoop-common-dev-archive@hadoop.apache.org
Received: (qmail 28502 invoked by uid 500); 1 Feb 2012 16:37:59 -0000
Mailing-List: contact common-dev-help@hadoop.apache.org; run by ezmlm
Precedence: bulk
List-Help: <mailto:common-dev-help@hadoop.apache.org>
List-Unsubscribe: <mailto:common-dev-unsubscribe@hadoop.apache.org>
List-Post: <mailto:common-dev@hadoop.apache.org>
List-Id: <common-dev.hadoop.apache.org>
Reply-To: common-dev@hadoop.apache.org
Delivered-To: mailing list common-dev@hadoop.apache.org
Received: (qmail 28494 invoked by uid 99); 1 Feb 2012 16:37:59 -0000
Received: from nike.apache.org (HELO nike.apache.org) (192.87.106.230)
by apache.org (qpsmtpd/0.29) with ESMTP; Wed, 01 Feb 2012 16:37:58 +0000
X-ASF-Spam-Status: No, hits=-0.7 required=5.0
tests=RCVD_IN_DNSWL_LOW,SPF_PASS
X-Spam-Check-By: apache.org
Received-SPF: pass (nike.apache.org: domain of rhc.openmpi@gmail.com designates 209.85.160.48 as permitted sender)
Received: from [209.85.160.48] (HELO mail-pw0-f48.google.com) (209.85.160.48)
by apache.org (qpsmtpd/0.29) with ESMTP; Wed, 01 Feb 2012 16:37:50 +0000
Received: by pbcc11 with SMTP id c11so1542603pbc.35
for <common-dev@hadoop.apache.org>; Wed, 01 Feb 2012 08:37:29 -0800 (PST)
DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed;
d=gmail.com; s=gamma;
h=sender:content-type:mime-version:subject:from:in-reply-to:date
:content-transfer-encoding:message-id:references:to:x-mailer;
bh=eXHkjS5Tf/ofZm7lcCXGVEALMDq6sLNT9NN4yDVBaFQ=;
b=q4fua47fo8YA4dWPW9IgM5UODNq4K4PTgFgoyVJwbRX+4UE2U7WEIeLf/n9/eHs8mm
W3INhvKJ35AMPAkOQHdJJl+4eOkcE9swVKFYl6RLV1tzNtWJ2UXHIhotO2E5Ik/AcNc7
x6NkkvGqnFqMYaarX2FW4KRdygPIcYtTabupI=
Received: by 10.68.75.136 with SMTP id c8mr60841297pbw.113.1328114249558;
Wed, 01 Feb 2012 08:37:29 -0800 (PST)
Received: from [192.168.1.3] (c-98-245-155-46.hsd1.co.comcast.net. [98.245.155.46])
by mx.google.com with ESMTPS id x8sm64417082pbr.11.2012.02.01.08.37.27
(version=TLSv1/SSLv3 cipher=OTHER);
Wed, 01 Feb 2012 08:37:28 -0800 (PST)
Sender: Ralph Castain <rhc.openmpi@gmail.com>
Content-Type: text/plain; charset=us-ascii
Mime-Version: 1.0 (Apple Message framework v1084)
Subject: Re: MPI: Java/JNI help
From: Ralph Castain <rhc@open-mpi.org>
In-Reply-To: <CB4DD6DD.12F7C%kihwal@yahoo-inc.com>
Date: Wed, 1 Feb 2012 09:37:24 -0700
Content-Transfer-Encoding: quoted-printable
Message-Id: <5EA543BD-A12E-4729-B66A-C746BC789EC3@open-mpi.org>
References: <CB4DD6DD.12F7C%kihwal@yahoo-inc.com>
To: common-dev@hadoop.apache.org
X-Mailer: Apple Mail (2.1084)
X-Virus-Checked: Checked by ClamAV on apache.org
Thanks Kihwal! This was an excellent suggestion and worked great!
Should have the Java bindings out shortly...
On Jan 31, 2012, at 4:35 PM, Kihwal Lee wrote:
> There might be other tricks you can play with CL, but here is my idea: =
You could have the initial jni native lib to become a sort of wrapper to =
dlopen() the real thing (the one plug-ins depend on) with RTLD_GLOBAL, =
so that the fact that the jni library is loaded in a specific name space =
does not matter.
>=20
> Kihwal
>=20
> On 1/31/12 4:34 PM, "Ralph Castain" <rhc@open-mpi.org> wrote:
>=20
> I was able to dig further into this, and we believe we finally tracked =
this down to root cause. It appears that java loads things into a =
private, as opposed to global, namespace. Thus, the Java MPI bindings =
load the initial libmpi just fine.
>=20
> However, when libmpi then attempts to load the individual plug-ins =
beneath it, the load fails due to "unfound" symbols. Our plug-ins are =
implemented as individual dll's, and reference symbols from within the =
larger libmpi above them. In order to find those symbols, the libraries =
must be in the global namespace.
>=20
> We have a workaround - namely, to disable dlopen so all the plug-ins =
get pulled up into libmpi. However, this eliminates the ability for a =
vendor to distribute a binary, proprietary plug-in that we "absorb" =
during dlopen. For the moment, this isn't a big deal, but it could be an =
issue down the line. We have some ideas on how to resolve it internally, =
but it would take a fair amount of work, and have some side-effects.
>=20
> Does anyone know if it is possible to convince java to use the global =
namespace? Or can you point me to someone/someplace where I should =
explore the question?
>=20
> Thanks
> Ralph
>=20
> On Jan 30, 2012, at 5:13 PM, Kihwal Lee wrote:
>=20
>> It doesn't have to be static.
>> Do architectures match between the node manager jvm and the library?
>> If one is 32 bit and the other is 64, it won't work.
>>=20
>> Kihwal
>>=20
>> On 1/30/12 5:58 PM, "Ralph Castain" <rhc@open-mpi.org> wrote:
>>=20
>> Hi folks
>>=20
>> As per earlier emails, I'm just about ready to release the Java MPI =
bindings. I have one remaining issue and would appreciate some help.
>>=20
>> We typically build OpenMPI dynamically. For the Java bindings, this =
means that the JNI code underlying the Java binding must dynamically =
load OMPI plug-ins. Everything works fine on Mac. However, on Linux, I =
am getting dynamic library load errors.
>>=20
>> I have tried setting -Djava.library.path and LD_LIBRARY_PATH to the =
correct locations. In both cases, I get errors from the JNI code =
indicating that it was unable to open the specified dynamic library.
>>=20
>> I have heard from one person that JNI may need to be built =
statically, and I suppose it is possible that Apple's customized Java =
implementation specifically resolved that problem. However, all the =
online documentation I can find indicates that Java on Linux should also =
be able to load dynamic libraries - but JNI is not specifically =
addressed.
>>=20
>> Can any of you Java experts provide advice on this behavior? I'd like =
to get these bindings released!
>>=20
>> Thanks
>> Ralph
>>=20
>>=20
>=20
>=20
From common-dev-return-77589-apmail-hadoop-common-dev-archive=hadoop.apache.org@hadoop.apache.org Wed Feb 1 17:06:16 2012
Return-Path: <common-dev-return-77589-apmail-hadoop-common-dev-archive=hadoop.apache.org@hadoop.apache.org>
X-Original-To: apmail-hadoop-common-dev-archive@www.apache.org
Delivered-To: apmail-hadoop-common-dev-archive@www.apache.org
Received: from mail.apache.org (hermes.apache.org [140.211.11.3])
by minotaur.apache.org (Postfix) with SMTP id 855999A4C
for <apmail-hadoop-common-dev-archive@www.apache.org>; Wed, 1 Feb 2012 17:06:16 +0000 (UTC)
Received: (qmail 5269 invoked by uid 500); 1 Feb 2012 17:06:14 -0000
Delivered-To: apmail-hadoop-common-dev-archive@hadoop.apache.org
Received: (qmail 5190 invoked by uid 500); 1 Feb 2012 17:06:13 -0000
Mailing-List: contact common-dev-help@hadoop.apache.org; run by ezmlm
Precedence: bulk
List-Help: <mailto:common-dev-help@hadoop.apache.org>
List-Unsubscribe: <mailto:common-dev-unsubscribe@hadoop.apache.org>
List-Post: <mailto:common-dev@hadoop.apache.org>
List-Id: <common-dev.hadoop.apache.org>
Reply-To: common-dev@hadoop.apache.org
Delivered-To: mailing list common-dev@hadoop.apache.org
Received: (qmail 5181 invoked by uid 99); 1 Feb 2012 17:06:13 -0000
Received: from athena.apache.org (HELO athena.apache.org) (140.211.11.136)
by apache.org (qpsmtpd/0.29) with ESMTP; Wed, 01 Feb 2012 17:06:13 +0000
X-ASF-Spam-Status: No, hits=-0.0 required=5.0
tests=SPF_PASS
X-Spam-Check-By: apache.org
Received-SPF: pass (athena.apache.org: local policy)
Received: from [204.154.183.83] (HELO smtp1.exar.com) (204.154.183.83)
by apache.org (qpsmtpd/0.29) with ESMTP; Wed, 01 Feb 2012 17:06:09 +0000
Received: from FRE1EXCH02.hq.exar.com ([fe80::e9a7:6160:4e13:1677]) by
fre1-cas ([10.127.1.162]) with mapi; Wed, 1 Feb 2012 09:05:48 -0800
From: Tim Broberg <Tim.Broberg@exar.com>
To: "common-dev@hadoop.apache.org" <common-dev@hadoop.apache.org>
Date: Wed, 1 Feb 2012 09:01:17 -0800
Subject: RE: Debugging 1.0.0 with jdb
Thread-Topic: Debugging 1.0.0 with jdb
Thread-Index: Aczgz5NpLQXY1QZUTl6VzW/4NpfVlQAM4k0A
Message-ID: <FCA91A92EE52B041906A0358FC28FCC38F667B5E0F@FRE1EXCH02.hq.exar.com>
References: <AQHM3vGFH2Mvri7mdUeyZZ/mtgemZA==>
<FCA91A92EE52B041906A0358FC28FCC38F667B5DFF@FRE1EXCH02.hq.exar.com>,<CAOcnVr2NvHqRJbdMc0OphuzQ-RidbDhvnCFzxoPOVL9v3Zjx+g@mail.gmail.com>
In-Reply-To: <CAOcnVr2NvHqRJbdMc0OphuzQ-RidbDhvnCFzxoPOVL9v3Zjx+g@mail.gmail.com>
Accept-Language: en-US
Content-Language: en-US
X-MS-Has-Attach:
X-MS-TNEF-Correlator:
acceptlanguage: en-US
Content-Type: text/plain; charset="us-ascii"
Content-Transfer-Encoding: quoted-printable
MIME-Version: 1.0
Terrific, thanks, Harsh.
...and I'll take a stab at bringing eclipse up today.
- Tim.
________________________________________
From: Harsh J [harsh@cloudera.com]
Sent: Wednesday, February 01, 2012 2:51 AM
To: common-dev@hadoop.apache.org
Subject: Re: Debugging 1.0.0 with jdb
I've not used jdb since I almost always use Eclipse to do this, but to
have ant run javac with debug info on, you'll need to find the
relevant <javac> elements and add the attribute 'debug=3D"on"' to them,
to have the javac produce files with debug info. You can then pick up
the generated test jar and run it via jdb?
On Mon, Jan 30, 2012 at 7:17 AM, Tim Broberg <Tim.Broberg@exar.com> wrote:
> I'd like to be able to step through unit tests with jdb to debug my class=
es.
>
> Is there a quick-and-easy way to rebuild with ant such that debug informa=
tion is included?
>
> Thanks,
> - Tim.
>
> The information and any attached documents contained in this message
> may be confidential and/or legally privileged. The message is
> intended solely for the addressee(s). If you are not the intended
> recipient, you are hereby notified that any use, dissemination, or
> reproduction is strictly prohibited and may be unlawful. If you are
> not the intended recipient, please contact the sender immediately by
> return e-mail and destroy all copies of the original message.
--
Harsh J
Customer Ops. Engineer
Cloudera | http://tiny.cloudera.com/about
The information and any attached documents contained in this message
may be confidential and/or legally privileged. The message is
intended solely for the addressee(s). If you are not the intended
recipient, you are hereby notified that any use, dissemination, or
reproduction is strictly prohibited and may be unlawful. If you are
not the intended recipient, please contact the sender immediately by
return e-mail and destroy all copies of the original message.
From common-dev-return-77590-apmail-hadoop-common-dev-archive=hadoop.apache.org@hadoop.apache.org Wed Feb 1 20:37:23 2012
Return-Path: <common-dev-return-77590-apmail-hadoop-common-dev-archive=hadoop.apache.org@hadoop.apache.org>
X-Original-To: apmail-hadoop-common-dev-archive@www.apache.org
Delivered-To: apmail-hadoop-common-dev-archive@www.apache.org
Received: from mail.apache.org (hermes.apache.org [140.211.11.3])
by minotaur.apache.org (Postfix) with SMTP id E1BFD97B8
for <apmail-hadoop-common-dev-archive@www.apache.org>; Wed, 1 Feb 2012 20:37:22 +0000 (UTC)
Received: (qmail 3380 invoked by uid 500); 1 Feb 2012 20:37:21 -0000
Delivered-To: apmail-hadoop-common-dev-archive@hadoop.apache.org
Received: (qmail 2944 invoked by uid 500); 1 Feb 2012 20:37:19 -0000
Mailing-List: contact common-dev-help@hadoop.apache.org; run by ezmlm
Precedence: bulk
List-Help: <mailto:common-dev-help@hadoop.apache.org>
List-Unsubscribe: <mailto:common-dev-unsubscribe@hadoop.apache.org>
List-Post: <mailto:common-dev@hadoop.apache.org>
List-Id: <common-dev.hadoop.apache.org>
Reply-To: common-dev@hadoop.apache.org
Delivered-To: mailing list common-dev@hadoop.apache.org
Received: (qmail 2923 invoked by uid 99); 1 Feb 2012 20:37:19 -0000
Received: from athena.apache.org (HELO athena.apache.org) (140.211.11.136)
by apache.org (qpsmtpd/0.29) with ESMTP; Wed, 01 Feb 2012 20:37:19 +0000
X-ASF-Spam-Status: No, hits=-2000.0 required=5.0
tests=ALL_TRUSTED,T_RP_MATCHES_RCVD
X-Spam-Check-By: apache.org
Received: from [140.211.11.116] (HELO hel.zones.apache.org) (140.211.11.116)
by apache.org (qpsmtpd/0.29) with ESMTP; Wed, 01 Feb 2012 20:37:18 +0000
Received: from hel.zones.apache.org (hel.zones.apache.org [140.211.11.116])
by hel.zones.apache.org (Postfix) with ESMTP id ABDB11853A4
for <common-dev@hadoop.apache.org>; Wed, 1 Feb 2012 20:36:58 +0000 (UTC)
Date: Wed, 1 Feb 2012 20:36:58 +0000 (UTC)
From: "Roman Shaposhnik (Created) (JIRA)" <jira@apache.org>
To: common-dev@hadoop.apache.org
Message-ID: <1142640527.4136.1328128618705.JavaMail.tomcat@hel.zones.apache.org>
Subject: [jira] [Created] (HADOOP-8012) hadoop-daemon.sh and yarn-daemon.sh
are trying to mkdir and chow log/pid dirs which can fail
MIME-Version: 1.0
Content-Type: text/plain; charset=utf-8
Content-Transfer-Encoding: 7bit
X-JIRA-FingerPrint: 30527f35849b9dde25b450d4833f0394
hadoop-daemon.sh and yarn-daemon.sh are trying to mkdir and chow log/pid dirs which can fail
--------------------------------------------------------------------------------------------
Key: HADOOP-8012
URL: https://issues.apache.org/jira/browse/HADOOP-8012
Project: Hadoop Common
Issue Type: Bug
Components: scripts
Affects Versions: 0.23.0
Reporter: Roman Shaposhnik
Assignee: Roman Shaposhnik
Priority: Minor
Fix For: 0.23.1
Here's what I see when using Hadoop in Bigtop:
{noformat}
$ sudo /sbin/service hadoop-hdfs-namenode start
Starting Hadoop namenode daemon (hadoop-namenode): chown: changing ownership of `/var/log/hadoop': Operation not permitted
starting namenode, logging to /var/log/hadoop/hadoop-hdfs-namenode-centos5.out
{noformat}
This is a cosmetic issue, but it would be nice to fix it.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
From common-dev-return-77591-apmail-hadoop-common-dev-archive=hadoop.apache.org@hadoop.apache.org Thu Feb 2 03:30:55 2012
Return-Path: <common-dev-return-77591-apmail-hadoop-common-dev-archive=hadoop.apache.org@hadoop.apache.org>
X-Original-To: apmail-hadoop-common-dev-archive@www.apache.org
Delivered-To: apmail-hadoop-common-dev-archive@www.apache.org
Received: from mail.apache.org (hermes.apache.org [140.211.11.3])
by minotaur.apache.org (Postfix) with SMTP id C19369C4D
for <apmail-hadoop-common-dev-archive@www.apache.org>; Thu, 2 Feb 2012 03:30:55 +0000 (UTC)
Received: (qmail 21910 invoked by uid 500); 2 Feb 2012 03:30:54 -0000
Delivered-To: apmail-hadoop-common-dev-archive@hadoop.apache.org
Received: (qmail 21103 invoked by uid 500); 2 Feb 2012 03:30:43 -0000
Mailing-List: contact common-dev-help@hadoop.apache.org; run by ezmlm
Precedence: bulk
List-Help: <mailto:common-dev-help@hadoop.apache.org>
List-Unsubscribe: <mailto:common-dev-unsubscribe@hadoop.apache.org>
List-Post: <mailto:common-dev@hadoop.apache.org>
List-Id: <common-dev.hadoop.apache.org>
Reply-To: common-dev@hadoop.apache.org
Delivered-To: mailing list common-dev@hadoop.apache.org
Received: (qmail 21093 invoked by uid 99); 2 Feb 2012 03:30:39 -0000
Received: from athena.apache.org (HELO athena.apache.org) (140.211.11.136)
by apache.org (qpsmtpd/0.29) with ESMTP; Thu, 02 Feb 2012 03:30:39 +0000
X-ASF-Spam-Status: No, hits=1.5 required=5.0
tests=HTML_MESSAGE,RCVD_IN_DNSWL_LOW,SPF_PASS
X-Spam-Check-By: apache.org
Received-SPF: pass (athena.apache.org: domain of hwazynn@gmail.com designates 209.85.160.48 as permitted sender)
Received: from [209.85.160.48] (HELO mail-pw0-f48.google.com) (209.85.160.48)
by apache.org (qpsmtpd/0.29) with ESMTP; Thu, 02 Feb 2012 03:30:32 +0000
Received: by pbcc11 with SMTP id c11so2131763pbc.35
for <common-dev@hadoop.apache.org>; Wed, 01 Feb 2012 19:30:12 -0800 (PST)
DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed;
d=gmail.com; s=gamma;
h=mime-version:in-reply-to:references:date:message-id:subject:from:to
:content-type;
bh=VjKFvFazDDguVa/Md3durwxDP26wwYqBXbhc9xUayZ4=;
b=wYiqcqb8hNrDSEiSDYLK+kJY9vc9UejLT655/xmmgUTgJDAgjqyGVQTPFJpTpKiB8E
gkvA7NaAXQcJLa47kdnNUieEtiVM5jry9kIo00BlD9H714yDBc29HAFH/TGifE7b+esZ
uOCbjtBIPw+OvrIymsW2pZ6vxZsWM/D9GbY3k=
MIME-Version: 1.0
Received: by 10.68.75.79 with SMTP id a15mr3775685pbw.62.1328153412656; Wed,
01 Feb 2012 19:30:12 -0800 (PST)
Received: by 10.142.100.2 with HTTP; Wed, 1 Feb 2012 19:30:12 -0800 (PST)
In-Reply-To: <CADpxtMLFdKyDNO5Cjr6wZDJFAqt9nPkCpgkZizUUfU_=-YjTjQ@mail.gmail.com>
References: <CADpxtMLFdKyDNO5Cjr6wZDJFAqt9nPkCpgkZizUUfU_=-YjTjQ@mail.gmail.com>
Date: Wed, 1 Feb 2012 19:30:12 -0800
Message-ID: <CADpxtM+wJObQ+h2eK=Tc=DCK5rT7zOdhMZR9Wm56Z9uO02B3Xg@mail.gmail.com>
Subject: Fwd: question about branches
From: Hwa Zynn <hwazynn@gmail.com>
To: common-dev@hadoop.apache.org
Content-Type: multipart/alternative; boundary=e89a8ffba0c35e5e6a04b7f2d07f
--e89a8ffba0c35e5e6a04b7f2d07f
Content-Type: text/plain; charset=ISO-8859-1
Hi, all,
I have a newcomer question. I would like to browse HDFS source code for the
1.0 release, but the Git repository (git://git.apache.org/hadoop-hdfs.git)
for Hadoop-HDFS project doesn't have this branch, not even 0.20. I can see
a lot more branches from Hadoop-Common project (
git://git.apache.org/hadoop-common.git) including branch-1.0 .
Why is that? Does Hadoop-Common branch-1.0 include all source code for HDFS
and MapReduce projects?
Thanks,
Yong
--e89a8ffba0c35e5e6a04b7f2d07f--
From common-dev-return-77592-apmail-hadoop-common-dev-archive=hadoop.apache.org@hadoop.apache.org Thu Feb 2 15:15:11 2012
Return-Path: <common-dev-return-77592-apmail-hadoop-common-dev-archive=hadoop.apache.org@hadoop.apache.org>
X-Original-To: apmail-hadoop-common-dev-archive@www.apache.org
Delivered-To: apmail-hadoop-common-dev-archive@www.apache.org
Received: from mail.apache.org (hermes.apache.org [140.211.11.3])
by minotaur.apache.org (Postfix) with SMTP id 359DD90BA
for <apmail-hadoop-common-dev-archive@www.apache.org>; Thu, 2 Feb 2012 15:15:11 +0000 (UTC)
Received: (qmail 64688 invoked by uid 500); 2 Feb 2012 15:15:09 -0000
Delivered-To: apmail-hadoop-common-dev-archive@hadoop.apache.org
Received: (qmail 64566 invoked by uid 500); 2 Feb 2012 15:15:08 -0000
Mailing-List: contact common-dev-help@hadoop.apache.org; run by ezmlm
Precedence: bulk
List-Help: <mailto:common-dev-help@hadoop.apache.org>
List-Unsubscribe: <mailto:common-dev-unsubscribe@hadoop.apache.org>
List-Post: <mailto:common-dev@hadoop.apache.org>
List-Id: <common-dev.hadoop.apache.org>
Reply-To: common-dev@hadoop.apache.org
Delivered-To: mailing list common-dev@hadoop.apache.org
Received: (qmail 64558 invoked by uid 500); 2 Feb 2012 15:15:07 -0000
Delivered-To: apmail-hadoop-core-dev@hadoop.apache.org
Received: (qmail 64554 invoked by uid 99); 2 Feb 2012 15:15:07 -0000
Received: from nike.apache.org (HELO nike.apache.org) (192.87.106.230)
by apache.org (qpsmtpd/0.29) with ESMTP; Thu, 02 Feb 2012 15:15:07 +0000
X-ASF-Spam-Status: No, hits=-0.0 required=5.0
tests=SPF_PASS
X-Spam-Check-By: apache.org
Received-SPF: pass (nike.apache.org: domain of lists@nabble.com designates 216.139.236.26 as permitted sender)
Received: from [216.139.236.26] (HELO sam.nabble.com) (216.139.236.26)
by apache.org (qpsmtpd/0.29) with ESMTP; Thu, 02 Feb 2012 15:15:01 +0000
Received: from isper.nabble.com ([192.168.236.156])
by sam.nabble.com with esmtp (Exim 4.72)
(envelope-from <lists@nabble.com>)
id 1RsyMx-0004nb-W6
for core-dev@hadoop.apache.org; Thu, 02 Feb 2012 07:14:39 -0800
Message-ID: <33250801.post@talk.nabble.com>
Date: Thu, 2 Feb 2012 07:14:39 -0800 (PST)
From: abees muhammad <abees.pm@gmail.com>
To: core-dev@hadoop.apache.org
Subject: Execute a Map/Reduce Job Jar from Another Java Program.
MIME-Version: 1.0
Content-Type: text/plain; charset=us-ascii
Content-Transfer-Encoding: 7bit
X-Nabble-From: abees.pm@gmail.com
X-Virus-Checked: Checked by ClamAV on apache.org
Hi,
I am a newbie to Hadoop Development. I have a Map/Reduce job jar file, i
want to execute this jar file programmatically from another java program. I
used the following code to execute it.
RunJar.main(String[] args). But The jar file is not executed.
Can you please give me a work around for this issue.
--
View this message in context: http://old.nabble.com/Execute-a-Map-Reduce-Job-Jar-from-Another-Java-Program.-tp33250801p33250801.html
Sent from the Hadoop core-dev mailing list archive at Nabble.com.
From common-dev-return-77593-apmail-hadoop-common-dev-archive=hadoop.apache.org@hadoop.apache.org Thu Feb 2 15:15:36 2012
Return-Path: <common-dev-return-77593-apmail-hadoop-common-dev-archive=hadoop.apache.org@hadoop.apache.org>
X-Original-To: apmail-hadoop-common-dev-archive@www.apache.org
Delivered-To: apmail-hadoop-common-dev-archive@www.apache.org
Received: from mail.apache.org (hermes.apache.org [140.211.11.3])
by minotaur.apache.org (Postfix) with SMTP id 5199890E5
for <apmail-hadoop-common-dev-archive@www.apache.org>; Thu, 2 Feb 2012 15:15:36 +0000 (UTC)
Received: (qmail 66376 invoked by uid 500); 2 Feb 2012 15:15:34 -0000
Delivered-To: apmail-hadoop-common-dev-archive@hadoop.apache.org
Received: (qmail 66222 invoked by uid 500); 2 Feb 2012 15:15:33 -0000
Mailing-List: contact common-dev-help@hadoop.apache.org; run by ezmlm
Precedence: bulk
List-Help: <mailto:common-dev-help@hadoop.apache.org>
List-Unsubscribe: <mailto:common-dev-unsubscribe@hadoop.apache.org>
List-Post: <mailto:common-dev@hadoop.apache.org>
List-Id: <common-dev.hadoop.apache.org>
Reply-To: common-dev@hadoop.apache.org
Delivered-To: mailing list common-dev@hadoop.apache.org
Received: (qmail 66214 invoked by uid 500); 2 Feb 2012 15:15:33 -0000
Delivered-To: apmail-hadoop-core-dev@hadoop.apache.org
Received: (qmail 66211 invoked by uid 99); 2 Feb 2012 15:15:33 -0000
Received: from nike.apache.org (HELO nike.apache.org) (192.87.106.230)
by apache.org (qpsmtpd/0.29) with ESMTP; Thu, 02 Feb 2012 15:15:33 +0000
X-ASF-Spam-Status: No, hits=-0.0 required=5.0
tests=SPF_PASS
X-Spam-Check-By: apache.org
Received-SPF: pass (nike.apache.org: domain of lists@nabble.com designates 216.139.236.26 as permitted sender)
Received: from [216.139.236.26] (HELO sam.nabble.com) (216.139.236.26)
by apache.org (qpsmtpd/0.29) with ESMTP; Thu, 02 Feb 2012 15:15:26 +0000
Received: from isper.nabble.com ([192.168.236.156])
by sam.nabble.com with esmtp (Exim 4.72)
(envelope-from <lists@nabble.com>)
id 1RsyNO-0004sS-8L
for core-dev@hadoop.apache.org; Thu, 02 Feb 2012 07:15:06 -0800
Message-ID: <33250805.post@talk.nabble.com>
Date: Thu, 2 Feb 2012 07:15:06 -0800 (PST)
From: abees muhammad <abees.pm@gmail.com>
To: core-dev@hadoop.apache.org
Subject: Execute a Map/Reduce Job Jar from Another Java Program.
MIME-Version: 1.0
Content-Type: text/plain; charset=us-ascii
Content-Transfer-Encoding: 7bit
X-Nabble-From: abees.pm@gmail.com
X-Virus-Checked: Checked by ClamAV on apache.org
Hi,
I am a newbie to Hadoop Development. I have a Map/Reduce job jar file, i
want to execute this jar file programmatically from another java program. I
used the following code to execute it.
RunJar.main(String[] args). But The jar file is not executed.
Can you please give me a work around for this issue.
--
View this message in context: http://old.nabble.com/Execute-a-Map-Reduce-Job-Jar-from-Another-Java-Program.-tp33250805p33250805.html
Sent from the Hadoop core-dev mailing list archive at Nabble.com.
From common-dev-return-77594-apmail-hadoop-common-dev-archive=hadoop.apache.org@hadoop.apache.org Thu Feb 2 15:37:40 2012
Return-Path: <common-dev-return-77594-apmail-hadoop-common-dev-archive=hadoop.apache.org@hadoop.apache.org>
X-Original-To: apmail-hadoop-common-dev-archive@www.apache.org
Delivered-To: apmail-hadoop-common-dev-archive@www.apache.org
Received: from mail.apache.org (hermes.apache.org [140.211.11.3])
by minotaur.apache.org (Postfix) with SMTP id 52D9D965B
for <apmail-hadoop-common-dev-archive@www.apache.org>; Thu, 2 Feb 2012 15:37:40 +0000 (UTC)
Received: (qmail 26664 invoked by uid 500); 2 Feb 2012 15:37:38 -0000
Delivered-To: apmail-hadoop-common-dev-archive@hadoop.apache.org
Received: (qmail 26579 invoked by uid 500); 2 Feb 2012 15:37:37 -0000
Mailing-List: contact common-dev-help@hadoop.apache.org; run by ezmlm
Precedence: bulk
List-Help: <mailto:common-dev-help@hadoop.apache.org>
List-Unsubscribe: <mailto:common-dev-unsubscribe@hadoop.apache.org>
List-Post: <mailto:common-dev@hadoop.apache.org>
List-Id: <common-dev.hadoop.apache.org>
Reply-To: common-dev@hadoop.apache.org
Delivered-To: mailing list common-dev@hadoop.apache.org
Received: (qmail 26568 invoked by uid 99); 2 Feb 2012 15:37:37 -0000
Received: from athena.apache.org (HELO athena.apache.org) (140.211.11.136)
by apache.org (qpsmtpd/0.29) with ESMTP; Thu, 02 Feb 2012 15:37:37 +0000
X-ASF-Spam-Status: No, hits=-0.7 required=5.0
tests=RCVD_IN_DNSWL_LOW,SPF_PASS
X-Spam-Check-By: apache.org
Received-SPF: pass (athena.apache.org: domain of harsh@cloudera.com designates 209.85.160.48 as permitted sender)
Received: from [209.85.160.48] (HELO mail-pw0-f48.google.com) (209.85.160.48)
by apache.org (qpsmtpd/0.29) with ESMTP; Thu, 02 Feb 2012 15:37:33 +0000
Received: by pbcc11 with SMTP id c11so2676368pbc.35
for <common-dev@hadoop.apache.org>; Thu, 02 Feb 2012 07:37:12 -0800 (PST)
Received: by 10.68.134.228 with SMTP id pn4mr8378675pbb.52.1328197032196; Thu,
02 Feb 2012 07:37:12 -0800 (PST)
MIME-Version: 1.0
Received: by 10.142.72.17 with HTTP; Thu, 2 Feb 2012 07:36:52 -0800 (PST)
In-Reply-To: <33250801.post@talk.nabble.com>
References: <33250801.post@talk.nabble.com>
From: Harsh J <harsh@cloudera.com>
Date: Thu, 2 Feb 2012 21:06:52 +0530
Message-ID: <CAOcnVr281N_zHD_BfSNBo8VivKEPT_KQnaiMM1K1mCcvac1-YQ@mail.gmail.com>
Subject: Re: Execute a Map/Reduce Job Jar from Another Java Program.
To: common-user@hadoop.apache.org, abees.pm@gmail.com
Content-Type: text/plain; charset=ISO-8859-1
Content-Transfer-Encoding: quoted-printable
Moving to common-user. Common-dev is for project development
discussions, not user help.
Could you elaborate on how you used RunJar? What arguments did you
provide, and is the target jar a runnable one or a regular jar? What
error did you get?
On Thu, Feb 2, 2012 at 8:44 PM, abees muhammad <abees.pm@gmail.com> wrote:
>
> Hi,
>
> I am a newbie to Hadoop Development. I have a Map/Reduce job jar file, i
> want to execute this jar file programmatically from another java program.=
I
> used the following code to execute it.
>
> RunJar.main(String[] args). But The jar file is not executed.
>
> Can you please give me =A0a work around for this issue.
> --
> View this message in context: http://old.nabble.com/Execute-a-Map-Reduce-=
Job-Jar-from-Another-Java-Program.-tp33250801p33250801.html
> Sent from the Hadoop core-dev mailing list archive at Nabble.com.
>
--=20
Harsh J
Customer Ops. Engineer
Cloudera | http://tiny.cloudera.com/about
From common-dev-return-77595-apmail-hadoop-common-dev-archive=hadoop.apache.org@hadoop.apache.org Thu Feb 2 16:21:17 2012
Return-Path: <common-dev-return-77595-apmail-hadoop-common-dev-archive=hadoop.apache.org@hadoop.apache.org>
X-Original-To: apmail-hadoop-common-dev-archive@www.apache.org
Delivered-To: apmail-hadoop-common-dev-archive@www.apache.org
Received: from mail.apache.org (hermes.apache.org [140.211.11.3])
by minotaur.apache.org (Postfix) with SMTP id 986509855
for <apmail-hadoop-common-dev-archive@www.apache.org>; Thu, 2 Feb 2012 16:21:17 +0000 (UTC)
Received: (qmail 35434 invoked by uid 500); 2 Feb 2012 16:21:15 -0000
Delivered-To: apmail-hadoop-common-dev-archive@hadoop.apache.org
Received: (qmail 35011 invoked by uid 500); 2 Feb 2012 16:21:14 -0000
Mailing-List: contact common-dev-help@hadoop.apache.org; run by ezmlm
Precedence: bulk
List-Help: <mailto:common-dev-help@hadoop.apache.org>
List-Unsubscribe: <mailto:common-dev-unsubscribe@hadoop.apache.org>
List-Post: <mailto:common-dev@hadoop.apache.org>
List-Id: <common-dev.hadoop.apache.org>
Reply-To: common-dev@hadoop.apache.org
Delivered-To: mailing list common-dev@hadoop.apache.org
Received: (qmail 34985 invoked by uid 99); 2 Feb 2012 16:21:13 -0000
Received: from athena.apache.org (HELO athena.apache.org) (140.211.11.136)
by apache.org (qpsmtpd/0.29) with ESMTP; Thu, 02 Feb 2012 16:21:13 +0000
X-ASF-Spam-Status: No, hits=-2000.0 required=5.0
tests=ALL_TRUSTED,T_RP_MATCHES_RCVD
X-Spam-Check-By: apache.org
Received: from [140.211.11.116] (HELO hel.zones.apache.org) (140.211.11.116)
by apache.org (qpsmtpd/0.29) with ESMTP; Thu, 02 Feb 2012 16:21:13 +0000
Received: from hel.zones.apache.org (hel.zones.apache.org [140.211.11.116])
by hel.zones.apache.org (Postfix) with ESMTP id 042B2188EA4
for <common-dev@hadoop.apache.org>; Thu, 2 Feb 2012 16:20:53 +0000 (UTC)
Date: Thu, 2 Feb 2012 16:20:53 +0000 (UTC)
From: "Robert Joseph Evans (Resolved) (JIRA)" <jira@apache.org>
To: common-dev@hadoop.apache.org
Message-ID: <1536690828.3250.1328199653019.JavaMail.tomcat@hel.zones.apache.org>
In-Reply-To: <39732429.1959.1297925244912.JavaMail.tomcat@hel.zones.apache.org>
Subject: [jira] [Resolved] (HADOOP-7147) setnetgrent in native code is not
portable
MIME-Version: 1.0
Content-Type: text/plain; charset=utf-8
Content-Transfer-Encoding: 7bit
X-JIRA-FingerPrint: 30527f35849b9dde25b450d4833f0394
[ https://issues.apache.org/jira/browse/HADOOP-7147?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Robert Joseph Evans resolved HADOOP-7147.
-----------------------------------------
Resolution: Won't Fix
This is still an issue, but it is not a big priority right now. If support for OS's becomes important we can reopen this issue.
> setnetgrent in native code is not portable
> ------------------------------------------
>
> Key: HADOOP-7147
> URL: https://issues.apache.org/jira/browse/HADOOP-7147
> Project: Hadoop Common
> Issue Type: Bug
> Components: native
> Affects Versions: 0.22.0, 0.23.0
> Reporter: Todd Lipcon
> Assignee: Allen Wittenauer
> Attachments: hadoop-7147.patch
>
>
> HADOOP-6864 uses the setnetgrent function in a way which is not compatible with BSD APIs, where the call returns void rather than int. This prevents the native libs from building on OSX, for example.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
From common-dev-return-77596-apmail-hadoop-common-dev-archive=hadoop.apache.org@hadoop.apache.org Thu Feb 2 16:57:52 2012
Return-Path: <common-dev-return-77596-apmail-hadoop-common-dev-archive=hadoop.apache.org@hadoop.apache.org>
X-Original-To: apmail-hadoop-common-dev-archive@www.apache.org
Delivered-To: apmail-hadoop-common-dev-archive@www.apache.org
Received: from mail.apache.org (hermes.apache.org [140.211.11.3])
by minotaur.apache.org (Postfix) with SMTP id 8C1D2954B
for <apmail-hadoop-common-dev-archive@www.apache.org>; Thu, 2 Feb 2012 16:57:52 +0000 (UTC)
Received: (qmail 14892 invoked by uid 500); 2 Feb 2012 16:57:50 -0000
Delivered-To: apmail-hadoop-common-dev-archive@hadoop.apache.org
Received: (qmail 14689 invoked by uid 500); 2 Feb 2012 16:57:49 -0000
Mailing-List: contact common-dev-help@hadoop.apache.org; run by ezmlm
Precedence: bulk
List-Help: <mailto:common-dev-help@hadoop.apache.org>
List-Unsubscribe: <mailto:common-dev-unsubscribe@hadoop.apache.org>
List-Post: <mailto:common-dev@hadoop.apache.org>
List-Id: <common-dev.hadoop.apache.org>
Reply-To: common-dev@hadoop.apache.org
Delivered-To: mailing list common-dev@hadoop.apache.org
Received: (qmail 14680 invoked by uid 99); 2 Feb 2012 16:57:49 -0000
Received: from minotaur.apache.org (HELO minotaur.apache.org) (140.211.11.9)
by apache.org (qpsmtpd/0.29) with ESMTP; Thu, 02 Feb 2012 16:57:49 +0000
Received: from localhost (HELO mail-lpp01m020-f176.google.com) (127.0.0.1)
(smtp-auth username omalley, mechanism plain)
by minotaur.apache.org (qpsmtpd/0.29) with ESMTP; Thu, 02 Feb 2012 16:57:49 +0000
Received: by lboi15 with SMTP id i15so557472lbo.35
for <common-dev@hadoop.apache.org>; Thu, 02 Feb 2012 08:57:47 -0800 (PST)
MIME-Version: 1.0
Received: by 10.112.25.106 with SMTP id b10mr923906lbg.102.1328201867475; Thu,
02 Feb 2012 08:57:47 -0800 (PST)
Received: by 10.112.62.35 with HTTP; Thu, 2 Feb 2012 08:57:47 -0800 (PST)
In-Reply-To: <CADpxtM+wJObQ+h2eK=Tc=DCK5rT7zOdhMZR9Wm56Z9uO02B3Xg@mail.gmail.com>
References: <CADpxtMLFdKyDNO5Cjr6wZDJFAqt9nPkCpgkZizUUfU_=-YjTjQ@mail.gmail.com>
<CADpxtM+wJObQ+h2eK=Tc=DCK5rT7zOdhMZR9Wm56Z9uO02B3Xg@mail.gmail.com>
Date: Thu, 2 Feb 2012 08:57:47 -0800
Message-ID: <CAHfHakGZLNddnMcnPPsOjO1KQF_K4XcaO-k9qba8p2cf8y+qMg@mail.gmail.com>
Subject: Re: question about branches
From: "Owen O'Malley" <omalley@apache.org>
To: common-dev@hadoop.apache.org
Content-Type: text/plain; charset=UTF-8
On Wed, Feb 1, 2012 at 7:30 PM, Hwa Zynn <hwazynn@gmail.com> wrote:
> Hi, all,
>
> I have a newcomer question. I would like to browse HDFS source code for the
> 1.0 release, but the Git repository (git://git.apache.org/hadoop-hdfs.git)
> for Hadoop-HDFS project doesn't have this branch, not even 0.20. I can see
> a lot more branches from Hadoop-Common project (
> git://git.apache.org/hadoop-common.git) including branch-1.0 .
>
> Why is that? Does Hadoop-Common branch-1.0 include all source code for HDFS
> and MapReduce projects?
The hadoop-hdfs.git and hadoop-mapreduce.git are basically dead at
this point. The project was split and then rejoined into a single
hadoop-common.git.
-- Owen
From common-dev-return-77597-apmail-hadoop-common-dev-archive=hadoop.apache.org@hadoop.apache.org Thu Feb 2 17:33:04 2012
Return-Path: <common-dev-return-77597-apmail-hadoop-common-dev-archive=hadoop.apache.org@hadoop.apache.org>
X-Original-To: apmail-hadoop-common-dev-archive@www.apache.org
Delivered-To: apmail-hadoop-common-dev-archive@www.apache.org
Received: from mail.apache.org (hermes.apache.org [140.211.11.3])
by minotaur.apache.org (Postfix) with SMTP id 549FC9E96
for <apmail-hadoop-common-dev-archive@www.apache.org>; Thu, 2 Feb 2012 17:33:04 +0000 (UTC)
Received: (qmail 99731 invoked by uid 500); 2 Feb 2012 17:32:58 -0000
Delivered-To: apmail-hadoop-common-dev-archive@hadoop.apache.org
Received: (qmail 99628 invoked by uid 500); 2 Feb 2012 17:32:57 -0000
Mailing-List: contact common-dev-help@hadoop.apache.org; run by ezmlm
Precedence: bulk
List-Help: <mailto:common-dev-help@hadoop.apache.org>
List-Unsubscribe: <mailto:common-dev-unsubscribe@hadoop.apache.org>
List-Post: <mailto:common-dev@hadoop.apache.org>
List-Id: <common-dev.hadoop.apache.org>
Reply-To: common-dev@hadoop.apache.org
Delivered-To: mailing list common-dev@hadoop.apache.org
Received: (qmail 99612 invoked by uid 99); 2 Feb 2012 17:32:56 -0000
Received: from nike.apache.org (HELO nike.apache.org) (192.87.106.230)
by apache.org (qpsmtpd/0.29) with ESMTP; Thu, 02 Feb 2012 17:32:56 +0000
X-ASF-Spam-Status: No, hits=2.6 required=5.0
tests=HTML_MESSAGE,NO_RDNS_DOTCOM_HELO,RCVD_IN_DNSWL_LOW,SPF_NEUTRAL
X-Spam-Check-By: apache.org
Received-SPF: neutral (nike.apache.org: 216.145.54.172 is neither permitted nor denied by domain of evans@yahoo-inc.com)
Received: from [216.145.54.172] (HELO mrout2.yahoo.com) (216.145.54.172)
by apache.org (qpsmtpd/0.29) with ESMTP; Thu, 02 Feb 2012 17:32:49 +0000
Received: from SP1-EX07CAS04.ds.corp.yahoo.com (sp1-ex07cas04.corp.sp1.yahoo.com [216.252.116.155])
by mrout2.yahoo.com (8.14.4/8.14.4/y.out) with ESMTP id q12HWFfk097559;
Thu, 2 Feb 2012 09:32:15 -0800 (PST)
DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/simple; d=yahoo-inc.com;
s=cobra; t=1328203935;
bh=rbkX52Aed9D4oW0VJzzzPA5sjhfBvB/HpBevSv0QCNw=;
h=From:To:Date:Subject:Message-ID:In-Reply-To:Content-Type:
MIME-Version;
b=pxJ+M+OMB7vkgwBw6Xc1wu/5W9rUN/0aFFrBy9oJVtARQSEUHZdLJSJq0HxF7QAkl
0kJ04+eSpn5wEvfTtjx+DoGS3gNtYsQbsx6P90YQkpewrWPKFldy8clpoWfxvk5ETX
j9ZnL9mCWdz5I9Bbc5aIt2nzJEho896uVwsPM+/w=
Received: from SP1-EX07VS02.ds.corp.yahoo.com ([216.252.116.135]) by
SP1-EX07CAS04.ds.corp.yahoo.com ([216.252.116.155]) with mapi; Thu, 2 Feb
2012 11:32:15 -0600
From: Robert Evans <evans@yahoo-inc.com>
To: "common-dev@hadoop.apache.org" <common-dev@hadoop.apache.org>,
"common-user@hadoop.apache.org" <common-user@hadoop.apache.org>,
"abees.pm@gmail.com" <abees.pm@gmail.com>
Date: Thu, 2 Feb 2012 11:32:12 -0600
Subject: Re: Execute a Map/Reduce Job Jar from Another Java Program.
Thread-Topic: Execute a Map/Reduce Job Jar from Another Java Program.
Thread-Index: AczhwKOjqS0GYmLkQumnRNEDb1FNZwAD/UrK
Message-ID: <CB5024BC.338EF%evans@yahoo-inc.com>
In-Reply-To: <CAOcnVr281N_zHD_BfSNBo8VivKEPT_KQnaiMM1K1mCcvac1-YQ@mail.gmail.com>
Accept-Language: en-US
Content-Language: en
X-MS-Has-Attach:
X-MS-TNEF-Correlator:
acceptlanguage: en-US
Content-Type: multipart/alternative;
boundary="_000_CB5024BC338EFevansyahooinccom_"
MIME-Version: 1.0
X-Virus-Checked: Checked by ClamAV on apache.org
--_000_CB5024BC338EFevansyahooinccom_
Content-Type: text/plain; charset="iso-8859-1"
Content-Transfer-Encoding: quoted-printable
What happens? Is there an exception, does nothing happen? I am curious. =
Also how did you launch your other job that is trying to run this one. The=
hadoop script sets up a lot of environment variables classpath etc to make=
hadoop work properly, and some of that may not be set up correctly to make=
RunJar work.
--Bobby Evans
On 2/2/12 9:36 AM, "Harsh J" <harsh@cloudera.com> wrote:
Moving to common-user. Common-dev is for project development
discussions, not user help.
Could you elaborate on how you used RunJar? What arguments did you
provide, and is the target jar a runnable one or a regular jar? What
error did you get?
On Thu, Feb 2, 2012 at 8:44 PM, abees muhammad <abees.pm@gmail.com> wrote:
>
> Hi,
>
> I am a newbie to Hadoop Development. I have a Map/Reduce job jar file, i
> want to execute this jar file programmatically from another java program.=
I
> used the following code to execute it.
>
> RunJar.main(String[] args). But The jar file is not executed.
>
> Can you please give me a work around for this issue.
> --
> View this message in context: http://old.nabble.com/Execute-a-Map-Reduce-=
Job-Jar-from-Another-Java-Program.-tp33250801p33250801.html
> Sent from the Hadoop core-dev mailing list archive at Nabble.com.
>
--
Harsh J
Customer Ops. Engineer
Cloudera | http://tiny.cloudera.com/about
--_000_CB5024BC338EFevansyahooinccom_--
From common-dev-return-77598-apmail-hadoop-common-dev-archive=hadoop.apache.org@hadoop.apache.org Thu Feb 2 18:39:20 2012
Return-Path: <common-dev-return-77598-apmail-hadoop-common-dev-archive=hadoop.apache.org@hadoop.apache.org>
X-Original-To: apmail-hadoop-common-dev-archive@www.apache.org
Delivered-To: apmail-hadoop-common-dev-archive@www.apache.org
Received: from mail.apache.org (hermes.apache.org [140.211.11.3])
by minotaur.apache.org (Postfix) with SMTP id E1D569F70
for <apmail-hadoop-common-dev-archive@www.apache.org>; Thu, 2 Feb 2012 18:39:20 +0000 (UTC)
Received: (qmail 42190 invoked by uid 500); 2 Feb 2012 18:39:19 -0000
Delivered-To: apmail-hadoop-common-dev-archive@hadoop.apache.org
Received: (qmail 41765 invoked by uid 500); 2 Feb 2012 18:39:18 -0000
Mailing-List: contact common-dev-help@hadoop.apache.org; run by ezmlm
Precedence: bulk
List-Help: <mailto:common-dev-help@hadoop.apache.org>
List-Unsubscribe: <mailto:common-dev-unsubscribe@hadoop.apache.org>
List-Post: <mailto:common-dev@hadoop.apache.org>
List-Id: <common-dev.hadoop.apache.org>
Reply-To: common-dev@hadoop.apache.org
Delivered-To: mailing list common-dev@hadoop.apache.org
Received: (qmail 41755 invoked by uid 99); 2 Feb 2012 18:39:17 -0000
Received: from nike.apache.org (HELO nike.apache.org) (192.87.106.230)
by apache.org (qpsmtpd/0.29) with ESMTP; Thu, 02 Feb 2012 18:39:17 +0000
X-ASF-Spam-Status: No, hits=-2000.0 required=5.0
tests=ALL_TRUSTED,T_RP_MATCHES_RCVD
X-Spam-Check-By: apache.org
Received: from [140.211.11.116] (HELO hel.zones.apache.org) (140.211.11.116)
by apache.org (qpsmtpd/0.29) with ESMTP; Thu, 02 Feb 2012 18:39:15 +0000
Received: from hel.zones.apache.org (hel.zones.apache.org [140.211.11.116])
by hel.zones.apache.org (Postfix) with ESMTP id A1C2F188B44
for <common-dev@hadoop.apache.org>; Thu, 2 Feb 2012 18:38:54 +0000 (UTC)
Date: Thu, 2 Feb 2012 18:38:54 +0000 (UTC)
From: "Daryn Sharp (Created) (JIRA)" <jira@apache.org>
To: common-dev@hadoop.apache.org
Message-ID: <1562427463.3975.1328207934664.JavaMail.tomcat@hel.zones.apache.org>
Subject: [jira] [Created] (HADOOP-8013) ViewFileSystem does not honer
setVerifyChecksum
MIME-Version: 1.0
Content-Type: text/plain; charset=utf-8
Content-Transfer-Encoding: 7bit
X-JIRA-FingerPrint: 30527f35849b9dde25b450d4833f0394
X-Virus-Checked: Checked by ClamAV on apache.org
ViewFileSystem does not honer setVerifyChecksum
-----------------------------------------------
Key: HADOOP-8013
URL: https://issues.apache.org/jira/browse/HADOOP-8013
Project: Hadoop Common
Issue Type: Bug
Components: fs
Affects Versions: 0.23.0, 0.24.0
Reporter: Daryn Sharp
Assignee: Daryn Sharp
{{ViewFileSystem#setVerifyChecksum}} is a no-op. It should call {{setVerifyChecksum}} on the mount points.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
From common-dev-return-77599-apmail-hadoop-common-dev-archive=hadoop.apache.org@hadoop.apache.org Thu Feb 2 18:51:20 2012
Return-Path: <common-dev-return-77599-apmail-hadoop-common-dev-archive=hadoop.apache.org@hadoop.apache.org>
X-Original-To: apmail-hadoop-common-dev-archive@www.apache.org
Delivered-To: apmail-hadoop-common-dev-archive@www.apache.org
Received: from mail.apache.org (hermes.apache.org [140.211.11.3])
by minotaur.apache.org (Postfix) with SMTP id AFAEF9903
for <apmail-hadoop-common-dev-archive@www.apache.org>; Thu, 2 Feb 2012 18:51:20 +0000 (UTC)
Received: (qmail 77904 invoked by uid 500); 2 Feb 2012 18:51:18 -0000
Delivered-To: apmail-hadoop-common-dev-archive@hadoop.apache.org
Received: (qmail 77638 invoked by uid 500); 2 Feb 2012 18:51:17 -0000
Mailing-List: contact common-dev-help@hadoop.apache.org; run by ezmlm
Precedence: bulk
List-Help: <mailto:common-dev-help@hadoop.apache.org>
List-Unsubscribe: <mailto:common-dev-unsubscribe@hadoop.apache.org>
List-Post: <mailto:common-dev@hadoop.apache.org>
List-Id: <common-dev.hadoop.apache.org>
Reply-To: common-dev@hadoop.apache.org
Delivered-To: mailing list common-dev@hadoop.apache.org
Received: (qmail 77579 invoked by uid 99); 2 Feb 2012 18:51:17 -0000
Received: from nike.apache.org (HELO nike.apache.org) (192.87.106.230)
by apache.org (qpsmtpd/0.29) with ESMTP; Thu, 02 Feb 2012 18:51:17 +0000
X-ASF-Spam-Status: No, hits=-2000.0 required=5.0
tests=ALL_TRUSTED,T_RP_MATCHES_RCVD
X-Spam-Check-By: apache.org
Received: from [140.211.11.116] (HELO hel.zones.apache.org) (140.211.11.116)
by apache.org (qpsmtpd/0.29) with ESMTP; Thu, 02 Feb 2012 18:51:15 +0000
Received: from hel.zones.apache.org (hel.zones.apache.org [140.211.11.116])
by hel.zones.apache.org (Postfix) with ESMTP id 1B7A6189619
for <common-dev@hadoop.apache.org>; Thu, 2 Feb 2012 18:50:54 +0000 (UTC)
Date: Thu, 2 Feb 2012 18:50:54 +0000 (UTC)
From: "Daryn Sharp (Created) (JIRA)" <jira@apache.org>
To: common-dev@hadoop.apache.org
Message-ID: <1392144349.4083.1328208654114.JavaMail.tomcat@hel.zones.apache.org>
Subject: [jira] [Created] (HADOOP-8014) ViewFileSystem does not correctly
implement getDefaultBlockSize and getDefaultReplication
MIME-Version: 1.0
Content-Type: text/plain; charset=utf-8
Content-Transfer-Encoding: 7bit
X-JIRA-FingerPrint: 30527f35849b9dde25b450d4833f0394
X-Virus-Checked: Checked by ClamAV on apache.org
ViewFileSystem does not correctly implement getDefaultBlockSize and getDefaultReplication
-----------------------------------------------------------------------------------------
Key: HADOOP-8014
URL: https://issues.apache.org/jira/browse/HADOOP-8014
Project: Hadoop Common
Issue Type: Bug
Components: fs
Affects Versions: 0.23.0, 0.24.0
Reporter: Daryn Sharp
Assignee: Daryn Sharp
{{ViewFileSystem}} incorrectly returns the {{FileSystem}} default values for {{getDefaultBlockSize()}} and {{getDefaultReplication()}}. This causes files to be created with incorrect values. The problem is that the current apis are insufficient for viewfs because the defaults depend on the underlying mount point. These methods need counterparts that accept a {{Path}} so viewfs can resolve the mount point for a path.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
From common-dev-return-77600-apmail-hadoop-common-dev-archive=hadoop.apache.org@hadoop.apache.org Thu Feb 2 18:59:21 2012
Return-Path: <common-dev-return-77600-apmail-hadoop-common-dev-archive=hadoop.apache.org@hadoop.apache.org>
X-Original-To: apmail-hadoop-common-dev-archive@www.apache.org
Delivered-To: apmail-hadoop-common-dev-archive@www.apache.org
Received: from mail.apache.org (hermes.apache.org [140.211.11.3])
by minotaur.apache.org (Postfix) with SMTP id C92B89D5D
for <apmail-hadoop-common-dev-archive@www.apache.org>; Thu, 2 Feb 2012 18:59:21 +0000 (UTC)
Received: (qmail 98765 invoked by uid 500); 2 Feb 2012 18:59:19 -0000
Delivered-To: apmail-hadoop-common-dev-archive@hadoop.apache.org
Received: (qmail 98466 invoked by uid 500); 2 Feb 2012 18:59:18 -0000
Mailing-List: contact common-dev-help@hadoop.apache.org; run by ezmlm
Precedence: bulk
List-Help: <mailto:common-dev-help@hadoop.apache.org>
List-Unsubscribe: <mailto:common-dev-unsubscribe@hadoop.apache.org>
List-Post: <mailto:common-dev@hadoop.apache.org>
List-Id: <common-dev.hadoop.apache.org>
Reply-To: common-dev@hadoop.apache.org
Delivered-To: mailing list common-dev@hadoop.apache.org
Received: (qmail 98449 invoked by uid 99); 2 Feb 2012 18:59:18 -0000
Received: from athena.apache.org (HELO athena.apache.org) (140.211.11.136)
by apache.org (qpsmtpd/0.29) with ESMTP; Thu, 02 Feb 2012 18:59:18 +0000
X-ASF-Spam-Status: No, hits=-2000.0 required=5.0
tests=ALL_TRUSTED,T_RP_MATCHES_RCVD
X-Spam-Check-By: apache.org
Received: from [140.211.11.116] (HELO hel.zones.apache.org) (140.211.11.116)
by apache.org (qpsmtpd/0.29) with ESMTP; Thu, 02 Feb 2012 18:59:17 +0000
Received: from hel.zones.apache.org (hel.zones.apache.org [140.211.11.116])
by hel.zones.apache.org (Postfix) with ESMTP id 5AF9B189B50
for <common-dev@hadoop.apache.org>; Thu, 2 Feb 2012 18:58:57 +0000 (UTC)
Date: Thu, 2 Feb 2012 18:58:57 +0000 (UTC)
From: "Daryn Sharp (Created) (JIRA)" <jira@apache.org>
To: common-dev@hadoop.apache.org
Message-ID: <9793606.4124.1328209137377.JavaMail.tomcat@hel.zones.apache.org>
Subject: [jira] [Created] (HADOOP-8015) ChRootFileSystem should extend
FilterFileSystem
MIME-Version: 1.0
Content-Type: text/plain; charset=utf-8
Content-Transfer-Encoding: 7bit
X-JIRA-FingerPrint: 30527f35849b9dde25b450d4833f0394
ChRootFileSystem should extend FilterFileSystem
-----------------------------------------------
Key: HADOOP-8015
URL: https://issues.apache.org/jira/browse/HADOOP-8015
Project: Hadoop Common
Issue Type: Improvement
Components: fs
Affects Versions: 0.23.0, 0.24.0
Reporter: Daryn Sharp
Assignee: Daryn Sharp
{{ChRootFileSystem}} simply extends {{FileSystem}}, and attempts to delegate some methods to the underlying mount point. It is essentially the same as {{FilterFileSystem}} but it mangles the paths to include the chroot path. Unfortunately {{ChRootFileSystem}} is not delegating some methods that should be delegated. Changing the inheritance will prevent a copy-n-paste of code for HADOOP-8013 and HADOOP-8014 into both {{ChRootFileSystem}} and {{FilterFileSystem}}.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
From common-dev-return-77601-apmail-hadoop-common-dev-archive=hadoop.apache.org@hadoop.apache.org Thu Feb 2 21:37:17 2012
Return-Path: <common-dev-return-77601-apmail-hadoop-common-dev-archive=hadoop.apache.org@hadoop.apache.org>
X-Original-To: apmail-hadoop-common-dev-archive@www.apache.org
Delivered-To: apmail-hadoop-common-dev-archive@www.apache.org
Received: from mail.apache.org (hermes.apache.org [140.211.11.3])
by minotaur.apache.org (Postfix) with SMTP id EA514929F
for <apmail-hadoop-common-dev-archive@www.apache.org>; Thu, 2 Feb 2012 21:37:17 +0000 (UTC)
Received: (qmail 87683 invoked by uid 500); 2 Feb 2012 21:37:15 -0000
Delivered-To: apmail-hadoop-common-dev-archive@hadoop.apache.org
Received: (qmail 87089 invoked by uid 500); 2 Feb 2012 21:37:15 -0000
Mailing-List: contact common-dev-help@hadoop.apache.org; run by ezmlm
Precedence: bulk
List-Help: <mailto:common-dev-help@hadoop.apache.org>
List-Unsubscribe: <mailto:common-dev-unsubscribe@hadoop.apache.org>
List-Post: <mailto:common-dev@hadoop.apache.org>
List-Id: <common-dev.hadoop.apache.org>
Reply-To: common-dev@hadoop.apache.org
Delivered-To: mailing list common-dev@hadoop.apache.org
Received: (qmail 86720 invoked by uid 99); 2 Feb 2012 21:37:14 -0000
Received: from athena.apache.org (HELO athena.apache.org) (140.211.11.136)
by apache.org (qpsmtpd/0.29) with ESMTP; Thu, 02 Feb 2012 21:37:14 +0000
X-ASF-Spam-Status: No, hits=-2000.0 required=5.0
tests=ALL_TRUSTED,T_RP_MATCHES_RCVD
X-Spam-Check-By: apache.org
Received: from [140.211.11.116] (HELO hel.zones.apache.org) (140.211.11.116)
by apache.org (qpsmtpd/0.29) with ESMTP; Thu, 02 Feb 2012 21:37:13 +0000
Received: from hel.zones.apache.org (hel.zones.apache.org [140.211.11.116])
by hel.zones.apache.org (Postfix) with ESMTP id C569C18975D
for <common-dev@hadoop.apache.org>; Thu, 2 Feb 2012 21:36:53 +0000 (UTC)
Date: Thu, 2 Feb 2012 21:36:53 +0000 (UTC)
From: "Bert Sanders (Created) (JIRA)" <jira@apache.org>
To: common-dev@hadoop.apache.org
Message-ID: <408332890.4883.1328218613810.JavaMail.tomcat@hel.zones.apache.org>
Subject: [jira] [Created] (HADOOP-8016) Support LZ4/Snappy within TFile
MIME-Version: 1.0
Content-Type: text/plain; charset=utf-8
Content-Transfer-Encoding: 7bit
X-JIRA-FingerPrint: 30527f35849b9dde25b450d4833f0394
Support LZ4/Snappy within TFile
-------------------------------
Key: HADOOP-8016
URL: https://issues.apache.org/jira/browse/HADOOP-8016
Project: Hadoop Common
Issue Type: Improvement
Reporter: Bert Sanders
TFile currently allows LZO and GZ as compression mechanisms.
It would be good to allow any other compression algorithm among those integrated within Hadoop.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
From common-dev-return-77602-apmail-hadoop-common-dev-archive=hadoop.apache.org@hadoop.apache.org Thu Feb 2 23:49:13 2012
Return-Path: <common-dev-return-77602-apmail-hadoop-common-dev-archive=hadoop.apache.org@hadoop.apache.org>
X-Original-To: apmail-hadoop-common-dev-archive@www.apache.org
Delivered-To: apmail-hadoop-common-dev-archive@www.apache.org
Received: from mail.apache.org (hermes.apache.org [140.211.11.3])
by minotaur.apache.org (Postfix) with SMTP id 85A199660
for <apmail-hadoop-common-dev-archive@www.apache.org>; Thu, 2 Feb 2012 23:49:13 +0000 (UTC)
Received: (qmail 9016 invoked by uid 500); 2 Feb 2012 23:49:11 -0000
Delivered-To: apmail-hadoop-common-dev-archive@hadoop.apache.org
Received: (qmail 8905 invoked by uid 500); 2 Feb 2012 23:49:11 -0000
Mailing-List: contact common-dev-help@hadoop.apache.org; run by ezmlm
Precedence: bulk
List-Help: <mailto:common-dev-help@hadoop.apache.org>
List-Unsubscribe: <mailto:common-dev-unsubscribe@hadoop.apache.org>
List-Post: <mailto:common-dev@hadoop.apache.org>
List-Id: <common-dev.hadoop.apache.org>
Reply-To: common-dev@hadoop.apache.org
Delivered-To: mailing list common-dev@hadoop.apache.org
Received: (qmail 8897 invoked by uid 99); 2 Feb 2012 23:49:10 -0000
Received: from nike.apache.org (HELO nike.apache.org) (192.87.106.230)
by apache.org (qpsmtpd/0.29) with ESMTP; Thu, 02 Feb 2012 23:49:10 +0000
X-ASF-Spam-Status: No, hits=2.2 required=5.0
tests=HTML_MESSAGE,SPF_PASS
X-Spam-Check-By: apache.org
Received-SPF: pass (nike.apache.org: local policy)
Received: from [204.154.183.83] (HELO smtp1.exar.com) (204.154.183.83)
by apache.org (qpsmtpd/0.29) with ESMTP; Thu, 02 Feb 2012 23:49:02 +0000
Received: from FRE1EXCH02.hq.exar.com ([fe80::e9a7:6160:4e13:1677]) by
fre1-cas ([10.127.1.162]) with mapi; Thu, 2 Feb 2012 15:48:40 -0800
From: Tim Broberg <Tim.Broberg@exar.com>
To: "common-dev@hadoop.apache.org" <common-dev@hadoop.apache.org>
Date: Thu, 2 Feb 2012 15:48:40 -0800
Subject: Getting started with Eclipse for Hadoop 1.0.0?
Thread-Topic: Getting started with Eclipse for Hadoop 1.0.0?
Thread-Index: AQHM4gUw6Dx0OVBDMkyZgmyjIne4Nw==
Message-ID: <FCA91A92EE52B041906A0358FC28FCC38F667B5E1E@FRE1EXCH02.hq.exar.com>
Accept-Language: en-US
Content-Language: en-US
X-MS-Has-Attach:
X-MS-TNEF-Correlator:
acceptlanguage: en-US
Content-Type: multipart/alternative;
boundary="_000_FCA91A92EE52B041906A0358FC28FCC38F667B5E1EFRE1EXCH02hqe_"
MIME-Version: 1.0
X-Virus-Checked: Checked by ClamAV on apache.org
--_000_FCA91A92EE52B041906A0358FC28FCC38F667B5E1EFRE1EXCH02hqe_
Content-Type: text/plain; charset="iso-8859-1"
Content-Transfer-Encoding: quoted-printable
Any suggestions with getting started with eclipse debugging for 1.0.0?
I would like to be able to debug unit tests for my compression codec with s=
ome reasonable debugger, be it eclipse, netbeans, or even jdb.
Harsh recommended Eclipse, so I'm wading in...
When I run "ant eclipse" I get missing file errors. The docs on the wiki ar=
e about using mvn, which isn't supported in 1.x and they include a cryptic =
note that "this" doesn't work, whatever "this" is.
Many of the blog entries describing how to do this refer to the eclipse plu=
gin page above, but the sections they refer to appear to have been deleted.
Eclipse isn't mentioned in The Book at all, and the 1.0.0 docs directory me=
ntions it only in passing in the release notes and changes docs.
If I just try to create a project from build.xml, there appears to be a mis=
sing ivy classpath file.
What is the best way to get started debugging with Eclipse?
Thanks,
- Tim.
________________________________
The information and any attached documents contained in this message
may be confidential and/or legally privileged. The message is
intended solely for the addressee(s). If you are not the intended
recipient, you are hereby notified that any use, dissemination, or
reproduction is strictly prohibited and may be unlawful. If you are
not the intended recipient, please contact the sender immediately by
return e-mail and destroy all copies of the original message.
--_000_FCA91A92EE52B041906A0358FC28FCC38F667B5E1EFRE1EXCH02hqe_--
From common-dev-return-77603-apmail-hadoop-common-dev-archive=hadoop.apache.org@hadoop.apache.org Fri Feb 3 03:53:56 2012
Return-Path: <common-dev-return-77603-apmail-hadoop-common-dev-archive=hadoop.apache.org@hadoop.apache.org>
X-Original-To: apmail-hadoop-common-dev-archive@www.apache.org
Delivered-To: apmail-hadoop-common-dev-archive@www.apache.org
Received: from mail.apache.org (hermes.apache.org [140.211.11.3])
by minotaur.apache.org (Postfix) with SMTP id E3B899834
for <apmail-hadoop-common-dev-archive@www.apache.org>; Fri, 3 Feb 2012 03:53:55 +0000 (UTC)
Received: (qmail 28647 invoked by uid 500); 3 Feb 2012 03:53:52 -0000
Delivered-To: apmail-hadoop-common-dev-archive@hadoop.apache.org
Received: (qmail 27973 invoked by uid 500); 3 Feb 2012 03:53:44 -0000
Mailing-List: contact common-dev-help@hadoop.apache.org; run by ezmlm
Precedence: bulk
List-Help: <mailto:common-dev-help@hadoop.apache.org>
List-Unsubscribe: <mailto:common-dev-unsubscribe@hadoop.apache.org>
List-Post: <mailto:common-dev@hadoop.apache.org>
List-Id: <common-dev.hadoop.apache.org>
Reply-To: common-dev@hadoop.apache.org
Delivered-To: mailing list common-dev@hadoop.apache.org
Received: (qmail 27965 invoked by uid 99); 3 Feb 2012 03:53:43 -0000
Received: from athena.apache.org (HELO athena.apache.org) (140.211.11.136)
by apache.org (qpsmtpd/0.29) with ESMTP; Fri, 03 Feb 2012 03:53:43 +0000
X-ASF-Spam-Status: No, hits=-0.7 required=5.0
tests=RCVD_IN_DNSWL_LOW,SPF_PASS
X-Spam-Check-By: apache.org
Received-SPF: pass (athena.apache.org: domain of harsh@cloudera.com designates 209.85.210.48 as permitted sender)
Received: from [209.85.210.48] (HELO mail-pz0-f48.google.com) (209.85.210.48)
by apache.org (qpsmtpd/0.29) with ESMTP; Fri, 03 Feb 2012 03:53:38 +0000
Received: by dadp13 with SMTP id p13so2956938dad.35
for <common-dev@hadoop.apache.org>; Thu, 02 Feb 2012 19:53:18 -0800 (PST)
Received: by 10.68.74.167 with SMTP id u7mr13700044pbv.103.1328241198151; Thu,
02 Feb 2012 19:53:18 -0800 (PST)
MIME-Version: 1.0
Received: by 10.142.72.17 with HTTP; Thu, 2 Feb 2012 19:52:58 -0800 (PST)
In-Reply-To: <FCA91A92EE52B041906A0358FC28FCC38F667B5E1E@FRE1EXCH02.hq.exar.com>
References: <FCA91A92EE52B041906A0358FC28FCC38F667B5E1E@FRE1EXCH02.hq.exar.com>
From: Harsh J <harsh@cloudera.com>
Date: Fri, 3 Feb 2012 09:22:58 +0530
Message-ID: <CAOcnVr2hGcEVofXmFEx_GdG=2LoxQRmYPAj-a8y7ULc-x8zkOg@mail.gmail.com>
Subject: Re: Getting started with Eclipse for Hadoop 1.0.0?
To: common-dev@hadoop.apache.org
Content-Type: text/plain; charset=ISO-8859-1
Content-Transfer-Encoding: quoted-printable
Hi Tim,
Could you try using the branch-1 from the svn-repo/git-clone instead
of a release tarball which may not work in the case of 1.0?
Its a WIP but I also cover some branch building at
http://wiki.apache.org/hadoop/QwertyManiac/BuildingHadoopTrunk --
Perhaps it could come useful to you.
On Fri, Feb 3, 2012 at 5:18 AM, Tim Broberg <Tim.Broberg@exar.com> wrote:
> Any suggestions with getting started with eclipse debugging for 1.0.0?
>
> I would like to be able to debug unit tests for my compression codec with=
some reasonable debugger, be it eclipse, netbeans, or even jdb.
>
> Harsh recommended Eclipse, so I'm wading in...
>
> When I run "ant eclipse" I get missing file errors. The docs on the wiki =
are about using mvn, which isn't supported in 1.x and they include a crypti=
c note that "this" doesn't work, whatever "this" is.
>
> Many of the blog entries describing how to do this refer to the eclipse p=
lugin page above, but the sections they refer to appear to have been delete=
d.
>
> Eclipse isn't mentioned in The Book at all, and the 1.0.0 docs directory =
mentions it only in passing in the release notes and changes docs.
>
> If I just try to create a project from build.xml, there appears to be a m=
issing ivy classpath file.
>
> What is the best way to get started debugging with Eclipse?
>
> Thanks,
> =A0 =A0- Tim.
>
> ________________________________
> The information and any attached documents contained in this message
> may be confidential and/or legally privileged. The message is
> intended solely for the addressee(s). If you are not the intended
> recipient, you are hereby notified that any use, dissemination, or
> reproduction is strictly prohibited and may be unlawful. If you are
> not the intended recipient, please contact the sender immediately by
> return e-mail and destroy all copies of the original message.
--=20
Harsh J
Customer Ops. Engineer
Cloudera | http://tiny.cloudera.com/about
From common-dev-return-77604-apmail-hadoop-common-dev-archive=hadoop.apache.org@hadoop.apache.org Fri Feb 3 05:28:19 2012
Return-Path: <common-dev-return-77604-apmail-hadoop-common-dev-archive=hadoop.apache.org@hadoop.apache.org>
X-Original-To: apmail-hadoop-common-dev-archive@www.apache.org
Delivered-To: apmail-hadoop-common-dev-archive@www.apache.org
Received: from mail.apache.org (hermes.apache.org [140.211.11.3])
by minotaur.apache.org (Postfix) with SMTP id D4B069660
for <apmail-hadoop-common-dev-archive@www.apache.org>; Fri, 3 Feb 2012 05:28:19 +0000 (UTC)
Received: (qmail 7671 invoked by uid 500); 3 Feb 2012 05:28:16 -0000
Delivered-To: apmail-hadoop-common-dev-archive@hadoop.apache.org
Received: (qmail 7264 invoked by uid 500); 3 Feb 2012 05:28:02 -0000
Mailing-List: contact common-dev-help@hadoop.apache.org; run by ezmlm
Precedence: bulk
List-Help: <mailto:common-dev-help@hadoop.apache.org>
List-Unsubscribe: <mailto:common-dev-unsubscribe@hadoop.apache.org>
List-Post: <mailto:common-dev@hadoop.apache.org>
List-Id: <common-dev.hadoop.apache.org>
Reply-To: common-dev@hadoop.apache.org
Delivered-To: mailing list common-dev@hadoop.apache.org
Received: (qmail 7246 invoked by uid 99); 3 Feb 2012 05:27:52 -0000
Received: from athena.apache.org (HELO athena.apache.org) (140.211.11.136)
by apache.org (qpsmtpd/0.29) with ESMTP; Fri, 03 Feb 2012 05:27:52 +0000
X-ASF-Spam-Status: No, hits=3.0 required=5.0
tests=FREEMAIL_ENVFROM_END_DIGIT,FREEMAIL_FORGED_REPLYTO,FREEMAIL_REPLYTO_END_DIGIT,RCVD_IN_DNSWL_NONE,SPF_PASS
X-Spam-Check-By: apache.org
Received-SPF: pass (athena.apache.org: local policy)
Received: from [98.138.229.165] (HELO nm39-vm5.bullet.mail.ne1.yahoo.com) (98.138.229.165)
by apache.org (qpsmtpd/0.29) with SMTP; Fri, 03 Feb 2012 05:27:41 +0000
Received: from [98.138.90.57] by nm39.bullet.mail.ne1.yahoo.com with NNFMP; 03 Feb 2012 05:27:20 -0000
Received: from [98.138.87.5] by tm10.bullet.mail.ne1.yahoo.com with NNFMP; 03 Feb 2012 05:27:20 -0000
Received: from [127.0.0.1] by omp1005.mail.ne1.yahoo.com with NNFMP; 03 Feb 2012 05:27:20 -0000
X-Yahoo-Newman-Property: ymail-3
X-Yahoo-Newman-Id: 474215.52753.bm@omp1005.mail.ne1.yahoo.com
Received: (qmail 28265 invoked by uid 60001); 3 Feb 2012 05:27:20 -0000
DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=yahoo.com; s=s1024; t=1328246840; bh=yeGnXdj4GbrbPAJUhTLJug1xm659QLU0id+x11iIiZw=; h=X-YMail-OSG:Received:X-Mailer:References:Message-ID:Date:From:Reply-To:Subject:To:In-Reply-To:MIME-Version:Content-Type:Content-Transfer-Encoding; b=IfZ4bKUEQbhyHfu5BR5p2PBM9d/eE9bY6hOI2nYHi3VUFdG6Yxyo2L7R7/JFibwqYwYBHeRdSepYGeSUeaIHmOzgHArC33QSESs+9QEsSzTDGy5Radj8JmQUE38L7yrwy4Q7YiMzLxtMgL+ly5lTqmXZ0n6WXsohuusBCVqpXrY=
DomainKey-Signature:a=rsa-sha1; q=dns; c=nofws;
s=s1024; d=yahoo.com;
h=X-YMail-OSG:Received:X-Mailer:References:Message-ID:Date:From:Reply-To:Subject:To:In-Reply-To:MIME-Version:Content-Type:Content-Transfer-Encoding;
b=cGR86oak0IgUIjGx1dnaipZ6YjsiXAu2ookaK04yjr85mg9hsVb6Awn1D5kD5cJsgkWtiuJLL02MgEo/4sWFPN90TzdazYbuO21CUifgwWXpA6Ws49VU80CS1eE3oePfqQ6snd0rYWXYOlXhmChsrC85eB94UEEUQcBUaOJPims=;
X-YMail-OSG: fej94OMVM1nZDuOo4Je_BUcEZNl_NVPInzn4zssdr7cUKvP
OpZXK43CSSfNlagncpxbd2txP7EZk3KEt85LDBipFDH5F5x2R_4vIC7ubr8o
RAHwbS25J8bHxWLzjyHOHQhfZTmVxD6NF9FKDowYPrXeqHKQaSDR5rX8mtqq
u4CiiqDHGmM3B8XTAXnR1RGkRBdA.i749GBCbeOn4Hkj1_JD1eUqH5bFU9m2
xiLcClMwSLqi6QIhK.DX2cqMSzJB0duvIt6Z.wQQbz2J.JbsDvMOgTfz3w_Q
Stnf0qWbtbxW32AjMkx87JkPRScMj4jT_VMRI6SKYLWNFKPwpnNCtI6PF0n6
lx9MhU3An0HzGrfVBuDcExpYl5NR1GNE2_tL9EhFZRwED4j3AKb3DJUqQtSU
bZ00ggaAuq8pf.RqIXweZfg--
Received: from [174.113.144.83] by web121204.mail.ne1.yahoo.com via HTTP; Thu, 02 Feb 2012 21:27:20 PST
X-Mailer: YahooMailWebService/0.8.116.331537
References: <1327880657.10233.YahooMailNeo@web121206.mail.ne1.yahoo.com>
Message-ID: <1328246840.72176.YahooMailNeo@web121204.mail.ne1.yahoo.com>
Date: Thu, 2 Feb 2012 21:27:20 -0800 (PST)
From: Hai Huang <hhuang2012@yahoo.com>
Reply-To: Hai Huang <hhuang2012@yahoo.com>
Subject: Re: Issue on formating the file system
To: "common-dev@hadoop.apache.org" <common-dev@hadoop.apache.org>
In-Reply-To: <1327880657.10233.YahooMailNeo@web121206.mail.ne1.yahoo.com>
MIME-Version: 1.0
Content-Type: text/plain; charset=iso-8859-1
Content-Transfer-Encoding: quoted-printable
I am trying to=A0format a filesystem (below) following the online doc=0A=A0=
=0A=A0=0A--------------------------------------------=0A=A0$ bin/hadoop nam=
enode -format=0A--------------------------------------------=0A=A0=0AI got =
the following error message:=0A=A0=0A--------------------------------------=
------=0ADEPRECATED: Use of this script to execute hdfs command is deprecat=
ed.=0AInstead use the hdfs command for it.=0A....=0A=A0=0AFormatting using =
clusterid: CID-22948dd2-0f38-4ecb-a5ff-2d2e1d24285d=0A12/02/02 21:17:26 ERR=
OR namenode.NameNode: Exception in namenode join=0Ajava.lang.IllegalArgumen=
tException: URI has an authority component=0A=A0=A0=A0=A0=A0=A0=A0 at java.=
io.File.<init>(File.java:385)=0A=A0=A0=A0=A0=A0=A0=A0 at org.apache.hadoop.=
hdfs.server.namenode.NNStorage.getStorageDirectory(NNStorage.java:310)=0A=
=A0=A0=A0=A0=A0=A0=A0 at org.apache.hadoop.hdfs.server.namenode.FSEditLog.i=
nit(FSEditLog.java:178)=0A=A0=A0=A0=A0=A0=A0=A0 at org.apache.hadoop.hdfs.s=
erver.namenode.FSEditLog.<init>(FSEditLog.java:155)=0A=A0=A0=A0=A0=A0=A0=A0=
at org.apache.hadoop.hdfs.server.namenode.FSImage.<init>(FSImage.java:125)=
=0A=A0=A0=A0=A0=A0=A0=A0 at org.apache.hadoop.hdfs.server.namenode.NameNode=
.format(NameNode.java:605)=0A=A0=A0=A0=A0=A0=A0=A0 at org.apache.hadoop.hdf=
s.server.namenode.NameNode.createNameNode(NameNode.java:733)=0A=A0=A0=A0=A0=
=A0=A0=A0 at org.apache.hadoop.hdfs.server.namenode.NameNode.main(NameNode.=
java:800)=0A12/02/02 21:17:26 INFO namenode.NameNode: SHUTDOWN_MSG:=0A/****=
********************************************************=0ASHUTDOWN_MSG: Sh=
utting down NameNode at localhost.localdomain/127.0.0.1=0A*****************=
*******************************************/=0A----------------------------=
----------------=0A=A0=0ADoes anyone know this issue?=0A=A0=0AI am using th=
e hadoop built myself . The command ( $ bin/hadoop namenode -format) =A0is =
issed under the directory =0A=A0=0A/hadoop-common/hadoop-dist/target/hadoop=
-0.24.0-SNAPSHOT=0A=A0=0A=A0=0AThanks,=0A=A0=0AHaifegng
From common-dev-return-77605-apmail-hadoop-common-dev-archive=hadoop.apache.org@hadoop.apache.org Fri Feb 3 06:05:56 2012
Return-Path: <common-dev-return-77605-apmail-hadoop-common-dev-archive=hadoop.apache.org@hadoop.apache.org>
X-Original-To: apmail-hadoop-common-dev-archive@www.apache.org
Delivered-To: apmail-hadoop-common-dev-archive@www.apache.org
Received: from mail.apache.org (hermes.apache.org [140.211.11.3])
by minotaur.apache.org (Postfix) with SMTP id C9C5D90AA
for <apmail-hadoop-common-dev-archive@www.apache.org>; Fri, 3 Feb 2012 06:05:56 +0000 (UTC)
Received: (qmail 42788 invoked by uid 500); 3 Feb 2012 06:05:54 -0000
Delivered-To: apmail-hadoop-common-dev-archive@hadoop.apache.org
Received: (qmail 41993 invoked by uid 500); 3 Feb 2012 06:05:36 -0000
Mailing-List: contact common-dev-help@hadoop.apache.org; run by ezmlm
Precedence: bulk
List-Help: <mailto:common-dev-help@hadoop.apache.org>
List-Unsubscribe: <mailto:common-dev-unsubscribe@hadoop.apache.org>
List-Post: <mailto:common-dev@hadoop.apache.org>
List-Id: <common-dev.hadoop.apache.org>
Reply-To: common-dev@hadoop.apache.org
Delivered-To: mailing list common-dev@hadoop.apache.org
Received: (qmail 41941 invoked by uid 99); 3 Feb 2012 06:05:27 -0000
Received: from nike.apache.org (HELO nike.apache.org) (192.87.106.230)
by apache.org (qpsmtpd/0.29) with ESMTP; Fri, 03 Feb 2012 06:05:27 +0000
X-ASF-Spam-Status: No, hits=-0.7 required=5.0
tests=RCVD_IN_DNSWL_LOW,SPF_PASS
X-Spam-Check-By: apache.org
Received-SPF: pass (nike.apache.org: domain of harsh@cloudera.com designates 209.85.160.48 as permitted sender)
Received: from [209.85.160.48] (HELO mail-pw0-f48.google.com) (209.85.160.48)
by apache.org (qpsmtpd/0.29) with ESMTP; Fri, 03 Feb 2012 06:05:20 +0000
Received: by pbcc11 with SMTP id c11so3407687pbc.35
for <common-dev@hadoop.apache.org>; Thu, 02 Feb 2012 22:04:59 -0800 (PST)
Received: by 10.68.216.227 with SMTP id ot3mr15038698pbc.18.1328249099149;
Thu, 02 Feb 2012 22:04:59 -0800 (PST)
MIME-Version: 1.0
Received: by 10.142.72.17 with HTTP; Thu, 2 Feb 2012 22:04:39 -0800 (PST)
In-Reply-To: <1328246840.72176.YahooMailNeo@web121204.mail.ne1.yahoo.com>
References: <1327880657.10233.YahooMailNeo@web121206.mail.ne1.yahoo.com> <1328246840.72176.YahooMailNeo@web121204.mail.ne1.yahoo.com>
From: Harsh J <harsh@cloudera.com>
Date: Fri, 3 Feb 2012 11:34:39 +0530
Message-ID: <CAOcnVr1eBdvCUHJ2nn4vH2q2vTCCmjOPGdZHBt7pog7tpbbKSA@mail.gmail.com>
Subject: Re: Issue on formating the file system
To: common-dev@hadoop.apache.org, Hai Huang <hhuang2012@yahoo.com>
Content-Type: text/plain; charset=ISO-8859-1
Content-Transfer-Encoding: quoted-printable
X-Virus-Checked: Checked by ClamAV on apache.org
What is your dfs.namenode.name.dir configured to, in hdfs-site.xml?
On Fri, Feb 3, 2012 at 10:57 AM, Hai Huang <hhuang2012@yahoo.com> wrote:
> I am trying to=A0format a filesystem (below) following the online doc
>
>
> --------------------------------------------
> =A0$ bin/hadoop namenode -format
> --------------------------------------------
>
> I got the following error message:
>
> --------------------------------------------
> DEPRECATED: Use of this script to execute hdfs command is deprecated.
> Instead use the hdfs command for it.
> ....
>
> Formatting using clusterid: CID-22948dd2-0f38-4ecb-a5ff-2d2e1d24285d
> 12/02/02 21:17:26 ERROR namenode.NameNode: Exception in namenode join
> java.lang.IllegalArgumentException: URI has an authority component
> =A0=A0=A0=A0=A0=A0=A0 at java.io.File.<init>(File.java:385)
> =A0=A0=A0=A0=A0=A0=A0 at org.apache.hadoop.hdfs.server.namenode.NNStorage=
.getStorageDirectory(NNStorage.java:310)
> =A0=A0=A0=A0=A0=A0=A0 at org.apache.hadoop.hdfs.server.namenode.FSEditLog=
.init(FSEditLog.java:178)
> =A0=A0=A0=A0=A0=A0=A0 at org.apache.hadoop.hdfs.server.namenode.FSEditLog=
.<init>(FSEditLog.java:155)
> =A0=A0=A0=A0=A0=A0=A0 at org.apache.hadoop.hdfs.server.namenode.FSImage.<=
init>(FSImage.java:125)
> =A0=A0=A0=A0=A0=A0=A0 at org.apache.hadoop.hdfs.server.namenode.NameNode.=
format(NameNode.java:605)
> =A0=A0=A0=A0=A0=A0=A0 at org.apache.hadoop.hdfs.server.namenode.NameNode.=
createNameNode(NameNode.java:733)
> =A0=A0=A0=A0=A0=A0=A0 at org.apache.hadoop.hdfs.server.namenode.NameNode.=
main(NameNode.java:800)
> 12/02/02 21:17:26 INFO namenode.NameNode: SHUTDOWN_MSG:
> /************************************************************
> SHUTDOWN_MSG: Shutting down NameNode at localhost.localdomain/127.0.0.1
> ************************************************************/
> --------------------------------------------
>
> Does anyone know this issue?
>
> I am using the hadoop built myself . The command ( $ bin/hadoop namenode =
-format) =A0is issed under the directory
>
> /hadoop-common/hadoop-dist/target/hadoop-0.24.0-SNAPSHOT
>
>
> Thanks,
>
> Haifegng
--=20
Harsh J
Customer Ops. Engineer
Cloudera | http://tiny.cloudera.com/about
From common-dev-return-77606-apmail-hadoop-common-dev-archive=hadoop.apache.org@hadoop.apache.org Fri Feb 3 12:32:22 2012
Return-Path: <common-dev-return-77606-apmail-hadoop-common-dev-archive=hadoop.apache.org@hadoop.apache.org>
X-Original-To: apmail-hadoop-common-dev-archive@www.apache.org
Delivered-To: apmail-hadoop-common-dev-archive@www.apache.org
Received: from mail.apache.org (hermes.apache.org [140.211.11.3])
by minotaur.apache.org (Postfix) with SMTP id 315EB966B
for <apmail-hadoop-common-dev-archive@www.apache.org>; Fri, 3 Feb 2012 12:32:22 +0000 (UTC)
Received: (qmail 22081 invoked by uid 500); 3 Feb 2012 12:32:20 -0000
Delivered-To: apmail-hadoop-common-dev-archive@hadoop.apache.org
Received: (qmail 21554 invoked by uid 500); 3 Feb 2012 12:32:18 -0000
Mailing-List: contact common-dev-help@hadoop.apache.org; run by ezmlm
Precedence: bulk
List-Help: <mailto:common-dev-help@hadoop.apache.org>
List-Unsubscribe: <mailto:common-dev-unsubscribe@hadoop.apache.org>
List-Post: <mailto:common-dev@hadoop.apache.org>
List-Id: <common-dev.hadoop.apache.org>
Reply-To: common-dev@hadoop.apache.org
Delivered-To: mailing list common-dev@hadoop.apache.org
Received: (qmail 21520 invoked by uid 99); 3 Feb 2012 12:32:18 -0000
Received: from nike.apache.org (HELO nike.apache.org) (192.87.106.230)
by apache.org (qpsmtpd/0.29) with ESMTP; Fri, 03 Feb 2012 12:32:18 +0000
X-ASF-Spam-Status: No, hits=-2000.0 required=5.0
tests=ALL_TRUSTED,T_RP_MATCHES_RCVD
X-Spam-Check-By: apache.org
Received: from [140.211.11.116] (HELO hel.zones.apache.org) (140.211.11.116)
by apache.org (qpsmtpd/0.29) with ESMTP; Fri, 03 Feb 2012 12:32:15 +0000
Received: from hel.zones.apache.org (hel.zones.apache.org [140.211.11.116])
by hel.zones.apache.org (Postfix) with ESMTP id 9211118B52F
for <common-dev@hadoop.apache.org>; Fri, 3 Feb 2012 12:31:54 +0000 (UTC)
Date: Fri, 3 Feb 2012 12:31:54 +0000 (UTC)
From: "Eric Charles (Created) (JIRA)" <jira@apache.org>
To: common-dev@hadoop.apache.org
Message-ID: <1954564001.7137.1328272314599.JavaMail.tomcat@hel.zones.apache.org>
Subject: [jira] [Created] (HADOOP-8017) Configure hadoop-main pom to get rid
of M2E plugin execution not covered
MIME-Version: 1.0
Content-Type: text/plain; charset=utf-8
Content-Transfer-Encoding: 7bit
X-JIRA-FingerPrint: 30527f35849b9dde25b450d4833f0394
X-Virus-Checked: Checked by ClamAV on apache.org
Configure hadoop-main pom to get rid of M2E plugin execution not covered
------------------------------------------------------------------------
Key: HADOOP-8017
URL: https://issues.apache.org/jira/browse/HADOOP-8017
Project: Hadoop Common
Issue Type: Improvement
Components: build
Affects Versions: 0.24.0
Reporter: Eric Charles
Last M2Eclipse plugin (maven plugin for eclipse) shows nasty errors when importing the hadoop maven modules (read more on http://wiki.eclipse.org/M2E_plugin_execution_not_covered).
The solution is to configure the build section of the pom with a org.eclipse.m2e:lifecycle-mapping plugin.
This configuration has no influence on the Maven build itself.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
From common-dev-return-77607-apmail-hadoop-common-dev-archive=hadoop.apache.org@hadoop.apache.org Fri Feb 3 16:06:18 2012
Return-Path: <common-dev-return-77607-apmail-hadoop-common-dev-archive=hadoop.apache.org@hadoop.apache.org>
X-Original-To: apmail-hadoop-common-dev-archive@www.apache.org
Delivered-To: apmail-hadoop-common-dev-archive@www.apache.org
Received: from mail.apache.org (hermes.apache.org [140.211.11.3])
by minotaur.apache.org (Postfix) with SMTP id 4D0BD95F6
for <apmail-hadoop-common-dev-archive@www.apache.org>; Fri, 3 Feb 2012 16:06:18 +0000 (UTC)
Received: (qmail 5666 invoked by uid 500); 3 Feb 2012 16:06:16 -0000
Delivered-To: apmail-hadoop-common-dev-archive@hadoop.apache.org
Received: (qmail 5482 invoked by uid 500); 3 Feb 2012 16:06:15 -0000
Mailing-List: contact common-dev-help@hadoop.apache.org; run by ezmlm
Precedence: bulk
List-Help: <mailto:common-dev-help@hadoop.apache.org>
List-Unsubscribe: <mailto:common-dev-unsubscribe@hadoop.apache.org>
List-Post: <mailto:common-dev@hadoop.apache.org>
List-Id: <common-dev.hadoop.apache.org>
Reply-To: common-dev@hadoop.apache.org
Delivered-To: mailing list common-dev@hadoop.apache.org
Received: (qmail 5472 invoked by uid 99); 3 Feb 2012 16:06:14 -0000
Received: from athena.apache.org (HELO athena.apache.org) (140.211.11.136)
by apache.org (qpsmtpd/0.29) with ESMTP; Fri, 03 Feb 2012 16:06:14 +0000
X-ASF-Spam-Status: No, hits=-2000.0 required=5.0
tests=ALL_TRUSTED,T_RP_MATCHES_RCVD
X-Spam-Check-By: apache.org
Received: from [140.211.11.116] (HELO hel.zones.apache.org) (140.211.11.116)
by apache.org (qpsmtpd/0.29) with ESMTP; Fri, 03 Feb 2012 16:06:13 +0000
Received: from hel.zones.apache.org (hel.zones.apache.org [140.211.11.116])
by hel.zones.apache.org (Postfix) with ESMTP id D92F618BED8
for <common-dev@hadoop.apache.org>; Fri, 3 Feb 2012 16:05:53 +0000 (UTC)
Date: Fri, 3 Feb 2012 16:05:53 +0000 (UTC)
From: "Robert Joseph Evans (Created) (JIRA)" <jira@apache.org>
To: common-dev@hadoop.apache.org
Message-ID: <1942115197.7815.1328285153891.JavaMail.tomcat@hel.zones.apache.org>
Subject: [jira] [Created] (HADOOP-8019) Oracle no longer supports old
javadoc URL, so we get a lot more javadoc warnings
MIME-Version: 1.0
Content-Type: text/plain; charset=utf-8
Content-Transfer-Encoding: 7bit
X-JIRA-FingerPrint: 30527f35849b9dde25b450d4833f0394
Oracle no longer supports old javadoc URL, so we get a lot more javadoc warnings
---------------------------------------------------------------------------------
Key: HADOOP-8019
URL: https://issues.apache.org/jira/browse/HADOOP-8019
Project: Hadoop Common
Issue Type: Bug
Affects Versions: 0.24.0, 0.23.1
Reporter: Robert Joseph Evans
we need to work around http://jira.codehaus.org/browse/MJAVADOC-300 until it is fixed.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
From common-dev-return-77608-apmail-hadoop-common-dev-archive=hadoop.apache.org@hadoop.apache.org Fri Feb 3 16:10:20 2012
Return-Path: <common-dev-return-77608-apmail-hadoop-common-dev-archive=hadoop.apache.org@hadoop.apache.org>
X-Original-To: apmail-hadoop-common-dev-archive@www.apache.org
Delivered-To: apmail-hadoop-common-dev-archive@www.apache.org
Received: from mail.apache.org (hermes.apache.org [140.211.11.3])
by minotaur.apache.org (Postfix) with SMTP id 55E34976B
for <apmail-hadoop-common-dev-archive@www.apache.org>; Fri, 3 Feb 2012 16:10:20 +0000 (UTC)
Received: (qmail 16169 invoked by uid 500); 3 Feb 2012 16:10:18 -0000
Delivered-To: apmail-hadoop-common-dev-archive@hadoop.apache.org
Received: (qmail 15802 invoked by uid 500); 3 Feb 2012 16:10:17 -0000
Mailing-List: contact common-dev-help@hadoop.apache.org; run by ezmlm
Precedence: bulk
List-Help: <mailto:common-dev-help@hadoop.apache.org>
List-Unsubscribe: <mailto:common-dev-unsubscribe@hadoop.apache.org>
List-Post: <mailto:common-dev@hadoop.apache.org>
List-Id: <common-dev.hadoop.apache.org>
Reply-To: common-dev@hadoop.apache.org
Delivered-To: mailing list common-dev@hadoop.apache.org
Received: (qmail 15789 invoked by uid 99); 3 Feb 2012 16:10:17 -0000
Received: from nike.apache.org (HELO nike.apache.org) (192.87.106.230)
by apache.org (qpsmtpd/0.29) with ESMTP; Fri, 03 Feb 2012 16:10:17 +0000
X-ASF-Spam-Status: No, hits=-2000.0 required=5.0
tests=ALL_TRUSTED,T_RP_MATCHES_RCVD
X-Spam-Check-By: apache.org
Received: from [140.211.11.116] (HELO hel.zones.apache.org) (140.211.11.116)
by apache.org (qpsmtpd/0.29) with ESMTP; Fri, 03 Feb 2012 16:10:15 +0000
Received: from hel.zones.apache.org (hel.zones.apache.org [140.211.11.116])
by hel.zones.apache.org (Postfix) with ESMTP id 1BA8918B129
for <common-dev@hadoop.apache.org>; Fri, 3 Feb 2012 16:09:54 +0000 (UTC)
Date: Fri, 3 Feb 2012 16:09:54 +0000 (UTC)
From: "Robert Joseph Evans (Resolved) (JIRA)" <jira@apache.org>
To: common-dev@hadoop.apache.org
Message-ID: <865069667.7829.1328285394114.JavaMail.tomcat@hel.zones.apache.org>
In-Reply-To: <1942115197.7815.1328285153891.JavaMail.tomcat@hel.zones.apache.org>
Subject: [jira] [Resolved] (HADOOP-8019) Oracle no longer supports old
javadoc URL, so we get a lot more javadoc warnings
MIME-Version: 1.0
Content-Type: text/plain; charset=utf-8
Content-Transfer-Encoding: 7bit
X-JIRA-FingerPrint: 30527f35849b9dde25b450d4833f0394
X-Virus-Checked: Checked by ClamAV on apache.org
[ https://issues.apache.org/jira/browse/HADOOP-8019?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Robert Joseph Evans resolved HADOOP-8019.
-----------------------------------------
Resolution: Duplicate
> Oracle no longer supports old javadoc URL, so we get a lot more javadoc warnings
> ---------------------------------------------------------------------------------
>
> Key: HADOOP-8019
> URL: https://issues.apache.org/jira/browse/HADOOP-8019
> Project: Hadoop Common
> Issue Type: Bug
> Affects Versions: 0.24.0, 0.23.1
> Reporter: Robert Joseph Evans
>
> we need to work around http://jira.codehaus.org/browse/MJAVADOC-300 until it is fixed.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
From common-dev-return-77609-apmail-hadoop-common-dev-archive=hadoop.apache.org@hadoop.apache.org Fri Feb 3 16:54:19 2012
Return-Path: <common-dev-return-77609-apmail-hadoop-common-dev-archive=hadoop.apache.org@hadoop.apache.org>
X-Original-To: apmail-hadoop-common-dev-archive@www.apache.org
Delivered-To: apmail-hadoop-common-dev-archive@www.apache.org
Received: from mail.apache.org (hermes.apache.org [140.211.11.3])
by minotaur.apache.org (Postfix) with SMTP id 525D79C04
for <apmail-hadoop-common-dev-archive@www.apache.org>; Fri, 3 Feb 2012 16:54:19 +0000 (UTC)
Received: (qmail 26751 invoked by uid 500); 3 Feb 2012 16:54:17 -0000
Delivered-To: apmail-hadoop-common-dev-archive@hadoop.apache.org
Received: (qmail 26396 invoked by uid 500); 3 Feb 2012 16:54:16 -0000
Mailing-List: contact common-dev-help@hadoop.apache.org; run by ezmlm
Precedence: bulk
List-Help: <mailto:common-dev-help@hadoop.apache.org>
List-Unsubscribe: <mailto:common-dev-unsubscribe@hadoop.apache.org>
List-Post: <mailto:common-dev@hadoop.apache.org>
List-Id: <common-dev.hadoop.apache.org>
Reply-To: common-dev@hadoop.apache.org
Delivered-To: mailing list common-dev@hadoop.apache.org
Received: (qmail 26382 invoked by uid 99); 3 Feb 2012 16:54:16 -0000
Received: from athena.apache.org (HELO athena.apache.org) (140.211.11.136)
by apache.org (qpsmtpd/0.29) with ESMTP; Fri, 03 Feb 2012 16:54:16 +0000
X-ASF-Spam-Status: No, hits=-2000.0 required=5.0
tests=ALL_TRUSTED,T_RP_MATCHES_RCVD
X-Spam-Check-By: apache.org
Received: from [140.211.11.116] (HELO hel.zones.apache.org) (140.211.11.116)
by apache.org (qpsmtpd/0.29) with ESMTP; Fri, 03 Feb 2012 16:54:15 +0000
Received: from hel.zones.apache.org (hel.zones.apache.org [140.211.11.116])
by hel.zones.apache.org (Postfix) with ESMTP id 3A14318BE37
for <common-dev@hadoop.apache.org>; Fri, 3 Feb 2012 16:53:55 +0000 (UTC)
Date: Fri, 3 Feb 2012 16:53:55 +0000 (UTC)
From: "Jonathan Eagles (Created) (JIRA)" <jira@apache.org>
To: common-dev@hadoop.apache.org
Message-ID: <217766716.8062.1328288035240.JavaMail.tomcat@hel.zones.apache.org>
Subject: [jira] [Created] (HADOOP-8020) test-patch will +1 patches with
added javadoc warnings
MIME-Version: 1.0
Content-Type: text/plain; charset=utf-8
Content-Transfer-Encoding: 7bit
X-JIRA-FingerPrint: 30527f35849b9dde25b450d4833f0394
test-patch will +1 patches with added javadoc warnings
------------------------------------------------------
Key: HADOOP-8020
URL: https://issues.apache.org/jira/browse/HADOOP-8020
Project: Hadoop Common
Issue Type: Bug
Components: build
Affects Versions: 0.23.1
Reporter: Jonathan Eagles
Assignee: Jonathan Eagles
OK_JAVADOC_WARNINGS is set too high in hadoop-common-project/dev-support/test-patch.properties
{noformat}
$ cd hadoop-common-project/
$ mvn clean test javadoc:javadoc -DskipTests -Pdocs -DHadoopPatchProcess > ~/patchJavadocWarnings.txt.hadoop-trunk 2>&1
$ grep '\[WARNING\]' ~/patchJavadocWarnings.txt.hadoop-trunk | awk '/Javadoc Warnings/,EOF' | grep warning | awk 'BEGIN {total = 0} {total += 1} END {print total}'
11
{noformat}
{noformat}
$ cat dev-support/test-patch.properties
OK_RELEASEAUDIT_WARNINGS=0
OK_FINDBUGS_WARNINGS=0
OK_JAVADOC_WARNINGS=13
{noformat}
This will allow in 2 new javadoc warnings and still +1 the build
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
From common-dev-return-77610-apmail-hadoop-common-dev-archive=hadoop.apache.org@hadoop.apache.org Fri Feb 3 17:13:25 2012
Return-Path: <common-dev-return-77610-apmail-hadoop-common-dev-archive=hadoop.apache.org@hadoop.apache.org>
X-Original-To: apmail-hadoop-common-dev-archive@www.apache.org
Delivered-To: apmail-hadoop-common-dev-archive@www.apache.org
Received: from mail.apache.org (hermes.apache.org [140.211.11.3])
by minotaur.apache.org (Postfix) with SMTP id 4CA4C95AC
for <apmail-hadoop-common-dev-archive@www.apache.org>; Fri, 3 Feb 2012 17:13:25 +0000 (UTC)
Received: (qmail 66200 invoked by uid 500); 3 Feb 2012 17:13:19 -0000
Delivered-To: apmail-hadoop-common-dev-archive@hadoop.apache.org
Received: (qmail 66007 invoked by uid 500); 3 Feb 2012 17:13:18 -0000
Mailing-List: contact common-dev-help@hadoop.apache.org; run by ezmlm
Precedence: bulk
List-Help: <mailto:common-dev-help@hadoop.apache.org>
List-Unsubscribe: <mailto:common-dev-unsubscribe@hadoop.apache.org>
List-Post: <mailto:common-dev@hadoop.apache.org>
List-Id: <common-dev.hadoop.apache.org>
Reply-To: common-dev@hadoop.apache.org
Delivered-To: mailing list common-dev@hadoop.apache.org
Received: (qmail 65992 invoked by uid 99); 3 Feb 2012 17:13:17 -0000
Received: from nike.apache.org (HELO nike.apache.org) (192.87.106.230)
by apache.org (qpsmtpd/0.29) with ESMTP; Fri, 03 Feb 2012 17:13:17 +0000
X-ASF-Spam-Status: No, hits=3.3 required=5.0
tests=HTML_MESSAGE,NO_RDNS_DOTCOM_HELO,RCVD_IN_DNSWL_NONE,SPF_NEUTRAL
X-Spam-Check-By: apache.org
Received-SPF: neutral (nike.apache.org: 98.139.253.104 is neither permitted nor denied by domain of evans@yahoo-inc.com)
Received: from [98.139.253.104] (HELO mrout1-b.corp.bf1.yahoo.com) (98.139.253.104)
by apache.org (qpsmtpd/0.29) with ESMTP; Fri, 03 Feb 2012 17:13:10 +0000
Received: from sp1-ex07cas01.ds.corp.yahoo.com (sp1-ex07cas01.ds.corp.yahoo.com [216.252.116.137])
by mrout1-b.corp.bf1.yahoo.com (8.14.4/8.14.4/y.out) with ESMTP id q13HCWY5028526;
Fri, 3 Feb 2012 09:12:32 -0800 (PST)
DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/simple; d=yahoo-inc.com;
s=cobra; t=1328289152;
bh=bhtDf3+1SNYBd/F/M/CoXMnRMPuBxZ99CvQFsflM0w8=;
h=From:To:CC:Date:Subject:Message-ID:In-Reply-To:Content-Type:
MIME-Version;
b=Hc6AWZjW+hNhnjIC4To+UZcdvwN9PrqJHQZ00o/4vZ1bW1l8XoEqAmw5k36XElO6y
fEmt6EwPo630cTd4neCa8bDXIVjMehGnbQuS14gZJQisVzpA8ccF6FSnyhUc3/xmQF
wShdYcAMngsMpIWCQv7CNLe7VB++7CSJ6daboNFc=
Received: from SP1-EX07VS02.ds.corp.yahoo.com ([216.252.116.135]) by
sp1-ex07cas01.ds.corp.yahoo.com ([216.252.116.137]) with mapi; Fri, 3 Feb
2012 09:12:31 -0800
From: Robert Evans <evans@yahoo-inc.com>
To: Abees Muhammad <abees.pm@gmail.com>
CC: "common-dev@hadoop.apache.org" <common-dev@hadoop.apache.org>,
"common-user@hadoop.apache.org" <common-user@hadoop.apache.org>
Date: Fri, 3 Feb 2012 09:12:27 -0800
Subject: Re: Execute a Map/Reduce Job Jar from Another Java Program.
Thread-Topic: Execute a Map/Reduce Job Jar from Another Java Program.
Thread-Index: AcziNSekCtD2n8LnQHGqSznOacUe2QAYdlB8
Message-ID: <CB51719B.33A2D%evans@yahoo-inc.com>
In-Reply-To: <CANc9RnLwj67NEvqHD4MPHC1SOmfD5XYQidxcjCA2YcE9k15RPA@mail.gmail.com>
Accept-Language: en-US
Content-Language: en
X-MS-Has-Attach:
X-MS-TNEF-Correlator:
acceptlanguage: en-US
Content-Type: multipart/alternative;
boundary="_000_CB51719B33A2Devansyahooinccom_"
MIME-Version: 1.0
X-Virus-Checked: Checked by ClamAV on apache.org
--_000_CB51719B33A2Devansyahooinccom_
Content-Type: text/plain; charset="iso-8859-1"
Content-Transfer-Encoding: quoted-printable
It looks like there is something wrong with your configuration where the de=
fault file system is coming back as the local file system, but you are pass=
ing in an HDFS URI fs.exists(Path), I cannot tell for sure because I don't =
have access to com.amd.kdf.protobuf.SequentialFileDriver.main(SequentialFil=
eDriver.java:64).
If running it works just fine from the command line, you could try doing a =
fork/exec to launch the process and then monitor it.
--Bobby Evans
On 2/2/12 11:31 PM, "Abees Muhammad" <abees.pm@gmail.com> wrote:
Hi Evans,
Thanks for your reply. I have a mapreduce job jar file lets call it as test=
.jar. I am executing this jar file as hadoop jar test.jar inputpath outPath=
, and it is executed succesfully. Now i want to execute this job for a batc=
h of files(a batch of 20 files), for this purpose i have created another ja=
va application,this application moves a batch of files from one location of=
hdfs to another location in hdfs. After that this application needs to exe=
cute the m/R job for this batch. we will invoke the second application(whic=
h will execute the M/R Job) from as control m job.But i dont know how to cr=
eate the second java application which will invoke the M/R job. The code sn=
ippet i used for testing the jar which calls the M/R job is
List arguments =3D new ArrayList();
arguments.add("test.jar");
arguments.add("inputPath");
arguments.add(outputPath);
RunJar.main((String[])arguments.toArray(new String[0]));
i executed this jar as java -jar M/RJobInvokeApp.jar but i got error as
java.lang.IllegalArgumentException: Wrong FS: hdfs://ip address:54310/tmp/t=
est-out, expected: file:///
at org.apache.hadoop.fs.FileSystem.checkPath(FileSystem.java:410)
at org.apache.hadoop.fs.RawLocalFileSystem.pathToFile(RawLocalFileSyste=
m.java:56)
at org.apache.hadoop.fs.RawLocalFileSystem.getFileStatus(RawLocalFileSy=
stem.java:379)
at org.apache.hadoop.fs.FilterFileSystem.getFileStatus(FilterFileSystem=
.java:251)
at org.apache.hadoop.fs.FileSystem.exists(FileSystem.java:748)
at com.amd.kdf.protobuf.SequentialFileDriver.main(SequentialFileDriver.=
java:64)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl=
.java:39)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAcce=
ssorImpl.java:25)
at java.lang.reflect.Method.invoke(Method.java:597)
at org.apache.hadoop.util.RunJar.main(RunJar.java:186)
at com.amd.wrapper.main.ParserWrapper.main(ParserWrapper.java:31)
Thanks,
Abees
On 2 February 2012 23:02, Robert Evans <evans@yahoo-inc.com> wrote:
What happens? Is there an exception, does nothing happen? I am curious. =
Also how did you launch your other job that is trying to run this one. The=
hadoop script sets up a lot of environment variables classpath etc to make=
hadoop work properly, and some of that may not be set up correctly to make=
RunJar work.
--Bobby Evans
On 2/2/12 9:36 AM, "Harsh J" <harsh@cloudera.com <http://harsh@cloudera.com=
> > wrote:
Moving to common-user. Common-dev is for project development
discussions, not user help.
Could you elaborate on how you used RunJar? What arguments did you
provide, and is the target jar a runnable one or a regular jar? What
error did you get?
On Thu, Feb 2, 2012 at 8:44 PM, abees muhammad <abees.pm@gmail.com <http://=
abees.pm@gmail.com> > wrote:
>
> Hi,
>
> I am a newbie to Hadoop Development. I have a Map/Reduce job jar file, i
> want to execute this jar file programmatically from another java program.=
I
> used the following code to execute it.
>
> RunJar.main(String[] args). But The jar file is not executed.
>
> Can you please give me a work around for this issue.
> --
> View this message in context: http://old.nabble.com/Execute-a-Map-Reduce-=
Job-Jar-from-Another-Java-Program.-tp33250801p33250801.html
> Sent from the Hadoop core-dev mailing list archive at Nabble.com.
>
--
Harsh J
Customer Ops. Engineer
Cloudera | http://tiny.cloudera.com/about
--_000_CB51719B33A2Devansyahooinccom_--
From common-dev-return-77611-apmail-hadoop-common-dev-archive=hadoop.apache.org@hadoop.apache.org Fri Feb 3 19:48:20 2012
Return-Path: <common-dev-return-77611-apmail-hadoop-common-dev-archive=hadoop.apache.org@hadoop.apache.org>
X-Original-To: apmail-hadoop-common-dev-archive@www.apache.org
Delivered-To: apmail-hadoop-common-dev-archive@www.apache.org
Received: from mail.apache.org (hermes.apache.org [140.211.11.3])
by minotaur.apache.org (Postfix) with SMTP id 81D69979F
for <apmail-hadoop-common-dev-archive@www.apache.org>; Fri, 3 Feb 2012 19:48:20 +0000 (UTC)
Received: (qmail 16492 invoked by uid 500); 3 Feb 2012 19:48:18 -0000
Delivered-To: apmail-hadoop-common-dev-archive@hadoop.apache.org
Received: (qmail 16098 invoked by uid 500); 3 Feb 2012 19:48:17 -0000
Mailing-List: contact common-dev-help@hadoop.apache.org; run by ezmlm
Precedence: bulk
List-Help: <mailto:common-dev-help@hadoop.apache.org>
List-Unsubscribe: <mailto:common-dev-unsubscribe@hadoop.apache.org>
List-Post: <mailto:common-dev@hadoop.apache.org>
List-Id: <common-dev.hadoop.apache.org>
Reply-To: common-dev@hadoop.apache.org
Delivered-To: mailing list common-dev@hadoop.apache.org
Received: (qmail 16087 invoked by uid 99); 3 Feb 2012 19:48:17 -0000
Received: from nike.apache.org (HELO nike.apache.org) (192.87.106.230)
by apache.org (qpsmtpd/0.29) with ESMTP; Fri, 03 Feb 2012 19:48:17 +0000
X-ASF-Spam-Status: No, hits=-2000.0 required=5.0
tests=ALL_TRUSTED,T_RP_MATCHES_RCVD
X-Spam-Check-By: apache.org
Received: from [140.211.11.116] (HELO hel.zones.apache.org) (140.211.11.116)
by apache.org (qpsmtpd/0.29) with ESMTP; Fri, 03 Feb 2012 19:48:14 +0000
Received: from hel.zones.apache.org (hel.zones.apache.org [140.211.11.116])
by hel.zones.apache.org (Postfix) with ESMTP id E147618BBC9
for <common-dev@hadoop.apache.org>; Fri, 3 Feb 2012 19:47:53 +0000 (UTC)
Date: Fri, 3 Feb 2012 19:47:53 +0000 (UTC)
From: "Todd Lipcon (Resolved) (JIRA)" <jira@apache.org>
To: common-dev@hadoop.apache.org
Message-ID: <1725678159.8700.1328298473924.JavaMail.tomcat@hel.zones.apache.org>
In-Reply-To: <179411052.75421.1327459721376.JavaMail.tomcat@hel.zones.apache.org>
Subject: [jira] [Resolved] (HADOOP-7991) HA: the FailoverController should
check the standby is ready before failing over
MIME-Version: 1.0
Content-Type: text/plain; charset=utf-8
Content-Transfer-Encoding: 7bit
X-JIRA-FingerPrint: 30527f35849b9dde25b450d4833f0394
X-Virus-Checked: Checked by ClamAV on apache.org
[ https://issues.apache.org/jira/browse/HADOOP-7991?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Todd Lipcon resolved HADOOP-7991.
---------------------------------
Resolution: Fixed
Fix Version/s: HA Branch (HDFS-1623)
Hadoop Flags: Reviewed
Eli committed this yesterday, but was having JIRA problems. Resolving on his behalf.
> HA: the FailoverController should check the standby is ready before failing over
> --------------------------------------------------------------------------------
>
> Key: HADOOP-7991
> URL: https://issues.apache.org/jira/browse/HADOOP-7991
> Project: Hadoop Common
> Issue Type: Sub-task
> Components: ha
> Affects Versions: HA Branch (HDFS-1623)
> Reporter: Eli Collins
> Assignee: Eli Collins
> Fix For: HA Branch (HDFS-1623)
>
> Attachments: hadoop-7991.txt
>
>
> The FC in preFailoverChecks should check that the target service is ready for failover (eg in the case of HDFS, that it's not in SM) before failing over to it. We'll need to provide a force option as well since the standby may not actually be ready until the failover has been initiated (eg because becoming active kicks it to check the log and see newly allocated blocks).
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
From common-dev-return-77612-apmail-hadoop-common-dev-archive=hadoop.apache.org@hadoop.apache.org Fri Feb 3 21:45:18 2012
Return-Path: <common-dev-return-77612-apmail-hadoop-common-dev-archive=hadoop.apache.org@hadoop.apache.org>
X-Original-To: apmail-hadoop-common-dev-archive@www.apache.org
Delivered-To: apmail-hadoop-common-dev-archive@www.apache.org
Received: from mail.apache.org (hermes.apache.org [140.211.11.3])
by minotaur.apache.org (Postfix) with SMTP id 277809248
for <apmail-hadoop-common-dev-archive@www.apache.org>; Fri, 3 Feb 2012 21:45:17 +0000 (UTC)
Received: (qmail 3035 invoked by uid 500); 3 Feb 2012 21:45:16 -0000
Delivered-To: apmail-hadoop-common-dev-archive@hadoop.apache.org
Received: (qmail 2695 invoked by uid 500); 3 Feb 2012 21:45:14 -0000
Mailing-List: contact common-dev-help@hadoop.apache.org; run by ezmlm
Precedence: bulk
List-Help: <mailto:common-dev-help@hadoop.apache.org>
List-Unsubscribe: <mailto:common-dev-unsubscribe@hadoop.apache.org>
List-Post: <mailto:common-dev@hadoop.apache.org>
List-Id: <common-dev.hadoop.apache.org>
Reply-To: common-dev@hadoop.apache.org
Delivered-To: mailing list common-dev@hadoop.apache.org
Received: (qmail 2679 invoked by uid 99); 3 Feb 2012 21:45:14 -0000
Received: from athena.apache.org (HELO athena.apache.org) (140.211.11.136)
by apache.org (qpsmtpd/0.29) with ESMTP; Fri, 03 Feb 2012 21:45:14 +0000
X-ASF-Spam-Status: No, hits=-2000.0 required=5.0
tests=ALL_TRUSTED,T_RP_MATCHES_RCVD
X-Spam-Check-By: apache.org
Received: from [140.211.11.116] (HELO hel.zones.apache.org) (140.211.11.116)
by apache.org (qpsmtpd/0.29) with ESMTP; Fri, 03 Feb 2012 21:45:13 +0000
Received: from hel.zones.apache.org (hel.zones.apache.org [140.211.11.116])
by hel.zones.apache.org (Postfix) with ESMTP id 8EE2E18CE29
for <common-dev@hadoop.apache.org>; Fri, 3 Feb 2012 21:44:53 +0000 (UTC)
Date: Fri, 3 Feb 2012 21:44:53 +0000 (UTC)
From: "Anupam Seth (Created) (JIRA)" <jira@apache.org>
To: common-dev@hadoop.apache.org
Message-ID: <346625560.9169.1328305493586.JavaMail.tomcat@hel.zones.apache.org>
Subject: [jira] [Created] (HADOOP-8021) Hadoop ignores old-style config
options for enabling compressed output when passed on from PIG
MIME-Version: 1.0
Content-Type: text/plain; charset=utf-8
Content-Transfer-Encoding: 7bit
X-JIRA-FingerPrint: 30527f35849b9dde25b450d4833f0394
Hadoop ignores old-style config options for enabling compressed output when passed on from PIG
----------------------------------------------------------------------------------------------
Key: HADOOP-8021
URL: https://issues.apache.org/jira/browse/HADOOP-8021
Project: Hadoop Common
Issue Type: Bug
Components: conf
Affects Versions: 0.23.1
Reporter: Anupam Seth
Assignee: Anupam Seth
Fix For: 0.23.1
Hadoop seems to ignore the config options even though they are printed as deprecation warnings in the log: mapred.output.compress and
mapred.output.compression.codec
- settings that work on 0.20 but not on 0.23
mapred.output.compress=true
mapred.output.compression.codec=org.apache.hadoop.io.compress.BZip2Codec
- settings that work on 0.23
mapreduce.output.fileoutputformat.compress=true
mapreduce.output.fileoutputformat.compress.codec=org.apache.hadoop.io.compress.BZip2Codec
This breaks backwards compatibility and causes existing jobs to fail.
This was found to happen due to the JobSubmitter writing out the job.xml file with the old-style configs and can be fixed by handdling deprecation before the file is written out.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
From common-dev-return-77613-apmail-hadoop-common-dev-archive=hadoop.apache.org@hadoop.apache.org Fri Feb 3 22:52:17 2012
Return-Path: <common-dev-return-77613-apmail-hadoop-common-dev-archive=hadoop.apache.org@hadoop.apache.org>
X-Original-To: apmail-hadoop-common-dev-archive@www.apache.org
Delivered-To: apmail-hadoop-common-dev-archive@www.apache.org
Received: from mail.apache.org (hermes.apache.org [140.211.11.3])
by minotaur.apache.org (Postfix) with SMTP id D575A9CD2
for <apmail-hadoop-common-dev-archive@www.apache.org>; Fri, 3 Feb 2012 22:52:17 +0000 (UTC)
Received: (qmail 24138 invoked by uid 500); 3 Feb 2012 22:52:16 -0000
Delivered-To: apmail-hadoop-common-dev-archive@hadoop.apache.org
Received: (qmail 23889 invoked by uid 500); 3 Feb 2012 22:52:14 -0000
Mailing-List: contact common-dev-help@hadoop.apache.org; run by ezmlm
Precedence: bulk
List-Help: <mailto:common-dev-help@hadoop.apache.org>
List-Unsubscribe: <mailto:common-dev-unsubscribe@hadoop.apache.org>
List-Post: <mailto:common-dev@hadoop.apache.org>
List-Id: <common-dev.hadoop.apache.org>
Reply-To: common-dev@hadoop.apache.org
Delivered-To: mailing list common-dev@hadoop.apache.org
Received: (qmail 23873 invoked by uid 99); 3 Feb 2012 22:52:14 -0000
Received: from athena.apache.org (HELO athena.apache.org) (140.211.11.136)
by apache.org (qpsmtpd/0.29) with ESMTP; Fri, 03 Feb 2012 22:52:14 +0000
X-ASF-Spam-Status: No, hits=-2000.0 required=5.0
tests=ALL_TRUSTED,T_RP_MATCHES_RCVD
X-Spam-Check-By: apache.org
Received: from [140.211.11.116] (HELO hel.zones.apache.org) (140.211.11.116)
by apache.org (qpsmtpd/0.29) with ESMTP; Fri, 03 Feb 2012 22:52:13 +0000
Received: from hel.zones.apache.org (hel.zones.apache.org [140.211.11.116])
by hel.zones.apache.org (Postfix) with ESMTP id C0FDF18C12F
for <common-dev@hadoop.apache.org>; Fri, 3 Feb 2012 22:51:53 +0000 (UTC)
Date: Fri, 3 Feb 2012 22:51:53 +0000 (UTC)
From: "Robert Joseph Evans (Created) (JIRA)" <jira@apache.org>
To: common-dev@hadoop.apache.org
Message-ID: <39560682.9611.1328309513792.JavaMail.tomcat@hel.zones.apache.org>
Subject: [jira] [Created] (HADOOP-8022) Deprecate
checkTGTAndReloginFromKeytab()
MIME-Version: 1.0
Content-Type: text/plain; charset=utf-8
Content-Transfer-Encoding: 7bit
X-JIRA-FingerPrint: 30527f35849b9dde25b450d4833f0394
Deprecate checkTGTAndReloginFromKeytab()
----------------------------------------
Key: HADOOP-8022
URL: https://issues.apache.org/jira/browse/HADOOP-8022
Project: Hadoop Common
Issue Type: Improvement
Components: security
Affects Versions: 0.24.0
Reporter: Robert Joseph Evans
checkTGTAndReloginFromKeytab() does a small check and then calls reloginFromKeytab() which has been updated to do the same check. checkTGTAndReloginFromKeytab() is redundant, and should be deprecated if it is publicly visible, or just removed if it is not publicly visible.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
From common-dev-return-77614-apmail-hadoop-common-dev-archive=hadoop.apache.org@hadoop.apache.org Fri Feb 3 23:01:18 2012
Return-Path: <common-dev-return-77614-apmail-hadoop-common-dev-archive=hadoop.apache.org@hadoop.apache.org>
X-Original-To: apmail-hadoop-common-dev-archive@www.apache.org
Delivered-To: apmail-hadoop-common-dev-archive@www.apache.org
Received: from mail.apache.org (hermes.apache.org [140.211.11.3])
by minotaur.apache.org (Postfix) with SMTP id ECB6E90CC
for <apmail-hadoop-common-dev-archive@www.apache.org>; Fri, 3 Feb 2012 23:01:17 +0000 (UTC)
Received: (qmail 45728 invoked by uid 500); 3 Feb 2012 23:01:16 -0000
Delivered-To: apmail-hadoop-common-dev-archive@hadoop.apache.org
Received: (qmail 45304 invoked by uid 500); 3 Feb 2012 23:01:14 -0000
Mailing-List: contact common-dev-help@hadoop.apache.org; run by ezmlm
Precedence: bulk
List-Help: <mailto:common-dev-help@hadoop.apache.org>
List-Unsubscribe: <mailto:common-dev-unsubscribe@hadoop.apache.org>
List-Post: <mailto:common-dev@hadoop.apache.org>
List-Id: <common-dev.hadoop.apache.org>
Reply-To: common-dev@hadoop.apache.org
Delivered-To: mailing list common-dev@hadoop.apache.org
Received: (qmail 45288 invoked by uid 99); 3 Feb 2012 23:01:14 -0000
Received: from nike.apache.org (HELO nike.apache.org) (192.87.106.230)
by apache.org (qpsmtpd/0.29) with ESMTP; Fri, 03 Feb 2012 23:01:14 +0000
X-ASF-Spam-Status: No, hits=-2000.0 required=5.0
tests=ALL_TRUSTED,T_RP_MATCHES_RCVD
X-Spam-Check-By: apache.org
Received: from [140.211.11.116] (HELO hel.zones.apache.org) (140.211.11.116)
by apache.org (qpsmtpd/0.29) with ESMTP; Fri, 03 Feb 2012 23:01:12 +0000
Received: from hel.zones.apache.org (hel.zones.apache.org [140.211.11.116])
by hel.zones.apache.org (Postfix) with ESMTP id 7B75518C6FF
for <common-dev@hadoop.apache.org>; Fri, 3 Feb 2012 23:00:51 +0000 (UTC)
Date: Fri, 3 Feb 2012 23:00:51 +0000 (UTC)
From: "Eli Collins (Resolved) (JIRA)" <jira@apache.org>
To: common-dev@hadoop.apache.org
Message-ID: <1522317883.9670.1328310051507.JavaMail.tomcat@hel.zones.apache.org>
In-Reply-To: <1195385494.8009.1325733999513.JavaMail.tomcat@hel.zones.apache.org>
Subject: [jira] [Resolved] (HADOOP-7958) HA: failover should error out if
either host is not specified in the configs
MIME-Version: 1.0
Content-Type: text/plain; charset=utf-8
Content-Transfer-Encoding: 7bit
X-JIRA-FingerPrint: 30527f35849b9dde25b450d4833f0394
X-Virus-Checked: Checked by ClamAV on apache.org
[ https://issues.apache.org/jira/browse/HADOOP-7958?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Eli Collins resolved HADOOP-7958.
---------------------------------
Resolution: Duplicate
> HA: failover should error out if either host is not specified in the configs
> ------------------------------------------------------------------------------
>
> Key: HADOOP-7958
> URL: https://issues.apache.org/jira/browse/HADOOP-7958
> Project: Hadoop Common
> Issue Type: Sub-task
> Components: ha
> Affects Versions: HA Branch (HDFS-1623)
> Reporter: Eli Collins
> Assignee: Eli Collins
>
> Per HADOOP-7924 users should not be allowed to specify hosts on the command that are not listed as potential options in the config. This catches the case where someone does a failover X Y but there's a typo in X so we accidentally end up having two actives.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
From common-dev-return-77615-apmail-hadoop-common-dev-archive=hadoop.apache.org@hadoop.apache.org Sat Feb 4 00:32:19 2012
Return-Path: <common-dev-return-77615-apmail-hadoop-common-dev-archive=hadoop.apache.org@hadoop.apache.org>
X-Original-To: apmail-hadoop-common-dev-archive@www.apache.org
Delivered-To: apmail-hadoop-common-dev-archive@www.apache.org
Received: from mail.apache.org (hermes.apache.org [140.211.11.3])
by minotaur.apache.org (Postfix) with SMTP id E3B9797DD
for <apmail-hadoop-common-dev-archive@www.apache.org>; Sat, 4 Feb 2012 00:32:19 +0000 (UTC)
Received: (qmail 57333 invoked by uid 500); 4 Feb 2012 00:32:18 -0000
Delivered-To: apmail-hadoop-common-dev-archive@hadoop.apache.org
Received: (qmail 57035 invoked by uid 500); 4 Feb 2012 00:32:17 -0000
Mailing-List: contact common-dev-help@hadoop.apache.org; run by ezmlm
Precedence: bulk
List-Help: <mailto:common-dev-help@hadoop.apache.org>
List-Unsubscribe: <mailto:common-dev-unsubscribe@hadoop.apache.org>
List-Post: <mailto:common-dev@hadoop.apache.org>
List-Id: <common-dev.hadoop.apache.org>
Reply-To: common-dev@hadoop.apache.org
Delivered-To: mailing list common-dev@hadoop.apache.org
Received: (qmail 56939 invoked by uid 99); 4 Feb 2012 00:32:16 -0000
Received: from nike.apache.org (HELO nike.apache.org) (192.87.106.230)
by apache.org (qpsmtpd/0.29) with ESMTP; Sat, 04 Feb 2012 00:32:16 +0000
X-ASF-Spam-Status: No, hits=-2000.0 required=5.0
tests=ALL_TRUSTED,T_RP_MATCHES_RCVD
X-Spam-Check-By: apache.org
Received: from [140.211.11.116] (HELO hel.zones.apache.org) (140.211.11.116)
by apache.org (qpsmtpd/0.29) with ESMTP; Sat, 04 Feb 2012 00:32:14 +0000
Received: from hel.zones.apache.org (hel.zones.apache.org [140.211.11.116])
by hel.zones.apache.org (Postfix) with ESMTP id 93D1F18C890
for <common-dev@hadoop.apache.org>; Sat, 4 Feb 2012 00:31:53 +0000 (UTC)
Date: Sat, 4 Feb 2012 00:31:53 +0000 (UTC)
From: "Alejandro Abdelnur (Created) (JIRA)" <jira@apache.org>
To: common-dev@hadoop.apache.org
Message-ID: <390612671.10095.1328315513607.JavaMail.tomcat@hel.zones.apache.org>
Subject: [jira] [Created] (HADOOP-8023) Add unset() method to Configuration
MIME-Version: 1.0
Content-Type: text/plain; charset=utf-8
Content-Transfer-Encoding: 7bit
X-JIRA-FingerPrint: 30527f35849b9dde25b450d4833f0394
X-Virus-Checked: Checked by ClamAV on apache.org
Add unset() method to Configuration
-----------------------------------
Key: HADOOP-8023
URL: https://issues.apache.org/jira/browse/HADOOP-8023
Project: Hadoop Common
Issue Type: New Feature
Components: conf
Affects Versions: 1.0.0
Reporter: Alejandro Abdelnur
Assignee: Alejandro Abdelnur
Priority: Critical
HADOOP-7001 introduced the *Configuration.unset(String)* method.
MAPREDUCE-3727 requires that method in order to be back-ported.
This is required to fix an issue manifested when running MR/Hive/Sqoop jobs from Oozie, details are in MAPREDUCE-3727.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
From common-dev-return-77616-apmail-hadoop-common-dev-archive=hadoop.apache.org@hadoop.apache.org Sat Feb 4 03:17:10 2012
Return-Path: <common-dev-return-77616-apmail-hadoop-common-dev-archive=hadoop.apache.org@hadoop.apache.org>
X-Original-To: apmail-hadoop-common-dev-archive@www.apache.org
Delivered-To: apmail-hadoop-common-dev-archive@www.apache.org
Received: from mail.apache.org (hermes.apache.org [140.211.11.3])
by minotaur.apache.org (Postfix) with SMTP id 78C72908D
for <apmail-hadoop-common-dev-archive@www.apache.org>; Sat, 4 Feb 2012 03:17:10 +0000 (UTC)
Received: (qmail 8125 invoked by uid 500); 4 Feb 2012 03:17:07 -0000
Delivered-To: apmail-hadoop-common-dev-archive@hadoop.apache.org
Received: (qmail 7761 invoked by uid 500); 4 Feb 2012 03:16:50 -0000
Mailing-List: contact common-dev-help@hadoop.apache.org; run by ezmlm
Precedence: bulk
List-Help: <mailto:common-dev-help@hadoop.apache.org>
List-Unsubscribe: <mailto:common-dev-unsubscribe@hadoop.apache.org>
List-Post: <mailto:common-dev@hadoop.apache.org>
List-Id: <common-dev.hadoop.apache.org>
Reply-To: common-dev@hadoop.apache.org
Delivered-To: mailing list common-dev@hadoop.apache.org
Received: (qmail 7753 invoked by uid 99); 4 Feb 2012 03:16:46 -0000
Received: from athena.apache.org (HELO athena.apache.org) (140.211.11.136)
by apache.org (qpsmtpd/0.29) with ESMTP; Sat, 04 Feb 2012 03:16:46 +0000
X-ASF-Spam-Status: No, hits=0.5 required=5.0
tests=FREEMAIL_ENVFROM_END_DIGIT,FREEMAIL_REPLYTO_END_DIGIT,RCVD_IN_DNSWL_NONE,SPF_PASS
X-Spam-Check-By: apache.org
Received-SPF: pass (athena.apache.org: local policy)
Received: from [98.138.229.160] (HELO nm39-vm0.bullet.mail.ne1.yahoo.com) (98.138.229.160)
by apache.org (qpsmtpd/0.29) with SMTP; Sat, 04 Feb 2012 03:16:37 +0000
Received: from [98.138.90.55] by nm39.bullet.mail.ne1.yahoo.com with NNFMP; 04 Feb 2012 03:16:17 -0000
Received: from [98.138.87.3] by tm8.bullet.mail.ne1.yahoo.com with NNFMP; 04 Feb 2012 03:16:17 -0000
Received: from [127.0.0.1] by omp1003.mail.ne1.yahoo.com with NNFMP; 04 Feb 2012 03:16:17 -0000
X-Yahoo-Newman-Property: ymail-3
X-Yahoo-Newman-Id: 79676.50691.bm@omp1003.mail.ne1.yahoo.com
Received: (qmail 24927 invoked by uid 60001); 4 Feb 2012 03:16:17 -0000
DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=yahoo.com; s=s1024; t=1328325377; bh=TnnLz/AfA1UtH7dAm8Fz04swVlXjDQSpGrj6dhbwnIE=; h=X-YMail-OSG:Received:X-Mailer:References:Message-ID:Date:From:Reply-To:Subject:To:Cc:In-Reply-To:MIME-Version:Content-Type:Content-Transfer-Encoding; b=pttDZwTc0fU/wRdC/xgjGuumJeID6GXzStpNNTyEwG2ZN5JRANswL15jtJRe+BaISa8EX2pDQNrHByjNrwz3DNNM4sO6cdqRGVd6PHbwMzWme8pOul8FNfYSqsDSzd88SRYIay98wzdHZ7OObU5BiiwN6GULJZn9IjnWV9uof74=
DomainKey-Signature:a=rsa-sha1; q=dns; c=nofws;
s=s1024; d=yahoo.com;
h=X-YMail-OSG:Received:X-Mailer:References:Message-ID:Date:From:Reply-To:Subject:To:Cc:In-Reply-To:MIME-Version:Content-Type:Content-Transfer-Encoding;
b=IUjPu1kbHAsVSHwWE7iiY/oy1S2g6NTxg8ETAaKmDvVxyGS8lEMjlmK6KdurcTYVfcYaczt2XIwLlttrxZ3+cT59iYKoEtzCRlGEphGpmYT7x3B41woHlsyIfUv03mqXMErkYs80joc2AT9QtUXxX2g+vn5lar6nmbTIrLpZtSg=;
X-YMail-OSG: glqMcfQVM1mfgP_VFtjv3FOoEnBHY2_yCQD6i2Fb0rxAAVH
ri4NzRYeyiA67k.vp87N2_VwdBsMg3HUcbcITyPjhorjl1zLeuRG7sHzd9Gj
wJR1Kr7z24ROpw_Bsra6jfhihR9009b4Tn017ctte0XKsgyKbCHAyLObV5eA
w4XJaSflXjT6hkyDqJ_.0rjuzwnSBr1b0IfhPJEIrDbZoenxo8D7Eb_G6dH7
262Cav4Rzq.4Pa49xCYIHz.L2pf93JYbKTnCstVVClmIWQar7F72DtAzta8m
VvxGctiEf0jdHqYrPEN_nSieVv1BslYMgV99wLBUjZL6YoyLm8lCQgpyOaAS
7qS9G5v9PbbuF9Tft4gwiR5uK05mfII6xKeVLYxWxTDSmqb3v4ewNagNgeAy
s77.Tn9vMHVfmDHQyiEzeA0YLCAs-
Received: from [174.113.144.83] by web121202.mail.ne1.yahoo.com via HTTP; Fri, 03 Feb 2012 19:16:16 PST
X-Mailer: YahooMailWebService/0.8.116.338427
References: <1327880657.10233.YahooMailNeo@web121206.mail.ne1.yahoo.com> <1328246840.72176.YahooMailNeo@web121204.mail.ne1.yahoo.com> <CAOcnVr1eBdvCUHJ2nn4vH2q2vTCCmjOPGdZHBt7pog7tpbbKSA@mail.gmail.com>
Message-ID: <1328325376.24292.YahooMailNeo@web121202.mail.ne1.yahoo.com>
Date: Fri, 3 Feb 2012 19:16:16 -0800 (PST)
From: Hai Huang <hhuang2012@yahoo.com>
Reply-To: Hai Huang <hhuang2012@yahoo.com>
Subject: Re: Issue on formating the file system
To: "common-dev@hadoop.apache.org" <common-dev@hadoop.apache.org>
Cc: Harsh J <harsh@cloudera.com>
In-Reply-To: <CAOcnVr1eBdvCUHJ2nn4vH2q2vTCCmjOPGdZHBt7pog7tpbbKSA@mail.gmail.com>
MIME-Version: 1.0
Content-Type: text/plain; charset=iso-8859-1
Content-Transfer-Encoding: quoted-printable
It is =0A=0A=A0 <property>=0A=A0=A0=A0 <name>dfs.namenode.name.dir</name>=
=0A=A0=A0=A0 <value>${HADOOP_NN_DIR}</value>=0A=A0 </property>=0A=0AIs the =
issue of the value of ${HADOOP_NN_DIR}=A0 ? I do not find it is defined in =
somewhere.=0A=0AThanks,=0A=0AHai=0A=0A=A0=0A----- Original Message -----=0A=
From: Harsh J <harsh@cloudera.com>=0ATo: common-dev@hadoop.apache.org; Hai =
Huang <hhuang2012@yahoo.com>=0ACc: =0ASent: Friday, February 3, 2012 1:04:3=
9 AM=0ASubject: Re: Issue on formating the file system=0A=0AWhat is your df=
s.namenode.name.dir configured to, in hdfs-site.xml?=0A=0AOn Fri, Feb 3, 20=
12 at 10:57 AM, Hai Huang <hhuang2012@yahoo.com> wrote:=0A> I am trying to=
=A0format a filesystem (below) following the online doc=0A>=0A>=0A> -------=
-------------------------------------=0A> =A0$ bin/hadoop namenode -format=
=0A> --------------------------------------------=0A>=0A> I got the followi=
ng error message:=0A>=0A> --------------------------------------------=0A> =
DEPRECATED: Use of this script to execute hdfs command is deprecated.=0A> I=
nstead use the hdfs command for it.=0A> ....=0A>=0A> Formatting using clust=
erid: CID-22948dd2-0f38-4ecb-a5ff-2d2e1d24285d=0A> 12/02/02 21:17:26 ERROR =
namenode.NameNode: Exception in namenode join=0A> java.lang.IllegalArgument=
Exception: URI has an authority component=0A> =A0=A0=A0=A0=A0=A0=A0 at java=
.io.File.<init>(File.java:385)=0A> =A0=A0=A0=A0=A0=A0=A0 at org.apache.hado=
op.hdfs.server.namenode.NNStorage.getStorageDirectory(NNStorage.java:310)=
=0A> =A0=A0=A0=A0=A0=A0=A0 at org.apache.hadoop.hdfs.server.namenode.FSEdit=
Log.init(FSEditLog.java:178)=0A> =A0=A0=A0=A0=A0=A0=A0 at org.apache.hadoop=
.hdfs.server.namenode.FSEditLog.<init>(FSEditLog.java:155)=0A> =A0=A0=A0=A0=
=A0=A0=A0 at org.apache.hadoop.hdfs.server.namenode.FSImage.<init>(FSImage.=
java:125)=0A> =A0=A0=A0=A0=A0=A0=A0 at org.apache.hadoop.hdfs.server.nameno=
de.NameNode.format(NameNode.java:605)=0A> =A0=A0=A0=A0=A0=A0=A0 at org.apac=
he.hadoop.hdfs.server.namenode.NameNode.createNameNode(NameNode.java:733)=
=0A> =A0=A0=A0=A0=A0=A0=A0 at org.apache.hadoop.hdfs.server.namenode.NameNo=
de.main(NameNode.java:800)=0A> 12/02/02 21:17:26 INFO namenode.NameNode: SH=
UTDOWN_MSG:=0A> /**********************************************************=
**=0A> SHUTDOWN_MSG: Shutting down NameNode at localhost.localdomain/127.0.=
0.1=0A> ************************************************************/=0A> -=
-------------------------------------------=0A>=0A> Does anyone know this i=
ssue?=0A>=0A> I am using the hadoop built myself . The command ( $ bin/hado=
op namenode -format) =A0is issed under the directory=0A>=0A> /hadoop-common=
/hadoop-dist/target/hadoop-0.24.0-SNAPSHOT=0A>=0A>=0A> Thanks,=0A>=0A> Haif=
egng=0A=0A=0A=0A-- =0AHarsh J=0ACustomer Ops. Engineer=0ACloudera | http://=
tiny.cloudera.com/about
From common-dev-return-77617-apmail-hadoop-common-dev-archive=hadoop.apache.org@hadoop.apache.org Sun Feb 5 09:40:16 2012
Return-Path: <common-dev-return-77617-apmail-hadoop-common-dev-archive=hadoop.apache.org@hadoop.apache.org>
X-Original-To: apmail-hadoop-common-dev-archive@www.apache.org
Delivered-To: apmail-hadoop-common-dev-archive@www.apache.org
Received: from mail.apache.org (hermes.apache.org [140.211.11.3])
by minotaur.apache.org (Postfix) with SMTP id F1F7A9A8E
for <apmail-hadoop-common-dev-archive@www.apache.org>; Sun, 5 Feb 2012 09:40:15 +0000 (UTC)
Received: (qmail 25838 invoked by uid 500); 5 Feb 2012 09:40:13 -0000
Delivered-To: apmail-hadoop-common-dev-archive@hadoop.apache.org
Received: (qmail 25400 invoked by uid 500); 5 Feb 2012 09:39:54 -0000
Mailing-List: contact common-dev-help@hadoop.apache.org; run by ezmlm
Precedence: bulk
List-Help: <mailto:common-dev-help@hadoop.apache.org>
List-Unsubscribe: <mailto:common-dev-unsubscribe@hadoop.apache.org>
List-Post: <mailto:common-dev@hadoop.apache.org>
List-Id: <common-dev.hadoop.apache.org>
Reply-To: common-dev@hadoop.apache.org
Delivered-To: mailing list common-dev@hadoop.apache.org
Received: (qmail 25381 invoked by uid 99); 5 Feb 2012 09:39:46 -0000
Received: from athena.apache.org (HELO athena.apache.org) (140.211.11.136)
by apache.org (qpsmtpd/0.29) with ESMTP; Sun, 05 Feb 2012 09:39:46 +0000
X-ASF-Spam-Status: No, hits=-0.0 required=5.0
tests=SPF_PASS
X-Spam-Check-By: apache.org
Received-SPF: pass (athena.apache.org: local policy)
Received: from [204.154.183.83] (HELO smtp1.exar.com) (204.154.183.83)
by apache.org (qpsmtpd/0.29) with ESMTP; Sun, 05 Feb 2012 09:39:41 +0000
Received: from FRE1EXCH02.hq.exar.com ([fe80::e9a7:6160:4e13:1677]) by
fre1-cas ([10.127.1.162]) with mapi; Sun, 5 Feb 2012 01:39:19 -0800
From: Tim Broberg <Tim.Broberg@exar.com>
To: "common-dev@hadoop.apache.org" <common-dev@hadoop.apache.org>
Date: Sun, 5 Feb 2012 01:39:10 -0800
Subject: RE: Getting started with Eclipse for Hadoop 1.0.0?
Thread-Topic: Getting started with Eclipse for Hadoop 1.0.0?
Thread-Index: AcziJ3LYFxmj6LboQvqhAtjlgabEowBwpApL
Message-ID: <FCA91A92EE52B041906A0358FC28FCC38F667B5E25@FRE1EXCH02.hq.exar.com>
References: <FCA91A92EE52B041906A0358FC28FCC38F667B5E1E@FRE1EXCH02.hq.exar.com>,<CAOcnVr2hGcEVofXmFEx_GdG=2LoxQRmYPAj-a8y7ULc-x8zkOg@mail.gmail.com>
In-Reply-To: <CAOcnVr2hGcEVofXmFEx_GdG=2LoxQRmYPAj-a8y7ULc-x8zkOg@mail.gmail.com>
Accept-Language: en-US
Content-Language: en-US
X-MS-Has-Attach:
X-MS-TNEF-Correlator:
acceptlanguage: en-US
Content-Type: text/plain; charset="us-ascii"
Content-Transfer-Encoding: quoted-printable
MIME-Version: 1.0
Thanks, Harsh, that helped.
________________________________________
From: Harsh J [harsh@cloudera.com]
Sent: Thursday, February 02, 2012 7:52 PM
To: common-dev@hadoop.apache.org
Subject: Re: Getting started with Eclipse for Hadoop 1.0.0?
Hi Tim,
Could you try using the branch-1 from the svn-repo/git-clone instead
of a release tarball which may not work in the case of 1.0?
Its a WIP but I also cover some branch building at
http://wiki.apache.org/hadoop/QwertyManiac/BuildingHadoopTrunk --
Perhaps it could come useful to you.
On Fri, Feb 3, 2012 at 5:18 AM, Tim Broberg <Tim.Broberg@exar.com> wrote:
> Any suggestions with getting started with eclipse debugging for 1.0.0?
>
> I would like to be able to debug unit tests for my compression codec with=
some reasonable debugger, be it eclipse, netbeans, or even jdb.
>
> Harsh recommended Eclipse, so I'm wading in...
>
> When I run "ant eclipse" I get missing file errors. The docs on the wiki =
are about using mvn, which isn't supported in 1.x and they include a crypti=
c note that "this" doesn't work, whatever "this" is.
>
> Many of the blog entries describing how to do this refer to the eclipse p=
lugin page above, but the sections they refer to appear to have been delete=
d.
>
> Eclipse isn't mentioned in The Book at all, and the 1.0.0 docs directory =
mentions it only in passing in the release notes and changes docs.
>
> If I just try to create a project from build.xml, there appears to be a m=
issing ivy classpath file.
>
> What is the best way to get started debugging with Eclipse?
>
> Thanks,
> - Tim.
>
> ________________________________
> The information and any attached documents contained in this message
> may be confidential and/or legally privileged. The message is
> intended solely for the addressee(s). If you are not the intended
> recipient, you are hereby notified that any use, dissemination, or
> reproduction is strictly prohibited and may be unlawful. If you are
> not the intended recipient, please contact the sender immediately by
> return e-mail and destroy all copies of the original message.
--
Harsh J
Customer Ops. Engineer
Cloudera | http://tiny.cloudera.com/about
The information and any attached documents contained in this message
may be confidential and/or legally privileged. The message is
intended solely for the addressee(s). If you are not the intended
recipient, you are hereby notified that any use, dissemination, or
reproduction is strictly prohibited and may be unlawful. If you are
not the intended recipient, please contact the sender immediately by
return e-mail and destroy all copies of the original message.
From common-dev-return-77618-apmail-hadoop-common-dev-archive=hadoop.apache.org@hadoop.apache.org Mon Feb 6 00:41:00 2012
Return-Path: <common-dev-return-77618-apmail-hadoop-common-dev-archive=hadoop.apache.org@hadoop.apache.org>
X-Original-To: apmail-hadoop-common-dev-archive@www.apache.org
Delivered-To: apmail-hadoop-common-dev-archive@www.apache.org
Received: from mail.apache.org (hermes.apache.org [140.211.11.3])
by minotaur.apache.org (Postfix) with SMTP id 21CCF9A38
for <apmail-hadoop-common-dev-archive@www.apache.org>; Mon, 6 Feb 2012 00:41:00 +0000 (UTC)
Received: (qmail 11582 invoked by uid 500); 6 Feb 2012 00:40:58 -0000
Delivered-To: apmail-hadoop-common-dev-archive@hadoop.apache.org
Received: (qmail 11494 invoked by uid 500); 6 Feb 2012 00:40:57 -0000
Mailing-List: contact common-dev-help@hadoop.apache.org; run by ezmlm
Precedence: bulk
List-Help: <mailto:common-dev-help@hadoop.apache.org>
List-Unsubscribe: <mailto:common-dev-unsubscribe@hadoop.apache.org>
List-Post: <mailto:common-dev@hadoop.apache.org>
List-Id: <common-dev.hadoop.apache.org>
Reply-To: common-dev@hadoop.apache.org
Delivered-To: mailing list common-dev@hadoop.apache.org
Delivered-To: moderator for common-dev@hadoop.apache.org
Received: (qmail 44574 invoked by uid 99); 5 Feb 2012 07:02:30 -0000
Message-ID: <4F2E2983.60002@apache.org>
Date: Sat, 04 Feb 2012 23:02:27 -0800
From: Mingjie Lai <mlai@apache.org>
User-Agent: Mozilla/5.0 (X11; Linux x86_64; rv:9.0) Gecko/20111229 Thunderbird/9.0
MIME-Version: 1.0
To: common-dev@hadoop.apache.org
Subject: Re: Issue on formating the file system
References: <1327880657.10233.YahooMailNeo@web121206.mail.ne1.yahoo.com> <1328246840.72176.YahooMailNeo@web121204.mail.ne1.yahoo.com> <CAOcnVr1eBdvCUHJ2nn4vH2q2vTCCmjOPGdZHBt7pog7tpbbKSA@mail.gmail.com> <1328325376.24292.YahooMailNeo@web121202.mail.ne1.yahoo.com>
In-Reply-To: <1328325376.24292.YahooMailNeo@web121202.mail.ne1.yahoo.com>
Content-Type: text/plain; charset=ISO-8859-1; format=flowed
Content-Transfer-Encoding: 7bit
> Is the issue of the value of ${HADOOP_NN_DIR}
Yes.
You need to set it to your namenode directory. By default it's
file:///tmp/hadoop-${user.name}/dfs/name. Environment variable won't
work here. So you need to explicitly set a path name.
On 02/03/2012 07:16 PM, Hai Huang wrote:
> It is
>
> <property>
> <name>dfs.namenode.name.dir</name>
> <value>${HADOOP_NN_DIR}</value>
> </property>
>
> Is the issue of the value of ${HADOOP_NN_DIR} ? I do not find it is defined in somewhere.
>
> Thanks,
>
> Hai
>
>
> ----- Original Message -----
> From: Harsh J<harsh@cloudera.com>
> To: common-dev@hadoop.apache.org; Hai Huang<hhuang2012@yahoo.com>
> Cc:
> Sent: Friday, February 3, 2012 1:04:39 AM
> Subject: Re: Issue on formating the file system
>
> What is your dfs.namenode.name.dir configured to, in hdfs-site.xml?
>
> On Fri, Feb 3, 2012 at 10:57 AM, Hai Huang<hhuang2012@yahoo.com> wrote:
>> I am trying to format a filesystem (below) following the online doc
>>
>>
>> --------------------------------------------
>> $ bin/hadoop namenode -format
>> --------------------------------------------
>>
>> I got the following error message:
>>
>> --------------------------------------------
>> DEPRECATED: Use of this script to execute hdfs command is deprecated.
>> Instead use the hdfs command for it.
>> ....
>>
>> Formatting using clusterid: CID-22948dd2-0f38-4ecb-a5ff-2d2e1d24285d
>> 12/02/02 21:17:26 ERROR namenode.NameNode: Exception in namenode join
>> java.lang.IllegalArgumentException: URI has an authority component
>> at java.io.File.<init>(File.java:385)
>> at org.apache.hadoop.hdfs.server.namenode.NNStorage.getStorageDirectory(NNStorage.java:310)
>> at org.apache.hadoop.hdfs.server.namenode.FSEditLog.init(FSEditLog.java:178)
>> at org.apache.hadoop.hdfs.server.namenode.FSEditLog.<init>(FSEditLog.java:155)
>> at org.apache.hadoop.hdfs.server.namenode.FSImage.<init>(FSImage.java:125)
>> at org.apache.hadoop.hdfs.server.namenode.NameNode.format(NameNode.java:605)
>> at org.apache.hadoop.hdfs.server.namenode.NameNode.createNameNode(NameNode.java:733)
>> at org.apache.hadoop.hdfs.server.namenode.NameNode.main(NameNode.java:800)
>> 12/02/02 21:17:26 INFO namenode.NameNode: SHUTDOWN_MSG:
>> /************************************************************
>> SHUTDOWN_MSG: Shutting down NameNode at localhost.localdomain/127.0.0.1
>> ************************************************************/
>> --------------------------------------------
>>
>> Does anyone know this issue?
>>
>> I am using the hadoop built myself . The command ( $ bin/hadoop namenode -format) is issed under the directory
>>
>> /hadoop-common/hadoop-dist/target/hadoop-0.24.0-SNAPSHOT
>>
>>
>> Thanks,
>>
>> Haifegng
>
>
>
From common-dev-return-77619-apmail-hadoop-common-dev-archive=hadoop.apache.org@hadoop.apache.org Mon Feb 6 01:49:21 2012
Return-Path: <common-dev-return-77619-apmail-hadoop-common-dev-archive=hadoop.apache.org@hadoop.apache.org>
X-Original-To: apmail-hadoop-common-dev-archive@www.apache.org
Delivered-To: apmail-hadoop-common-dev-archive@www.apache.org
Received: from mail.apache.org (hermes.apache.org [140.211.11.3])
by minotaur.apache.org (Postfix) with SMTP id 7CF689F1E
for <apmail-hadoop-common-dev-archive@www.apache.org>; Mon, 6 Feb 2012 01:49:21 +0000 (UTC)
Received: (qmail 45648 invoked by uid 500); 6 Feb 2012 01:49:19 -0000
Delivered-To: apmail-hadoop-common-dev-archive@hadoop.apache.org
Received: (qmail 45591 invoked by uid 500); 6 Feb 2012 01:49:19 -0000
Mailing-List: contact common-dev-help@hadoop.apache.org; run by ezmlm
Precedence: bulk
List-Help: <mailto:common-dev-help@hadoop.apache.org>
List-Unsubscribe: <mailto:common-dev-unsubscribe@hadoop.apache.org>
List-Post: <mailto:common-dev@hadoop.apache.org>
List-Id: <common-dev.hadoop.apache.org>
Reply-To: common-dev@hadoop.apache.org
Delivered-To: mailing list common-dev@hadoop.apache.org
Received: (qmail 45583 invoked by uid 99); 6 Feb 2012 01:49:18 -0000
Received: from nike.apache.org (HELO nike.apache.org) (192.87.106.230)
by apache.org (qpsmtpd/0.29) with ESMTP; Mon, 06 Feb 2012 01:49:18 +0000
X-ASF-Spam-Status: No, hits=0.5 required=5.0
tests=FREEMAIL_ENVFROM_END_DIGIT,FREEMAIL_REPLYTO_END_DIGIT,RCVD_IN_DNSWL_NONE,SPF_PASS
X-Spam-Check-By: apache.org
Received-SPF: pass (nike.apache.org: local policy)
Received: from [98.138.91.21] (HELO nm20-vm1.bullet.mail.ne1.yahoo.com) (98.138.91.21)
by apache.org (qpsmtpd/0.29) with SMTP; Mon, 06 Feb 2012 01:49:09 +0000
Received: from [98.138.90.51] by nm20.bullet.mail.ne1.yahoo.com with NNFMP; 06 Feb 2012 01:48:48 -0000
Received: from [98.138.89.233] by tm4.bullet.mail.ne1.yahoo.com with NNFMP; 06 Feb 2012 01:48:48 -0000
Received: from [127.0.0.1] by omp1048.mail.ne1.yahoo.com with NNFMP; 06 Feb 2012 01:48:48 -0000
X-Yahoo-Newman-Property: ymail-3
X-Yahoo-Newman-Id: 279701.64108.bm@omp1048.mail.ne1.yahoo.com
Received: (qmail 21594 invoked by uid 60001); 6 Feb 2012 01:48:48 -0000
DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=yahoo.com; s=s1024; t=1328492928; bh=j8fiX0TXapYMDRMUZzkaatV0pUTC4KJSmGrnmIp91jI=; h=X-YMail-OSG:Received:X-Mailer:References:Message-ID:Date:From:Reply-To:Subject:To:Cc:MIME-Version:Content-Type:Content-Transfer-Encoding; b=cg8pxcYKFbzR/oZUifxB6XIIZoGBes0ks5j1VVXEghtDV3/uLkYvK0043xBC1nFKX3hagoBoXWagJIqEXa0cuFsDzVz2pOHDr2xRtqxgegPAnUeZ6DCPHQA0CEfGDuRZCY5oXr+Z7r0Ask5vuPhMotBl2+mI+/+Y0SbfFvr7DF4=
DomainKey-Signature:a=rsa-sha1; q=dns; c=nofws;
s=s1024; d=yahoo.com;
h=X-YMail-OSG:Received:X-Mailer:References:Message-ID:Date:From:Reply-To:Subject:To:Cc:MIME-Version:Content-Type:Content-Transfer-Encoding;
b=Xf4fj0+CIPN87/JlqN/w05CjTEfhjZu8q/GhC9C7tJfjQ6yQ+jC8Jg7hlzpziYG50dRGcZF4vsz+uU5ws3KkSJ2w5lxOEjxntTOlpgTWfD4PB6mfAqq/7hmFieJx+L+yNAGhVk2jaTEbLnOud/B/kmyHg7jzFz04KvhMUScaHi8=;
X-YMail-OSG: 04FQNxIVM1nZ6eQf4i2j6hcZejP..Dvl2tbTOGLzkl5OOca
_jjJmRGx1DGQVtK.9XfOzIXHPCwaK4t3NJRmZHF5Bm7Ux0JadaEIoaZWv.CQ
bHcseDrPMPND0RDAtv3hublM.adktndBZwDaRgHK1OsJKOFBwWQPzReiEMSw
KJG_yarLUNURYGxnq_9Wga_PrdSBQ0sRSBB_39OHv9Tj7xxcww5QefIqj6h3
k2aUP0_UKS0oTrn1eIn5_Jf67MrDuFJ4k1wCz_cK51CPUC0WWBc2AMVEslh2
pCYm1SdoyZXtC_.GUD7h4JOIJpNf8H5xHsNInr4dnTuHNora6DotF57WSpF.
fmgf4f8_i59mhiNG_Jyp0m88lJLv0ivK3TsZa86HosvgJNS6bFsdc3LJG_7m
iYNf0
Received: from [174.113.144.83] by web121201.mail.ne1.yahoo.com via HTTP; Sun, 05 Feb 2012 17:48:48 PST
X-Mailer: YahooMailWebService/0.8.116.338427
References: <1327880657.10233.YahooMailNeo@web121206.mail.ne1.yahoo.com> <1328246840.72176.YahooMailNeo@web121204.mail.ne1.yahoo.com> <CAOcnVr1eBdvCUHJ2nn4vH2q2vTCCmjOPGdZHBt7pog7tpbbKSA@mail.gmail.com>
Message-ID: <1328492928.7909.YahooMailNeo@web121201.mail.ne1.yahoo.com>
Date: Sun, 5 Feb 2012 17:48:48 -0800 (PST)
From: Hai Huang <hhuang2012@yahoo.com>
Reply-To: Hai Huang <hhuang2012@yahoo.com>
Subject: Re: Issue on formating the file system
To: "common-dev@hadoop.apache.org" <common-dev@hadoop.apache.org>
Cc: Harsh J <harsh@cloudera.com>
MIME-Version: 1.0
Content-Type: text/plain; charset=iso-8859-1
Content-Transfer-Encoding: quoted-printable
X-Virus-Checked: Checked by ClamAV on apache.org
Thanks Harsh.=0A=0AI figured out the issue. Added following environment var=
iables :=0A=0A=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=
=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=0A=0Aexport HADOOP_D=
EV_HOME=3D`pwd`=0Aexport HADOOP_MAPRED_HOME=3D${HADOOP_DEV_HOME}=0Aexport H=
ADOOP_COMMON_HOME=3D${HADOOP_DEV_HOME}=0Aexport HADOOP_HDFS_HOME=3D${HADOOP=
_DEV_HOME}=0Aexport YARN_HOME=3D${HADOOP_DEV_HOME}=0Aexport HADOOP_CONF_DIR=
=3D${HADOOP_DEV_HOME}/conf/=0Aexport YARN_CONF_DIR=3D~${HADOOP_DEV_HOME}/co=
nf/=0A=0A=A0Then the=A0format is working.=0A=0A=0A----- Original Message --=
---=0AFrom: Harsh J <harsh@cloudera.com>=0ATo: common-dev@hadoop.apache.org=
; Hai Huang <hhuang2012@yahoo.com>=0ACc: =0ASent: Friday, February 3, 2012 =
1:04:39 AM=0ASubject: Re: Issue on formating the file system=0A=0AWhat is y=
our dfs.namenode.name.dir configured to, in hdfs-site.xml?=0A=0AOn Fri, Feb=
3, 2012 at 10:57 AM, Hai Huang <hhuang2012@yahoo.com> wrote:=0A> I am tryi=
ng to=A0format a filesystem (below) following the online doc=0A>=0A>=0A> --=
------------------------------------------=0A> =A0$ bin/hadoop namenode -fo=
rmat=0A> --------------------------------------------=0A>=0A> I got the fol=
lowing error message:=0A>=0A> --------------------------------------------=
=0A> DEPRECATED: Use of this script to execute hdfs command is deprecated.=
=0A> Instead use the hdfs command for it.=0A> ....=0A>=0A> Formatting using=
clusterid: CID-22948dd2-0f38-4ecb-a5ff-2d2e1d24285d=0A> 12/02/02 21:17:26 =
ERROR namenode.NameNode: Exception in namenode join=0A> java.lang.IllegalAr=
gumentException: URI has an authority component=0A> =A0=A0=A0=A0=A0=A0=A0 a=
t java.io.File.<init>(File.java:385)=0A> =A0=A0=A0=A0=A0=A0=A0 at org.apach=
e.hadoop.hdfs.server.namenode.NNStorage.getStorageDirectory(NNStorage.java:=
310)=0A> =A0=A0=A0=A0=A0=A0=A0 at org.apache.hadoop.hdfs.server.namenode.FS=
EditLog.init(FSEditLog.java:178)=0A> =A0=A0=A0=A0=A0=A0=A0 at org.apache.ha=
doop.hdfs.server.namenode.FSEditLog.<init>(FSEditLog.java:155)=0A> =A0=A0=
=A0=A0=A0=A0=A0 at org.apache.hadoop.hdfs.server.namenode.FSImage.<init>(FS=
Image.java:125)=0A> =A0=A0=A0=A0=A0=A0=A0 at org.apache.hadoop.hdfs.server.=
namenode.NameNode.format(NameNode.java:605)=0A> =A0=A0=A0=A0=A0=A0=A0 at or=
g.apache.hadoop.hdfs.server.namenode.NameNode.createNameNode(NameNode.java:=
733)=0A> =A0=A0=A0=A0=A0=A0=A0 at org.apache.hadoop.hdfs.server.namenode.Na=
meNode.main(NameNode.java:800)=0A> 12/02/02 21:17:26 INFO namenode.NameNode=
: SHUTDOWN_MSG:=0A> /******************************************************=
******=0A> SHUTDOWN_MSG: Shutting down NameNode at localhost.localdomain/12=
7.0.0.1=0A> ************************************************************/=
=0A> --------------------------------------------=0A>=0A> Does anyone know =
this issue?=0A>=0A> I am using the hadoop built myself . The command ( $ bi=
n/hadoop namenode -format) =A0is issed under the directory=0A>=0A> /hadoop-=
common/hadoop-dist/target/hadoop-0.24.0-SNAPSHOT=0A>=0A>=0A> Thanks,=0A>=0A=
> Haifegng=0A=0A=0A=0A-- =0AHarsh J=0ACustomer Ops. Engineer=0ACloudera | h=
ttp://tiny.cloudera.com/about
From common-dev-return-77620-apmail-hadoop-common-dev-archive=hadoop.apache.org@hadoop.apache.org Mon Feb 6 02:24:25 2012
Return-Path: <common-dev-return-77620-apmail-hadoop-common-dev-archive=hadoop.apache.org@hadoop.apache.org>
X-Original-To: apmail-hadoop-common-dev-archive@www.apache.org
Delivered-To: apmail-hadoop-common-dev-archive@www.apache.org
Received: from mail.apache.org (hermes.apache.org [140.211.11.3])
by minotaur.apache.org (Postfix) with SMTP id 33FC79611
for <apmail-hadoop-common-dev-archive@www.apache.org>; Mon, 6 Feb 2012 02:24:25 +0000 (UTC)
Received: (qmail 82145 invoked by uid 500); 6 Feb 2012 02:24:23 -0000
Delivered-To: apmail-hadoop-common-dev-archive@hadoop.apache.org
Received: (qmail 82093 invoked by uid 500); 6 Feb 2012 02:24:22 -0000
Mailing-List: contact common-dev-help@hadoop.apache.org; run by ezmlm
Precedence: bulk
List-Help: <mailto:common-dev-help@hadoop.apache.org>
List-Unsubscribe: <mailto:common-dev-unsubscribe@hadoop.apache.org>
List-Post: <mailto:common-dev@hadoop.apache.org>
List-Id: <common-dev.hadoop.apache.org>
Reply-To: common-dev@hadoop.apache.org
Delivered-To: mailing list common-dev@hadoop.apache.org
Received: (qmail 82085 invoked by uid 99); 6 Feb 2012 02:24:22 -0000
Received: from nike.apache.org (HELO nike.apache.org) (192.87.106.230)
by apache.org (qpsmtpd/0.29) with ESMTP; Mon, 06 Feb 2012 02:24:22 +0000
X-ASF-Spam-Status: No, hits=-2000.0 required=5.0
tests=ALL_TRUSTED,T_RP_MATCHES_RCVD
X-Spam-Check-By: apache.org
Received: from [140.211.11.116] (HELO hel.zones.apache.org) (140.211.11.116)
by apache.org (qpsmtpd/0.29) with ESMTP; Mon, 06 Feb 2012 02:24:20 +0000
Received: from hel.zones.apache.org (hel.zones.apache.org [140.211.11.116])
by hel.zones.apache.org (Postfix) with ESMTP id 668DD1A533D
for <common-dev@hadoop.apache.org>; Mon, 6 Feb 2012 02:23:59 +0000 (UTC)
Date: Mon, 6 Feb 2012 02:23:59 +0000 (UTC)
From: "Ambud Sharma (Created) (JIRA)" <jira@apache.org>
To: common-dev@hadoop.apache.org
Message-ID: <598434594.608.1328495039421.JavaMail.tomcat@hel.zones.apache.org>
Subject: [jira] [Created] (HADOOP-8024) Debugging Hadoop daemons in Eclipse
/ Netbeans debugger
MIME-Version: 1.0
Content-Type: text/plain; charset=utf-8
Content-Transfer-Encoding: 7bit
X-JIRA-FingerPrint: 30527f35849b9dde25b450d4833f0394
X-Virus-Checked: Checked by ClamAV on apache.org
Debugging Hadoop daemons in Eclipse / Netbeans debugger
-------------------------------------------------------
Key: HADOOP-8024
URL: https://issues.apache.org/jira/browse/HADOOP-8024
Project: Hadoop Common
Issue Type: Improvement
Components: test
Affects Versions: 0.20.203.0
Environment: Windows/Linux; Eclipse and Netbeans
Reporter: Ambud Sharma
Priority: Minor
To debug Hadoop daemons for prototyping; I discovered the use of Eclipse and Netbeans for the purpose.
To perform this import the source code of Hadoop as a Java Project (you will have to do some refactoring to make sure the imports and packages are correct)
instead of an ant project or importing an existing project.
Please make sure the apache-commons libraries are in classpath and you should now be able to launch the particular daemon from their respective packages inside the debugger.
I find it particularly useful to use the eclipse and netbeans standard debugger to perform any code increments as its fairly simple to perform stacktrace and point to the exact code error.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
From common-dev-return-77621-apmail-hadoop-common-dev-archive=hadoop.apache.org@hadoop.apache.org Mon Feb 6 02:52:56 2012
Return-Path: <common-dev-return-77621-apmail-hadoop-common-dev-archive=hadoop.apache.org@hadoop.apache.org>
X-Original-To: apmail-hadoop-common-dev-archive@www.apache.org
Delivered-To: apmail-hadoop-common-dev-archive@www.apache.org
Received: from mail.apache.org (hermes.apache.org [140.211.11.3])
by minotaur.apache.org (Postfix) with SMTP id 9D54D90DB
for <apmail-hadoop-common-dev-archive@www.apache.org>; Mon, 6 Feb 2012 02:52:56 +0000 (UTC)
Received: (qmail 5161 invoked by uid 500); 6 Feb 2012 02:52:54 -0000
Delivered-To: apmail-hadoop-common-dev-archive@hadoop.apache.org
Received: (qmail 4938 invoked by uid 500); 6 Feb 2012 02:52:52 -0000
Mailing-List: contact common-dev-help@hadoop.apache.org; run by ezmlm
Precedence: bulk
List-Help: <mailto:common-dev-help@hadoop.apache.org>
List-Unsubscribe: <mailto:common-dev-unsubscribe@hadoop.apache.org>
List-Post: <mailto:common-dev@hadoop.apache.org>
List-Id: <common-dev.hadoop.apache.org>
Reply-To: common-dev@hadoop.apache.org
Delivered-To: mailing list common-dev@hadoop.apache.org
Received: (qmail 4930 invoked by uid 99); 6 Feb 2012 02:52:51 -0000
Received: from nike.apache.org (HELO nike.apache.org) (192.87.106.230)
by apache.org (qpsmtpd/0.29) with ESMTP; Mon, 06 Feb 2012 02:52:51 +0000
X-ASF-Spam-Status: No, hits=3.0 required=5.0
tests=FREEMAIL_ENVFROM_END_DIGIT,FREEMAIL_FORGED_REPLYTO,FREEMAIL_REPLYTO_END_DIGIT,RCVD_IN_DNSWL_NONE,SPF_PASS
X-Spam-Check-By: apache.org
Received-SPF: pass (nike.apache.org: local policy)
Received: from [98.138.91.59] (HELO nm19-vm0.bullet.mail.ne1.yahoo.com) (98.138.91.59)
by apache.org (qpsmtpd/0.29) with SMTP; Mon, 06 Feb 2012 02:52:43 +0000
Received: from [98.138.90.55] by nm19.bullet.mail.ne1.yahoo.com with NNFMP; 06 Feb 2012 02:52:21 -0000
Received: from [98.138.226.160] by tm8.bullet.mail.ne1.yahoo.com with NNFMP; 06 Feb 2012 02:52:21 -0000
Received: from [127.0.0.1] by omp1061.mail.ne1.yahoo.com with NNFMP; 06 Feb 2012 02:52:21 -0000
X-Yahoo-Newman-Property: ymail-3
X-Yahoo-Newman-Id: 405204.94162.bm@omp1061.mail.ne1.yahoo.com
Received: (qmail 33577 invoked by uid 60001); 6 Feb 2012 02:52:21 -0000
DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=yahoo.com; s=s1024; t=1328496741; bh=ywJ6VcrEPMyK1utsggvn7mW4MFIuENSqvjzjBhqED9s=; h=X-YMail-OSG:Received:X-Mailer:References:Message-ID:Date:From:Reply-To:Subject:To:In-Reply-To:MIME-Version:Content-Type:Content-Transfer-Encoding; b=LRxQHjr9v0Mmp9xfgZkUcAAZnzGdHMkFkZ2LKUA18U8jPYug3dx2r0bTcLztVq33vBg7VxWu2SN1nTlsvaCmVGRME4bV7rPrZndGLSPFXhLjq4pI44FQs68gahx917qjBKD+8C/8jE/BxcDVFRH4evdmWIcZMFKVic8ytTFMjmA=
DomainKey-Signature:a=rsa-sha1; q=dns; c=nofws;
s=s1024; d=yahoo.com;
h=X-YMail-OSG:Received:X-Mailer:References:Message-ID:Date:From:Reply-To:Subject:To:In-Reply-To:MIME-Version:Content-Type:Content-Transfer-Encoding;
b=GfeoUQTOfTN4effK6RDRTkD9uniTyRCnyHinxBf2TUSkDMpnDaWVJDjcUE9lZeJgYQVjmLQ7u5hlzYrv91oefc6Diqa7k0CR42EPgjyaJaIvfvFrdW5S6cpLad/0KDCTcQx+8laUx2ycOGpUBFV32qAuTt/oxOQCPzAuk1JDC+w=;
X-YMail-OSG: IrVbfgAVM1mvt2zqv6GSeZQaQoSLgshACDNuhMOsrloHa2s
_8PbweNn5AIPQdJ0c1W0xoWjMQrPJ5r3wShgepKDP7SPg7qMkesiPWt3r9gv
plUShNVy4Qa2eUtq3VmyNdmq8swPHkRTW6r7GG6th3IQe3m37Cs98FtWZbS8
KaSICTSDuyNcZP2._yBw3k8rynH5mFA6zCN8J2hhbDD5B1yFfIJSYkNEze5W
1IHHdBwpk3l9kV0QxAJVhS5IYv5yMCL4xuSc.os_iqYGWIIMj3MtI7y4wH9x
wpxwqpg_UQPyQuAwlZyXCOPx2mgS2eE3xspGW_cHQ3OLnEmKt0ON49zvL6MB
P0Rr3apqtMEBvFc1nNkBgYt85ZvEksjbhdPl.n8JRdlBgMwTIYvEpZcNjqhI
h_ei3YCoyCO2V2cQ1S9xiromq1tw9QwzSrA_bjoV.hqhXsR1KQa.jT28XNaN
uBrbkAt4jI_ycaVlJC_se6uiir61USHeTvc3OFYH36wOg2Dkd7pZpbU.hODd
nJDxu6giQ1xyj.oz1noHO3oRIZ_OUEdG8xsb_eypso3zntBVPv7QwUuA758J
qGyJY4Wa8IcuXtY5ky45h8Xd7xhfrI0OrpJpzUAEj.84TxkNcna0rhuA0bhC
vyFGE.36uw9RoRmNoS04OGiDWbigMOOSPBnetJ4Gzim6z_BhsvxLD3d9v0Kp
kRtuhpLa1Kqk90.NAa6O01vgTezs9Gqebohb9LpbE05u8mrHy2AtvAlUIY2L
0d6_DY8Dau.j8fBdYovAlJcuEpjROgvvbbhbnMl4vtABIOgPPf9TTeQ8lvNz
LxjvVTUoxNqQZCXO0KZgL8DpWQHlqe3YWEtYLOgMibPM5CDN0SN2f.yChQW2
3uK8ykr9bIteC__bQthAyJ8X3e1.2RjouWoSY_ctMAxlm0EezaDP6v8S1DLS
N2pJgObbQkFvNNoC67JgxukIKCyCbilaSMHMVwl_J5xWiuhRDFHWTK057dcb
LtmPPZI0C6F2FTcNYsCDi_e6UwMgoV57sOmvgiKutzEg-
Received: from [174.113.144.83] by web121205.mail.ne1.yahoo.com via HTTP; Sun, 05 Feb 2012 18:52:21 PST
X-Mailer: YahooMailWebService/0.8.116.338427
References: <1327880657.10233.YahooMailNeo@web121206.mail.ne1.yahoo.com> <1328246840.72176.YahooMailNeo@web121204.mail.ne1.yahoo.com> <CAOcnVr1eBdvCUHJ2nn4vH2q2vTCCmjOPGdZHBt7pog7tpbbKSA@mail.gmail.com> <1328492928.7909.YahooMailNeo@web121201.mail.ne1.yahoo.com>
Message-ID: <1328496741.60161.YahooMailNeo@web121205.mail.ne1.yahoo.com>
Date: Sun, 5 Feb 2012 18:52:21 -0800 (PST)
From: Hai Huang <hhuang2012@yahoo.com>
Reply-To: Hai Huang <hhuang2012@yahoo.com>
Subject: Re: Issue on running examples
To: "common-dev@hadoop.apache.org" <common-dev@hadoop.apache.org>
In-Reply-To: <1328492928.7909.YahooMailNeo@web121201.mail.ne1.yahoo.com>
MIME-Version: 1.0
Content-Type: text/plain; charset=iso-8859-1
Content-Transfer-Encoding: quoted-printable
X-Virus-Checked: Checked by ClamAV on apache.org
I am doing following steps to running a example=A0-- randomwriter=0A=A0=0A1=
.=A0=A0=A0=A0 sbin/hadoop-daemon.sh start namenode=0A=A0=0A2. =A0=A0=A0=A0s=
bin/hadoop-daemon.sh start datanode=0A=A0=0A3.=A0=A0=A0=A0bin/yarn-daemon.s=
h start resourcemanager=0A=A0=0A4.=A0=A0=A0=A0bin/yarn-daemon.sh start node=
manager=0A=A0=0A5.=A0 ./bin/hadoop jar ./share/hadoop/mapreduce/hadoop-mapr=
educe-examples-0.24.0-SNAPSHOT.jar randomwriter -Dmapreduce.job.user.name=
=3D$USER -Dmapreduce.clientfactory.class.name=3Dorg.apache.hadoop.mapred.Ya=
rnClientFactory -Dmapreduce.randomwriter.bytespermap=3D10000 -Ddfs.blocksiz=
e=3D536870912 -Ddfs.block.size=3D536870912 -libjars ./share/hadoop/mapreduc=
e/hadoop-mapreduce-client-jobclient-0.24.0-SNAPSHOT.jar output=0A=A0=0AThe =
step reported error message in below:=0A=A0=0A=3D=3D=3D=3D=3D=3D=3D=3D=3D=
=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=
=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=
=3D=3D=3D=3D=3D=3D=3D=3D=3D=0A=A0=0A2012-02-05 18:44:21,905 WARN=A0 conf.Co=
nfiguration (Configuration.java:set(639)) - mapred.used.genericoptionsparse=
r is deprecated. Instead, use mapreduce.client.genericoptionsparser.used=0A=
Running 10 maps.=0AJob started: Sun Feb 05 18:44:22 PST 2012=0A2012-02-05 1=
8:44:22,512 WARN=A0 conf.Configuration (Configuration.java:handleDeprecatio=
n(326)) - fs.default.name is deprecated. Instead, use fs.defaultFS=0A2012-0=
2-05 18:44:22,618 WARN=A0 hdfs.DFSClient (DFSOutputStream.java:run(549)) - =
DataStreamer Exception=0Ajava.io.IOException: java.io.IOException: File /tm=
p/hadoop-yarn/staging/hai/.staging/job_1328468416955_0007/libjars/hadoop-ma=
preduce-client-jobclient-0.24.0-SNAPSHOT.jar could only be replicated to 0 =
nodes instead of minReplication (=3D1).=A0 There are 1 datanode(s) running =
and no node(s) are excluded in this operation.=0A=A0=A0=A0=A0=A0=A0=A0 at o=
rg.apache.hadoop.hdfs.server.blockmanagement.BlockManager.chooseTarget(Bloc=
kManager.java:1145)=0A=A0=A0=A0=A0=A0=A0=A0 at org.apache.hadoop.hdfs.serve=
r.namenode.FSNamesystem.getAdditionalBlock(FSNamesystem.java:1540)=0A=A0=A0=
=A0=A0=A0=A0=A0 at org.apache.hadoop.hdfs.server.namenode.NameNodeRpcServer=
.addBlock(NameNodeRpcServer.java:477)=0A=A0=A0=A0=A0=A0=A0=A0 at org.apache=
.hadoop.hdfs.protocolPB.ClientNamenodeProtocolServerSideTranslatorPB.addBlo=
ck(ClientNamenodeProtocolServerSideTranslatorPB.java:346)=0A=A0=A0=A0=A0=A0=
=A0=A0 at org.apache.hadoop.hdfs.protocol.proto.ClientNamenodeProtocolProto=
s$ClientNamenodeProtocol$2.callBlockingMethod(ClientNamenodeProtocolProtos.=
java:42602)=0A=A0=A0=A0=A0=A0=A0=A0 at org.apache.hadoop.ipc.ProtobufRpcEng=
ine$Server$ProtoBufRpcInvoker.call(ProtobufRpcEngine.java:439)=0A=A0=A0=A0=
=A0=A0=A0=A0 at org.apache.hadoop.ipc.RPC$Server.call(RPC.java:862)=0A=A0=
=A0=A0=A0=A0=A0=A0 at org.apache.hadoop.ipc.Server$Handler$1.run(Server.jav=
a:1608)=0A=A0=A0=A0=A0=A0=A0=A0 at org.apache.hadoop.ipc.Server$Handler$1.r=
un(Server.java:1604)=0A=A0=A0=A0=A0=A0=A0=A0 at java.security.AccessControl=
ler.doPrivileged(Native Method)=0A=A0=A0=A0=A0=A0=A0=A0 at javax.security.a=
uth.Subject.doAs(Subject.java:416)=0A=A0=A0=A0=A0=A0=A0=A0 at org.apache.ha=
doop.security.UserGroupInformation.doAs(UserGroupInformation.java:1177)=0A=
=A0=A0=A0=A0=A0=A0=A0 at org.apache.hadoop.ipc.Server$Handler.run(Server.ja=
va:1602)=0A=A0=A0=A0=A0=A0=A0=A0 at org.apache.hadoop.ipc.ProtobufRpcEngine=
$Invoker.invoke(ProtobufRpcEngine.java:203)=0A=A0=A0=A0=A0=A0=A0=A0 at $Pro=
xy10.addBlock(Unknown Source)=0A=A0=A0=A0=A0=A0=A0=A0 at sun.reflect.Native=
MethodAccessorImpl.invoke0(Native Method)=0A=A0=A0=A0=A0=A0=A0=A0 at sun.re=
flect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57)=0A=
=A0=A0=A0=A0=A0=A0=A0 at sun.reflect.DelegatingMethodAccessorImpl.invoke(De=
legatingMethodAccessorImpl.java:43)=0A=A0=A0=A0=A0=A0=A0=A0 at java.lang.re=
flect.Method.invoke(Method.java:616)=0A=A0=A0=A0=A0=A0=A0=A0 at org.apache.=
hadoop.io.retry.RetryInvocationHandler.invokeMethod(RetryInvocationHandler.=
java:127)=0A=A0=A0=A0=A0=A0=A0=A0 at org.apache.hadoop.io.retry.RetryInvoca=
tionHandler.invoke(RetryInvocationHandler.java:81)=0A=A0=A0=A0=A0=A0=A0=A0 =
at $Proxy10.addBlock(Unknown Source)=0A=A0=A0=A0=A0=A0=A0=A0 at org.apache.=
hadoop.hdfs.protocolPB.ClientNamenodeProtocolTranslatorPB.addBlock(ClientNa=
menodeProtocolTranslatorPB.java:355)=0A=A0=A0=A0=A0=A0=A0=A0 at org.apache.=
hadoop.hdfs.DFSOutputStream$DataStreamer.locateFollowingBlock(DFSOutputStre=
am.java:1097)=0A=A0=A0=A0=A0=A0=A0=A0 at org.apache.hadoop.hdfs.DFSOutputSt=
ream$DataStreamer.nextBlockOutputStream(DFSOutputStream.java:973)=0A=A0=A0=
=A0=A0=A0=A0=A0 at org.apache.hadoop.hdfs.DFSOutputStream$DataStreamer.run(=
DFSOutputStream.java:455)=0A2012-02-05 18:44:22,620 INFO=A0 mapreduce.JobSu=
bmitter (JobSubmitter.java:submitJobInternal(388)) - Cleaning up the stagin=
g area /tmp/hadoop-yarn/staging/hai/.staging/job_1328468416955_0007=0A2012-=
02-05 18:44:22,626 ERROR security.UserGroupInformation (UserGroupInformatio=
n.java:doAs(1180)) - PriviledgedActionException as:hai (auth:SIMPLE) cause:=
java.io.IOException: java.io.IOException: File /tmp/hadoop-yarn/staging/hai=
/.staging/job_1328468416955_0007/libjars/hadoop-mapreduce-client-jobclient-=
0.24.0-SNAPSHOT.jar could only be replicated to 0 nodes instead of minRepli=
cation (=3D1).=A0 There are 1 datanode(s) running and no node(s) are exclud=
ed in this operation.=0A=A0=A0=A0=A0=A0=A0=A0 at org.apache.hadoop.hdfs.ser=
ver.blockmanagement.BlockManager.chooseTarget(BlockManager.java:1145)=0A=A0=
=A0=A0=A0=A0=A0=A0 at org.apache.hadoop.hdfs.server.namenode.FSNamesystem.g=
etAdditionalBlock(FSNamesystem.java:1540)=0A=A0=A0=A0=A0=A0=A0=A0 at org.ap=
ache.hadoop.hdfs.server.namenode.NameNodeRpcServer.addBlock(NameNodeRpcServ=
er.java:477)=0A=A0=A0=A0=A0=A0=A0=A0 at org.apache.hadoop.hdfs.protocolPB.C=
lientNamenodeProtocolServerSideTranslatorPB.addBlock(ClientNamenodeProtocol=
ServerSideTranslatorPB.java:346)=0A=A0=A0=A0=A0=A0=A0=A0 at org.apache.hado=
op.hdfs.protocol.proto.ClientNamenodeProtocolProtos$ClientNamenodeProtocol$=
2.callBlockingMethod(ClientNamenodeProtocolProtos.java:42602)=0A=A0=A0=A0=
=A0=A0=A0=A0 at org.apache.hadoop.ipc.ProtobufRpcEngine$Server$ProtoBufRpcI=
nvoker.call(ProtobufRpcEngine.java:439)=0A=A0=A0=A0=A0=A0=A0=A0 at org.apac=
he.hadoop.ipc.RPC$Server.call(RPC.java:862)=0A=A0=A0=A0=A0=A0=A0=A0 at org.=
apache.hadoop.ipc.Server$Handler$1.run(Server.java:1608)=0A=A0=A0=A0=A0=A0=
=A0=A0 at org.apache.hadoop.ipc.Server$Handler$1.run(Server.java:1604)=0A=
=A0=A0=A0=A0=A0=A0=A0 at java.security.AccessController.doPrivileged(Native=
Method)=0A=A0=A0=A0=A0=A0=A0=A0 at javax.security.auth.Subject.doAs(Subjec=
t.java:416)=0A=A0=A0=A0=A0=A0=A0=A0 at org.apache.hadoop.security.UserGroup=
Information.doAs(UserGroupInformation.java:1177)=0A=A0=A0=A0=A0=A0=A0=A0 at=
org.apache.hadoop.ipc.Server$Handler.run(Server.java:1602)=0Ajava.io.IOExc=
eption: java.io.IOException: File /tmp/hadoop-yarn/staging/hai/.staging/job=
_1328468416955_0007/libjars/hadoop-mapreduce-client-jobclient-0.24.0-SNAPSH=
OT.jar could only be replicated to 0 nodes instead of minReplication (=3D1)=
.=A0 There are 1 datanode(s) running and no node(s) are excluded in this op=
eration.=0A=A0=A0=A0=A0=A0=A0=A0 at org.apache.hadoop.hdfs.server.blockmana=
gement.BlockManager.chooseTarget(BlockManager.java:1145)=0A=A0=A0=A0=A0=A0=
=A0=A0 at org.apache.hadoop.hdfs.server.namenode.FSNamesystem.getAdditional=
Block(FSNamesystem.java:1540)=0A=A0=A0=A0=A0=A0=A0=A0 at org.apache.hadoop.=
hdfs.server.namenode.NameNodeRpcServer.addBlock(NameNodeRpcServer.java:477)=
=0A=A0=A0=A0=A0=A0=A0=A0 at org.apache.hadoop.hdfs.protocolPB.ClientNamenod=
eProtocolServerSideTranslatorPB.addBlock(ClientNamenodeProtocolServerSideTr=
anslatorPB.java:346)=0A=A0=A0=A0=A0=A0=A0=A0 at org.apache.hadoop.hdfs.prot=
ocol.proto.ClientNamenodeProtocolProtos$ClientNamenodeProtocol$2.callBlocki=
ngMethod(ClientNamenodeProtocolProtos.java:42602)=0A=A0=A0=A0=A0=A0=A0=A0 a=
t org.apache.hadoop.ipc.ProtobufRpcEngine$Server$ProtoBufRpcInvoker.call(Pr=
otobufRpcEngine.java:439)=0A=A0=A0=A0=A0=A0=A0=A0 at org.apache.hadoop.ipc.=
RPC$Server.call(RPC.java:862)=0A=A0=A0=A0=A0=A0=A0=A0 at org.apache.hadoop.=
ipc.Server$Handler$1.run(Server.java:1608)=0A=A0=A0=A0=A0=A0=A0=A0 at org.a=
pache.hadoop.ipc.Server$Handler$1.run(Server.java:1604)=0A=A0=A0=A0=A0=A0=
=A0=A0 at java.security.AccessController.doPrivileged(Native Method)=0A=A0=
=A0=A0=A0=A0=A0=A0 at javax.security.auth.Subject.doAs(Subject.java:416)=0A=
=A0=A0=A0=A0=A0=A0=A0 at org.apache.hadoop.security.UserGroupInformation.do=
As(UserGroupInformation.java:1177)=0A=A0=A0=A0=A0=A0=A0=A0 at org.apache.ha=
doop.ipc.Server$Handler.run(Server.java:1602)=0A=A0=A0=A0=A0=A0=A0=A0 at or=
g.apache.hadoop.ipc.ProtobufRpcEngine$Invoker.invoke(ProtobufRpcEngine.java=
:203)=0A=A0=A0=A0=A0=A0=A0=A0 at $Proxy10.addBlock(Unknown Source)=0A=A0=A0=
=A0=A0=A0=A0=A0 at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Meth=
od)=0A=A0=A0=A0=A0=A0=A0=A0 at sun.reflect.NativeMethodAccessorImpl.invoke(=
NativeMethodAccessorImpl.java:57)=0A=A0=A0=A0=A0=A0=A0=A0 at sun.reflect.De=
legatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)=0A=
=A0=A0=A0=A0=A0=A0=A0 at java.lang.reflect.Method.invoke(Method.java:616)=
=0A=A0=A0=A0=A0=A0=A0=A0 at org.apache.hadoop.io.retry.RetryInvocationHandl=
er.invokeMethod(RetryInvocationHandler.java:127)=0A=A0=A0=A0=A0=A0=A0=A0 at=
org.apache.hadoop.io.retry.RetryInvocationHandler.invoke(RetryInvocationHa=
ndler.java:81)=0A=A0=A0=A0=A0=A0=A0=A0 at $Proxy10.addBlock(Unknown Source)=
=0A=A0=A0=A0=A0=A0=A0=A0 at org.apache.hadoop.hdfs.protocolPB.ClientNamenod=
eProtocolTranslatorPB.addBlock(ClientNamenodeProtocolTranslatorPB.java:355)=
=0A=A0=A0=A0=A0=A0=A0=A0 at org.apache.hadoop.hdfs.DFSOutputStream$DataStre=
amer.locateFollowingBlock(DFSOutputStream.java:1097)=0A=A0=A0=A0=A0=A0=A0=
=A0 at org.apache.hadoop.hdfs.DFSOutputStream$DataStreamer.nextBlockOutputS=
tream(DFSOutputStream.java:973)=0A=A0=A0=A0=A0=A0=A0=A0 at org.apache.hadoo=
p.hdfs.DFSOutputStream$DataStreamer.run(DFSOutputStream.java:455)=0A2012-02=
-05 18:44:22,629 ERROR hdfs.DFSClient (DFSClient.java:closeAllFilesBeingWri=
tten(435)) - Failed to close file /tmp/hadoop-yarn/staging/hai/.staging/job=
_1328468416955_0007/libjars/hadoop-mapreduce-client-jobclient-0.24.0-SNAPSH=
OT.jar=0Ajava.io.IOException: java.io.IOException: File /tmp/hadoop-yarn/st=
aging/hai/.staging/job_1328468416955_0007/libjars/hadoop-mapreduce-client-j=
obclient-0.24.0-SNAPSHOT.jar could only be replicated to 0 nodes instead of=
minReplication (=3D1).=A0 There are 1 datanode(s) running and no node(s) a=
re excluded in this operation.=0A=A0=A0=A0=A0=A0=A0=A0 at org.apache.hadoop=
.hdfs.server.blockmanagement.BlockManager.chooseTarget(BlockManager.java:11=
45)=0A=A0=A0=A0=A0=A0=A0=A0 at org.apache.hadoop.hdfs.server.namenode.FSNam=
esystem.getAdditionalBlock(FSNamesystem.java:1540)=0A=A0=A0=A0=A0=A0=A0=A0 =
at org.apache.hadoop.hdfs.server.namenode.NameNodeRpcServer.addBlock(NameNo=
deRpcServer.java:477)=0A=A0=A0=A0=A0=A0=A0=A0 at org.apache.hadoop.hdfs.pro=
tocolPB.ClientNamenodeProtocolServerSideTranslatorPB.addBlock(ClientNamenod=
eProtocolServerSideTranslatorPB.java:346)=0A=A0=A0=A0=A0=A0=A0=A0 at org.ap=
ache.hadoop.hdfs.protocol.proto.ClientNamenodeProtocolProtos$ClientNamenode=
Protocol$2.callBlockingMethod(ClientNamenodeProtocolProtos.java:42602)=0A=
=A0=A0=A0=A0=A0=A0=A0 at org.apache.hadoop.ipc.ProtobufRpcEngine$Server$Pro=
toBufRpcInvoker.call(ProtobufRpcEngine.java:439)=0A=A0=A0=A0=A0=A0=A0=A0 at=
org.apache.hadoop.ipc.RPC$Server.call(RPC.java:862)=0A=A0=A0=A0=A0=A0=A0=
=A0 at org.apache.hadoop.ipc.Server$Handler$1.run(Server.java:1608)=0A=A0=
=A0=A0=A0=A0=A0=A0 at org.apache.hadoop.ipc.Server$Handler$1.run(Server.jav=
a:1604)=0A=A0=A0=A0=A0=A0=A0=A0 at java.security.AccessController.doPrivile=
ged(Native Method)=0A=A0=A0=A0=A0=A0=A0=A0 at javax.security.auth.Subject.d=
oAs(Subject.java:416)=0A=A0=A0=A0=A0=A0=A0=A0 at org.apache.hadoop.security=
.UserGroupInformation.doAs(UserGroupInformation.java:1177)=0A=A0=A0=A0=A0=
=A0=A0=A0 at org.apache.hadoop.ipc.Server$Handler.run(Server.java:1602)=0A=
=A0=A0=A0=A0=A0=A0=A0 at org.apache.hadoop.ipc.ProtobufRpcEngine$Invoker.in=
voke(ProtobufRpcEngine.java:203)=0A=A0=A0=A0=A0=A0=A0=A0 at $Proxy10.addBlo=
ck(Unknown Source)=0A=A0=A0=A0=A0=A0=A0=A0 at sun.reflect.NativeMethodAcces=
sorImpl.invoke0(Native Method)=0A=A0=A0=A0=A0=A0=A0=A0 at sun.reflect.Nativ=
eMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57)=0A=A0=A0=A0=A0=
=A0=A0=A0 at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMeth=
odAccessorImpl.java:43)=0A=A0=A0=A0=A0=A0=A0=A0 at java.lang.reflect.Method=
.invoke(Method.java:616)=0A=A0=A0=A0=A0=A0=A0=A0 at org.apache.hadoop.io.re=
try.RetryInvocationHandler.invokeMethod(RetryInvocationHandler.java:127)=0A=
=A0=A0=A0=A0=A0=A0=A0 at org.apache.hadoop.io.retry.RetryInvocationHandler.=
invoke(RetryInvocationHandler.java:81)=0A=A0=A0=A0=A0=A0=A0=A0 at $Proxy10.=
addBlock(Unknown Source)=0A=A0=A0=A0=A0=A0=A0=A0 at org.apache.hadoop.hdfs.=
protocolPB.ClientNamenodeProtocolTranslatorPB.addBlock(ClientNamenodeProtoc=
olTranslatorPB.java:355)=0A=A0=A0=A0=A0=A0=A0=A0 at org.apache.hadoop.hdfs.=
DFSOutputStream$DataStreamer.locateFollowingBlock(DFSOutputStream.java:1097=
)=0A=A0=A0=A0=A0=A0=A0=A0 at org.apache.hadoop.hdfs.DFSOutputStream$DataStr=
eamer.nextBlockOutputStream(DFSOutputStream.java:973)=0A=A0=A0=A0=A0=A0=A0=
=A0 at org.apache.hadoop.hdfs.DFSOutputStream$DataStreamer.run(DFSOutputStr=
eam.java:455)=0A=A0=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=
=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=
=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=
=0A=A0=0AAny ideas about this issue ? Also , I tried to used following comm=
and=0A=A0=0Asbin/stop-dfs.sh=0Aand got issues of =0A=3D=3D=3D=3D=3D=3D=3D=
=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=
=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=
=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=0AStopping namenodes on [localhost]=0Aloc=
alhost: stopping namenode=0Acat: /home/hai/hadoop-common/hadoop-dist/target=
/hadoop-0.24.0-SNAPSHOT/conf//slaves: No such file or directory=0ASecondary=
namenodes are not configured.=A0 Cannot stop secondary namenodes.=0A=3D=3D=
=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=
=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=
=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=0A=A0=0AAnyway, the doc in=
the http://hadoop.apache.org/common/docs/stable/single_node_setup.html=A0l=
ooks like out-of-date since the command "$sbin/start-all.sh" reported "This=
script is Deprecated. Instead use start-dfs.sh and start-mapred.sh "=0A=A0=
=0A=A0=0AThanks,=0A=A0=0AHai
From common-dev-return-77622-apmail-hadoop-common-dev-archive=hadoop.apache.org@hadoop.apache.org Mon Feb 6 03:30:18 2012
Return-Path: <common-dev-return-77622-apmail-hadoop-common-dev-archive=hadoop.apache.org@hadoop.apache.org>
X-Original-To: apmail-hadoop-common-dev-archive@www.apache.org
Delivered-To: apmail-hadoop-common-dev-archive@www.apache.org
Received: from mail.apache.org (hermes.apache.org [140.211.11.3])
by minotaur.apache.org (Postfix) with SMTP id AF7A1919F
for <apmail-hadoop-common-dev-archive@www.apache.org>; Mon, 6 Feb 2012 03:30:18 +0000 (UTC)
Received: (qmail 21535 invoked by uid 500); 6 Feb 2012 03:30:15 -0000
Delivered-To: apmail-hadoop-common-dev-archive@hadoop.apache.org
Received: (qmail 21014 invoked by uid 500); 6 Feb 2012 03:30:04 -0000
Mailing-List: contact common-dev-help@hadoop.apache.org; run by ezmlm
Precedence: bulk
List-Help: <mailto:common-dev-help@hadoop.apache.org>
List-Unsubscribe: <mailto:common-dev-unsubscribe@hadoop.apache.org>
List-Post: <mailto:common-dev@hadoop.apache.org>
List-Id: <common-dev.hadoop.apache.org>
Reply-To: common-dev@hadoop.apache.org
Delivered-To: mailing list common-dev@hadoop.apache.org
Received: (qmail 21006 invoked by uid 99); 6 Feb 2012 03:30:00 -0000
Received: from athena.apache.org (HELO athena.apache.org) (140.211.11.136)
by apache.org (qpsmtpd/0.29) with ESMTP; Mon, 06 Feb 2012 03:30:00 +0000
X-ASF-Spam-Status: No, hits=2.5 required=5.0
tests=FREEMAIL_REPLY,HTML_MESSAGE,RCVD_IN_DNSWL_LOW,SPF_PASS
X-Spam-Check-By: apache.org
Received-SPF: pass (athena.apache.org: domain of mundlapudi@gmail.com designates 209.85.220.176 as permitted sender)
Received: from [209.85.220.176] (HELO mail-vx0-f176.google.com) (209.85.220.176)
by apache.org (qpsmtpd/0.29) with ESMTP; Mon, 06 Feb 2012 03:29:55 +0000
Received: by vcbfl13 with SMTP id fl13so5298714vcb.35
for <common-dev@hadoop.apache.org>; Sun, 05 Feb 2012 19:29:34 -0800 (PST)
DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed;
d=gmail.com; s=gamma;
h=mime-version:in-reply-to:references:date:message-id:subject:from:to
:content-type;
bh=Fal6+jI3H2yWXGj20NW2aFvSIPd2mdzwUanHJvxXRqA=;
b=IuIAF9rN35Uvn3b8lFAdb6bntIJSvWKL6PcmEFhl9ww67JvjDZrMkIViIayep8+ETO
76QVqfOkWit+FQzmMC8uBcv8w4I0O009hjYaMGyIp6BFRtpXJDYtK41X9aT7Y1JPJqyf
gwJ1baH3W5Qoo7rFggSdoUngrowCuN5vIAW24=
MIME-Version: 1.0
Received: by 10.52.68.241 with SMTP id z17mr1871001vdt.97.1328498974444; Sun,
05 Feb 2012 19:29:34 -0800 (PST)
Received: by 10.220.199.9 with HTTP; Sun, 5 Feb 2012 19:29:34 -0800 (PST)
In-Reply-To: <CB51719B.33A2D%evans@yahoo-inc.com>
References: <CANc9RnLwj67NEvqHD4MPHC1SOmfD5XYQidxcjCA2YcE9k15RPA@mail.gmail.com>
<CB51719B.33A2D%evans@yahoo-inc.com>
Date: Sun, 5 Feb 2012 19:29:34 -0800
Message-ID: <CAAUf7F5pPJZzS4s4aeVosadOEhkH49GO3DVLv=XGLpcsq8KmZQ@mail.gmail.com>
Subject: Re: Execute a Map/Reduce Job Jar from Another Java Program.
From: Bharath Mundlapudi <mundlapudi@gmail.com>
To: common-dev@hadoop.apache.org
Content-Type: multipart/alternative; boundary=20cf3079b81674cc2504b84345c3
--20cf3079b81674cc2504b84345c3
Content-Type: text/plain; charset=ISO-8859-1
Essentially, there are two ways to achieve the functionality you need.
1. By forking your MR job from your java application as Evans suggested.
Look at java APIs for Runtime.exec or ProcessBuilder.
2. In your java application, you write the complete main method of your
test.jar - which will have your input/output format, paths etc etc. Here,
you will be using MR APIs directly. You can use runJob/submitJob to run
your job.
-Bharath
On Fri, Feb 3, 2012 at 9:12 AM, Robert Evans <evans@yahoo-inc.com> wrote:
> It looks like there is something wrong with your configuration where the
> default file system is coming back as the local file system, but you are
> passing in an HDFS URI fs.exists(Path), I cannot tell for sure because I
> don't have access to
> com.amd.kdf.protobuf.SequentialFileDriver.main(SequentialFileDriver.java:64).
>
> If running it works just fine from the command line, you could try doing a
> fork/exec to launch the process and then monitor it.
>
> --Bobby Evans
>
> On 2/2/12 11:31 PM, "Abees Muhammad" <abees.pm@gmail.com> wrote:
>
> Hi Evans,
>
> Thanks for your reply. I have a mapreduce job jar file lets call it as
> test.jar. I am executing this jar file as hadoop jar test.jar inputpath
> outPath, and it is executed succesfully. Now i want to execute this job for
> a batch of files(a batch of 20 files), for this purpose i have created
> another java application,this application moves a batch of files from one
> location of hdfs to another location in hdfs. After that this application
> needs to execute the m/R job for this batch. we will invoke the second
> application(which will execute the M/R Job) from as control m job.But i
> dont know how to create the second java application which will invoke the
> M/R job. The code snippet i used for testing the jar which calls the M/R
> job is
>
> List arguments = new ArrayList();
> arguments.add("test.jar");
> arguments.add("inputPath");
> arguments.add(outputPath);
> RunJar.main((String[])arguments.toArray(new String[0]));
>
> i executed this jar as java -jar M/RJobInvokeApp.jar but i got error as
>
> java.lang.IllegalArgumentException: Wrong FS: hdfs://ip
> address:54310/tmp/test-out, expected: file:///
> at org.apache.hadoop.fs.FileSystem.checkPath(FileSystem.java:410)
> at
> org.apache.hadoop.fs.RawLocalFileSystem.pathToFile(RawLocalFileSystem.java:56)
> at
> org.apache.hadoop.fs.RawLocalFileSystem.getFileStatus(RawLocalFileSystem.java:379)
> at
> org.apache.hadoop.fs.FilterFileSystem.getFileStatus(FilterFileSystem.java:251)
> at org.apache.hadoop.fs.FileSystem.exists(FileSystem.java:748)
> at
> com.amd.kdf.protobuf.SequentialFileDriver.main(SequentialFileDriver.java:64)
> at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
> at
> sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39)
> at
> sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
> at java.lang.reflect.Method.invoke(Method.java:597)
> at org.apache.hadoop.util.RunJar.main(RunJar.java:186)
> at com.amd.wrapper.main.ParserWrapper.main(ParserWrapper.java:31)
>
>
>
>
>
>
> Thanks,
> Abees
>
> On 2 February 2012 23:02, Robert Evans <evans@yahoo-inc.com> wrote:
> What happens? Is there an exception, does nothing happen? I am curious.
> Also how did you launch your other job that is trying to run this one.
> The hadoop script sets up a lot of environment variables classpath etc to
> make hadoop work properly, and some of that may not be set up correctly to
> make RunJar work.
>
> --Bobby Evans
>
>
> On 2/2/12 9:36 AM, "Harsh J" <harsh@cloudera.com <
> http://harsh@cloudera.com> > wrote:
>
> Moving to common-user. Common-dev is for project development
> discussions, not user help.
>
> Could you elaborate on how you used RunJar? What arguments did you
> provide, and is the target jar a runnable one or a regular jar? What
> error did you get?
>
> On Thu, Feb 2, 2012 at 8:44 PM, abees muhammad <abees.pm@gmail.com <
> http://abees.pm@gmail.com> > wrote:
> >
> > Hi,
> >
> > I am a newbie to Hadoop Development. I have a Map/Reduce job jar file, i
> > want to execute this jar file programmatically from another java
> program. I
> > used the following code to execute it.
> >
> > RunJar.main(String[] args). But The jar file is not executed.
> >
> > Can you please give me a work around for this issue.
> > --
> > View this message in context:
> http://old.nabble.com/Execute-a-Map-Reduce-Job-Jar-from-Another-Java-Program.-tp33250801p33250801.html
> > Sent from the Hadoop core-dev mailing list archive at Nabble.com.
> >
>
>
>
> --
> Harsh J
> Customer Ops. Engineer
> Cloudera | http://tiny.cloudera.com/about
>
>
>
>
--20cf3079b81674cc2504b84345c3--
From common-dev-return-77623-apmail-hadoop-common-dev-archive=hadoop.apache.org@hadoop.apache.org Mon Feb 6 13:36:07 2012
Return-Path: <common-dev-return-77623-apmail-hadoop-common-dev-archive=hadoop.apache.org@hadoop.apache.org>
X-Original-To: apmail-hadoop-common-dev-archive@www.apache.org
Delivered-To: apmail-hadoop-common-dev-archive@www.apache.org
Received: from mail.apache.org (hermes.apache.org [140.211.11.3])
by minotaur.apache.org (Postfix) with SMTP id BA0B9908A
for <apmail-hadoop-common-dev-archive@www.apache.org>; Mon, 6 Feb 2012 13:36:07 +0000 (UTC)
Received: (qmail 35131 invoked by uid 500); 6 Feb 2012 13:36:06 -0000
Delivered-To: apmail-hadoop-common-dev-archive@hadoop.apache.org
Received: (qmail 35003 invoked by uid 500); 6 Feb 2012 13:36:04 -0000
Mailing-List: contact common-dev-help@hadoop.apache.org; run by ezmlm
Precedence: bulk
List-Help: <mailto:common-dev-help@hadoop.apache.org>
List-Unsubscribe: <mailto:common-dev-unsubscribe@hadoop.apache.org>
List-Post: <mailto:common-dev@hadoop.apache.org>
List-Id: <common-dev.hadoop.apache.org>
Reply-To: common-dev@hadoop.apache.org
Delivered-To: mailing list common-dev@hadoop.apache.org
Received: (qmail 34995 invoked by uid 99); 6 Feb 2012 13:36:04 -0000
Received: from nike.apache.org (HELO nike.apache.org) (192.87.106.230)
by apache.org (qpsmtpd/0.29) with ESMTP; Mon, 06 Feb 2012 13:36:04 +0000
X-ASF-Spam-Status: No, hits=1.5 required=5.0
tests=HTML_MESSAGE,RCVD_IN_DNSWL_LOW,SPF_PASS
X-Spam-Check-By: apache.org
Received-SPF: pass (nike.apache.org: domain of sysolve@gmail.com designates 209.85.214.48 as permitted sender)
Received: from [209.85.214.48] (HELO mail-bk0-f48.google.com) (209.85.214.48)
by apache.org (qpsmtpd/0.29) with ESMTP; Mon, 06 Feb 2012 13:35:56 +0000
Received: by bkbzt19 with SMTP id zt19so6810495bkb.35
for <common-dev@hadoop.apache.org>; Mon, 06 Feb 2012 05:35:36 -0800 (PST)
DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed;
d=gmail.com; s=gamma;
h=mime-version:in-reply-to:references:date:message-id:subject:from:to
:content-type;
bh=qzKYV0BtEB2i89jK//faDIjAfImAvWD7BbnxZv0fwwo=;
b=x6H/0sVB+CIkjPKcFQkV7/BMA7Qehh/omrGXA6Q0twlJhmGWPxGU95YzDCHf0QVdqb
oMSADyvLBCaKxns3Ax0q4QVHz9qgQA2tkMlYDezeJjnEHKN8TyQrTMkCRHIhjU+UhLcH
3CBw3qhDZq9/rrkpICTBj6uDFLr7vuzzYAifI=
MIME-Version: 1.0
Received: by 10.204.154.211 with SMTP id p19mr8652426bkw.130.1328535336592;
Mon, 06 Feb 2012 05:35:36 -0800 (PST)
Received: by 10.205.25.7 with HTTP; Mon, 6 Feb 2012 05:35:36 -0800 (PST)
In-Reply-To: <CAD7nt4gybooqripXK4oPH3ByFPBfEAKUtN1TFR8HwdvCH8OmKA@mail.gmail.com>
References: <CAD7nt4gybooqripXK4oPH3ByFPBfEAKUtN1TFR8HwdvCH8OmKA@mail.gmail.com>
Date: Mon, 6 Feb 2012 21:35:36 +0800
Message-ID: <CAD7nt4gjLdbDzjcdAZ8YZjige9q3OkXhzHc+4VQ0ObdGW7KqRw@mail.gmail.com>
Subject: 2 Failures in unit test of Hadoop 1.0.0 version
From: Grace <sysolve@gmail.com>
To: common-dev@hadoop.apache.org
Content-Type: multipart/alternative; boundary=0015175cd130cf245704b84bbc81
X-Virus-Checked: Checked by ClamAV on apache.org
--0015175cd130cf245704b84bbc81
Content-Type: text/plain; charset=ISO-8859-1
Hi all,
Downloading the release version Hadoop 1.0.0. from the apache web site.
After several hours' test period(by executing "ant test"), I found there
are totally 2 failures in TestCLI and TestSaslRPC cases respectively. I
wonder if there is any missing steps for me. Is there someone having the
same problem? could you please help me with it?
Thanks a lot for your time.
-Grace
--0015175cd130cf245704b84bbc81--
From common-dev-return-77624-apmail-hadoop-common-dev-archive=hadoop.apache.org@hadoop.apache.org Mon Feb 6 13:54:30 2012
Return-Path: <common-dev-return-77624-apmail-hadoop-common-dev-archive=hadoop.apache.org@hadoop.apache.org>
X-Original-To: apmail-hadoop-common-dev-archive@www.apache.org
Delivered-To: apmail-hadoop-common-dev-archive@www.apache.org
Received: from mail.apache.org (hermes.apache.org [140.211.11.3])
by minotaur.apache.org (Postfix) with SMTP id 19D639B98
for <apmail-hadoop-common-dev-archive@www.apache.org>; Mon, 6 Feb 2012 13:54:30 +0000 (UTC)
Received: (qmail 74442 invoked by uid 500); 6 Feb 2012 13:54:28 -0000
Delivered-To: apmail-hadoop-common-dev-archive@hadoop.apache.org
Received: (qmail 74341 invoked by uid 500); 6 Feb 2012 13:54:27 -0000
Mailing-List: contact common-dev-help@hadoop.apache.org; run by ezmlm
Precedence: bulk
List-Help: <mailto:common-dev-help@hadoop.apache.org>
List-Unsubscribe: <mailto:common-dev-unsubscribe@hadoop.apache.org>
List-Post: <mailto:common-dev@hadoop.apache.org>
List-Id: <common-dev.hadoop.apache.org>
Reply-To: common-dev@hadoop.apache.org
Delivered-To: mailing list common-dev@hadoop.apache.org
Received: (qmail 74089 invoked by uid 99); 6 Feb 2012 13:54:25 -0000
Received: from nike.apache.org (HELO nike.apache.org) (192.87.106.230)
by apache.org (qpsmtpd/0.29) with ESMTP; Mon, 06 Feb 2012 13:54:25 +0000
X-ASF-Spam-Status: No, hits=1.5 required=5.0
tests=HTML_MESSAGE,RCVD_IN_DNSWL_LOW,SPF_PASS
X-Spam-Check-By: apache.org
Received-SPF: pass (nike.apache.org: domain of sysolve@gmail.com designates 209.85.214.48 as permitted sender)
Received: from [209.85.214.48] (HELO mail-bk0-f48.google.com) (209.85.214.48)
by apache.org (qpsmtpd/0.29) with ESMTP; Mon, 06 Feb 2012 13:54:17 +0000
Received: by bkbzt19 with SMTP id zt19so6831144bkb.35
for <common-dev@hadoop.apache.org>; Mon, 06 Feb 2012 05:53:57 -0800 (PST)
DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed;
d=gmail.com; s=gamma;
h=mime-version:in-reply-to:references:date:message-id:subject:from:to
:content-type;
bh=/T4Hx6BW5JknV2S57k26vV7HLIWtVH/gVKsnrE82bnI=;
b=O88h0qkJtzCpf4kekJQZCZD8bD1OFkG4oZL28YKj4UX7kxZ9inzYnp53rOuc1Xc4JP
KfTrj4Jsg1dvT83xttqxRE57RR0OFdS9exvFNe9y5Gg5j7drovs2CKTcUyPHUoxNS9Xx
zIBVM386WRCgE76/1re0d522MmRASnVsveNog=
MIME-Version: 1.0
Received: by 10.204.154.211 with SMTP id p19mr8683825bkw.130.1328536437612;
Mon, 06 Feb 2012 05:53:57 -0800 (PST)
Received: by 10.205.25.7 with HTTP; Mon, 6 Feb 2012 05:53:57 -0800 (PST)
In-Reply-To: <CAD7nt4gjLdbDzjcdAZ8YZjige9q3OkXhzHc+4VQ0ObdGW7KqRw@mail.gmail.com>
References: <CAD7nt4gybooqripXK4oPH3ByFPBfEAKUtN1TFR8HwdvCH8OmKA@mail.gmail.com>
<CAD7nt4gjLdbDzjcdAZ8YZjige9q3OkXhzHc+4VQ0ObdGW7KqRw@mail.gmail.com>
Date: Mon, 6 Feb 2012 21:53:57 +0800
Message-ID: <CAD7nt4iCKLK2Jdw3FRscUeHU+_2=NhOgNvS=6BOybnBSaxH+Ww@mail.gmail.com>
Subject: Re: 2 Failures in unit test of Hadoop 1.0.0 version
From: Grace <sysolve@gmail.com>
To: common-dev@hadoop.apache.org
Content-Type: multipart/alternative; boundary=0015175cd1306f5faa04b84bfeb7
X-Virus-Checked: Checked by ClamAV on apache.org
--0015175cd1306f5faa04b84bfeb7
Content-Type: text/plain; charset=ISO-8859-1
Found one of the problem(TestCLI) . The user name
contains uppercase alphabet, which causes the parts of the RegexpComparator
failed.
On Mon, Feb 6, 2012 at 9:35 PM, Grace <sysolve@gmail.com> wrote:
> Hi all,
>
> Downloading the release version Hadoop 1.0.0. from the apache web site.
> After several hours' test period(by executing "ant test"), I found there
> are totally 2 failures in TestCLI and TestSaslRPC cases respectively. I
> wonder if there is any missing steps for me. Is there someone having the
> same problem? could you please help me with it?
>
> Thanks a lot for your time.
>
> -Grace
>
>
--0015175cd1306f5faa04b84bfeb7--
From common-dev-return-77625-apmail-hadoop-common-dev-archive=hadoop.apache.org@hadoop.apache.org Mon Feb 6 14:13:33 2012
Return-Path: <common-dev-return-77625-apmail-hadoop-common-dev-archive=hadoop.apache.org@hadoop.apache.org>
X-Original-To: apmail-hadoop-common-dev-archive@www.apache.org
Delivered-To: apmail-hadoop-common-dev-archive@www.apache.org
Received: from mail.apache.org (hermes.apache.org [140.211.11.3])
by minotaur.apache.org (Postfix) with SMTP id 2A8689681
for <apmail-hadoop-common-dev-archive@www.apache.org>; Mon, 6 Feb 2012 14:13:33 +0000 (UTC)
Received: (qmail 19010 invoked by uid 500); 6 Feb 2012 14:13:31 -0000
Delivered-To: apmail-hadoop-common-dev-archive@hadoop.apache.org
Received: (qmail 18913 invoked by uid 500); 6 Feb 2012 14:13:30 -0000
Mailing-List: contact common-dev-help@hadoop.apache.org; run by ezmlm
Precedence: bulk
List-Help: <mailto:common-dev-help@hadoop.apache.org>
List-Unsubscribe: <mailto:common-dev-unsubscribe@hadoop.apache.org>
List-Post: <mailto:common-dev@hadoop.apache.org>
List-Id: <common-dev.hadoop.apache.org>
Reply-To: common-dev@hadoop.apache.org
Delivered-To: mailing list common-dev@hadoop.apache.org
Received: (qmail 18905 invoked by uid 99); 6 Feb 2012 14:13:30 -0000
Received: from nike.apache.org (HELO nike.apache.org) (192.87.106.230)
by apache.org (qpsmtpd/0.29) with ESMTP; Mon, 06 Feb 2012 14:13:30 +0000
X-ASF-Spam-Status: No, hits=1.5 required=5.0
tests=HTML_MESSAGE,RCVD_IN_DNSWL_LOW,SPF_PASS
X-Spam-Check-By: apache.org
Received-SPF: pass (nike.apache.org: domain of sysolve@gmail.com designates 209.85.214.48 as permitted sender)
Received: from [209.85.214.48] (HELO mail-bk0-f48.google.com) (209.85.214.48)
by apache.org (qpsmtpd/0.29) with ESMTP; Mon, 06 Feb 2012 14:13:22 +0000
Received: by bkbzt19 with SMTP id zt19so6854608bkb.35
for <common-dev@hadoop.apache.org>; Mon, 06 Feb 2012 06:13:02 -0800 (PST)
DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed;
d=gmail.com; s=gamma;
h=mime-version:in-reply-to:references:date:message-id:subject:from:to
:content-type;
bh=Yo8BEeYaQgvL5EZePirnzwpPhtXwv6aoTIglc1iHmwQ=;
b=OHLlA++ufHG+v6quy71QeVgc4IAPL7z2LgYf2A9EZgQWaE7xt8NNMFWcMk7T2uNRdN
JmvsIcMo2zAryVBWACmt812yXcMKwKz/6LxijZNDWuTgD9IIuiXOSH5S9r3DVy0G7Rk/
Ts4hTOJJD0njPqCMPYrNV0aV8ctWaHPtlJnD0=
MIME-Version: 1.0
Received: by 10.205.133.133 with SMTP id hy5mr8790468bkc.94.1328537582162;
Mon, 06 Feb 2012 06:13:02 -0800 (PST)
Received: by 10.205.25.7 with HTTP; Mon, 6 Feb 2012 06:13:02 -0800 (PST)
In-Reply-To: <CAD7nt4iCKLK2Jdw3FRscUeHU+_2=NhOgNvS=6BOybnBSaxH+Ww@mail.gmail.com>
References: <CAD7nt4gybooqripXK4oPH3ByFPBfEAKUtN1TFR8HwdvCH8OmKA@mail.gmail.com>
<CAD7nt4gjLdbDzjcdAZ8YZjige9q3OkXhzHc+4VQ0ObdGW7KqRw@mail.gmail.com>
<CAD7nt4iCKLK2Jdw3FRscUeHU+_2=NhOgNvS=6BOybnBSaxH+Ww@mail.gmail.com>
Date: Mon, 6 Feb 2012 22:13:02 +0800
Message-ID: <CAD7nt4gPUKPO0e+=rBr8d5enapE_Jw+v6EKg+rFHMo=wfz=2bw@mail.gmail.com>
Subject: Re: 2 Failures in unit test of Hadoop 1.0.0 version
From: Grace <sysolve@gmail.com>
To: common-dev@hadoop.apache.org
Content-Type: multipart/alternative; boundary=000e0ce0391ea7d46404b84c4210
X-Virus-Checked: Checked by ClamAV on apache.org
--000e0ce0391ea7d46404b84c4210
Content-Type: text/plain; charset=ISO-8859-1
The root cause for another one has been found as well. To map 127.0.0.1
with localhost instead of localhost.localdomain(which is set in the OS by
default).
Now, all the unit tests have passed already. No more question. thanks
On Mon, Feb 6, 2012 at 9:53 PM, Grace <sysolve@gmail.com> wrote:
> Found one of the problem(TestCLI) . The user name
> contains uppercase alphabet, which causes the parts of the RegexpComparator
> failed.
>
>
> On Mon, Feb 6, 2012 at 9:35 PM, Grace <sysolve@gmail.com> wrote:
>
>> Hi all,
>>
>> Downloading the release version Hadoop 1.0.0. from the apache web site.
>> After several hours' test period(by executing "ant test"), I found there
>> are totally 2 failures in TestCLI and TestSaslRPC cases respectively. I
>> wonder if there is any missing steps for me. Is there someone having the
>> same problem? could you please help me with it?
>>
>> Thanks a lot for your time.
>>
>> -Grace
>>
>>
>
--000e0ce0391ea7d46404b84c4210--
From common-dev-return-77626-apmail-hadoop-common-dev-archive=hadoop.apache.org@hadoop.apache.org Mon Feb 6 16:26:27 2012
Return-Path: <common-dev-return-77626-apmail-hadoop-common-dev-archive=hadoop.apache.org@hadoop.apache.org>
X-Original-To: apmail-hadoop-common-dev-archive@www.apache.org
Delivered-To: apmail-hadoop-common-dev-archive@www.apache.org
Received: from mail.apache.org (hermes.apache.org [140.211.11.3])
by minotaur.apache.org (Postfix) with SMTP id 35EBF9D2C
for <apmail-hadoop-common-dev-archive@www.apache.org>; Mon, 6 Feb 2012 16:26:27 +0000 (UTC)
Received: (qmail 98708 invoked by uid 500); 6 Feb 2012 16:26:24 -0000
Delivered-To: apmail-hadoop-common-dev-archive@hadoop.apache.org
Received: (qmail 97945 invoked by uid 500); 6 Feb 2012 16:26:22 -0000
Mailing-List: contact common-dev-help@hadoop.apache.org; run by ezmlm
Precedence: bulk
List-Help: <mailto:common-dev-help@hadoop.apache.org>
List-Unsubscribe: <mailto:common-dev-unsubscribe@hadoop.apache.org>
List-Post: <mailto:common-dev@hadoop.apache.org>
List-Id: <common-dev.hadoop.apache.org>
Reply-To: common-dev@hadoop.apache.org
Delivered-To: mailing list common-dev@hadoop.apache.org
Received: (qmail 97936 invoked by uid 99); 6 Feb 2012 16:26:22 -0000
Received: from nike.apache.org (HELO nike.apache.org) (192.87.106.230)
by apache.org (qpsmtpd/0.29) with ESMTP; Mon, 06 Feb 2012 16:26:22 +0000
X-ASF-Spam-Status: No, hits=-2000.0 required=5.0
tests=ALL_TRUSTED,T_RP_MATCHES_RCVD
X-Spam-Check-By: apache.org
Received: from [140.211.11.116] (HELO hel.zones.apache.org) (140.211.11.116)
by apache.org (qpsmtpd/0.29) with ESMTP; Mon, 06 Feb 2012 16:26:20 +0000
Received: from hel.zones.apache.org (hel.zones.apache.org [140.211.11.116])
by hel.zones.apache.org (Postfix) with ESMTP id 4A645CB13C
for <common-dev@hadoop.apache.org>; Mon, 6 Feb 2012 16:25:59 +0000 (UTC)
Date: Mon, 6 Feb 2012 16:25:59 +0000 (UTC)
From: "Anupam Seth (Resolved) (JIRA)" <jira@apache.org>
To: common-dev@hadoop.apache.org
Message-ID: <654322091.2466.1328545559306.JavaMail.tomcat@hel.zones.apache.org>
In-Reply-To: <346625560.9169.1328305493586.JavaMail.tomcat@hel.zones.apache.org>
Subject: [jira] [Resolved] (HADOOP-8021) Hadoop ignores old-style config
options for enabling compressed output when passed on from PIG
MIME-Version: 1.0
Content-Type: text/plain; charset=utf-8
Content-Transfer-Encoding: 7bit
X-JIRA-FingerPrint: 30527f35849b9dde25b450d4833f0394
X-Virus-Checked: Checked by ClamAV on apache.org
[ https://issues.apache.org/jira/browse/HADOOP-8021?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Anupam Seth resolved HADOOP-8021.
---------------------------------
Resolution: Duplicate
> Hadoop ignores old-style config options for enabling compressed output when passed on from PIG
> ----------------------------------------------------------------------------------------------
>
> Key: HADOOP-8021
> URL: https://issues.apache.org/jira/browse/HADOOP-8021
> Project: Hadoop Common
> Issue Type: Bug
> Components: conf
> Affects Versions: 0.23.1
> Reporter: Anupam Seth
> Assignee: Anupam Seth
> Fix For: 0.23.1
>
>
> Hadoop seems to ignore the config options even though they are printed as deprecation warnings in the log: mapred.output.compress and
> mapred.output.compression.codec
> - settings that work on 0.20 but not on 0.23
> mapred.output.compress=true
> mapred.output.compression.codec=org.apache.hadoop.io.compress.BZip2Codec
> - settings that work on 0.23
> mapreduce.output.fileoutputformat.compress=true
> mapreduce.output.fileoutputformat.compress.codec=org.apache.hadoop.io.compress.BZip2Codec
> This breaks backwards compatibility and causes existing jobs to fail.
> This is different from HADOOP-7993 in that that one fixes any jobs run from the CLI but PIG jobs are still facing this issue.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
From common-dev-return-77627-apmail-hadoop-common-dev-archive=hadoop.apache.org@hadoop.apache.org Mon Feb 6 21:35:26 2012
Return-Path: <common-dev-return-77627-apmail-hadoop-common-dev-archive=hadoop.apache.org@hadoop.apache.org>
X-Original-To: apmail-hadoop-common-dev-archive@www.apache.org
Delivered-To: apmail-hadoop-common-dev-archive@www.apache.org
Received: from mail.apache.org (hermes.apache.org [140.211.11.3])
by minotaur.apache.org (Postfix) with SMTP id F1B879FFB
for <apmail-hadoop-common-dev-archive@www.apache.org>; Mon, 6 Feb 2012 21:35:25 +0000 (UTC)
Received: (qmail 67535 invoked by uid 500); 6 Feb 2012 21:35:24 -0000
Delivered-To: apmail-hadoop-common-dev-archive@hadoop.apache.org
Received: (qmail 67126 invoked by uid 500); 6 Feb 2012 21:35:23 -0000
Mailing-List: contact common-dev-help@hadoop.apache.org; run by ezmlm
Precedence: bulk
List-Help: <mailto:common-dev-help@hadoop.apache.org>
List-Unsubscribe: <mailto:common-dev-unsubscribe@hadoop.apache.org>
List-Post: <mailto:common-dev@hadoop.apache.org>
List-Id: <common-dev.hadoop.apache.org>
Reply-To: common-dev@hadoop.apache.org
Delivered-To: mailing list common-dev@hadoop.apache.org
Received: (qmail 67107 invoked by uid 99); 6 Feb 2012 21:35:22 -0000
Received: from nike.apache.org (HELO nike.apache.org) (192.87.106.230)
by apache.org (qpsmtpd/0.29) with ESMTP; Mon, 06 Feb 2012 21:35:22 +0000
X-ASF-Spam-Status: No, hits=-2000.0 required=5.0
tests=ALL_TRUSTED,T_RP_MATCHES_RCVD
X-Spam-Check-By: apache.org
Received: from [140.211.11.116] (HELO hel.zones.apache.org) (140.211.11.116)
by apache.org (qpsmtpd/0.29) with ESMTP; Mon, 06 Feb 2012 21:35:20 +0000
Received: from hel.zones.apache.org (hel.zones.apache.org [140.211.11.116])
by hel.zones.apache.org (Postfix) with ESMTP id C7730CCF86
for <common-dev@hadoop.apache.org>; Mon, 6 Feb 2012 21:34:59 +0000 (UTC)
Date: Mon, 6 Feb 2012 21:34:59 +0000 (UTC)
From: "Robert Joseph Evans (Resolved) (JIRA)" <jira@apache.org>
To: common-dev@hadoop.apache.org
Message-ID: <1752529120.3904.1328564099818.JavaMail.tomcat@hel.zones.apache.org>
In-Reply-To: <1954564001.7137.1328272314599.JavaMail.tomcat@hel.zones.apache.org>
Subject: [jira] [Resolved] (HADOOP-8017) Configure hadoop-main pom to get
rid of M2E plugin execution not covered
MIME-Version: 1.0
Content-Type: text/plain; charset=utf-8
Content-Transfer-Encoding: 7bit
X-JIRA-FingerPrint: 30527f35849b9dde25b450d4833f0394
X-Virus-Checked: Checked by ClamAV on apache.org
[ https://issues.apache.org/jira/browse/HADOOP-8017?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Robert Joseph Evans resolved HADOOP-8017.
-----------------------------------------
Resolution: Fixed
Fix Version/s: 0.24.0
> Configure hadoop-main pom to get rid of M2E plugin execution not covered
> ------------------------------------------------------------------------
>
> Key: HADOOP-8017
> URL: https://issues.apache.org/jira/browse/HADOOP-8017
> Project: Hadoop Common
> Issue Type: Improvement
> Components: build
> Affects Versions: 0.24.0
> Reporter: Eric Charles
> Fix For: 0.24.0
>
> Attachments: HADOOP-8017.patch
>
>
> Last M2Eclipse plugin (maven plugin for eclipse) shows nasty errors when importing the hadoop maven modules (read more on http://wiki.eclipse.org/M2E_plugin_execution_not_covered).
> The solution is to configure the build section of the pom with a org.eclipse.m2e:lifecycle-mapping plugin.
> This configuration has no influence on the Maven build itself.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
From common-dev-return-77628-apmail-hadoop-common-dev-archive=hadoop.apache.org@hadoop.apache.org Mon Feb 6 23:05:29 2012
Return-Path: <common-dev-return-77628-apmail-hadoop-common-dev-archive=hadoop.apache.org@hadoop.apache.org>
X-Original-To: apmail-hadoop-common-dev-archive@www.apache.org
Delivered-To: apmail-hadoop-common-dev-archive@www.apache.org
Received: from mail.apache.org (hermes.apache.org [140.211.11.3])
by minotaur.apache.org (Postfix) with SMTP id EEBDC9546
for <apmail-hadoop-common-dev-archive@www.apache.org>; Mon, 6 Feb 2012 23:05:29 +0000 (UTC)
Received: (qmail 32835 invoked by uid 500); 6 Feb 2012 23:05:28 -0000
Delivered-To: apmail-hadoop-common-dev-archive@hadoop.apache.org
Received: (qmail 32696 invoked by uid 500); 6 Feb 2012 23:05:27 -0000
Mailing-List: contact common-dev-help@hadoop.apache.org; run by ezmlm
Precedence: bulk
List-Help: <mailto:common-dev-help@hadoop.apache.org>
List-Unsubscribe: <mailto:common-dev-unsubscribe@hadoop.apache.org>
List-Post: <mailto:common-dev@hadoop.apache.org>
List-Id: <common-dev.hadoop.apache.org>
Reply-To: common-dev@hadoop.apache.org
Delivered-To: mailing list common-dev@hadoop.apache.org
Received: (qmail 32687 invoked by uid 99); 6 Feb 2012 23:05:26 -0000
Received: from nike.apache.org (HELO nike.apache.org) (192.87.106.230)
by apache.org (qpsmtpd/0.29) with ESMTP; Mon, 06 Feb 2012 23:05:26 +0000
X-ASF-Spam-Status: No, hits=-2000.0 required=5.0
tests=ALL_TRUSTED,T_RP_MATCHES_RCVD
X-Spam-Check-By: apache.org
Received: from [140.211.11.116] (HELO hel.zones.apache.org) (140.211.11.116)
by apache.org (qpsmtpd/0.29) with ESMTP; Mon, 06 Feb 2012 23:05:24 +0000
Received: from hel.zones.apache.org (hel.zones.apache.org [140.211.11.116])
by hel.zones.apache.org (Postfix) with ESMTP id 83C08CC74E
for <common-dev@hadoop.apache.org>; Mon, 6 Feb 2012 23:05:03 +0000 (UTC)
Date: Mon, 6 Feb 2012 23:05:03 +0000 (UTC)
From: "Allen Wittenauer (Created) (JIRA)" <jira@apache.org>
To: common-dev@hadoop.apache.org
Message-ID: <1773051224.4732.1328569503541.JavaMail.tomcat@hel.zones.apache.org>
Subject: [jira] [Created] (HADOOP-8025) change default distcp log location
to be /tmp rather than cwd
MIME-Version: 1.0
Content-Type: text/plain; charset=utf-8
Content-Transfer-Encoding: 7bit
X-JIRA-FingerPrint: 30527f35849b9dde25b450d4833f0394
X-Virus-Checked: Checked by ClamAV on apache.org
change default distcp log location to be /tmp rather than cwd
-------------------------------------------------------------
Key: HADOOP-8025
URL: https://issues.apache.org/jira/browse/HADOOP-8025
Project: Hadoop Common
Issue Type: Improvement
Affects Versions: 1.0.0
Reporter: Allen Wittenauer
Priority: Trivial
distcp loves to leave emtpy files around. this puts them in /tmp so at least they are easy to find and kill.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
From common-dev-return-77629-apmail-hadoop-common-dev-archive=hadoop.apache.org@hadoop.apache.org Mon Feb 6 23:23:24 2012
Return-Path: <common-dev-return-77629-apmail-hadoop-common-dev-archive=hadoop.apache.org@hadoop.apache.org>
X-Original-To: apmail-hadoop-common-dev-archive@www.apache.org
Delivered-To: apmail-hadoop-common-dev-archive@www.apache.org
Received: from mail.apache.org (hermes.apache.org [140.211.11.3])
by minotaur.apache.org (Postfix) with SMTP id 35CDA9E4E
for <apmail-hadoop-common-dev-archive@www.apache.org>; Mon, 6 Feb 2012 23:23:24 +0000 (UTC)
Received: (qmail 67905 invoked by uid 500); 6 Feb 2012 23:23:22 -0000
Delivered-To: apmail-hadoop-common-dev-archive@hadoop.apache.org
Received: (qmail 67482 invoked by uid 500); 6 Feb 2012 23:23:20 -0000
Mailing-List: contact common-dev-help@hadoop.apache.org; run by ezmlm
Precedence: bulk
List-Help: <mailto:common-dev-help@hadoop.apache.org>
List-Unsubscribe: <mailto:common-dev-unsubscribe@hadoop.apache.org>
List-Post: <mailto:common-dev@hadoop.apache.org>
List-Id: <common-dev.hadoop.apache.org>
Reply-To: common-dev@hadoop.apache.org
Delivered-To: mailing list common-dev@hadoop.apache.org
Received: (qmail 67456 invoked by uid 99); 6 Feb 2012 23:23:20 -0000
Received: from athena.apache.org (HELO athena.apache.org) (140.211.11.136)
by apache.org (qpsmtpd/0.29) with ESMTP; Mon, 06 Feb 2012 23:23:20 +0000
X-ASF-Spam-Status: No, hits=-2000.0 required=5.0
tests=ALL_TRUSTED,T_RP_MATCHES_RCVD
X-Spam-Check-By: apache.org
Received: from [140.211.11.116] (HELO hel.zones.apache.org) (140.211.11.116)
by apache.org (qpsmtpd/0.29) with ESMTP; Mon, 06 Feb 2012 23:23:19 +0000
Received: from hel.zones.apache.org (hel.zones.apache.org [140.211.11.116])
by hel.zones.apache.org (Postfix) with ESMTP id 556BDCC9F7
for <common-dev@hadoop.apache.org>; Mon, 6 Feb 2012 23:22:59 +0000 (UTC)
Date: Mon, 6 Feb 2012 23:22:59 +0000 (UTC)
From: "Allen Wittenauer (Created) (JIRA)" <jira@apache.org>
To: common-dev@hadoop.apache.org
Message-ID: <384880901.4839.1328570579351.JavaMail.tomcat@hel.zones.apache.org>
Subject: [jira] [Created] (HADOOP-8026) various shell script fixes
MIME-Version: 1.0
Content-Type: text/plain; charset=utf-8
Content-Transfer-Encoding: 7bit
X-JIRA-FingerPrint: 30527f35849b9dde25b450d4833f0394
various shell script fixes
--------------------------
Key: HADOOP-8026
URL: https://issues.apache.org/jira/browse/HADOOP-8026
Project: Hadoop Common
Issue Type: Bug
Affects Versions: 1.0.0
Reporter: Allen Wittenauer
Attachments: HADOOP-8026-branch-1.0.txt
Various shell script fixes:
* repair naked $0s so that dir detections work
* remove superfluous JAVA_HOME settings
* use /usr/bin/pdsh in slaves.sh if it exists
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
From common-dev-return-77630-apmail-hadoop-common-dev-archive=hadoop.apache.org@hadoop.apache.org Tue Feb 7 09:11:46 2012
Return-Path: <common-dev-return-77630-apmail-hadoop-common-dev-archive=hadoop.apache.org@hadoop.apache.org>
X-Original-To: apmail-hadoop-common-dev-archive@www.apache.org
Delivered-To: apmail-hadoop-common-dev-archive@www.apache.org
Received: from mail.apache.org (hermes.apache.org [140.211.11.3])
by minotaur.apache.org (Postfix) with SMTP id 6B34199CD
for <apmail-hadoop-common-dev-archive@www.apache.org>; Tue, 7 Feb 2012 09:11:46 +0000 (UTC)
Received: (qmail 21901 invoked by uid 500); 7 Feb 2012 09:11:44 -0000
Delivered-To: apmail-hadoop-common-dev-archive@hadoop.apache.org
Received: (qmail 20954 invoked by uid 500); 7 Feb 2012 09:11:30 -0000
Mailing-List: contact common-dev-help@hadoop.apache.org; run by ezmlm
Precedence: bulk
List-Help: <mailto:common-dev-help@hadoop.apache.org>
List-Unsubscribe: <mailto:common-dev-unsubscribe@hadoop.apache.org>
List-Post: <mailto:common-dev@hadoop.apache.org>
List-Id: <common-dev.hadoop.apache.org>
Reply-To: common-dev@hadoop.apache.org
Delivered-To: mailing list common-dev@hadoop.apache.org
Received: (qmail 20754 invoked by uid 99); 7 Feb 2012 09:11:26 -0000
Received: from athena.apache.org (HELO athena.apache.org) (140.211.11.136)
by apache.org (qpsmtpd/0.29) with ESMTP; Tue, 07 Feb 2012 09:11:26 +0000
X-ASF-Spam-Status: No, hits=-0.7 required=5.0
tests=RCVD_IN_DNSWL_LOW,SPF_PASS
X-Spam-Check-By: apache.org
Received-SPF: pass (athena.apache.org: domain of lars.francke@gmail.com designates 209.85.213.48 as permitted sender)
Received: from [209.85.213.48] (HELO mail-yw0-f48.google.com) (209.85.213.48)
by apache.org (qpsmtpd/0.29) with ESMTP; Tue, 07 Feb 2012 09:11:20 +0000
Received: by yhjj52 with SMTP id j52so3336799yhj.35
for <common-dev@hadoop.apache.org>; Tue, 07 Feb 2012 01:11:00 -0800 (PST)
DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed;
d=gmail.com; s=gamma;
h=mime-version:from:date:message-id:subject:to:content-type;
bh=oK+uLtSdFwU2yAgDvYsGghtiFmEmwvhfS5yqxbzE0S8=;
b=LE5tZ/t47OWgAH/Rap2NY3l2bPD4YXkpAHbOS9KOaj35TBLgtPEx33V/ldUgbd64dS
1hE3E/mwrilP6zO4pwnpbTC/2KronDb+RU36CvLMviO5bH7NSdmJwd45BExlpLh9pRT9
4aN3VBNqflBhOHfmHCSWnU2ovmu4ENlLhSrr0=
Received: by 10.236.124.2 with SMTP id w2mr30201001yhh.83.1328605860275; Tue,
07 Feb 2012 01:11:00 -0800 (PST)
MIME-Version: 1.0
Received: by 10.236.156.66 with HTTP; Tue, 7 Feb 2012 01:10:20 -0800 (PST)
From: Lars Francke <lars.francke@gmail.com>
Date: Tue, 7 Feb 2012 10:10:20 +0100
Message-ID: <CAD-Ua_j+k00SkOfB7Ra6fhvgy6V0FSiNzh5FeGzpRg7Vx2PwsA@mail.gmail.com>
Subject: PoweredBy Wiki
To: common-dev@hadoop.apache.org
Content-Type: text/plain; charset=UTF-8
Hi,
I'd like to request access to the PoweredBy Wiki page for my user
account "LarsFrancke" so I can add GBIF[1] to the list. The page also
still mentions core-dev instead of common-dev but I can update that
too.
Thanks!
Cheers,
Lars
[1] <http://www.gbif.org>
From common-dev-return-77631-apmail-hadoop-common-dev-archive=hadoop.apache.org@hadoop.apache.org Tue Feb 7 09:19:52 2012
Return-Path: <common-dev-return-77631-apmail-hadoop-common-dev-archive=hadoop.apache.org@hadoop.apache.org>
X-Original-To: apmail-hadoop-common-dev-archive@www.apache.org
Delivered-To: apmail-hadoop-common-dev-archive@www.apache.org
Received: from mail.apache.org (hermes.apache.org [140.211.11.3])
by minotaur.apache.org (Postfix) with SMTP id 9FA059E42
for <apmail-hadoop-common-dev-archive@www.apache.org>; Tue, 7 Feb 2012 09:19:52 +0000 (UTC)
Received: (qmail 37293 invoked by uid 500); 7 Feb 2012 09:19:49 -0000
Delivered-To: apmail-hadoop-common-dev-archive@hadoop.apache.org
Received: (qmail 36913 invoked by uid 500); 7 Feb 2012 09:19:28 -0000
Mailing-List: contact common-dev-help@hadoop.apache.org; run by ezmlm
Precedence: bulk
List-Help: <mailto:common-dev-help@hadoop.apache.org>
List-Unsubscribe: <mailto:common-dev-unsubscribe@hadoop.apache.org>
List-Post: <mailto:common-dev@hadoop.apache.org>
List-Id: <common-dev.hadoop.apache.org>
Reply-To: common-dev@hadoop.apache.org
Delivered-To: mailing list common-dev@hadoop.apache.org
Received: (qmail 36883 invoked by uid 99); 7 Feb 2012 09:19:21 -0000
Received: from athena.apache.org (HELO athena.apache.org) (140.211.11.136)
by apache.org (qpsmtpd/0.29) with ESMTP; Tue, 07 Feb 2012 09:19:21 +0000
X-ASF-Spam-Status: No, hits=-2000.0 required=5.0
tests=ALL_TRUSTED,T_RP_MATCHES_RCVD
X-Spam-Check-By: apache.org
Received: from [140.211.11.116] (HELO hel.zones.apache.org) (140.211.11.116)
by apache.org (qpsmtpd/0.29) with ESMTP; Tue, 07 Feb 2012 09:19:19 +0000
Received: from hel.zones.apache.org (hel.zones.apache.org [140.211.11.116])
by hel.zones.apache.org (Postfix) with ESMTP id 547CC1A6F2E
for <common-dev@hadoop.apache.org>; Tue, 7 Feb 2012 09:18:59 +0000 (UTC)
Date: Tue, 7 Feb 2012 09:18:59 +0000 (UTC)
From: "Uma Maheswara Rao G (Created) (JIRA)" <jira@apache.org>
To: common-dev@hadoop.apache.org
Message-ID: <1497311536.7462.1328606339347.JavaMail.tomcat@hel.zones.apache.org>
Subject: [jira] [Created] (HADOOP-8028) Mbeans and MBeanUtil are almost
duplicated in code.
MIME-Version: 1.0
Content-Type: text/plain; charset=utf-8
Content-Transfer-Encoding: 7bit
X-JIRA-FingerPrint: 30527f35849b9dde25b450d4833f0394
Mbeans and MBeanUtil are almost duplicated in code.
---------------------------------------------------
Key: HADOOP-8028
URL: https://issues.apache.org/jira/browse/HADOOP-8028
Project: Hadoop Common
Issue Type: Bug
Components: metrics
Affects Versions: 0.24.0
Reporter: Uma Maheswara Rao G
Looks Mbeans.java and MBeanUtil.java are duplicated and has the similar set of apis.
Not sure it was intentional to keep that.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
From common-dev-return-77632-apmail-hadoop-common-dev-archive=hadoop.apache.org@hadoop.apache.org Tue Feb 7 10:50:56 2012
Return-Path: <common-dev-return-77632-apmail-hadoop-common-dev-archive=hadoop.apache.org@hadoop.apache.org>
X-Original-To: apmail-hadoop-common-dev-archive@www.apache.org
Delivered-To: apmail-hadoop-common-dev-archive@www.apache.org
Received: from mail.apache.org (hermes.apache.org [140.211.11.3])
by minotaur.apache.org (Postfix) with SMTP id 350D8994D
for <apmail-hadoop-common-dev-archive@www.apache.org>; Tue, 7 Feb 2012 10:50:56 +0000 (UTC)
Received: (qmail 93802 invoked by uid 500); 7 Feb 2012 10:50:54 -0000
Delivered-To: apmail-hadoop-common-dev-archive@hadoop.apache.org
Received: (qmail 93209 invoked by uid 500); 7 Feb 2012 10:50:45 -0000
Mailing-List: contact common-dev-help@hadoop.apache.org; run by ezmlm
Precedence: bulk
List-Help: <mailto:common-dev-help@hadoop.apache.org>
List-Unsubscribe: <mailto:common-dev-unsubscribe@hadoop.apache.org>
List-Post: <mailto:common-dev@hadoop.apache.org>
List-Id: <common-dev.hadoop.apache.org>
Reply-To: common-dev@hadoop.apache.org
Delivered-To: mailing list common-dev@hadoop.apache.org
Received: (qmail 93201 invoked by uid 99); 7 Feb 2012 10:50:36 -0000
Received: from nike.apache.org (HELO nike.apache.org) (192.87.106.230)
by apache.org (qpsmtpd/0.29) with ESMTP; Tue, 07 Feb 2012 10:50:36 +0000
X-ASF-Spam-Status: No, hits=-0.7 required=5.0
tests=RCVD_IN_DNSWL_LOW,SPF_PASS
X-Spam-Check-By: apache.org
Received-SPF: pass (nike.apache.org: domain of harsh@cloudera.com designates 209.85.210.48 as permitted sender)
Received: from [209.85.210.48] (HELO mail-pz0-f48.google.com) (209.85.210.48)
by apache.org (qpsmtpd/0.29) with ESMTP; Tue, 07 Feb 2012 10:50:30 +0000
Received: by dadp13 with SMTP id p13so6915177dad.35
for <common-dev@hadoop.apache.org>; Tue, 07 Feb 2012 02:50:09 -0800 (PST)
Received: by 10.68.227.132 with SMTP id sa4mr57448301pbc.64.1328611809181;
Tue, 07 Feb 2012 02:50:09 -0800 (PST)
MIME-Version: 1.0
Received: by 10.142.101.3 with HTTP; Tue, 7 Feb 2012 02:49:49 -0800 (PST)
In-Reply-To: <CAD-Ua_j+k00SkOfB7Ra6fhvgy6V0FSiNzh5FeGzpRg7Vx2PwsA@mail.gmail.com>
References: <CAD-Ua_j+k00SkOfB7Ra6fhvgy6V0FSiNzh5FeGzpRg7Vx2PwsA@mail.gmail.com>
From: Harsh J <harsh@cloudera.com>
Date: Tue, 7 Feb 2012 16:19:49 +0530
Message-ID: <CAOcnVr24OR0qW-0PAVWLLf-jPo+XB3-zsPG0GWC1ok2V8JcR5A@mail.gmail.com>
Subject: Re: PoweredBy Wiki
To: common-dev@hadoop.apache.org
Content-Type: text/plain; charset=ISO-8859-1
X-Virus-Checked: Checked by ClamAV on apache.org
Lars,
Done. You can now edit the PoweredBy page. Thanks!
On Tue, Feb 7, 2012 at 2:40 PM, Lars Francke <lars.francke@gmail.com> wrote:
> Hi,
>
> I'd like to request access to the PoweredBy Wiki page for my user
> account "LarsFrancke" so I can add GBIF[1] to the list. The page also
> still mentions core-dev instead of common-dev but I can update that
> too.
>
> Thanks!
>
> Cheers,
> Lars
>
> [1] <http://www.gbif.org>
--
Harsh J
Customer Ops. Engineer
Cloudera | http://tiny.cloudera.com/about
From common-dev-return-77633-apmail-hadoop-common-dev-archive=hadoop.apache.org@hadoop.apache.org Tue Feb 7 10:56:13 2012
Return-Path: <common-dev-return-77633-apmail-hadoop-common-dev-archive=hadoop.apache.org@hadoop.apache.org>
X-Original-To: apmail-hadoop-common-dev-archive@www.apache.org
Delivered-To: apmail-hadoop-common-dev-archive@www.apache.org
Received: from mail.apache.org (hermes.apache.org [140.211.11.3])
by minotaur.apache.org (Postfix) with SMTP id 8071D9C65
for <apmail-hadoop-common-dev-archive@www.apache.org>; Tue, 7 Feb 2012 10:56:13 +0000 (UTC)
Received: (qmail 4430 invoked by uid 500); 7 Feb 2012 10:56:11 -0000
Delivered-To: apmail-hadoop-common-dev-archive@hadoop.apache.org
Received: (qmail 4151 invoked by uid 500); 7 Feb 2012 10:56:03 -0000
Mailing-List: contact common-dev-help@hadoop.apache.org; run by ezmlm
Precedence: bulk
List-Help: <mailto:common-dev-help@hadoop.apache.org>
List-Unsubscribe: <mailto:common-dev-unsubscribe@hadoop.apache.org>
List-Post: <mailto:common-dev@hadoop.apache.org>
List-Id: <common-dev.hadoop.apache.org>
Reply-To: common-dev@hadoop.apache.org
Delivered-To: mailing list common-dev@hadoop.apache.org
Received: (qmail 4130 invoked by uid 99); 7 Feb 2012 10:56:00 -0000
Received: from nike.apache.org (HELO nike.apache.org) (192.87.106.230)
by apache.org (qpsmtpd/0.29) with ESMTP; Tue, 07 Feb 2012 10:56:00 +0000
X-ASF-Spam-Status: No, hits=-0.7 required=5.0
tests=RCVD_IN_DNSWL_LOW,SPF_PASS
X-Spam-Check-By: apache.org
Received-SPF: pass (nike.apache.org: domain of lars.francke@gmail.com designates 209.85.160.176 as permitted sender)
Received: from [209.85.160.176] (HELO mail-gy0-f176.google.com) (209.85.160.176)
by apache.org (qpsmtpd/0.29) with ESMTP; Tue, 07 Feb 2012 10:55:52 +0000
Received: by ghbz2 with SMTP id z2so3808504ghb.35
for <common-dev@hadoop.apache.org>; Tue, 07 Feb 2012 02:55:31 -0800 (PST)
DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed;
d=gmail.com; s=gamma;
h=mime-version:in-reply-to:references:from:date:message-id:subject:to
:content-type;
bh=jUsdeqb82oP5yT3IT7g04hKku9b+u+l5wHio9s6MhdU=;
b=n2T+XnTwtYcOodeDYjVjdaSJA+9jQskFTjy9wlKnoAymuZ9xY5S/LdDm/ksSk5tUE5
VTcc55NNobG0TFr89dKvaHHEDhXkxiskMLcKVkSIw/VgOpYRJrowKl273dzeVdngzY7J
9EA0iPAuDAsm2ofnXN8CF6M+/FFVtN7NUB9ZI=
Received: by 10.101.9.25 with SMTP id m25mr9390846ani.20.1328612131229; Tue,
07 Feb 2012 02:55:31 -0800 (PST)
MIME-Version: 1.0
Received: by 10.236.156.66 with HTTP; Tue, 7 Feb 2012 02:54:51 -0800 (PST)
In-Reply-To: <CAOcnVr24OR0qW-0PAVWLLf-jPo+XB3-zsPG0GWC1ok2V8JcR5A@mail.gmail.com>
References: <CAD-Ua_j+k00SkOfB7Ra6fhvgy6V0FSiNzh5FeGzpRg7Vx2PwsA@mail.gmail.com>
<CAOcnVr24OR0qW-0PAVWLLf-jPo+XB3-zsPG0GWC1ok2V8JcR5A@mail.gmail.com>
From: Lars Francke <lars.francke@gmail.com>
Date: Tue, 7 Feb 2012 11:54:51 +0100
Message-ID: <CAD-Ua_hMn2TSYMwj_d1YB8-ugzDgCD-=HRkMUpZ6QwQeeNzh3Q@mail.gmail.com>
Subject: Re: PoweredBy Wiki
To: common-dev@hadoop.apache.org
Content-Type: text/plain; charset=UTF-8
X-Virus-Checked: Checked by ClamAV on apache.org
> Done. You can now edit the PoweredBy page. Thanks!
Thank you very much.
From common-dev-return-77634-apmail-hadoop-common-dev-archive=hadoop.apache.org@hadoop.apache.org Tue Feb 7 17:24:42 2012
Return-Path: <common-dev-return-77634-apmail-hadoop-common-dev-archive=hadoop.apache.org@hadoop.apache.org>
X-Original-To: apmail-hadoop-common-dev-archive@www.apache.org
Delivered-To: apmail-hadoop-common-dev-archive@www.apache.org
Received: from mail.apache.org (hermes.apache.org [140.211.11.3])
by minotaur.apache.org (Postfix) with SMTP id E75C89BC8
for <apmail-hadoop-common-dev-archive@www.apache.org>; Tue, 7 Feb 2012 17:24:41 +0000 (UTC)
Received: (qmail 53915 invoked by uid 500); 7 Feb 2012 17:24:40 -0000
Delivered-To: apmail-hadoop-common-dev-archive@hadoop.apache.org
Received: (qmail 53766 invoked by uid 500); 7 Feb 2012 17:24:39 -0000
Mailing-List: contact common-dev-help@hadoop.apache.org; run by ezmlm
Precedence: bulk
List-Help: <mailto:common-dev-help@hadoop.apache.org>
List-Unsubscribe: <mailto:common-dev-unsubscribe@hadoop.apache.org>
List-Post: <mailto:common-dev@hadoop.apache.org>
List-Id: <common-dev.hadoop.apache.org>
Reply-To: common-dev@hadoop.apache.org
Delivered-To: mailing list common-dev@hadoop.apache.org
Received: (qmail 53758 invoked by uid 99); 7 Feb 2012 17:24:38 -0000
Received: from athena.apache.org (HELO athena.apache.org) (140.211.11.136)
by apache.org (qpsmtpd/0.29) with ESMTP; Tue, 07 Feb 2012 17:24:38 +0000
X-ASF-Spam-Status: No, hits=2.2 required=5.0
tests=HTML_MESSAGE,RCVD_IN_DNSWL_LOW,SPF_NEUTRAL,UNPARSEABLE_RELAY
X-Spam-Check-By: apache.org
Received-SPF: neutral (athena.apache.org: local policy)
Received: from [195.245.231.130] (HELO mail1.bemta5.messagelabs.com) (195.245.231.130)
by apache.org (qpsmtpd/0.29) with ESMTP; Tue, 07 Feb 2012 17:24:32 +0000
Received: from [85.158.136.35:48451] by server-9.bemta-5.messagelabs.com id DD/ED-23757-B3E513F4; Tue, 07 Feb 2012 17:24:11 +0000
X-Env-Sender: Ian.Meyers@barclayscapital.com
X-Msg-Ref: server-5.tower-125.messagelabs.com!1328635450!16666122!1
X-Originating-IP: [141.228.106.169]
X-StarScan-Version: 6.5.5; banners=-,-,-
X-VirusChecked: Checked
Received: (qmail 23645 invoked from network); 7 Feb 2012 17:24:10 -0000
Received: from bcmh.barcap.com (HELO mx1118.barcap.com) (141.228.106.169)
by server-5.tower-125.messagelabs.com with DHE-RSA-AES256-SHA encrypted SMTP; 7 Feb 2012 17:24:10 -0000
Received: from ldnpsmeg0000001.INTRANET.BARCAPINT.COM (ldnpsmeg0000001.ldn.mess.barcap.com [10.76.204.221])
by mx1118.barcap.com (Postfix) with ESMTP id 5B312194060
for <common-dev@hadoop.apache.org>; Tue, 7 Feb 2012 17:24:10 +0000 (GMT)
Received: from ldnpsmmgch12.INTRANET.BARCAPINT.COM (Not Verified[10.127.121.45]) by ldnpsmeg0000001.INTRANET.BARCAPINT.COM with Barclays Capital Filter ESMTP
id <B4f315e340005>; Tue, 07 Feb 2012 17:24:04 +0000
Received: from LDNPCMMGMB05.INTRANET.BARCAPINT.COM ([169.254.1.239]) by
ldnpsmmgch12.INTRANET.BARCAPINT.COM ([10.127.121.45]) with mapi; Tue, 7 Feb
2012 17:23:58 +0000
From: <Ian.Meyers@barclayscapital.com>
To: <common-dev@hadoop.apache.org>
Date: Tue, 7 Feb 2012 17:23:59 +0000
Subject: Hadoop 1.0 Install Guide
Thread-Topic: Hadoop 1.0 Install Guide
Thread-Index: AczlvUeK3xa4QWV5SOOtJAourpC/DA==
Message-ID: <4F5D27780CAA0148844A065A2A3C244D0DDDA51FCC@LDNPCMMGMB05.INTRANET.BARCAPINT.COM>
Accept-Language: en-US, en-GB
Content-Language: en-US
X-MS-Has-Attach:
X-MS-TNEF-Correlator:
acceptlanguage: en-US, en-GB
Content-Type: multipart/alternative;
boundary="_000_4F5D27780CAA0148844A065A2A3C244D0DDDA51FCCLDNPCMMGMB05I_"
MIME-Version: 1.0
--_000_4F5D27780CAA0148844A065A2A3C244D0DDDA51FCCLDNPCMMGMB05I_
Content-Type: text/plain; charset="us-ascii"
Content-Transfer-Encoding: quoted-printable
Hi All,
Am tearing my hair out trying to find documentation for 1.0. Has it been =
created yet? If not, does anyone have an idea of when this may be publish=
ed?
Thanks,
Ian
_______________________________________________
This e-mail may contain information that is confidential, privileged or o=
therwise protected from disclosure. If you are not an intended recipient =
of this e-mail, do not duplicate or redistribute it by any means. Please =
delete it and any attachments and notify the sender that you have receive=
d it in error. Unless specifically indicated, this e-mail is not an offer=
=20to buy or sell or a solicitation to buy or sell any securities, invest=
ment products or other financial product or service, an official confirma=
tion of any transaction, or an official statement of Barclays. Any views =
or opinions presented are solely those of the author and do not necessari=
ly represent those of Barclays. This e-mail is subject to terms available=
=20at the following link: www.barcap.com/emaildisclaimer. By messaging wi=
th Barclays you consent to the foregoing. Barclays Capital is the invest=
ment banking division of Barclays Bank PLC, a company registered in Engla=
nd (number 1026167) with its registered office at 1 Churchill Place, Lond=
on, E14 5HP. This email may relate to or be sent from other members of t=
he Barclays Group.
_______________________________________________
--_000_4F5D27780CAA0148844A065A2A3C244D0DDDA51FCCLDNPCMMGMB05I_--
From common-dev-return-77635-apmail-hadoop-common-dev-archive=hadoop.apache.org@hadoop.apache.org Tue Feb 7 17:27:41 2012
Return-Path: <common-dev-return-77635-apmail-hadoop-common-dev-archive=hadoop.apache.org@hadoop.apache.org>
X-Original-To: apmail-hadoop-common-dev-archive@www.apache.org
Delivered-To: apmail-hadoop-common-dev-archive@www.apache.org
Received: from mail.apache.org (hermes.apache.org [140.211.11.3])
by minotaur.apache.org (Postfix) with SMTP id 93BD19D8E
for <apmail-hadoop-common-dev-archive@www.apache.org>; Tue, 7 Feb 2012 17:27:41 +0000 (UTC)
Received: (qmail 62878 invoked by uid 500); 7 Feb 2012 17:27:39 -0000
Delivered-To: apmail-hadoop-common-dev-archive@hadoop.apache.org
Received: (qmail 62740 invoked by uid 500); 7 Feb 2012 17:27:38 -0000
Mailing-List: contact common-dev-help@hadoop.apache.org; run by ezmlm
Precedence: bulk
List-Help: <mailto:common-dev-help@hadoop.apache.org>
List-Unsubscribe: <mailto:common-dev-unsubscribe@hadoop.apache.org>
List-Post: <mailto:common-dev@hadoop.apache.org>
List-Id: <common-dev.hadoop.apache.org>
Reply-To: common-dev@hadoop.apache.org
Delivered-To: mailing list common-dev@hadoop.apache.org
Received: (qmail 62732 invoked by uid 99); 7 Feb 2012 17:27:38 -0000
Received: from nike.apache.org (HELO nike.apache.org) (192.87.106.230)
by apache.org (qpsmtpd/0.29) with ESMTP; Tue, 07 Feb 2012 17:27:38 +0000
X-ASF-Spam-Status: No, hits=-0.7 required=5.0
tests=RCVD_IN_DNSWL_LOW,SPF_PASS
X-Spam-Check-By: apache.org
Received-SPF: pass (nike.apache.org: domain of jdcryans@gmail.com designates 209.85.210.176 as permitted sender)
Received: from [209.85.210.176] (HELO mail-iy0-f176.google.com) (209.85.210.176)
by apache.org (qpsmtpd/0.29) with ESMTP; Tue, 07 Feb 2012 17:27:32 +0000
Received: by iagz35 with SMTP id z35so14218139iag.35
for <common-dev@hadoop.apache.org>; Tue, 07 Feb 2012 09:27:11 -0800 (PST)
DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed;
d=gmail.com; s=gamma;
h=mime-version:sender:in-reply-to:references:date
:x-google-sender-auth:message-id:subject:from:to:content-type
:content-transfer-encoding;
bh=BEKnO8+kRLiApv+Tcsx1R6ESy66XL/dMmpma3ZoxDmY=;
b=wOi1SAwvup+L0/qNJqvaRCyeGtZ5T3t2aXnDUmiW033AGR7oZetz5A7XLKgnchEpW8
5A51X6LBCexhneSHrilEK/WJwfOsVthtI15V82M+yVUYd++680H2pcGJYGcJzYfm2Vgp
s2PXtfZvFlvh4dRJZ3kGXkSNyojiB973ZqxiA=
MIME-Version: 1.0
Received: by 10.42.155.70 with SMTP id t6mr22812353icw.11.1328635631645; Tue,
07 Feb 2012 09:27:11 -0800 (PST)
Sender: jdcryans@gmail.com
Received: by 10.231.229.6 with HTTP; Tue, 7 Feb 2012 09:27:11 -0800 (PST)
In-Reply-To: <4F5D27780CAA0148844A065A2A3C244D0DDDA51FCC@LDNPCMMGMB05.INTRANET.BARCAPINT.COM>
References: <4F5D27780CAA0148844A065A2A3C244D0DDDA51FCC@LDNPCMMGMB05.INTRANET.BARCAPINT.COM>
Date: Tue, 7 Feb 2012 09:27:11 -0800
X-Google-Sender-Auth: 0VGnE3eoyiUGpMMMNnWLZZmf4xQ
Message-ID: <CAGpTDNeCu3fkt4QL=2eWEitfqd+DS4AGUpucpoJ3APjJD4FPGg@mail.gmail.com>
Subject: Re: Hadoop 1.0 Install Guide
From: Jean-Daniel Cryans <jdcryans@apache.org>
To: common-dev@hadoop.apache.org
Content-Type: text/plain; charset=ISO-8859-1
Content-Transfer-Encoding: quoted-printable
X-Virus-Checked: Checked by ClamAV on apache.org
There's the usual stuff on the website:
http://hadoop.apache.org/common/docs/r1.0.0/
It has the good old Getting Started and whatnot.
J-D
On Tue, Feb 7, 2012 at 9:23 AM, <Ian.Meyers@barclayscapital.com> wrote:
> Hi All,
>
> Am tearing my hair out trying to find documentation for 1.0. Has it been =
created yet? If not, does anyone have an idea of when this may be published=
?
>
> Thanks,
>
> Ian
>
>
> _______________________________________________
>
> This e-mail may contain information that is confidential, privileged or o=
therwise protected from disclosure. If you are not an intended recipient of=
this e-mail, do not duplicate or redistribute it by any means. Please dele=
te it and any attachments and notify the sender that you have received it i=
n error. Unless specifically indicated, this e-mail is not an offer to buy =
or sell or a solicitation to buy or sell any securities, investment product=
s or other financial product or service, an official confirmation of any tr=
ansaction, or an official statement of Barclays. Any views or opinions pres=
ented are solely those of the author and do not necessarily represent those=
of Barclays. This e-mail is subject to terms available at the following li=
nk: www.barcap.com/emaildisclaimer. By messaging with Barclays you consent =
to the foregoing. =A0Barclays Capital is the investment banking division of=
Barclays Bank PLC, a company registered in England (number 1026167) with i=
ts registered office at 1 Churchill Place, London, E14 5HP. =A0This email m=
ay relate to or be sent from other members of the Barclays Group.
> _______________________________________________
From common-dev-return-77636-apmail-hadoop-common-dev-archive=hadoop.apache.org@hadoop.apache.org Tue Feb 7 18:19:26 2012
Return-Path: <common-dev-return-77636-apmail-hadoop-common-dev-archive=hadoop.apache.org@hadoop.apache.org>
X-Original-To: apmail-hadoop-common-dev-archive@www.apache.org
Delivered-To: apmail-hadoop-common-dev-archive@www.apache.org
Received: from mail.apache.org (hermes.apache.org [140.211.11.3])
by minotaur.apache.org (Postfix) with SMTP id C2E8C99AE
for <apmail-hadoop-common-dev-archive@www.apache.org>; Tue, 7 Feb 2012 18:19:26 +0000 (UTC)
Received: (qmail 98328 invoked by uid 500); 7 Feb 2012 18:19:24 -0000
Delivered-To: apmail-hadoop-common-dev-archive@hadoop.apache.org
Received: (qmail 98045 invoked by uid 500); 7 Feb 2012 18:19:23 -0000
Mailing-List: contact common-dev-help@hadoop.apache.org; run by ezmlm
Precedence: bulk
List-Help: <mailto:common-dev-help@hadoop.apache.org>
List-Unsubscribe: <mailto:common-dev-unsubscribe@hadoop.apache.org>
List-Post: <mailto:common-dev@hadoop.apache.org>
List-Id: <common-dev.hadoop.apache.org>
Reply-To: common-dev@hadoop.apache.org
Delivered-To: mailing list common-dev@hadoop.apache.org
Received: (qmail 98023 invoked by uid 99); 7 Feb 2012 18:19:23 -0000
Received: from nike.apache.org (HELO nike.apache.org) (192.87.106.230)
by apache.org (qpsmtpd/0.29) with ESMTP; Tue, 07 Feb 2012 18:19:23 +0000
X-ASF-Spam-Status: No, hits=-2000.0 required=5.0
tests=ALL_TRUSTED,T_RP_MATCHES_RCVD
X-Spam-Check-By: apache.org
Received: from [140.211.11.116] (HELO hel.zones.apache.org) (140.211.11.116)
by apache.org (qpsmtpd/0.29) with ESMTP; Tue, 07 Feb 2012 18:19:20 +0000
Received: from hel.zones.apache.org (hel.zones.apache.org [140.211.11.116])
by hel.zones.apache.org (Postfix) with ESMTP id 7B2AD1A74F9
for <common-dev@hadoop.apache.org>; Tue, 7 Feb 2012 18:18:59 +0000 (UTC)
Date: Tue, 7 Feb 2012 18:18:59 +0000 (UTC)
From: "Tim Mattison (Created) (JIRA)" <jira@apache.org>
To: common-dev@hadoop.apache.org
Message-ID: <869868662.9398.1328638739506.JavaMail.tomcat@hel.zones.apache.org>
Subject: [jira] [Created] (HADOOP-8029)
org.apache.hadoop.io.nativeio.NativeIO.posixFadviseIfPossible does not
handle EINVAL
MIME-Version: 1.0
Content-Type: text/plain; charset=utf-8
Content-Transfer-Encoding: 7bit
X-JIRA-FingerPrint: 30527f35849b9dde25b450d4833f0394
X-Virus-Checked: Checked by ClamAV on apache.org
org.apache.hadoop.io.nativeio.NativeIO.posixFadviseIfPossible does not handle EINVAL
------------------------------------------------------------------------------------
Key: HADOOP-8029
URL: https://issues.apache.org/jira/browse/HADOOP-8029
Project: Hadoop Common
Issue Type: Bug
Components: native
Affects Versions: 0.20.205.0
Environment: Debian Wheezy 64-bit
uname -a = "Linux desktop 3.1.0-1-amd64 #1 SMP Tue Jan 10 05:01:58 UTC 2012 x86_64 GNU/Linux"
cat /etc/issue = "Debian GNU/Linux wheezy/sid \n \l"
/etc/apt/sources.list = "
deb http://ftp.us.debian.org/debian/ wheezy main contrib non-free
deb-src http://ftp.us.debian.org/debian/ wheezy main contrib non-free
deb http://security.debian.org/ wheezy/updates main contrib non-free
deb-src http://security.debian.org/ wheezy/updates main contrib non-free
deb http://archive.cloudera.com/debian squeeze-cdh3 contrib
deb-src http://archive.cloudera.com/debian squeeze-cdh3 contrib"
Hadoop specific configuration (disabled permissions, pseudo-distributed mode, replication set to 1, from my own blog post here: http://j.mp/tsVBR4
Reporter: Tim Mattison
When Hadoop's directories reside on tmpfs in Debian Wheezy (and possibly all Linux 3.1 distros) in an installation that is using the native libraries fadvise returns EINVAL when trying to run a MapReduce job. Since EINVAL isn't handled all MapReduce jobs report "Map output lost, rescheduling: getMapOutput".
A full stack trace for this issue looks like this:
[exec] 12/02/03 09:50:58 INFO mapred.JobClient: Task Id : attempt_201202030949_0001_m_000000_0, Status : FAILED
[exec] Map output lost, rescheduling: getMapOutput(attempt_201202030949_0001_m_000000_0,0) failed :
[exec] EINVAL: Invalid argument
[exec] at org.apache.hadoop.io.nativeio.NativeIO.posix_fadvise(Native Method)
[exec] at org.apache.hadoop.io.nativeio.NativeIO.posixFadviseIfPossible(NativeIO.java:177)
[exec] at org.apache.hadoop.mapred.TaskTracker$MapOutputServlet.doGet(TaskTracker.java:4026)
[exec] at javax.servlet.http.HttpServlet.service(HttpServlet.java:707)
[exec] at javax.servlet.http.HttpServlet.service(HttpServlet.java:820)
[exec] at org.mortbay.jetty.servlet.ServletHolder.handle(ServletHolder.java:511)
[exec] at org.mortbay.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1221)
[exec] at org.apache.hadoop.http.HttpServer$QuotingInputFilter.doFilter(HttpServer.java:829)
[exec] at org.mortbay.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1212)
[exec] at org.mortbay.jetty.servlet.ServletHandler.handle(ServletHandler.java:399)
[exec] at org.mortbay.jetty.security.SecurityHandler.handle(SecurityHandler.java:216)
Some logic will need to be implemented to handle EINVAL to properly support all file systems.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
From common-dev-return-77637-apmail-hadoop-common-dev-archive=hadoop.apache.org@hadoop.apache.org Tue Feb 7 20:19:22 2012
Return-Path: <common-dev-return-77637-apmail-hadoop-common-dev-archive=hadoop.apache.org@hadoop.apache.org>
X-Original-To: apmail-hadoop-common-dev-archive@www.apache.org
Delivered-To: apmail-hadoop-common-dev-archive@www.apache.org
Received: from mail.apache.org (hermes.apache.org [140.211.11.3])
by minotaur.apache.org (Postfix) with SMTP id EB9309E7F
for <apmail-hadoop-common-dev-archive@www.apache.org>; Tue, 7 Feb 2012 20:19:22 +0000 (UTC)
Received: (qmail 66196 invoked by uid 500); 7 Feb 2012 20:19:21 -0000
Delivered-To: apmail-hadoop-common-dev-archive@hadoop.apache.org
Received: (qmail 66050 invoked by uid 500); 7 Feb 2012 20:19:20 -0000
Mailing-List: contact common-dev-help@hadoop.apache.org; run by ezmlm
Precedence: bulk
List-Help: <mailto:common-dev-help@hadoop.apache.org>
List-Unsubscribe: <mailto:common-dev-unsubscribe@hadoop.apache.org>
List-Post: <mailto:common-dev@hadoop.apache.org>
List-Id: <common-dev.hadoop.apache.org>
Reply-To: common-dev@hadoop.apache.org
Delivered-To: mailing list common-dev@hadoop.apache.org
Received: (qmail 66042 invoked by uid 99); 7 Feb 2012 20:19:20 -0000
Received: from athena.apache.org (HELO athena.apache.org) (140.211.11.136)
by apache.org (qpsmtpd/0.29) with ESMTP; Tue, 07 Feb 2012 20:19:20 +0000
X-ASF-Spam-Status: No, hits=-2000.0 required=5.0
tests=ALL_TRUSTED,T_RP_MATCHES_RCVD
X-Spam-Check-By: apache.org
Received: from [140.211.11.116] (HELO hel.zones.apache.org) (140.211.11.116)
by apache.org (qpsmtpd/0.29) with ESMTP; Tue, 07 Feb 2012 20:19:19 +0000
Received: from hel.zones.apache.org (hel.zones.apache.org [140.211.11.116])
by hel.zones.apache.org (Postfix) with ESMTP id 6FECB1A78CF
for <common-dev@hadoop.apache.org>; Tue, 7 Feb 2012 20:18:59 +0000 (UTC)
Date: Tue, 7 Feb 2012 20:18:59 +0000 (UTC)
From: "Elias Ross (Created) (JIRA)" <jira@apache.org>
To: common-dev@hadoop.apache.org
Message-ID: <1420438214.10099.1328645939459.JavaMail.tomcat@hel.zones.apache.org>
Subject: [jira] [Created] (HADOOP-8030) Configuration class can throw
exceptions in quiet mode; quiet mode usage unclear
MIME-Version: 1.0
Content-Type: text/plain; charset=utf-8
Content-Transfer-Encoding: 7bit
X-JIRA-FingerPrint: 30527f35849b9dde25b450d4833f0394
Configuration class can throw exceptions in quiet mode; quiet mode usage unclear
--------------------------------------------------------------------------------
Key: HADOOP-8030
URL: https://issues.apache.org/jira/browse/HADOOP-8030
Project: Hadoop Common
Issue Type: Bug
Components: conf
Reporter: Elias Ross
hadoop-common-project/hadoop-common/src/main/java/org/apache/hadoop/conf/Configuration.java
if (doc == null && root == null) {
if (quiet)
return;
throw new RuntimeException(name + " not found");
}
Unclear why a diagnostic mode would throw an exception, while normally off it would not.
It's also not clear why 'quiet' is being passed around as well. Why not use logging levels and logging configuration and remove 'quiet' mode altogether?
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
From common-dev-return-77638-apmail-hadoop-common-dev-archive=hadoop.apache.org@hadoop.apache.org Tue Feb 7 20:23:23 2012
Return-Path: <common-dev-return-77638-apmail-hadoop-common-dev-archive=hadoop.apache.org@hadoop.apache.org>
X-Original-To: apmail-hadoop-common-dev-archive@www.apache.org
Delivered-To: apmail-hadoop-common-dev-archive@www.apache.org
Received: from mail.apache.org (hermes.apache.org [140.211.11.3])
by minotaur.apache.org (Postfix) with SMTP id 5754B9095
for <apmail-hadoop-common-dev-archive@www.apache.org>; Tue, 7 Feb 2012 20:23:23 +0000 (UTC)
Received: (qmail 77457 invoked by uid 500); 7 Feb 2012 20:23:21 -0000
Delivered-To: apmail-hadoop-common-dev-archive@hadoop.apache.org
Received: (qmail 77342 invoked by uid 500); 7 Feb 2012 20:23:20 -0000
Mailing-List: contact common-dev-help@hadoop.apache.org; run by ezmlm
Precedence: bulk
List-Help: <mailto:common-dev-help@hadoop.apache.org>
List-Unsubscribe: <mailto:common-dev-unsubscribe@hadoop.apache.org>
List-Post: <mailto:common-dev@hadoop.apache.org>
List-Id: <common-dev.hadoop.apache.org>
Reply-To: common-dev@hadoop.apache.org
Delivered-To: mailing list common-dev@hadoop.apache.org
Received: (qmail 77326 invoked by uid 99); 7 Feb 2012 20:23:20 -0000
Received: from athena.apache.org (HELO athena.apache.org) (140.211.11.136)
by apache.org (qpsmtpd/0.29) with ESMTP; Tue, 07 Feb 2012 20:23:20 +0000
X-ASF-Spam-Status: No, hits=-2000.0 required=5.0
tests=ALL_TRUSTED,T_RP_MATCHES_RCVD
X-Spam-Check-By: apache.org
Received: from [140.211.11.116] (HELO hel.zones.apache.org) (140.211.11.116)
by apache.org (qpsmtpd/0.29) with ESMTP; Tue, 07 Feb 2012 20:23:19 +0000
Received: from hel.zones.apache.org (hel.zones.apache.org [140.211.11.116])
by hel.zones.apache.org (Postfix) with ESMTP id 6432F1A7C6F
for <common-dev@hadoop.apache.org>; Tue, 7 Feb 2012 20:22:59 +0000 (UTC)
Date: Tue, 7 Feb 2012 20:22:59 +0000 (UTC)
From: "Elias Ross (Created) (JIRA)" <jira@apache.org>
To: common-dev@hadoop.apache.org
Message-ID: <1334226718.10123.1328646179411.JavaMail.tomcat@hel.zones.apache.org>
Subject: [jira] [Created] (HADOOP-8031) Configuration class fails to find
embedded .jar resources; should use URL.openStream()
MIME-Version: 1.0
Content-Type: text/plain; charset=utf-8
Content-Transfer-Encoding: 7bit
X-JIRA-FingerPrint: 30527f35849b9dde25b450d4833f0394
Configuration class fails to find embedded .jar resources; should use URL.openStream()
--------------------------------------------------------------------------------------
Key: HADOOP-8031
URL: https://issues.apache.org/jira/browse/HADOOP-8031
Project: Hadoop Common
Issue Type: Bug
Reporter: Elias Ross
While running a hadoop client within RHQ (monitoring software) using its classloader, I see this:
2012-02-07 09:15:25,313 INFO [ResourceContainer.invoker.daemon-2] (org.apache.hadoop.conf.Configuration)- parsing jar:file:/usr/local/rhq-agent/data/tmp/rhq-hadoop-plugin-4.3.0-SNAPSHOT.jar6856622641102893436.classloader/hadoop-core-0.20.2+737+1.jar7204287718482036191.tmp!/core-default.xml
2012-02-07 09:15:25,318 ERROR [InventoryManager.discovery-1] (rhq.core.pc.inventory.InventoryManager)- Failed to start component for Resource[id=16290, type=NameNode, key=NameNode:/usr/lib/hadoop-0.20, name=NameNode, parent=vg61l01ad-hadoop002.apple.com] from synchronized merge.
org.rhq.core.clientapi.agent.PluginContainerException: Failed to start component for resource Resource[id=16290, type=NameNode, key=NameNode:/usr/lib/hadoop-0.20, name=NameNode, parent=vg61l01ad-hadoop002.apple.com].
Caused by: java.lang.RuntimeException: core-site.xml not found
at org.apache.hadoop.conf.Configuration.loadResource(Configuration.java:1308)
at org.apache.hadoop.conf.Configuration.loadResources(Configuration.java:1228)
at org.apache.hadoop.conf.Configuration.getProps(Configuration.java:1169)
at org.apache.hadoop.conf.Configuration.set(Configuration.java:438)
This is because the URL
jar:file:/usr/local/rhq-agent/data/tmp/rhq-hadoop-plugin-4.3.0-SNAPSHOT.jar6856622641102893436.classloader/hadoop-core-0.20.2+737+1.jar7204287718482036191.tmp!/core-default.xml
cannot be found by DocumentBuilder (doesn't understand it). (Note: the logs are for an old version of Configuration class, but the new version has the same code.)
The solution is to obtain the resource stream directly from the URL object itself.
That is to say:
{code}
URL url = getResource((String)name);
- if (url != null) {
- if (!quiet) {
- LOG.info("parsing " + url);
- }
- doc = builder.parse(url.toString());
- }
+ doc = builder.parse(url.openStream());
{code}
Note: I have a full patch pending approval at Apple for this change, including some cleanup.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
From common-dev-return-77639-apmail-hadoop-common-dev-archive=hadoop.apache.org@hadoop.apache.org Tue Feb 7 20:53:24 2012
Return-Path: <common-dev-return-77639-apmail-hadoop-common-dev-archive=hadoop.apache.org@hadoop.apache.org>
X-Original-To: apmail-hadoop-common-dev-archive@www.apache.org
Delivered-To: apmail-hadoop-common-dev-archive@www.apache.org
Received: from mail.apache.org (hermes.apache.org [140.211.11.3])
by minotaur.apache.org (Postfix) with SMTP id 7655091D9
for <apmail-hadoop-common-dev-archive@www.apache.org>; Tue, 7 Feb 2012 20:53:24 +0000 (UTC)
Received: (qmail 66814 invoked by uid 500); 7 Feb 2012 20:53:22 -0000
Delivered-To: apmail-hadoop-common-dev-archive@hadoop.apache.org
Received: (qmail 66101 invoked by uid 500); 7 Feb 2012 20:53:21 -0000
Mailing-List: contact common-dev-help@hadoop.apache.org; run by ezmlm
Precedence: bulk
List-Help: <mailto:common-dev-help@hadoop.apache.org>
List-Unsubscribe: <mailto:common-dev-unsubscribe@hadoop.apache.org>
List-Post: <mailto:common-dev@hadoop.apache.org>
List-Id: <common-dev.hadoop.apache.org>
Reply-To: common-dev@hadoop.apache.org
Delivered-To: mailing list common-dev@hadoop.apache.org
Received: (qmail 66075 invoked by uid 99); 7 Feb 2012 20:53:20 -0000
Received: from athena.apache.org (HELO athena.apache.org) (140.211.11.136)
by apache.org (qpsmtpd/0.29) with ESMTP; Tue, 07 Feb 2012 20:53:20 +0000
X-ASF-Spam-Status: No, hits=-2000.0 required=5.0
tests=ALL_TRUSTED,T_RP_MATCHES_RCVD
X-Spam-Check-By: apache.org
Received: from [140.211.11.116] (HELO hel.zones.apache.org) (140.211.11.116)
by apache.org (qpsmtpd/0.29) with ESMTP; Tue, 07 Feb 2012 20:53:19 +0000
Received: from hel.zones.apache.org (hel.zones.apache.org [140.211.11.116])
by hel.zones.apache.org (Postfix) with ESMTP id E3EE41A8227
for <common-dev@hadoop.apache.org>; Tue, 7 Feb 2012 20:52:59 +0000 (UTC)
Date: Tue, 7 Feb 2012 20:52:59 +0000 (UTC)
From: "Ravi Prakash (Created) (JIRA)" <jira@apache.org>
To: common-dev@hadoop.apache.org
Message-ID: <788798230.10292.1328647979935.JavaMail.tomcat@hel.zones.apache.org>
Subject: [jira] [Created] (HADOOP-8032) mvn site:stage-deploy should be able
to use the scp protocol to stage documents
MIME-Version: 1.0
Content-Type: text/plain; charset=utf-8
Content-Transfer-Encoding: 7bit
X-JIRA-FingerPrint: 30527f35849b9dde25b450d4833f0394
mvn site:stage-deploy should be able to use the scp protocol to stage documents
-------------------------------------------------------------------------------
Key: HADOOP-8032
URL: https://issues.apache.org/jira/browse/HADOOP-8032
Project: Hadoop Common
Issue Type: Wish
Components: build, documentation
Affects Versions: 0.23.0, 0.24.0
Reporter: Ravi Prakash
Assignee: Ravi Prakash
mvn site:stage-deploy should be able to use the scp protocol to stage documents.
http://maven.apache.org/plugins/maven-site-plugin/examples/adding-deploy-protocol.html shows what we need to add to the pom.xml
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
From common-dev-return-77640-apmail-hadoop-common-dev-archive=hadoop.apache.org@hadoop.apache.org Tue Feb 7 22:37:25 2012
Return-Path: <common-dev-return-77640-apmail-hadoop-common-dev-archive=hadoop.apache.org@hadoop.apache.org>
X-Original-To: apmail-hadoop-common-dev-archive@www.apache.org
Delivered-To: apmail-hadoop-common-dev-archive@www.apache.org
Received: from mail.apache.org (hermes.apache.org [140.211.11.3])
by minotaur.apache.org (Postfix) with SMTP id 31B339B56
for <apmail-hadoop-common-dev-archive@www.apache.org>; Tue, 7 Feb 2012 22:37:25 +0000 (UTC)
Received: (qmail 69143 invoked by uid 500); 7 Feb 2012 22:37:23 -0000
Delivered-To: apmail-hadoop-common-dev-archive@hadoop.apache.org
Received: (qmail 68823 invoked by uid 500); 7 Feb 2012 22:37:21 -0000
Mailing-List: contact common-dev-help@hadoop.apache.org; run by ezmlm
Precedence: bulk
List-Help: <mailto:common-dev-help@hadoop.apache.org>
List-Unsubscribe: <mailto:common-dev-unsubscribe@hadoop.apache.org>
List-Post: <mailto:common-dev@hadoop.apache.org>
List-Id: <common-dev.hadoop.apache.org>
Reply-To: common-dev@hadoop.apache.org
Delivered-To: mailing list common-dev@hadoop.apache.org
Received: (qmail 68794 invoked by uid 99); 7 Feb 2012 22:37:21 -0000
Received: from athena.apache.org (HELO athena.apache.org) (140.211.11.136)
by apache.org (qpsmtpd/0.29) with ESMTP; Tue, 07 Feb 2012 22:37:21 +0000
X-ASF-Spam-Status: No, hits=-2000.0 required=5.0
tests=ALL_TRUSTED,T_RP_MATCHES_RCVD
X-Spam-Check-By: apache.org
Received: from [140.211.11.116] (HELO hel.zones.apache.org) (140.211.11.116)
by apache.org (qpsmtpd/0.29) with ESMTP; Tue, 07 Feb 2012 22:37:20 +0000
Received: from hel.zones.apache.org (hel.zones.apache.org [140.211.11.116])
by hel.zones.apache.org (Postfix) with ESMTP id 75D681A897E
for <common-dev@hadoop.apache.org>; Tue, 7 Feb 2012 22:37:00 +0000 (UTC)
Date: Tue, 7 Feb 2012 22:37:00 +0000 (UTC)
From: "Eli Collins (Created) (JIRA)" <jira@apache.org>
To: common-dev@hadoop.apache.org
Message-ID: <992444855.10923.1328654220484.JavaMail.tomcat@hel.zones.apache.org>
Subject: [jira] [Created] (HADOOP-8033) HADOOP_JAVA_PLATFORM_OPS is no
longer respected
MIME-Version: 1.0
Content-Type: text/plain; charset=utf-8
Content-Transfer-Encoding: 7bit
X-JIRA-FingerPrint: 30527f35849b9dde25b450d4833f0394
HADOOP_JAVA_PLATFORM_OPS is no longer respected
-----------------------------------------------
Key: HADOOP-8033
URL: https://issues.apache.org/jira/browse/HADOOP-8033
Project: Hadoop Common
Issue Type: Improvement
Components: conf
Affects Versions: 0.23.0, 0.22.0
Reporter: Eli Collins
Priority: Minor
HADOOP-6284 introduced HADOOP_JAVA_PLATFORM_OPS and it's in branch-1, however it's not in trunk or 22, 23. It's referenced in hadoop-env.sh (commented out) but not actually used anywhere, not sure when it was removed from bin/hadoop. Perhaps the intention was to just use HADOOP_OPTS?
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
From common-dev-return-77641-apmail-hadoop-common-dev-archive=hadoop.apache.org@hadoop.apache.org Tue Feb 7 22:39:24 2012
Return-Path: <common-dev-return-77641-apmail-hadoop-common-dev-archive=hadoop.apache.org@hadoop.apache.org>
X-Original-To: apmail-hadoop-common-dev-archive@www.apache.org
Delivered-To: apmail-hadoop-common-dev-archive@www.apache.org
Received: from mail.apache.org (hermes.apache.org [140.211.11.3])
by minotaur.apache.org (Postfix) with SMTP id C10EB9C01
for <apmail-hadoop-common-dev-archive@www.apache.org>; Tue, 7 Feb 2012 22:39:24 +0000 (UTC)
Received: (qmail 73643 invoked by uid 500); 7 Feb 2012 22:39:23 -0000
Delivered-To: apmail-hadoop-common-dev-archive@hadoop.apache.org
Received: (qmail 73390 invoked by uid 500); 7 Feb 2012 22:39:22 -0000
Mailing-List: contact common-dev-help@hadoop.apache.org; run by ezmlm
Precedence: bulk
List-Help: <mailto:common-dev-help@hadoop.apache.org>
List-Unsubscribe: <mailto:common-dev-unsubscribe@hadoop.apache.org>
List-Post: <mailto:common-dev@hadoop.apache.org>
List-Id: <common-dev.hadoop.apache.org>
Reply-To: common-dev@hadoop.apache.org
Delivered-To: mailing list common-dev@hadoop.apache.org
Received: (qmail 73377 invoked by uid 99); 7 Feb 2012 22:39:21 -0000
Received: from athena.apache.org (HELO athena.apache.org) (140.211.11.136)
by apache.org (qpsmtpd/0.29) with ESMTP; Tue, 07 Feb 2012 22:39:21 +0000
X-ASF-Spam-Status: No, hits=-2000.0 required=5.0
tests=ALL_TRUSTED,T_RP_MATCHES_RCVD
X-Spam-Check-By: apache.org
Received: from [140.211.11.116] (HELO hel.zones.apache.org) (140.211.11.116)
by apache.org (qpsmtpd/0.29) with ESMTP; Tue, 07 Feb 2012 22:39:21 +0000
Received: from hel.zones.apache.org (hel.zones.apache.org [140.211.11.116])
by hel.zones.apache.org (Postfix) with ESMTP id 0612B1A8A7D
for <common-dev@hadoop.apache.org>; Tue, 7 Feb 2012 22:39:01 +0000 (UTC)
Date: Tue, 7 Feb 2012 22:39:01 +0000 (UTC)
From: "Eli Collins (Created) (JIRA)" <jira@apache.org>
To: common-dev@hadoop.apache.org
Message-ID: <1866682653.10931.1328654341026.JavaMail.tomcat@hel.zones.apache.org>
Subject: [jira] [Created] (HADOOP-8034) Add comment/docs to enable
assertions in hadoop-env.sh
MIME-Version: 1.0
Content-Type: text/plain; charset=utf-8
Content-Transfer-Encoding: 7bit
X-JIRA-FingerPrint: 30527f35849b9dde25b450d4833f0394
Add comment/docs to enable assertions in hadoop-env.sh
------------------------------------------------------
Key: HADOOP-8034
URL: https://issues.apache.org/jira/browse/HADOOP-8034
Project: Hadoop Common
Issue Type: Improvement
Components: conf
Affects Versions: 1.0.0, 0.23.0
Reporter: Eli Collins
Assignee: Eli Collins
For testing it's useful to enable jvm assertions. Let's add a commented out line to hadoop-env.sh that sets the "-enableassertions" and "-enablesystemassertions" jvm options to make it easier to run "debug" builds. Per HADOOP-8033 perhaps this should be HADOOP_JAVA_PLATFORM_OPTS.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
From common-dev-return-77642-apmail-hadoop-common-dev-archive=hadoop.apache.org@hadoop.apache.org Wed Feb 8 00:46:55 2012
Return-Path: <common-dev-return-77642-apmail-hadoop-common-dev-archive=hadoop.apache.org@hadoop.apache.org>
X-Original-To: apmail-hadoop-common-dev-archive@www.apache.org
Delivered-To: apmail-hadoop-common-dev-archive@www.apache.org
Received: from mail.apache.org (hermes.apache.org [140.211.11.3])
by minotaur.apache.org (Postfix) with SMTP id D04169ECE
for <apmail-hadoop-common-dev-archive@www.apache.org>; Wed, 8 Feb 2012 00:46:55 +0000 (UTC)
Received: (qmail 43948 invoked by uid 500); 8 Feb 2012 00:46:54 -0000
Delivered-To: apmail-hadoop-common-dev-archive@hadoop.apache.org
Received: (qmail 43875 invoked by uid 500); 8 Feb 2012 00:46:53 -0000
Mailing-List: contact common-dev-help@hadoop.apache.org; run by ezmlm
Precedence: bulk
List-Help: <mailto:common-dev-help@hadoop.apache.org>
List-Unsubscribe: <mailto:common-dev-unsubscribe@hadoop.apache.org>
List-Post: <mailto:common-dev@hadoop.apache.org>
List-Id: <common-dev.hadoop.apache.org>
Reply-To: common-dev@hadoop.apache.org
Delivered-To: mailing list common-dev@hadoop.apache.org
Received: (qmail 43867 invoked by uid 99); 8 Feb 2012 00:46:53 -0000
Received: from nike.apache.org (HELO nike.apache.org) (192.87.106.230)
by apache.org (qpsmtpd/0.29) with ESMTP; Wed, 08 Feb 2012 00:46:53 +0000
X-ASF-Spam-Status: No, hits=-0.1 required=5.0
tests=HTML_MESSAGE,RCVD_IN_DNSWL_MED,SPF_PASS
X-Spam-Check-By: apache.org
Received-SPF: pass (nike.apache.org: domain of bbeaudreault@hubspot.com designates 74.125.149.201 as permitted sender)
Received: from [74.125.149.201] (HELO na3sys009aog109.obsmtp.com) (74.125.149.201)
by apache.org (qpsmtpd/0.29) with SMTP; Wed, 08 Feb 2012 00:46:44 +0000
Received: from mail-pz0-f44.google.com ([209.85.210.44]) (using TLSv1) by na3sys009aob109.postini.com ([74.125.148.12]) with SMTP
ID DSNKTzHF3mYEM7HSPcR8Y8JGDgvEJqGXnFRi@postini.com; Tue, 07 Feb 2012 16:46:23 PST
Received: by dakl33 with SMTP id l33so24846dak.17
for <common-dev@hadoop.apache.org>; Tue, 07 Feb 2012 16:46:22 -0800 (PST)
Received: by 10.68.212.161 with SMTP id nl1mr62537360pbc.38.1328661982105;
Tue, 07 Feb 2012 16:46:22 -0800 (PST)
MIME-Version: 1.0
Received: by 10.68.216.100 with HTTP; Tue, 7 Feb 2012 16:46:02 -0800 (PST)
From: Bryan Beaudreault <bbeaudreault@hubspot.com>
Date: Tue, 7 Feb 2012 19:46:02 -0500
Message-ID: <CANZDn9tsJnX9-pfgo2qkgMir=o1aUSkXzUcPVTjAU9y2qvFpcA@mail.gmail.com>
Subject: wiki privileges
To: common-dev@hadoop.apache.org
Content-Type: multipart/alternative; boundary=e89a8ff1c89c78511804b869390f
X-Virus-Checked: Checked by ClamAV on apache.org
--e89a8ff1c89c78511804b869390f
Content-Type: text/plain; charset=ISO-8859-1
Hello,
Can I please get wiki edit privileges for the username BryanBeaudreault?
Thanks!
Bryan
--e89a8ff1c89c78511804b869390f--
From common-dev-return-77643-apmail-hadoop-common-dev-archive=hadoop.apache.org@hadoop.apache.org Wed Feb 8 01:47:25 2012
Return-Path: <common-dev-return-77643-apmail-hadoop-common-dev-archive=hadoop.apache.org@hadoop.apache.org>
X-Original-To: apmail-hadoop-common-dev-archive@www.apache.org
Delivered-To: apmail-hadoop-common-dev-archive@www.apache.org
Received: from mail.apache.org (hermes.apache.org [140.211.11.3])
by minotaur.apache.org (Postfix) with SMTP id 64AF69017
for <apmail-hadoop-common-dev-archive@www.apache.org>; Wed, 8 Feb 2012 01:47:25 +0000 (UTC)
Received: (qmail 35828 invoked by uid 500); 8 Feb 2012 01:47:23 -0000
Delivered-To: apmail-hadoop-common-dev-archive@hadoop.apache.org
Received: (qmail 35542 invoked by uid 500); 8 Feb 2012 01:47:22 -0000
Mailing-List: contact common-dev-help@hadoop.apache.org; run by ezmlm
Precedence: bulk
List-Help: <mailto:common-dev-help@hadoop.apache.org>
List-Unsubscribe: <mailto:common-dev-unsubscribe@hadoop.apache.org>
List-Post: <mailto:common-dev@hadoop.apache.org>
List-Id: <common-dev.hadoop.apache.org>
Reply-To: common-dev@hadoop.apache.org
Delivered-To: mailing list common-dev@hadoop.apache.org
Received: (qmail 35526 invoked by uid 99); 8 Feb 2012 01:47:22 -0000
Received: from nike.apache.org (HELO nike.apache.org) (192.87.106.230)
by apache.org (qpsmtpd/0.29) with ESMTP; Wed, 08 Feb 2012 01:47:22 +0000
X-ASF-Spam-Status: No, hits=-2000.0 required=5.0
tests=ALL_TRUSTED,T_RP_MATCHES_RCVD
X-Spam-Check-By: apache.org
Received: from [140.211.11.116] (HELO hel.zones.apache.org) (140.211.11.116)
by apache.org (qpsmtpd/0.29) with ESMTP; Wed, 08 Feb 2012 01:47:20 +0000
Received: from hel.zones.apache.org (hel.zones.apache.org [140.211.11.116])
by hel.zones.apache.org (Postfix) with ESMTP id 26E041A99D8
for <common-dev@hadoop.apache.org>; Wed, 8 Feb 2012 01:46:59 +0000 (UTC)
Date: Wed, 8 Feb 2012 01:46:59 +0000 (UTC)
From: "Andrew Bayer (Created) (JIRA)" <jira@apache.org>
To: common-dev@hadoop.apache.org
Message-ID: <1871385707.12400.1328665619161.JavaMail.tomcat@hel.zones.apache.org>
Subject: [jira] [Created] (HADOOP-8035) Hadoop Maven build is inefficient
and runs phases redundantly
MIME-Version: 1.0
Content-Type: text/plain; charset=utf-8
Content-Transfer-Encoding: 7bit
X-JIRA-FingerPrint: 30527f35849b9dde25b450d4833f0394
X-Virus-Checked: Checked by ClamAV on apache.org
Hadoop Maven build is inefficient and runs phases redundantly
-------------------------------------------------------------
Key: HADOOP-8035
URL: https://issues.apache.org/jira/browse/HADOOP-8035
Project: Hadoop Common
Issue Type: Bug
Components: build
Affects Versions: 0.23.0
Reporter: Andrew Bayer
Priority: Minor
The Hadoop 0.23 Maven build has some major inefficiencies, most notably in site and javadoc. As a result of redundant plugin executions and certain plugin executions being inherited when they really shouldn't be, builds take a lot longer than they should.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
From common-dev-return-77644-apmail-hadoop-common-dev-archive=hadoop.apache.org@hadoop.apache.org Wed Feb 8 01:55:23 2012
Return-Path: <common-dev-return-77644-apmail-hadoop-common-dev-archive=hadoop.apache.org@hadoop.apache.org>
X-Original-To: apmail-hadoop-common-dev-archive@www.apache.org
Delivered-To: apmail-hadoop-common-dev-archive@www.apache.org
Received: from mail.apache.org (hermes.apache.org [140.211.11.3])
by minotaur.apache.org (Postfix) with SMTP id 8CD519184
for <apmail-hadoop-common-dev-archive@www.apache.org>; Wed, 8 Feb 2012 01:55:23 +0000 (UTC)
Received: (qmail 43900 invoked by uid 500); 8 Feb 2012 01:55:21 -0000
Delivered-To: apmail-hadoop-common-dev-archive@hadoop.apache.org
Received: (qmail 43488 invoked by uid 500); 8 Feb 2012 01:55:20 -0000
Mailing-List: contact common-dev-help@hadoop.apache.org; run by ezmlm
Precedence: bulk
List-Help: <mailto:common-dev-help@hadoop.apache.org>
List-Unsubscribe: <mailto:common-dev-unsubscribe@hadoop.apache.org>
List-Post: <mailto:common-dev@hadoop.apache.org>
List-Id: <common-dev.hadoop.apache.org>
Reply-To: common-dev@hadoop.apache.org
Delivered-To: mailing list common-dev@hadoop.apache.org
Received: (qmail 43466 invoked by uid 99); 8 Feb 2012 01:55:20 -0000
Received: from athena.apache.org (HELO athena.apache.org) (140.211.11.136)
by apache.org (qpsmtpd/0.29) with ESMTP; Wed, 08 Feb 2012 01:55:20 +0000
X-ASF-Spam-Status: No, hits=-2000.0 required=5.0
tests=ALL_TRUSTED,T_RP_MATCHES_RCVD
X-Spam-Check-By: apache.org
Received: from [140.211.11.116] (HELO hel.zones.apache.org) (140.211.11.116)
by apache.org (qpsmtpd/0.29) with ESMTP; Wed, 08 Feb 2012 01:55:19 +0000
Received: from hel.zones.apache.org (hel.zones.apache.org [140.211.11.116])
by hel.zones.apache.org (Postfix) with ESMTP id 8AC031A9E0F
for <common-dev@hadoop.apache.org>; Wed, 8 Feb 2012 01:54:59 +0000 (UTC)
Date: Wed, 8 Feb 2012 01:54:59 +0000 (UTC)
From: "Arun C Murthy (Resolved) (JIRA)" <jira@apache.org>
To: common-dev@hadoop.apache.org
Message-ID: <398340564.12454.1328666099570.JavaMail.tomcat@hel.zones.apache.org>
In-Reply-To: <1131110465.13902.1322330980114.JavaMail.tomcat@hel.zones.apache.org>
Subject: [jira] [Resolved] (HADOOP-7863) Apply HADOOP-7424 "Log an error if
the topology script doesn't handle multiple args" to 0.23 branch
MIME-Version: 1.0
Content-Type: text/plain; charset=utf-8
Content-Transfer-Encoding: 7bit
X-JIRA-FingerPrint: 30527f35849b9dde25b450d4833f0394
[ https://issues.apache.org/jira/browse/HADOOP-7863?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Arun C Murthy resolved HADOOP-7863.
-----------------------------------
Resolution: Duplicate
Closing as duplicate of HADOOP-7424, mucks up release notes and CHANGES.txt.
> Apply HADOOP-7424 "Log an error if the topology script doesn't handle multiple args" to 0.23 branch
> ----------------------------------------------------------------------------------------------------
>
> Key: HADOOP-7863
> URL: https://issues.apache.org/jira/browse/HADOOP-7863
> Project: Hadoop Common
> Issue Type: Bug
> Affects Versions: 0.23.0
> Reporter: Steve Loughran
> Assignee: Steve Loughran
> Priority: Minor
> Fix For: 0.23.1
>
> Original Estimate: 0.5h
> Remaining Estimate: 0.5h
>
> Merging HADOOP-7777 to 0.23.1 fails because this (minor) patch isn't in there. Rather than generate a new patch for 0.23.1, it would be easier to apply the existing patch to the 0.23.x branch and move the change log entries
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
From common-dev-return-77645-apmail-hadoop-common-dev-archive=hadoop.apache.org@hadoop.apache.org Wed Feb 8 01:55:26 2012
Return-Path: <common-dev-return-77645-apmail-hadoop-common-dev-archive=hadoop.apache.org@hadoop.apache.org>
X-Original-To: apmail-hadoop-common-dev-archive@www.apache.org
Delivered-To: apmail-hadoop-common-dev-archive@www.apache.org
Received: from mail.apache.org (hermes.apache.org [140.211.11.3])
by minotaur.apache.org (Postfix) with SMTP id 252E291C8
for <apmail-hadoop-common-dev-archive@www.apache.org>; Wed, 8 Feb 2012 01:55:26 +0000 (UTC)
Received: (qmail 45574 invoked by uid 500); 8 Feb 2012 01:55:23 -0000
Delivered-To: apmail-hadoop-common-dev-archive@hadoop.apache.org
Received: (qmail 44817 invoked by uid 500); 8 Feb 2012 01:55:22 -0000
Mailing-List: contact common-dev-help@hadoop.apache.org; run by ezmlm
Precedence: bulk
List-Help: <mailto:common-dev-help@hadoop.apache.org>
List-Unsubscribe: <mailto:common-dev-unsubscribe@hadoop.apache.org>
List-Post: <mailto:common-dev@hadoop.apache.org>
List-Id: <common-dev.hadoop.apache.org>
Reply-To: common-dev@hadoop.apache.org
Delivered-To: mailing list common-dev@hadoop.apache.org
Received: (qmail 44655 invoked by uid 99); 8 Feb 2012 01:55:22 -0000
Received: from nike.apache.org (HELO nike.apache.org) (192.87.106.230)
by apache.org (qpsmtpd/0.29) with ESMTP; Wed, 08 Feb 2012 01:55:22 +0000
X-ASF-Spam-Status: No, hits=-2000.0 required=5.0
tests=ALL_TRUSTED,T_RP_MATCHES_RCVD
X-Spam-Check-By: apache.org
Received: from [140.211.11.116] (HELO hel.zones.apache.org) (140.211.11.116)
by apache.org (qpsmtpd/0.29) with ESMTP; Wed, 08 Feb 2012 01:55:20 +0000
Received: from hel.zones.apache.org (hel.zones.apache.org [140.211.11.116])
by hel.zones.apache.org (Postfix) with ESMTP id 8344B1A9E0E
for <common-dev@hadoop.apache.org>; Wed, 8 Feb 2012 01:54:59 +0000 (UTC)
Date: Wed, 8 Feb 2012 01:54:59 +0000 (UTC)
From: "Arun C Murthy (Reopened) (JIRA)" <jira@apache.org>
To: common-dev@hadoop.apache.org
Message-ID: <562736736.12453.1328666099539.JavaMail.tomcat@hel.zones.apache.org>
In-Reply-To: <1131110465.13902.1322330980114.JavaMail.tomcat@hel.zones.apache.org>
Subject: [jira] [Reopened] (HADOOP-7863) Apply HADOOP-7424 "Log an error if
the topology script doesn't handle multiple args" to 0.23 branch
MIME-Version: 1.0
Content-Type: text/plain; charset=utf-8
Content-Transfer-Encoding: 7bit
X-JIRA-FingerPrint: 30527f35849b9dde25b450d4833f0394
X-Virus-Checked: Checked by ClamAV on apache.org
[ https://issues.apache.org/jira/browse/HADOOP-7863?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Arun C Murthy reopened HADOOP-7863:
-----------------------------------
> Apply HADOOP-7424 "Log an error if the topology script doesn't handle multiple args" to 0.23 branch
> ----------------------------------------------------------------------------------------------------
>
> Key: HADOOP-7863
> URL: https://issues.apache.org/jira/browse/HADOOP-7863
> Project: Hadoop Common
> Issue Type: Bug
> Affects Versions: 0.23.0
> Reporter: Steve Loughran
> Assignee: Steve Loughran
> Priority: Minor
> Fix For: 0.23.1
>
> Original Estimate: 0.5h
> Remaining Estimate: 0.5h
>
> Merging HADOOP-7777 to 0.23.1 fails because this (minor) patch isn't in there. Rather than generate a new patch for 0.23.1, it would be easier to apply the existing patch to the 0.23.x branch and move the change log entries
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
From common-dev-return-77646-apmail-hadoop-common-dev-archive=hadoop.apache.org@hadoop.apache.org Wed Feb 8 02:11:26 2012
Return-Path: <common-dev-return-77646-apmail-hadoop-common-dev-archive=hadoop.apache.org@hadoop.apache.org>
X-Original-To: apmail-hadoop-common-dev-archive@www.apache.org
Delivered-To: apmail-hadoop-common-dev-archive@www.apache.org
Received: from mail.apache.org (hermes.apache.org [140.211.11.3])
by minotaur.apache.org (Postfix) with SMTP id 568DA97F9
for <apmail-hadoop-common-dev-archive@www.apache.org>; Wed, 8 Feb 2012 02:11:26 +0000 (UTC)
Received: (qmail 71046 invoked by uid 500); 8 Feb 2012 02:11:24 -0000
Delivered-To: apmail-hadoop-common-dev-archive@hadoop.apache.org
Received: (qmail 70494 invoked by uid 500); 8 Feb 2012 02:11:23 -0000
Mailing-List: contact common-dev-help@hadoop.apache.org; run by ezmlm
Precedence: bulk
List-Help: <mailto:common-dev-help@hadoop.apache.org>
List-Unsubscribe: <mailto:common-dev-unsubscribe@hadoop.apache.org>
List-Post: <mailto:common-dev@hadoop.apache.org>
List-Id: <common-dev.hadoop.apache.org>
Reply-To: common-dev@hadoop.apache.org
Delivered-To: mailing list common-dev@hadoop.apache.org
Received: (qmail 70474 invoked by uid 99); 8 Feb 2012 02:11:22 -0000
Received: from nike.apache.org (HELO nike.apache.org) (192.87.106.230)
by apache.org (qpsmtpd/0.29) with ESMTP; Wed, 08 Feb 2012 02:11:22 +0000
X-ASF-Spam-Status: No, hits=-1998.0 required=5.0
tests=ALL_TRUSTED,FB_GET_MEDS,T_RP_MATCHES_RCVD
X-Spam-Check-By: apache.org
Received: from [140.211.11.116] (HELO hel.zones.apache.org) (140.211.11.116)
by apache.org (qpsmtpd/0.29) with ESMTP; Wed, 08 Feb 2012 02:11:20 +0000
Received: from hel.zones.apache.org (hel.zones.apache.org [140.211.11.116])
by hel.zones.apache.org (Postfix) with ESMTP id 98A4A1A88F8
for <common-dev@hadoop.apache.org>; Wed, 8 Feb 2012 02:10:59 +0000 (UTC)
Date: Wed, 8 Feb 2012 02:10:59 +0000 (UTC)
From: "Arun C Murthy (Resolved) (JIRA)" <jira@apache.org>
To: common-dev@hadoop.apache.org
Message-ID: <91269484.12560.1328667059626.JavaMail.tomcat@hel.zones.apache.org>
In-Reply-To: <447876036.39935.1326498640277.JavaMail.tomcat@hel.zones.apache.org>
Subject: [jira] [Resolved] (HADOOP-7974) TestViewFsTrash incorrectly
determines the user's home directory
MIME-Version: 1.0
Content-Type: text/plain; charset=utf-8
Content-Transfer-Encoding: 7bit
X-JIRA-FingerPrint: 30527f35849b9dde25b450d4833f0394
X-Virus-Checked: Checked by ClamAV on apache.org
[ https://issues.apache.org/jira/browse/HADOOP-7974?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Arun C Murthy resolved HADOOP-7974.
-----------------------------------
Resolution: Fixed
It's been fixed for a while.
> TestViewFsTrash incorrectly determines the user's home directory
> ----------------------------------------------------------------
>
> Key: HADOOP-7974
> URL: https://issues.apache.org/jira/browse/HADOOP-7974
> Project: Hadoop Common
> Issue Type: Bug
> Components: fs
> Affects Versions: 0.23.1
> Reporter: Eli Collins
> Assignee: Harsh J
> Fix For: 0.23.1
>
> Attachments: HADOOP-7974.patch
>
>
> HADOOP-7284 added a test called TestViewFsTrash which contains the following code to determine the user's home directory. It only works if the user's directory is one level deep, and breaks if the home directory is more than one level deep (eg user hudson, who's home dir might be /usr/lib/hudson instead of /home/hudson).
> {code}
> // create a link for home directory so that trash path works
> // set up viewfs's home dir root to point to home dir root on target
> // But home dir is different on linux, mac etc.
> // Figure it out by calling home dir on target
>
> String homeDir = fsTarget.getHomeDirectory().toUri().getPath();
> int indexOf2ndSlash = homeDir.indexOf('/', 1);
> String homeDirRoot = homeDir.substring(0, indexOf2ndSlash);
> ConfigUtil.addLink(conf, homeDirRoot,
> fsTarget.makeQualified(new Path(homeDirRoot)).toUri());
> ConfigUtil.setHomeDirConf(conf, homeDirRoot);
> Log.info("Home dir base " + homeDirRoot);
> {code}
> Seems like we should instead search from the end of the path for the last slash and use that as the base, ie ask the home directory for its parent.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
From common-dev-return-77647-apmail-hadoop-common-dev-archive=hadoop.apache.org@hadoop.apache.org Wed Feb 8 04:14:18 2012
Return-Path: <common-dev-return-77647-apmail-hadoop-common-dev-archive=hadoop.apache.org@hadoop.apache.org>
X-Original-To: apmail-hadoop-common-dev-archive@www.apache.org
Delivered-To: apmail-hadoop-common-dev-archive@www.apache.org
Received: from mail.apache.org (hermes.apache.org [140.211.11.3])
by minotaur.apache.org (Postfix) with SMTP id 114F89E61
for <apmail-hadoop-common-dev-archive@www.apache.org>; Wed, 8 Feb 2012 04:14:18 +0000 (UTC)
Received: (qmail 19557 invoked by uid 500); 8 Feb 2012 04:14:13 -0000
Delivered-To: apmail-hadoop-common-dev-archive@hadoop.apache.org
Received: (qmail 18816 invoked by uid 500); 8 Feb 2012 04:14:00 -0000
Mailing-List: contact common-dev-help@hadoop.apache.org; run by ezmlm
Precedence: bulk
List-Help: <mailto:common-dev-help@hadoop.apache.org>
List-Unsubscribe: <mailto:common-dev-unsubscribe@hadoop.apache.org>
List-Post: <mailto:common-dev@hadoop.apache.org>
List-Id: <common-dev.hadoop.apache.org>
Reply-To: common-dev@hadoop.apache.org
Delivered-To: mailing list common-dev@hadoop.apache.org
Received: (qmail 18725 invoked by uid 99); 8 Feb 2012 04:13:57 -0000
Received: from athena.apache.org (HELO athena.apache.org) (140.211.11.136)
by apache.org (qpsmtpd/0.29) with ESMTP; Wed, 08 Feb 2012 04:13:57 +0000
X-ASF-Spam-Status: No, hits=0.5 required=5.0
tests=FREEMAIL_ENVFROM_END_DIGIT,FREEMAIL_REPLYTO_END_DIGIT,RCVD_IN_DNSWL_NONE,SPF_PASS
X-Spam-Check-By: apache.org
Received-SPF: pass (athena.apache.org: local policy)
Received: from [98.138.90.58] (HELO nm11-vm0.bullet.mail.ne1.yahoo.com) (98.138.90.58)
by apache.org (qpsmtpd/0.29) with SMTP; Wed, 08 Feb 2012 04:13:51 +0000
Received: from [98.138.90.49] by nm11.bullet.mail.ne1.yahoo.com with NNFMP; 08 Feb 2012 04:13:30 -0000
Received: from [98.138.87.9] by tm2.bullet.mail.ne1.yahoo.com with NNFMP; 08 Feb 2012 04:13:30 -0000
Received: from [127.0.0.1] by omp1009.mail.ne1.yahoo.com with NNFMP; 08 Feb 2012 04:13:30 -0000
X-Yahoo-Newman-Property: ymail-3
X-Yahoo-Newman-Id: 392551.139.bm@omp1009.mail.ne1.yahoo.com
Received: (qmail 22298 invoked by uid 60001); 8 Feb 2012 04:13:30 -0000
DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=yahoo.com; s=s1024; t=1328674410; bh=ZhZRUXkn+2fwY61hdkyTMpki/qKjlMtltPyg2D1+/cA=; h=X-YMail-OSG:Received:X-Mailer:References:Message-ID:Date:From:Reply-To:Subject:To:In-Reply-To:MIME-Version:Content-Type:Content-Transfer-Encoding; b=mwP/+fkoDrFbWEAcROObVfrjcTjRU+Ykw0x/dCRb25/aKAIm2XdpSP5MwM8fQ10lnS8CZ8DW2fqOH2fXNUd+9mmFOOrD1tYnJQZRJOQRqL2Ijoi/oClYtqv0iCNvO064+B/deMrLRxSgeLAzRyKdnvyaKkQKSu8Ez8U2d7G9Y4k=
DomainKey-Signature:a=rsa-sha1; q=dns; c=nofws;
s=s1024; d=yahoo.com;
h=X-YMail-OSG:Received:X-Mailer:References:Message-ID:Date:From:Reply-To:Subject:To:In-Reply-To:MIME-Version:Content-Type:Content-Transfer-Encoding;
b=KBqQvyJHx4HrcjxnBodt2bvUnGjn+89Xj97Ni6Zf5rqlGNBzTf8MXrRMxpNX8ekzExDT2Kd/vRoTJFk9cDYDO/CjsTkLYjs22EONS6bzET6Kw4TSg68tMxfLt68DDkM6rPXnx1Zwa3SvV0Yix0H1zcaXU+LXNo3OSlVyK3MKzNM=;
X-YMail-OSG: vinIFT0VM1nFrjTlxrIZsTiAqKjy_NpsivGygu2AC5XC4cV
KqnSWkc8pYI9rLbOP4XMD7zsqEoAy8.O_QpS7ijvJ6qt8WW8f4gcggTAIgHs
Deu_0cCeM8c13_wZ776FQKhbi5JAHkvIPuMKkbXNOjQantDjK5D1EChtI4_k
4jdnRgE_oogfqvyHlYaRANojbrXq3h8AoZDWDp4Py_7EVYy.rWh9jqS1s1TR
Qssr7sHZzGJNZHwy8o34pVpkPJpxQKcmI6Q9jTvk2wNhfEm9.J8bHZZCQLOX
Zu9DX9pNNp9hjemgItLeOoW0D7PTeKj4RrK1updxQc5nxfi4buHF8bzfQqGt
3bY._Eduy1JlbaF0tVUUJInn7xJ.ftIuUQuQIJj.H.12orh0LJqo7iQi83UC
bLoTZgkqAUV0dRuVUv0H_gOnH8miuLhq_ygV1G3SDE8JDrwl3gNY9AaNklDE
_9CZqe1.DMeweK4sjN31rbiC0DxiC5FRUx4BI9LYSMK.VqiDhcjiF.T0DtSY
csiq22RrbE3o8CQeubHZLiH2ds3mgFBiQBnhjPSPPJN0yb0xCvRg.bCOSbqe
mn44Z.1P.EMVsA0wNtnR3EYujoJP.BjbNwHc6rX6488Q5Ks6MVk3CLqKouea
qVYJS1VhuApUm6enaHgU4s12QOn23gW93n2yYWhoM3jU6BsIk3w7LN8Ejzm0
p42nYcZgIyd78uVfm6nkGNi_3i8iuCuZvmwxeQaxsUxWAs7NU1HIBpCeXVPF
3KmfdrUF0xL5Fk0wqmQDkzzttmUlsuFgYXDyNRig82NulNA8fNPAsecKQFGI
9W0Xg_QJ.tTWMzKIC2ro8ZMN0TUpgpo.oHCp7bYn5kvjdM2f4yeTBzamCR6O
.R9Qg6n.1uFoIsttNuoxPzPIEDPeTnTkRQ7VasZ_s.dS6oPxfVHk0GRJ0f0r
hPLfpx9zxa6aGjWpscrUz4fqJT.Rka5R6idCOZvrbCdo2WUc3FJAGHnhiME4
bUxedYDvxnpabq3GYYGYqt8a3uFKNTUKrtBUMCmqGZbm4Gsd5oeVqgsrpci9
QnuSuT90DcyekFjQ8TCNus.GGkIt2kw--
Received: from [174.113.144.83] by web121205.mail.ne1.yahoo.com via HTTP; Tue, 07 Feb 2012 20:13:30 PST
X-Mailer: YahooMailWebService/0.8.116.338427
References: <1327880657.10233.YahooMailNeo@web121206.mail.ne1.yahoo.com> <1328246840.72176.YahooMailNeo@web121204.mail.ne1.yahoo.com> <CAOcnVr1eBdvCUHJ2nn4vH2q2vTCCmjOPGdZHBt7pog7tpbbKSA@mail.gmail.com> <1328492928.7909.YahooMailNeo@web121201.mail.ne1.yahoo.com> <1328496741.60161.YahooMailNeo@web121205.mail.ne1.yahoo.com>
Message-ID: <1328674410.4792.YahooMailNeo@web121205.mail.ne1.yahoo.com>
Date: Tue, 7 Feb 2012 20:13:30 -0800 (PST)
From: Hai Huang <hhuang2012@yahoo.com>
Reply-To: Hai Huang <hhuang2012@yahoo.com>
Subject: Re: Issue on running examples
To: "common-dev@hadoop.apache.org" <common-dev@hadoop.apache.org>
In-Reply-To: <1328496741.60161.YahooMailNeo@web121205.mail.ne1.yahoo.com>
MIME-Version: 1.0
Content-Type: text/plain; charset=iso-8859-1
Content-Transfer-Encoding: quoted-printable
Figured out the issue. It is due to=A0incorrectly using=A0=A0parameters=A0 =
in "-Dmapreduce.job.user.name=3D$USER -Dmapreduce.clientfactory.class.name=
=3Dorg.apache.hadoop.mapred.YarnClientFactory -Dmapreduce.randomwriter.byte=
spermap=3D10000 -Ddfs.blocksize=3D536870912 -Ddfs.block.size=3D536870912 -l=
ibjars ./share/hadoop/mapreduce/hadoop-mapreduce-client-jobclient-0.24.0-SN=
APSHOT.jar "=0A=A0=0AIf I cancel them , then the example run=A0, but=A0stil=
l got some exceptions=A0thrown in the result, for example=0A=A0=0A"=0A2012-=
02-07 20:05:25,202 WARN=A0 mapreduce.Job (Job.java:getTaskLogs(1460)) - Err=
or reading task output Server returned HTTP response code: 400 for URL: htt=
p://localhost:8080/tasklog?plaintext=3Dtrue&attemptid=3Dattempt_13286728955=
60_0002_m_000003_1&filter=3Dstdout=0A"=A0=0AThe link above displayed page w=
ith "Required param job, map and reduce"=0A=0AI am going to=A0check=A0 more=
=A0of them.=0A=0AHai=0A=A0=0A----- Original Message -----=0AFrom: Hai Huang=
<hhuang2012@yahoo.com>=0ATo: "common-dev@hadoop.apache.org" <common-dev@ha=
doop.apache.org>=0ACc: =0ASent: Sunday, February 5, 2012 9:52:21 PM=0ASubje=
ct: Re: Issue on running examples=0A=0AI am doing following steps to runnin=
g a example=A0-- randomwriter=0A=A0=0A1.=A0=A0=A0=A0 sbin/hadoop-daemon.sh =
start namenode-Dmapreduce.job.user.name=3D$USER -Dmapreduce.clientfactory.c=
lass.name=3Dorg.apache.hadoop.mapred.YarnClientFactory -Dmapreduce.randomwr=
iter.bytespermap=3D10000 -Ddfs.blocksize=3D536870912 -Ddfs.block.size=3D536=
870912 -libjars ./share/hadoop/mapreduce/hadoop-mapreduce-client-jobclient-=
0.24.0-SNAPSHOT.jar=A0=0A=A0=0A2. =A0=A0=A0=A0sbin/hadoop-daemon.sh start d=
atanode=0A=A0=0A3.=A0=A0=A0=A0bin/yarn-daemon.sh start resourcemanager=0A=
=A0=0A4.=A0=A0=A0=A0bin/yarn-daemon.sh start nodemanager=0A=A0=0A5.=A0 ./bi=
n/hadoop jar ./share/hadoop/mapreduce/hadoop-mapreduce-examples-0.24.0-SNAP=
SHOT.jar randomwriter output=0A=A0=0AThe step reported error message in bel=
ow:=0A=A0=0A=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=
=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=
=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=0A=A0=0A=
2012-02-05 18:44:21,905 WARN=A0 conf.Configuration (Configuration.java:set(=
639)) - mapred.used.genericoptionsparser is deprecated. Instead, use mapred=
uce.client.genericoptionsparser.used=0ARunning 10 maps.=0AJob started: Sun =
Feb 05 18:44:22 PST 2012=0A2012-02-05 18:44:22,512 WARN=A0 conf.Configurati=
on (Configuration.java:handleDeprecation(326)) - fs.default.name is depreca=
ted. Instead, use fs.defaultFS=0A2012-02-05 18:44:22,618 WARN=A0 hdfs.DFSCl=
ient (DFSOutputStream.java:run(549)) - DataStreamer Exception=0Ajava.io.IOE=
xception: java.io.IOException: File /tmp/hadoop-yarn/staging/hai/.staging/j=
ob_1328468416955_0007/libjars/hadoop-mapreduce-client-jobclient-0.24.0-SNAP=
SHOT.jar could only be replicated to 0 nodes instead of minReplication (=3D=
1).=A0 There are 1 datanode(s) running and no node(s) are excluded in this =
operation.=0A=A0=A0=A0=A0=A0=A0=A0 at org.apache.hadoop.hdfs.server.blockma=
nagement.BlockManager.chooseTarget(BlockManager.java:1145)=0A=A0=A0=A0=A0=
=A0=A0=A0 at org.apache.hadoop.hdfs.server.namenode.FSNamesystem.getAdditio=
nalBlock(FSNamesystem.java:1540)=0A=A0=A0=A0=A0=A0=A0=A0 at org.apache.hado=
op.hdfs.server.namenode.NameNodeRpcServer.addBlock(NameNodeRpcServer.java:4=
77)=0A=A0=A0=A0=A0=A0=A0=A0 at org.apache.hadoop.hdfs.protocolPB.ClientName=
nodeProtocolServerSideTranslatorPB.addBlock(ClientNamenodeProtocolServerSid=
eTranslatorPB.java:346)=0A=A0=A0=A0=A0=A0=A0=A0 at org.apache.hadoop.hdfs.p=
rotocol.proto.ClientNamenodeProtocolProtos$ClientNamenodeProtocol$2.callBlo=
ckingMethod(ClientNamenodeProtocolProtos.java:42602)=0A=A0=A0=A0=A0=A0=A0=
=A0 at org.apache.hadoop.ipc.ProtobufRpcEngine$Server$ProtoBufRpcInvoker.ca=
ll(ProtobufRpcEngine.java:439)=0A=A0=A0=A0=A0=A0=A0=A0 at org.apache.hadoop=
.ipc.RPC$Server.call(RPC.java:862)=0A=A0=A0=A0=A0=A0=A0=A0 at org.apache.ha=
doop.ipc.Server$Handler$1.run(Server.java:1608)=0A=A0=A0=A0=A0=A0=A0=A0 at =
org.apache.hadoop.ipc.Server$Handler$1.run(Server.java:1604)=0A=A0=A0=A0=A0=
=A0=A0=A0 at java.security.AccessController.doPrivileged(Native Method)=0A=
=A0=A0=A0=A0=A0=A0=A0 at javax.security.auth.Subject.doAs(Subject.java:416)=
=0A=A0=A0=A0=A0=A0=A0=A0 at org.apache.hadoop.security.UserGroupInformation=
.doAs(UserGroupInformation.java:1177)=0A=A0=A0=A0=A0=A0=A0=A0 at org.apache=
.hadoop.ipc.Server$Handler.run(Server.java:1602)=0A=A0=A0=A0=A0=A0=A0=A0 at=
org.apache.hadoop.ipc.ProtobufRpcEngine$Invoker.invoke(ProtobufRpcEngine.j=
ava:203)=0A=A0=A0=A0=A0=A0=A0=A0 at $Proxy10.addBlock(Unknown Source)=0A=A0=
=A0=A0=A0=A0=A0=A0 at sun.reflect.NativeMethodAccessorImpl.invoke0(Native M=
ethod)=0A=A0=A0=A0=A0=A0=A0=A0 at sun.reflect.NativeMethodAccessorImpl.invo=
ke(NativeMethodAccessorImpl.java:57)=0A=A0=A0=A0=A0=A0=A0=A0 at sun.reflect=
.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)=
=0A=A0=A0=A0=A0=A0=A0=A0 at java.lang.reflect.Method.invoke(Method.java:616=
)=0A=A0=A0=A0=A0=A0=A0=A0 at org.apache.hadoop.io.retry.RetryInvocationHand=
ler.invokeMethod(RetryInvocationHandler.java:127)=0A=A0=A0=A0=A0=A0=A0=A0 a=
t org.apache.hadoop.io.retry.RetryInvocationHandler.invoke(RetryInvocationH=
andler.java:81)=0A=A0=A0=A0=A0=A0=A0=A0 at $Proxy10.addBlock(Unknown Source=
)=0A=A0=A0=A0=A0=A0=A0=A0 at org.apache.hadoop.hdfs.protocolPB.ClientNameno=
deProtocolTranslatorPB.addBlock(ClientNamenodeProtocolTranslatorPB.java:355=
)=0A=A0=A0=A0=A0=A0=A0=A0 at org.apache.hadoop.hdfs.DFSOutputStream$DataStr=
eamer.locateFollowingBlock(DFSOutputStream.java:1097)=0A=A0=A0=A0=A0=A0=A0=
=A0 at org.apache.hadoop.hdfs.DFSOutputStream$DataStreamer.nextBlockOutputS=
tream(DFSOutputStream.java:973)=0A=A0=A0=A0=A0=A0=A0=A0 at org.apache.hadoo=
p.hdfs.DFSOutputStream$DataStreamer.run(DFSOutputStream.java:455)=0A2012-02=
-05 18:44:22,620 INFO=A0 mapreduce.JobSubmitter (JobSubmitter.java:submitJo=
bInternal(388)) - Cleaning up the staging area /tmp/hadoop-yarn/staging/hai=
/.staging/job_1328468416955_0007=0A2012-02-05 18:44:22,626 ERROR security.U=
serGroupInformation (UserGroupInformation.java:doAs(1180)) - PriviledgedAct=
ionException as:hai (auth:SIMPLE) cause:java.io.IOException: java.io.IOExce=
ption: File /tmp/hadoop-yarn/staging/hai/.staging/job_1328468416955_0007/li=
bjars/hadoop-mapreduce-client-jobclient-0.24.0-SNAPSHOT.jar could only be r=
eplicated to 0 nodes instead of minReplication (=3D1).=A0 There are 1 datan=
ode(s) running and no node(s) are excluded in this operation.=0A=A0=A0=A0=
=A0=A0=A0=A0 at org.apache.hadoop.hdfs.server.blockmanagement.BlockManager.=
chooseTarget(BlockManager.java:1145)=0A=A0=A0=A0=A0=A0=A0=A0 at org.apache.=
hadoop.hdfs.server.namenode.FSNamesystem.getAdditionalBlock(FSNamesystem.ja=
va:1540)=0A=A0=A0=A0=A0=A0=A0=A0 at org.apache.hadoop.hdfs.server.namenode.=
NameNodeRpcServer.addBlock(NameNodeRpcServer.java:477)=0A=A0=A0=A0=A0=A0=A0=
=A0 at org.apache.hadoop.hdfs.protocolPB.ClientNamenodeProtocolServerSideTr=
anslatorPB.addBlock(ClientNamenodeProtocolServerSideTranslatorPB.java:346)=
=0A=A0=A0=A0=A0=A0=A0=A0 at org.apache.hadoop.hdfs.protocol.proto.ClientNam=
enodeProtocolProtos$ClientNamenodeProtocol$2.callBlockingMethod(ClientNamen=
odeProtocolProtos.java:42602)=0A=A0=A0=A0=A0=A0=A0=A0 at org.apache.hadoop.=
ipc.ProtobufRpcEngine$Server$ProtoBufRpcInvoker.call(ProtobufRpcEngine.java=
:439)=0A=A0=A0=A0=A0=A0=A0=A0 at org.apache.hadoop.ipc.RPC$Server.call(RPC.=
java:862)=0A=A0=A0=A0=A0=A0=A0=A0 at org.apache.hadoop.ipc.Server$Handler$1=
.run(Server.java:1608)=0A=A0=A0=A0=A0=A0=A0=A0 at org.apache.hadoop.ipc.Ser=
ver$Handler$1.run(Server.java:1604)=0A=A0=A0=A0=A0=A0=A0=A0 at java.securit=
y.AccessController.doPrivileged(Native Method)=0A=A0=A0=A0=A0=A0=A0=A0 at j=
avax.security.auth.Subject.doAs(Subject.java:416)=0A=A0=A0=A0=A0=A0=A0=A0 a=
t org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation=
.java:1177)=0A=A0=A0=A0=A0=A0=A0=A0 at org.apache.hadoop.ipc.Server$Handler=
.run(Server.java:1602)=0Ajava.io.IOException: java.io.IOException: File /tm=
p/hadoop-yarn/staging/hai/.staging/job_1328468416955_0007/libjars/hadoop-ma=
preduce-client-jobclient-0.24.0-SNAPSHOT.jar could only be replicated to 0 =
nodes instead of minReplication (=3D1).=A0 There are 1 datanode(s) running =
and no node(s) are excluded in this operation.=0A=A0=A0=A0=A0=A0=A0=A0 at o=
rg.apache.hadoop.hdfs.server.blockmanagement.BlockManager.chooseTarget(Bloc=
kManager.java:1145)=0A=A0=A0=A0=A0=A0=A0=A0 at org.apache.hadoop.hdfs.serve=
r.namenode.FSNamesystem.getAdditionalBlock(FSNamesystem.java:1540)=0A=A0=A0=
=A0=A0=A0=A0=A0 at org.apache.hadoop.hdfs.server.namenode.NameNodeRpcServer=
.addBlock(NameNodeRpcServer.java:477)=0A=A0=A0=A0=A0=A0=A0=A0 at org.apache=
.hadoop.hdfs.protocolPB.ClientNamenodeProtocolServerSideTranslatorPB.addBlo=
ck(ClientNamenodeProtocolServerSideTranslatorPB.java:346)=0A=A0=A0=A0=A0=A0=
=A0=A0 at org.apache.hadoop.hdfs.protocol.proto.ClientNamenodeProtocolProto=
s$ClientNamenodeProtocol$2.callBlockingMethod(ClientNamenodeProtocolProtos.=
java:42602)=0A=A0=A0=A0=A0=A0=A0=A0 at org.apache.hadoop.ipc.ProtobufRpcEng=
ine$Server$ProtoBufRpcInvoker.call(ProtobufRpcEngine.java:439)=0A=A0=A0=A0=
=A0=A0=A0=A0 at org.apache.hadoop.ipc.RPC$Server.call(RPC.java:862)=0A=A0=
=A0=A0=A0=A0=A0=A0 at org.apache.hadoop.ipc.Server$Handler$1.run(Server.jav=
a:1608)=0A=A0=A0=A0=A0=A0=A0=A0 at org.apache.hadoop.ipc.Server$Handler$1.r=
un(Server.java:1604)=0A=A0=A0=A0=A0=A0=A0=A0 at java.security.AccessControl=
ler.doPrivileged(Native Method)=0A=A0=A0=A0=A0=A0=A0=A0 at javax.security.a=
uth.Subject.doAs(Subject.java:416)=0A=A0=A0=A0=A0=A0=A0=A0 at org.apache.ha=
doop.security.UserGroupInformation.doAs(UserGroupInformation.java:1177)=0A=
=A0=A0=A0=A0=A0=A0=A0 at org.apache.hadoop.ipc.Server$Handler.run(Server.ja=
va:1602)=0A=A0=A0=A0=A0=A0=A0=A0 at org.apache.hadoop.ipc.ProtobufRpcEngine=
$Invoker.invoke(ProtobufRpcEngine.java:203)=0A=A0=A0=A0=A0=A0=A0=A0 at $Pro=
xy10.addBlock(Unknown Source)=0A=A0=A0=A0=A0=A0=A0=A0 at sun.reflect.Native=
MethodAccessorImpl.invoke0(Native Method)=0A=A0=A0=A0=A0=A0=A0=A0 at sun.re=
flect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57)=0A=
=A0=A0=A0=A0=A0=A0=A0 at sun.reflect.DelegatingMethodAccessorImpl.invoke(De=
legatingMethodAccessorImpl.java:43)=0A=A0=A0=A0=A0=A0=A0=A0 at java.lang.re=
flect.Method.invoke(Method.java:616)=0A=A0=A0=A0=A0=A0=A0=A0 at org.apache.=
hadoop.io.retry.RetryInvocationHandler.invokeMethod(RetryInvocationHandler.=
java:127)=0A=A0=A0=A0=A0=A0=A0=A0 at org.apache.hadoop.io.retry.RetryInvoca=
tionHandler.invoke(RetryInvocationHandler.java:81)=0A=A0=A0=A0=A0=A0=A0=A0 =
at $Proxy10.addBlock(Unknown Source)=0A=A0=A0=A0=A0=A0=A0=A0 at org.apache.=
hadoop.hdfs.protocolPB.ClientNamenodeProtocolTranslatorPB.addBlock(ClientNa=
menodeProtocolTranslatorPB.java:355)=0A=A0=A0=A0=A0=A0=A0=A0 at org.apache.=
hadoop.hdfs.DFSOutputStream$DataStreamer.locateFollowingBlock(DFSOutputStre=
am.java:1097)=0A=A0=A0=A0=A0=A0=A0=A0 at org.apache.hadoop.hdfs.DFSOutputSt=
ream$DataStreamer.nextBlockOutputStream(DFSOutputStream.java:973)=0A=A0=A0=
=A0=A0=A0=A0=A0 at org.apache.hadoop.hdfs.DFSOutputStream$DataStreamer.run(=
DFSOutputStream.java:455)=0A2012-02-05 18:44:22,629 ERROR hdfs.DFSClient (D=
FSClient.java:closeAllFilesBeingWritten(435)) - Failed to close file /tmp/h=
adoop-yarn/staging/hai/.staging/job_1328468416955_0007/libjars/hadoop-mapre=
duce-client-jobclient-0.24.0-SNAPSHOT.jar=0Ajava.io.IOException: java.io.IO=
Exception: File /tmp/hadoop-yarn/staging/hai/.staging/job_1328468416955_000=
7/libjars/hadoop-mapreduce-client-jobclient-0.24.0-SNAPSHOT.jar could only =
be replicated to 0 nodes instead of minReplication (=3D1).=A0 There are 1 d=
atanode(s) running and no node(s) are excluded in this operation.=0A=A0=A0=
=A0=A0=A0=A0=A0 at org.apache.hadoop.hdfs.server.blockmanagement.BlockManag=
er.chooseTarget(BlockManager.java:1145)=0A=A0=A0=A0=A0=A0=A0=A0 at org.apac=
he.hadoop.hdfs.server.namenode.FSNamesystem.getAdditionalBlock(FSNamesystem=
.java:1540)=0A=A0=A0=A0=A0=A0=A0=A0 at org.apache.hadoop.hdfs.server.nameno=
de.NameNodeRpcServer.addBlock(NameNodeRpcServer.java:477)=0A=A0=A0=A0=A0=A0=
=A0=A0 at org.apache.hadoop.hdfs.protocolPB.ClientNamenodeProtocolServerSid=
eTranslatorPB.addBlock(ClientNamenodeProtocolServerSideTranslatorPB.java:34=
6)=0A=A0=A0=A0=A0=A0=A0=A0 at org.apache.hadoop.hdfs.protocol.proto.ClientN=
amenodeProtocolProtos$ClientNamenodeProtocol$2.callBlockingMethod(ClientNam=
enodeProtocolProtos.java:42602)=0A=A0=A0=A0=A0=A0=A0=A0 at org.apache.hadoo=
p.ipc.ProtobufRpcEngine$Server$ProtoBufRpcInvoker.call(ProtobufRpcEngine.ja=
va:439)=0A=A0=A0=A0=A0=A0=A0=A0 at org.apache.hadoop.ipc.RPC$Server.call(RP=
C.java:862)=0A=A0=A0=A0=A0=A0=A0=A0 at org.apache.hadoop.ipc.Server$Handler=
$1.run(Server.java:1608)=0A=A0=A0=A0=A0=A0=A0=A0 at org.apache.hadoop.ipc.S=
erver$Handler$1.run(Server.java:1604)=0A=A0=A0=A0=A0=A0=A0=A0 at java.secur=
ity.AccessController.doPrivileged(Native Method)=0A=A0=A0=A0=A0=A0=A0=A0 at=
javax.security.auth.Subject.doAs(Subject.java:416)=0A=A0=A0=A0=A0=A0=A0=A0=
at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformati=
on.java:1177)=0A=A0=A0=A0=A0=A0=A0=A0 at org.apache.hadoop.ipc.Server$Handl=
er.run(Server.java:1602)=0A=A0=A0=A0=A0=A0=A0=A0 at org.apache.hadoop.ipc.P=
rotobufRpcEngine$Invoker.invoke(ProtobufRpcEngine.java:203)=0A=A0=A0=A0=A0=
=A0=A0=A0 at $Proxy10.addBlock(Unknown Source)=0A=A0=A0=A0=A0=A0=A0=A0 at s=
un.reflect.NativeMethodAccessorImpl.invoke0(Native Method)=0A=A0=A0=A0=A0=
=A0=A0=A0 at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccess=
orImpl.java:57)=0A=A0=A0=A0=A0=A0=A0=A0 at sun.reflect.DelegatingMethodAcce=
ssorImpl.invoke(DelegatingMethodAccessorImpl.java:43)=0A=A0=A0=A0=A0=A0=A0=
=A0 at java.lang.reflect.Method.invoke(Method.java:616)=0A=A0=A0=A0=A0=A0=
=A0=A0 at org.apache.hadoop.io.retry.RetryInvocationHandler.invokeMethod(Re=
tryInvocationHandler.java:127)=0A=A0=A0=A0=A0=A0=A0=A0 at org.apache.hadoop=
.io.retry.RetryInvocationHandler.invoke(RetryInvocationHandler.java:81)=0A=
=A0=A0=A0=A0=A0=A0=A0 at $Proxy10.addBlock(Unknown Source)=0A=A0=A0=A0=A0=
=A0=A0=A0 at org.apache.hadoop.hdfs.protocolPB.ClientNamenodeProtocolTransl=
atorPB.addBlock(ClientNamenodeProtocolTranslatorPB.java:355)=0A=A0=A0=A0=A0=
=A0=A0=A0 at org.apache.hadoop.hdfs.DFSOutputStream$DataStreamer.locateFoll=
owingBlock(DFSOutputStream.java:1097)=0A=A0=A0=A0=A0=A0=A0=A0 at org.apache=
.hadoop.hdfs.DFSOutputStream$DataStreamer.nextBlockOutputStream(DFSOutputSt=
ream.java:973)=0A=A0=A0=A0=A0=A0=A0=A0 at org.apache.hadoop.hdfs.DFSOutputS=
tream$DataStreamer.run(DFSOutputStream.java:455)=0A=A0=3D=3D=3D=3D=3D=3D=3D=
=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=
=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=
=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=0A=A0=0AAny ideas about this issue ? Also=
, I tried to used following command=0A=A0=0Asbin/stop-dfs.sh=0Aand got iss=
ues of =0A=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=
=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=
=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=0AStoppi=
ng namenodes on [localhost]=0Alocalhost: stopping namenode=0Acat: /home/hai=
/hadoop-common/hadoop-dist/target/hadoop-0.24.0-SNAPSHOT/conf//slaves: No s=
uch file or directory=0ASecondary namenodes are not configured.=A0 Cannot s=
top secondary namenodes.=0A=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=
=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=
=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=
=3D=3D=0A=A0=0AAnyway, the doc in the http://hadoop.apache.org/common/docs/=
stable/single_node_setup.html=A0looks like out-of-date since the command "$=
sbin/start-all.sh" reported "This script is Deprecated. Instead use start-d=
fs.sh and start-mapred.sh "=0A=A0=0A=A0=0AThanks,=0A=A0=0AHai
From common-dev-return-77648-apmail-hadoop-common-dev-archive=hadoop.apache.org@hadoop.apache.org Wed Feb 8 05:35:34 2012
Return-Path: <common-dev-return-77648-apmail-hadoop-common-dev-archive=hadoop.apache.org@hadoop.apache.org>
X-Original-To: apmail-hadoop-common-dev-archive@www.apache.org
Delivered-To: apmail-hadoop-common-dev-archive@www.apache.org
Received: from mail.apache.org (hermes.apache.org [140.211.11.3])
by minotaur.apache.org (Postfix) with SMTP id 19624953A
for <apmail-hadoop-common-dev-archive@www.apache.org>; Wed, 8 Feb 2012 05:35:34 +0000 (UTC)
Received: (qmail 85762 invoked by uid 500); 8 Feb 2012 05:35:32 -0000
Delivered-To: apmail-hadoop-common-dev-archive@hadoop.apache.org
Received: (qmail 85038 invoked by uid 500); 8 Feb 2012 05:35:24 -0000
Mailing-List: contact common-dev-help@hadoop.apache.org; run by ezmlm
Precedence: bulk
List-Help: <mailto:common-dev-help@hadoop.apache.org>
List-Unsubscribe: <mailto:common-dev-unsubscribe@hadoop.apache.org>
List-Post: <mailto:common-dev@hadoop.apache.org>
List-Id: <common-dev.hadoop.apache.org>
Reply-To: common-dev@hadoop.apache.org
Delivered-To: mailing list common-dev@hadoop.apache.org
Received: (qmail 85008 invoked by uid 99); 8 Feb 2012 05:35:22 -0000
Received: from athena.apache.org (HELO athena.apache.org) (140.211.11.136)
by apache.org (qpsmtpd/0.29) with ESMTP; Wed, 08 Feb 2012 05:35:22 +0000
X-ASF-Spam-Status: No, hits=-2000.0 required=5.0
tests=ALL_TRUSTED,T_RP_MATCHES_RCVD
X-Spam-Check-By: apache.org
Received: from [140.211.11.116] (HELO hel.zones.apache.org) (140.211.11.116)
by apache.org (qpsmtpd/0.29) with ESMTP; Wed, 08 Feb 2012 05:35:20 +0000
Received: from hel.zones.apache.org (hel.zones.apache.org [140.211.11.116])
by hel.zones.apache.org (Postfix) with ESMTP id 925F81A9500
for <common-dev@hadoop.apache.org>; Wed, 8 Feb 2012 05:35:00 +0000 (UTC)
Date: Wed, 8 Feb 2012 05:35:00 +0000 (UTC)
From: "Eli Collins (Created) (JIRA)" <jira@apache.org>
To: common-dev@hadoop.apache.org
Message-ID: <566455775.13336.1328679300601.JavaMail.tomcat@hel.zones.apache.org>
Subject: [jira] [Created] (HADOOP-8036) TestViewFsTrash assumes the user's
home directory is 2 levels deep
MIME-Version: 1.0
Content-Type: text/plain; charset=utf-8
Content-Transfer-Encoding: 7bit
X-JIRA-FingerPrint: 30527f35849b9dde25b450d4833f0394
TestViewFsTrash assumes the user's home directory is 2 levels deep
------------------------------------------------------------------
Key: HADOOP-8036
URL: https://issues.apache.org/jira/browse/HADOOP-8036
Project: Hadoop Common
Issue Type: Bug
Components: test
Affects Versions: 0.23.0
Reporter: Eli Collins
Looks like HADOOP-7974 didn't fix the issue. Still get "Path /var already exists as dir; cannot create link here Stacktrace" when running on jenkins with home dir /var/lib/jenkins.
{noformat}
org.apache.hadoop.fs.FileAlreadyExistsException: Path /var already exists as dir; cannot create link here
at org.apache.hadoop.fs.viewfs.InodeTree.createLink(InodeTree.java:244)
at org.apache.hadoop.fs.viewfs.InodeTree.<init>(InodeTree.java:334)
at org.apache.hadoop.fs.viewfs.ViewFileSystem$1.<init>(ViewFileSystem.java:165)
{noformat}
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
From common-dev-return-77649-apmail-hadoop-common-dev-archive=hadoop.apache.org@hadoop.apache.org Wed Feb 8 08:32:43 2012
Return-Path: <common-dev-return-77649-apmail-hadoop-common-dev-archive=hadoop.apache.org@hadoop.apache.org>
X-Original-To: apmail-hadoop-common-dev-archive@www.apache.org
Delivered-To: apmail-hadoop-common-dev-archive@www.apache.org
Received: from mail.apache.org (hermes.apache.org [140.211.11.3])
by minotaur.apache.org (Postfix) with SMTP id 884E79DDD
for <apmail-hadoop-common-dev-archive@www.apache.org>; Wed, 8 Feb 2012 08:32:43 +0000 (UTC)
Received: (qmail 82331 invoked by uid 500); 8 Feb 2012 08:32:41 -0000
Delivered-To: apmail-hadoop-common-dev-archive@hadoop.apache.org
Received: (qmail 81696 invoked by uid 500); 8 Feb 2012 08:32:28 -0000
Mailing-List: contact common-dev-help@hadoop.apache.org; run by ezmlm
Precedence: bulk
List-Help: <mailto:common-dev-help@hadoop.apache.org>
List-Unsubscribe: <mailto:common-dev-unsubscribe@hadoop.apache.org>
List-Post: <mailto:common-dev@hadoop.apache.org>
List-Id: <common-dev.hadoop.apache.org>
Reply-To: common-dev@hadoop.apache.org
Delivered-To: mailing list common-dev@hadoop.apache.org
Received: (qmail 81628 invoked by uid 99); 8 Feb 2012 08:32:24 -0000
Received: from nike.apache.org (HELO nike.apache.org) (192.87.106.230)
by apache.org (qpsmtpd/0.29) with ESMTP; Wed, 08 Feb 2012 08:32:24 +0000
X-ASF-Spam-Status: No, hits=-2000.0 required=5.0
tests=ALL_TRUSTED,T_RP_MATCHES_RCVD
X-Spam-Check-By: apache.org
Received: from [140.211.11.116] (HELO hel.zones.apache.org) (140.211.11.116)
by apache.org (qpsmtpd/0.29) with ESMTP; Wed, 08 Feb 2012 08:32:20 +0000
Received: from hel.zones.apache.org (hel.zones.apache.org [140.211.11.116])
by hel.zones.apache.org (Postfix) with ESMTP id 7DC6DADF4A
for <common-dev@hadoop.apache.org>; Wed, 8 Feb 2012 08:31:59 +0000 (UTC)
Date: Wed, 8 Feb 2012 08:31:59 +0000 (UTC)
From: "Matt Foley (Created) (JIRA)" <jira@apache.org>
To: common-dev@hadoop.apache.org
Message-ID: <740714091.13751.1328689919516.JavaMail.tomcat@hel.zones.apache.org>
Subject: [jira] [Created] (HADOOP-8037) Binary tarball does not preserve
platform info for native builds
MIME-Version: 1.0
Content-Type: text/plain; charset=utf-8
Content-Transfer-Encoding: 7bit
X-JIRA-FingerPrint: 30527f35849b9dde25b450d4833f0394
X-Virus-Checked: Checked by ClamAV on apache.org
Binary tarball does not preserve platform info for native builds
----------------------------------------------------------------
Key: HADOOP-8037
URL: https://issues.apache.org/jira/browse/HADOOP-8037
Project: Hadoop Common
Issue Type: Bug
Components: build
Affects Versions: 1.0.1
Reporter: Matt Foley
Assignee: Giridharan Kesavan
The source tarball uses "package" ant target, which includes both sets of native builds (32 and 64 bit libraries), under subdirectories that are named for the supported platform, so you can tell what they are.
The binary tarball uses the "bin-package" ant target, which projects both sets of native builds into a single directory, stripping out the platform names from the directory paths. Since the native built libraries have identical names, only one of each survives the process. Afterward, there is no way to know whether they are intended for 32 or 64 bit environments.
It seems to be done this way as a step toward building the rpm and deb artifacts. But the rpms and debs are self-identifying as to the platform they were built for, and contain only one set of libs each, while the binary tarball isn't. The binary tarball should have the same platform-specific subdirectories that the full tarball does; but this means that the rpm and deb builds have to be more careful about include/exclude specs for what goes into those artifacts.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
From common-dev-return-77650-apmail-hadoop-common-dev-archive=hadoop.apache.org@hadoop.apache.org Wed Feb 8 14:18:25 2012
Return-Path: <common-dev-return-77650-apmail-hadoop-common-dev-archive=hadoop.apache.org@hadoop.apache.org>
X-Original-To: apmail-hadoop-common-dev-archive@www.apache.org
Delivered-To: apmail-hadoop-common-dev-archive@www.apache.org
Received: from mail.apache.org (hermes.apache.org [140.211.11.3])
by minotaur.apache.org (Postfix) with SMTP id 9FEF49CF0
for <apmail-hadoop-common-dev-archive@www.apache.org>; Wed, 8 Feb 2012 14:18:25 +0000 (UTC)
Received: (qmail 23512 invoked by uid 500); 8 Feb 2012 14:18:23 -0000
Delivered-To: apmail-hadoop-common-dev-archive@hadoop.apache.org
Received: (qmail 22937 invoked by uid 500); 8 Feb 2012 14:18:22 -0000
Mailing-List: contact common-dev-help@hadoop.apache.org; run by ezmlm
Precedence: bulk
List-Help: <mailto:common-dev-help@hadoop.apache.org>
List-Unsubscribe: <mailto:common-dev-unsubscribe@hadoop.apache.org>
List-Post: <mailto:common-dev@hadoop.apache.org>
List-Id: <common-dev.hadoop.apache.org>
Reply-To: common-dev@hadoop.apache.org
Delivered-To: mailing list common-dev@hadoop.apache.org
Received: (qmail 22905 invoked by uid 99); 8 Feb 2012 14:18:21 -0000
Received: from athena.apache.org (HELO athena.apache.org) (140.211.11.136)
by apache.org (qpsmtpd/0.29) with ESMTP; Wed, 08 Feb 2012 14:18:21 +0000
X-ASF-Spam-Status: No, hits=-2000.0 required=5.0
tests=ALL_TRUSTED,T_RP_MATCHES_RCVD
X-Spam-Check-By: apache.org
Received: from [140.211.11.116] (HELO hel.zones.apache.org) (140.211.11.116)
by apache.org (qpsmtpd/0.29) with ESMTP; Wed, 08 Feb 2012 14:18:20 +0000
Received: from hel.zones.apache.org (hel.zones.apache.org [140.211.11.116])
by hel.zones.apache.org (Postfix) with ESMTP id E61F91AA6C9
for <common-dev@hadoop.apache.org>; Wed, 8 Feb 2012 14:18:00 +0000 (UTC)
Date: Wed, 8 Feb 2012 14:18:00 +0000 (UTC)
From: "Uma Maheswara Rao G (Created) (JIRA)" <jira@apache.org>
To: common-dev@hadoop.apache.org
Message-ID: <1665434940.14931.1328710680943.JavaMail.tomcat@hel.zones.apache.org>
Subject: [jira] [Created] (HADOOP-8038) Add
'ipc.client.connect.max.retries.on.timeouts' entry in core-default.xml
file.
MIME-Version: 1.0
Content-Type: text/plain; charset=utf-8
Content-Transfer-Encoding: 7bit
X-JIRA-FingerPrint: 30527f35849b9dde25b450d4833f0394
Add 'ipc.client.connect.max.retries.on.timeouts' entry in core-default.xml file.
--------------------------------------------------------------------------------
Key: HADOOP-8038
URL: https://issues.apache.org/jira/browse/HADOOP-8038
Project: Hadoop Common
Issue Type: Sub-task
Reporter: Uma Maheswara Rao G
Assignee: Uma Maheswara Rao G
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
From common-dev-return-77651-apmail-hadoop-common-dev-archive=hadoop.apache.org@hadoop.apache.org Wed Feb 8 14:26:30 2012
Return-Path: <common-dev-return-77651-apmail-hadoop-common-dev-archive=hadoop.apache.org@hadoop.apache.org>
X-Original-To: apmail-hadoop-common-dev-archive@www.apache.org
Delivered-To: apmail-hadoop-common-dev-archive@www.apache.org
Received: from mail.apache.org (hermes.apache.org [140.211.11.3])
by minotaur.apache.org (Postfix) with SMTP id A31D29E71
for <apmail-hadoop-common-dev-archive@www.apache.org>; Wed, 8 Feb 2012 14:26:30 +0000 (UTC)
Received: (qmail 41061 invoked by uid 500); 8 Feb 2012 14:26:26 -0000
Delivered-To: apmail-hadoop-common-dev-archive@hadoop.apache.org
Received: (qmail 40495 invoked by uid 500); 8 Feb 2012 14:26:25 -0000
Mailing-List: contact common-dev-help@hadoop.apache.org; run by ezmlm
Precedence: bulk
List-Help: <mailto:common-dev-help@hadoop.apache.org>
List-Unsubscribe: <mailto:common-dev-unsubscribe@hadoop.apache.org>
List-Post: <mailto:common-dev@hadoop.apache.org>
List-Id: <common-dev.hadoop.apache.org>
Reply-To: common-dev@hadoop.apache.org
Delivered-To: mailing list common-dev@hadoop.apache.org
Received: (qmail 40338 invoked by uid 99); 8 Feb 2012 14:26:25 -0000
Received: from nike.apache.org (HELO nike.apache.org) (192.87.106.230)
by apache.org (qpsmtpd/0.29) with ESMTP; Wed, 08 Feb 2012 14:26:25 +0000
X-ASF-Spam-Status: No, hits=0.7 required=5.0
tests=RCVD_IN_DNSWL_NONE,SPF_NEUTRAL
X-Spam-Check-By: apache.org
Received-SPF: neutral (nike.apache.org: local policy)
Received: from [217.70.183.196] (HELO relay4-d.mail.gandi.net) (217.70.183.196)
by apache.org (qpsmtpd/0.29) with ESMTP; Wed, 08 Feb 2012 14:26:17 +0000
X-Originating-IP: 217.70.178.135
Received: from mfilter6-d.gandi.net (mfilter6-d.gandi.net [217.70.178.135])
by relay4-d.mail.gandi.net (Postfix) with ESMTP id 3CB141720BC;
Wed, 8 Feb 2012 15:25:57 +0100 (CET)
X-Virus-Scanned: Debian amavisd-new at mfilter6-d.gandi.net
Received: from relay4-d.mail.gandi.net ([217.70.183.196])
by mfilter6-d.gandi.net (mfilter6-d.gandi.net [10.0.15.180]) (amavisd-new, port 10024)
with ESMTP id LwWQisYu03sq; Wed, 8 Feb 2012 15:25:55 +0100 (CET)
X-Originating-IP: 82.238.224.4
Received: from [192.168.134.15] (bre91-1-82-238-224-4.fbx.proxad.net [82.238.224.4])
(Authenticated sender: jb@nanthrax.net)
by relay4-d.mail.gandi.net (Postfix) with ESMTPSA id 068F117208B;
Wed, 8 Feb 2012 15:25:54 +0100 (CET)
Message-ID: <4F3285F1.2000704@nanthrax.net>
Date: Wed, 08 Feb 2012 15:25:53 +0100
From: =?ISO-8859-1?Q?Jean-Baptiste_Onofr=E9?= <jb@nanthrax.net>
User-Agent: Mozilla/5.0 (X11; Linux x86_64; rv:9.0) Gecko/20111229 Thunderbird/9.0
MIME-Version: 1.0
To: common-dev@hadoop.apache.org, hdfs-dev@hadoop.apache.org,
mapreduce-dev@hadoop.apache.org
Subject: [PROPOSAL] Hadoop OSGi compliant and Apache Karaf features
Content-Type: text/plain; charset=ISO-8859-1; format=flowed
Content-Transfer-Encoding: quoted-printable
X-Virus-Checked: Checked by ClamAV on apache.org
Hi folks,
I'm working right now to turn Hadoop as an OSGi compliant set of modules.
I've more or less achieved the first step:
- turn all Hadoop modules (common, annotations, hdfs, mapreduce, etc) as=20
OSGi bundle
- provide a Karaf features descriptor to easily deploy it into Apache=20
Karaf OSGi container
I will upload the patches on the different Jira related to that.
The second step that I propose is to introduce blueprint descriptor in=20
order to expose some Hadoop features as OSGi services.
It won't affect the "non-OSGi" users but give lot of fun and interest=20
for OSGi users ;)
WDYT ?
Regards
JB
PS: the Jira issues are HADOOP-6484, HADOOP-7977, MAPREDUCE-243. It=20
would be great if someone can assign it to me (easier to track it).
--=20
Jean-Baptiste Onofr=E9
jbonofre@apache.org
http://blog.nanthrax.net
Talend - http://www.talend.com
From common-dev-return-77652-apmail-hadoop-common-dev-archive=hadoop.apache.org@hadoop.apache.org Wed Feb 8 17:55:27 2012
Return-Path: <common-dev-return-77652-apmail-hadoop-common-dev-archive=hadoop.apache.org@hadoop.apache.org>
X-Original-To: apmail-hadoop-common-dev-archive@www.apache.org
Delivered-To: apmail-hadoop-common-dev-archive@www.apache.org
Received: from mail.apache.org (hermes.apache.org [140.211.11.3])
by minotaur.apache.org (Postfix) with SMTP id E18389757
for <apmail-hadoop-common-dev-archive@www.apache.org>; Wed, 8 Feb 2012 17:55:27 +0000 (UTC)
Received: (qmail 34325 invoked by uid 500); 8 Feb 2012 17:55:26 -0000
Delivered-To: apmail-hadoop-common-dev-archive@hadoop.apache.org
Received: (qmail 33792 invoked by uid 500); 8 Feb 2012 17:55:24 -0000
Mailing-List: contact common-dev-help@hadoop.apache.org; run by ezmlm
Precedence: bulk
List-Help: <mailto:common-dev-help@hadoop.apache.org>
List-Unsubscribe: <mailto:common-dev-unsubscribe@hadoop.apache.org>
List-Post: <mailto:common-dev@hadoop.apache.org>
List-Id: <common-dev.hadoop.apache.org>
Reply-To: common-dev@hadoop.apache.org
Delivered-To: mailing list common-dev@hadoop.apache.org
Received: (qmail 33765 invoked by uid 99); 8 Feb 2012 17:55:24 -0000
Received: from nike.apache.org (HELO nike.apache.org) (192.87.106.230)
by apache.org (qpsmtpd/0.29) with ESMTP; Wed, 08 Feb 2012 17:55:24 +0000
X-ASF-Spam-Status: No, hits=-2000.0 required=5.0
tests=ALL_TRUSTED,T_RP_MATCHES_RCVD
X-Spam-Check-By: apache.org
Received: from [140.211.11.116] (HELO hel.zones.apache.org) (140.211.11.116)
by apache.org (qpsmtpd/0.29) with ESMTP; Wed, 08 Feb 2012 17:55:21 +0000
Received: from hel.zones.apache.org (hel.zones.apache.org [140.211.11.116])
by hel.zones.apache.org (Postfix) with ESMTP id EC0FB1AA811
for <common-dev@hadoop.apache.org>; Wed, 8 Feb 2012 17:55:00 +0000 (UTC)
Date: Wed, 8 Feb 2012 17:55:00 +0000 (UTC)
From: "Ravi Prakash (Created) (JIRA)" <jira@apache.org>
To: common-dev@hadoop.apache.org
Message-ID: <289978148.15564.1328723700968.JavaMail.tomcat@hel.zones.apache.org>
Subject: [jira] [Created] (HADOOP-8039) mvn site:stage-deploy should not
have broken links.
MIME-Version: 1.0
Content-Type: text/plain; charset=utf-8
Content-Transfer-Encoding: 7bit
X-JIRA-FingerPrint: 30527f35849b9dde25b450d4833f0394
X-Virus-Checked: Checked by ClamAV on apache.org
mvn site:stage-deploy should not have broken links.
---------------------------------------------------
Key: HADOOP-8039
URL: https://issues.apache.org/jira/browse/HADOOP-8039
Project: Hadoop Common
Issue Type: Bug
Components: build, documentation
Affects Versions: 0.23.1
Reporter: Ravi Prakash
The stage-deployed site has a lot of broken links / missing pages. We should fix that.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
From common-dev-return-77653-apmail-hadoop-common-dev-archive=hadoop.apache.org@hadoop.apache.org Wed Feb 8 17:59:23 2012
Return-Path: <common-dev-return-77653-apmail-hadoop-common-dev-archive=hadoop.apache.org@hadoop.apache.org>
X-Original-To: apmail-hadoop-common-dev-archive@www.apache.org
Delivered-To: apmail-hadoop-common-dev-archive@www.apache.org
Received: from mail.apache.org (hermes.apache.org [140.211.11.3])
by minotaur.apache.org (Postfix) with SMTP id 57EFE9B31
for <apmail-hadoop-common-dev-archive@www.apache.org>; Wed, 8 Feb 2012 17:59:23 +0000 (UTC)
Received: (qmail 50142 invoked by uid 500); 8 Feb 2012 17:59:21 -0000
Delivered-To: apmail-hadoop-common-dev-archive@hadoop.apache.org
Received: (qmail 49851 invoked by uid 500); 8 Feb 2012 17:59:20 -0000
Mailing-List: contact common-dev-help@hadoop.apache.org; run by ezmlm
Precedence: bulk
List-Help: <mailto:common-dev-help@hadoop.apache.org>
List-Unsubscribe: <mailto:common-dev-unsubscribe@hadoop.apache.org>
List-Post: <mailto:common-dev@hadoop.apache.org>
List-Id: <common-dev.hadoop.apache.org>
Reply-To: common-dev@hadoop.apache.org
Delivered-To: mailing list common-dev@hadoop.apache.org
Received: (qmail 49835 invoked by uid 99); 8 Feb 2012 17:59:20 -0000
Received: from athena.apache.org (HELO athena.apache.org) (140.211.11.136)
by apache.org (qpsmtpd/0.29) with ESMTP; Wed, 08 Feb 2012 17:59:20 +0000
X-ASF-Spam-Status: No, hits=-2000.0 required=5.0
tests=ALL_TRUSTED,T_RP_MATCHES_RCVD
X-Spam-Check-By: apache.org
Received: from [140.211.11.116] (HELO hel.zones.apache.org) (140.211.11.116)
by apache.org (qpsmtpd/0.29) with ESMTP; Wed, 08 Feb 2012 17:59:19 +0000
Received: from hel.zones.apache.org (hel.zones.apache.org [140.211.11.116])
by hel.zones.apache.org (Postfix) with ESMTP id 53AB31AAB0A
for <common-dev@hadoop.apache.org>; Wed, 8 Feb 2012 17:58:59 +0000 (UTC)
Date: Wed, 8 Feb 2012 17:58:59 +0000 (UTC)
From: "Aaron T. Myers (Resolved) (JIRA)" <jira@apache.org>
To: common-dev@hadoop.apache.org
Message-ID: <2100253581.15579.1328723939344.JavaMail.tomcat@hel.zones.apache.org>
In-Reply-To: <1665434940.14931.1328710680943.JavaMail.tomcat@hel.zones.apache.org>
Subject: [jira] [Resolved] (HADOOP-8038) Add
'ipc.client.connect.max.retries.on.timeouts' entry in core-default.xml
file.
MIME-Version: 1.0
Content-Type: text/plain; charset=utf-8
Content-Transfer-Encoding: 7bit
X-JIRA-FingerPrint: 30527f35849b9dde25b450d4833f0394
[ https://issues.apache.org/jira/browse/HADOOP-8038?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Aaron T. Myers resolved HADOOP-8038.
------------------------------------
Resolution: Fixed
Fix Version/s: HA Branch (HDFS-1623)
Hadoop Flags: Reviewed
> Add 'ipc.client.connect.max.retries.on.timeouts' entry in core-default.xml file.
> --------------------------------------------------------------------------------
>
> Key: HADOOP-8038
> URL: https://issues.apache.org/jira/browse/HADOOP-8038
> Project: Hadoop Common
> Issue Type: Sub-task
> Components: conf, ha
> Affects Versions: HA Branch (HDFS-1623)
> Reporter: Uma Maheswara Rao G
> Assignee: Uma Maheswara Rao G
> Priority: Minor
> Fix For: HA Branch (HDFS-1623)
>
> Attachments: HADOOP-8038.patch
>
>
> HADOOP-7932 added the new property 'ipc.client.connect.max.retries.on.timeouts', which needs to be added in core-default.xml with documentation.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
From common-dev-return-77654-apmail-hadoop-common-dev-archive=hadoop.apache.org@hadoop.apache.org Wed Feb 8 18:44:08 2012
Return-Path: <common-dev-return-77654-apmail-hadoop-common-dev-archive=hadoop.apache.org@hadoop.apache.org>
X-Original-To: apmail-hadoop-common-dev-archive@www.apache.org
Delivered-To: apmail-hadoop-common-dev-archive@www.apache.org
Received: from mail.apache.org (hermes.apache.org [140.211.11.3])
by minotaur.apache.org (Postfix) with SMTP id A90EE9694
for <apmail-hadoop-common-dev-archive@www.apache.org>; Wed, 8 Feb 2012 18:44:08 +0000 (UTC)
Received: (qmail 53836 invoked by uid 500); 8 Feb 2012 18:44:07 -0000
Delivered-To: apmail-hadoop-common-dev-archive@hadoop.apache.org
Received: (qmail 53749 invoked by uid 500); 8 Feb 2012 18:44:06 -0000
Mailing-List: contact common-dev-help@hadoop.apache.org; run by ezmlm
Precedence: bulk
List-Help: <mailto:common-dev-help@hadoop.apache.org>
List-Unsubscribe: <mailto:common-dev-unsubscribe@hadoop.apache.org>
List-Post: <mailto:common-dev@hadoop.apache.org>
List-Id: <common-dev.hadoop.apache.org>
Reply-To: common-dev@hadoop.apache.org
Delivered-To: mailing list common-dev@hadoop.apache.org
Received: (qmail 53740 invoked by uid 99); 8 Feb 2012 18:44:06 -0000
Received: from nike.apache.org (HELO nike.apache.org) (192.87.106.230)
by apache.org (qpsmtpd/0.29) with ESMTP; Wed, 08 Feb 2012 18:44:06 +0000
X-ASF-Spam-Status: No, hits=1.5 required=5.0
tests=HTML_MESSAGE,RCVD_IN_DNSWL_LOW,SPF_PASS
X-Spam-Check-By: apache.org
Received-SPF: pass (nike.apache.org: domain of bewang.tech@gmail.com designates 209.85.213.176 as permitted sender)
Received: from [209.85.213.176] (HELO mail-yx0-f176.google.com) (209.85.213.176)
by apache.org (qpsmtpd/0.29) with ESMTP; Wed, 08 Feb 2012 18:43:59 +0000
Received: by yenl9 with SMTP id l9so533546yen.35
for <common-dev@hadoop.apache.org>; Wed, 08 Feb 2012 10:43:38 -0800 (PST)
DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed;
d=gmail.com; s=gamma;
h=mime-version:in-reply-to:references:date:message-id:subject:from:to
:content-type;
bh=/fGHZBur6DQ4PmMWHR1WM1pbfNNpEieHBVIf8c1OdUc=;
b=I9jRxi6GwAYTCnYZ80O7FQt9cHKlk0AJ29vB7iKwaM2v62BKBlfur55/dqxleE7cU5
wqenZllNk5AWvpVcD94O3o5N5cxFRjdLGiJw7Ns3f+7O3gESGZmSnUJb3vE7G3MbFWun
B0dleyNCPW6eefG7frjIr0SJPvfjq0Ps7RxCA=
MIME-Version: 1.0
Received: by 10.50.208.1 with SMTP id ma1mr42783169igc.4.1328726618360; Wed,
08 Feb 2012 10:43:38 -0800 (PST)
Received: by 10.50.87.135 with HTTP; Wed, 8 Feb 2012 10:43:38 -0800 (PST)
In-Reply-To: <CAMoVmf8qx_f2Txh-syv_Thegy5iD6Aa344EsBcepafk9SW0Mcg@mail.gmail.com>
References: <CAMoVmf8qx_f2Txh-syv_Thegy5iD6Aa344EsBcepafk9SW0Mcg@mail.gmail.com>
Date: Wed, 8 Feb 2012 10:43:38 -0800
Message-ID: <CAMoVmf8_o3fL=AjTNyeyt4qLKj=tCkPn=OXwWxq3nzpKwergPA@mail.gmail.com>
Subject: Fwd: Hadoop Active Directory Integration
From: Benyi Wang <bewang.tech@gmail.com>
To: common-dev@hadoop.apache.org
Content-Type: multipart/alternative; boundary=14dae9340aed174c4304b878461f
X-Virus-Checked: Checked by ClamAV on apache.org
--14dae9340aed174c4304b878461f
Content-Type: text/plain; charset=ISO-8859-1
Can anyone answer my questions?
Thanks a lot.
---------- Forwarded message ----------
From: Benyi Wang <bewang.tech@gmail.com>
Date: Mon, Feb 6, 2012 at 11:07 PM
Subject: Hadoop Active Directory Integration
To: common-user@hadoop.apache.org
Hi,
I have questions about Hadoop Active Directory Integration:
1. When using Active Directory, do we still need to create a Linux
account for each user on each Linux node?
2. What about if I enable queue acls and use fairscheduler? Will task
trackers send all ACLs check to Active directory? Can I list the user
accounts or AD security groups in mapred-queue-acls.xml? Do I need to
create those groups in Linux node?
3. Does someone configure Hadoop AD integration in multiple networks?
for example, my company have three networks: corp, lab, and prod. A user
in "corp" network can log on a window server in lab or prod. If we want to
use local MIT KDC and set up "one-way cross-realm trust from this realm
to the Active Directory realm" in
https://ccp.cloudera.com/display/CDHDOC/Integrating+Hadoop+Security+with+Active+Directory.
How to set up Kerberos in such a environment?
4. Is this right? If AD is setup, a window user can remotely submit a
mapred job?
5. What about the authorization? Can hadoop configure so that only users
in the specified security groups in AD can submit jobs.
Thanks.
Ben
--14dae9340aed174c4304b878461f--
From common-dev-return-77655-apmail-hadoop-common-dev-archive=hadoop.apache.org@hadoop.apache.org Wed Feb 8 18:55:03 2012
Return-Path: <common-dev-return-77655-apmail-hadoop-common-dev-archive=hadoop.apache.org@hadoop.apache.org>
X-Original-To: apmail-hadoop-common-dev-archive@www.apache.org
Delivered-To: apmail-hadoop-common-dev-archive@www.apache.org
Received: from mail.apache.org (hermes.apache.org [140.211.11.3])
by minotaur.apache.org (Postfix) with SMTP id D41629F99
for <apmail-hadoop-common-dev-archive@www.apache.org>; Wed, 8 Feb 2012 18:55:03 +0000 (UTC)
Received: (qmail 79344 invoked by uid 500); 8 Feb 2012 18:55:02 -0000
Delivered-To: apmail-hadoop-common-dev-archive@hadoop.apache.org
Received: (qmail 79221 invoked by uid 500); 8 Feb 2012 18:55:01 -0000
Mailing-List: contact common-dev-help@hadoop.apache.org; run by ezmlm
Precedence: bulk
List-Help: <mailto:common-dev-help@hadoop.apache.org>
List-Unsubscribe: <mailto:common-dev-unsubscribe@hadoop.apache.org>
List-Post: <mailto:common-dev@hadoop.apache.org>
List-Id: <common-dev.hadoop.apache.org>
Reply-To: common-dev@hadoop.apache.org
Delivered-To: mailing list common-dev@hadoop.apache.org
Received: (qmail 79213 invoked by uid 99); 8 Feb 2012 18:55:01 -0000
Received: from nike.apache.org (HELO nike.apache.org) (192.87.106.230)
by apache.org (qpsmtpd/0.29) with ESMTP; Wed, 08 Feb 2012 18:55:01 +0000
X-ASF-Spam-Status: No, hits=1.5 required=5.0
tests=HTML_MESSAGE,RCVD_IN_DNSWL_LOW,SPF_PASS
X-Spam-Check-By: apache.org
Received-SPF: pass (nike.apache.org: domain of patrickangeles@gmail.com designates 209.85.213.176 as permitted sender)
Received: from [209.85.213.176] (HELO mail-yx0-f176.google.com) (209.85.213.176)
by apache.org (qpsmtpd/0.29) with ESMTP; Wed, 08 Feb 2012 18:54:54 +0000
Received: by yenl9 with SMTP id l9so543503yen.35
for <common-dev@hadoop.apache.org>; Wed, 08 Feb 2012 10:54:33 -0800 (PST)
DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed;
d=gmail.com; s=gamma;
h=mime-version:in-reply-to:references:date:message-id:subject:from:to
:content-type;
bh=GVUl2zJURRZILouElVH3+o/FL067jmCdfMwzKqLGU6s=;
b=a23RDXHxIl7jswyC+u9U0qQac9kCsn5dup4R/8WRmSvrlVLumW8U9lTmiw3fHX1g95
/dryVpFPf6uGmYwN8olzxnuoLTEWCg4tek+2u3y2ftDBHXMB2blG7gTehRHhfC830K4E
YyhJGO8Jy370/xFJsABqIyaxOO8fhfdQhR60w=
MIME-Version: 1.0
Received: by 10.50.196.228 with SMTP id ip4mr35862674igc.28.1328727273581;
Wed, 08 Feb 2012 10:54:33 -0800 (PST)
Received: by 10.231.172.77 with HTTP; Wed, 8 Feb 2012 10:54:33 -0800 (PST)
In-Reply-To: <CAMoVmf8_o3fL=AjTNyeyt4qLKj=tCkPn=OXwWxq3nzpKwergPA@mail.gmail.com>
References: <CAMoVmf8qx_f2Txh-syv_Thegy5iD6Aa344EsBcepafk9SW0Mcg@mail.gmail.com>
<CAMoVmf8_o3fL=AjTNyeyt4qLKj=tCkPn=OXwWxq3nzpKwergPA@mail.gmail.com>
Date: Wed, 8 Feb 2012 13:54:33 -0500
Message-ID: <CANS822irt99c=NY74AChwKdzHRq1kyWNOUd6k8KZAYdyWB+zhQ@mail.gmail.com>
Subject: Re: Hadoop Active Directory Integration
From: Patrick Angeles <patrickangeles@gmail.com>
To: common-dev@hadoop.apache.org
Content-Type: multipart/alternative; boundary=bcaec554da6a252adb04b8786d50
X-Virus-Checked: Checked by ClamAV on apache.org
--bcaec554da6a252adb04b8786d50
Content-Type: text/plain; charset=ISO-8859-1
On Wed, Feb 8, 2012 at 1:43 PM, Benyi Wang <bewang.tech@gmail.com> wrote:
> Can anyone answer my questions?
>
> Thanks a lot.
>
> ---------- Forwarded message ----------
> From: Benyi Wang <bewang.tech@gmail.com>
> Date: Mon, Feb 6, 2012 at 11:07 PM
> Subject: Hadoop Active Directory Integration
> To: common-user@hadoop.apache.org
>
>
> Hi,
>
> I have questions about Hadoop Active Directory Integration:
>
> 1. When using Active Directory, do we still need to create a Linux
> account for each user on each Linux node?
>
Yes. You can do LDAP integration via PAM.
> 2. What about if I enable queue acls and use fairscheduler? Will task
> trackers send all ACLs check to Active directory? Can I list the user
> accounts or AD security groups in mapred-queue-acls.xml? Do I need to
> create those groups in Linux node?
>
The fairscheduler runs entirely on the JT. Those groups need to resolve on
the JT (and NN) machines.
> 3. Does someone configure Hadoop AD integration in multiple networks?
> for example, my company have three networks: corp, lab, and prod. A
> user
> in "corp" network can log on a window server in lab or prod. If we want
> to
> use local MIT KDC and set up "one-way cross-realm trust from this realm
> to the Active Directory realm" in
>
> https://ccp.cloudera.com/display/CDHDOC/Integrating+Hadoop+Security+with+Active+Directory
> .
> How to set up Kerberos in such a environment?
>
You can have a local KDC and realm per cluster, and set up one-way
cross-realm trust on each realm to your corp AD.
> 4. Is this right? If AD is setup, a window user can remotely submit a
> mapred job?
>
I've never tried this, but my guess is it won't just work.
> 5. What about the authorization? Can hadoop configure so that only users
> in the specified security groups in AD can submit jobs.
>
You can do this via ACLs.
>
> Thanks.
>
> Ben
>
--bcaec554da6a252adb04b8786d50--
From common-dev-return-77656-apmail-hadoop-common-dev-archive=hadoop.apache.org@hadoop.apache.org Wed Feb 8 19:29:27 2012
Return-Path: <common-dev-return-77656-apmail-hadoop-common-dev-archive=hadoop.apache.org@hadoop.apache.org>
X-Original-To: apmail-hadoop-common-dev-archive@www.apache.org
Delivered-To: apmail-hadoop-common-dev-archive@www.apache.org
Received: from mail.apache.org (hermes.apache.org [140.211.11.3])
by minotaur.apache.org (Postfix) with SMTP id AD8279D0A
for <apmail-hadoop-common-dev-archive@www.apache.org>; Wed, 8 Feb 2012 19:29:27 +0000 (UTC)
Received: (qmail 52093 invoked by uid 500); 8 Feb 2012 19:29:25 -0000
Delivered-To: apmail-hadoop-common-dev-archive@hadoop.apache.org
Received: (qmail 51741 invoked by uid 500); 8 Feb 2012 19:29:24 -0000
Mailing-List: contact common-dev-help@hadoop.apache.org; run by ezmlm
Precedence: bulk
List-Help: <mailto:common-dev-help@hadoop.apache.org>
List-Unsubscribe: <mailto:common-dev-unsubscribe@hadoop.apache.org>
List-Post: <mailto:common-dev@hadoop.apache.org>
List-Id: <common-dev.hadoop.apache.org>
Reply-To: common-dev@hadoop.apache.org
Delivered-To: mailing list common-dev@hadoop.apache.org
Received: (qmail 51710 invoked by uid 99); 8 Feb 2012 19:29:24 -0000
Received: from nike.apache.org (HELO nike.apache.org) (192.87.106.230)
by apache.org (qpsmtpd/0.29) with ESMTP; Wed, 08 Feb 2012 19:29:24 +0000
X-ASF-Spam-Status: No, hits=-2000.0 required=5.0
tests=ALL_TRUSTED,T_RP_MATCHES_RCVD
X-Spam-Check-By: apache.org
Received: from [140.211.11.116] (HELO hel.zones.apache.org) (140.211.11.116)
by apache.org (qpsmtpd/0.29) with ESMTP; Wed, 08 Feb 2012 19:29:21 +0000
Received: from hel.zones.apache.org (hel.zones.apache.org [140.211.11.116])
by hel.zones.apache.org (Postfix) with ESMTP id AF5C21AB3E2
for <common-dev@hadoop.apache.org>; Wed, 8 Feb 2012 19:29:00 +0000 (UTC)
Date: Wed, 8 Feb 2012 19:29:00 +0000 (UTC)
From: "Eli Collins (Created) (JIRA)" <jira@apache.org>
To: common-dev@hadoop.apache.org
Message-ID: <2427604.16014.1328729340719.JavaMail.tomcat@hel.zones.apache.org>
Subject: [jira] [Created] (HADOOP-8040) Add symlink support to FileSystem
MIME-Version: 1.0
Content-Type: text/plain; charset=utf-8
Content-Transfer-Encoding: 7bit
X-JIRA-FingerPrint: 30527f35849b9dde25b450d4833f0394
X-Virus-Checked: Checked by ClamAV on apache.org
Add symlink support to FileSystem
---------------------------------
Key: HADOOP-8040
URL: https://issues.apache.org/jira/browse/HADOOP-8040
Project: Hadoop Common
Issue Type: New Feature
Components: fs
Affects Versions: 0.23.0
Reporter: Eli Collins
Assignee: Eli Collins
HADOOP-6421 added symbolic links to FileContext. Resolving symlinks is done on the client-side, and therefore requires client support. An HDFS symlink (created by FileContext) when accessed by FileSystem will result in an unhandled UnresolvedLinkException. Because not all users will migrate from FileSystem to FileContext in lock step, and we want users of FileSystem to be able to access all paths created by FileContext, we need to support symlink resolution in FileSystem as well, to facilitate migration to FileContext.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
From common-dev-return-77657-apmail-hadoop-common-dev-archive=hadoop.apache.org@hadoop.apache.org Wed Feb 8 22:13:15 2012
Return-Path: <common-dev-return-77657-apmail-hadoop-common-dev-archive=hadoop.apache.org@hadoop.apache.org>
X-Original-To: apmail-hadoop-common-dev-archive@www.apache.org
Delivered-To: apmail-hadoop-common-dev-archive@www.apache.org
Received: from mail.apache.org (hermes.apache.org [140.211.11.3])
by minotaur.apache.org (Postfix) with SMTP id F188E9117
for <apmail-hadoop-common-dev-archive@www.apache.org>; Wed, 8 Feb 2012 22:13:14 +0000 (UTC)
Received: (qmail 77298 invoked by uid 500); 8 Feb 2012 22:13:13 -0000
Delivered-To: apmail-hadoop-common-dev-archive@hadoop.apache.org
Received: (qmail 77196 invoked by uid 500); 8 Feb 2012 22:13:12 -0000
Mailing-List: contact common-dev-help@hadoop.apache.org; run by ezmlm
Precedence: bulk
List-Help: <mailto:common-dev-help@hadoop.apache.org>
List-Unsubscribe: <mailto:common-dev-unsubscribe@hadoop.apache.org>
List-Post: <mailto:common-dev@hadoop.apache.org>
List-Id: <common-dev.hadoop.apache.org>
Reply-To: common-dev@hadoop.apache.org
Delivered-To: mailing list common-dev@hadoop.apache.org
Received: (qmail 77188 invoked by uid 99); 8 Feb 2012 22:13:12 -0000
Received: from athena.apache.org (HELO athena.apache.org) (140.211.11.136)
by apache.org (qpsmtpd/0.29) with ESMTP; Wed, 08 Feb 2012 22:13:12 +0000
X-ASF-Spam-Status: No, hits=3.5 required=5.0
tests=HTML_MESSAGE,RCVD_IN_BL_SPAMCOP_NET,RCVD_IN_DNSWL_LOW,SPF_PASS
X-Spam-Check-By: apache.org
Received-SPF: pass (athena.apache.org: domain of bewang.tech@gmail.com designates 209.85.210.176 as permitted sender)
Received: from [209.85.210.176] (HELO mail-iy0-f176.google.com) (209.85.210.176)
by apache.org (qpsmtpd/0.29) with ESMTP; Wed, 08 Feb 2012 22:13:07 +0000
Received: by iagz35 with SMTP id z35so1909857iag.35
for <common-dev@hadoop.apache.org>; Wed, 08 Feb 2012 14:12:46 -0800 (PST)
DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed;
d=gmail.com; s=gamma;
h=mime-version:in-reply-to:references:date:message-id:subject:from:to
:content-type;
bh=Wl9/lSl6k6FUQ4qyj/j26yPH9vJGStom9Vl1v8ilAUM=;
b=SBeIz/lERJ1SEvwnKtXoAra8LE6SbSMqz2JXiIe4vUTo2BJe2t9Ae8IAPMg4chnZBw
pDEo9q/MEzXxGMpV8rHrlmIE6JylNrzdmH1rn2sCBX3hehV3NLaBkhq29kSQcE8NHrSG
lqRMrq9wAmw9K2NGVXcE6g3G/rhmJs/gA6sME=
MIME-Version: 1.0
Received: by 10.50.208.1 with SMTP id ma1mr44076435igc.4.1328739166860; Wed,
08 Feb 2012 14:12:46 -0800 (PST)
Received: by 10.50.87.135 with HTTP; Wed, 8 Feb 2012 14:12:46 -0800 (PST)
In-Reply-To: <CANS822irt99c=NY74AChwKdzHRq1kyWNOUd6k8KZAYdyWB+zhQ@mail.gmail.com>
References: <CAMoVmf8qx_f2Txh-syv_Thegy5iD6Aa344EsBcepafk9SW0Mcg@mail.gmail.com>
<CAMoVmf8_o3fL=AjTNyeyt4qLKj=tCkPn=OXwWxq3nzpKwergPA@mail.gmail.com>
<CANS822irt99c=NY74AChwKdzHRq1kyWNOUd6k8KZAYdyWB+zhQ@mail.gmail.com>
Date: Wed, 8 Feb 2012 14:12:46 -0800
Message-ID: <CAMoVmf-AUuAVhBHahsgh7HpsUXtxmudzK0RAqCpiz5qpHRLGOw@mail.gmail.com>
Subject: Re: Hadoop Active Directory Integration
From: Benyi Wang <bewang.tech@gmail.com>
To: common-dev@hadoop.apache.org
Content-Type: multipart/alternative; boundary=14dae9340aed0a36bf04b87b32df
--14dae9340aed0a36bf04b87b32df
Content-Type: text/plain; charset=ISO-8859-1
Thanks for your answers.
But I am still not sure that I understand. Let me try again to clarify what
I really want to know:
Our cluster's is built on Linux CentOS without the integration of Kerberos
and Active directory integration. There is a Linux LDAP server which is not
integrated with Corp's Active Directory. I need to ask the admin team to
create a Linux account in the LDAP server first, then I can ssh to a Linux
box which we call client node. From the client node, I can submit mapred
jobs. This probably is what you say LDAP via PAM. Hadoop's user/group
system calls is actually redirected to the LDAP server by OS. Is this
right?
We have to wait for months before the admin team can synchronize Active
Directory with the Linux LDAP server. Before this happens, is it possible
that a new user which registered in AD can use our hadoop cluster without
creating an account in the Linux LDAP server?
When a client sends a request to NN or JT using kerberos authentication,
does the kerberos ticket include enough information about user/group so
that Hadoop doesn't need to use user/group system call, in other words,
doesn't need the LDAP server?
There is a slide called "kerberos dataflow" in
http://www.slideshare.net/hadoopusergroup/hadoop-security-preview. It said
user joe needs to get TGT and a service ticket, then be able to connect to
NN using the service ticket. Does it mean: a windows user can get a service
ticket and connect to NN without a Linux account for hadoop Linux cluster?
Suppose the window user in a security group of AD which allows to access
Hadoop Linux cluster.
We need this because we don't want our business user to log on our cluster,
but we want to allow them submit jobs remotely.
Hope this time I make it clear.
Thanks.
On Wed, Feb 8, 2012 at 10:54 AM, Patrick Angeles
<patrickangeles@gmail.com>wrote:
> On Wed, Feb 8, 2012 at 1:43 PM, Benyi Wang <bewang.tech@gmail.com> wrote:
>
> > Can anyone answer my questions?
> >
> > Thanks a lot.
> >
> > ---------- Forwarded message ----------
> > From: Benyi Wang <bewang.tech@gmail.com>
> > Date: Mon, Feb 6, 2012 at 11:07 PM
> > Subject: Hadoop Active Directory Integration
> > To: common-user@hadoop.apache.org
> >
> >
> > Hi,
> >
> > I have questions about Hadoop Active Directory Integration:
> >
> > 1. When using Active Directory, do we still need to create a Linux
> > account for each user on each Linux node?
> >
>
> Yes. You can do LDAP integration via PAM.
>
>
> > 2. What about if I enable queue acls and use fairscheduler? Will task
> > trackers send all ACLs check to Active directory? Can I list the user
> > accounts or AD security groups in mapred-queue-acls.xml? Do I need to
> > create those groups in Linux node?
> >
> The fairscheduler runs entirely on the JT. Those groups need to resolve on
> the JT (and NN) machines.
>
>
> > 3. Does someone configure Hadoop AD integration in multiple networks?
> > for example, my company have three networks: corp, lab, and prod. A
> > user
> > in "corp" network can log on a window server in lab or prod. If we want
> > to
> > use local MIT KDC and set up "one-way cross-realm trust from this realm
> > to the Active Directory realm" in
> >
> >
> https://ccp.cloudera.com/display/CDHDOC/Integrating+Hadoop+Security+with+Active+Directory
> > .
> > How to set up Kerberos in such a environment?
> >
>
> You can have a local KDC and realm per cluster, and set up one-way
> cross-realm trust on each realm to your corp AD.
>
>
> > 4. Is this right? If AD is setup, a window user can remotely submit a
> > mapred job?
> >
> I've never tried this, but my guess is it won't just work.
>
>
> > 5. What about the authorization? Can hadoop configure so that only
> users
> > in the specified security groups in AD can submit jobs.
> >
> You can do this via ACLs.
>
>
> >
> > Thanks.
> >
> > Ben
> >
>
--14dae9340aed0a36bf04b87b32df--
From common-dev-return-77658-apmail-hadoop-common-dev-archive=hadoop.apache.org@hadoop.apache.org Thu Feb 9 02:08:25 2012
Return-Path: <common-dev-return-77658-apmail-hadoop-common-dev-archive=hadoop.apache.org@hadoop.apache.org>
X-Original-To: apmail-hadoop-common-dev-archive@www.apache.org
Delivered-To: apmail-hadoop-common-dev-archive@www.apache.org
Received: from mail.apache.org (hermes.apache.org [140.211.11.3])
by minotaur.apache.org (Postfix) with SMTP id 6ACB498A3
for <apmail-hadoop-common-dev-archive@www.apache.org>; Thu, 9 Feb 2012 02:08:25 +0000 (UTC)
Received: (qmail 74501 invoked by uid 500); 9 Feb 2012 02:08:23 -0000
Delivered-To: apmail-hadoop-common-dev-archive@hadoop.apache.org
Received: (qmail 74448 invoked by uid 500); 9 Feb 2012 02:08:22 -0000
Mailing-List: contact common-dev-help@hadoop.apache.org; run by ezmlm
Precedence: bulk
List-Help: <mailto:common-dev-help@hadoop.apache.org>
List-Unsubscribe: <mailto:common-dev-unsubscribe@hadoop.apache.org>
List-Post: <mailto:common-dev@hadoop.apache.org>
List-Id: <common-dev.hadoop.apache.org>
Reply-To: common-dev@hadoop.apache.org
Delivered-To: mailing list common-dev@hadoop.apache.org
Received: (qmail 74440 invoked by uid 99); 9 Feb 2012 02:08:22 -0000
Received: from nike.apache.org (HELO nike.apache.org) (192.87.106.230)
by apache.org (qpsmtpd/0.29) with ESMTP; Thu, 09 Feb 2012 02:08:22 +0000
X-ASF-Spam-Status: No, hits=-2000.0 required=5.0
tests=ALL_TRUSTED,T_RP_MATCHES_RCVD
X-Spam-Check-By: apache.org
Received: from [140.211.11.116] (HELO hel.zones.apache.org) (140.211.11.116)
by apache.org (qpsmtpd/0.29) with ESMTP; Thu, 09 Feb 2012 02:08:20 +0000
Received: from hel.zones.apache.org (hel.zones.apache.org [140.211.11.116])
by hel.zones.apache.org (Postfix) with ESMTP id 614411AB418
for <common-dev@hadoop.apache.org>; Thu, 9 Feb 2012 02:07:59 +0000 (UTC)
Date: Thu, 9 Feb 2012 02:07:59 +0000 (UTC)
From: "Eli Collins (Created) (JIRA)" <jira@apache.org>
To: common-dev@hadoop.apache.org
Message-ID: <786239118.17729.1328753279399.JavaMail.tomcat@hel.zones.apache.org>
Subject: [jira] [Created] (HADOOP-8041) HA: log a warning when a failover is
first attempted
MIME-Version: 1.0
Content-Type: text/plain; charset=utf-8
Content-Transfer-Encoding: 7bit
X-JIRA-FingerPrint: 30527f35849b9dde25b450d4833f0394
X-Virus-Checked: Checked by ClamAV on apache.org
HA: log a warning when a failover is first attempted
-----------------------------------------------------
Key: HADOOP-8041
URL: https://issues.apache.org/jira/browse/HADOOP-8041
Project: Hadoop Common
Issue Type: Sub-task
Components: ha
Affects Versions: HA Branch (HDFS-1623)
Reporter: Eli Collins
Currently we always warn for each client operation made to a NN we've failed over to:
{noformat}
hadoop-0.24.0-SNAPSHOT $ ./bin/hdfs dfs -lsr /
12/02/08 17:43:04 WARN retry.RetryInvocationHandler: Exception while invoking getFileInfo of class org.apache.hadoop.hdfs.protocolPB.ClientNamenodeProtocolTranslatorPB after 0 fail over attempts. Trying to fail over immediately.
{noformat}
I'm going to remove this warning in HDFS-2918 since we shouldn't warn every time a client performs an operation, eg could be weeks after the failover. But we should eg log a warning eg the client first does a failover.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
From common-dev-return-77659-apmail-hadoop-common-dev-archive=hadoop.apache.org@hadoop.apache.org Thu Feb 9 02:10:52 2012
Return-Path: <common-dev-return-77659-apmail-hadoop-common-dev-archive=hadoop.apache.org@hadoop.apache.org>
X-Original-To: apmail-hadoop-common-dev-archive@www.apache.org
Delivered-To: apmail-hadoop-common-dev-archive@www.apache.org
Received: from mail.apache.org (hermes.apache.org [140.211.11.3])
by minotaur.apache.org (Postfix) with SMTP id DEA7498DE
for <apmail-hadoop-common-dev-archive@www.apache.org>; Thu, 9 Feb 2012 02:10:51 +0000 (UTC)
Received: (qmail 76598 invoked by uid 500); 9 Feb 2012 02:10:50 -0000
Delivered-To: apmail-hadoop-common-dev-archive@hadoop.apache.org
Received: (qmail 76476 invoked by uid 500); 9 Feb 2012 02:10:49 -0000
Mailing-List: contact common-dev-help@hadoop.apache.org; run by ezmlm
Precedence: bulk
List-Help: <mailto:common-dev-help@hadoop.apache.org>
List-Unsubscribe: <mailto:common-dev-unsubscribe@hadoop.apache.org>
List-Post: <mailto:common-dev@hadoop.apache.org>
List-Id: <common-dev.hadoop.apache.org>
Reply-To: common-dev@hadoop.apache.org
Delivered-To: mailing list common-dev@hadoop.apache.org
Received: (qmail 76453 invoked by uid 99); 9 Feb 2012 02:10:49 -0000
Received: from nike.apache.org (HELO nike.apache.org) (192.87.106.230)
by apache.org (qpsmtpd/0.29) with ESMTP; Thu, 09 Feb 2012 02:10:49 +0000
X-ASF-Spam-Status: No, hits=2.2 required=5.0
tests=HTML_MESSAGE,SPF_PASS
X-Spam-Check-By: apache.org
Received-SPF: pass (nike.apache.org: domain of ryanzhutao@163.com designates 220.181.13.31 as permitted sender)
Received: from [220.181.13.31] (HELO m13-31.163.com) (220.181.13.31)
by apache.org (qpsmtpd/0.29) with ESMTP; Thu, 09 Feb 2012 02:10:41 +0000
DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=163.com;
s=s110527; h=Received:Date:From:To:Message-ID:Subject:
MIME-Version:Content-Type; bh=OZiAilLluajdFWAiGwe84D0zkxezmuvtcb
nUZMlfIPg=; b=Pba4a+qKOWW0fPXnrTKHl3T43DmJR5qdD/eaMiqAygDeHc7rsi
hGRNJSXIc1tI/gf/uP4fe53Lgklbc/LHBIZ8slVQkDXR6MquLG9b+NcxvqSHfoTh
SCNVuyhkW2FWJiwN+WRUCVvn1XGYUptcg+L9jSxSHwffZqaUuGuu9AxSM=
Received: from ryanzhutao ( [221.123.180.107] ) by ajax-webmail-wmsvr31
(Coremail) ; Thu, 9 Feb 2012 10:10:16 +0800 (CST)
Date: Thu, 9 Feb 2012 10:10:16 +0800 (CST)
From: =?GBK?B?1uzoug==?= <ryanzhutao@163.com>
To: "common-user@hadoop.apache.org" <common-user@hadoop.apache.org>,
"core-user@hadoop.apache.org" <core-user@hadoop.apache.org>,
"common-dev@hadoop.apache.org" <common-dev@hadoop.apache.org>
Message-ID: <43004e96.5a21.1355fe01945.Coremail.ryanzhutao@163.com>
Subject: problem with hadoop yarn configuration
MIME-Version: 1.0
Content-Type: multipart/alternative;
boundary="----=_Part_69895_1789896811.1328753416516"
X-Originating-IP: [221.123.180.107]
X-Priority: 3
X-Mailer: Coremail Webmail Server Version SP_ntes V3.5 build
111202(16086.4213.4207) Copyright (c) 2002-2012 www.mailtech.cn 163com
X-CM-CTRLDATA: T0JvOWZvb3Rlcl9odG09NjkyOjgx
X-CM-TRANSID:H8GowGD5nkAIKzNPtisVAA--.3161W
X-CM-SenderInfo: hu1d065kxwt0i6rwjhhfrp/1tbiLhhP0U0vMTKVRQABsY
X-Coremail-Antispam: 1U5529EdanIXcx71UUUUU7vcSsGvfC2KfnxnUU==
X-Virus-Checked: Checked by ClamAV on apache.org
------=_Part_69895_1789896811.1328753416516
Content-Type: text/plain; charset=GBK
Content-Transfer-Encoding: 7bit
hi guys,
I met a problem with hadoop yarn configuration.
If I configure "mapreduce.framework.name" as yarn, I submit a job, the job does not run, it stays map 0% reduce 0%. I can see the submitted job from resourcemanage But if I does not configure this parameter(the default value is local), the job runs exceptionally fast and I can't see the submitted job from resourcemanage.
What is the difference between "local" and "yarn"?
Tao Zhu
------=_Part_69895_1789896811.1328753416516--
From common-dev-return-77660-apmail-hadoop-common-dev-archive=hadoop.apache.org@hadoop.apache.org Thu Feb 9 03:08:40 2012
Return-Path: <common-dev-return-77660-apmail-hadoop-common-dev-archive=hadoop.apache.org@hadoop.apache.org>
X-Original-To: apmail-hadoop-common-dev-archive@www.apache.org
Delivered-To: apmail-hadoop-common-dev-archive@www.apache.org
Received: from mail.apache.org (hermes.apache.org [140.211.11.3])
by minotaur.apache.org (Postfix) with SMTP id 611689D52
for <apmail-hadoop-common-dev-archive@www.apache.org>; Thu, 9 Feb 2012 03:08:40 +0000 (UTC)
Received: (qmail 34939 invoked by uid 500); 9 Feb 2012 03:08:37 -0000
Delivered-To: apmail-hadoop-common-dev-archive@hadoop.apache.org
Received: (qmail 34022 invoked by uid 500); 9 Feb 2012 03:08:28 -0000
Mailing-List: contact common-dev-help@hadoop.apache.org; run by ezmlm
Precedence: bulk
List-Help: <mailto:common-dev-help@hadoop.apache.org>
List-Unsubscribe: <mailto:common-dev-unsubscribe@hadoop.apache.org>
List-Post: <mailto:common-dev@hadoop.apache.org>
List-Id: <common-dev.hadoop.apache.org>
Reply-To: common-dev@hadoop.apache.org
Delivered-To: mailing list common-dev@hadoop.apache.org
Received: (qmail 33972 invoked by uid 99); 9 Feb 2012 03:08:25 -0000
Received: from athena.apache.org (HELO athena.apache.org) (140.211.11.136)
by apache.org (qpsmtpd/0.29) with ESMTP; Thu, 09 Feb 2012 03:08:25 +0000
X-ASF-Spam-Status: No, hits=-2000.0 required=5.0
tests=ALL_TRUSTED,T_RP_MATCHES_RCVD
X-Spam-Check-By: apache.org
Received: from [140.211.11.116] (HELO hel.zones.apache.org) (140.211.11.116)
by apache.org (qpsmtpd/0.29) with ESMTP; Thu, 09 Feb 2012 03:08:24 +0000
Received: from hel.zones.apache.org (hel.zones.apache.org [140.211.11.116])
by hel.zones.apache.org (Postfix) with ESMTP id ED3271AB9E9
for <common-dev@hadoop.apache.org>; Thu, 9 Feb 2012 03:08:03 +0000 (UTC)
Date: Thu, 9 Feb 2012 03:08:03 +0000 (UTC)
From: "Allen Wittenauer (Created) (JIRA)" <jira@apache.org>
To: common-dev@hadoop.apache.org
Message-ID: <345252500.17847.1328756883972.JavaMail.tomcat@hel.zones.apache.org>
Subject: [jira] [Created] (HADOOP-8043) KerberosAuthenticationFilter and
friends have some problems
MIME-Version: 1.0
Content-Type: text/plain; charset=utf-8
Content-Transfer-Encoding: 7bit
X-JIRA-FingerPrint: 30527f35849b9dde25b450d4833f0394
KerberosAuthenticationFilter and friends have some problems
-----------------------------------------------------------
Key: HADOOP-8043
URL: https://issues.apache.org/jira/browse/HADOOP-8043
Project: Hadoop Common
Issue Type: Bug
Components: security
Affects Versions: 1.0.0
Reporter: Allen Wittenauer
Priority: Critical
KerberosAuthenticationFilter and friends have three killer usability issues and bugs:
1. Documentation is misleading/wrong.
2. Shared secret stored in a world readable file.
3. Lacks support for _HOST macro
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
From common-dev-return-77661-apmail-hadoop-common-dev-archive=hadoop.apache.org@hadoop.apache.org Thu Feb 9 03:08:46 2012
Return-Path: <common-dev-return-77661-apmail-hadoop-common-dev-archive=hadoop.apache.org@hadoop.apache.org>
X-Original-To: apmail-hadoop-common-dev-archive@www.apache.org
Delivered-To: apmail-hadoop-common-dev-archive@www.apache.org
Received: from mail.apache.org (hermes.apache.org [140.211.11.3])
by minotaur.apache.org (Postfix) with SMTP id 573159D7E
for <apmail-hadoop-common-dev-archive@www.apache.org>; Thu, 9 Feb 2012 03:08:46 +0000 (UTC)
Received: (qmail 36402 invoked by uid 500); 9 Feb 2012 03:08:44 -0000
Delivered-To: apmail-hadoop-common-dev-archive@hadoop.apache.org
Received: (qmail 35109 invoked by uid 500); 9 Feb 2012 03:08:38 -0000
Mailing-List: contact common-dev-help@hadoop.apache.org; run by ezmlm
Precedence: bulk
List-Help: <mailto:common-dev-help@hadoop.apache.org>
List-Unsubscribe: <mailto:common-dev-unsubscribe@hadoop.apache.org>
List-Post: <mailto:common-dev@hadoop.apache.org>
List-Id: <common-dev.hadoop.apache.org>
Reply-To: common-dev@hadoop.apache.org
Delivered-To: mailing list common-dev@hadoop.apache.org
Received: (qmail 33990 invoked by uid 99); 9 Feb 2012 03:08:27 -0000
Received: from nike.apache.org (HELO nike.apache.org) (192.87.106.230)
by apache.org (qpsmtpd/0.29) with ESMTP; Thu, 09 Feb 2012 03:08:27 +0000
X-ASF-Spam-Status: No, hits=-2000.0 required=5.0
tests=ALL_TRUSTED,T_RP_MATCHES_RCVD
X-Spam-Check-By: apache.org
Received: from [140.211.11.116] (HELO hel.zones.apache.org) (140.211.11.116)
by apache.org (qpsmtpd/0.29) with ESMTP; Thu, 09 Feb 2012 03:08:24 +0000
Received: from hel.zones.apache.org (hel.zones.apache.org [140.211.11.116])
by hel.zones.apache.org (Postfix) with ESMTP id 92D5A1AB9E7
for <common-dev@hadoop.apache.org>; Thu, 9 Feb 2012 03:08:03 +0000 (UTC)
Date: Thu, 9 Feb 2012 03:08:03 +0000 (UTC)
From: "Matt Foley (Resolved) (JIRA)" <jira@apache.org>
To: common-dev@hadoop.apache.org
Message-ID: <1142929095.17845.1328756883620.JavaMail.tomcat@hel.zones.apache.org>
In-Reply-To: <740714091.13751.1328689919516.JavaMail.tomcat@hel.zones.apache.org>
Subject: [jira] [Resolved] (HADOOP-8037) Binary tarball does not preserve
platform info for native builds, and RPMs fail to provide needed symlinks
for libhadoop.so
MIME-Version: 1.0
Content-Type: text/plain; charset=utf-8
Content-Transfer-Encoding: 7bit
X-JIRA-FingerPrint: 30527f35849b9dde25b450d4833f0394
X-Virus-Checked: Checked by ClamAV on apache.org
[ https://issues.apache.org/jira/browse/HADOOP-8037?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Matt Foley resolved HADOOP-8037.
--------------------------------
Resolution: Fixed
Fix Version/s: 1.0.1
> Binary tarball does not preserve platform info for native builds, and RPMs fail to provide needed symlinks for libhadoop.so
> ---------------------------------------------------------------------------------------------------------------------------
>
> Key: HADOOP-8037
> URL: https://issues.apache.org/jira/browse/HADOOP-8037
> Project: Hadoop Common
> Issue Type: Bug
> Components: build
> Affects Versions: 1.0.1
> Reporter: Matt Foley
> Assignee: Giridharan Kesavan
> Priority: Blocker
> Fix For: 1.0.1
>
> Attachments: hadoop-8027-1.patch, hadoop-8037-1.patch, hadoop-8037.patch
>
>
> The source tarball uses "package" ant target, which includes both sets of native builds (32 and 64 bit libraries), under subdirectories that are named for the supported platform, so you can tell what they are.
> The binary tarball uses the "bin-package" ant target, which projects both sets of native builds into a single directory, stripping out the platform names from the directory paths. Since the native built libraries have identical names, only one of each survives the process. Afterward, there is no way to know whether they are intended for 32 or 64 bit environments.
> It seems to be done this way as a step toward building the rpm and deb artifacts. But the rpms and debs are self-identifying as to the platform they were built for, and contain only one set of libs each, while the binary tarball isn't. The binary tarball should have the same platform-specific subdirectories that the full tarball does; but this means that the rpm and deb builds have to be more careful about include/exclude specs for what goes into those artifacts.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
From common-dev-return-77662-apmail-hadoop-common-dev-archive=hadoop.apache.org@hadoop.apache.org Thu Feb 9 04:58:55 2012
Return-Path: <common-dev-return-77662-apmail-hadoop-common-dev-archive=hadoop.apache.org@hadoop.apache.org>
X-Original-To: apmail-hadoop-common-dev-archive@www.apache.org
Delivered-To: apmail-hadoop-common-dev-archive@www.apache.org
Received: from mail.apache.org (hermes.apache.org [140.211.11.3])
by minotaur.apache.org (Postfix) with SMTP id 0A8C390D4
for <apmail-hadoop-common-dev-archive@www.apache.org>; Thu, 9 Feb 2012 04:58:55 +0000 (UTC)
Received: (qmail 17440 invoked by uid 500); 9 Feb 2012 04:58:53 -0000
Delivered-To: apmail-hadoop-common-dev-archive@hadoop.apache.org
Received: (qmail 16385 invoked by uid 500); 9 Feb 2012 04:58:35 -0000
Mailing-List: contact common-dev-help@hadoop.apache.org; run by ezmlm
Precedence: bulk
List-Help: <mailto:common-dev-help@hadoop.apache.org>
List-Unsubscribe: <mailto:common-dev-unsubscribe@hadoop.apache.org>
List-Post: <mailto:common-dev@hadoop.apache.org>
List-Id: <common-dev.hadoop.apache.org>
Reply-To: common-dev@hadoop.apache.org
Delivered-To: mailing list common-dev@hadoop.apache.org
Received: (qmail 16357 invoked by uid 99); 9 Feb 2012 04:58:21 -0000
Received: from athena.apache.org (HELO athena.apache.org) (140.211.11.136)
by apache.org (qpsmtpd/0.29) with ESMTP; Thu, 09 Feb 2012 04:58:21 +0000
X-ASF-Spam-Status: No, hits=-2000.0 required=5.0
tests=ALL_TRUSTED,T_RP_MATCHES_RCVD
X-Spam-Check-By: apache.org
Received: from [140.211.11.116] (HELO hel.zones.apache.org) (140.211.11.116)
by apache.org (qpsmtpd/0.29) with ESMTP; Thu, 09 Feb 2012 04:58:19 +0000
Received: from hel.zones.apache.org (hel.zones.apache.org [140.211.11.116])
by hel.zones.apache.org (Postfix) with ESMTP id 9AE041AB5DA
for <common-dev@hadoop.apache.org>; Thu, 9 Feb 2012 04:57:59 +0000 (UTC)
Date: Thu, 9 Feb 2012 04:57:59 +0000 (UTC)
From: "Todd Lipcon (Created) (JIRA)" <jira@apache.org>
To: common-dev@hadoop.apache.org
Message-ID: <626472902.18077.1328763479635.JavaMail.tomcat@hel.zones.apache.org>
Subject: [jira] [Created] (HADOOP-8044) Unify ProtocolMetaInterface and
ProtocolTranslator interface
MIME-Version: 1.0
Content-Type: text/plain; charset=utf-8
Content-Transfer-Encoding: 7bit
X-JIRA-FingerPrint: 30527f35849b9dde25b450d4833f0394
Unify ProtocolMetaInterface and ProtocolTranslator interface
------------------------------------------------------------
Key: HADOOP-8044
URL: https://issues.apache.org/jira/browse/HADOOP-8044
Project: Hadoop Common
Issue Type: Improvement
Components: ha, ipc
Affects Versions: HA Branch (HDFS-1623)
Reporter: Todd Lipcon
Assignee: Aaron T. Myers
Priority: Minor
Fix For: HA Branch (HDFS-1623)
In the HA branch we have a "ProtocolTranslator" interface which we had to add, and it seems to have the same purpose as the "ProtocolMetaInterface" interface which got added in trunk in the meantime. We should unify the two.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
From common-dev-return-77663-apmail-hadoop-common-dev-archive=hadoop.apache.org@hadoop.apache.org Thu Feb 9 06:20:47 2012
Return-Path: <common-dev-return-77663-apmail-hadoop-common-dev-archive=hadoop.apache.org@hadoop.apache.org>
X-Original-To: apmail-hadoop-common-dev-archive@www.apache.org
Delivered-To: apmail-hadoop-common-dev-archive@www.apache.org
Received: from mail.apache.org (hermes.apache.org [140.211.11.3])
by minotaur.apache.org (Postfix) with SMTP id 33DFD90C4
for <apmail-hadoop-common-dev-archive@www.apache.org>; Thu, 9 Feb 2012 06:20:47 +0000 (UTC)
Received: (qmail 5356 invoked by uid 500); 9 Feb 2012 06:20:43 -0000
Delivered-To: apmail-hadoop-common-dev-archive@hadoop.apache.org
Received: (qmail 2447 invoked by uid 500); 9 Feb 2012 06:20:26 -0000
Mailing-List: contact common-dev-help@hadoop.apache.org; run by ezmlm
Precedence: bulk
List-Help: <mailto:common-dev-help@hadoop.apache.org>
List-Unsubscribe: <mailto:common-dev-unsubscribe@hadoop.apache.org>
List-Post: <mailto:common-dev@hadoop.apache.org>
List-Id: <common-dev.hadoop.apache.org>
Reply-To: common-dev@hadoop.apache.org
Delivered-To: mailing list common-dev@hadoop.apache.org
Received: (qmail 2389 invoked by uid 99); 9 Feb 2012 06:20:21 -0000
Received: from athena.apache.org (HELO athena.apache.org) (140.211.11.136)
by apache.org (qpsmtpd/0.29) with ESMTP; Thu, 09 Feb 2012 06:20:21 +0000
X-ASF-Spam-Status: No, hits=-2000.0 required=5.0
tests=ALL_TRUSTED,T_RP_MATCHES_RCVD
X-Spam-Check-By: apache.org
Received: from [140.211.11.116] (HELO hel.zones.apache.org) (140.211.11.116)
by apache.org (qpsmtpd/0.29) with ESMTP; Thu, 09 Feb 2012 06:20:19 +0000
Received: from hel.zones.apache.org (hel.zones.apache.org [140.211.11.116])
by hel.zones.apache.org (Postfix) with ESMTP id 7EE941AB7FD
for <common-dev@hadoop.apache.org>; Thu, 9 Feb 2012 06:19:59 +0000 (UTC)
Date: Thu, 9 Feb 2012 06:19:59 +0000 (UTC)
From: "Matt Foley (Reopened) (JIRA)" <jira@apache.org>
To: common-dev@hadoop.apache.org
Message-ID: <435040833.18299.1328768399521.JavaMail.tomcat@hel.zones.apache.org>
In-Reply-To: <740714091.13751.1328689919516.JavaMail.tomcat@hel.zones.apache.org>
Subject: [jira] [Reopened] (HADOOP-8037) Binary tarball does not preserve
platform info for native builds, and RPMs fail to provide needed symlinks
for libhadoop.so
MIME-Version: 1.0
Content-Type: text/plain; charset=utf-8
Content-Transfer-Encoding: 7bit
X-JIRA-FingerPrint: 30527f35849b9dde25b450d4833f0394
[ https://issues.apache.org/jira/browse/HADOOP-8037?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Matt Foley reopened HADOOP-8037:
--------------------------------
Regrettably, I have to revert this patch. I didn't notice it before, but the sizes of the resulting rpm and bin-tarball files are greatly increased due to duplicated files. We have to try again:
{code}
pre-patch sizes:
-rw-r--r-- 1 hortonfo users 31975332 Jan 31 02:42 hadoop_1.0.1-1_amd64.deb
-rw-r--r-- 1 hortonfo users 32039471 Jan 31 02:40 hadoop-1.0.1-1.amd64.rpm
-rw-r--r-- 1 hortonfo users 35909710 Jan 31 02:35 hadoop_1.0.1-1_i386.deb
-rw-r--r-- 1 hortonfo users 35974659 Jan 31 02:34 hadoop-1.0.1-1.i386.rpm
-rw-r--r-- 1 hortonfo users 31965140 Jan 31 02:41 hadoop-1.0.1-bin.tar.gz
-rw-r--r-- 1 hortonfo users 60322619 Jan 31 02:39 hadoop-1.0.1.tar.gz
post-patch sizes:
-rw-r--r-- 1 hortonfo users 93729906 Feb 9 03:38 hadoop_1.0.1-1_amd64.deb
-rw-r--r-- 1 hortonfo users 40754076 Feb 9 03:36 hadoop-1.0.1-1.amd64.rpm
-rw-r--r-- 1 hortonfo users 101357042 Feb 9 03:29 hadoop_1.0.1-1_i386.deb
-rw-r--r-- 1 hortonfo users 48735998 Feb 9 03:27 hadoop-1.0.1-1.i386.rpm
-rw-r--r-- 1 hortonfo users 66467789 Feb 9 03:38 hadoop-1.0.1-bin.tar.gz
-rw-r--r-- 1 hortonfo users 60782862 Feb 9 03:34 hadoop-1.0.1.tar.gz
pre-patch file counts:
445 hadoop-1.0.1-1.amd64.rpm
445 hadoop-1.0.1-1.i386.rpm
330 hadoop-1.0.1-bin.tar.gz
6974 hadoop-1.0.1.tar.gz
post-patch file counts:
789 hadoop-1.0.1-1.amd64.rpm
792 hadoop-1.0.1-1.i386.rpm
668 hadoop-1.0.1-bin.tar.gz
6978 hadoop-1.0.1.tar.gz
{code}
> Binary tarball does not preserve platform info for native builds, and RPMs fail to provide needed symlinks for libhadoop.so
> ---------------------------------------------------------------------------------------------------------------------------
>
> Key: HADOOP-8037
> URL: https://issues.apache.org/jira/browse/HADOOP-8037
> Project: Hadoop Common
> Issue Type: Bug
> Components: build
> Affects Versions: 1.0.1
> Reporter: Matt Foley
> Assignee: Giridharan Kesavan
> Priority: Blocker
> Attachments: hadoop-8027-1.patch, hadoop-8037-1.patch, hadoop-8037.patch
>
>
> The source tarball uses "package" ant target, which includes both sets of native builds (32 and 64 bit libraries), under subdirectories that are named for the supported platform, so you can tell what they are.
> The binary tarball uses the "bin-package" ant target, which projects both sets of native builds into a single directory, stripping out the platform names from the directory paths. Since the native built libraries have identical names, only one of each survives the process. Afterward, there is no way to know whether they are intended for 32 or 64 bit environments.
> It seems to be done this way as a step toward building the rpm and deb artifacts. But the rpms and debs are self-identifying as to the platform they were built for, and contain only one set of libs each, while the binary tarball isn't. The binary tarball should have the same platform-specific subdirectories that the full tarball does; but this means that the rpm and deb builds have to be more careful about include/exclude specs for what goes into those artifacts.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
From common-dev-return-77664-apmail-hadoop-common-dev-archive=hadoop.apache.org@hadoop.apache.org Thu Feb 9 06:47:45 2012
Return-Path: <common-dev-return-77664-apmail-hadoop-common-dev-archive=hadoop.apache.org@hadoop.apache.org>
X-Original-To: apmail-hadoop-common-dev-archive@www.apache.org
Delivered-To: apmail-hadoop-common-dev-archive@www.apache.org
Received: from mail.apache.org (hermes.apache.org [140.211.11.3])
by minotaur.apache.org (Postfix) with SMTP id ECB509330
for <apmail-hadoop-common-dev-archive@www.apache.org>; Thu, 9 Feb 2012 06:47:44 +0000 (UTC)
Received: (qmail 34005 invoked by uid 500); 9 Feb 2012 06:47:42 -0000
Delivered-To: apmail-hadoop-common-dev-archive@hadoop.apache.org
Received: (qmail 33042 invoked by uid 500); 9 Feb 2012 06:47:25 -0000
Mailing-List: contact common-dev-help@hadoop.apache.org; run by ezmlm
Precedence: bulk
List-Help: <mailto:common-dev-help@hadoop.apache.org>
List-Unsubscribe: <mailto:common-dev-unsubscribe@hadoop.apache.org>
List-Post: <mailto:common-dev@hadoop.apache.org>
List-Id: <common-dev.hadoop.apache.org>
Reply-To: common-dev@hadoop.apache.org
Delivered-To: mailing list common-dev@hadoop.apache.org
Received: (qmail 33010 invoked by uid 99); 9 Feb 2012 06:47:18 -0000
Received: from athena.apache.org (HELO athena.apache.org) (140.211.11.136)
by apache.org (qpsmtpd/0.29) with ESMTP; Thu, 09 Feb 2012 06:47:18 +0000
X-ASF-Spam-Status: No, hits=-2000.0 required=5.0
tests=ALL_TRUSTED,T_RP_MATCHES_RCVD
X-Spam-Check-By: apache.org
Received: from [140.211.11.116] (HELO hel.zones.apache.org) (140.211.11.116)
by apache.org (qpsmtpd/0.29) with ESMTP; Thu, 09 Feb 2012 06:47:17 +0000
Received: from hel.zones.apache.org (hel.zones.apache.org [140.211.11.116])
by hel.zones.apache.org (Postfix) with ESMTP id 7BD121AC3D9
for <common-dev@hadoop.apache.org>; Thu, 9 Feb 2012 06:46:57 +0000 (UTC)
Date: Thu, 9 Feb 2012 06:46:57 +0000 (UTC)
From: "Todd Lipcon (Resolved) (JIRA)" <jira@apache.org>
To: common-dev@hadoop.apache.org
Message-ID: <937889010.18344.1328770017508.JavaMail.tomcat@hel.zones.apache.org>
In-Reply-To: <626472902.18077.1328763479635.JavaMail.tomcat@hel.zones.apache.org>
Subject: [jira] [Resolved] (HADOOP-8044) Unify ProtocolMetaInterface and
ProtocolTranslator interface
MIME-Version: 1.0
Content-Type: text/plain; charset=utf-8
Content-Transfer-Encoding: 7bit
X-JIRA-FingerPrint: 30527f35849b9dde25b450d4833f0394
[ https://issues.apache.org/jira/browse/HADOOP-8044?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Todd Lipcon resolved HADOOP-8044.
---------------------------------
Resolution: Invalid
Gotcha, that makes sense. Resolving as invalid, sorry for the noise.
> Unify ProtocolMetaInterface and ProtocolTranslator interface
> ------------------------------------------------------------
>
> Key: HADOOP-8044
> URL: https://issues.apache.org/jira/browse/HADOOP-8044
> Project: Hadoop Common
> Issue Type: Improvement
> Components: ha, ipc
> Affects Versions: HA Branch (HDFS-1623)
> Reporter: Todd Lipcon
> Assignee: Aaron T. Myers
> Priority: Minor
> Fix For: HA Branch (HDFS-1623)
>
>
> In the HA branch we have a "ProtocolTranslator" interface which we had to add, and it seems to have the same purpose as the "ProtocolMetaInterface" interface which got added in trunk in the meantime. We should unify the two.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
From common-dev-return-77665-apmail-hadoop-common-dev-archive=hadoop.apache.org@hadoop.apache.org Thu Feb 9 07:19:40 2012
Return-Path: <common-dev-return-77665-apmail-hadoop-common-dev-archive=hadoop.apache.org@hadoop.apache.org>
X-Original-To: apmail-hadoop-common-dev-archive@www.apache.org
Delivered-To: apmail-hadoop-common-dev-archive@www.apache.org
Received: from mail.apache.org (hermes.apache.org [140.211.11.3])
by minotaur.apache.org (Postfix) with SMTP id 13CA59DB9
for <apmail-hadoop-common-dev-archive@www.apache.org>; Thu, 9 Feb 2012 07:19:40 +0000 (UTC)
Received: (qmail 64322 invoked by uid 500); 9 Feb 2012 07:19:38 -0000
Delivered-To: apmail-hadoop-common-dev-archive@hadoop.apache.org
Received: (qmail 63349 invoked by uid 500); 9 Feb 2012 07:19:27 -0000
Mailing-List: contact common-dev-help@hadoop.apache.org; run by ezmlm
Precedence: bulk
List-Help: <mailto:common-dev-help@hadoop.apache.org>
List-Unsubscribe: <mailto:common-dev-unsubscribe@hadoop.apache.org>
List-Post: <mailto:common-dev@hadoop.apache.org>
List-Id: <common-dev.hadoop.apache.org>
Reply-To: common-dev@hadoop.apache.org
Delivered-To: mailing list common-dev@hadoop.apache.org
Received: (qmail 63322 invoked by uid 99); 9 Feb 2012 07:19:21 -0000
Received: from athena.apache.org (HELO athena.apache.org) (140.211.11.136)
by apache.org (qpsmtpd/0.29) with ESMTP; Thu, 09 Feb 2012 07:19:21 +0000
X-ASF-Spam-Status: No, hits=-2000.0 required=5.0
tests=ALL_TRUSTED,T_RP_MATCHES_RCVD
X-Spam-Check-By: apache.org
Received: from [140.211.11.116] (HELO hel.zones.apache.org) (140.211.11.116)
by apache.org (qpsmtpd/0.29) with ESMTP; Thu, 09 Feb 2012 07:19:19 +0000
Received: from hel.zones.apache.org (hel.zones.apache.org [140.211.11.116])
by hel.zones.apache.org (Postfix) with ESMTP id A8B391ACEE1
for <common-dev@hadoop.apache.org>; Thu, 9 Feb 2012 07:18:59 +0000 (UTC)
Date: Thu, 9 Feb 2012 07:18:59 +0000 (UTC)
From: "Tarjei Huse (Created) (JIRA)" <jira@apache.org>
To: common-dev@hadoop.apache.org
Message-ID: <2133034977.18391.1328771939692.JavaMail.tomcat@hel.zones.apache.org>
Subject: [jira] [Created] (HADOOP-8045)
org.apache.hadoop.mapreduce.lib.output.MultipleOutputs does not handle many
files well
MIME-Version: 1.0
Content-Type: text/plain; charset=utf-8
Content-Transfer-Encoding: 7bit
X-JIRA-FingerPrint: 30527f35849b9dde25b450d4833f0394
org.apache.hadoop.mapreduce.lib.output.MultipleOutputs does not handle many files well
--------------------------------------------------------------------------------------
Key: HADOOP-8045
URL: https://issues.apache.org/jira/browse/HADOOP-8045
Project: Hadoop Common
Issue Type: Bug
Components: io
Affects Versions: 1.0.0, 0.21.0
Environment: Cloudera CH3 release.
Reporter: Tarjei Huse
We were tryong to use MultipleOutputs to write one file per key. This produced the error:
exception:
org.apache.hadoop.ipc.RemoteException: java.io.IOException: File
/user/me/part6/_temporary/
_attempt_201202071305_0017_r_000000_2/2011-11-18-22-
attempt_201202071305_0017_r_000000_2-r-00000
could only be replicated to 0 nodes, instead of 1
at
org.apache.hadoop.hdfs.server.namenode.FSNamesystem.getAdditionalBlock(FSNamesystem.java:
1520)
at
org.apache.hadoop.hdfs.server.namenode.NameNode.addBlock(NameNode.java:
665)
at sun.reflect.GeneratedMethodAccessor4.invoke(Unknown Source)
at
sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:
25)
at java.lang.reflect.Method.invoke(Method.java:597)
at org.apache.hadoop.ipc.RPC$Server.call(RPC.java:557)
at org.apache.hadoop.ipc.Server$Handler$1.run(Server.java:1434)
at org.apache.hadoop.ipc.Server$Handler$1.run(Server.java:1430)
at java.security.AccessController.doPrivileged(Native Method)
at javax.security.auth.Subject.doAs(Subject.java:396)
at
org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:
1157)
When the nr. of files processed increased over 20 on a single developer system.
The solution proved to be to close each RecordWriter when the reducer was finished with a key, something that required that we extended the multiple outputs to fetch the recordwriter - not a good solution.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
From common-dev-return-77666-apmail-hadoop-common-dev-archive=hadoop.apache.org@hadoop.apache.org Thu Feb 9 07:58:40 2012
Return-Path: <common-dev-return-77666-apmail-hadoop-common-dev-archive=hadoop.apache.org@hadoop.apache.org>
X-Original-To: apmail-hadoop-common-dev-archive@www.apache.org
Delivered-To: apmail-hadoop-common-dev-archive@www.apache.org
Received: from mail.apache.org (hermes.apache.org [140.211.11.3])
by minotaur.apache.org (Postfix) with SMTP id 2D8919F9D
for <apmail-hadoop-common-dev-archive@www.apache.org>; Thu, 9 Feb 2012 07:58:40 +0000 (UTC)
Received: (qmail 94401 invoked by uid 500); 9 Feb 2012 07:58:33 -0000
Delivered-To: apmail-hadoop-common-dev-archive@hadoop.apache.org
Received: (qmail 94012 invoked by uid 500); 9 Feb 2012 07:58:17 -0000
Mailing-List: contact common-dev-help@hadoop.apache.org; run by ezmlm
Precedence: bulk
List-Help: <mailto:common-dev-help@hadoop.apache.org>
List-Unsubscribe: <mailto:common-dev-unsubscribe@hadoop.apache.org>
List-Post: <mailto:common-dev@hadoop.apache.org>
List-Id: <common-dev.hadoop.apache.org>
Reply-To: common-dev@hadoop.apache.org
Delivered-To: mailing list common-dev@hadoop.apache.org
Received: (qmail 94003 invoked by uid 500); 9 Feb 2012 07:58:11 -0000
Delivered-To: apmail-hadoop-core-dev@hadoop.apache.org
Received: (qmail 93996 invoked by uid 99); 9 Feb 2012 07:58:10 -0000
Received: from athena.apache.org (HELO athena.apache.org) (140.211.11.136)
by apache.org (qpsmtpd/0.29) with ESMTP; Thu, 09 Feb 2012 07:58:10 +0000
X-ASF-Spam-Status: No, hits=-0.0 required=5.0
tests=SPF_PASS
X-Spam-Check-By: apache.org
Received-SPF: pass (athena.apache.org: domain of lists@nabble.com designates 216.139.236.26 as permitted sender)
Received: from [216.139.236.26] (HELO sam.nabble.com) (216.139.236.26)
by apache.org (qpsmtpd/0.29) with ESMTP; Thu, 09 Feb 2012 07:58:04 +0000
Received: from isper.nabble.com ([192.168.236.156])
by sam.nabble.com with esmtp (Exim 4.72)
(envelope-from <lists@nabble.com>)
id 1RvOsy-0005ns-7S
for core-dev@hadoop.apache.org; Wed, 08 Feb 2012 23:57:44 -0800
Message-ID: <33291451.post@talk.nabble.com>
Date: Wed, 8 Feb 2012 23:57:44 -0800 (PST)
From: Amir Tuval <amirtu@gmail.com>
To: core-dev@hadoop.apache.org
Subject: Big Data storage price in the cloud
MIME-Version: 1.0
Content-Type: text/plain; charset=us-ascii
Content-Transfer-Encoding: 7bit
X-Nabble-From: amirtu@gmail.com
I am currently looking into implementing a big data SAAS system in the cloud.
I plan to use hadoop to analyze hundreds of TBs or even several PBs of data.
Looking at the pricing for storage in AWS, it is roughly 10 cents per GB per
month for both S3 and EBS. That amounts to 100,000$ per month per PB!!!
I think the storage is relatively expensive, and will probably be much more
than what I will pay for computing resources. The thing about hadoop is that
should run on commodity servers with a relatively cheap storage, replicating
data to handle failures, and so I expected to pay a lot less for storage.
Can anyone point me to best practices as to how to keep storage costs down
in the cloud? Maybe there are other cloud providers that offer services
better suited for this scenario?
--
View this message in context: http://old.nabble.com/Big-Data-storage-price-in-the-cloud-tp33291451p33291451.html
Sent from the Hadoop core-dev mailing list archive at Nabble.com.
From common-dev-return-77667-apmail-hadoop-common-dev-archive=hadoop.apache.org@hadoop.apache.org Thu Feb 9 09:39:55 2012
Return-Path: <common-dev-return-77667-apmail-hadoop-common-dev-archive=hadoop.apache.org@hadoop.apache.org>
X-Original-To: apmail-hadoop-common-dev-archive@www.apache.org
Delivered-To: apmail-hadoop-common-dev-archive@www.apache.org
Received: from mail.apache.org (hermes.apache.org [140.211.11.3])
by minotaur.apache.org (Postfix) with SMTP id CBF41907C
for <apmail-hadoop-common-dev-archive@www.apache.org>; Thu, 9 Feb 2012 09:39:55 +0000 (UTC)
Received: (qmail 25036 invoked by uid 500); 9 Feb 2012 09:39:54 -0000
Delivered-To: apmail-hadoop-common-dev-archive@hadoop.apache.org
Received: (qmail 24656 invoked by uid 500); 9 Feb 2012 09:39:43 -0000
Mailing-List: contact common-dev-help@hadoop.apache.org; run by ezmlm
Precedence: bulk
List-Help: <mailto:common-dev-help@hadoop.apache.org>
List-Unsubscribe: <mailto:common-dev-unsubscribe@hadoop.apache.org>
List-Post: <mailto:common-dev@hadoop.apache.org>
List-Id: <common-dev.hadoop.apache.org>
Reply-To: common-dev@hadoop.apache.org
Delivered-To: mailing list common-dev@hadoop.apache.org
Received: (qmail 24640 invoked by uid 99); 9 Feb 2012 09:39:40 -0000
Received: from nike.apache.org (HELO nike.apache.org) (192.87.106.230)
by apache.org (qpsmtpd/0.29) with ESMTP; Thu, 09 Feb 2012 09:39:40 +0000
X-ASF-Spam-Status: No, hits=-0.1 required=5.0
tests=HTML_MESSAGE,RCVD_IN_DNSWL_MED,SPF_PASS
X-Spam-Check-By: apache.org
Received-SPF: pass (nike.apache.org: domain of Doreen.Seider@dlr.de designates 129.247.252.33 as permitted sender)
Received: from [129.247.252.33] (HELO mailhost.dlr.de) (129.247.252.33)
by apache.org (qpsmtpd/0.29) with ESMTP; Thu, 09 Feb 2012 09:39:32 +0000
Received: from DLREXHUB01.intra.dlr.de (172.21.152.130) by dlrexedge02.dlr.de
(172.21.163.101) with Microsoft SMTP Server (TLS) id 14.1.355.2; Thu, 9 Feb
2012 10:39:06 +0100
Received: from DLREXMBX01.intra.dlr.de ([fe80::d198:77e5:d411:fccd]) by
dlrexhub01.intra.dlr.de ([::1]) with mapi id 14.01.0355.002; Thu, 9 Feb 2012
10:39:11 +0100
From: <Doreen.Seider@dlr.de>
To: <common-dev@hadoop.apache.org>
Subject: "thoughts request" about RepoGuard project
Thread-Topic: "thoughts request" about RepoGuard project
Thread-Index: AcznDm3RxHLEj3mCRKSIT2ZiGpuHMg==
Date: Thu, 9 Feb 2012 09:39:11 +0000
Message-ID: <77F76527CB95FD4E9F248AF7EF1923A50BEF4F24@DLREXMBX01.intra.dlr.de>
Accept-Language: en-US, de-DE
Content-Language: de-DE
X-MS-Has-Attach:
X-MS-TNEF-Correlator:
x-originating-ip: [129.247.10.112]
Content-Type: multipart/alternative;
boundary="_000_77F76527CB95FD4E9F248AF7EF1923A50BEF4F24DLREXMBX01intra_"
MIME-Version: 1.0
X-Virus-Checked: Checked by ClamAV on apache.org
--_000_77F76527CB95FD4E9F248AF7EF1923A50BEF4F24DLREXMBX01intra_
Content-Type: text/plain; charset="iso-8859-1"
Content-Transfer-Encoding: quoted-printable
Hi!
I`m writing to your dev mailing list because I'd like to know your thoughts=
about a project I'd like it to become an Incubator project at Apache and =
that might be interesting for you. I hope this mailing list is the right on=
e for that purpose. Otherwise please let me know.
The project is called RepoGuard, it is Open Source under the Apache License=
v2.0 and currently hosted at Tigris.org: http://repoguard.tigris.org/
RepoGuard is a framework to integrate development tools with source code re=
positories. It is designed as a framework to be extensible to integrate dif=
ferent kind of tools und repositories (later on). Uses cases for RepoGuard =
are automatic checks for source code, which needs to be committed, specifie=
d kinds of notifications for commits, or adding notes to the bug tracking s=
ystem for each commit, to ensure each commit is related to an issue in the =
bug tracker.
RepoGuard is developed at the German Aerospace Center (DLR). We think that =
the things RepoGuard does in a software development project is stuff every=
projects needs or should need. As far as I know you already have the integ=
ration of your repository with your bug tracker. And I guess you are not th=
e only ones. So, we asked us, why do we need multiple implementations for s=
uch basic stuff.
Thus, my question here is: What do you think about a project like RepoGuard=
and our idea behind it: to invest in one implementation for the integratio=
n of development tools and source code repositories?
Thanks for your replies in advance and best regards
Doreen
________________________________________________________
Doreen Seider
German Aerospace Center (DLR)
Simulation and Software Technology
Linder H=F6he
51147 Cologne
Phone: +49 (02203) 601-3857
Fax: +49 (02203) 601-3070
Mail: Doreen.Seider@dlr.de<mailto:Doreen.Seider@dlr.de>
Netz: http://www.dlr.de/sc
--_000_77F76527CB95FD4E9F248AF7EF1923A50BEF4F24DLREXMBX01intra_--
From common-dev-return-77668-apmail-hadoop-common-dev-archive=hadoop.apache.org@hadoop.apache.org Thu Feb 9 13:10:27 2012
Return-Path: <common-dev-return-77668-apmail-hadoop-common-dev-archive=hadoop.apache.org@hadoop.apache.org>
X-Original-To: apmail-hadoop-common-dev-archive@www.apache.org
Delivered-To: apmail-hadoop-common-dev-archive@www.apache.org
Received: from mail.apache.org (hermes.apache.org [140.211.11.3])
by minotaur.apache.org (Postfix) with SMTP id 1EE379037
for <apmail-hadoop-common-dev-archive@www.apache.org>; Thu, 9 Feb 2012 13:10:27 +0000 (UTC)
Received: (qmail 34775 invoked by uid 500); 9 Feb 2012 13:10:25 -0000
Delivered-To: apmail-hadoop-common-dev-archive@hadoop.apache.org
Received: (qmail 34141 invoked by uid 500); 9 Feb 2012 13:10:23 -0000
Mailing-List: contact common-dev-help@hadoop.apache.org; run by ezmlm
Precedence: bulk
List-Help: <mailto:common-dev-help@hadoop.apache.org>
List-Unsubscribe: <mailto:common-dev-unsubscribe@hadoop.apache.org>
List-Post: <mailto:common-dev@hadoop.apache.org>
List-Id: <common-dev.hadoop.apache.org>
Reply-To: common-dev@hadoop.apache.org
Delivered-To: mailing list common-dev@hadoop.apache.org
Received: (qmail 34116 invoked by uid 99); 9 Feb 2012 13:10:22 -0000
Received: from nike.apache.org (HELO nike.apache.org) (192.87.106.230)
by apache.org (qpsmtpd/0.29) with ESMTP; Thu, 09 Feb 2012 13:10:22 +0000
X-ASF-Spam-Status: No, hits=-2000.0 required=5.0
tests=ALL_TRUSTED,T_RP_MATCHES_RCVD
X-Spam-Check-By: apache.org
Received: from [140.211.11.116] (HELO hel.zones.apache.org) (140.211.11.116)
by apache.org (qpsmtpd/0.29) with ESMTP; Thu, 09 Feb 2012 13:10:20 +0000
Received: from hel.zones.apache.org (hel.zones.apache.org [140.211.11.116])
by hel.zones.apache.org (Postfix) with ESMTP id BD6E31ACCF7
for <common-dev@hadoop.apache.org>; Thu, 9 Feb 2012 13:09:59 +0000 (UTC)
Date: Thu, 9 Feb 2012 13:09:59 +0000 (UTC)
From: "Steve Loughran (Created) (JIRA)" <jira@apache.org>
To: common-dev@hadoop.apache.org
Message-ID: <369969333.19247.1328792999777.JavaMail.tomcat@hel.zones.apache.org>
Subject: [jira] [Created] (HADOOP-8047) CachedDNSToSwitchMapping caches
negative results forever
MIME-Version: 1.0
Content-Type: text/plain; charset=utf-8
Content-Transfer-Encoding: 7bit
X-JIRA-FingerPrint: 30527f35849b9dde25b450d4833f0394
X-Virus-Checked: Checked by ClamAV on apache.org
CachedDNSToSwitchMapping caches negative results forever
--------------------------------------------------------
Key: HADOOP-8047
URL: https://issues.apache.org/jira/browse/HADOOP-8047
Project: Hadoop Common
Issue Type: Bug
Components: util
Affects Versions: 1.0.0, 0.23.0, 0.24.0
Reporter: Steve Loughran
Priority: Trivial
This is very minor, just worth filing in JIRA unless someone wants to rethink topology caching for a dynamic world.
# The CachedDNSToSwitchMapping caches the results from all relayed DNS queries.
# The DNS script mapper returns the default rack for all unknown entries (or when the script fails)
# The Cache stores this in its map and never re-resolves it.
As a result, if a node is added to a live cluster that the existing script cannot resolve, then it won't get assigned to a rack unless the script is updated before the rack map is resolved.
This isn't usually that important, it just means "update your scripts before adding new racks". Perhaps there should be a page on that activity, "runbook and checklist for adding new servers and racks".
Where it would matter if anyone started playing with dynamic topologies, but in that situation the cached mapping itself would become the liability, as it assumes that servers never switch switches in a live system: the topology is static for existing nodes.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
From common-dev-return-77669-apmail-hadoop-common-dev-archive=hadoop.apache.org@hadoop.apache.org Thu Feb 9 17:20:27 2012
Return-Path: <common-dev-return-77669-apmail-hadoop-common-dev-archive=hadoop.apache.org@hadoop.apache.org>
X-Original-To: apmail-hadoop-common-dev-archive@www.apache.org
Delivered-To: apmail-hadoop-common-dev-archive@www.apache.org
Received: from mail.apache.org (hermes.apache.org [140.211.11.3])
by minotaur.apache.org (Postfix) with SMTP id 6C00E91A9
for <apmail-hadoop-common-dev-archive@www.apache.org>; Thu, 9 Feb 2012 17:20:27 +0000 (UTC)
Received: (qmail 88428 invoked by uid 500); 9 Feb 2012 17:20:25 -0000
Delivered-To: apmail-hadoop-common-dev-archive@hadoop.apache.org
Received: (qmail 88126 invoked by uid 500); 9 Feb 2012 17:20:23 -0000
Mailing-List: contact common-dev-help@hadoop.apache.org; run by ezmlm
Precedence: bulk
List-Help: <mailto:common-dev-help@hadoop.apache.org>
List-Unsubscribe: <mailto:common-dev-unsubscribe@hadoop.apache.org>
List-Post: <mailto:common-dev@hadoop.apache.org>
List-Id: <common-dev.hadoop.apache.org>
Reply-To: common-dev@hadoop.apache.org
Delivered-To: mailing list common-dev@hadoop.apache.org
Received: (qmail 88101 invoked by uid 99); 9 Feb 2012 17:20:23 -0000
Received: from nike.apache.org (HELO nike.apache.org) (192.87.106.230)
by apache.org (qpsmtpd/0.29) with ESMTP; Thu, 09 Feb 2012 17:20:23 +0000
X-ASF-Spam-Status: No, hits=-2000.0 required=5.0
tests=ALL_TRUSTED,T_RP_MATCHES_RCVD
X-Spam-Check-By: apache.org
Received: from [140.211.11.116] (HELO hel.zones.apache.org) (140.211.11.116)
by apache.org (qpsmtpd/0.29) with ESMTP; Thu, 09 Feb 2012 17:20:21 +0000
Received: from hel.zones.apache.org (hel.zones.apache.org [140.211.11.116])
by hel.zones.apache.org (Postfix) with ESMTP id 4B3731AD169
for <common-dev@hadoop.apache.org>; Thu, 9 Feb 2012 17:20:00 +0000 (UTC)
Date: Thu, 9 Feb 2012 17:20:00 +0000 (UTC)
From: "Daryn Sharp (Created) (JIRA)" <jira@apache.org>
To: common-dev@hadoop.apache.org
Message-ID: <2063235031.19970.1328808000309.JavaMail.tomcat@hel.zones.apache.org>
Subject: [jira] [Created] (HADOOP-8048) Allow merging of Credentials
MIME-Version: 1.0
Content-Type: text/plain; charset=utf-8
Content-Transfer-Encoding: 7bit
X-JIRA-FingerPrint: 30527f35849b9dde25b450d4833f0394
X-Virus-Checked: Checked by ClamAV on apache.org
Allow merging of Credentials
----------------------------
Key: HADOOP-8048
URL: https://issues.apache.org/jira/browse/HADOOP-8048
Project: Hadoop Common
Issue Type: Improvement
Components: util
Affects Versions: 0.24.0, 0.23.1
Reporter: Daryn Sharp
Assignee: Daryn Sharp
There is an existing {{Credentials#addAll}} which combines two {{Credentials}}, but it overwrites all existing {{Credentials}}. There should be a {{Credentials#mergeAll}} that will not overwrite. This will facility the cleanup of code in {{TokenCache}} denoted with:
{code}
//TODO: Need to come up with a better place to put
//this block of code to do with reading the file
{code}
The token cache basically needs to merge the contents of a binary credentials file when it fails to find a token. Performing the merge within {{Credentials}} is cleaner, and will break the cross-component dependency whereby the {{TokenCache}} currently has to have intimate knowledge of how the {{FileSystem}} will key tokens in the cache.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
From common-dev-return-77670-apmail-hadoop-common-dev-archive=hadoop.apache.org@hadoop.apache.org Thu Feb 9 17:34:23 2012
Return-Path: <common-dev-return-77670-apmail-hadoop-common-dev-archive=hadoop.apache.org@hadoop.apache.org>
X-Original-To: apmail-hadoop-common-dev-archive@www.apache.org
Delivered-To: apmail-hadoop-common-dev-archive@www.apache.org
Received: from mail.apache.org (hermes.apache.org [140.211.11.3])
by minotaur.apache.org (Postfix) with SMTP id 37E509554
for <apmail-hadoop-common-dev-archive@www.apache.org>; Thu, 9 Feb 2012 17:34:23 +0000 (UTC)
Received: (qmail 24591 invoked by uid 500); 9 Feb 2012 17:34:21 -0000
Delivered-To: apmail-hadoop-common-dev-archive@hadoop.apache.org
Received: (qmail 24476 invoked by uid 500); 9 Feb 2012 17:34:20 -0000
Mailing-List: contact common-dev-help@hadoop.apache.org; run by ezmlm
Precedence: bulk
List-Help: <mailto:common-dev-help@hadoop.apache.org>
List-Unsubscribe: <mailto:common-dev-unsubscribe@hadoop.apache.org>
List-Post: <mailto:common-dev@hadoop.apache.org>
List-Id: <common-dev.hadoop.apache.org>
Reply-To: common-dev@hadoop.apache.org
Delivered-To: mailing list common-dev@hadoop.apache.org
Received: (qmail 24463 invoked by uid 99); 9 Feb 2012 17:34:20 -0000
Received: from athena.apache.org (HELO athena.apache.org) (140.211.11.136)
by apache.org (qpsmtpd/0.29) with ESMTP; Thu, 09 Feb 2012 17:34:20 +0000
X-ASF-Spam-Status: No, hits=-2000.0 required=5.0
tests=ALL_TRUSTED,T_RP_MATCHES_RCVD
X-Spam-Check-By: apache.org
Received: from [140.211.11.116] (HELO hel.zones.apache.org) (140.211.11.116)
by apache.org (qpsmtpd/0.29) with ESMTP; Thu, 09 Feb 2012 17:34:19 +0000
Received: from hel.zones.apache.org (hel.zones.apache.org [140.211.11.116])
by hel.zones.apache.org (Postfix) with ESMTP id 7274A1AD7E6
for <common-dev@hadoop.apache.org>; Thu, 9 Feb 2012 17:33:59 +0000 (UTC)
Date: Thu, 9 Feb 2012 17:33:59 +0000 (UTC)
From: "Steve Loughran (Created) (JIRA)" <jira@apache.org>
To: common-dev@hadoop.apache.org
Message-ID: <633934543.20000.1328808839470.JavaMail.tomcat@hel.zones.apache.org>
Subject: [jira] [Created] (HADOOP-8049) Add entry point/script to do
preflight checking of script resolution
MIME-Version: 1.0
Content-Type: text/plain; charset=utf-8
Content-Transfer-Encoding: 7bit
X-JIRA-FingerPrint: 30527f35849b9dde25b450d4833f0394
Add entry point/script to do preflight checking of script resolution
--------------------------------------------------------------------
Key: HADOOP-8049
URL: https://issues.apache.org/jira/browse/HADOOP-8049
Project: Hadoop Common
Issue Type: New Feature
Components: util
Affects Versions: 1.0.0, 0.24.0
Reporter: Steve Loughran
Priority: Minor
The script supplied by the ops team could have many problems
# not run
# have the wrong permissions
# fail to parse/resolve some or all hosts
# not be the string set in the configuration file.
Diagnostics could be improved here with an entry point that
# reads in the configuration file
# instantiates whatever mapper is declared
# attempts to resolve all hosts passed in as arguments, logging success and failures
# prints out a topology map at the end
A key goal would be to recognise and report a complete failure to report a mapping as per MAPREDUCE-50, so let people identify problems in their script before updating the cluster
Test plan
-Java entry point: invoke it with arguments, get the output as a string and scan.
-Shell script. Include whatever post-install script tests are being written.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
From common-dev-return-77671-apmail-hadoop-common-dev-archive=hadoop.apache.org@hadoop.apache.org Thu Feb 9 18:26:26 2012
Return-Path: <common-dev-return-77671-apmail-hadoop-common-dev-archive=hadoop.apache.org@hadoop.apache.org>
X-Original-To: apmail-hadoop-common-dev-archive@www.apache.org
Delivered-To: apmail-hadoop-common-dev-archive@www.apache.org
Received: from mail.apache.org (hermes.apache.org [140.211.11.3])
by minotaur.apache.org (Postfix) with SMTP id 2661798AC
for <apmail-hadoop-common-dev-archive@www.apache.org>; Thu, 9 Feb 2012 18:26:26 +0000 (UTC)
Received: (qmail 31667 invoked by uid 500); 9 Feb 2012 18:26:24 -0000
Delivered-To: apmail-hadoop-common-dev-archive@hadoop.apache.org
Received: (qmail 31222 invoked by uid 500); 9 Feb 2012 18:26:23 -0000
Mailing-List: contact common-dev-help@hadoop.apache.org; run by ezmlm
Precedence: bulk
List-Help: <mailto:common-dev-help@hadoop.apache.org>
List-Unsubscribe: <mailto:common-dev-unsubscribe@hadoop.apache.org>
List-Post: <mailto:common-dev@hadoop.apache.org>
List-Id: <common-dev.hadoop.apache.org>
Reply-To: common-dev@hadoop.apache.org
Delivered-To: mailing list common-dev@hadoop.apache.org
Received: (qmail 31205 invoked by uid 99); 9 Feb 2012 18:26:22 -0000
Received: from nike.apache.org (HELO nike.apache.org) (192.87.106.230)
by apache.org (qpsmtpd/0.29) with ESMTP; Thu, 09 Feb 2012 18:26:22 +0000
X-ASF-Spam-Status: No, hits=-2000.0 required=5.0
tests=ALL_TRUSTED,T_RP_MATCHES_RCVD
X-Spam-Check-By: apache.org
Received: from [140.211.11.116] (HELO hel.zones.apache.org) (140.211.11.116)
by apache.org (qpsmtpd/0.29) with ESMTP; Thu, 09 Feb 2012 18:26:20 +0000
Received: from hel.zones.apache.org (hel.zones.apache.org [140.211.11.116])
by hel.zones.apache.org (Postfix) with ESMTP id 93D561AD467
for <common-dev@hadoop.apache.org>; Thu, 9 Feb 2012 18:25:59 +0000 (UTC)
Date: Thu, 9 Feb 2012 18:25:59 +0000 (UTC)
From: "Todd Lipcon (Resolved) (JIRA)" <jira@apache.org>
To: common-dev@hadoop.apache.org
Message-ID: <767880117.20172.1328811959606.JavaMail.tomcat@hel.zones.apache.org>
In-Reply-To: <786239118.17729.1328753279399.JavaMail.tomcat@hel.zones.apache.org>
Subject: [jira] [Resolved] (HADOOP-8041) HA: log a warning when a failover
is first attempted
MIME-Version: 1.0
Content-Type: text/plain; charset=utf-8
Content-Transfer-Encoding: 7bit
X-JIRA-FingerPrint: 30527f35849b9dde25b450d4833f0394
X-Virus-Checked: Checked by ClamAV on apache.org
[ https://issues.apache.org/jira/browse/HADOOP-8041?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Todd Lipcon resolved HADOOP-8041.
---------------------------------
Resolution: Fixed
Fix Version/s: HA Branch (HDFS-1623)
Hadoop Flags: Reviewed
Committed to branch, thanks.
> HA: log a warning when a failover is first attempted
> -----------------------------------------------------
>
> Key: HADOOP-8041
> URL: https://issues.apache.org/jira/browse/HADOOP-8041
> Project: Hadoop Common
> Issue Type: Sub-task
> Components: ha
> Affects Versions: HA Branch (HDFS-1623)
> Reporter: Eli Collins
> Assignee: Todd Lipcon
> Fix For: HA Branch (HDFS-1623)
>
> Attachments: hadoop-8041.txt
>
>
> Currently we always warn for each client operation made to a NN we've failedover to:
> {noformat}
> hadoop-0.24.0-SNAPSHOT $ ./bin/hdfs dfs -lsr /
> 12/02/08 17:43:04 WARN retry.RetryInvocationHandler: Exception while invoking getFileInfo of class
> org.apache.hadoop.hdfs.protocolPB.ClientNamenodeProtocolTranslatorPB after 0 fail over attempts. Trying to fail over immediately.
> {noformat}
> I'm going to remove this warning in HDFS-2922 since we shouldn't warn every time a client performs an operation, eg could be weeks after the failover. But we should eg log a warning when the client first does a failover so it shows up eg in the MR and HBase logs.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
From common-dev-return-77672-apmail-hadoop-common-dev-archive=hadoop.apache.org@hadoop.apache.org Thu Feb 9 19:55:21 2012
Return-Path: <common-dev-return-77672-apmail-hadoop-common-dev-archive=hadoop.apache.org@hadoop.apache.org>
X-Original-To: apmail-hadoop-common-dev-archive@www.apache.org
Delivered-To: apmail-hadoop-common-dev-archive@www.apache.org
Received: from mail.apache.org (hermes.apache.org [140.211.11.3])
by minotaur.apache.org (Postfix) with SMTP id 65ABB9C12
for <apmail-hadoop-common-dev-archive@www.apache.org>; Thu, 9 Feb 2012 19:55:21 +0000 (UTC)
Received: (qmail 53702 invoked by uid 500); 9 Feb 2012 19:55:19 -0000
Delivered-To: apmail-hadoop-common-dev-archive@hadoop.apache.org
Received: (qmail 53428 invoked by uid 500); 9 Feb 2012 19:55:18 -0000
Mailing-List: contact common-dev-help@hadoop.apache.org; run by ezmlm
Precedence: bulk
List-Help: <mailto:common-dev-help@hadoop.apache.org>
List-Unsubscribe: <mailto:common-dev-unsubscribe@hadoop.apache.org>
List-Post: <mailto:common-dev@hadoop.apache.org>
List-Id: <common-dev.hadoop.apache.org>
Reply-To: common-dev@hadoop.apache.org
Delivered-To: mailing list common-dev@hadoop.apache.org
Received: (qmail 53420 invoked by uid 99); 9 Feb 2012 19:55:18 -0000
Received: from athena.apache.org (HELO athena.apache.org) (140.211.11.136)
by apache.org (qpsmtpd/0.29) with ESMTP; Thu, 09 Feb 2012 19:55:18 +0000
X-ASF-Spam-Status: No, hits=-2000.0 required=5.0
tests=ALL_TRUSTED,T_RP_MATCHES_RCVD
X-Spam-Check-By: apache.org
Received: from [140.211.11.116] (HELO hel.zones.apache.org) (140.211.11.116)
by apache.org (qpsmtpd/0.29) with ESMTP; Thu, 09 Feb 2012 19:55:17 +0000
Received: from hel.zones.apache.org (hel.zones.apache.org [140.211.11.116])
by hel.zones.apache.org (Postfix) with ESMTP id 7FDFC1A952A
for <common-dev@hadoop.apache.org>; Thu, 9 Feb 2012 19:54:57 +0000 (UTC)
Date: Thu, 9 Feb 2012 19:54:57 +0000 (UTC)
From: "Tsz Wo (Nicholas), SZE (Resolved) (JIRA)" <jira@apache.org>
To: common-dev@hadoop.apache.org
Message-ID: <774556341.20800.1328817297525.JavaMail.tomcat@hel.zones.apache.org>
Subject: [jira] [Resolved] (HADOOP-7923) Automatically update doc versions
MIME-Version: 1.0
Content-Type: text/plain; charset=utf-8
Content-Transfer-Encoding: 7bit
X-JIRA-FingerPrint: 30527f35849b9dde25b450d4833f0394
[ https://issues.apache.org/jira/browse/HADOOP-7923?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Tsz Wo (Nicholas), SZE resolved HADOOP-7923.
--------------------------------------------
Resolution: Fixed
Fix Version/s: 0.23.2
0.24.0
Hadoop Flags: Reviewed
I have committed this to 0.23 and trunk.
> Automatically update doc versions
> ---------------------------------
>
> Key: HADOOP-7923
> URL: https://issues.apache.org/jira/browse/HADOOP-7923
> Project: Hadoop Common
> Issue Type: Task
> Components: build, documentation
> Affects Versions: 1.0.0, 1.1.0
> Reporter: Tsz Wo (Nicholas), SZE
> Assignee: Tsz Wo (Nicholas), SZE
> Fix For: 0.24.0, 0.23.2, 1.0.0
>
> Attachments: c7923_20111213_branch-1.patch, c7923_20111215.patch, h2643_20111207_branch-1.patch, h2643_20111213_branch-1.patch
>
>
> The docs version is hard coded. It should be updated automatically.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
From common-dev-return-77673-apmail-hadoop-common-dev-archive=hadoop.apache.org@hadoop.apache.org Thu Feb 9 20:31:21 2012
Return-Path: <common-dev-return-77673-apmail-hadoop-common-dev-archive=hadoop.apache.org@hadoop.apache.org>
X-Original-To: apmail-hadoop-common-dev-archive@www.apache.org
Delivered-To: apmail-hadoop-common-dev-archive@www.apache.org
Received: from mail.apache.org (hermes.apache.org [140.211.11.3])
by minotaur.apache.org (Postfix) with SMTP id 972E49244
for <apmail-hadoop-common-dev-archive@www.apache.org>; Thu, 9 Feb 2012 20:31:21 +0000 (UTC)
Received: (qmail 27815 invoked by uid 500); 9 Feb 2012 20:31:19 -0000
Delivered-To: apmail-hadoop-common-dev-archive@hadoop.apache.org
Received: (qmail 27344 invoked by uid 500); 9 Feb 2012 20:31:18 -0000
Mailing-List: contact common-dev-help@hadoop.apache.org; run by ezmlm
Precedence: bulk
List-Help: <mailto:common-dev-help@hadoop.apache.org>
List-Unsubscribe: <mailto:common-dev-unsubscribe@hadoop.apache.org>
List-Post: <mailto:common-dev@hadoop.apache.org>
List-Id: <common-dev.hadoop.apache.org>
Reply-To: common-dev@hadoop.apache.org
Delivered-To: mailing list common-dev@hadoop.apache.org
Received: (qmail 27326 invoked by uid 99); 9 Feb 2012 20:31:18 -0000
Received: from athena.apache.org (HELO athena.apache.org) (140.211.11.136)
by apache.org (qpsmtpd/0.29) with ESMTP; Thu, 09 Feb 2012 20:31:18 +0000
X-ASF-Spam-Status: No, hits=-2000.0 required=5.0
tests=ALL_TRUSTED,T_RP_MATCHES_RCVD
X-Spam-Check-By: apache.org
Received: from [140.211.11.116] (HELO hel.zones.apache.org) (140.211.11.116)
by apache.org (qpsmtpd/0.29) with ESMTP; Thu, 09 Feb 2012 20:31:17 +0000
Received: from hel.zones.apache.org (hel.zones.apache.org [140.211.11.116])
by hel.zones.apache.org (Postfix) with ESMTP id 553201A94D4
for <common-dev@hadoop.apache.org>; Thu, 9 Feb 2012 20:30:57 +0000 (UTC)
Date: Thu, 9 Feb 2012 20:30:57 +0000 (UTC)
From: "Kihwal Lee (Created) (JIRA)" <jira@apache.org>
To: common-dev@hadoop.apache.org
Message-ID: <1832977634.21006.1328819457350.JavaMail.tomcat@hel.zones.apache.org>
Subject: [jira] [Created] (HADOOP-8050) Deadlock in metrics
MIME-Version: 1.0
Content-Type: text/plain; charset=utf-8
Content-Transfer-Encoding: 7bit
X-JIRA-FingerPrint: 30527f35849b9dde25b450d4833f0394
Deadlock in metrics
-------------------
Key: HADOOP-8050
URL: https://issues.apache.org/jira/browse/HADOOP-8050
Project: Hadoop Common
Issue Type: Bug
Components: metrics
Affects Versions: 1.0.0, 0.20.205.0, 0.20.204.0
Reporter: Kihwal Lee
Fix For: 1.1.0, 1.0.1
The metrics serving thread and the periodic snapshot thread can deadlock.
It happened a few times on one of namenode we have. When it happens RPC works but the web ui and hftp stop working. I haven't look at the trunk too closely, but it might happen there too.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
From common-dev-return-77674-apmail-hadoop-common-dev-archive=hadoop.apache.org@hadoop.apache.org Thu Feb 9 20:59:23 2012
Return-Path: <common-dev-return-77674-apmail-hadoop-common-dev-archive=hadoop.apache.org@hadoop.apache.org>
X-Original-To: apmail-hadoop-common-dev-archive@www.apache.org
Delivered-To: apmail-hadoop-common-dev-archive@www.apache.org
Received: from mail.apache.org (hermes.apache.org [140.211.11.3])
by minotaur.apache.org (Postfix) with SMTP id 0598A9EA5
for <apmail-hadoop-common-dev-archive@www.apache.org>; Thu, 9 Feb 2012 20:59:23 +0000 (UTC)
Received: (qmail 90872 invoked by uid 500); 9 Feb 2012 20:59:21 -0000
Delivered-To: apmail-hadoop-common-dev-archive@hadoop.apache.org
Received: (qmail 90421 invoked by uid 500); 9 Feb 2012 20:59:19 -0000
Mailing-List: contact common-dev-help@hadoop.apache.org; run by ezmlm
Precedence: bulk
List-Help: <mailto:common-dev-help@hadoop.apache.org>
List-Unsubscribe: <mailto:common-dev-unsubscribe@hadoop.apache.org>
List-Post: <mailto:common-dev@hadoop.apache.org>
List-Id: <common-dev.hadoop.apache.org>
Reply-To: common-dev@hadoop.apache.org
Delivered-To: mailing list common-dev@hadoop.apache.org
Received: (qmail 90393 invoked by uid 99); 9 Feb 2012 20:59:19 -0000
Received: from athena.apache.org (HELO athena.apache.org) (140.211.11.136)
by apache.org (qpsmtpd/0.29) with ESMTP; Thu, 09 Feb 2012 20:59:19 +0000
X-ASF-Spam-Status: No, hits=-2000.0 required=5.0
tests=ALL_TRUSTED,T_RP_MATCHES_RCVD
X-Spam-Check-By: apache.org
Received: from [140.211.11.116] (HELO hel.zones.apache.org) (140.211.11.116)
by apache.org (qpsmtpd/0.29) with ESMTP; Thu, 09 Feb 2012 20:59:18 +0000
Received: from hel.zones.apache.org (hel.zones.apache.org [140.211.11.116])
by hel.zones.apache.org (Postfix) with ESMTP id 5CDF71A9723
for <common-dev@hadoop.apache.org>; Thu, 9 Feb 2012 20:58:58 +0000 (UTC)
Date: Thu, 9 Feb 2012 20:58:58 +0000 (UTC)
From: "Varun Kapoor (Created) (JIRA)" <jira@apache.org>
To: common-dev@hadoop.apache.org
Message-ID: <598739148.21167.1328821138381.JavaMail.tomcat@hel.zones.apache.org>
Subject: [jira] [Created] (HADOOP-8052) Hadoop Metrics2 should emit
Float.MAX_VALUE (instead of Double.MAX_VALUE) to avoid making Ganglia's
gmetad core
MIME-Version: 1.0
Content-Type: text/plain; charset=utf-8
Content-Transfer-Encoding: 7bit
X-JIRA-FingerPrint: 30527f35849b9dde25b450d4833f0394
Hadoop Metrics2 should emit Float.MAX_VALUE (instead of Double.MAX_VALUE) to avoid making Ganglia's gmetad core
---------------------------------------------------------------------------------------------------------------
Key: HADOOP-8052
URL: https://issues.apache.org/jira/browse/HADOOP-8052
Project: Hadoop Common
Issue Type: Bug
Components: metrics
Affects Versions: 1.0.0, 0.23.0
Reporter: Varun Kapoor
Assignee: Varun Kapoor
Ganglia's gmetad converts the doubles emitted by Hadoop's Metrics2 system to strings, and the buffer it uses is 256 bytes wide.
When the SampleStat.MinMax class (in org.apache.hadoop.metrics2.util) emits its default min value (currently initialized to Double.MAX_VALUE), it ends up causing a buffer overflow in gmetad, which causes it to core, effectively rendering Ganglia useless (for some, the core is continuous; for others who are more fortunate, it's only a one-time Hadoop-startup-time thing).
The fix needed to Ganglia is simple - the buffer needs to be bumped up to be 512 bytes wide, and all will be well - but instead of requiring a minimum version of Ganglia to work with Hadoop's Metrics2 system, it might be more prudent to just use Float.MAX_VALUE.
An additional problem caused in librrd (which Ganglia uses beneath-the-covers) by the use of Double.MIN_VALUE (which functions as the default max value) is an underflow when librrd runs the received strings through libc's strtod(), but the librrd code is good enough to check for this, and only emits a warning - moving to Float.MIN_VALUE fixes that as well.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
From common-dev-return-77675-apmail-hadoop-common-dev-archive=hadoop.apache.org@hadoop.apache.org Fri Feb 10 01:50:23 2012
Return-Path: <common-dev-return-77675-apmail-hadoop-common-dev-archive=hadoop.apache.org@hadoop.apache.org>
X-Original-To: apmail-hadoop-common-dev-archive@www.apache.org
Delivered-To: apmail-hadoop-common-dev-archive@www.apache.org
Received: from mail.apache.org (hermes.apache.org [140.211.11.3])
by minotaur.apache.org (Postfix) with SMTP id E393E9FD6
for <apmail-hadoop-common-dev-archive@www.apache.org>; Fri, 10 Feb 2012 01:50:23 +0000 (UTC)
Received: (qmail 20771 invoked by uid 500); 10 Feb 2012 01:50:22 -0000
Delivered-To: apmail-hadoop-common-dev-archive@hadoop.apache.org
Received: (qmail 20676 invoked by uid 500); 10 Feb 2012 01:50:21 -0000
Mailing-List: contact common-dev-help@hadoop.apache.org; run by ezmlm
Precedence: bulk
List-Help: <mailto:common-dev-help@hadoop.apache.org>
List-Unsubscribe: <mailto:common-dev-unsubscribe@hadoop.apache.org>
List-Post: <mailto:common-dev@hadoop.apache.org>
List-Id: <common-dev.hadoop.apache.org>
Reply-To: common-dev@hadoop.apache.org
Delivered-To: mailing list common-dev@hadoop.apache.org
Received: (qmail 20664 invoked by uid 99); 10 Feb 2012 01:50:21 -0000
Received: from nike.apache.org (HELO nike.apache.org) (192.87.106.230)
by apache.org (qpsmtpd/0.29) with ESMTP; Fri, 10 Feb 2012 01:50:21 +0000
X-ASF-Spam-Status: No, hits=1.5 required=5.0
tests=HTML_MESSAGE,RCVD_IN_DNSWL_LOW,SPF_PASS
X-Spam-Check-By: apache.org
Received-SPF: pass (nike.apache.org: domain of sysolve@gmail.com designates 209.85.214.48 as permitted sender)
Received: from [209.85.214.48] (HELO mail-bk0-f48.google.com) (209.85.214.48)
by apache.org (qpsmtpd/0.29) with ESMTP; Fri, 10 Feb 2012 01:50:13 +0000
Received: by bkcjm1 with SMTP id jm1so2686445bkc.35
for <common-dev@hadoop.apache.org>; Thu, 09 Feb 2012 17:49:53 -0800 (PST)
DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed;
d=gmail.com; s=gamma;
h=mime-version:date:message-id:subject:from:to:content-type;
bh=toyHGvFo3jTur0cUwx4b9Reldu1GmNR9+bHbN+OBD9A=;
b=okm0ywSSjwHAp5/D+ZZS8tgeLALrAM9CDXI1Y3C02U92DGDwXSPyt16B9ROCeHWzij
4uHIP8PWl+g+Bi15NAI69BKNBNkyYyXpb+fXSkco7w2/YCsJBtG8KgUyt4pDXGVJU4XC
+VADvRQoZw3HwEpkFQdBLhnsR67B2membMMdU=
MIME-Version: 1.0
Received: by 10.204.156.155 with SMTP id x27mr1693888bkw.4.1328838593264; Thu,
09 Feb 2012 17:49:53 -0800 (PST)
Received: by 10.204.35.208 with HTTP; Thu, 9 Feb 2012 17:49:53 -0800 (PST)
Date: Fri, 10 Feb 2012 09:49:53 +0800
Message-ID: <CAD7nt4i5_J3XS8CCQ8G3_mMJR8dNnUnW_TvHGez=1dBz_SNJzA@mail.gmail.com>
Subject: Another 2 failures found in hadoop 1.0.0
From: Grace <sysolve@gmail.com>
To: common-dev@hadoop.apache.org
Content-Type: multipart/alternative; boundary=0015175df1fc50bd4504b892584d
X-Virus-Checked: Checked by ClamAV on apache.org
--0015175df1fc50bd4504b892584d
Content-Type: text/plain; charset=ISO-8859-1
Hi all,
I Met 2 errors in the unit test(test-core-excluding-commit-and-smoke) of
hadoop 1.0.0. One is org.apache.hadoop.mapred.TestTTResourceReporting and
the other is org.apache.hadoop.tools.rumen.TestRumenJobTraces.
Does anyone have similar problem or have some idea? Thanks.
-Grace.
--0015175df1fc50bd4504b892584d--
From common-dev-return-77676-apmail-hadoop-common-dev-archive=hadoop.apache.org@hadoop.apache.org Fri Feb 10 02:30:23 2012
Return-Path: <common-dev-return-77676-apmail-hadoop-common-dev-archive=hadoop.apache.org@hadoop.apache.org>
X-Original-To: apmail-hadoop-common-dev-archive@www.apache.org
Delivered-To: apmail-hadoop-common-dev-archive@www.apache.org
Received: from mail.apache.org (hermes.apache.org [140.211.11.3])
by minotaur.apache.org (Postfix) with SMTP id 6D13B960C
for <apmail-hadoop-common-dev-archive@www.apache.org>; Fri, 10 Feb 2012 02:30:23 +0000 (UTC)
Received: (qmail 62862 invoked by uid 500); 10 Feb 2012 02:30:21 -0000
Delivered-To: apmail-hadoop-common-dev-archive@hadoop.apache.org
Received: (qmail 62788 invoked by uid 500); 10 Feb 2012 02:30:20 -0000
Mailing-List: contact common-dev-help@hadoop.apache.org; run by ezmlm
Precedence: bulk
List-Help: <mailto:common-dev-help@hadoop.apache.org>
List-Unsubscribe: <mailto:common-dev-unsubscribe@hadoop.apache.org>
List-Post: <mailto:common-dev@hadoop.apache.org>
List-Id: <common-dev.hadoop.apache.org>
Reply-To: common-dev@hadoop.apache.org
Delivered-To: mailing list common-dev@hadoop.apache.org
Received: (qmail 62780 invoked by uid 99); 10 Feb 2012 02:30:20 -0000
Received: from athena.apache.org (HELO athena.apache.org) (140.211.11.136)
by apache.org (qpsmtpd/0.29) with ESMTP; Fri, 10 Feb 2012 02:30:20 +0000
X-ASF-Spam-Status: No, hits=-2000.0 required=5.0
tests=ALL_TRUSTED,T_RP_MATCHES_RCVD
X-Spam-Check-By: apache.org
Received: from [140.211.11.116] (HELO hel.zones.apache.org) (140.211.11.116)
by apache.org (qpsmtpd/0.29) with ESMTP; Fri, 10 Feb 2012 02:30:19 +0000
Received: from hel.zones.apache.org (hel.zones.apache.org [140.211.11.116])
by hel.zones.apache.org (Postfix) with ESMTP id 5713A1AD355
for <common-dev@hadoop.apache.org>; Fri, 10 Feb 2012 02:29:59 +0000 (UTC)
Date: Fri, 10 Feb 2012 02:29:59 +0000 (UTC)
From: "Carl Steinbach (Created) (JIRA)" <jira@apache.org>
To: common-dev@hadoop.apache.org
Message-ID: <1404282534.22724.1328840999358.JavaMail.tomcat@hel.zones.apache.org>
Subject: [jira] [Created] (HADOOP-8053) "har://hdfs-/foo" is not a valid URI
MIME-Version: 1.0
Content-Type: text/plain; charset=utf-8
Content-Transfer-Encoding: 7bit
X-JIRA-FingerPrint: 30527f35849b9dde25b450d4833f0394
"har://hdfs-/foo" is not a valid URI
------------------------------------
Key: HADOOP-8053
URL: https://issues.apache.org/jira/browse/HADOOP-8053
Project: Hadoop Common
Issue Type: Bug
Components: fs
Affects Versions: 0.23.0, 0.21.0
Reporter: Carl Steinbach
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
From common-dev-return-77677-apmail-hadoop-common-dev-archive=hadoop.apache.org@hadoop.apache.org Fri Feb 10 08:20:41 2012
Return-Path: <common-dev-return-77677-apmail-hadoop-common-dev-archive=hadoop.apache.org@hadoop.apache.org>
X-Original-To: apmail-hadoop-common-dev-archive@www.apache.org
Delivered-To: apmail-hadoop-common-dev-archive@www.apache.org
Received: from mail.apache.org (hermes.apache.org [140.211.11.3])
by minotaur.apache.org (Postfix) with SMTP id A47AB9D5F
for <apmail-hadoop-common-dev-archive@www.apache.org>; Fri, 10 Feb 2012 08:20:41 +0000 (UTC)
Received: (qmail 30997 invoked by uid 500); 10 Feb 2012 08:20:39 -0000
Delivered-To: apmail-hadoop-common-dev-archive@hadoop.apache.org
Received: (qmail 30601 invoked by uid 500); 10 Feb 2012 08:20:25 -0000
Mailing-List: contact common-dev-help@hadoop.apache.org; run by ezmlm
Precedence: bulk
List-Help: <mailto:common-dev-help@hadoop.apache.org>
List-Unsubscribe: <mailto:common-dev-unsubscribe@hadoop.apache.org>
List-Post: <mailto:common-dev@hadoop.apache.org>
List-Id: <common-dev.hadoop.apache.org>
Reply-To: common-dev@hadoop.apache.org
Delivered-To: mailing list common-dev@hadoop.apache.org
Received: (qmail 30583 invoked by uid 99); 10 Feb 2012 08:20:21 -0000
Received: from athena.apache.org (HELO athena.apache.org) (140.211.11.136)
by apache.org (qpsmtpd/0.29) with ESMTP; Fri, 10 Feb 2012 08:20:21 +0000
X-ASF-Spam-Status: No, hits=-2000.0 required=5.0
tests=ALL_TRUSTED,T_RP_MATCHES_RCVD
X-Spam-Check-By: apache.org
Received: from [140.211.11.116] (HELO hel.zones.apache.org) (140.211.11.116)
by apache.org (qpsmtpd/0.29) with ESMTP; Fri, 10 Feb 2012 08:20:19 +0000
Received: from hel.zones.apache.org (hel.zones.apache.org [140.211.11.116])
by hel.zones.apache.org (Postfix) with ESMTP id 753DC1AE72E
for <common-dev@hadoop.apache.org>; Fri, 10 Feb 2012 08:19:59 +0000 (UTC)
Date: Fri, 10 Feb 2012 08:19:59 +0000 (UTC)
From: "Amareshwari Sriramadasu (Created) (JIRA)" <jira@apache.org>
To: common-dev@hadoop.apache.org
Message-ID: <1167956971.23508.1328861999481.JavaMail.tomcat@hel.zones.apache.org>
Subject: [jira] [Created] (HADOOP-8054) NPE with RawLocalFileSystem
MIME-Version: 1.0
Content-Type: text/plain; charset=utf-8
Content-Transfer-Encoding: 7bit
X-JIRA-FingerPrint: 30527f35849b9dde25b450d4833f0394
NPE with RawLocalFileSystem
---------------------------
Key: HADOOP-8054
URL: https://issues.apache.org/jira/browse/HADOOP-8054
Project: Hadoop Common
Issue Type: Bug
Affects Versions: 0.23.1
Reporter: Amareshwari Sriramadasu
Priority: Critical
While running Hive tests, I'm seeing the following exception with 0.23.1,
{noformat}
ava.lang.NullPointerException
at org.apache.hadoop.fs.FileSystem.getDefaultBlockSize(FileSystem.java:1901)
at org.apache.hadoop.fs.RawLocalFileSystem.getFileStatus(RawLocalFileSystem.java:447)
at org.apache.hadoop.fs.FilterFileSystem.getFileStatus(FilterFileSystem.java:351)
at org.apache.hadoop.fs.FilterFileSystem.getFileStatus(FilterFileSystem.java:351)
at org.apache.hadoop.fs.ProxyFileSystem.getFileStatus(ProxyFileSystem.java:247)
at org.apache.hadoop.fs.FilterFileSystem.getFileStatus(FilterFileSystem.java:351)
at org.apache.hadoop.fs.FileSystem.exists(FileSystem.java:1165)
at org.apache.hadoop.fs.FileUtil.checkDest(FileUtil.java:390)
at org.apache.hadoop.fs.FileUtil.copy(FileUtil.java:242)
at org.apache.hadoop.fs.FileUtil.copy(FileUtil.java:232)
{noformat}
Did not see this with 0.23.0, though.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
From common-dev-return-77678-apmail-hadoop-common-dev-archive=hadoop.apache.org@hadoop.apache.org Fri Feb 10 11:58:24 2012
Return-Path: <common-dev-return-77678-apmail-hadoop-common-dev-archive=hadoop.apache.org@hadoop.apache.org>
X-Original-To: apmail-hadoop-common-dev-archive@www.apache.org
Delivered-To: apmail-hadoop-common-dev-archive@www.apache.org
Received: from mail.apache.org (hermes.apache.org [140.211.11.3])
by minotaur.apache.org (Postfix) with SMTP id 729B89DB7
for <apmail-hadoop-common-dev-archive@www.apache.org>; Fri, 10 Feb 2012 11:58:24 +0000 (UTC)
Received: (qmail 14599 invoked by uid 500); 10 Feb 2012 11:58:22 -0000
Delivered-To: apmail-hadoop-common-dev-archive@hadoop.apache.org
Received: (qmail 14184 invoked by uid 500); 10 Feb 2012 11:58:21 -0000
Mailing-List: contact common-dev-help@hadoop.apache.org; run by ezmlm
Precedence: bulk
List-Help: <mailto:common-dev-help@hadoop.apache.org>
List-Unsubscribe: <mailto:common-dev-unsubscribe@hadoop.apache.org>
List-Post: <mailto:common-dev@hadoop.apache.org>
List-Id: <common-dev.hadoop.apache.org>
Reply-To: common-dev@hadoop.apache.org
Delivered-To: mailing list common-dev@hadoop.apache.org
Received: (qmail 14168 invoked by uid 99); 10 Feb 2012 11:58:20 -0000
Received: from athena.apache.org (HELO athena.apache.org) (140.211.11.136)
by apache.org (qpsmtpd/0.29) with ESMTP; Fri, 10 Feb 2012 11:58:20 +0000
X-ASF-Spam-Status: No, hits=-2000.0 required=5.0
tests=ALL_TRUSTED,T_RP_MATCHES_RCVD
X-Spam-Check-By: apache.org
Received: from [140.211.11.116] (HELO hel.zones.apache.org) (140.211.11.116)
by apache.org (qpsmtpd/0.29) with ESMTP; Fri, 10 Feb 2012 11:58:19 +0000
Received: from hel.zones.apache.org (hel.zones.apache.org [140.211.11.116])
by hel.zones.apache.org (Postfix) with ESMTP id 6F1B61AE245
for <common-dev@hadoop.apache.org>; Fri, 10 Feb 2012 11:57:59 +0000 (UTC)
Date: Fri, 10 Feb 2012 11:57:59 +0000 (UTC)
From: "Eric Charles (Created) (JIRA)" <jira@apache.org>
To: common-dev@hadoop.apache.org
Message-ID: <155681302.23865.1328875079456.JavaMail.tomcat@hel.zones.apache.org>
Subject: [jira] [Created] (HADOOP-8055) Distribution tar.gz does not contain
etc/hadoop/core-site.xml
MIME-Version: 1.0
Content-Type: text/plain; charset=utf-8
Content-Transfer-Encoding: 7bit
X-JIRA-FingerPrint: 30527f35849b9dde25b450d4833f0394
Distribution tar.gz does not contain etc/hadoop/core-site.xml
-------------------------------------------------------------
Key: HADOOP-8055
URL: https://issues.apache.org/jira/browse/HADOOP-8055
Project: Hadoop Common
Issue Type: Bug
Components: build
Affects Versions: 0.24.0
Reporter: Eric Charles
A dist built from trunk (0.24.0-SNAPSHOT) does not contain a core-site.xml in $HADOOP_HOME/etc/hadoop/ folder.
$HADOOP_HOME/sbin/start-dfs.sh without that folder gives an exception
Exception in thread "main" java.lang.IllegalArgumentException: URI has an authority component
at java.io.File.<init>(File.java:368)
at org.apache.hadoop.hdfs.server.namenode.NNStorage.getStorageDirectory(NNStorage.java:310)
at org.apache.hadoop.hdfs.server.namenode.FSEditLog.init(FSEditLog.java:178)
...
Manually creating $HADOOP_HOME/etc/hadoop/core-site.xml solves this problem and hadoop starts fine.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
From common-dev-return-77679-apmail-hadoop-common-dev-archive=hadoop.apache.org@hadoop.apache.org Fri Feb 10 17:27:26 2012
Return-Path: <common-dev-return-77679-apmail-hadoop-common-dev-archive=hadoop.apache.org@hadoop.apache.org>
X-Original-To: apmail-hadoop-common-dev-archive@www.apache.org
Delivered-To: apmail-hadoop-common-dev-archive@www.apache.org
Received: from mail.apache.org (hermes.apache.org [140.211.11.3])
by minotaur.apache.org (Postfix) with SMTP id C965E9CBA
for <apmail-hadoop-common-dev-archive@www.apache.org>; Fri, 10 Feb 2012 17:27:26 +0000 (UTC)
Received: (qmail 94216 invoked by uid 500); 10 Feb 2012 17:27:24 -0000
Delivered-To: apmail-hadoop-common-dev-archive@hadoop.apache.org
Received: (qmail 94094 invoked by uid 500); 10 Feb 2012 17:27:23 -0000
Mailing-List: contact common-dev-help@hadoop.apache.org; run by ezmlm
Precedence: bulk
List-Help: <mailto:common-dev-help@hadoop.apache.org>
List-Unsubscribe: <mailto:common-dev-unsubscribe@hadoop.apache.org>
List-Post: <mailto:common-dev@hadoop.apache.org>
List-Id: <common-dev.hadoop.apache.org>
Reply-To: common-dev@hadoop.apache.org
Delivered-To: mailing list common-dev@hadoop.apache.org
Received: (qmail 94078 invoked by uid 99); 10 Feb 2012 17:27:23 -0000
Received: from nike.apache.org (HELO nike.apache.org) (192.87.106.230)
by apache.org (qpsmtpd/0.29) with ESMTP; Fri, 10 Feb 2012 17:27:23 +0000
X-ASF-Spam-Status: No, hits=-2000.0 required=5.0
tests=ALL_TRUSTED,T_RP_MATCHES_RCVD
X-Spam-Check-By: apache.org
Received: from [140.211.11.116] (HELO hel.zones.apache.org) (140.211.11.116)
by apache.org (qpsmtpd/0.29) with ESMTP; Fri, 10 Feb 2012 17:27:21 +0000
Received: from hel.zones.apache.org (hel.zones.apache.org [140.211.11.116])
by hel.zones.apache.org (Postfix) with ESMTP id 7DDDE1AF353
for <common-dev@hadoop.apache.org>; Fri, 10 Feb 2012 17:27:00 +0000 (UTC)
Date: Fri, 10 Feb 2012 17:27:00 +0000 (UTC)
From: "Luca Pireddu (Created) (JIRA)" <jira@apache.org>
To: common-dev@hadoop.apache.org
Message-ID: <581693568.24830.1328894820517.JavaMail.tomcat@hel.zones.apache.org>
Subject: [jira] [Created] (HADOOP-8056) Configuration doesn't pass empty
string values to tasks
MIME-Version: 1.0
Content-Type: text/plain; charset=utf-8
Content-Transfer-Encoding: 7bit
X-JIRA-FingerPrint: 30527f35849b9dde25b450d4833f0394
X-Virus-Checked: Checked by ClamAV on apache.org
Configuration doesn't pass empty string values to tasks
-------------------------------------------------------
Key: HADOOP-8056
URL: https://issues.apache.org/jira/browse/HADOOP-8056
Project: Hadoop Common
Issue Type: Bug
Components: conf
Affects Versions: 1.0.0, 0.20.2
Reporter: Luca Pireddu
If I assign an *empty string* as a value to a property in a JobConf 'job' while I'm preparing it to run, the Configuration does store that value. I can retrieve it later while in the same process and the value is maintained.
However, if then call JobClient.runJob(job), the Configuration that is received by the Map and Reduce tasks doesn't contain the property, and calling JobConf.get with that property name returns null (instead of an empty string). Futher, if I inspect the job's configuration via Hadoop's web interface, the property isn't present.
It seems as if whatever serialization mechanism that is used to transmit the Configuration from the job client to the tasks discards properties with "" value.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
From common-dev-return-77680-apmail-hadoop-common-dev-archive=hadoop.apache.org@hadoop.apache.org Fri Feb 10 17:43:00 2012
Return-Path: <common-dev-return-77680-apmail-hadoop-common-dev-archive=hadoop.apache.org@hadoop.apache.org>
X-Original-To: apmail-hadoop-common-dev-archive@www.apache.org
Delivered-To: apmail-hadoop-common-dev-archive@www.apache.org
Received: from mail.apache.org (hermes.apache.org [140.211.11.3])
by minotaur.apache.org (Postfix) with SMTP id 2501D9BF9
for <apmail-hadoop-common-dev-archive@www.apache.org>; Fri, 10 Feb 2012 17:43:00 +0000 (UTC)
Received: (qmail 22472 invoked by uid 500); 10 Feb 2012 17:42:58 -0000
Delivered-To: apmail-hadoop-common-dev-archive@hadoop.apache.org
Received: (qmail 22391 invoked by uid 500); 10 Feb 2012 17:42:57 -0000
Mailing-List: contact common-dev-help@hadoop.apache.org; run by ezmlm
Precedence: bulk
List-Help: <mailto:common-dev-help@hadoop.apache.org>
List-Unsubscribe: <mailto:common-dev-unsubscribe@hadoop.apache.org>
List-Post: <mailto:common-dev@hadoop.apache.org>
List-Id: <common-dev.hadoop.apache.org>
Reply-To: common-dev@hadoop.apache.org
Delivered-To: mailing list common-dev@hadoop.apache.org
Received: (qmail 22381 invoked by uid 99); 10 Feb 2012 17:42:57 -0000
Received: from athena.apache.org (HELO athena.apache.org) (140.211.11.136)
by apache.org (qpsmtpd/0.29) with ESMTP; Fri, 10 Feb 2012 17:42:57 +0000
X-ASF-Spam-Status: No, hits=-0.7 required=5.0
tests=RCVD_IN_DNSWL_LOW,SPF_PASS
X-Spam-Check-By: apache.org
Received-SPF: pass (athena.apache.org: domain of rhc.openmpi@gmail.com designates 209.85.160.48 as permitted sender)
Received: from [209.85.160.48] (HELO mail-pw0-f48.google.com) (209.85.160.48)
by apache.org (qpsmtpd/0.29) with ESMTP; Fri, 10 Feb 2012 17:42:49 +0000
Received: by pbcuo1 with SMTP id uo1so2887266pbc.35
for <common-dev@hadoop.apache.org>; Fri, 10 Feb 2012 09:42:29 -0800 (PST)
DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed;
d=gmail.com; s=gamma;
h=sender:from:content-type:content-transfer-encoding:subject:date
:message-id:to:mime-version:x-mailer;
bh=+WNzkIygTk3eAj4Hcoq/qzc5CQLn5YGj6TkY4QRFEJQ=;
b=njxR9BoU/8gj+es+t9NXW30CoX+K/ACohODJ37zDZ6Ode3M5sGradclG/ZkWO2UmVG
4/lqrj6BKXMkc8MaC5Ic94SzYoLvYJ5S+6AUUSB1MlIvGIJFVxvXn1GL6NZvr0306r+D
s1Miw/+mTMKKGzGF2H55oLpue2wObnm8JC/XI=
Received: by 10.68.219.69 with SMTP id pm5mr18552288pbc.5.1328895749387;
Fri, 10 Feb 2012 09:42:29 -0800 (PST)
Received: from [192.168.1.10] (c-98-245-155-46.hsd1.co.comcast.net. [98.245.155.46])
by mx.google.com with ESMTPS id li19sm15150265pbb.17.2012.02.10.09.42.27
(version=TLSv1/SSLv3 cipher=OTHER);
Fri, 10 Feb 2012 09:42:28 -0800 (PST)
Sender: Ralph Castain <rhc.openmpi@gmail.com>
From: Ralph Castain <rhc@open-mpi.org>
Content-Type: text/plain; charset=us-ascii
Content-Transfer-Encoding: quoted-printable
Subject: Trunk build failure
Date: Fri, 10 Feb 2012 10:42:25 -0700
Message-Id: <44A69A91-98E3-439B-ACFF-A0C02225254E@open-mpi.org>
To: Hadoop Devel <common-dev@hadoop.apache.org>
Mime-Version: 1.0 (Apple Message framework v1257)
X-Mailer: Apple Mail (2.1257)
Hi folks
I'm a newbie to the Hadoop code and am trying to build the svn trunk per =
instructions on the wiki and the mailing list. I'm hitting a failure =
and would appreciate any suggestions:
main:
[exec] tar: Failed to open =
'hadoop-project-dist-0.24.0-SNAPSHOT.tar.gz'
It looks like this file isn't getting created, but I don't know why. I =
used the -e option for mvn, and saw this:
[INFO] --- maven-antrun-plugin:1.6:run (pre-dist) @ hadoop-project-dist =
---
[INFO] Executing tasks
main:
[exec] ./dist-copynativelibs.sh: line 10: [: too many arguments
[INFO] Executed tasks
[INFO]=20
[INFO] --- maven-assembly-plugin:2.2.1:single (dist) @ =
hadoop-project-dist ---
[WARNING] The following patterns were never triggered in this artifact =
exclusion filter:
o 'org.apache.ant:*:jar'
o 'jdiff:jdiff:jar'
[INFO] Copying files to /Volumes/Macintosh HD =
2/rhc/hadoop/svn-trunk/hadoop-project-dist/target/hadoop-project-dist-0.24=
.0-SNAPSHOT
[INFO]=20
[INFO] --- maven-source-plugin:2.1.2:jar-no-fork (hadoop-java-sources) @ =
hadoop-project-dist ---
[INFO]=20
[INFO] --- maven-enforcer-plugin:1.0:enforce (dist-enforce) @ =
hadoop-project-dist ---
[INFO]=20
[INFO] --- maven-site-plugin:3.0:attach-descriptor (attach-descriptor) @ =
hadoop-project-dist ---
[INFO]=20
[INFO] --- maven-javadoc-plugin:2.8.1:jar (module-javadocs) @ =
hadoop-project-dist ---
[INFO] Not executing Javadoc as the project is not a Java =
classpath-capable package
[INFO]=20
[INFO] --- maven-antrun-plugin:1.6:run (tar) @ hadoop-project-dist ---
[INFO] Executing tasks
main:
[exec] tar: Failed to open =
'hadoop-project-dist-0.24.0-SNAPSHOT.tar.gz'
The detailed error report:
[ERROR] Failed to execute goal =
org.apache.maven.plugins:maven-antrun-plugin:1.6:run (tar) on project =
hadoop-project-dist: An Ant BuildException has occured: exec returned: 1 =
-> [Help 1]
org.apache.maven.lifecycle.LifecycleExecutionException: Failed to =
execute goal org.apache.maven.plugins:maven-antrun-plugin:1.6:run (tar) =
on project hadoop-project-dist: An Ant BuildException has occured: exec =
returned: 1
at =
org.apache.maven.lifecycle.internal.MojoExecutor.execute(MojoExecutor.java=
:217)
at =
org.apache.maven.lifecycle.internal.MojoExecutor.execute(MojoExecutor.java=
:153)
at =
org.apache.maven.lifecycle.internal.MojoExecutor.execute(MojoExecutor.java=
:145)
at =
org.apache.maven.lifecycle.internal.LifecycleModuleBuilder.buildProject(Li=
fecycleModuleBuilder.java:84)
at =
org.apache.maven.lifecycle.internal.LifecycleModuleBuilder.buildProject(Li=
fecycleModuleBuilder.java:59)
at =
org.apache.maven.lifecycle.internal.LifecycleStarter.singleThreadedBuild(L=
ifecycleStarter.java:183)
at =
org.apache.maven.lifecycle.internal.LifecycleStarter.execute(LifecycleStar=
ter.java:161)
at =
org.apache.maven.DefaultMaven.doExecute(DefaultMaven.java:319)
at org.apache.maven.DefaultMaven.execute(DefaultMaven.java:156)
at org.apache.maven.cli.MavenCli.execute(MavenCli.java:537)
at org.apache.maven.cli.MavenCli.doMain(MavenCli.java:196)
at org.apache.maven.cli.MavenCli.main(MavenCli.java:141)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at =
sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:=
39)
at =
sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorIm=
pl.java:25)
at java.lang.reflect.Method.invoke(Method.java:597)
at =
org.codehaus.plexus.classworlds.launcher.Launcher.launchEnhanced(Launcher.=
java:290)
at =
org.codehaus.plexus.classworlds.launcher.Launcher.launch(Launcher.java:230=
)
at =
org.codehaus.plexus.classworlds.launcher.Launcher.mainWithExitCode(Launche=
r.java:409)
at =
org.codehaus.plexus.classworlds.launcher.Launcher.main(Launcher.java:352)
Caused by: org.apache.maven.plugin.MojoExecutionException: An Ant =
BuildException has occured: exec returned: 1
at =
org.apache.maven.plugin.antrun.AntRunMojo.execute(AntRunMojo.java:283)
at =
org.apache.maven.plugin.DefaultBuildPluginManager.executeMojo(DefaultBuild=
PluginManager.java:101)
at =
org.apache.maven.lifecycle.internal.MojoExecutor.execute(MojoExecutor.java=
:209)
... 19 more
Caused by: /Volumes/Macintosh HD =
2/rhc/hadoop/svn-trunk/hadoop-project-dist/target/antrun/build-main.xml:12=
: exec returned: 1
at =
org.apache.tools.ant.taskdefs.ExecTask.runExecute(ExecTask.java:650)
at =
org.apache.tools.ant.taskdefs.ExecTask.runExec(ExecTask.java:676)
at =
org.apache.tools.ant.taskdefs.ExecTask.execute(ExecTask.java:502)
at =
org.apache.tools.ant.UnknownElement.execute(UnknownElement.java:291)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at =
sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:=
39)
at =
sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorIm=
pl.java:25)
at java.lang.reflect.Method.invoke(Method.java:597)
at =
org.apache.tools.ant.dispatch.DispatchUtils.execute(DispatchUtils.java:106=
)
at org.apache.tools.ant.Task.perform(Task.java:348)
at org.apache.tools.ant.Target.execute(Target.java:390)
at org.apache.tools.ant.Target.performTasks(Target.java:411)
at =
org.apache.tools.ant.Project.executeSortedTargets(Project.java:1397)
at org.apache.tools.ant.Project.executeTarget(Project.java:1366)
at =
org.apache.maven.plugin.antrun.AntRunMojo.execute(AntRunMojo.java:270)
... 21 more
[
Any ideas what may be going wrong? This is on Mac OSX/Lion, and the =
Maven cmd line was:
mvn clean package -Pdist -Dtar -DskipTests -P-native
Thanks
Ralph
From common-dev-return-77681-apmail-hadoop-common-dev-archive=hadoop.apache.org@hadoop.apache.org Fri Feb 10 21:20:50 2012
Return-Path: <common-dev-return-77681-apmail-hadoop-common-dev-archive=hadoop.apache.org@hadoop.apache.org>
X-Original-To: apmail-hadoop-common-dev-archive@www.apache.org
Delivered-To: apmail-hadoop-common-dev-archive@www.apache.org
Received: from mail.apache.org (hermes.apache.org [140.211.11.3])
by minotaur.apache.org (Postfix) with SMTP id 30D8F9F3C
for <apmail-hadoop-common-dev-archive@www.apache.org>; Fri, 10 Feb 2012 21:20:50 +0000 (UTC)
Received: (qmail 10509 invoked by uid 500); 10 Feb 2012 21:20:48 -0000
Delivered-To: apmail-hadoop-common-dev-archive@hadoop.apache.org
Received: (qmail 10396 invoked by uid 500); 10 Feb 2012 21:20:47 -0000
Mailing-List: contact common-dev-help@hadoop.apache.org; run by ezmlm
Precedence: bulk
List-Help: <mailto:common-dev-help@hadoop.apache.org>
List-Unsubscribe: <mailto:common-dev-unsubscribe@hadoop.apache.org>
List-Post: <mailto:common-dev@hadoop.apache.org>
List-Id: <common-dev.hadoop.apache.org>
Reply-To: common-dev@hadoop.apache.org
Delivered-To: mailing list common-dev@hadoop.apache.org
Received: (qmail 10388 invoked by uid 99); 10 Feb 2012 21:20:47 -0000
Received: from nike.apache.org (HELO nike.apache.org) (192.87.106.230)
by apache.org (qpsmtpd/0.29) with ESMTP; Fri, 10 Feb 2012 21:20:47 +0000
X-ASF-Spam-Status: No, hits=1.5 required=5.0
tests=HTML_MESSAGE,RCVD_IN_DNSWL_LOW,SPF_PASS
X-Spam-Check-By: apache.org
Received-SPF: pass (nike.apache.org: domain of bautin.mailing.lists@gmail.com designates 209.85.160.48 as permitted sender)
Received: from [209.85.160.48] (HELO mail-pw0-f48.google.com) (209.85.160.48)
by apache.org (qpsmtpd/0.29) with ESMTP; Fri, 10 Feb 2012 21:20:40 +0000
Received: by pbcuo1 with SMTP id uo1so3087128pbc.35
for <common-dev@hadoop.apache.org>; Fri, 10 Feb 2012 13:20:18 -0800 (PST)
DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed;
d=gmail.com; s=gamma;
h=mime-version:date:message-id:subject:from:to:content-type;
bh=M5v5NLg+68bDxlfhoRAGJjvM0xo3re/87vUK8FgQQFQ=;
b=WPKW3V8iQA3UMazmqVJhFCJ/s3B9yy2mHLpYTYAWvPU7Hpkgz7Q9vWrZF4L6y5Tr1J
TNFKDHZKzGmOi6nadtgdM5rNHQ01suy4QCgkFcILzUhxXhxuDbOm2IXX3Q1W9pEH9dCU
fCb0lJrXKURCRiyPQf+hCSndPewYcCU1ajEXQ=
MIME-Version: 1.0
Received: by 10.68.217.41 with SMTP id ov9mr20054344pbc.82.1328908818805; Fri,
10 Feb 2012 13:20:18 -0800 (PST)
Received: by 10.142.122.4 with HTTP; Fri, 10 Feb 2012 13:20:18 -0800 (PST)
Date: Fri, 10 Feb 2012 13:20:18 -0800
Message-ID: <CAF63A-aTE4E2kVcoUpJkwg94-q8jcex7hBor5v+ZyhRB8KY3Fw@mail.gmail.com>
Subject: Hadoop QA machine configuration / getting a Jenkins account
From: Mikhail Bautin <bautin.mailing.lists@gmail.com>
To: common-dev@hadoop.apache.org
Content-Type: multipart/alternative; boundary=e89a8ff2441315719304b8a2b20d
X-Virus-Checked: Checked by ClamAV on apache.org
--e89a8ff2441315719304b8a2b20d
Content-Type: text/plain; charset=ISO-8859-1
Hello Hadoop Developers,
A couple of questions about Hadoop QA:
(1) Does anyone know what the configuration of Hadoop QA boxes is?
Specifically, I am interested in the amount of memory available on these
boxes.
(2) How to get an account for https://builds.apache.org/?
Thanks,
--Mikhail
--e89a8ff2441315719304b8a2b20d--
From common-dev-return-77682-apmail-hadoop-common-dev-archive=hadoop.apache.org@hadoop.apache.org Fri Feb 10 21:25:32 2012
Return-Path: <common-dev-return-77682-apmail-hadoop-common-dev-archive=hadoop.apache.org@hadoop.apache.org>
X-Original-To: apmail-hadoop-common-dev-archive@www.apache.org
Delivered-To: apmail-hadoop-common-dev-archive@www.apache.org
Received: from mail.apache.org (hermes.apache.org [140.211.11.3])
by minotaur.apache.org (Postfix) with SMTP id 0A56F9B50
for <apmail-hadoop-common-dev-archive@www.apache.org>; Fri, 10 Feb 2012 21:25:32 +0000 (UTC)
Received: (qmail 21400 invoked by uid 500); 10 Feb 2012 21:25:30 -0000
Delivered-To: apmail-hadoop-common-dev-archive@hadoop.apache.org
Received: (qmail 21343 invoked by uid 500); 10 Feb 2012 21:25:29 -0000
Mailing-List: contact common-dev-help@hadoop.apache.org; run by ezmlm
Precedence: bulk
List-Help: <mailto:common-dev-help@hadoop.apache.org>
List-Unsubscribe: <mailto:common-dev-unsubscribe@hadoop.apache.org>
List-Post: <mailto:common-dev@hadoop.apache.org>
List-Id: <common-dev.hadoop.apache.org>
Reply-To: common-dev@hadoop.apache.org
Delivered-To: mailing list common-dev@hadoop.apache.org
Received: (qmail 21335 invoked by uid 99); 10 Feb 2012 21:25:29 -0000
Received: from nike.apache.org (HELO nike.apache.org) (192.87.106.230)
by apache.org (qpsmtpd/0.29) with ESMTP; Fri, 10 Feb 2012 21:25:29 +0000
X-ASF-Spam-Status: No, hits=-0.0 required=5.0
tests=RCVD_IN_DNSWL_LOW,SPF_NEUTRAL
X-Spam-Check-By: apache.org
Received-SPF: neutral (nike.apache.org: local policy)
Received: from [209.85.220.176] (HELO mail-vx0-f176.google.com) (209.85.220.176)
by apache.org (qpsmtpd/0.29) with ESMTP; Fri, 10 Feb 2012 21:25:22 +0000
Received: by vcbfl13 with SMTP id fl13so3229176vcb.35
for <common-dev@hadoop.apache.org>; Fri, 10 Feb 2012 13:25:01 -0800 (PST)
MIME-Version: 1.0
Received: by 10.52.72.83 with SMTP id b19mr3819299vdv.24.1328909101185; Fri,
10 Feb 2012 13:25:01 -0800 (PST)
Received: by 10.220.199.1 with HTTP; Fri, 10 Feb 2012 13:25:01 -0800 (PST)
In-Reply-To: <CAF63A-aTE4E2kVcoUpJkwg94-q8jcex7hBor5v+ZyhRB8KY3Fw@mail.gmail.com>
References: <CAF63A-aTE4E2kVcoUpJkwg94-q8jcex7hBor5v+ZyhRB8KY3Fw@mail.gmail.com>
Date: Fri, 10 Feb 2012 13:25:01 -0800
Message-ID: <CANJr2=Hn3ygbgDx0jBgOrvQ8FQOPcAnOh=V2Zagx16-nJb393g@mail.gmail.com>
Subject: Re: Hadoop QA machine configuration / getting a Jenkins account
From: Giridharan Kesavan <gkesavan@hortonworks.com>
To: common-dev@hadoop.apache.org
Content-Type: text/plain; charset=ISO-8859-1
X-Gm-Message-State: ALoCoQlECHpo2xYQvIvYp2fI6XW/8BD4B2l2Kx/RiN0bkXzjsH4OYWMJGwZd+s+8dC+cED7TDB0f
X-Virus-Checked: Checked by ClamAV on apache.org
Mikhali,
I can get you the memory details, May I know the reason please?
Giri
Apache Hudson Admin
On Fri, Feb 10, 2012 at 1:20 PM, Mikhail Bautin
<bautin.mailing.lists@gmail.com> wrote:
> Hello Hadoop Developers,
>
> A couple of questions about Hadoop QA:
> (1) Does anyone know what the configuration of Hadoop QA boxes is?
> Specifically, I am interested in the amount of memory available on these
> boxes.
> (2) How to get an account for https://builds.apache.org/?
>
> Thanks,
> --Mikhail
--
-Giri
From common-dev-return-77683-apmail-hadoop-common-dev-archive=hadoop.apache.org@hadoop.apache.org Fri Feb 10 21:32:03 2012
Return-Path: <common-dev-return-77683-apmail-hadoop-common-dev-archive=hadoop.apache.org@hadoop.apache.org>
X-Original-To: apmail-hadoop-common-dev-archive@www.apache.org
Delivered-To: apmail-hadoop-common-dev-archive@www.apache.org
Received: from mail.apache.org (hermes.apache.org [140.211.11.3])
by minotaur.apache.org (Postfix) with SMTP id 98DEE9F9E
for <apmail-hadoop-common-dev-archive@www.apache.org>; Fri, 10 Feb 2012 21:32:03 +0000 (UTC)
Received: (qmail 31554 invoked by uid 500); 10 Feb 2012 21:32:01 -0000
Delivered-To: apmail-hadoop-common-dev-archive@hadoop.apache.org
Received: (qmail 31357 invoked by uid 500); 10 Feb 2012 21:32:01 -0000
Mailing-List: contact common-dev-help@hadoop.apache.org; run by ezmlm
Precedence: bulk
List-Help: <mailto:common-dev-help@hadoop.apache.org>
List-Unsubscribe: <mailto:common-dev-unsubscribe@hadoop.apache.org>
List-Post: <mailto:common-dev@hadoop.apache.org>
List-Id: <common-dev.hadoop.apache.org>
Reply-To: common-dev@hadoop.apache.org
Delivered-To: mailing list common-dev@hadoop.apache.org
Received: (qmail 31348 invoked by uid 99); 10 Feb 2012 21:32:00 -0000
Received: from nike.apache.org (HELO nike.apache.org) (192.87.106.230)
by apache.org (qpsmtpd/0.29) with ESMTP; Fri, 10 Feb 2012 21:32:00 +0000
X-ASF-Spam-Status: No, hits=1.5 required=5.0
tests=HTML_MESSAGE,RCVD_IN_DNSWL_LOW,SPF_PASS
X-Spam-Check-By: apache.org
Received-SPF: pass (nike.apache.org: domain of bautin.mailing.lists@gmail.com designates 209.85.210.48 as permitted sender)
Received: from [209.85.210.48] (HELO mail-pz0-f48.google.com) (209.85.210.48)
by apache.org (qpsmtpd/0.29) with ESMTP; Fri, 10 Feb 2012 21:31:53 +0000
Received: by dadp13 with SMTP id p13so3283395dad.35
for <common-dev@hadoop.apache.org>; Fri, 10 Feb 2012 13:31:32 -0800 (PST)
DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed;
d=gmail.com; s=gamma;
h=mime-version:in-reply-to:references:date:message-id:subject:from:to
:cc:content-type;
bh=/J/J9RMT/J4b/nEtfb6qSbnJA1tg7ToZaJh5qbhdmQk=;
b=CbS2p9wiP4J4NRNkUaq2cnrEIAXX5LqVWmva0SGtZvWuiw18GaGZ1sUtbKmElxzI4b
QJiJ37s/OkJZ81PCsynTHhj5f/N2YVN+rl+ZiwfMI07yPNj9qBIqfXADK6MV0aVaCC7m
/REkJxOKzWpv5uV1im2wnz/Zala7xU58XrtD4=
MIME-Version: 1.0
Received: by 10.68.238.136 with SMTP id vk8mr20006000pbc.14.1328909492183;
Fri, 10 Feb 2012 13:31:32 -0800 (PST)
Received: by 10.142.122.4 with HTTP; Fri, 10 Feb 2012 13:31:32 -0800 (PST)
In-Reply-To: <CANJr2=Hn3ygbgDx0jBgOrvQ8FQOPcAnOh=V2Zagx16-nJb393g@mail.gmail.com>
References: <CAF63A-aTE4E2kVcoUpJkwg94-q8jcex7hBor5v+ZyhRB8KY3Fw@mail.gmail.com>
<CANJr2=Hn3ygbgDx0jBgOrvQ8FQOPcAnOh=V2Zagx16-nJb393g@mail.gmail.com>
Date: Fri, 10 Feb 2012 13:31:32 -0800
Message-ID: <CAF63A-Z8pWFc=ti7T_KUH0y43oH5woDrn5UeP24KCE9NoStk0A@mail.gmail.com>
Subject: Re: Hadoop QA machine configuration / getting a Jenkins account
From: Mikhail Bautin <bautin.mailing.lists@gmail.com>
To: common-dev@hadoop.apache.org
Cc: yuzhihong@gmail.com
Content-Type: multipart/alternative; boundary=047d7b33cf7838614604b8a2daa1
X-Virus-Checked: Checked by ClamAV on apache.org
--047d7b33cf7838614604b8a2daa1
Content-Type: text/plain; charset=ISO-8859-1
Hi Giri,
Thank you for your prompt response. I am trying to debug recent HBase unit
test failures that only appear in Hadoop QA and are not easily reproducible
locally, such as the following:
https://builds.apache.org/job/HBase-TRUNK/2658/testReport/
This is not Java heap memory which is configurable in HBase's pom.xml but
native memory, suggesting that the machine might be rather memory
constrained (e.g. 2 GB or so).
Thanks!
--Mikhail
On Fri, Feb 10, 2012 at 1:25 PM, Giridharan Kesavan <
gkesavan@hortonworks.com> wrote:
> Mikhali,
>
> I can get you the memory details, May I know the reason please?
>
> Giri
> Apache Hudson Admin
>
>
> On Fri, Feb 10, 2012 at 1:20 PM, Mikhail Bautin
> <bautin.mailing.lists@gmail.com> wrote:
> > Hello Hadoop Developers,
> >
> > A couple of questions about Hadoop QA:
> > (1) Does anyone know what the configuration of Hadoop QA boxes is?
> > Specifically, I am interested in the amount of memory available on these
> > boxes.
> > (2) How to get an account for https://builds.apache.org/?
> >
> > Thanks,
> > --Mikhail
>
>
>
> --
> -Giri
>
--047d7b33cf7838614604b8a2daa1--
From common-dev-return-77684-apmail-hadoop-common-dev-archive=hadoop.apache.org@hadoop.apache.org Fri Feb 10 21:40:01 2012
Return-Path: <common-dev-return-77684-apmail-hadoop-common-dev-archive=hadoop.apache.org@hadoop.apache.org>
X-Original-To: apmail-hadoop-common-dev-archive@www.apache.org
Delivered-To: apmail-hadoop-common-dev-archive@www.apache.org
Received: from mail.apache.org (hermes.apache.org [140.211.11.3])
by minotaur.apache.org (Postfix) with SMTP id ED7FA9236
for <apmail-hadoop-common-dev-archive@www.apache.org>; Fri, 10 Feb 2012 21:40:00 +0000 (UTC)
Received: (qmail 45888 invoked by uid 500); 10 Feb 2012 21:39:59 -0000
Delivered-To: apmail-hadoop-common-dev-archive@hadoop.apache.org
Received: (qmail 45837 invoked by uid 500); 10 Feb 2012 21:39:58 -0000
Mailing-List: contact common-dev-help@hadoop.apache.org; run by ezmlm
Precedence: bulk
List-Help: <mailto:common-dev-help@hadoop.apache.org>
List-Unsubscribe: <mailto:common-dev-unsubscribe@hadoop.apache.org>
List-Post: <mailto:common-dev@hadoop.apache.org>
List-Id: <common-dev.hadoop.apache.org>
Reply-To: common-dev@hadoop.apache.org
Delivered-To: mailing list common-dev@hadoop.apache.org
Received: (qmail 45829 invoked by uid 99); 10 Feb 2012 21:39:58 -0000
Received: from nike.apache.org (HELO nike.apache.org) (192.87.106.230)
by apache.org (qpsmtpd/0.29) with ESMTP; Fri, 10 Feb 2012 21:39:58 +0000
X-ASF-Spam-Status: No, hits=-0.0 required=5.0
tests=RCVD_IN_DNSWL_LOW,SPF_NEUTRAL
X-Spam-Check-By: apache.org
Received-SPF: neutral (nike.apache.org: local policy)
Received: from [209.85.212.48] (HELO mail-vw0-f48.google.com) (209.85.212.48)
by apache.org (qpsmtpd/0.29) with ESMTP; Fri, 10 Feb 2012 21:39:51 +0000
Received: by vbjk13 with SMTP id k13so3245896vbj.35
for <common-dev@hadoop.apache.org>; Fri, 10 Feb 2012 13:39:30 -0800 (PST)
MIME-Version: 1.0
Received: by 10.52.95.233 with SMTP id dn9mr3844390vdb.7.1328909970762; Fri,
10 Feb 2012 13:39:30 -0800 (PST)
Received: by 10.220.199.1 with HTTP; Fri, 10 Feb 2012 13:39:30 -0800 (PST)
In-Reply-To: <CAF63A-Z8pWFc=ti7T_KUH0y43oH5woDrn5UeP24KCE9NoStk0A@mail.gmail.com>
References: <CAF63A-aTE4E2kVcoUpJkwg94-q8jcex7hBor5v+ZyhRB8KY3Fw@mail.gmail.com>
<CANJr2=Hn3ygbgDx0jBgOrvQ8FQOPcAnOh=V2Zagx16-nJb393g@mail.gmail.com>
<CAF63A-Z8pWFc=ti7T_KUH0y43oH5woDrn5UeP24KCE9NoStk0A@mail.gmail.com>
Date: Fri, 10 Feb 2012 13:39:30 -0800
Message-ID: <CANJr2=H9_uCh28qHeJcw7UkdNZ2HEosiyopzxX7My1-LLgoQFQ@mail.gmail.com>
Subject: Re: Hadoop QA machine configuration / getting a Jenkins account
From: Giridharan Kesavan <gkesavan@hortonworks.com>
To: common-dev@hadoop.apache.org
Content-Type: text/plain; charset=ISO-8859-1
X-Gm-Message-State: ALoCoQkltkRf4m7pVK3Y7F9FwnV1M8asnROb9/7yi+7oDWRebeBVuQkADBi0Fro6NPHBcgUyU3MG
X-Virus-Checked: Checked by ClamAV on apache.org
Mikhali,
gkesavan@minerva:~$ free -g
total used free shared buffers cached
Mem: 7 3 4 0 0 1
-/+ buffers/cache: 1 5
Swap: 22 0 21
On Fri, Feb 10, 2012 at 1:31 PM, Mikhail Bautin
<bautin.mailing.lists@gmail.com> wrote:
> Hi Giri,
>
> Thank you for your prompt response. I am trying to debug recent HBase unit
> test failures that only appear in Hadoop QA and are not easily reproducible
> locally, such as the following:
>
> https://builds.apache.org/job/HBase-TRUNK/2658/testReport/
>
> This is not Java heap memory which is configurable in HBase's pom.xml but
> native memory, suggesting that the machine might be rather memory
> constrained (e.g. 2 GB or so).
>
> Thanks!
> --Mikhail
>
> On Fri, Feb 10, 2012 at 1:25 PM, Giridharan Kesavan <
> gkesavan@hortonworks.com> wrote:
>
>> Mikhali,
>>
>> I can get you the memory details, May I know the reason please?
>>
>> Giri
>> Apache Hudson Admin
>>
>>
>> On Fri, Feb 10, 2012 at 1:20 PM, Mikhail Bautin
>> <bautin.mailing.lists@gmail.com> wrote:
>> > Hello Hadoop Developers,
>> >
>> > A couple of questions about Hadoop QA:
>> > (1) Does anyone know what the configuration of Hadoop QA boxes is?
>> > Specifically, I am interested in the amount of memory available on these
>> > boxes.
>> > (2) How to get an account for https://builds.apache.org/?
>> >
>> > Thanks,
>> > --Mikhail
>>
>>
>>
>> --
>> -Giri
>>
--
-Giri
From common-dev-return-77685-apmail-hadoop-common-dev-archive=hadoop.apache.org@hadoop.apache.org Fri Feb 10 23:41:24 2012
Return-Path: <common-dev-return-77685-apmail-hadoop-common-dev-archive=hadoop.apache.org@hadoop.apache.org>
X-Original-To: apmail-hadoop-common-dev-archive@www.apache.org
Delivered-To: apmail-hadoop-common-dev-archive@www.apache.org
Received: from mail.apache.org (hermes.apache.org [140.211.11.3])
by minotaur.apache.org (Postfix) with SMTP id 480FD983B
for <apmail-hadoop-common-dev-archive@www.apache.org>; Fri, 10 Feb 2012 23:41:24 +0000 (UTC)
Received: (qmail 16577 invoked by uid 500); 10 Feb 2012 23:41:22 -0000
Delivered-To: apmail-hadoop-common-dev-archive@hadoop.apache.org
Received: (qmail 15906 invoked by uid 500); 10 Feb 2012 23:41:21 -0000
Mailing-List: contact common-dev-help@hadoop.apache.org; run by ezmlm
Precedence: bulk
List-Help: <mailto:common-dev-help@hadoop.apache.org>
List-Unsubscribe: <mailto:common-dev-unsubscribe@hadoop.apache.org>
List-Post: <mailto:common-dev@hadoop.apache.org>
List-Id: <common-dev.hadoop.apache.org>
Reply-To: common-dev@hadoop.apache.org
Delivered-To: mailing list common-dev@hadoop.apache.org
Received: (qmail 15875 invoked by uid 99); 10 Feb 2012 23:41:20 -0000
Received: from athena.apache.org (HELO athena.apache.org) (140.211.11.136)
by apache.org (qpsmtpd/0.29) with ESMTP; Fri, 10 Feb 2012 23:41:20 +0000
X-ASF-Spam-Status: No, hits=-2000.0 required=5.0
tests=ALL_TRUSTED,T_RP_MATCHES_RCVD
X-Spam-Check-By: apache.org
Received: from [140.211.11.116] (HELO hel.zones.apache.org) (140.211.11.116)
by apache.org (qpsmtpd/0.29) with ESMTP; Fri, 10 Feb 2012 23:41:19 +0000
Received: from hel.zones.apache.org (hel.zones.apache.org [140.211.11.116])
by hel.zones.apache.org (Postfix) with ESMTP id C3DA41B0B5E
for <common-dev@hadoop.apache.org>; Fri, 10 Feb 2012 23:40:59 +0000 (UTC)
Date: Fri, 10 Feb 2012 23:40:59 +0000 (UTC)
From: "VINAYAKUMAR B (Created) (JIRA)" <jira@apache.org>
To: common-dev@hadoop.apache.org
Message-ID: <1734740195.26635.1328917259803.JavaMail.tomcat@hel.zones.apache.org>
Subject: [jira] [Created] (HADOOP-8057) hadoop-setup-conf.sh not working
because of some extra spaces.
MIME-Version: 1.0
Content-Type: text/plain; charset=utf-8
Content-Transfer-Encoding: 7bit
X-JIRA-FingerPrint: 30527f35849b9dde25b450d4833f0394
hadoop-setup-conf.sh not working because of some extra spaces.
--------------------------------------------------------------
Key: HADOOP-8057
URL: https://issues.apache.org/jira/browse/HADOOP-8057
Project: Hadoop Common
Issue Type: Bug
Components: scripts
Affects Versions: 0.24.0
Environment: Suse11
Reporter: VINAYAKUMAR B
Fix For: 0.24.0
hadoop-setup-conf.sh is not working because of one extra space, while configuring the getopt.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
From common-dev-return-77686-apmail-hadoop-common-dev-archive=hadoop.apache.org@hadoop.apache.org Sat Feb 11 02:55:36 2012
Return-Path: <common-dev-return-77686-apmail-hadoop-common-dev-archive=hadoop.apache.org@hadoop.apache.org>
X-Original-To: apmail-hadoop-common-dev-archive@www.apache.org
Delivered-To: apmail-hadoop-common-dev-archive@www.apache.org
Received: from mail.apache.org (hermes.apache.org [140.211.11.3])
by minotaur.apache.org (Postfix) with SMTP id 0D4DA9F7A
for <apmail-hadoop-common-dev-archive@www.apache.org>; Sat, 11 Feb 2012 02:55:36 +0000 (UTC)
Received: (qmail 91121 invoked by uid 500); 11 Feb 2012 02:55:34 -0000
Delivered-To: apmail-hadoop-common-dev-archive@hadoop.apache.org
Received: (qmail 90363 invoked by uid 500); 11 Feb 2012 02:55:31 -0000
Mailing-List: contact common-dev-help@hadoop.apache.org; run by ezmlm
Precedence: bulk
List-Help: <mailto:common-dev-help@hadoop.apache.org>
List-Unsubscribe: <mailto:common-dev-unsubscribe@hadoop.apache.org>
List-Post: <mailto:common-dev@hadoop.apache.org>
List-Id: <common-dev.hadoop.apache.org>
Reply-To: common-dev@hadoop.apache.org
Delivered-To: mailing list common-dev@hadoop.apache.org
Received: (qmail 90349 invoked by uid 99); 11 Feb 2012 02:55:28 -0000
Received: from athena.apache.org (HELO athena.apache.org) (140.211.11.136)
by apache.org (qpsmtpd/0.29) with ESMTP; Sat, 11 Feb 2012 02:55:28 +0000
X-ASF-Spam-Status: No, hits=1.5 required=5.0
tests=HTML_MESSAGE,RCVD_IN_DNSWL_LOW,SPF_PASS
X-Spam-Check-By: apache.org
Received-SPF: pass (athena.apache.org: domain of bautin.mailing.lists@gmail.com designates 209.85.210.48 as permitted sender)
Received: from [209.85.210.48] (HELO mail-pz0-f48.google.com) (209.85.210.48)
by apache.org (qpsmtpd/0.29) with ESMTP; Sat, 11 Feb 2012 02:55:22 +0000
Received: by dadp13 with SMTP id p13so3501599dad.35
for <common-dev@hadoop.apache.org>; Fri, 10 Feb 2012 18:55:02 -0800 (PST)
DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed;
d=gmail.com; s=gamma;
h=mime-version:in-reply-to:references:date:message-id:subject:from:to
:content-type;
bh=k6RIfCMSPFREMbtoGz3ZxwqwLD2PxWEUfdnwg2wXDLw=;
b=GR6/YNW1iTv9daYbuOe7OQYhIEDxCHZiBVueC2pfjrJDu/3kv0GBUMbR3fB5WBxNsF
kc8xZ+7jf/haG4GXiPbYyIh3w6InTyEsGspSZUdyhxohBxqXLjXuScj/M4jAfus6Tmus
Qh1+2K3VF5T7uBzMCLcQw9BegjDoMqCf4ripA=
MIME-Version: 1.0
Received: by 10.68.217.41 with SMTP id ov9mr22347652pbc.82.1328928902241; Fri,
10 Feb 2012 18:55:02 -0800 (PST)
Received: by 10.142.122.4 with HTTP; Fri, 10 Feb 2012 18:55:02 -0800 (PST)
In-Reply-To: <CANJr2=H9_uCh28qHeJcw7UkdNZ2HEosiyopzxX7My1-LLgoQFQ@mail.gmail.com>
References: <CAF63A-aTE4E2kVcoUpJkwg94-q8jcex7hBor5v+ZyhRB8KY3Fw@mail.gmail.com>
<CANJr2=Hn3ygbgDx0jBgOrvQ8FQOPcAnOh=V2Zagx16-nJb393g@mail.gmail.com>
<CAF63A-Z8pWFc=ti7T_KUH0y43oH5woDrn5UeP24KCE9NoStk0A@mail.gmail.com>
<CANJr2=H9_uCh28qHeJcw7UkdNZ2HEosiyopzxX7My1-LLgoQFQ@mail.gmail.com>
Date: Fri, 10 Feb 2012 18:55:02 -0800
Message-ID: <CAF63A-basg82V+HTYE+9hF4byzrFf18wHrz+zFTGcWBfor+iAg@mail.gmail.com>
Subject: Re: Hadoop QA machine configuration / getting a Jenkins account
From: Mikhail Bautin <bautin.mailing.lists@gmail.com>
To: common-dev@hadoop.apache.org
Content-Type: multipart/alternative; boundary=e89a8ff24413265be404b8a75f76
--e89a8ff24413265be404b8a75f76
Content-Type: text/plain; charset=ISO-8859-1
Hi Giri,
Thank you for the memory details. I will now assume these are 8 GB boxes.
How can I get an account on Jenkins? Can registered users trigger builds on
demand?
Thanks!
--Mikhail
On Fri, Feb 10, 2012 at 1:39 PM, Giridharan Kesavan <
gkesavan@hortonworks.com> wrote:
> Mikhali,
>
> gkesavan@minerva:~$ free -g
> total used free shared buffers cached
> Mem: 7 3 4 0 0 1
> -/+ buffers/cache: 1 5
> Swap: 22 0 21
>
> On Fri, Feb 10, 2012 at 1:31 PM, Mikhail Bautin
> <bautin.mailing.lists@gmail.com> wrote:
> > Hi Giri,
> >
> > Thank you for your prompt response. I am trying to debug recent HBase
> unit
> > test failures that only appear in Hadoop QA and are not easily
> reproducible
> > locally, such as the following:
> >
> > https://builds.apache.org/job/HBase-TRUNK/2658/testReport/
> >
> > This is not Java heap memory which is configurable in HBase's pom.xml but
> > native memory, suggesting that the machine might be rather memory
> > constrained (e.g. 2 GB or so).
> >
> > Thanks!
> > --Mikhail
> >
> > On Fri, Feb 10, 2012 at 1:25 PM, Giridharan Kesavan <
> > gkesavan@hortonworks.com> wrote:
> >
> >> Mikhali,
> >>
> >> I can get you the memory details, May I know the reason please?
> >>
> >> Giri
> >> Apache Hudson Admin
> >>
> >>
> >> On Fri, Feb 10, 2012 at 1:20 PM, Mikhail Bautin
> >> <bautin.mailing.lists@gmail.com> wrote:
> >> > Hello Hadoop Developers,
> >> >
> >> > A couple of questions about Hadoop QA:
> >> > (1) Does anyone know what the configuration of Hadoop QA boxes is?
> >> > Specifically, I am interested in the amount of memory available on
> these
> >> > boxes.
> >> > (2) How to get an account for https://builds.apache.org/?
> >> >
> >> > Thanks,
> >> > --Mikhail
> >>
> >>
> >>
> >> --
> >> -Giri
> >>
>
>
>
> --
> -Giri
>
--e89a8ff24413265be404b8a75f76--
From common-dev-return-77687-apmail-hadoop-common-dev-archive=hadoop.apache.org@hadoop.apache.org Sat Feb 11 09:24:31 2012
Return-Path: <common-dev-return-77687-apmail-hadoop-common-dev-archive=hadoop.apache.org@hadoop.apache.org>
X-Original-To: apmail-hadoop-common-dev-archive@www.apache.org
Delivered-To: apmail-hadoop-common-dev-archive@www.apache.org
Received: from mail.apache.org (hermes.apache.org [140.211.11.3])
by minotaur.apache.org (Postfix) with SMTP id 32A5A9D42
for <apmail-hadoop-common-dev-archive@www.apache.org>; Sat, 11 Feb 2012 09:24:31 +0000 (UTC)
Received: (qmail 61751 invoked by uid 500); 11 Feb 2012 09:24:29 -0000
Delivered-To: apmail-hadoop-common-dev-archive@hadoop.apache.org
Received: (qmail 61102 invoked by uid 500); 11 Feb 2012 09:24:26 -0000
Mailing-List: contact common-dev-help@hadoop.apache.org; run by ezmlm
Precedence: bulk
List-Help: <mailto:common-dev-help@hadoop.apache.org>
List-Unsubscribe: <mailto:common-dev-unsubscribe@hadoop.apache.org>
List-Post: <mailto:common-dev@hadoop.apache.org>
List-Id: <common-dev.hadoop.apache.org>
Reply-To: common-dev@hadoop.apache.org
Delivered-To: mailing list common-dev@hadoop.apache.org
Received: (qmail 61031 invoked by uid 99); 11 Feb 2012 09:24:22 -0000
Received: from nike.apache.org (HELO nike.apache.org) (192.87.106.230)
by apache.org (qpsmtpd/0.29) with ESMTP; Sat, 11 Feb 2012 09:24:22 +0000
X-ASF-Spam-Status: No, hits=-2000.0 required=5.0
tests=ALL_TRUSTED,T_RP_MATCHES_RCVD
X-Spam-Check-By: apache.org
Received: from [140.211.11.116] (HELO hel.zones.apache.org) (140.211.11.116)
by apache.org (qpsmtpd/0.29) with ESMTP; Sat, 11 Feb 2012 09:24:20 +0000
Received: from hel.zones.apache.org (hel.zones.apache.org [140.211.11.116])
by hel.zones.apache.org (Postfix) with ESMTP id 7E5F51B088B
for <common-dev@hadoop.apache.org>; Sat, 11 Feb 2012 09:23:59 +0000 (UTC)
Date: Sat, 11 Feb 2012 09:23:59 +0000 (UTC)
From: "Eric Charles (Created) (JIRA)" <jira@apache.org>
To: common-dev@hadoop.apache.org
Message-ID: <2107107955.27735.1328952239519.JavaMail.tomcat@hel.zones.apache.org>
Subject: [jira] [Created] (HADOOP-8058) Configure Jenkins to run test from
root trunk
MIME-Version: 1.0
Content-Type: text/plain; charset=utf-8
Content-Transfer-Encoding: 7bit
X-JIRA-FingerPrint: 30527f35849b9dde25b450d4833f0394
X-Virus-Checked: Checked by ClamAV on apache.org
Configure Jenkins to run test from root trunk
---------------------------------------------
Key: HADOOP-8058
URL: https://issues.apache.org/jira/browse/HADOOP-8058
Project: Hadoop Common
Issue Type: Improvement
Components: build
Affects Versions: hudson
Reporter: Eric Charles
The current Jenkins configuration does a 'cd hadoop-common-project' before invoking $MAVEN_HOME/bin/mvn test -Pclover..., this is why we only have a partial report (only for hadoop-common). See for example https://builds.apache.org/job/Hadoop-Common-trunk/315/testReport/
If we had the complete report, anyone could compare its local tests to the Jenkins ones (supposed to be the reference).
If we do this, there can be more Jenkins mails on the lists (unstability, errors...), but I find the advantages worth the price.
Thx,
Eric
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
From common-dev-return-77688-apmail-hadoop-common-dev-archive=hadoop.apache.org@hadoop.apache.org Sat Feb 11 09:52:32 2012
Return-Path: <common-dev-return-77688-apmail-hadoop-common-dev-archive=hadoop.apache.org@hadoop.apache.org>
X-Original-To: apmail-hadoop-common-dev-archive@www.apache.org
Delivered-To: apmail-hadoop-common-dev-archive@www.apache.org
Received: from mail.apache.org (hermes.apache.org [140.211.11.3])
by minotaur.apache.org (Postfix) with SMTP id ADB67994C
for <apmail-hadoop-common-dev-archive@www.apache.org>; Sat, 11 Feb 2012 09:52:32 +0000 (UTC)
Received: (qmail 80257 invoked by uid 500); 11 Feb 2012 09:52:30 -0000
Delivered-To: apmail-hadoop-common-dev-archive@hadoop.apache.org
Received: (qmail 79810 invoked by uid 500); 11 Feb 2012 09:52:22 -0000
Mailing-List: contact common-dev-help@hadoop.apache.org; run by ezmlm
Precedence: bulk
List-Help: <mailto:common-dev-help@hadoop.apache.org>
List-Unsubscribe: <mailto:common-dev-unsubscribe@hadoop.apache.org>
List-Post: <mailto:common-dev@hadoop.apache.org>
List-Id: <common-dev.hadoop.apache.org>
Reply-To: common-dev@hadoop.apache.org
Delivered-To: mailing list common-dev@hadoop.apache.org
Received: (qmail 79792 invoked by uid 99); 11 Feb 2012 09:52:20 -0000
Received: from athena.apache.org (HELO athena.apache.org) (140.211.11.136)
by apache.org (qpsmtpd/0.29) with ESMTP; Sat, 11 Feb 2012 09:52:20 +0000
X-ASF-Spam-Status: No, hits=-2000.0 required=5.0
tests=ALL_TRUSTED,T_RP_MATCHES_RCVD
X-Spam-Check-By: apache.org
Received: from [140.211.11.116] (HELO hel.zones.apache.org) (140.211.11.116)
by apache.org (qpsmtpd/0.29) with ESMTP; Sat, 11 Feb 2012 09:52:19 +0000
Received: from hel.zones.apache.org (hel.zones.apache.org [140.211.11.116])
by hel.zones.apache.org (Postfix) with ESMTP id 64B8B1B0EC9
for <common-dev@hadoop.apache.org>; Sat, 11 Feb 2012 09:51:59 +0000 (UTC)
Date: Sat, 11 Feb 2012 09:51:59 +0000 (UTC)
From: "Eric Charles (Resolved) (JIRA)" <jira@apache.org>
To: common-dev@hadoop.apache.org
Message-ID: <127691272.27764.1328953919413.JavaMail.tomcat@hel.zones.apache.org>
In-Reply-To: <2107107955.27735.1328952239519.JavaMail.tomcat@hel.zones.apache.org>
Subject: [jira] [Resolved] (HADOOP-8058) Configure Jenkins to run test from
root trunk
MIME-Version: 1.0
Content-Type: text/plain; charset=utf-8
Content-Transfer-Encoding: 7bit
X-JIRA-FingerPrint: 30527f35849b9dde25b450d4833f0394
[ https://issues.apache.org/jira/browse/HADOOP-8058?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Eric Charles resolved HADOOP-8058.
----------------------------------
Resolution: Won't Fix
Sorry, forget this.
There are separate hdfs and mapreduce jobs
https://builds.apache.org/view/G-L/view/Hadoop/job/Hadoop-Hdfs-trunk-Commit/
https://builds.apache.org/view/G-L/view/Hadoop/job/Hadoop-Mapreduce-trunk/
I was confused by the name "hadoop-common", thinking it was aimed to build the whole http://svn.apache.org/repos/asf/hadoop/common/trunk/ tree ('hadoop-common').
Eric
> Configure Jenkins to run test from root trunk
> ---------------------------------------------
>
> Key: HADOOP-8058
> URL: https://issues.apache.org/jira/browse/HADOOP-8058
> Project: Hadoop Common
> Issue Type: Improvement
> Components: build
> Affects Versions: hudson
> Reporter: Eric Charles
>
> The current Jenkins configuration does a 'cd hadoop-common-project' before invoking $MAVEN_HOME/bin/mvn test -Pclover..., this is why we only have a partial report (only for hadoop-common). See for example https://builds.apache.org/job/Hadoop-Common-trunk/315/testReport/
> If we had the complete report, anyone could compare its local tests to the Jenkins ones (supposed to be the reference).
> If we do this, there can be more Jenkins mails on the lists (unstability, errors...), but I find the advantages worth the price.
> Thx,
> Eric
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
From common-dev-return-77689-apmail-hadoop-common-dev-archive=hadoop.apache.org@hadoop.apache.org Sat Feb 11 10:12:00 2012
Return-Path: <common-dev-return-77689-apmail-hadoop-common-dev-archive=hadoop.apache.org@hadoop.apache.org>
X-Original-To: apmail-hadoop-common-dev-archive@www.apache.org
Delivered-To: apmail-hadoop-common-dev-archive@www.apache.org
Received: from mail.apache.org (hermes.apache.org [140.211.11.3])
by minotaur.apache.org (Postfix) with SMTP id 3F4019AE9
for <apmail-hadoop-common-dev-archive@www.apache.org>; Sat, 11 Feb 2012 10:12:00 +0000 (UTC)
Received: (qmail 88587 invoked by uid 500); 11 Feb 2012 10:11:56 -0000
Delivered-To: apmail-hadoop-common-dev-archive@hadoop.apache.org
Received: (qmail 88375 invoked by uid 500); 11 Feb 2012 10:11:49 -0000
Mailing-List: contact common-dev-help@hadoop.apache.org; run by ezmlm
Precedence: bulk
List-Help: <mailto:common-dev-help@hadoop.apache.org>
List-Unsubscribe: <mailto:common-dev-unsubscribe@hadoop.apache.org>
List-Post: <mailto:common-dev@hadoop.apache.org>
List-Id: <common-dev.hadoop.apache.org>
Reply-To: common-dev@hadoop.apache.org
Delivered-To: mailing list common-dev@hadoop.apache.org
Received: (qmail 88367 invoked by uid 99); 11 Feb 2012 10:11:47 -0000
Received: from athena.apache.org (HELO athena.apache.org) (140.211.11.136)
by apache.org (qpsmtpd/0.29) with ESMTP; Sat, 11 Feb 2012 10:11:47 +0000
X-ASF-Spam-Status: No, hits=1.5 required=5.0
tests=HTML_MESSAGE,RCVD_IN_DNSWL_LOW,SPF_PASS
X-Spam-Check-By: apache.org
Received-SPF: pass (athena.apache.org: domain of sysolve@gmail.com designates 209.85.214.48 as permitted sender)
Received: from [209.85.214.48] (HELO mail-bk0-f48.google.com) (209.85.214.48)
by apache.org (qpsmtpd/0.29) with ESMTP; Sat, 11 Feb 2012 10:11:41 +0000
Received: by bkcjm1 with SMTP id jm1so4004282bkc.35
for <common-dev@hadoop.apache.org>; Sat, 11 Feb 2012 02:11:19 -0800 (PST)
DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed;
d=gmail.com; s=gamma;
h=mime-version:date:message-id:subject:from:to:content-type;
bh=RaSvmtRl07OJ9Mq/nJYml034ubUWraeWNoXAJ++oEbI=;
b=Ynkp8rLtNOIq5b+FGVrx/su6vjeSKheteggmJx32fL9bLWrlvr6naJtyynUgjFqGpL
3Q6c1UlkH8aAOaC7vRQENItBEDvU9m7GZV0pqDBm8QguL8YGCfO+U1kAQZLTyi3rlipU
09FVtLDmqXpVbh4i4g38c9zNMPsWqgUyKU91A=
MIME-Version: 1.0
Received: by 10.204.156.155 with SMTP id x27mr3903227bkw.4.1328955079721; Sat,
11 Feb 2012 02:11:19 -0800 (PST)
Received: by 10.204.35.208 with HTTP; Sat, 11 Feb 2012 02:11:19 -0800 (PST)
Date: Sat, 11 Feb 2012 18:11:19 +0800
Message-ID: <CAD7nt4jwcv9sVLbyA5z9YOPXVEfzbshxOMkYcp1Rx9KDNxc4XQ@mail.gmail.com>
Subject: Several Unit-test failures in Hadoop 1.0.0 release version
From: Grace <sysolve@gmail.com>
To: common-dev@hadoop.apache.org
Content-Type: multipart/alternative; boundary=0015175df1fc7304f604b8ad77cb
--0015175df1fc7304f604b8ad77cb
Content-Type: text/plain; charset=ISO-8859-1
Hi all,
Met with several failures when running 'ant test' under hadoop-1.0.0
version from apache web site. does any one have the similar problems? I did
not get any related information from the google. Is there anything or
configuration I missing?
here is the failure list:
[junit] Running org.apache.hadoop.mapred.TestTTResourceReporting
[junit] Tests run: 3, Failures: 0, Errors: 1, Time elapsed: 179.124 sec
[junit] Running org.apache.hadoop.metrics2.impl.TestGangliaMetrics
[junit] Tests run: 1, Failures: 1, Errors: 0, Time elapsed: 0.14 sec
[junit] Running org.apache.hadoop.metrics2.impl.TestSinkQueue
[junit] Tests run: 8, Failures: 1, Errors: 0, Time elapsed: 0.291 sec
[junit] Running org.apache.hadoop.tools.rumen.TestRumenJobTraces
[junit] Tests run: 9, Failures: 0, Errors: 1, Time elapsed: 41.904 sec
[junit] Running org.apache.hadoop.streaming.TestUlimit
[junit] Tests run: 1, Failures: 1, Errors: 0, Time elapsed: 84.974 sec
-------------
Detailed exceptions for each of them for your reference
-------------
TEST-org.apache.hadoop.mapred.TestTTResourceReporting.txt
{{{
Testcase: testConfiguredResourceValues took 103.764 sec
Caused an ERROR
Job failed!
java.io.IOException: Job failed!
at org.apache.hadoop.mapred.JobClient.runJob(JobClient.java:1265)
at org.apache.hadoop.examples.SleepJob.run(SleepJob.java:174)
at org.apache.hadoop.examples.SleepJob.run(SleepJob.java:237)
at org.apache.hadoop.util.ToolRunner.run(ToolRunner.java:65)
at
org.apache.hadoop.mapred.TestTTResourceReporting.runSleepJob(TestTTResourceReporting.java:342)
at
org.apache.hadoop.mapred.TestTTResourceReporting.testConfiguredResourceValues(TestTTResourceReporting.java:296)
Testcase: testResourceValuesOnLinux took 37.521 sec
}}}
TEST-org.apache.hadoop.metrics2.impl.TestGangliaMetrics
{{{
Testcase: testGangliaMetrics2 took 0.128 sec
FAILED
Missing metrics: test.s1rec.c1
junit.framework.AssertionFailedError: Missing metrics: test.s1rec.c1
at
org.apache.hadoop.metrics2.impl.TestGangliaMetrics.checkMetrics(TestGangliaMetrics.java:98)
at
org.apache.hadoop.metrics2.impl.TestGangliaMetrics.testGangliaMetrics2(TestGangliaMetrics.java:77)
}}}
TEST-org.apache.hadoop.metrics2.impl.TestSinkQueue.txt:
{{{
Testcase: testConcurrentConsumers took 0.003 sec
FAILED
should've thrown
junit.framework.AssertionFailedError: should've thrown
at
org.apache.hadoop.metrics2.impl.TestSinkQueue.shouldThrowCME(TestSinkQueue.java:229)
at
org.apache.hadoop.metrics2.impl.TestSinkQueue.testConcurrentConsumers(TestSinkQueue.java:195)
}}}
TEST-org.apache.hadoop.tools.rumen.TestRumenJobTraces.txt
{{{
Can not create a Path from a null string
java.lang.IllegalArgumentException: Can not create a Path from a null string
at org.apache.hadoop.fs.Path.checkPathArg(Path.java:78)
at org.apache.hadoop.fs.Path.<init>(Path.java:90)
at
org.apache.hadoop.tools.rumen.TestRumenJobTraces.testCurrentJHParser(TestRumenJobTraces.java:405)
}}}
Could anyone help with this problem? thank you for your time and helps.
-Grace
--0015175df1fc7304f604b8ad77cb--
From common-dev-return-77690-apmail-hadoop-common-dev-archive=hadoop.apache.org@hadoop.apache.org Sat Feb 11 20:47:23 2012
Return-Path: <common-dev-return-77690-apmail-hadoop-common-dev-archive=hadoop.apache.org@hadoop.apache.org>
X-Original-To: apmail-hadoop-common-dev-archive@www.apache.org
Delivered-To: apmail-hadoop-common-dev-archive@www.apache.org
Received: from mail.apache.org (hermes.apache.org [140.211.11.3])
by minotaur.apache.org (Postfix) with SMTP id C3A6C9A45
for <apmail-hadoop-common-dev-archive@www.apache.org>; Sat, 11 Feb 2012 20:47:23 +0000 (UTC)
Received: (qmail 9456 invoked by uid 500); 11 Feb 2012 20:47:22 -0000
Delivered-To: apmail-hadoop-common-dev-archive@hadoop.apache.org
Received: (qmail 8960 invoked by uid 500); 11 Feb 2012 20:47:20 -0000
Mailing-List: contact common-dev-help@hadoop.apache.org; run by ezmlm
Precedence: bulk
List-Help: <mailto:common-dev-help@hadoop.apache.org>
List-Unsubscribe: <mailto:common-dev-unsubscribe@hadoop.apache.org>
List-Post: <mailto:common-dev@hadoop.apache.org>
List-Id: <common-dev.hadoop.apache.org>
Reply-To: common-dev@hadoop.apache.org
Delivered-To: mailing list common-dev@hadoop.apache.org
Received: (qmail 8943 invoked by uid 99); 11 Feb 2012 20:47:20 -0000
Received: from athena.apache.org (HELO athena.apache.org) (140.211.11.136)
by apache.org (qpsmtpd/0.29) with ESMTP; Sat, 11 Feb 2012 20:47:20 +0000
X-ASF-Spam-Status: No, hits=-2000.0 required=5.0
tests=ALL_TRUSTED,T_RP_MATCHES_RCVD
X-Spam-Check-By: apache.org
Received: from [140.211.11.116] (HELO hel.zones.apache.org) (140.211.11.116)
by apache.org (qpsmtpd/0.29) with ESMTP; Sat, 11 Feb 2012 20:47:19 +0000
Received: from hel.zones.apache.org (hel.zones.apache.org [140.211.11.116])
by hel.zones.apache.org (Postfix) with ESMTP id 8BE481B16F3
for <common-dev@hadoop.apache.org>; Sat, 11 Feb 2012 20:46:59 +0000 (UTC)
Date: Sat, 11 Feb 2012 20:46:59 +0000 (UTC)
From: "Suresh Srinivas (Created) (JIRA)" <jira@apache.org>
To: common-dev@hadoop.apache.org
Message-ID: <1727931782.28660.1328993219574.JavaMail.tomcat@hel.zones.apache.org>
Subject: [jira] [Created] (HADOOP-8059) Add javadoc to InterfaceAudience and
InterfaceStability
MIME-Version: 1.0
Content-Type: text/plain; charset=utf-8
Content-Transfer-Encoding: 7bit
X-JIRA-FingerPrint: 30527f35849b9dde25b450d4833f0394
Add javadoc to InterfaceAudience and InterfaceStability
-------------------------------------------------------
Key: HADOOP-8059
URL: https://issues.apache.org/jira/browse/HADOOP-8059
Project: Hadoop Common
Issue Type: Improvement
Components: documentation
Affects Versions: 0.24.0
Reporter: Suresh Srinivas
Assignee: Suresh Srinivas
InterfaceAudience and InterfaceStability javadoc is incomplete. The details from HADOOP-5073.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
From common-dev-return-77691-apmail-hadoop-common-dev-archive=hadoop.apache.org@hadoop.apache.org Sat Feb 11 22:03:48 2012
Return-Path: <common-dev-return-77691-apmail-hadoop-common-dev-archive=hadoop.apache.org@hadoop.apache.org>
X-Original-To: apmail-hadoop-common-dev-archive@www.apache.org
Delivered-To: apmail-hadoop-common-dev-archive@www.apache.org
Received: from mail.apache.org (hermes.apache.org [140.211.11.3])
by minotaur.apache.org (Postfix) with SMTP id 814BD919C
for <apmail-hadoop-common-dev-archive@www.apache.org>; Sat, 11 Feb 2012 22:03:48 +0000 (UTC)
Received: (qmail 56164 invoked by uid 500); 11 Feb 2012 22:03:46 -0000
Delivered-To: apmail-hadoop-common-dev-archive@hadoop.apache.org
Received: (qmail 55988 invoked by uid 500); 11 Feb 2012 22:03:45 -0000
Mailing-List: contact common-dev-help@hadoop.apache.org; run by ezmlm
Precedence: bulk
List-Help: <mailto:common-dev-help@hadoop.apache.org>
List-Unsubscribe: <mailto:common-dev-unsubscribe@hadoop.apache.org>
List-Post: <mailto:common-dev@hadoop.apache.org>
List-Id: <common-dev.hadoop.apache.org>
Reply-To: common-dev@hadoop.apache.org
Delivered-To: mailing list common-dev@hadoop.apache.org
Received: (qmail 55980 invoked by uid 500); 11 Feb 2012 22:03:45 -0000
Delivered-To: apmail-hadoop-core-dev@hadoop.apache.org
Received: (qmail 55977 invoked by uid 99); 11 Feb 2012 22:03:45 -0000
Received: from nike.apache.org (HELO nike.apache.org) (192.87.106.230)
by apache.org (qpsmtpd/0.29) with ESMTP; Sat, 11 Feb 2012 22:03:45 +0000
X-ASF-Spam-Status: No, hits=1.2 required=5.0
tests=FORGED_HOTMAIL_RCVD2,SPF_PASS
X-Spam-Check-By: apache.org
Received-SPF: pass (nike.apache.org: domain of lists@nabble.com designates 216.139.236.26 as permitted sender)
Received: from [216.139.236.26] (HELO sam.nabble.com) (216.139.236.26)
by apache.org (qpsmtpd/0.29) with ESMTP; Sat, 11 Feb 2012 22:03:38 +0000
Received: from isper.nabble.com ([192.168.236.156])
by sam.nabble.com with esmtp (Exim 4.72)
(envelope-from <lists@nabble.com>)
id 1RwL2L-0006Vz-In
for core-dev@hadoop.apache.org; Sat, 11 Feb 2012 14:03:17 -0800
Message-ID: <33307961.post@talk.nabble.com>
Date: Sat, 11 Feb 2012 14:03:17 -0800 (PST)
From: jem85 <the_rome@hotmail.com>
To: core-dev@hadoop.apache.org
Subject: Hadoop Pipes WordCount Compilation Issues...
MIME-Version: 1.0
Content-Type: text/plain; charset=us-ascii
Content-Transfer-Encoding: 7bit
X-Nabble-From: the_rome@hotmail.com
X-Virus-Checked: Checked by ClamAV on apache.org
Hi, I am trying to execute Hadoop's WordCount using Pipes but have an issue
compiling it.
I get the following error:
Undefined symbols:
"HadoopUtils::toString(int)", referenced from:
WordCountReducer::reduce(HadoopPipes::ReduceContext&) in
ccYJiEZw.o
WordCountMapper::map(HadoopPipes::MapContext&) in ccYJiEZw.o
"HadoopUtils::splitString(std::basic_string<char, std::char_traits<char>,
std::allocator<char> > const&, char const*)", referenced from:
WordCountMapper::map(HadoopPipes::MapContext&) in ccYJiEZw.o
"HadoopUtils::toInt(std::basic_string<char, std::char_traits<char>,
std::allocator<char> > const&)", referenced from:
WordCountReducer::reduce(HadoopPipes::ReduceContext&) in
ccYJiEZw.o
"HadoopPipes::runTask(HadoopPipes::Factory const&)", referenced from:
_main in ccYJiEZw.o
ld: symbol(s) not found
collect2: ld returned 1 exit status
make: *** [WordCountC] Error 1
Any help would be greatly appreciated!
--
View this message in context: http://old.nabble.com/Hadoop-Pipes-WordCount-Compilation-Issues...-tp33307961p33307961.html
Sent from the Hadoop core-dev mailing list archive at Nabble.com.
From common-dev-return-77692-apmail-hadoop-common-dev-archive=hadoop.apache.org@hadoop.apache.org Sun Feb 12 00:01:53 2012
Return-Path: <common-dev-return-77692-apmail-hadoop-common-dev-archive=hadoop.apache.org@hadoop.apache.org>
X-Original-To: apmail-hadoop-common-dev-archive@www.apache.org
Delivered-To: apmail-hadoop-common-dev-archive@www.apache.org
Received: from mail.apache.org (hermes.apache.org [140.211.11.3])
by minotaur.apache.org (Postfix) with SMTP id D53B4987D
for <apmail-hadoop-common-dev-archive@www.apache.org>; Sun, 12 Feb 2012 00:01:53 +0000 (UTC)
Received: (qmail 37280 invoked by uid 500); 12 Feb 2012 00:01:52 -0000
Delivered-To: apmail-hadoop-common-dev-archive@hadoop.apache.org
Received: (qmail 37193 invoked by uid 500); 12 Feb 2012 00:01:51 -0000
Mailing-List: contact common-dev-help@hadoop.apache.org; run by ezmlm
Precedence: bulk
List-Help: <mailto:common-dev-help@hadoop.apache.org>
List-Unsubscribe: <mailto:common-dev-unsubscribe@hadoop.apache.org>
List-Post: <mailto:common-dev@hadoop.apache.org>
List-Id: <common-dev.hadoop.apache.org>
Reply-To: common-dev@hadoop.apache.org
Delivered-To: mailing list common-dev@hadoop.apache.org
Received: (qmail 37184 invoked by uid 99); 12 Feb 2012 00:01:51 -0000
Received: from nike.apache.org (HELO nike.apache.org) (192.87.106.230)
by apache.org (qpsmtpd/0.29) with ESMTP; Sun, 12 Feb 2012 00:01:51 +0000
X-ASF-Spam-Status: No, hits=-2000.0 required=5.0
tests=ALL_TRUSTED,T_RP_MATCHES_RCVD
X-Spam-Check-By: apache.org
Received: from [140.211.11.116] (HELO hel.zones.apache.org) (140.211.11.116)
by apache.org (qpsmtpd/0.29) with ESMTP; Sun, 12 Feb 2012 00:01:48 +0000
Received: from hel.zones.apache.org (hel.zones.apache.org [140.211.11.116])
by hel.zones.apache.org (Postfix) with ESMTP id 107811B11B1
for <common-dev@hadoop.apache.org>; Sun, 12 Feb 2012 00:01:28 +0000 (UTC)
Date: Sun, 12 Feb 2012 00:01:28 +0000 (UTC)
From: "Kihwal Lee (Created) (JIRA)" <jira@apache.org>
To: common-dev@hadoop.apache.org
Message-ID: <1185768810.28848.1329004888068.JavaMail.tomcat@hel.zones.apache.org>
Subject: [jira] [Created] (HADOOP-8060) Add a capability to use of
consistent checksums for append and copy
MIME-Version: 1.0
Content-Type: text/plain; charset=utf-8
Content-Transfer-Encoding: 7bit
X-JIRA-FingerPrint: 30527f35849b9dde25b450d4833f0394
X-Virus-Checked: Checked by ClamAV on apache.org
Add a capability to use of consistent checksums for append and copy
-------------------------------------------------------------------
Key: HADOOP-8060
URL: https://issues.apache.org/jira/browse/HADOOP-8060
Project: Hadoop Common
Issue Type: Bug
Components: fs, util
Affects Versions: 0.23.0, 0.24.0, 0.23.1
Reporter: Kihwal Lee
Assignee: Kihwal Lee
Fix For: 0.24.0, 0.23.2
After the improved CRC32C checksum feature became default, some of use cases involving data movement are no longer supported. For example, when running DistCp to copy from a file stored with the CRC32 checksum to a new cluster with the CRC32C set to default checksum, the final data integrity check fails because of mismatch in checksums.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
From common-dev-return-77693-apmail-hadoop-common-dev-archive=hadoop.apache.org@hadoop.apache.org Sun Feb 12 02:21:25 2012
Return-Path: <common-dev-return-77693-apmail-hadoop-common-dev-archive=hadoop.apache.org@hadoop.apache.org>
X-Original-To: apmail-hadoop-common-dev-archive@www.apache.org
Delivered-To: apmail-hadoop-common-dev-archive@www.apache.org
Received: from mail.apache.org (hermes.apache.org [140.211.11.3])
by minotaur.apache.org (Postfix) with SMTP id C264A9303
for <apmail-hadoop-common-dev-archive@www.apache.org>; Sun, 12 Feb 2012 02:21:25 +0000 (UTC)
Received: (qmail 11645 invoked by uid 500); 12 Feb 2012 02:21:24 -0000
Delivered-To: apmail-hadoop-common-dev-archive@hadoop.apache.org
Received: (qmail 11235 invoked by uid 500); 12 Feb 2012 02:21:22 -0000
Mailing-List: contact common-dev-help@hadoop.apache.org; run by ezmlm
Precedence: bulk
List-Help: <mailto:common-dev-help@hadoop.apache.org>
List-Unsubscribe: <mailto:common-dev-unsubscribe@hadoop.apache.org>
List-Post: <mailto:common-dev@hadoop.apache.org>
List-Id: <common-dev.hadoop.apache.org>
Reply-To: common-dev@hadoop.apache.org
Delivered-To: mailing list common-dev@hadoop.apache.org
Received: (qmail 11215 invoked by uid 99); 12 Feb 2012 02:21:22 -0000
Received: from nike.apache.org (HELO nike.apache.org) (192.87.106.230)
by apache.org (qpsmtpd/0.29) with ESMTP; Sun, 12 Feb 2012 02:21:22 +0000
X-ASF-Spam-Status: No, hits=-2000.0 required=5.0
tests=ALL_TRUSTED,T_RP_MATCHES_RCVD
X-Spam-Check-By: apache.org
Received: from [140.211.11.116] (HELO hel.zones.apache.org) (140.211.11.116)
by apache.org (qpsmtpd/0.29) with ESMTP; Sun, 12 Feb 2012 02:21:20 +0000
Received: from hel.zones.apache.org (hel.zones.apache.org [140.211.11.116])
by hel.zones.apache.org (Postfix) with ESMTP id 7BAB11B102E
for <common-dev@hadoop.apache.org>; Sun, 12 Feb 2012 02:20:59 +0000 (UTC)
Date: Sun, 12 Feb 2012 02:20:59 +0000 (UTC)
From: "Luke Lu (Created) (JIRA)" <jira@apache.org>
To: common-dev@hadoop.apache.org
Message-ID: <314264709.29027.1329013259507.JavaMail.tomcat@hel.zones.apache.org>
Subject: [jira] [Created] (HADOOP-8061) Back port trunk metrics2 changes to
1.x branch
MIME-Version: 1.0
Content-Type: text/plain; charset=utf-8
Content-Transfer-Encoding: 7bit
X-JIRA-FingerPrint: 30527f35849b9dde25b450d4833f0394
X-Virus-Checked: Checked by ClamAV on apache.org
Back port trunk metrics2 changes to 1.x branch
----------------------------------------------
Key: HADOOP-8061
URL: https://issues.apache.org/jira/browse/HADOOP-8061
Project: Hadoop Common
Issue Type: Improvement
Components: metrics
Affects Versions: 1.0.0
Reporter: Luke Lu
Assignee: Luke Lu
For hysterical raisins, metrics2 code in hadoop 1.x branch and trunk diverged. It looks like HBase needs to support both 1.x and 0.23+ for a while, hence the more urgent need to clean up the situation.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
From common-dev-return-77694-apmail-hadoop-common-dev-archive=hadoop.apache.org@hadoop.apache.org Sun Feb 12 17:41:26 2012
Return-Path: <common-dev-return-77694-apmail-hadoop-common-dev-archive=hadoop.apache.org@hadoop.apache.org>
X-Original-To: apmail-hadoop-common-dev-archive@www.apache.org
Delivered-To: apmail-hadoop-common-dev-archive@www.apache.org
Received: from mail.apache.org (hermes.apache.org [140.211.11.3])
by minotaur.apache.org (Postfix) with SMTP id 9FCA895E0
for <apmail-hadoop-common-dev-archive@www.apache.org>; Sun, 12 Feb 2012 17:41:26 +0000 (UTC)
Received: (qmail 14560 invoked by uid 500); 12 Feb 2012 17:41:24 -0000
Delivered-To: apmail-hadoop-common-dev-archive@hadoop.apache.org
Received: (qmail 13945 invoked by uid 500); 12 Feb 2012 17:41:23 -0000
Mailing-List: contact common-dev-help@hadoop.apache.org; run by ezmlm
Precedence: bulk
List-Help: <mailto:common-dev-help@hadoop.apache.org>
List-Unsubscribe: <mailto:common-dev-unsubscribe@hadoop.apache.org>
List-Post: <mailto:common-dev@hadoop.apache.org>
List-Id: <common-dev.hadoop.apache.org>
Reply-To: common-dev@hadoop.apache.org
Delivered-To: mailing list common-dev@hadoop.apache.org
Received: (qmail 13925 invoked by uid 99); 12 Feb 2012 17:41:22 -0000
Received: from nike.apache.org (HELO nike.apache.org) (192.87.106.230)
by apache.org (qpsmtpd/0.29) with ESMTP; Sun, 12 Feb 2012 17:41:22 +0000
X-ASF-Spam-Status: No, hits=-2000.0 required=5.0
tests=ALL_TRUSTED,T_RP_MATCHES_RCVD
X-Spam-Check-By: apache.org
Received: from [140.211.11.116] (HELO hel.zones.apache.org) (140.211.11.116)
by apache.org (qpsmtpd/0.29) with ESMTP; Sun, 12 Feb 2012 17:41:20 +0000
Received: from hel.zones.apache.org (hel.zones.apache.org [140.211.11.116])
by hel.zones.apache.org (Postfix) with ESMTP id 7F3781B295D
for <common-dev@hadoop.apache.org>; Sun, 12 Feb 2012 17:40:59 +0000 (UTC)
Date: Sun, 12 Feb 2012 17:40:59 +0000 (UTC)
From: "Harsh J (Created) (JIRA)" <jira@apache.org>
To: common-dev@hadoop.apache.org
Message-ID: <1800084241.29711.1329068459522.JavaMail.tomcat@hel.zones.apache.org>
Subject: [jira] [Created] (HADOOP-8062) Incorrect registrant on the Apache
Hadoop mailing list is causing a lot of delivery failure return mails
MIME-Version: 1.0
Content-Type: text/plain; charset=utf-8
Content-Transfer-Encoding: 7bit
X-JIRA-FingerPrint: 30527f35849b9dde25b450d4833f0394
X-Virus-Checked: Checked by ClamAV on apache.org
Incorrect registrant on the Apache Hadoop mailing list is causing a lot of delivery failure return mails
--------------------------------------------------------------------------------------------------------
Key: HADOOP-8062
URL: https://issues.apache.org/jira/browse/HADOOP-8062
Project: Hadoop Common
Issue Type: Task
Reporter: Harsh J
Priority: Trivial
Unsure who has moderation/admin access to mailing list subscriptions for Apache Hadoop but the following address somehow got registered but is not useful for the mailer:
bq. "NOTES:Stanislav_Seltser/SSP/SUNGARD%SSP-Bedford"@sas.sungardrs.com
Failure mail that comes for every mail the mailer sends:
{code}
Your message
Subject: Re: Hadoop Terasort Error- "File _partition.lst does not exist"
was not delivered to:
"NOTES:Stanislav_Seltser/SSP/SUNGARD%SSP-Bedford"@sas.sungardrs.com
because:
The message could not be delivered because the recipient's destination email system is unknown or invalid. Please check the address and try again, or contact your system administrator to verify connectivity to the email system of the recipient. [MAPI Reason Code: 0, MAPI Diagnostic Code 48]
Final-Recipient: rfc822;"NOTES:Stanislav_Seltser/SSP/SUNGARD%SSP-Bedford"@sas.sungardrs.com
Action: failed
Status: 5.0.0
Diagnostic-Code: X-Notes;The message could not be delivered because the recipient's destination email system is unknown or invalid. Please check the address and try again, or contact your system administrator to verify connectivity to the email system of
---------- Forwarded message ----------
From: <harsh cloudera.com>
To: <common-user@hadoop.apache.org>
Cc:
Date: Wed, 25 Jan 2012 01:10:21 -0500
Subject: Re: Hadoop Terasort Error- "File _partition.lst does not exist"
Apparently, you are running terasort with a local job runner as
explained by the presence of "org.apache.hadoop.fs.RawLocalFileSystem"
and "LocalJobRunner" in your provided log message.
{code}
If this is the wrong place to report this, please do help moving it to right section -- INFRA?
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
From common-dev-return-77695-apmail-hadoop-common-dev-archive=hadoop.apache.org@hadoop.apache.org Sun Feb 12 20:33:44 2012
Return-Path: <common-dev-return-77695-apmail-hadoop-common-dev-archive=hadoop.apache.org@hadoop.apache.org>
X-Original-To: apmail-hadoop-common-dev-archive@www.apache.org
Delivered-To: apmail-hadoop-common-dev-archive@www.apache.org
Received: from mail.apache.org (hermes.apache.org [140.211.11.3])
by minotaur.apache.org (Postfix) with SMTP id CEEC89CBB
for <apmail-hadoop-common-dev-archive@www.apache.org>; Sun, 12 Feb 2012 20:33:44 +0000 (UTC)
Received: (qmail 64222 invoked by uid 500); 12 Feb 2012 20:33:43 -0000
Delivered-To: apmail-hadoop-common-dev-archive@hadoop.apache.org
Received: (qmail 63799 invoked by uid 500); 12 Feb 2012 20:33:42 -0000
Mailing-List: contact common-dev-help@hadoop.apache.org; run by ezmlm
Precedence: bulk
List-Help: <mailto:common-dev-help@hadoop.apache.org>
List-Unsubscribe: <mailto:common-dev-unsubscribe@hadoop.apache.org>
List-Post: <mailto:common-dev@hadoop.apache.org>
List-Id: <common-dev.hadoop.apache.org>
Reply-To: common-dev@hadoop.apache.org
Delivered-To: mailing list common-dev@hadoop.apache.org
Received: (qmail 63791 invoked by uid 99); 12 Feb 2012 20:33:42 -0000
Received: from athena.apache.org (HELO athena.apache.org) (140.211.11.136)
by apache.org (qpsmtpd/0.29) with ESMTP; Sun, 12 Feb 2012 20:33:42 +0000
X-ASF-Spam-Status: No, hits=1.5 required=5.0
tests=HTML_MESSAGE,RCVD_IN_DNSWL_LOW,SPF_PASS
X-Spam-Check-By: apache.org
Received-SPF: pass (athena.apache.org: domain of bautin.mailing.lists@gmail.com designates 209.85.160.48 as permitted sender)
Received: from [209.85.160.48] (HELO mail-pw0-f48.google.com) (209.85.160.48)
by apache.org (qpsmtpd/0.29) with ESMTP; Sun, 12 Feb 2012 20:33:35 +0000
Received: by pbcuo1 with SMTP id uo1so4588359pbc.35
for <common-dev@hadoop.apache.org>; Sun, 12 Feb 2012 12:33:15 -0800 (PST)
DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed;
d=gmail.com; s=gamma;
h=mime-version:date:message-id:subject:from:to:content-type;
bh=hXDf3uJuNhed3O0g5QQRxhf8AsVzjeERpUHbG8cPeiw=;
b=E+8XPG6CTwPqhS15Z8EWfIvquYqS3k0o+2esVG2+e0GOswAE0VQLqJPzVBpM7EeXyn
qML0zmoQYT4qk3ZCVfGqW0Ztek+3rXRlNtfu8dTBtnl4ujBOcP0UQkuwBDdxcV2a/PQu
v3bRf6+y5aQ+vUtJJBXUvxC99aI4uYBat1hOQ=
MIME-Version: 1.0
Received: by 10.68.217.41 with SMTP id ov9mr40571572pbc.82.1329078795496; Sun,
12 Feb 2012 12:33:15 -0800 (PST)
Received: by 10.142.122.4 with HTTP; Sun, 12 Feb 2012 12:33:15 -0800 (PST)
Date: Sun, 12 Feb 2012 12:33:15 -0800
Message-ID: <CAF63A-ZEL1yBQMEQsX7aV9rWD4JVUniaW4RsWZ8+jqvh_3oMXg@mail.gmail.com>
Subject: Apache Jenkins is down
From: Mikhail Bautin <bautin.mailing.lists@gmail.com>
To: common-dev@hadoop.apache.org
Content-Type: multipart/alternative; boundary=e89a8ff244137bebb704b8ca4586
--e89a8ff244137bebb704b8ca4586
Content-Type: text/plain; charset=ISO-8859-1
Hello Everyone,
Does anyone know why Apache Jenkins has been down for about a day? We rely
on the continuous integration server extensively to test HBase patches. Any
help with this would be appreciated.
Sincerely,
--Mikhail
--e89a8ff244137bebb704b8ca4586--
From common-dev-return-77696-apmail-hadoop-common-dev-archive=hadoop.apache.org@hadoop.apache.org Mon Feb 13 06:03:43 2012
Return-Path: <common-dev-return-77696-apmail-hadoop-common-dev-archive=hadoop.apache.org@hadoop.apache.org>
X-Original-To: apmail-hadoop-common-dev-archive@www.apache.org
Delivered-To: apmail-hadoop-common-dev-archive@www.apache.org
Received: from mail.apache.org (hermes.apache.org [140.211.11.3])
by minotaur.apache.org (Postfix) with SMTP id 56EF59C78
for <apmail-hadoop-common-dev-archive@www.apache.org>; Mon, 13 Feb 2012 06:03:43 +0000 (UTC)
Received: (qmail 14396 invoked by uid 500); 13 Feb 2012 06:03:41 -0000
Delivered-To: apmail-hadoop-common-dev-archive@hadoop.apache.org
Received: (qmail 14122 invoked by uid 500); 13 Feb 2012 06:03:19 -0000
Mailing-List: contact common-dev-help@hadoop.apache.org; run by ezmlm
Precedence: bulk
List-Help: <mailto:common-dev-help@hadoop.apache.org>
List-Unsubscribe: <mailto:common-dev-unsubscribe@hadoop.apache.org>
List-Post: <mailto:common-dev@hadoop.apache.org>
List-Id: <common-dev.hadoop.apache.org>
Reply-To: common-dev@hadoop.apache.org
Delivered-To: mailing list common-dev@hadoop.apache.org
Received: (qmail 14114 invoked by uid 99); 13 Feb 2012 06:03:15 -0000
Received: from athena.apache.org (HELO athena.apache.org) (140.211.11.136)
by apache.org (qpsmtpd/0.29) with ESMTP; Mon, 13 Feb 2012 06:03:15 +0000
X-ASF-Spam-Status: No, hits=-0.7 required=5.0
tests=RCVD_IN_DNSWL_LOW,SPF_PASS
X-Spam-Check-By: apache.org
Received-SPF: pass (athena.apache.org: domain of shaposhnik@gmail.com designates 209.85.214.48 as permitted sender)
Received: from [209.85.214.48] (HELO mail-bk0-f48.google.com) (209.85.214.48)
by apache.org (qpsmtpd/0.29) with ESMTP; Mon, 13 Feb 2012 06:03:08 +0000
Received: by bkcjm1 with SMTP id jm1so5015941bkc.35
for <common-dev@hadoop.apache.org>; Sun, 12 Feb 2012 22:02:47 -0800 (PST)
DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed;
d=gmail.com; s=gamma;
h=mime-version:sender:in-reply-to:references:date
:x-google-sender-auth:message-id:subject:from:to:content-type;
bh=fuT2fz3VblrQIvUbnEmV7bgMtR/hOgo3u33uNNZ2hMg=;
b=uSwnxoH0KnUzD0Bbz4RAHDdR8AVbj5uDI74Umf9dLi8WxTDrdj1GXE6ixU7WSnNbEX
MLv/o7vWTQBO46nhSq3x/sPtMEKc3dm4q6XiFHUWiuKALQw9sD+ad5q/X6/LfVnNR4fY
ynpJmEgjgTjUnGqiJM/w0RaYEvEqB5Q4NinHw=
MIME-Version: 1.0
Received: by 10.204.173.11 with SMTP id n11mr6522048bkz.120.1329112967488;
Sun, 12 Feb 2012 22:02:47 -0800 (PST)
Sender: shaposhnik@gmail.com
Received: by 10.204.78.135 with HTTP; Sun, 12 Feb 2012 22:02:47 -0800 (PST)
In-Reply-To: <CAF63A-ZEL1yBQMEQsX7aV9rWD4JVUniaW4RsWZ8+jqvh_3oMXg@mail.gmail.com>
References: <CAF63A-ZEL1yBQMEQsX7aV9rWD4JVUniaW4RsWZ8+jqvh_3oMXg@mail.gmail.com>
Date: Sun, 12 Feb 2012 22:02:47 -0800
X-Google-Sender-Auth: EQ3h3mBy-lxCizDRxWrkgMKYgFI
Message-ID: <CA+ULb+t6CitS57EfA7yUE3PX-xuBefdFoaz5mOMce+YRqV7XpA@mail.gmail.com>
Subject: Re: Apache Jenkins is down
From: Roman Shaposhnik <rvs@apache.org>
To: common-dev@hadoop.apache.org
Content-Type: text/plain; charset=ISO-8859-1
On Sun, Feb 12, 2012 at 12:33 PM, Mikhail Bautin
<bautin.mailing.lists@gmail.com> wrote:
> Hello Everyone,
>
> Does anyone know why Apache Jenkins has been down for about a day? We rely
> on the continuous integration server extensively to test HBase patches. Any
> help with this would be appreciated.
For issues like these it always helps to file an INFRA Jira.
Thanks,
Roman.
From common-dev-return-77697-apmail-hadoop-common-dev-archive=hadoop.apache.org@hadoop.apache.org Mon Feb 13 08:47:33 2012
Return-Path: <common-dev-return-77697-apmail-hadoop-common-dev-archive=hadoop.apache.org@hadoop.apache.org>
X-Original-To: apmail-hadoop-common-dev-archive@www.apache.org
Delivered-To: apmail-hadoop-common-dev-archive@www.apache.org
Received: from mail.apache.org (hermes.apache.org [140.211.11.3])
by minotaur.apache.org (Postfix) with SMTP id 8092C9C45
for <apmail-hadoop-common-dev-archive@www.apache.org>; Mon, 13 Feb 2012 08:47:33 +0000 (UTC)
Received: (qmail 65182 invoked by uid 500); 13 Feb 2012 08:47:29 -0000
Delivered-To: apmail-hadoop-common-dev-archive@hadoop.apache.org
Received: (qmail 63771 invoked by uid 500); 13 Feb 2012 08:47:17 -0000
Mailing-List: contact common-dev-help@hadoop.apache.org; run by ezmlm
Precedence: bulk
List-Help: <mailto:common-dev-help@hadoop.apache.org>
List-Unsubscribe: <mailto:common-dev-unsubscribe@hadoop.apache.org>
List-Post: <mailto:common-dev@hadoop.apache.org>
List-Id: <common-dev.hadoop.apache.org>
Reply-To: common-dev@hadoop.apache.org
Delivered-To: mailing list common-dev@hadoop.apache.org
Received: (qmail 63750 invoked by uid 99); 13 Feb 2012 08:47:11 -0000
Received: from athena.apache.org (HELO athena.apache.org) (140.211.11.136)
by apache.org (qpsmtpd/0.29) with ESMTP; Mon, 13 Feb 2012 08:47:11 +0000
X-ASF-Spam-Status: No, hits=2.2 required=5.0
tests=HTML_MESSAGE,SPF_PASS
X-Spam-Check-By: apache.org
Received-SPF: pass (athena.apache.org: local policy)
Received: from [192.135.10.48] (HELO smtp.ba.infn.it) (192.135.10.48)
by apache.org (qpsmtpd/0.29) with ESMTP; Mon, 13 Feb 2012 08:47:02 +0000
Received: from [193.206.185.246] (giovanni.ba.infn.it [193.206.185.246])
(using TLSv1 with cipher DHE-RSA-AES256-SHA (256/256 bits))
(Client did not present a certificate)
by smtp.ba.infn.it (Postfix) with ESMTPSA id A9C7951443
for <common-dev@hadoop.apache.org>; Mon, 13 Feb 2012 09:46:40 +0100 (CET)
Message-ID: <4F38CDF1.1030401@ba.infn.it>
Date: Mon, 13 Feb 2012 09:46:41 +0100
From: Giovanni Marzulli <giovanni.marzulli@ba.infn.it>
User-Agent: Mozilla/5.0 (X11; Linux x86_64; rv:9.0) Gecko/20111229 Thunderbird/9.0
MIME-Version: 1.0
To: common-dev@hadoop.apache.org
Subject: Writing failure test. Client and datanode on the same machine.
Content-Type: multipart/alternative;
boundary="------------070602050601020101060906"
--------------070602050601020101060906
Content-Type: text/plain; charset=ISO-8859-15; format=flowed
Content-Transfer-Encoding: 7bit
Hi,
I'm testing HDFS (0.20.203) on my cluster.
Particularly, I'm conducting writing tests while a datanode is down, but
not yet marked dead by namenode.
If I write a file by client on the same machine where datanode process
was killed, the task fails and these logs are printed:
/...INFO hdfs.DFSClient: Exception in createBlockOutputStream
java.net.ConnectException: Connection refused... /(for every retries)/
/Inoticed that client insists on writing on local datanode exhausting
all retries (dfs.client.write.block.retries is set to 100) until writing
aborts!
Is this correct behavior? After N failed retries, it shouldn't contact
another datanode to avoid writing abort?
Thanks
Gianni
--------------070602050601020101060906--
From common-dev-return-77698-apmail-hadoop-common-dev-archive=hadoop.apache.org@hadoop.apache.org Mon Feb 13 09:01:42 2012
Return-Path: <common-dev-return-77698-apmail-hadoop-common-dev-archive=hadoop.apache.org@hadoop.apache.org>
X-Original-To: apmail-hadoop-common-dev-archive@www.apache.org
Delivered-To: apmail-hadoop-common-dev-archive@www.apache.org
Received: from mail.apache.org (hermes.apache.org [140.211.11.3])
by minotaur.apache.org (Postfix) with SMTP id 4049E90B8
for <apmail-hadoop-common-dev-archive@www.apache.org>; Mon, 13 Feb 2012 09:01:42 +0000 (UTC)
Received: (qmail 1944 invoked by uid 500); 13 Feb 2012 09:01:38 -0000
Delivered-To: apmail-hadoop-common-dev-archive@hadoop.apache.org
Received: (qmail 1093 invoked by uid 500); 13 Feb 2012 09:01:26 -0000
Mailing-List: contact common-dev-help@hadoop.apache.org; run by ezmlm
Precedence: bulk
List-Help: <mailto:common-dev-help@hadoop.apache.org>
List-Unsubscribe: <mailto:common-dev-unsubscribe@hadoop.apache.org>
List-Post: <mailto:common-dev@hadoop.apache.org>
List-Id: <common-dev.hadoop.apache.org>
Reply-To: common-dev@hadoop.apache.org
Delivered-To: mailing list common-dev@hadoop.apache.org
Received: (qmail 1069 invoked by uid 99); 13 Feb 2012 09:01:23 -0000
Received: from athena.apache.org (HELO athena.apache.org) (140.211.11.136)
by apache.org (qpsmtpd/0.29) with ESMTP; Mon, 13 Feb 2012 09:01:23 +0000
X-ASF-Spam-Status: No, hits=-2000.0 required=5.0
tests=ALL_TRUSTED,T_RP_MATCHES_RCVD
X-Spam-Check-By: apache.org
Received: from [140.211.11.116] (HELO hel.zones.apache.org) (140.211.11.116)
by apache.org (qpsmtpd/0.29) with ESMTP; Mon, 13 Feb 2012 09:01:21 +0000
Received: from hel.zones.apache.org (hel.zones.apache.org [140.211.11.116])
by hel.zones.apache.org (Postfix) with ESMTP id 69C181B3F47
for <common-dev@hadoop.apache.org>; Mon, 13 Feb 2012 09:01:01 +0000 (UTC)
Date: Mon, 13 Feb 2012 09:01:01 +0000 (UTC)
From: "sutao bian (Created) (JIRA)" <jira@apache.org>
To: common-dev@hadoop.apache.org
Message-ID: <554440942.31153.1329123661434.JavaMail.tomcat@hel.zones.apache.org>
Subject: [jira] [Created] (HADOOP-8063) Hadoop balancer will creart too many
threds will crash the balancer JVM
MIME-Version: 1.0
Content-Type: text/plain; charset=utf-8
Content-Transfer-Encoding: 7bit
X-JIRA-FingerPrint: 30527f35849b9dde25b450d4833f0394
Hadoop balancer will creart too many threds will crash the balancer JVM
-----------------------------------------------------------------------
Key: HADOOP-8063
URL: https://issues.apache.org/jira/browse/HADOOP-8063
Project: Hadoop Common
Issue Type: Bug
Environment: hadoop version
Hadoop 0.20.2
Subversion https://svn.apache.org/repos/asf/hadoop/common/branches/branch-0.20 -r 911707
Compiled by chrisdo on Fri Feb 19 08:07:34 UTC 2010
Reporter: sutao bian
The balancer process will create too many thread will more than the jvm and the jvm will crash.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
From common-dev-return-77699-apmail-hadoop-common-dev-archive=hadoop.apache.org@hadoop.apache.org Mon Feb 13 09:17:22 2012
Return-Path: <common-dev-return-77699-apmail-hadoop-common-dev-archive=hadoop.apache.org@hadoop.apache.org>
X-Original-To: apmail-hadoop-common-dev-archive@www.apache.org
Delivered-To: apmail-hadoop-common-dev-archive@www.apache.org
Received: from mail.apache.org (hermes.apache.org [140.211.11.3])
by minotaur.apache.org (Postfix) with SMTP id ED71495FB
for <apmail-hadoop-common-dev-archive@www.apache.org>; Mon, 13 Feb 2012 09:17:22 +0000 (UTC)
Received: (qmail 34153 invoked by uid 500); 13 Feb 2012 09:17:20 -0000
Delivered-To: apmail-hadoop-common-dev-archive@hadoop.apache.org
Received: (qmail 33792 invoked by uid 500); 13 Feb 2012 09:16:58 -0000
Mailing-List: contact common-dev-help@hadoop.apache.org; run by ezmlm
Precedence: bulk
List-Help: <mailto:common-dev-help@hadoop.apache.org>
List-Unsubscribe: <mailto:common-dev-unsubscribe@hadoop.apache.org>
List-Post: <mailto:common-dev@hadoop.apache.org>
List-Id: <common-dev.hadoop.apache.org>
Reply-To: common-dev@hadoop.apache.org
Delivered-To: mailing list common-dev@hadoop.apache.org
Received: (qmail 33782 invoked by uid 99); 13 Feb 2012 09:16:49 -0000
Received: from nike.apache.org (HELO nike.apache.org) (192.87.106.230)
by apache.org (qpsmtpd/0.29) with ESMTP; Mon, 13 Feb 2012 09:16:49 +0000
X-ASF-Spam-Status: No, hits=-2000.0 required=5.0
tests=ALL_TRUSTED
X-Spam-Check-By: apache.org
Received: from [140.211.11.8] (HELO aegis.apache.org) (140.211.11.8)
by apache.org (qpsmtpd/0.29) with ESMTP; Mon, 13 Feb 2012 09:16:43 +0000
Received: from aegis (localhost [127.0.0.1])
by aegis.apache.org (Postfix) with ESMTP id D5D26C0005
for <common-dev@hadoop.apache.org>; Mon, 13 Feb 2012 09:16:21 +0000 (UTC)
Date: Mon, 13 Feb 2012 09:16:21 +0000 (UTC)
From: Apache Jenkins Server <jenkins@builds.apache.org>
To: common-dev@hadoop.apache.org
Message-ID: <2137512221.571329124581860.JavaMail.hudson@aegis>
Subject: Build failed in Jenkins: Hadoop-Common-0.23-Build #163
MIME-Version: 1.0
Content-Type: text/plain; charset=UTF-8
Content-Transfer-Encoding: 7bit
X-Jenkins-Job: Hadoop-Common-0.23-Build
X-Jenkins-Result: FAILURE
X-Virus-Checked: Checked by ClamAV on apache.org
See <https://builds.apache.org/job/Hadoop-Common-0.23-Build/163/changes>
Changes:
[mahadev] MAPREDUCE-3852. Test TestLinuxResourceCalculatorPlugin failing. (Thomas Graves via mahadev) - Merging r1243418 from trunk.
[mattf] HADOOP-8052. Hadoop Metrics2 should emit Float.MAX_VALUE (instead of Double.MAX_VALUE) to avoid making Ganglia's gmetad core. Contributed by Varun Kapoor.
[harsh] HDFS-2869. svn merge -c 1243104 from trunk
[harsh] Amend HADOOP-8055. Placed changes log in a released section, corrected to 0.23.2. (harsh)
[harsh] HADOOP-8055. svn merge -c 1243065 from trunk
------------------------------------------
[...truncated 12107 lines...]
[javadoc] [loading sun/security/krb5/Credentials.class(sun/security/krb5:Credentials.class)]
[javadoc] [loading sun/security/krb5/PrincipalName.class(sun/security/krb5:PrincipalName.class)]
[javadoc] [loading sun/security/krb5/Config.class(sun/security/krb5:Config.class)]
[javadoc] [loading sun/security/krb5/KrbException.class(sun/security/krb5:KrbException.class)]
[javadoc] [loading javax/security/auth/login/Configuration.class(javax/security/auth/login:Configuration.class)]
[javadoc] [loading org/apache/hadoop/security/authentication/server/AuthenticationFilter.class(org/apache/hadoop/security/authentication/server:AuthenticationFilter.class)]
[javadoc] [loading org/apache/avro/reflect/Nullable.class(org/apache/avro/reflect:Nullable.class)]
[javadoc] [loading java/lang/Package.class(java/lang:Package.class)]
[javadoc] [loading java/text/DecimalFormat.class(java/text:DecimalFormat.class)]
[javadoc] [loading java/text/NumberFormat.class(java/text:NumberFormat.class)]
[javadoc] [loading java/util/jar/JarFile.class(java/util/jar:JarFile.class)]
[javadoc] [loading java/util/jar/JarEntry.class(java/util/jar:JarEntry.class)]
[javadoc] [loading java/util/jar/Manifest.class(java/util/jar:Manifest.class)]
[javadoc] [loading java/util/concurrent/ThreadFactory.class(java/util/concurrent:ThreadFactory.class)]
[javadoc] [loading java/lang/ThreadGroup.class(java/lang:ThreadGroup.class)]
[javadoc] [loading org/apache/commons/cli/CommandLine.class(org/apache/commons/cli:CommandLine.class)]
[javadoc] [loading org/apache/commons/cli/CommandLineParser.class(org/apache/commons/cli:CommandLineParser.class)]
[javadoc] [loading org/apache/commons/cli/GnuParser.class(org/apache/commons/cli:GnuParser.class)]
[javadoc] [loading org/apache/commons/cli/HelpFormatter.class(org/apache/commons/cli:HelpFormatter.class)]
[javadoc] [loading org/apache/commons/cli/Option.class(org/apache/commons/cli:Option.class)]
[javadoc] [loading org/apache/commons/cli/OptionBuilder.class(org/apache/commons/cli:OptionBuilder.class)]
[javadoc] [loading org/apache/commons/cli/Options.class(org/apache/commons/cli:Options.class)]
[javadoc] [loading org/apache/commons/cli/ParseException.class(org/apache/commons/cli:ParseException.class)]
[javadoc] [loading javax/xml/transform/TransformerConfigurationException.class(javax/xml/transform:TransformerConfigurationException.class)]
[javadoc] [loading java/lang/SecurityException.class(java/lang:SecurityException.class)]
[javadoc] [loading java/lang/NoSuchMethodException.class(java/lang:NoSuchMethodException.class)]
[javadoc] [loading java/util/Calendar.class(java/util:Calendar.class)]
[javadoc] [loading org/apache/commons/httpclient/URIException.class(org/apache/commons/httpclient:URIException.class)]
[javadoc] [loading org/apache/commons/httpclient/util/URIUtil.class(org/apache/commons/httpclient/util:URIUtil.class)]
[javadoc] [loading java/lang/Override.class(java/lang:Override.class)]
[javadoc] [loading com/google/common/annotations/GwtCompatible.class(com/google/common/annotations:GwtCompatible.class)]
[javadoc] [loading com/google/common/annotations/GwtIncompatible.class(com/google/common/annotations:GwtIncompatible.class)]
[javadoc] [loading <https://builds.apache.org/job/Hadoop-Common-0.23-Build/ws/trunk/hadoop-common-project/hadoop-common/target/classes/org/apache/hadoop/package-info.class]>
[javadoc] [loading <https://builds.apache.org/job/Hadoop-Common-0.23-Build/ws/trunk/hadoop-common-project/hadoop-common/target/classes/org/apache/hadoop/conf/Configuration$1.class]>
[javadoc] [loading <https://builds.apache.org/job/Hadoop-Common-0.23-Build/ws/trunk/hadoop-common-project/hadoop-common/target/classes/org/apache/hadoop/fs/FileContext$25.class]>
[javadoc] [loading <https://builds.apache.org/job/Hadoop-Common-0.23-Build/ws/trunk/hadoop-common-project/hadoop-common/target/classes/org/apache/hadoop/fs/FileContext$12.class]>
[javadoc] [loading /home/jenkins/jenkins-slave/workspace
[javadoc] /Hadoop-Common-0.23-Build/trunk/hadoop-common-project/hadoop-common/target/classes/org/apache/hadoop/fs/FileContext$5.class]
[javadoc] [loading <https://builds.apache.org/job/Hadoop-Common-0.23-Build/ws/trunk/hadoop-common-project/hadoop-common/target/classes/org/apache/hadoop/fs/FileContext$6.class]>
[javadoc] [loading <https://builds.apache.org/job/Hadoop-Common-0.23-Build/ws/trunk/hadoop-common-project/hadoop-common/target/classes/org/apache/hadoop/fs/FileContext$21.class]>
[javadoc] [loading <https://builds.apache.org/job/Hadoop-Common-0.23-Build/ws/trunk/hadoop-common-project/hadoop-common/target/classes/org/apache/hadoop/fs/FileContext$24.class]>
[javadoc] [loading <https://builds.apache.org/job/Hadoop-Common-0.23-Build/ws/trunk/hadoop-common-project/hadoop-common/target/classes/org/apache/hadoop/fs/GlobFilter$1.class]>
[javadoc] [loading <https://builds.apache.org/job/Hadoop-Common-0.23-Build/ws/trunk/hadoop-common-project/hadoop-common/target/classes/org/apache/hadoop/fs/FileContext$8.class]>
[javadoc] [loading <https://builds.apache.org/job/Hadoop-Common-0.23-Build/ws/trunk/hadoop-common-project/hadoop-common/target/classes/org/apache/hadoop/fs/FileSystem$3.class]>
[javadoc] [loading <https://builds.apache.org/job/Hadoop-Common-0.23-Build/ws/trunk/hadoop-common-project/hadoop-common/target/classes/org/apache/hadoop/fs/FileContext$16.class]>
[javadoc] [loading <https://builds.apache.org/job/Hadoop-Common-0.23-Build/ws/trunk/hadoop-common-project/hadoop-common/target/classes/org/apache/hadoop/fs/FileContext$3.class]>
[javadoc] [loading <https://builds.apache.org/job/Hadoop-Common-0.23-Build/ws/trunk/hadoop-common-project/hadoop-common/target/classes/org/apache/hadoop/fs/FileContext$9.class]>
[javadoc] [loading <https://builds.apache.org/job/Hadoop-Common-0.23-Build/ws/trunk/hadoop-common-project/hadoop-common/target/classes/org/apache/hadoop/fs/FileContext$10.class]>
[javadoc] [loading <https://builds.apache.org/job/Hadoop-Common-0.23-Build/ws/trunk/hadoop-common-project/hadoop-common/target/classes/org/apache/hadoop/fs/FileContext$15.class]>
[javadoc] [loading <https://builds.apache.org/job/Hadoop-Common-0.23-Build/ws/trunk/hadoop-common-project/hadoop-common/target/classes/org/apache/hadoop/fs/FileContext$Util$1.class]>
[javadoc] [loading <https://builds.apache.org/job/Hadoop-Common-0.23-Build/ws/trunk/hadoop-common-project/hadoop-common/target/classes/org/apache/hadoop/fs/FileSystem$4.class]>
[javadoc] [loading <https://builds.apache.org/job/Hadoop-Common-0.23-Build/ws/trunk/hadoop-common-project/hadoop-common/target/classes/org/apache/hadoop/fs/ChecksumFileSystem$1.class]>
[javadoc] [loading <https://builds.apache.org/job/Hadoop-Common-0.23-Build/ws/trunk/hadoop-common-project/hadoop-common/target/classes/org/apache/hadoop/fs/FileContext$4.class]>
[javadoc] [loading <https://builds.apache.org/job/Hadoop-Common-0.23-Build/ws/trunk/hadoop-common-project/hadoop-common/target/classes/org/apache/hadoop/fs/FileContext$7.class]>
[javadoc] [loading <https://builds.apache.org/job/Hadoop-Common-0.23-Build/ws/trunk/hadoop-common-project/hadoop-common/target/classes/org/apache/hadoop/fs/FsServerDefaults$1.class]>
[javadoc] [loading <https://builds.apache.org/job/Hadoop-Common-0.23-Build/ws/trunk/hadoop-common-project/hadoop-common/target/classes/org/apache/hadoop/fs/FileContext$19.class]>
[javadoc] [loading <https://builds.apache.org/job/Hadoop-Common-0.23-Build/ws/trunk/hadoop-common-project/hadoop-common/target/classes/org/apache/hadoop/fs/FileContext$20.class]>
[javadoc] [loading <https://builds.apache.org/job/Hadoop-Common-0.23-Build/ws/trunk/hadoop-common-project/hadoop-common/target/classes/org/apache/hadoop/fs/FileContext$18.class]>
[javadoc] [loading <https://builds.apache.org/job/Hadoop-Common-0.23-Build/ws/trunk/hadoop-common-project/hadoop-common/target/classes/org/apache/hadoop/fs/FileContext$14.class]>
[javadoc] [loading <https://builds.apache.org/job/Hadoop-Common-0.23-Build/ws/trunk/hadoop-common-project/hadoop-common/target/classes/org/apache/hadoop/fs/BlockLocation$1.class]>
[javadoc] [loading <https://builds.apache.org/job/Hadoop-Common-0.23-Build/ws/trunk/hadoop-common-project/hadoop-common/target/classes/org/apache/hadoop/fs/FileContext$13.class]>
[javadoc] [loading <https://builds.apache.org/job/Hadoop-Common-0.23-Build/ws/trunk/hadoop-common-project/hadoop-common/target/classes/org/apache/hadoop/fs/FileSystem$2.class]>
[javadoc] [loading <https://builds.apache.org/job/Hadoop-Common-0.23-Build/ws/trunk/hadoop-common-project/hadoop-common/target/classes/org/apache/hadoop/fs/FileContext$22.class]>
[javadoc] [loading <https://builds.apache.org/job/Hadoop-Common-0.23-Build/ws/trunk/hadoop-common-project/hadoop-common/target/classes/org/apache/hadoop/fs/FileSystem$5.class]>
[javadoc] [loading <https://builds.apache.org/job/Hadoop-Common-0.23-Build/ws/trunk/hadoop-common-project/hadoop-common/target/classes/org/apache/hadoop/fs/LocalDirAllocator$1.class]>
[javadoc] [loading <https://builds.apache.org/job/Hadoop-Common-0.23-Build/ws/trunk/hadoop-common-project/hadoop-common/target/classes/org/apache/hadoop/fs/FileContext$11.class]>
[javadoc] [loading <https://builds.apache.org/job/Hadoop-Common-0.23-Build/ws/trunk/hadoop-common-project/hadoop-common/target/classes/org/apache/hadoop/fs/DF$1.class]>
[javadoc] [loading <https://builds.apache.org/job/Hadoop-Common-0.23-Build/ws/trunk/hadoop-common-project/hadoop-common/target/classes/org/apache/hadoop/fs/TrashPolicyDefault$1.class]>
[javadoc] [loading <https://builds.apache.org/job/Hadoop-Common-0.23-Build/ws/trunk/hadoop-common-project/hadoop-common/target/classes/org/apache/hadoop/fs/FileContext$1.class]>
[javadoc] [loading <https://builds.apache.org/job/Hadoop-Common-0.23-Build/ws/trunk/hadoop-common-project/hadoop-common/target/classes/org/apache/hadoop/fs/AbstractFileSystem$2.class]>
[javadoc] [loading <https://builds.apache.org/job/Hadoop-Common-0.23-Build/ws/trunk/hadoop-common-project/hadoop-common/target/classes/org/apache/hadoop/fs/FileContext$Util$2.class]>
[javadoc] [loading <https://builds.apache.org/job/Hadoop-Common-0.23-Build/ws/trunk/hadoop-common-project/hadoop-common/target/classes/org/apache/hadoop/fs/HardLink$1.class]>
[javadoc] [loading <https://builds.apache.org/job/Hadoop-Common-0.23-Build/ws/trunk/hadoop-common-project/hadoop-common/target/classes/org/apache/hadoop/fs/AbstractFileSystem$1.class]>
[javadoc] [loading <https://builds.apache.org/job/Hadoop-Common-0.23-Build/ws/trunk/hadoop-common-project/hadoop-common/target/classes/org/apache/hadoop/fs/FileContext$23.class]>
[javadoc] [loading <https://builds.apache.org/job/Hadoop-Common-0.23-Build/ws/trunk/hadoop-common-project/hadoop-common/target/classes/org/apache/hadoop/fs/RawLocalFileSystem$1.class]>
[javadoc] [loading <https://builds.apache.org/job/Hadoop-Common-0.23-Build/ws/trunk/hadoop-common-project/hadoop-common/target/classes/org/apache/hadoop/fs/FileContext$17.class]>
[javadoc] [loading <https://builds.apache.org/job/Hadoop-Common-0.23-Build/ws/trunk/hadoop-common-project/hadoop-common/target/classes/org/apache/hadoop/fs/FileSystem$1.class]>
[javadoc] [loading <https://builds.apache.org/job/Hadoop-Common-0.23-Build/ws/trunk/hadoop-common-project/hadoop-common/target/classes/org/apache/hadoop/fs/Options$1.class]>
[javadoc] [loading <https://builds.apache.org/job/Hadoop-Common-0.23-Build/ws/trunk/hadoop-common-project/hadoop-common/target/classes/org/apache/hadoop/fs/FileContext$2.class]>
[javadoc] [loading <https://builds.apache.org/job/Hadoop-Common-0.23-Build/ws/trunk/hadoop-common-project/hadoop-common/target/classes/org/apache/hadoop/fs/ftp/FTPFileSystem$1.class]>
[javadoc] [loading <https://builds.apache.org/job/Hadoop-Common-0.23-Build/ws/trunk/hadoop-common-project/hadoop-common/target/classes/org/apache/hadoop/fs/permission/PermissionStatus$2.class]>
[javadoc] [loading <https://builds.apache.org/job/Hadoop-Common-0.23-Build/ws/trunk/hadoop-common-project/hadoop-common/target/classes/org/apache/hadoop/fs/permission/PermissionStatus$1.class]>
[javadoc] [loading <https://builds.apache.org/job/Hadoop-Common-0.23-Build/ws/trunk/hadoop-common-project/hadoop-common/target/classes/org/apache/hadoop/fs/permission/FsPermission$1.class]>
[javadoc] [loading <https://builds.apache.org/job/Hadoop-Common-0.23-Build/ws/trunk/hadoop-common-project/hadoop-common/target/classes/org/apache/hadoop/fs/s3/INode$1.class]>
[javadoc] [loading <https://builds.apache.org/job/Hadoop-Common-0.23-Build/ws/trunk/hadoop-common-project/hadoJDiff>: finished (took 0s, not including scanning the source files).
[javadoc] op-common/target/classes/org/apache/hadoop/fs/viewfs/ViewFileSystem$1.class]
[javadoc] [loading <https://builds.apache.org/job/Hadoop-Common-0.23-Build/ws/trunk/hadoop-common-project/hadoop-common/target/classes/org/apache/hadoop/fs/viewfs/ViewFs$2.class]>
[javadoc] [loading <https://builds.apache.org/job/Hadoop-Common-0.23-Build/ws/trunk/hadoop-common-project/hadoop-common/target/classes/org/apache/hadoop/fs/viewfs/ViewFs$1.class]>
[javadoc] [loading <https://builds.apache.org/job/Hadoop-Common-0.23-Build/ws/trunk/hadoop-common-project/hadoop-common/target/classes/org/apache/hadoop/http/lib/StaticUserWebFilter$StaticUserFilter$1.class]>
[javadoc] [loading <https://builds.apache.org/job/Hadoop-Common-0.23-Build/ws/trunk/hadoop-common-project/hadoop-common/target/classes/org/apache/hadoop/io/UTF8$1.class]>
[javadoc] [loading <https://builds.apache.org/job/Hadoop-Common-0.23-Build/ws/trunk/hadoop-common-project/hadoop-common/target/classes/org/apache/hadoop/io/EnumSetWritable$1.class]>
[javadoc] [loading <https://builds.apache.org/job/Hadoop-Common-0.23-Build/ws/trunk/hadoop-common-project/hadoop-common/target/classes/org/apache/hadoop/io/Text$2.class]>
[javadoc] [loading <https://builds.apache.org/job/Hadoop-Common-0.23-Build/ws/trunk/hadoop-common-project/hadoop-common/target/classes/org/apache/hadoop/io/Text$1.class]>
[javadoc] [loading <https://builds.apache.org/job/Hadoop-Common-0.23-Build/ws/trunk/hadoop-common-project/hadoop-common/target/classes/org/apache/hadoop/io/ReadaheadPool$1.class]>
[javadoc] [loading <https://builds.apache.org/job/Hadoop-Common-0.23-Build/ws/trunk/hadoop-common-project/hadoop-common/target/classes/org/apache/hadoop/io/SequenceFile$1.class]>
[javadoc] [loading <https://builds.apache.org/job/Hadoop-Common-0.23-Build/ws/trunk/hadoop-common-project/hadoop-common/target/classes/org/apache/hadoop/io/FastByteComparisons$LexicographicalComparerHolder$UnsafeComparer$1.class]>
[javadoc] [loading <https://builds.apache.org/job/Hadoop-Common-0.23-Build/ws/trunk/hadoop-common-project/hadoop-common/target/classes/org/apache/hadoop/io/MD5Hash$1.class]>
[javadoc] [loading <https://builds.apache.org/job/Hadoop-Common-0.23-Build/ws/trunk/hadoop-common-project/hadoop-common/target/classes/org/apache/hadoop/io/DataInputByteBuffer$1.class]>
[javadoc] [loading <https://builds.apache.org/job/Hadoop-Common-0.23-Build/ws/trunk/hadoop-common-project/hadoop-common/target/classes/org/apache/hadoop/io/OutputBuffer$1.class]>
[javadoc] [loading <https://builds.apache.org/job/Hadoop-Common-0.23-Build/ws/trunk/hadoop-common-project/hadoop-common/target/classes/org/apache/hadoop/io/file/tfile/Compression$Algorithm$1.class]>
[javadoc] [loading <https://builds.apache.org/job/Hadoop-Common-0.23-Build/ws/trunk/hadoop-common-project/hadoop-common/target/classes/org/apache/hadoop/io/file/tfile/Compression$Algorithm$3.class]>
[javadoc] [loading <https://builds.apache.org/job/Hadoop-Common-0.23-Build/ws/trunk/hadoop-common-project/hadoop-common/target/classes/org/apache/hadoop/io/file/tfile/Compression$Algorithm$2.class]>
[javadoc] [loading <https://builds.apache.org/job/Hadoop-Common-0.23-Build/ws/trunk/hadoop-common-project/hadoop-common/target/classes/org/apache/hadoop/io/file/tfile/TFile$Reader$1.class]>
[javadoc] [loading <https://builds.apache.org/job/Hadoop-Common-0.23-Build/ws/trunk/hadoop-common-project/hadoop-common/target/classes/org/apache/hadoop/io/serializer/JavaSerialization$JavaSerializationSerializer$1.class]>
[javadoc] [loading <https://builds.apache.org/job/Hadoop-Common-0.23-Build/ws/trunk/hadoop-common-project/hadoop-common/target/classes/org/apache/hadoop/io/serializer/JavaSerialization$JavaSerializationDeserializer$1.class]>
[javadoc] [loading <https://builds.apache.org/job/Hadoop-Common-0.23-Build/ws/trunk/hadoop-common-project/hadoop-common/target/classes/org/apache/hadoop/log/metrics/EventCounter$1.class]>
[javadoc] [loading <https://builds.apache.org/job/Hadoop-Common-0.23-Build/ws/trunk/hadoop-common-project/hadoop-common/target/classes/org/apache/hadoop/metrics/spi/AbstractMetricsContext$1.class]>
[javadoc] [loading <https://builds.apache.org/job/Hadoop-Common-0.23-Build/ws/trunk/hadoop-common-project/hadoop-common/target/classes/org/apache/hadoop/metrics2/lib/Interns$CacheWith2Keys$2.class]>
[javadoc] [loading <https://builds.apache.org/job/Hadoop-Common-0.23-Build/ws/trunk/hadoop-common-project/hadoop-common/target/classes/org/apache/hadoop/metrics2/lib/Interns$1.class]>
[javadoc] [loading <https://builds.apache.org/job/Hadoop-Common-0.23-Build/ws/trunk/hadoop-common-project/hadoop-common/target/classes/org/apache/hadoop/metrics2/lib/Interns$CacheWith2Keys$1.class]>
[javadoc] [loading <https://builds.apache.org/job/Hadoop-Common-0.23-Build/ws/trunk/hadoop-common-project/hadoop-common/target/classes/org/apache/hadoop/metrics2/lib/MethodMetric$1.class]>
[javadoc] [loading <https://builds.apache.org/job/Hadoop-Common-0.23-Build/ws/trunk/hadoop-common-project/hadoop-common/target/classes/org/apache/hadoop/metrics2/lib/MetricsSourceBuilder$1.class]>
[javadoc] [loading <https://builds.apache.org/job/Hadoop-Common-0.23-Build/ws/trunk/hadoop-common-project/hadoop-common/target/classes/org/apache/hadoop/metrics2/lib/Interns$Tags$1.class]>
[javadoc] [loading <https://builds.apache.org/job/Hadoop-Common-0.23-Build/ws/trunk/hadoop-common-project/hadoop-common/target/classes/org/apache/hadoop/metrics2/lib/Interns$Info$1.class]>
[javadoc] [loading <https://builds.apache.org/job/Hadoop-Common-0.23-Build/ws/trunk/hadoop-common-project/hadoop-common/target/classes/org/apache/hadoop/metrics2/lib/MethodMetric$3.class]>
[javadoc] [loading <https://builds.apache.org/job/Hadoop-Common-0.23-Build/ws/trunk/hadoop-common-project/hadoop-common/target/classes/org/apache/hadoop/metrics2/lib/MethodMetric$2.class]>
[javadoc] [loading <https://builds.apache.org/job/Hadoop-Common-0.23-Build/ws/trunk/hadoop-common-project/hadoop-common/target/classes/org/apache/hadoop/metrics2/lib/MethodMetric$4.class]>
[javadoc] [loading <https://builds.apache.org/job/Hadoop-Common-0.23-Build/ws/trunk/hadoop-common-project/hadoop-common/target/classes/org/apache/hadoop/metrics2/sink/ganglia/AbstractGangliaSink$1.class]>
[javadoc] [loading <https://builds.apache.org/job/Hadoop-Common-0.23-Build/ws/trunk/hadoop-common-project/hadoop-common/target/classes/org/apache/hadoop/metrics2/source/JvmMetrics$1.class]>
[javadoc] [loading <https://builds.apache.org/job/Hadoop-Common-0.23-Build/ws/trunk/hadoop-common-project/hadoop-common/target/classes/org/apache/hadoop/net/SocketIOWithTimeout$1.class]>
[javadoc] [loading <https://builds.apache.org/job/Hadoop-Common-0.23-Build/ws/trunk/hadoop-common-project/hadoop-common/target/classes/org/apache/hadoop/record/BinaryRecordInput$1.class]>
[javadoc] [loading <https://builds.apache.org/job/Hadoop-Common-0.23-Build/ws/trunk/hadoop-common-project/hadoop-common/target/classes/org/apache/hadoop/record/BinaryRecordOutput$1.class]>
[javadoc] [loading <https://builds.apache.org/job/Hadoop-Common-0.23-Build/ws/trunk/hadoop-common-project/hadoop-common/target/classes/org/apache/hadoop/record/CsvRecordInput$1.class]>
[javadoc] [loading <https://builds.apache.org/job/Hadoop-Common-0.23-Build/ws/trunk/hadoop-common-project/hadoop-common/target/classes/org/apache/hadoop/record/XmlRecordInput$1.class]>
[javadoc] [loading <https://builds.apache.org/job/Hadoop-Common-0.23-Build/ws/trunk/hadoop-common-project/hadoop-common/target/classes/org/apache/hadoop/security/SaslRpcClient$1.class]>
[javadoc] [loading <https://builds.apache.org/job/Hadoop-Common-0.23-Build/ws/trunk/hadoop-common-project/hadoop-common/target/classes/org/apache/hadoop/security/Krb5AndCertsSslSocketConnector$Krb5SslFilter$1.class]>
[javadoc] [loading <https://builds.apache.org/job/Hadoop-Common-0.23-Build/ws/trunk/hadoop-common-project/hadoop-common/target/classes/org/apache/hadoop/security/UserGroupInformation$1.class]>
[javadoc] [loading <https://builds.apache.org/job/Hadoop-Common-0.23-Build/ws/trunk/hadoop-common-project/hadoop-common/target/classes/org/apache/hadoop/util/RunJar$1.class]>
[javadoc] [loading <https://builds.apache.org/job/Hadoop-Common-0.23-Build/ws/trunk/hadoop-common-project/hadoop-common/target/classes/org/apache/hadoop/util/ReflectionUtils$1.class]>
[javadoc] [loading <https://builds.apache.org/job/Hadoop-Common-0.23-Build/ws/trunk/hadoop-common-project/hadoop-common/target/classes/org/apache/hadoop/util/Shell$1.class]>
[javadoc] [loading <https://builds.apache.org/job/Hadoop-Common-0.23-Build/ws/trunk/hadoop-common-project/hadoop-common/target/classes/org/apache/hadoop/util/StringUtils$1.class]>
[javadoc] [loading <https://builds.apache.org/job/Hadoop-Common-0.23-Build/ws/trunk/hadoop-common-project/hadoop-common/target/classes/org/apache/hadoop/util/AsyncDiskService$1.class]>
[javadoc] [loading java/util/zip/CRC32.class(java/util/zip:CRC32.class)]
[javadoc] [done in 2569 ms]
[javadoc] 9 warnings
[javadoc] Generating Javadoc
[javadoc] Javadoc execution
[javadoc] javadoc: error - Illegal package name: ""
[javadoc] javadoc: error - File not found: "<https://builds.apache.org/job/Hadoop-Common-0.23-Build/ws/trunk/hadoop-common-project/hadoop-common/dev-support/jdiff/Null.java">
[javadoc] Loading source files for package org.apache.hadoop...
[javadoc] Loading source files for package org.apache.hadoop.conf...
[javadoc] Loading source files for package org.apache.hadoop.fs...
[javadoc] Loading source files for package org.apache.hadoop.fs.ftp...
[javadoc] Loading source files for package org.apache.hadoop.fs.kfs...
[javadoc] Loading source files for package org.apache.hadoop.fs.local...
[javadoc] Loading source files for package org.apache.hadoop.fs.permission...
[javadoc] Loading source files for package org.apache.hadoop.fs.s3...
[javadoc] Loading source files for package org.apache.hadoop.fs.s3native...
[javadoc] Loading source files for package org.apache.hadoop.fs.shell...
[javadoc] Loading source files for package org.apache.hadoop.fs.viewfs...
[javadoc] Loading source files for package org.apache.hadoop.http...
[javadoc] Loading source files for package org.apache.hadoop.http.lib...
[javadoc] Loading source files for package org.apache.hadoop.io...
[javadoc] Loading source files for package org.apache.hadoop.io.compress...
[javadoc] Loading source files for package org.apache.hadoop.io.compress.bzip2...
[javadoc] Loading source files for package org.apache.hadoop.io.compress.lz4...
[javadoc] Loading source files for package org.apache.hadoop.io.compress.snappy...
[javadoc] Loading source files for package org.apache.hadoop.io.compress.zlib...
[javadoc] Loading source files for package org.apache.hadoop.io.file.tfile...
[javadoc] Loading source files for package org.apache.hadoop.io.nativeio...
[javadoc] Loading source files for package org.apache.hadoop.io.retry...
[javadoc] Loading source files for package org.apache.hadoop.io.serializer...
[javadoc] Loading source files for package org.apache.hadoop.io.serializer.avro...
[javadoc] Loading source files for package org.apache.hadoop.ipc...
[javadoc] Loading source files for package org.apache.hadoop.ipc.metrics...
[javadoc] Loading source files for package org.apache.hadoop.jmx...
[javadoc] Loading source files for package org.apache.hadoop.log...
[javadoc] Loading source files for package org.apache.hadoop.log.metrics...
[javadoc] Loading source files for package org.apache.hadoop.metrics...
[javadoc] Loading source files for package org.apache.hadoop.metrics.file...
[javadoc] Loading source files for package org.apache.hadoop.metrics.ganglia...
[javadoc] Loading source files for package org.apache.hadoop.metrics.jvm...
[javadoc] Loading source files for package org.apache.hadoop.metrics.spi...
[javadoc] Loading source files for package org.apache.hadoop.metrics.util...
[javadoc] Loading source files for package org.apache.hadoop.metrics2...
[javadoc] Loading source files for package org.apache.hadoop.metrics2.annotation...
[javadoc] Loading source files for package org.apache.hadoop.metrics2.filter...
[javadoc] Loading source files for package org.apache.hadoop.metrics2.impl...
[javadoc] Loading source files for package org.apache.hadoop.metrics2.lib...
[javadoc] Loading source files for package org.apache.hadoop.metrics2.sink...
[javadoc] Loading source files for package org.apache.hadoop.metrics2.sink.ganglia...
[javadoc] Loading source files for package org.apache.hadoop.metrics2.source...
[javadoc] Loading source files for package org.apache.hadoop.metrics2.util...
[javadoc] Loading source files for package org.apache.hadoop.net...
[javadoc] Loading source files for package org.apache.hadoop.record...
[javadoc] Loading source files for package org.apache.hadoop.record.compiler...
[javadoc] Loading source files for package org.apache.hadoop.record.compiler.ant...
[javadoc] Loading source files for package org.apache.hadoop.record.compiler.generated...
[javadoc] Loading source files for package org.apache.hadoop.record.meta...
[javadoc] Loading source files for package org.apache.hadoop.security...
[javadoc] Loading source files for package org.apache.hadoop.security.authorize...
[javadoc] Loading source files for package org.apache.hadoop.security.token...
[javadoc] Loading source files for package org.apache.hadoop.security.token.delegation...
[javadoc] Loading source files for package org.apache.hadoop.tools...
[javadoc] Loading source files for package org.apache.hadoop.util...
[javadoc] Loading source files for package org.apache.hadoop.util.bloom...
[javadoc] Loading source files for package org.apache.hadoop.util.hash...
[javadoc] 2 errors
[INFO] ------------------------------------------------------------------------
[INFO] Reactor Summary:
[INFO]
[INFO] Apache Hadoop Annotations ......................... SUCCESS [16.729s]
[INFO] Apache Hadoop Auth ................................ SUCCESS [19.152s]
[INFO] Apache Hadoop Auth Examples ....................... SUCCESS [7.468s]
[INFO] Apache Hadoop Common .............................. FAILURE [1:06.764s]
[INFO] Apache Hadoop Common Project ...................... SKIPPED
[INFO] ------------------------------------------------------------------------
[INFO] BUILD FAILURE
[INFO] ------------------------------------------------------------------------
[INFO] Total time: 1:52.000s
[INFO] Finished at: Mon Feb 13 09:06:56 UTC 2012
[INFO] Final Memory: 71M/719M
[INFO] ------------------------------------------------------------------------
[ERROR] Failed to execute goal org.apache.maven.plugins:maven-antrun-plugin:1.6:run (site) on project hadoop-common: An Ant BuildException has occured: input file <https://builds.apache.org/job/Hadoop-Common-0.23-Build/ws/trunk/hadoop-common-project/hadoop-common/target/findbugsXml.xml> does not exist -> [Help 1]
[ERROR]
[ERROR] To see the full stack trace of the errors, re-run Maven with the -e switch.
[ERROR] Re-run Maven using the -X switch to enable full debug logging.
[ERROR]
[ERROR] For more information about the errors and possible solutions, please read the following articles:
[ERROR] [Help 1] http://cwiki.apache.org/confluence/display/MAVEN/MojoExecutionException
[ERROR]
[ERROR] After correcting the problems, you can resume the build with the command
[ERROR] mvn <goals> -rf :hadoop-common
+ /home/jenkins/tools/maven/latest/bin/mvn test -Pclover -DcloverLicenseLocation=/home/jenkins/tools/clover/latest/lib/clover.license
[WARNINGS] Parsing warnings in console log with parsers [Java Compiler, JavaDoc]
[WARNINGS] Java Compiler : Found 72 warnings.
[WARNINGS] Java Compiler : Found 17 warnings.
[WARNINGS] JavaDoc : Found 0 warnings.
[WARNINGS] Computing warning deltas based on reference build #162
Archiving artifacts
Recording fingerprints
Publishing Javadoc
ERROR: Publisher hudson.tasks.JavadocArchiver aborted due to exception
<https://builds.apache.org/job/Hadoop-Common-0.23-Build/ws/trunk/hadoop-common-project/hadoop-common/target/site/api> does not exist.
at org.apache.tools.ant.types.AbstractFileSet.getDirectoryScanner(AbstractFileSet.java:474)
at hudson.FilePath$35.hasMatch(FilePath.java:1905)
at hudson.FilePath$35.invoke(FilePath.java:1814)
at hudson.FilePath$35.invoke(FilePath.java:1805)
at hudson.FilePath$FileCallableWrapper.call(FilePath.java:2099)
at hudson.remoting.UserRequest.perform(UserRequest.java:118)
at hudson.remoting.UserRequest.perform(UserRequest.java:48)
at hudson.remoting.Request$2.run(Request.java:287)
at hudson.remoting.InterceptingExecutorService$1.call(InterceptingExecutorService.java:72)
at java.util.concurrent.FutureTask$Sync.innerRun(FutureTask.java:303)
at java.util.concurrent.FutureTask.run(FutureTask.java:138)
at java.util.concurrent.ThreadPoolExecutor$Worker.runTask(ThreadPoolExecutor.java:886)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:908)
at java.lang.Thread.run(Thread.java:662)
Recording test results
From common-dev-return-77700-apmail-hadoop-common-dev-archive=hadoop.apache.org@hadoop.apache.org Mon Feb 13 09:34:15 2012
Return-Path: <common-dev-return-77700-apmail-hadoop-common-dev-archive=hadoop.apache.org@hadoop.apache.org>
X-Original-To: apmail-hadoop-common-dev-archive@www.apache.org
Delivered-To: apmail-hadoop-common-dev-archive@www.apache.org
Received: from mail.apache.org (hermes.apache.org [140.211.11.3])
by minotaur.apache.org (Postfix) with SMTP id 477E39519
for <apmail-hadoop-common-dev-archive@www.apache.org>; Mon, 13 Feb 2012 09:34:15 +0000 (UTC)
Received: (qmail 60789 invoked by uid 500); 13 Feb 2012 09:34:13 -0000
Delivered-To: apmail-hadoop-common-dev-archive@hadoop.apache.org
Received: (qmail 60441 invoked by uid 500); 13 Feb 2012 09:34:06 -0000
Mailing-List: contact common-dev-help@hadoop.apache.org; run by ezmlm
Precedence: bulk
List-Help: <mailto:common-dev-help@hadoop.apache.org>
List-Unsubscribe: <mailto:common-dev-unsubscribe@hadoop.apache.org>
List-Post: <mailto:common-dev@hadoop.apache.org>
List-Id: <common-dev.hadoop.apache.org>
Reply-To: common-dev@hadoop.apache.org
Delivered-To: mailing list common-dev@hadoop.apache.org
Received: (qmail 60431 invoked by uid 99); 13 Feb 2012 09:34:03 -0000
Received: from athena.apache.org (HELO athena.apache.org) (140.211.11.136)
by apache.org (qpsmtpd/0.29) with ESMTP; Mon, 13 Feb 2012 09:34:03 +0000
X-ASF-Spam-Status: No, hits=-2000.0 required=5.0
tests=ALL_TRUSTED
X-Spam-Check-By: apache.org
Received: from [140.211.11.8] (HELO aegis.apache.org) (140.211.11.8)
by apache.org (qpsmtpd/0.29) with ESMTP; Mon, 13 Feb 2012 09:34:00 +0000
Received: from aegis (localhost [127.0.0.1])
by aegis.apache.org (Postfix) with ESMTP id 50188C0005
for <common-dev@hadoop.apache.org>; Mon, 13 Feb 2012 09:33:40 +0000 (UTC)
Date: Mon, 13 Feb 2012 09:33:40 +0000 (UTC)
From: Apache Jenkins Server <jenkins@builds.apache.org>
To: common-dev@hadoop.apache.org
Message-ID: <430324247.591329125620311.JavaMail.hudson@aegis>
Subject: Build failed in Jenkins: Hadoop-Common-trunk #317
MIME-Version: 1.0
Content-Type: text/plain; charset=UTF-8
Content-Transfer-Encoding: quoted-printable
X-Jenkins-Job: Hadoop-Common-trunk
X-Jenkins-Result: FAILURE
See <https://builds.apache.org/job/Hadoop-Common-trunk/317/changes>
Changes:
[mahadev] MAPREDUCE-3852. Test TestLinuxResourceCalculatorPlugin failing. (=
Thomas Graves via mahadev)
[mattf] HADOOP-8052. Hadoop Metrics2 should emit Float.MAX_VALUE (instead o=
f Double.MAX_VALUE) to avoid making Ganglia's gmetad core. Contributed by V=
arun Kapoor.
[harsh] HDFS-2869. Fix an error in the webhdfs docs for the mkdir op (harsh=
)
[harsh] Amend HADOOP-8055. Placed changes log in a released section, correc=
ted to 0.23.2. (harsh)
[harsh] HADOOP-8055. Hadoop tarball distribution lacks a core-site.xml (har=
sh)
------------------------------------------
[...truncated 223452 lines...]
[javadoc] 'org.apache.hadoop.tools'
[javadoc] 'org.apache.hadoop.util'
[javadoc] 'org.apache.hadoop.util.bloom'
[javadoc] 'org.apache.hadoop.util.hash'
[javadoc] '<https://builds.apache.org/job/Hadoop-Common-trunk/ws/trunk/ha=
doop-common-project/hadoop-common/dev-support/jdiff/Null.java'>
[javadoc]=20
[javadoc] The ' characters around the executable and arguments are
[javadoc] not part of the command.
[javadoc] Javadoc execution
Execute:Java13CommandLauncher: Executing '/home/jenkins/tools/java/jdk1.6.0=
_27/bin/javadoc' with arguments:
'-d'
'<https://builds.apache.org/job/Hadoop-Common-trunk/ws/trunk/hadoop-common-=
project/hadoop-common/target/site/jdiff/xml'>
'-J-Xmx512m'
'-classpath'
'<https://builds.apache.org/job/Hadoop-Common-trunk/ws/trunk/hadoop-common-=
project/hadoop-common/target/classes>:<https://builds.apache.org/job/Hadoop=
-Common-trunk/ws/trunk/hadoop-common-project/hadoop-annotations/target/hado=
op-annotations-0.24.0-SNAPSHOT.jar>:/home/jenkins/.m2/repository/jdiff/jdif=
f/1.0.9/jdiff-1.0.9.jar:/home/jenkins/.m2/repository/com/google/guava/guava=
/r09/guava-r09.jar:/home/jenkins/.m2/repository/commons-cli/commons-cli/1.2=
/commons-cli-1.2.jar:/home/jenkins/.m2/repository/org/apache/commons/common=
s-math/2.1/commons-math-2.1.jar:/home/jenkins/.m2/repository/xmlenc/xmlenc/=
0.52/xmlenc-0.52.jar:/home/jenkins/.m2/repository/commons-httpclient/common=
s-httpclient/3.1/commons-httpclient-3.1.jar:/home/jenkins/.m2/repository/co=
mmons-codec/commons-codec/1.4/commons-codec-1.4.jar:/home/jenkins/.m2/repos=
itory/commons-net/commons-net/1.4.1/commons-net-1.4.1.jar:/home/jenkins/.m2=
/repository/javax/servlet/servlet-api/2.5/servlet-api-2.5.jar:/home/jenkins=
/.m2/repository/org/mortbay/jetty/jetty/6.1.26/jetty-6.1.26.jar:/home/jenki=
ns/.m2/repository/org/mortbay/jetty/jetty-util/6.1.26/jetty-util-6.1.26.jar=
:/home/jenkins/.m2/repository/asm/asm/3.2/asm-3.2.jar:/home/jenkins/.m2/rep=
ository/com/sun/jersey/jersey-core/1.8/jersey-core-1.8.jar:/home/jenkins/.m=
2/repository/com/sun/jersey/jersey-json/1.8/jersey-json-1.8.jar:/home/jenki=
ns/.m2/repository/org/codehaus/jettison/jettison/1.1/jettison-1.1.jar:/home=
/jenkins/.m2/repository/stax/stax-api/1.0.1/stax-api-1.0.1.jar:/home/jenkin=
s/.m2/repository/com/sun/xml/bind/jaxb-impl/2.2.3-1/jaxb-impl-2.2.3-1.jar:/=
home/jenkins/.m2/repository/javax/xml/bind/jaxb-api/2.2.2/jaxb-api-2.2.2.ja=
r:/home/jenkins/.m2/repository/javax/activation/activation/1.1/activation-1=
.1.jar:/home/jenkins/.m2/repository/org/codehaus/jackson/jackson-core-asl/1=
.7.1/jackson-core-asl-1.7.1.jar:/home/jenkins/.m2/repository/org/codehaus/j=
ackson/jackson-jaxrs/1.7.1/jackson-jaxrs-1.7.1.jar:/home/jenkins/.m2/reposi=
tory/org/codehaus/jackson/jackson-xc/1.7.1/jackson-xc-1.7.1.jar:/home/jenki=
ns/.m2/repository/com/sun/jersey/jersey-server/1.8/jersey-server-1.8.jar:/h=
ome/jenkins/.m2/repository/tomcat/jasper-compiler/5.5.23/jasper-compiler-5.=
5.23.jar:/home/jenkins/.m2/repository/tomcat/jasper-runtime/5.5.23/jasper-r=
untime-5.5.23.jar:/home/jenkins/.m2/repository/javax/servlet/jsp/jsp-api/2.=
1/jsp-api-2.1.jar:/home/jenkins/.m2/repository/commons-el/commons-el/1.0/co=
mmons-el-1.0.jar:/home/jenkins/.m2/repository/commons-logging/commons-loggi=
ng/1.1.1/commons-logging-1.1.1.jar:/home/jenkins/.m2/repository/commons-log=
ging/commons-logging-api/1.1/commons-logging-api-1.1.jar:/home/jenkins/.m2/=
repository/log4j/log4j/1.2.15/log4j-1.2.15.jar:/home/jenkins/.m2/repository=
/net/java/dev/jets3t/jets3t/0.6.1/jets3t-0.6.1.jar:/home/jenkins/.m2/reposi=
tory/commons-lang/commons-lang/2.5/commons-lang-2.5.jar:/home/jenkins/.m2/r=
epository/commons-collections/commons-collections/3.2.1/commons-collections=
-3.2.1.jar:/home/jenkins/.m2/repository/commons-configuration/commons-confi=
guration/1.6/commons-configuration-1.6.jar:/home/jenkins/.m2/repository/com=
mons-digester/commons-digester/1.8/commons-digester-1.8.jar:/home/jenkins/.=
m2/repository/commons-beanutils/commons-beanutils/1.7.0/commons-beanutils-1=
.7.0.jar:/home/jenkins/.m2/repository/commons-beanutils/commons-beanutils-c=
ore/1.8.0/commons-beanutils-core-1.8.0.jar:/home/jenkins/.m2/repository/hsq=
ldb/hsqldb/1.8.0.7/hsqldb-1.8.0.7.jar:/home/jenkins/.m2/repository/org/slf4=
j/slf4j-api/1.6.1/slf4j-api-1.6.1.jar:/home/jenkins/.m2/repository/org/slf4=
j/slf4j-log4j12/1.6.1/slf4j-log4j12-1.6.1.jar:/home/jenkins/.m2/repository/=
org/eclipse/jdt/core/3.1.1/core-3.1.1.jar:/home/jenkins/.m2/repository/oro/=
oro/2.0.8/oro-2.0.8.jar:/home/jenkins/.m2/repository/org/codehaus/jackson/j=
ackson-mapper-asl/1.8.8/jackson-mapper-asl-1.8.8.jar:/home/jenkins/.m2/repo=
sitory/org/aspectj/aspectjrt/1.6.5/aspectjrt-1.6.5.jar:/home/jenkins/.m2/re=
pository/org/apache/avro/avro/1.5.3/avro-1.5.3.jar:/home/jenkins/.m2/reposi=
tory/com/thoughtworks/paranamer/paranamer/2.3/paranamer-2.3.jar:/home/jenki=
ns/.m2/repository/org/xerial/snappy/snappy-java/1.0.3.2/snappy-java-1.0.3.2=
.jar:/home/jenkins/.m2/repository/net/sf/kosmosfs/kfs/0.3/kfs-0.3.jar:/home=
/jenkins/.m2/repository/org/apache/ant/ant/1.8.1/ant-1.8.1.jar:/home/jenkin=
s/.m2/repository/org/apache/ant/ant-launcher/1.8.1/ant-launcher-1.8.1.jar:/=
home/jenkins/.m2/repository/com/google/protobuf/protobuf-java/2.4.0a/protob=
uf-java-2.4.0a.jar:<https://builds.apache.org/job/Hadoop-Common-trunk/ws/tr=
unk/hadoop-common-project/hadoop-auth/target/hadoop-auth-0.24.0-SNAPSHOT.ja=
r>:/home/jenkins/.m2/repository/com/googlecode/json-simple/json-simple/1.1/=
json-simple-1.1.jar:/home/jenkins/tools/java/latest/lib/tools.jar'
'-sourcepath'
'<https://builds.apache.org/job/Hadoop-Common-trunk/ws/trunk/hadoop-common-=
project/hadoop-common/src/main/java'>
'-doclet'
'org.apache.hadoop.classification.tools.ExcludePrivateAnnotationsJDiffDocle=
t'
'-docletpath'
'<https://builds.apache.org/job/Hadoop-Common-trunk/ws/trunk/hadoop-common-=
project/hadoop-common/target/hadoop-annotations.jar>:<https://builds.apache=
.org/job/Hadoop-Common-trunk/ws/trunk/hadoop-common-project/hadoop-common/t=
arget/jdiff.jar'>
'-oldapi'
'hadoop-core 0.20.2'
'-newapi'
'hadoop-core 0.24.0-SNAPSHOT'
'-oldapidir'
'<https://builds.apache.org/job/Hadoop-Common-trunk/ws/trunk/hadoop-common-=
project/hadoop-common/dev-support/jdiff'>
'-newapidir'
'<https://builds.apache.org/job/Hadoop-Common-trunk/ws/trunk/hadoop-common-=
project/hadoop-common/target/site/jdiff/xml'>
'-javadocold'
'http://hadoop.apache.org/docs/0.20.2/api/'
'-javadocnew'
'<https://builds.apache.org/job/Hadoop-Common-trunk/ws/trunk/hadoop-common-=
project/hadoop-common/target/site/api'>
'-stats'
'-unstable'
''
'org.apache.hadoop'
'org.apache.hadoop.conf'
'org.apache.hadoop.fs'
'org.apache.hadoop.fs.ftp'
'org.apache.hadoop.fs.kfs'
'org.apache.hadoop.fs.local'
'org.apache.hadoop.fs.permission'
'org.apache.hadoop.fs.s3'
'org.apache.hadoop.fs.s3native'
'org.apache.hadoop.fs.shell'
'org.apache.hadoop.fs.viewfs'
'org.apache.hadoop.http'
'org.apache.hadoop.http.lib'
'org.apache.hadoop.io'
'org.apache.hadoop.io.compress'
'org.apache.hadoop.io.compress.bzip2'
'org.apache.hadoop.io.compress.lz4'
'org.apache.hadoop.io.compress.snappy'
'org.apache.hadoop.io.compress.zlib'
'org.apache.hadoop.io.file.tfile'
'org.apache.hadoop.io.nativeio'
'org.apache.hadoop.io.retry'
'org.apache.hadoop.io.serializer'
'org.apache.hadoop.io.serializer.avro'
'org.apache.hadoop.ipc'
'org.apache.hadoop.ipc.metrics'
'org.apache.hadoop.jmx'
'org.apache.hadoop.log'
'org.apache.hadoop.log.metrics'
'org.apache.hadoop.metrics'
'org.apache.hadoop.metrics.file'
'org.apache.hadoop.metrics.ganglia'
'org.apache.hadoop.metrics.jvm'
'org.apache.hadoop.metrics.spi'
'org.apache.hadoop.metrics.util'
'org.apache.hadoop.metrics2'
'org.apache.hadoop.metrics2.annotation'
'org.apache.hadoop.metrics2.filter'
'org.apache.hadoop.metrics2.impl'
'org.apache.hadoop.metrics2.lib'
'org.apache.hadoop.metrics2.sink'
'org.apache.hadoop.metrics2.sink.ganglia'
'org.apache.hadoop.metrics2.source'
'org.apache.hadoop.metrics2.util'
'org.apache.hadoop.net'
'org.apache.hadoop.record'
'org.apache.hadoop.record.compiler'
'org.apache.hadoop.record.compiler.ant'
'org.apache.hadoop.record.compiler.generated'
'org.apache.hadoop.record.meta'
'org.apache.hadoop.security'
'org.apache.hadoop.security.authorize'
'org.apache.hadoop.security.token'
'org.apache.hadoop.security.token.delegation'
'org.apache.hadoop.tools'
'org.apache.hadoop.util'
'org.apache.hadoop.util.bloom'
'org.apache.hadoop.util.hash'
'<https://builds.apache.org/job/Hadoop-Common-trunk/ws/trunk/hadoop-common-=
project/hadoop-common/dev-support/jdiff/Null.java'>
The ' characters around the executable and arguments are
not part of the command.
[javadoc] javadoc: error - Illegal package name: ""
[javadoc] javadoc: error - File not found: "<https://builds.apache.org/jo=
b/Hadoop-Common-trunk/ws/trunk/hadoop-common-project/hadoop-common/dev-supp=
ort/jdiff/Null.java">
[javadoc] Loading source files for package org.apache.hadoop...
[javadoc] Loading source files for package org.apache.hadoop.conf...
[javadoc] Loading source files for package org.apache.hadoop.fs...
[javadoc] Loading source files for package org.apache.hadoop.fs.ftp...
[javadoc] Loading source files for package org.apache.hadoop.fs.kfs...
[javadoc] Loading source files for package org.apache.hadoop.fs.local...
[javadoc] Loading source files for package org.apache.hadoop.fs.permissio=
n...
[javadoc] Loading source files for package org.apache.hadoop.fs.s3...
[javadoc] Loading source files for package org.apache.hadoop.fs.s3native.=
..
[javadoc] Loading source files for package org.apache.hadoop.fs.shell...
[javadoc] Loading source files for package org.apache.hadoop.fs.viewfs...
[javadoc] Loading source files for package org.apache.hadoop.http...
[javadoc] Loading source files for package org.apache.hadoop.http.lib...
[javadoc] Loading source files for package org.apache.hadoop.io...
[javadoc] Loading source files for package org.apache.hadoop.io.compress.=
..
[javadoc] Loading source files for package org.apache.hadoop.io.compress.=
bzip2...
[javadoc] Loading source files for package org.apache.hadoop.io.compress.=
lz4...
[javadoc] Loading source files for package org.apache.hadoop.io.compress.=
snappy...
[javadoc] Loading source files for package org.apache.hadoop.io.compress.=
zlib...
[javadoc] Loading source files for package org.apache.hadoop.io.file.tfil=
e...
[javadoc] Loading source files for package org.apache.hadoop.io.nativeio.=
..
[javadoc] Loading source files for package org.apache.hadoop.io.retry...
[javadoc] Loading source files for package org.apache.hadoop.io.serialize=
r...
[javadoc] Loading source files for package org.apache.hadoop.io.serialize=
r.avro...
[javadoc] Loading source files for package org.apache.hadoop.ipc...
[javadoc] Loading source files for package org.apache.hadoop.ipc.metrics.=
..
[javadoc] Loading source files for package org.apache.hadoop.jmx...
[javadoc] Loading source files for package org.apache.hadoop.log...
[javadoc] Loading source files for package org.apache.hadoop.log.metrics.=
..
[javadoc] Loading source files for package org.apache.hadoop.metrics...
[javadoc] Loading source files for package org.apache.hadoop.metrics.file=
...
[javadoc] Loading source files for package org.apache.hadoop.metrics.gang=
lia...
[javadoc] Loading source files for package org.apache.hadoop.metrics.jvm.=
..
[javadoc] Loading source files for package org.apache.hadoop.metrics.spi.=
..
[javadoc] Loading source files for package org.apache.hadoop.metrics.util=
...
[javadoc] Loading source files for package org.apache.hadoop.metrics2...
[javadoc] Loading source files for package org.apache.hadoop.metrics2.ann=
otation...
[javadoc] Loading source files for package org.apache.hadoop.metrics2.fil=
ter...
[javadoc] Loading source files for package org.apache.hadoop.metrics2.imp=
l...
[javadoc] Loading source files for package org.apache.hadoop.metrics2.lib=
...
[javadoc] Loading source files for package org.apache.hadoop.metrics2.sin=
k...
[javadoc] Loading source files for package org.apache.hadoop.metrics2.sin=
k.ganglia...
[javadoc] Loading source files for package org.apache.hadoop.metrics2.sou=
rce...
[javadoc] Loading source files for package org.apache.hadoop.metrics2.uti=
l...
[javadoc] Loading source files for package org.apache.hadoop.net...
[javadoc] Loading source files for package org.apache.hadoop.record...
[javadoc] Loading source files for package org.apache.hadoop.record.compi=
ler...
[javadoc] Loading source files for package org.apache.hadoop.record.compi=
ler.ant...
[javadoc] Loading source files for package org.apache.hadoop.record.compi=
ler.generated...
[javadoc] Loading source files for package org.apache.hadoop.record.meta.=
..
[javadoc] Loading source files for package org.apache.hadoop.security...
[javadoc] Loading source files for package org.apache.hadoop.security.aut=
horize...
[javadoc] Loading source files for package org.apache.hadoop.security.tok=
en...
[javadoc] Loading source files for package org.apache.hadoop.security.tok=
en.delegation...
[javadoc] Loading source files for package org.apache.hadoop.tools...
[javadoc] Loading source files for package org.apache.hadoop.util...
[javadoc] Loading source files for package org.apache.hadoop.util.bloom..=
.
[javadoc] Loading source files for package org.apache.hadoop.util.hash...
[javadoc] 2 errors
[INFO] --------------------------------------------------------------------=
----
[INFO] Reactor Summary:
[INFO]=20
[INFO] Apache Hadoop Annotations ......................... SUCCESS [1:31.51=
9s]
[INFO] Apache Hadoop Auth ................................ SUCCESS [1:05.74=
4s]
[INFO] Apache Hadoop Auth Examples ....................... SUCCESS [7.212s]
[INFO] Apache Hadoop Common .............................. FAILURE [1:32.19=
7s]
[INFO] Apache Hadoop Common Project ...................... SKIPPED
[INFO] --------------------------------------------------------------------=
----
[INFO] BUILD FAILURE
[INFO] --------------------------------------------------------------------=
----
[INFO] Total time: 4:28.751s
[INFO] Finished at: Mon Feb 13 09:19:22 UTC 2012
[INFO] Final Memory: 66M/350M
[INFO] --------------------------------------------------------------------=
----
[ERROR] Failed to execute goal org.apache.maven.plugins:maven-antrun-plugin=
:1.6:run (site) on project hadoop-common: An Ant BuildException has occured=
: input file <https://builds.apache.org/job/Hadoop-Common-trunk/ws/trunk/ha=
doop-common-project/hadoop-common/target/findbugsXml.xml> does not exist ->=
[Help 1]
org.apache.maven.lifecycle.LifecycleExecutionException: Failed to execute g=
oal org.apache.maven.plugins:maven-antrun-plugin:1.6:run (site) on project =
hadoop-common: An Ant BuildException has occured: input file <https://build=
s.apache.org/job/Hadoop-Common-trunk/ws/trunk/hadoop-common-project/hadoop-=
common/target/findbugsXml.xml> does not exist
=09at org.apache.maven.lifecycle.internal.MojoExecutor.execute(MojoExecutor=
.java:217)
=09at org.apache.maven.lifecycle.internal.MojoExecutor.execute(MojoExecutor=
.java:153)
=09at org.apache.maven.lifecycle.internal.MojoExecutor.execute(MojoExecutor=
.java:145)
=09at org.apache.maven.lifecycle.internal.LifecycleModuleBuilder.buildProje=
ct(LifecycleModuleBuilder.java:84)
=09at org.apache.maven.lifecycle.internal.LifecycleModuleBuilder.buildProje=
ct(LifecycleModuleBuilder.java:59)
=09at org.apache.maven.lifecycle.internal.LifecycleStarter.singleThreadedBu=
ild(LifecycleStarter.java:183)
=09at org.apache.maven.lifecycle.internal.LifecycleStarter.execute(Lifecycl=
eStarter.java:161)
=09at org.apache.maven.DefaultMaven.doExecute(DefaultMaven.java:319)
=09at org.apache.maven.DefaultMaven.execute(DefaultMaven.java:156)
=09at org.apache.maven.cli.MavenCli.execute(MavenCli.java:537)
=09at org.apache.maven.cli.MavenCli.doMain(MavenCli.java:196)
=09at org.apache.maven.cli.MavenCli.main(MavenCli.java:141)
=09at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
=09at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.=
java:39)
=09at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAcces=
sorImpl.java:25)
=09at java.lang.reflect.Method.invoke(Method.java:597)
=09at org.codehaus.plexus.classworlds.launcher.Launcher.launchEnhanced(Laun=
cher.java:290)
=09at org.codehaus.plexus.classworlds.launcher.Launcher.launch(Launcher.jav=
a:230)
=09at org.codehaus.plexus.classworlds.launcher.Launcher.mainWithExitCode(La=
uncher.java:409)
=09at org.codehaus.plexus.classworlds.launcher.Launcher.main(Launcher.java:=
352)
Caused by: org.apache.maven.plugin.MojoExecutionException: An Ant BuildExce=
ption has occured: input file <https://builds.apache.org/job/Hadoop-Common-=
trunk/ws/trunk/hadoop-common-project/hadoop-common/target/findbugsXml.xml> =
does not exist
=09at org.apache.maven.plugin.antrun.AntRunMojo.execute(AntRunMojo.java:283=
)
=09at org.apache.maven.plugin.DefaultBuildPluginManager.executeMojo(Default=
BuildPluginManager.java:101)
=09at org.apache.maven.lifecycle.internal.MojoExecutor.execute(MojoExecutor=
.java:209)
=09... 19 more
Caused by: <https://builds.apache.org/job/Hadoop-Common-trunk/ws/trunk/hado=
op-common-project/hadoop-common/target/antrun/build-main.xml>:48: input fil=
e <https://builds.apache.org/job/Hadoop-Common-trunk/ws/trunk/hadoop-common=
-project/hadoop-common/target/findbugsXml.xml> does not exist
=09at org.apache.tools.ant.taskdefs.XSLTProcess.handleError(XSLTProcess.jav=
a:1229)
=09at org.apache.tools.ant.taskdefs.XSLTProcess.execute(XSLTProcess.java:33=
5)
=09at org.apache.tools.ant.UnknownElement.execute(UnknownElement.java:291)
=09at sun.reflect.GeneratedMethodAccessor124.invoke(Unknown Source)
=09at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAcces=
sorImpl.java:25)
=09at java.lang.reflect.Method.invoke(Method.java:597)
=09at org.apache.tools.ant.dispatch.DispatchUtils.execute(DispatchUtils.jav=
a:106)
=09at org.apache.tools.ant.Task.perform(Task.java:348)
=09at org.apache.tools.ant.Target.execute(Target.java:390)
=09at org.apache.tools.ant.Target.performTasks(Target.java:411)
=09at org.apache.tools.ant.Project.executeSortedTargets(Project.java:1397)
=09at org.apache.tools.ant.Project.executeTarget(Project.java:1366)
=09at org.apache.maven.plugin.antrun.AntRunMojo.execute(AntRunMojo.java:270=
)
=09... 21 more
[ERROR]=20
[ERROR]=20
[ERROR] For more information about the errors and possible solutions, pleas=
e read the following articles:
[ERROR] [Help 1] http://cwiki.apache.org/confluence/display/MAVEN/MojoExecu=
tionException
[ERROR]=20
[ERROR] After correcting the problems, you can resume the build with the co=
mmand
[ERROR] mvn <goals> -rf :hadoop-common
+ /home/jenkins/tools/maven/latest/bin/mvn test -Pclover -DcloverLicenseLoc=
ation=3D/home/jenkins/tools/clover/latest/lib/clover.license
[WARNINGS] Parsing warnings in console log with parsers [Java Compiler, Jav=
aDoc]
[WARNINGS] Java Compiler : Found 72 warnings.
[WARNINGS] Java Compiler : Found 17 warnings.
[WARNINGS] JavaDoc : Found 0 warnings.
[WARNINGS] Computing warning deltas based on reference build #316
Archiving artifacts
Recording test results
Publishing Javadoc
ERROR: Publisher hudson.tasks.JavadocArchiver aborted due to exception
<https://builds.apache.org/job/Hadoop-Common-trunk/ws/trunk/hadoop-common-p=
roject/hadoop-common/target/site/api> does not exist.
=09at org.apache.tools.ant.types.AbstractFileSet.getDirectoryScanner(Abstra=
ctFileSet.java:474)
=09at hudson.FilePath$35.hasMatch(FilePath.java:1905)
=09at hudson.FilePath$35.invoke(FilePath.java:1814)
=09at hudson.FilePath$35.invoke(FilePath.java:1805)
=09at hudson.FilePath$FileCallableWrapper.call(FilePath.java:2099)
=09at hudson.remoting.UserRequest.perform(UserRequest.java:118)
=09at hudson.remoting.UserRequest.perform(UserRequest.java:48)
=09at hudson.remoting.Request$2.run(Request.java:287)
=09at hudson.remoting.InterceptingExecutorService$1.call(InterceptingExecut=
orService.java:72)
=09at java.util.concurrent.FutureTask$Sync.innerRun(FutureTask.java:303)
=09at java.util.concurrent.FutureTask.run(FutureTask.java:138)
=09at java.util.concurrent.ThreadPoolExecutor$Worker.runTask(ThreadPoolExec=
utor.java:886)
=09at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor=
.java:908)
=09at java.lang.Thread.run(Thread.java:662)
Recording fingerprints
From common-dev-return-77701-apmail-hadoop-common-dev-archive=hadoop.apache.org@hadoop.apache.org Mon Feb 13 10:27:09 2012
Return-Path: <common-dev-return-77701-apmail-hadoop-common-dev-archive=hadoop.apache.org@hadoop.apache.org>
X-Original-To: apmail-hadoop-common-dev-archive@www.apache.org
Delivered-To: apmail-hadoop-common-dev-archive@www.apache.org
Received: from mail.apache.org (hermes.apache.org [140.211.11.3])
by minotaur.apache.org (Postfix) with SMTP id CE1579766
for <apmail-hadoop-common-dev-archive@www.apache.org>; Mon, 13 Feb 2012 10:27:09 +0000 (UTC)
Received: (qmail 23136 invoked by uid 500); 13 Feb 2012 10:27:07 -0000
Delivered-To: apmail-hadoop-common-dev-archive@hadoop.apache.org
Received: (qmail 22414 invoked by uid 500); 13 Feb 2012 10:27:03 -0000
Mailing-List: contact common-dev-help@hadoop.apache.org; run by ezmlm
Precedence: bulk
List-Help: <mailto:common-dev-help@hadoop.apache.org>
List-Unsubscribe: <mailto:common-dev-unsubscribe@hadoop.apache.org>
List-Post: <mailto:common-dev@hadoop.apache.org>
List-Id: <common-dev.hadoop.apache.org>
Reply-To: common-dev@hadoop.apache.org
Delivered-To: mailing list common-dev@hadoop.apache.org
Received: (qmail 22395 invoked by uid 99); 13 Feb 2012 10:26:58 -0000
Received: from athena.apache.org (HELO athena.apache.org) (140.211.11.136)
by apache.org (qpsmtpd/0.29) with ESMTP; Mon, 13 Feb 2012 10:26:58 +0000
X-ASF-Spam-Status: No, hits=1.5 required=5.0
tests=HTML_MESSAGE,RCVD_IN_DNSWL_LOW,SPF_PASS
X-Spam-Check-By: apache.org
Received-SPF: pass (athena.apache.org: domain of masmertoz@gmail.com designates 209.85.160.176 as permitted sender)
Received: from [209.85.160.176] (HELO mail-gy0-f176.google.com) (209.85.160.176)
by apache.org (qpsmtpd/0.29) with ESMTP; Mon, 13 Feb 2012 10:26:51 +0000
Received: by ghbz2 with SMTP id z2so2772702ghb.35
for <common-dev@hadoop.apache.org>; Mon, 13 Feb 2012 02:26:30 -0800 (PST)
DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed;
d=gmail.com; s=gamma;
h=mime-version:date:message-id:subject:from:to:content-type;
bh=sV06iBdNe9Nb8tnWpqzY/TOzAhF5eFPi88Er0HQwAPs=;
b=u2JOtOFLOcT2Y9NDlkun4RFpN0R8uBu8EFQuHy3cCd0SW+xA3A3LkAS8yANga3gEwe
vt1aEOWfu+Pj3BtpU/ST6ChpIcXQhYcFNBlNCFK0o6WJCGQ+cOltLf1QN3x9s7I1Npsn
bXirpL8T+aPFNxfLaesXNNvXbWkzdkLF4XhtU=
MIME-Version: 1.0
Received: by 10.50.95.195 with SMTP id dm3mr25069822igb.9.1329128790274; Mon,
13 Feb 2012 02:26:30 -0800 (PST)
Received: by 10.42.241.132 with HTTP; Mon, 13 Feb 2012 02:26:30 -0800 (PST)
Date: Mon, 13 Feb 2012 11:26:30 +0100
Message-ID: <CAENBeZZYO8sTZcQjWQ8aUndBJo3mcQKbxJiL2S47qryM8KN7tw@mail.gmail.com>
Subject: Developing and deploying hadoop
From: Merto Mertek <masmertoz@gmail.com>
To: common-dev@hadoop.apache.org
Content-Type: multipart/alternative; boundary=e89a8f2349cb67b1a004b8d5e99b
--e89a8f2349cb67b1a004b8d5e99b
Content-Type: text/plain; charset=ISO-8859-1
I am interested in some general tips on how to develop and deploy new
versions of hadoop. I've been trying to compile a new version of hadoop
and place the new jar to the cluster in the lib folder, however it was not
picked despite the classpath was explicitly set to the lib folder. I am
interested in the following questions:
a) How to deploy a new version? Just copy the new compiled jar file to all
lib folders on all nodes?
b) Should I make just a new compile or a new release ('ant' vs 'ant tar')?
c) How do you develop and deploy hadoop locally and how remotely? For
deploying builds are you using your own sh scripts or are you using any
tools like ant/maven?
d) What is the purpose of the folder $HADOOP_HOME/share/hadoop?
Any other tips are welcomed..
Thank you
--e89a8f2349cb67b1a004b8d5e99b--
From common-dev-return-77702-apmail-hadoop-common-dev-archive=hadoop.apache.org@hadoop.apache.org Mon Feb 13 15:01:28 2012
Return-Path: <common-dev-return-77702-apmail-hadoop-common-dev-archive=hadoop.apache.org@hadoop.apache.org>
X-Original-To: apmail-hadoop-common-dev-archive@www.apache.org
Delivered-To: apmail-hadoop-common-dev-archive@www.apache.org
Received: from mail.apache.org (hermes.apache.org [140.211.11.3])
by minotaur.apache.org (Postfix) with SMTP id C9F7D9953
for <apmail-hadoop-common-dev-archive@www.apache.org>; Mon, 13 Feb 2012 15:01:28 +0000 (UTC)
Received: (qmail 27681 invoked by uid 500); 13 Feb 2012 15:01:26 -0000
Delivered-To: apmail-hadoop-common-dev-archive@hadoop.apache.org
Received: (qmail 27040 invoked by uid 500); 13 Feb 2012 15:01:25 -0000
Mailing-List: contact common-dev-help@hadoop.apache.org; run by ezmlm
Precedence: bulk
List-Help: <mailto:common-dev-help@hadoop.apache.org>
List-Unsubscribe: <mailto:common-dev-unsubscribe@hadoop.apache.org>
List-Post: <mailto:common-dev@hadoop.apache.org>
List-Id: <common-dev.hadoop.apache.org>
Reply-To: common-dev@hadoop.apache.org
Delivered-To: mailing list common-dev@hadoop.apache.org
Received: (qmail 26541 invoked by uid 99); 13 Feb 2012 15:01:24 -0000
Received: from nike.apache.org (HELO nike.apache.org) (192.87.106.230)
by apache.org (qpsmtpd/0.29) with ESMTP; Mon, 13 Feb 2012 15:01:24 +0000
X-ASF-Spam-Status: No, hits=-2000.0 required=5.0
tests=ALL_TRUSTED,T_RP_MATCHES_RCVD
X-Spam-Check-By: apache.org
Received: from [140.211.11.116] (HELO hel.zones.apache.org) (140.211.11.116)
by apache.org (qpsmtpd/0.29) with ESMTP; Mon, 13 Feb 2012 15:01:22 +0000
Received: from hel.zones.apache.org (hel.zones.apache.org [140.211.11.116])
by hel.zones.apache.org (Postfix) with ESMTP id 328451B45CE
for <common-dev@hadoop.apache.org>; Mon, 13 Feb 2012 15:01:01 +0000 (UTC)
Date: Mon, 13 Feb 2012 15:01:01 +0000 (UTC)
From: "Kihwal Lee (Created) (JIRA)" <jira@apache.org>
To: common-dev@hadoop.apache.org
Message-ID: <538820680.31849.1329145261208.JavaMail.tomcat@hel.zones.apache.org>
Subject: [jira] [Created] (HADOOP-8064) Remove unnecessary dependency on
w3c.org in document processing
MIME-Version: 1.0
Content-Type: text/plain; charset=utf-8
Content-Transfer-Encoding: 7bit
X-JIRA-FingerPrint: 30527f35849b9dde25b450d4833f0394
X-Virus-Checked: Checked by ClamAV on apache.org
Remove unnecessary dependency on w3c.org in document processing
---------------------------------------------------------------
Key: HADOOP-8064
URL: https://issues.apache.org/jira/browse/HADOOP-8064
Project: Hadoop Common
Issue Type: Bug
Components: build
Affects Versions: 0.23.0, 0.23.1
Reporter: Kihwal Lee
Fix For: 0.24.0, 0.23.2
Our builds fail occasionally due to validation failures caused by unavailability of w3.org. In fact, w3.org has been fed up with this kind of requests, blacklisting/throttling have been in place for some time.
The ones I've seen are coming from maven pdf plugin v.1.1 used in hadoop-tools/hadoop-distcp. The input validation has been made configurable in MPDF-39, which requires DOXIA-392 (fixed since doxia-1.1.3). Unfortunately, the maven pdf plugin 1.2 has been cooking for long time and not been released yet. May be we could force it to use a later version of doxia?
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
From common-dev-return-77703-apmail-hadoop-common-dev-archive=hadoop.apache.org@hadoop.apache.org Mon Feb 13 17:34:29 2012
Return-Path: <common-dev-return-77703-apmail-hadoop-common-dev-archive=hadoop.apache.org@hadoop.apache.org>
X-Original-To: apmail-hadoop-common-dev-archive@www.apache.org
Delivered-To: apmail-hadoop-common-dev-archive@www.apache.org
Received: from mail.apache.org (hermes.apache.org [140.211.11.3])
by minotaur.apache.org (Postfix) with SMTP id 997DE96F0
for <apmail-hadoop-common-dev-archive@www.apache.org>; Mon, 13 Feb 2012 17:34:29 +0000 (UTC)
Received: (qmail 75984 invoked by uid 500); 13 Feb 2012 17:34:28 -0000
Delivered-To: apmail-hadoop-common-dev-archive@hadoop.apache.org
Received: (qmail 75790 invoked by uid 500); 13 Feb 2012 17:34:27 -0000
Mailing-List: contact common-dev-help@hadoop.apache.org; run by ezmlm
Precedence: bulk
List-Help: <mailto:common-dev-help@hadoop.apache.org>
List-Unsubscribe: <mailto:common-dev-unsubscribe@hadoop.apache.org>
List-Post: <mailto:common-dev@hadoop.apache.org>
List-Id: <common-dev.hadoop.apache.org>
Reply-To: common-dev@hadoop.apache.org
Delivered-To: mailing list common-dev@hadoop.apache.org
Delivered-To: moderator for common-dev@hadoop.apache.org
Received: (qmail 92483 invoked by uid 500); 12 Feb 2012 01:41:34 -0000
Delivered-To: apmail-hadoop-core-dev@hadoop.apache.org
Delivered-To: apmail-lucene-hadoop-dev@lucene.apache.org
X-ASF-Spam-Status: No, hits=2.2 required=5.0
tests=FREEMAIL_ENVFROM_END_DIGIT,SPF_NEUTRAL,URI_HEX
X-Spam-Check-By: apache.org
Received-SPF: neutral (athena.apache.org: 216.139.236.26 is neither permitted nor denied by domain of elhamab99@gmail.com)
Date: Sat, 11 Feb 2012 17:41:08 -0800 (PST)
From: Selwa <elhamab99@gmail.com>
To: hadoop-dev@lucene.apache.org
Message-ID: <1329010868844-3736421.post@n3.nabble.com>
Subject: datanode to blocks mapping
MIME-Version: 1.0
Content-Type: text/plain; charset=us-ascii
Content-Transfer-Encoding: 7bit
Hello there,
currently i am working on research about the block placement policy of HDFS.
I want to find the blocks mapping of the pseudo cluster.
then i request the name node for this data structure by the following code
BlocksMap blocksMap = new BlocksMap(16, 0.75f);
Collection<BlockInfo>blocks = blocksMap.getBlocks();
but the collection does not hold any thing - always it is
empty
blocks.isempty() is becoming true even i saved some files on
the pseudo -cluster.
what is wrong with this code?
is there any other way to find block mapping?
thanks
Selwa
--
View this message in context: http://lucene.472066.n3.nabble.com/datanode-to-blocks-mapping-tp3736421p3736421.html
Sent from the Hadoop lucene-dev mailing list archive at Nabble.com.
From common-dev-return-77704-apmail-hadoop-common-dev-archive=hadoop.apache.org@hadoop.apache.org Mon Feb 13 18:43:30 2012
Return-Path: <common-dev-return-77704-apmail-hadoop-common-dev-archive=hadoop.apache.org@hadoop.apache.org>
X-Original-To: apmail-hadoop-common-dev-archive@www.apache.org
Delivered-To: apmail-hadoop-common-dev-archive@www.apache.org
Received: from mail.apache.org (hermes.apache.org [140.211.11.3])
by minotaur.apache.org (Postfix) with SMTP id F034A9BC0
for <apmail-hadoop-common-dev-archive@www.apache.org>; Mon, 13 Feb 2012 18:43:29 +0000 (UTC)
Received: (qmail 29964 invoked by uid 500); 13 Feb 2012 18:43:27 -0000
Delivered-To: apmail-hadoop-common-dev-archive@hadoop.apache.org
Received: (qmail 28830 invoked by uid 500); 13 Feb 2012 18:43:25 -0000
Mailing-List: contact common-dev-help@hadoop.apache.org; run by ezmlm
Precedence: bulk
List-Help: <mailto:common-dev-help@hadoop.apache.org>
List-Unsubscribe: <mailto:common-dev-unsubscribe@hadoop.apache.org>
List-Post: <mailto:common-dev@hadoop.apache.org>
List-Id: <common-dev.hadoop.apache.org>
Reply-To: common-dev@hadoop.apache.org
Delivered-To: mailing list common-dev@hadoop.apache.org
Received: (qmail 28793 invoked by uid 99); 13 Feb 2012 18:43:25 -0000
Received: from athena.apache.org (HELO athena.apache.org) (140.211.11.136)
by apache.org (qpsmtpd/0.29) with ESMTP; Mon, 13 Feb 2012 18:43:25 +0000
X-ASF-Spam-Status: No, hits=-2000.0 required=5.0
tests=ALL_TRUSTED,T_RP_MATCHES_RCVD
X-Spam-Check-By: apache.org
Received: from [140.211.11.116] (HELO hel.zones.apache.org) (140.211.11.116)
by apache.org (qpsmtpd/0.29) with ESMTP; Mon, 13 Feb 2012 18:43:24 +0000
Received: from hel.zones.apache.org (hel.zones.apache.org [140.211.11.116])
by hel.zones.apache.org (Postfix) with ESMTP id 146461B4C94
for <common-dev@hadoop.apache.org>; Mon, 13 Feb 2012 18:43:04 +0000 (UTC)
Date: Mon, 13 Feb 2012 18:43:04 +0000 (UTC)
From: "Suresh Antony (Created) (JIRA)" <jira@apache.org>
To: common-dev@hadoop.apache.org
Message-ID: <26034319.32575.1329158584085.JavaMail.tomcat@hel.zones.apache.org>
Subject: [jira] [Created] (HADOOP-8065) discp should have an option to
compress data while copying.
MIME-Version: 1.0
Content-Type: text/plain; charset=utf-8
Content-Transfer-Encoding: 7bit
X-JIRA-FingerPrint: 30527f35849b9dde25b450d4833f0394
discp should have an option to compress data while copying.
-----------------------------------------------------------
Key: HADOOP-8065
URL: https://issues.apache.org/jira/browse/HADOOP-8065
Project: Hadoop Common
Issue Type: Improvement
Components: fs
Affects Versions: 0.20.2
Reporter: Suresh Antony
Priority: Minor
Fix For: 0.20.2
We would like compress the data while transferring from our source system to target system. One way to do this is to write a map/reduce job to compress that after/before being transferred. This looks inefficient.
Since distcp already reading writing data it would be better if it can accomplish while doing this.
Flip side of this is that distcp -update option can not check file size before copying data. It can only check for the existence of file.
So I propose if -compress option is given then file size is not checked.
Also when we copy file appropriate extension needs to be added to file depending on compression type.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
From common-dev-return-77705-apmail-hadoop-common-dev-archive=hadoop.apache.org@hadoop.apache.org Mon Feb 13 18:46:55 2012
Return-Path: <common-dev-return-77705-apmail-hadoop-common-dev-archive=hadoop.apache.org@hadoop.apache.org>
X-Original-To: apmail-hadoop-common-dev-archive@www.apache.org
Delivered-To: apmail-hadoop-common-dev-archive@www.apache.org
Received: from mail.apache.org (hermes.apache.org [140.211.11.3])
by minotaur.apache.org (Postfix) with SMTP id 898A59D2D
for <apmail-hadoop-common-dev-archive@www.apache.org>; Mon, 13 Feb 2012 18:46:55 +0000 (UTC)
Received: (qmail 38790 invoked by uid 500); 13 Feb 2012 18:46:53 -0000
Delivered-To: apmail-hadoop-common-dev-archive@hadoop.apache.org
Received: (qmail 38690 invoked by uid 500); 13 Feb 2012 18:46:53 -0000
Mailing-List: contact common-dev-help@hadoop.apache.org; run by ezmlm
Precedence: bulk
List-Help: <mailto:common-dev-help@hadoop.apache.org>
List-Unsubscribe: <mailto:common-dev-unsubscribe@hadoop.apache.org>
List-Post: <mailto:common-dev@hadoop.apache.org>
List-Id: <common-dev.hadoop.apache.org>
Reply-To: common-dev@hadoop.apache.org
Delivered-To: mailing list common-dev@hadoop.apache.org
Received: (qmail 38682 invoked by uid 99); 13 Feb 2012 18:46:53 -0000
Received: from minotaur.apache.org (HELO minotaur.apache.org) (140.211.11.9)
by apache.org (qpsmtpd/0.29) with ESMTP; Mon, 13 Feb 2012 18:46:53 +0000
Received: from localhost (HELO [192.168.168.16]) (127.0.0.1)
(smtp-auth username cutting, mechanism plain)
by minotaur.apache.org (qpsmtpd/0.29) with ESMTP; Mon, 13 Feb 2012 18:46:52 +0000
Message-ID: <4F395A9C.9030704@apache.org>
Date: Mon, 13 Feb 2012 10:46:52 -0800
From: Doug Cutting <cutting@apache.org>
User-Agent: Mozilla/5.0 (X11; U; Linux i686; en-US; rv:1.9.2.26) Gecko/20120131 Thunderbird/3.1.18
MIME-Version: 1.0
To: common-dev@hadoop.apache.org
Subject: Re: Apache Jenkins is down
References: <CAF63A-ZEL1yBQMEQsX7aV9rWD4JVUniaW4RsWZ8+jqvh_3oMXg@mail.gmail.com> <CA+ULb+t6CitS57EfA7yUE3PX-xuBefdFoaz5mOMce+YRqV7XpA@mail.gmail.com>
In-Reply-To: <CA+ULb+t6CitS57EfA7yUE3PX-xuBefdFoaz5mOMce+YRqV7XpA@mail.gmail.com>
X-Enigmail-Version: 1.1.2
Content-Type: text/plain; charset=ISO-8859-1
Content-Transfer-Encoding: 7bit
On 02/12/2012 10:02 PM, Roman Shaposhnik wrote:
> For issues like these it always helps to file an INFRA Jira.
It's good to first check the ASF monitoring status page:
http://monitoring.apache.org/status/
If there's a red on that page then Infrastructure is already aware of
the problem.
Another thing is to listen in on #asfinfra on irc.freenode.net.
Doug
From common-dev-return-77706-apmail-hadoop-common-dev-archive=hadoop.apache.org@hadoop.apache.org Mon Feb 13 19:03:47 2012
Return-Path: <common-dev-return-77706-apmail-hadoop-common-dev-archive=hadoop.apache.org@hadoop.apache.org>
X-Original-To: apmail-hadoop-common-dev-archive@www.apache.org
Delivered-To: apmail-hadoop-common-dev-archive@www.apache.org
Received: from mail.apache.org (hermes.apache.org [140.211.11.3])
by minotaur.apache.org (Postfix) with SMTP id 8ECD0988F
for <apmail-hadoop-common-dev-archive@www.apache.org>; Mon, 13 Feb 2012 19:03:47 +0000 (UTC)
Received: (qmail 76344 invoked by uid 500); 13 Feb 2012 19:03:46 -0000
Delivered-To: apmail-hadoop-common-dev-archive@hadoop.apache.org
Received: (qmail 76257 invoked by uid 500); 13 Feb 2012 19:03:45 -0000
Mailing-List: contact common-dev-help@hadoop.apache.org; run by ezmlm
Precedence: bulk
List-Help: <mailto:common-dev-help@hadoop.apache.org>
List-Unsubscribe: <mailto:common-dev-unsubscribe@hadoop.apache.org>
List-Post: <mailto:common-dev@hadoop.apache.org>
List-Id: <common-dev.hadoop.apache.org>
Reply-To: common-dev@hadoop.apache.org
Delivered-To: mailing list common-dev@hadoop.apache.org
Received: (qmail 76248 invoked by uid 99); 13 Feb 2012 19:03:44 -0000
Received: from nike.apache.org (HELO nike.apache.org) (192.87.106.230)
by apache.org (qpsmtpd/0.29) with ESMTP; Mon, 13 Feb 2012 19:03:44 +0000
X-ASF-Spam-Status: No, hits=-0.0 required=5.0
tests=RCVD_IN_DNSWL_LOW,SPF_NEUTRAL
X-Spam-Check-By: apache.org
Received-SPF: neutral (nike.apache.org: local policy)
Received: from [209.85.212.48] (HELO mail-vw0-f48.google.com) (209.85.212.48)
by apache.org (qpsmtpd/0.29) with ESMTP; Mon, 13 Feb 2012 19:03:37 +0000
Received: by vbjk13 with SMTP id k13so5137152vbj.35
for <common-dev@hadoop.apache.org>; Mon, 13 Feb 2012 11:03:16 -0800 (PST)
MIME-Version: 1.0
Received: by 10.52.38.10 with SMTP id c10mr7553295vdk.58.1329159796530; Mon,
13 Feb 2012 11:03:16 -0800 (PST)
Received: by 10.220.199.1 with HTTP; Mon, 13 Feb 2012 11:03:16 -0800 (PST)
In-Reply-To: <CAF63A-ZEL1yBQMEQsX7aV9rWD4JVUniaW4RsWZ8+jqvh_3oMXg@mail.gmail.com>
References: <CAF63A-ZEL1yBQMEQsX7aV9rWD4JVUniaW4RsWZ8+jqvh_3oMXg@mail.gmail.com>
Date: Mon, 13 Feb 2012 11:03:16 -0800
Message-ID: <CANJr2=Gm2BEjBUESMEjfYkvm4XNao8ndd_ia9yggNg2xL-VzjA@mail.gmail.com>
Subject: Re: Apache Jenkins is down
From: Giridharan Kesavan <gkesavan@hortonworks.com>
To: common-dev@hadoop.apache.org
Content-Type: text/plain; charset=ISO-8859-1
X-Gm-Message-State: ALoCoQnjI2o2lrt/KUfX056KTQWDVzsgpGJxXvSjTgzAfQDJhffblKNq7s97WY2xR3jcDkKoSvpp
X-Virus-Checked: Checked by ClamAV on apache.org
Please use builds@apache.org mailing list for Apache Jenkins. That is
where the apache Jenkins admins live.
-Giri
On Sun, Feb 12, 2012 at 12:33 PM, Mikhail Bautin
<bautin.mailing.lists@gmail.com> wrote:
> Hello Everyone,
>
> Does anyone know why Apache Jenkins has been down for about a day? We rely
> on the continuous integration server extensively to test HBase patches. Any
> help with this would be appreciated.
>
> Sincerely,
> --Mikhail
--
-Giri
From common-dev-return-77707-apmail-hadoop-common-dev-archive=hadoop.apache.org@hadoop.apache.org Mon Feb 13 19:37:26 2012
Return-Path: <common-dev-return-77707-apmail-hadoop-common-dev-archive=hadoop.apache.org@hadoop.apache.org>
X-Original-To: apmail-hadoop-common-dev-archive@www.apache.org
Delivered-To: apmail-hadoop-common-dev-archive@www.apache.org
Received: from mail.apache.org (hermes.apache.org [140.211.11.3])
by minotaur.apache.org (Postfix) with SMTP id 4778A916A
for <apmail-hadoop-common-dev-archive@www.apache.org>; Mon, 13 Feb 2012 19:37:26 +0000 (UTC)
Received: (qmail 58319 invoked by uid 500); 13 Feb 2012 19:37:24 -0000
Delivered-To: apmail-hadoop-common-dev-archive@hadoop.apache.org
Received: (qmail 57832 invoked by uid 500); 13 Feb 2012 19:37:23 -0000
Mailing-List: contact common-dev-help@hadoop.apache.org; run by ezmlm
Precedence: bulk
List-Help: <mailto:common-dev-help@hadoop.apache.org>
List-Unsubscribe: <mailto:common-dev-unsubscribe@hadoop.apache.org>
List-Post: <mailto:common-dev@hadoop.apache.org>
List-Id: <common-dev.hadoop.apache.org>
Reply-To: common-dev@hadoop.apache.org
Delivered-To: mailing list common-dev@hadoop.apache.org
Received: (qmail 57588 invoked by uid 99); 13 Feb 2012 19:37:22 -0000
Received: from nike.apache.org (HELO nike.apache.org) (192.87.106.230)
by apache.org (qpsmtpd/0.29) with ESMTP; Mon, 13 Feb 2012 19:37:22 +0000
X-ASF-Spam-Status: No, hits=-2000.0 required=5.0
tests=ALL_TRUSTED,T_RP_MATCHES_RCVD
X-Spam-Check-By: apache.org
Received: from [140.211.11.116] (HELO hel.zones.apache.org) (140.211.11.116)
by apache.org (qpsmtpd/0.29) with ESMTP; Mon, 13 Feb 2012 19:37:20 +0000
Received: from hel.zones.apache.org (hel.zones.apache.org [140.211.11.116])
by hel.zones.apache.org (Postfix) with ESMTP id A8EA51B4574
for <common-dev@hadoop.apache.org>; Mon, 13 Feb 2012 19:36:59 +0000 (UTC)
Date: Mon, 13 Feb 2012 19:36:59 +0000 (UTC)
From: "Aaron T. Myers (Created) (JIRA)" <jira@apache.org>
To: common-dev@hadoop.apache.org
Message-ID: <645342589.32981.1329161819693.JavaMail.tomcat@hel.zones.apache.org>
Subject: [jira] [Created] (HADOOP-8066) The full docs build intermittently
fails
MIME-Version: 1.0
Content-Type: text/plain; charset=utf-8
Content-Transfer-Encoding: 7bit
X-JIRA-FingerPrint: 30527f35849b9dde25b450d4833f0394
X-Virus-Checked: Checked by ClamAV on apache.org
The full docs build intermittently fails
----------------------------------------
Key: HADOOP-8066
URL: https://issues.apache.org/jira/browse/HADOOP-8066
Project: Hadoop Common
Issue Type: Bug
Components: build
Affects Versions: 0.24.0
Reporter: Aaron T. Myers
Assignee: Andrew Bayer
See for example:
https://builds.apache.org/job/Hadoop-Hdfs-trunk/954/
https://builds.apache.org/job/Hadoop-Common-trunk/317/
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
From common-dev-return-77708-apmail-hadoop-common-dev-archive=hadoop.apache.org@hadoop.apache.org Mon Feb 13 19:39:27 2012
Return-Path: <common-dev-return-77708-apmail-hadoop-common-dev-archive=hadoop.apache.org@hadoop.apache.org>
X-Original-To: apmail-hadoop-common-dev-archive@www.apache.org
Delivered-To: apmail-hadoop-common-dev-archive@www.apache.org
Received: from mail.apache.org (hermes.apache.org [140.211.11.3])
by minotaur.apache.org (Postfix) with SMTP id 3264D91E5
for <apmail-hadoop-common-dev-archive@www.apache.org>; Mon, 13 Feb 2012 19:39:27 +0000 (UTC)
Received: (qmail 62102 invoked by uid 500); 13 Feb 2012 19:39:24 -0000
Delivered-To: apmail-hadoop-common-dev-archive@hadoop.apache.org
Received: (qmail 61819 invoked by uid 500); 13 Feb 2012 19:39:23 -0000
Mailing-List: contact common-dev-help@hadoop.apache.org; run by ezmlm
Precedence: bulk
List-Help: <mailto:common-dev-help@hadoop.apache.org>
List-Unsubscribe: <mailto:common-dev-unsubscribe@hadoop.apache.org>
List-Post: <mailto:common-dev@hadoop.apache.org>
List-Id: <common-dev.hadoop.apache.org>
Reply-To: common-dev@hadoop.apache.org
Delivered-To: mailing list common-dev@hadoop.apache.org
Received: (qmail 61806 invoked by uid 99); 13 Feb 2012 19:39:23 -0000
Received: from nike.apache.org (HELO nike.apache.org) (192.87.106.230)
by apache.org (qpsmtpd/0.29) with ESMTP; Mon, 13 Feb 2012 19:39:23 +0000
X-ASF-Spam-Status: No, hits=-2000.0 required=5.0
tests=ALL_TRUSTED,T_RP_MATCHES_RCVD
X-Spam-Check-By: apache.org
Received: from [140.211.11.116] (HELO hel.zones.apache.org) (140.211.11.116)
by apache.org (qpsmtpd/0.29) with ESMTP; Mon, 13 Feb 2012 19:39:20 +0000
Received: from hel.zones.apache.org (hel.zones.apache.org [140.211.11.116])
by hel.zones.apache.org (Postfix) with ESMTP id BFE531B47D2
for <common-dev@hadoop.apache.org>; Mon, 13 Feb 2012 19:38:59 +0000 (UTC)
Date: Mon, 13 Feb 2012 19:38:59 +0000 (UTC)
From: "Tom White (Resolved) (JIRA)" <jira@apache.org>
To: common-dev@hadoop.apache.org
Message-ID: <481482741.32989.1329161939787.JavaMail.tomcat@hel.zones.apache.org>
In-Reply-To: <1405076938.14133.1319561072277.JavaMail.tomcat@hel.zones.apache.org>
Subject: [jira] [Resolved] (HADOOP-7767) Document deprecated configuration
properties
MIME-Version: 1.0
Content-Type: text/plain; charset=utf-8
Content-Transfer-Encoding: 7bit
X-JIRA-FingerPrint: 30527f35849b9dde25b450d4833f0394
X-Virus-Checked: Checked by ClamAV on apache.org
[ https://issues.apache.org/jira/browse/HADOOP-7767?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Tom White resolved HADOOP-7767.
-------------------------------
Resolution: Duplicate
Fix Version/s: (was: 0.24.0)
This was fixed in HADOOP-7763.
> Document deprecated configuration properties
> --------------------------------------------
>
> Key: HADOOP-7767
> URL: https://issues.apache.org/jira/browse/HADOOP-7767
> Project: Hadoop Common
> Issue Type: Improvement
> Components: documentation
> Reporter: Tom White
> Assignee: Tom White
> Attachments: HADOOP-7767.patch
>
>
> Many configuration properties are deprecated in 0.23. We should include a table in the documentation that maps between the old and new names.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
From common-dev-return-77709-apmail-hadoop-common-dev-archive=hadoop.apache.org@hadoop.apache.org Mon Feb 13 19:45:25 2012
Return-Path: <common-dev-return-77709-apmail-hadoop-common-dev-archive=hadoop.apache.org@hadoop.apache.org>
X-Original-To: apmail-hadoop-common-dev-archive@www.apache.org
Delivered-To: apmail-hadoop-common-dev-archive@www.apache.org
Received: from mail.apache.org (hermes.apache.org [140.211.11.3])
by minotaur.apache.org (Postfix) with SMTP id BAAA295C5
for <apmail-hadoop-common-dev-archive@www.apache.org>; Mon, 13 Feb 2012 19:45:25 +0000 (UTC)
Received: (qmail 78616 invoked by uid 500); 13 Feb 2012 19:45:23 -0000
Delivered-To: apmail-hadoop-common-dev-archive@hadoop.apache.org
Received: (qmail 78491 invoked by uid 500); 13 Feb 2012 19:45:22 -0000
Mailing-List: contact common-dev-help@hadoop.apache.org; run by ezmlm
Precedence: bulk
List-Help: <mailto:common-dev-help@hadoop.apache.org>
List-Unsubscribe: <mailto:common-dev-unsubscribe@hadoop.apache.org>
List-Post: <mailto:common-dev@hadoop.apache.org>
List-Id: <common-dev.hadoop.apache.org>
Reply-To: common-dev@hadoop.apache.org
Delivered-To: mailing list common-dev@hadoop.apache.org
Received: (qmail 78475 invoked by uid 99); 13 Feb 2012 19:45:22 -0000
Received: from nike.apache.org (HELO nike.apache.org) (192.87.106.230)
by apache.org (qpsmtpd/0.29) with ESMTP; Mon, 13 Feb 2012 19:45:22 +0000
X-ASF-Spam-Status: No, hits=-2000.0 required=5.0
tests=ALL_TRUSTED,T_RP_MATCHES_RCVD
X-Spam-Check-By: apache.org
Received: from [140.211.11.116] (HELO hel.zones.apache.org) (140.211.11.116)
by apache.org (qpsmtpd/0.29) with ESMTP; Mon, 13 Feb 2012 19:45:20 +0000
Received: from hel.zones.apache.org (hel.zones.apache.org [140.211.11.116])
by hel.zones.apache.org (Postfix) with ESMTP id 7E38F1B4C42
for <common-dev@hadoop.apache.org>; Mon, 13 Feb 2012 19:44:59 +0000 (UTC)
Date: Mon, 13 Feb 2012 19:44:59 +0000 (UTC)
From: "Tom White (Resolved) (JIRA)" <jira@apache.org>
To: common-dev@hadoop.apache.org
Message-ID: <1796666086.33040.1329162299518.JavaMail.tomcat@hel.zones.apache.org>
Subject: [jira] [Resolved] (HADOOP-6437) HOD tests are not being run by
'test-contrib'
MIME-Version: 1.0
Content-Type: text/plain; charset=utf-8
Content-Transfer-Encoding: 7bit
X-JIRA-FingerPrint: 30527f35849b9dde25b450d4833f0394
X-Virus-Checked: Checked by ClamAV on apache.org
[ https://issues.apache.org/jira/browse/HADOOP-6437?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Tom White resolved HADOOP-6437.
-------------------------------
Resolution: Not A Problem
HOD was removed in HADOOP-7137.
> HOD tests are not being run by 'test-contrib'
> ---------------------------------------------
>
> Key: HADOOP-6437
> URL: https://issues.apache.org/jira/browse/HADOOP-6437
> Project: Hadoop Common
> Issue Type: Bug
> Reporter: Tom White
>
> The contrib projects build files were not being referenced correctly (post project split, see HADOOP-6426) so HOD tests are not being run. HOD tests need python.home to be set, but we should probably not run them if it is not set (Hudson sets this variable).
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
From common-dev-return-77710-apmail-hadoop-common-dev-archive=hadoop.apache.org@hadoop.apache.org Mon Feb 13 22:19:26 2012
Return-Path: <common-dev-return-77710-apmail-hadoop-common-dev-archive=hadoop.apache.org@hadoop.apache.org>
X-Original-To: apmail-hadoop-common-dev-archive@www.apache.org
Delivered-To: apmail-hadoop-common-dev-archive@www.apache.org
Received: from mail.apache.org (hermes.apache.org [140.211.11.3])
by minotaur.apache.org (Postfix) with SMTP id 1B239975D
for <apmail-hadoop-common-dev-archive@www.apache.org>; Mon, 13 Feb 2012 22:19:26 +0000 (UTC)
Received: (qmail 15646 invoked by uid 500); 13 Feb 2012 22:19:24 -0000
Delivered-To: apmail-hadoop-common-dev-archive@hadoop.apache.org
Received: (qmail 15257 invoked by uid 500); 13 Feb 2012 22:19:23 -0000
Mailing-List: contact common-dev-help@hadoop.apache.org; run by ezmlm
Precedence: bulk
List-Help: <mailto:common-dev-help@hadoop.apache.org>
List-Unsubscribe: <mailto:common-dev-unsubscribe@hadoop.apache.org>
List-Post: <mailto:common-dev@hadoop.apache.org>
List-Id: <common-dev.hadoop.apache.org>
Reply-To: common-dev@hadoop.apache.org
Delivered-To: mailing list common-dev@hadoop.apache.org
Received: (qmail 15222 invoked by uid 99); 13 Feb 2012 22:19:22 -0000
Received: from nike.apache.org (HELO nike.apache.org) (192.87.106.230)
by apache.org (qpsmtpd/0.29) with ESMTP; Mon, 13 Feb 2012 22:19:22 +0000
X-ASF-Spam-Status: No, hits=-2000.0 required=5.0
tests=ALL_TRUSTED,T_RP_MATCHES_RCVD
X-Spam-Check-By: apache.org
Received: from [140.211.11.116] (HELO hel.zones.apache.org) (140.211.11.116)
by apache.org (qpsmtpd/0.29) with ESMTP; Mon, 13 Feb 2012 22:19:20 +0000
Received: from hel.zones.apache.org (hel.zones.apache.org [140.211.11.116])
by hel.zones.apache.org (Postfix) with ESMTP id BBE521B425B
for <common-dev@hadoop.apache.org>; Mon, 13 Feb 2012 22:18:59 +0000 (UTC)
Date: Mon, 13 Feb 2012 22:18:59 +0000 (UTC)
From: "John Lewis (Created) (JIRA)" <jira@apache.org>
To: common-dev@hadoop.apache.org
Message-ID: <981108191.33810.1329171539770.JavaMail.tomcat@hel.zones.apache.org>
Subject: [jira] [Created] (HADOOP-8067) Errors building
hadoop-gpl-compression with Hadoop 1.0.0 and HBase 0.92.0
MIME-Version: 1.0
Content-Type: text/plain; charset=utf-8
Content-Transfer-Encoding: 7bit
X-JIRA-FingerPrint: 30527f35849b9dde25b450d4833f0394
X-Virus-Checked: Checked by ClamAV on apache.org
Errors building hadoop-gpl-compression with Hadoop 1.0.0 and HBase 0.92.0
-------------------------------------------------------------------------
Key: HADOOP-8067
URL: https://issues.apache.org/jira/browse/HADOOP-8067
Project: Hadoop Common
Issue Type: Bug
Components: build
Affects Versions: 1.0.0
Environment: Red Hat 5.5 64bit
Reporter: John Lewis
We were able to successfully configure and run HBase 0.92.0 on top of Hadoop 1.0.0. But when we were following the directions stated on http://wiki.apache.org/hadoop/UsingLzoCompression on enabling LZO compression in HBase we are getting errors building hadoop-gpl-compression with the hadoop-core-1.0.0.jar. These errors seem to be a result of different classes being deprecated.
When we use an older version of hadoop core jar such as hadoop-core-0.20.2.jar, we are able to build the hadoop-gpl-compression-0.1.0-dev.jar and native folder with no errors. Also after copying those files to the HBase library LZO functions without any errors even with HBase being on top of Hadoop 1.0.0.
Is there an LZO build compatible with Hadoop 1.0.0?
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
From common-dev-return-77711-apmail-hadoop-common-dev-archive=hadoop.apache.org@hadoop.apache.org Mon Feb 13 23:39:23 2012
Return-Path: <common-dev-return-77711-apmail-hadoop-common-dev-archive=hadoop.apache.org@hadoop.apache.org>
X-Original-To: apmail-hadoop-common-dev-archive@www.apache.org
Delivered-To: apmail-hadoop-common-dev-archive@www.apache.org
Received: from mail.apache.org (hermes.apache.org [140.211.11.3])
by minotaur.apache.org (Postfix) with SMTP id 315DB9A03
for <apmail-hadoop-common-dev-archive@www.apache.org>; Mon, 13 Feb 2012 23:39:23 +0000 (UTC)
Received: (qmail 47745 invoked by uid 500); 13 Feb 2012 23:39:21 -0000
Delivered-To: apmail-hadoop-common-dev-archive@hadoop.apache.org
Received: (qmail 47616 invoked by uid 500); 13 Feb 2012 23:39:20 -0000
Mailing-List: contact common-dev-help@hadoop.apache.org; run by ezmlm
Precedence: bulk
List-Help: <mailto:common-dev-help@hadoop.apache.org>
List-Unsubscribe: <mailto:common-dev-unsubscribe@hadoop.apache.org>
List-Post: <mailto:common-dev@hadoop.apache.org>
List-Id: <common-dev.hadoop.apache.org>
Reply-To: common-dev@hadoop.apache.org
Delivered-To: mailing list common-dev@hadoop.apache.org
Received: (qmail 47603 invoked by uid 99); 13 Feb 2012 23:39:20 -0000
Received: from athena.apache.org (HELO athena.apache.org) (140.211.11.136)
by apache.org (qpsmtpd/0.29) with ESMTP; Mon, 13 Feb 2012 23:39:20 +0000
X-ASF-Spam-Status: No, hits=-2000.0 required=5.0
tests=ALL_TRUSTED,T_RP_MATCHES_RCVD
X-Spam-Check-By: apache.org
Received: from [140.211.11.116] (HELO hel.zones.apache.org) (140.211.11.116)
by apache.org (qpsmtpd/0.29) with ESMTP; Mon, 13 Feb 2012 23:39:19 +0000
Received: from hel.zones.apache.org (hel.zones.apache.org [140.211.11.116])
by hel.zones.apache.org (Postfix) with ESMTP id 9B8D71B5048
for <common-dev@hadoop.apache.org>; Mon, 13 Feb 2012 23:38:59 +0000 (UTC)
Date: Mon, 13 Feb 2012 23:38:59 +0000 (UTC)
From: "Todd Lipcon (Created) (JIRA)" <jira@apache.org>
To: common-dev@hadoop.apache.org
Message-ID: <1158260874.34332.1329176339638.JavaMail.tomcat@hel.zones.apache.org>
Subject: [jira] [Created] (HADOOP-8068) HA: void methods can swallow
exceptions when going through failover path
MIME-Version: 1.0
Content-Type: text/plain; charset=utf-8
Content-Transfer-Encoding: 7bit
X-JIRA-FingerPrint: 30527f35849b9dde25b450d4833f0394
HA: void methods can swallow exceptions when going through failover path
------------------------------------------------------------------------
Key: HADOOP-8068
URL: https://issues.apache.org/jira/browse/HADOOP-8068
Project: Hadoop Common
Issue Type: Bug
Components: ha, ipc
Affects Versions: HA Branch (HDFS-1623)
Reporter: Todd Lipcon
Assignee: Todd Lipcon
Priority: Blocker
While running through scale testing, we saw an issue where clients were getting LeaseExpiredExceptions. We eventually tracked it down to the fact that some {{create}} calls had timed out (having been sent to a NN just before it crashed) but the resulting exception was swallowed by the retry policy code paths.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
From common-dev-return-77712-apmail-hadoop-common-dev-archive=hadoop.apache.org@hadoop.apache.org Tue Feb 14 04:13:56 2012
Return-Path: <common-dev-return-77712-apmail-hadoop-common-dev-archive=hadoop.apache.org@hadoop.apache.org>
X-Original-To: apmail-hadoop-common-dev-archive@www.apache.org
Delivered-To: apmail-hadoop-common-dev-archive@www.apache.org
Received: from mail.apache.org (hermes.apache.org [140.211.11.3])
by minotaur.apache.org (Postfix) with SMTP id 294D292B1
for <apmail-hadoop-common-dev-archive@www.apache.org>; Tue, 14 Feb 2012 04:13:56 +0000 (UTC)
Received: (qmail 68508 invoked by uid 500); 14 Feb 2012 04:13:53 -0000
Delivered-To: apmail-hadoop-common-dev-archive@hadoop.apache.org
Received: (qmail 61795 invoked by uid 500); 14 Feb 2012 04:13:31 -0000
Mailing-List: contact common-dev-help@hadoop.apache.org; run by ezmlm
Precedence: bulk
List-Help: <mailto:common-dev-help@hadoop.apache.org>
List-Unsubscribe: <mailto:common-dev-unsubscribe@hadoop.apache.org>
List-Post: <mailto:common-dev@hadoop.apache.org>
List-Id: <common-dev.hadoop.apache.org>
Reply-To: common-dev@hadoop.apache.org
Delivered-To: mailing list common-dev@hadoop.apache.org
Received: (qmail 61754 invoked by uid 99); 14 Feb 2012 04:13:24 -0000
Received: from nike.apache.org (HELO nike.apache.org) (192.87.106.230)
by apache.org (qpsmtpd/0.29) with ESMTP; Tue, 14 Feb 2012 04:13:24 +0000
X-ASF-Spam-Status: No, hits=-2000.0 required=5.0
tests=ALL_TRUSTED,T_RP_MATCHES_RCVD
X-Spam-Check-By: apache.org
Received: from [140.211.11.116] (HELO hel.zones.apache.org) (140.211.11.116)
by apache.org (qpsmtpd/0.29) with ESMTP; Tue, 14 Feb 2012 04:13:20 +0000
Received: from hel.zones.apache.org (hel.zones.apache.org [140.211.11.116])
by hel.zones.apache.org (Postfix) with ESMTP id BB63C1B52FF
for <common-dev@hadoop.apache.org>; Tue, 14 Feb 2012 04:12:59 +0000 (UTC)
Date: Tue, 14 Feb 2012 04:12:59 +0000 (UTC)
From: "Todd Lipcon (Created) (JIRA)" <jira@apache.org>
To: common-dev@hadoop.apache.org
Message-ID: <1318607522.35214.1329192779768.JavaMail.tomcat@hel.zones.apache.org>
Subject: [jira] [Created] (HADOOP-8069) Enable TCP_NODELAY by default for
IPC
MIME-Version: 1.0
Content-Type: text/plain; charset=utf-8
Content-Transfer-Encoding: 7bit
X-JIRA-FingerPrint: 30527f35849b9dde25b450d4833f0394
X-Virus-Checked: Checked by ClamAV on apache.org
Enable TCP_NODELAY by default for IPC
-------------------------------------
Key: HADOOP-8069
URL: https://issues.apache.org/jira/browse/HADOOP-8069
Project: Hadoop Common
Issue Type: Improvement
Components: ipc
Affects Versions: 0.23.0
Reporter: Todd Lipcon
Assignee: Todd Lipcon
I think we should switch the default for the IPC client and server NODELAY options to true. As wikipedia says:
{quote}
In general, since Nagle's algorithm is only a defense against careless applications, it will not benefit a carefully written application that takes proper care of buffering; the algorithm has either no effect, or negative effect on the application.
{quote}
Since our IPC layer is well contained and does its own buffering, we shouldn't be careless.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
From common-dev-return-77713-apmail-hadoop-common-dev-archive=hadoop.apache.org@hadoop.apache.org Tue Feb 14 04:15:37 2012
Return-Path: <common-dev-return-77713-apmail-hadoop-common-dev-archive=hadoop.apache.org@hadoop.apache.org>
X-Original-To: apmail-hadoop-common-dev-archive@www.apache.org
Delivered-To: apmail-hadoop-common-dev-archive@www.apache.org
Received: from mail.apache.org (hermes.apache.org [140.211.11.3])
by minotaur.apache.org (Postfix) with SMTP id 0A5A992FE
for <apmail-hadoop-common-dev-archive@www.apache.org>; Tue, 14 Feb 2012 04:15:37 +0000 (UTC)
Received: (qmail 70852 invoked by uid 500); 14 Feb 2012 04:15:32 -0000
Delivered-To: apmail-hadoop-common-dev-archive@hadoop.apache.org
Received: (qmail 70325 invoked by uid 500); 14 Feb 2012 04:15:24 -0000
Mailing-List: contact common-dev-help@hadoop.apache.org; run by ezmlm
Precedence: bulk
List-Help: <mailto:common-dev-help@hadoop.apache.org>
List-Unsubscribe: <mailto:common-dev-unsubscribe@hadoop.apache.org>
List-Post: <mailto:common-dev@hadoop.apache.org>
List-Id: <common-dev.hadoop.apache.org>
Reply-To: common-dev@hadoop.apache.org
Delivered-To: mailing list common-dev@hadoop.apache.org
Received: (qmail 70312 invoked by uid 99); 14 Feb 2012 04:15:22 -0000
Received: from nike.apache.org (HELO nike.apache.org) (192.87.106.230)
by apache.org (qpsmtpd/0.29) with ESMTP; Tue, 14 Feb 2012 04:15:22 +0000
X-ASF-Spam-Status: No, hits=-2000.0 required=5.0
tests=ALL_TRUSTED,T_RP_MATCHES_RCVD
X-Spam-Check-By: apache.org
Received: from [140.211.11.116] (HELO hel.zones.apache.org) (140.211.11.116)
by apache.org (qpsmtpd/0.29) with ESMTP; Tue, 14 Feb 2012 04:15:20 +0000
Received: from hel.zones.apache.org (hel.zones.apache.org [140.211.11.116])
by hel.zones.apache.org (Postfix) with ESMTP id 6B4851B53AE
for <common-dev@hadoop.apache.org>; Tue, 14 Feb 2012 04:14:59 +0000 (UTC)
Date: Tue, 14 Feb 2012 04:14:59 +0000 (UTC)
From: "Todd Lipcon (Created) (JIRA)" <jira@apache.org>
To: common-dev@hadoop.apache.org
Message-ID: <206506964.35221.1329192899440.JavaMail.tomcat@hel.zones.apache.org>
Subject: [jira] [Created] (HADOOP-8070) Add standalone benchmark of protobuf
IPC
MIME-Version: 1.0
Content-Type: text/plain; charset=utf-8
Content-Transfer-Encoding: 7bit
X-JIRA-FingerPrint: 30527f35849b9dde25b450d4833f0394
X-Virus-Checked: Checked by ClamAV on apache.org
Add standalone benchmark of protobuf IPC
----------------------------------------
Key: HADOOP-8070
URL: https://issues.apache.org/jira/browse/HADOOP-8070
Project: Hadoop Common
Issue Type: Improvement
Components: benchmarks, ipc
Affects Versions: 0.24.0
Reporter: Todd Lipcon
Assignee: Todd Lipcon
Fix For: 0.24.0
To be more comfortable with the switch to protobuf IPC, I'd like to contribute a standalone benchmark which can start any number of client threads and server threads.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
From common-dev-return-77714-apmail-hadoop-common-dev-archive=hadoop.apache.org@hadoop.apache.org Tue Feb 14 05:37:34 2012
Return-Path: <common-dev-return-77714-apmail-hadoop-common-dev-archive=hadoop.apache.org@hadoop.apache.org>
X-Original-To: apmail-hadoop-common-dev-archive@www.apache.org
Delivered-To: apmail-hadoop-common-dev-archive@www.apache.org
Received: from mail.apache.org (hermes.apache.org [140.211.11.3])
by minotaur.apache.org (Postfix) with SMTP id ED5729044
for <apmail-hadoop-common-dev-archive@www.apache.org>; Tue, 14 Feb 2012 05:37:34 +0000 (UTC)
Received: (qmail 44096 invoked by uid 500); 14 Feb 2012 05:37:32 -0000
Delivered-To: apmail-hadoop-common-dev-archive@hadoop.apache.org
Received: (qmail 43068 invoked by uid 500); 14 Feb 2012 05:37:23 -0000
Mailing-List: contact common-dev-help@hadoop.apache.org; run by ezmlm
Precedence: bulk
List-Help: <mailto:common-dev-help@hadoop.apache.org>
List-Unsubscribe: <mailto:common-dev-unsubscribe@hadoop.apache.org>
List-Post: <mailto:common-dev@hadoop.apache.org>
List-Id: <common-dev.hadoop.apache.org>
Reply-To: common-dev@hadoop.apache.org
Delivered-To: mailing list common-dev@hadoop.apache.org
Received: (qmail 43030 invoked by uid 99); 14 Feb 2012 05:37:20 -0000
Received: from athena.apache.org (HELO athena.apache.org) (140.211.11.136)
by apache.org (qpsmtpd/0.29) with ESMTP; Tue, 14 Feb 2012 05:37:20 +0000
X-ASF-Spam-Status: No, hits=-2000.0 required=5.0
tests=ALL_TRUSTED,T_RP_MATCHES_RCVD
X-Spam-Check-By: apache.org
Received: from [140.211.11.116] (HELO hel.zones.apache.org) (140.211.11.116)
by apache.org (qpsmtpd/0.29) with ESMTP; Tue, 14 Feb 2012 05:37:19 +0000
Received: from hel.zones.apache.org (hel.zones.apache.org [140.211.11.116])
by hel.zones.apache.org (Postfix) with ESMTP id 7CF0D1B5611
for <common-dev@hadoop.apache.org>; Tue, 14 Feb 2012 05:36:59 +0000 (UTC)
Date: Tue, 14 Feb 2012 05:36:59 +0000 (UTC)
From: "Todd Lipcon (Created) (JIRA)" <jira@apache.org>
To: common-dev@hadoop.apache.org
Message-ID: <788350500.35398.1329197819513.JavaMail.tomcat@hel.zones.apache.org>
Subject: [jira] [Created] (HADOOP-8071) Avoid an extra packet in client code
when nagling is disabled
MIME-Version: 1.0
Content-Type: text/plain; charset=utf-8
Content-Transfer-Encoding: 7bit
X-JIRA-FingerPrint: 30527f35849b9dde25b450d4833f0394
Avoid an extra packet in client code when nagling is disabled
-------------------------------------------------------------
Key: HADOOP-8071
URL: https://issues.apache.org/jira/browse/HADOOP-8071
Project: Hadoop Common
Issue Type: Improvement
Components: ipc
Affects Versions: 0.23.1
Reporter: Todd Lipcon
Assignee: Todd Lipcon
Priority: Minor
Currently, if you disable TCP_NODELAY in the IPC client, you get an extra packet for each call which contains the call's length. This is unnecessary. Instead, we can just reserve the 4 bytes in the buffer up front, then go back to fill it in before pushing the call to the wire.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
From common-dev-return-77715-apmail-hadoop-common-dev-archive=hadoop.apache.org@hadoop.apache.org Tue Feb 14 05:46:02 2012
Return-Path: <common-dev-return-77715-apmail-hadoop-common-dev-archive=hadoop.apache.org@hadoop.apache.org>
X-Original-To: apmail-hadoop-common-dev-archive@www.apache.org
Delivered-To: apmail-hadoop-common-dev-archive@www.apache.org
Received: from mail.apache.org (hermes.apache.org [140.211.11.3])
by minotaur.apache.org (Postfix) with SMTP id 31CEA914E
for <apmail-hadoop-common-dev-archive@www.apache.org>; Tue, 14 Feb 2012 05:46:02 +0000 (UTC)
Received: (qmail 48803 invoked by uid 500); 14 Feb 2012 05:45:59 -0000
Delivered-To: apmail-hadoop-common-dev-archive@hadoop.apache.org
Received: (qmail 48377 invoked by uid 500); 14 Feb 2012 05:45:48 -0000
Mailing-List: contact common-dev-help@hadoop.apache.org; run by ezmlm
Precedence: bulk
List-Help: <mailto:common-dev-help@hadoop.apache.org>
List-Unsubscribe: <mailto:common-dev-unsubscribe@hadoop.apache.org>
List-Post: <mailto:common-dev@hadoop.apache.org>
List-Id: <common-dev.hadoop.apache.org>
Reply-To: common-dev@hadoop.apache.org
Delivered-To: mailing list common-dev@hadoop.apache.org
Received: (qmail 48368 invoked by uid 500); 14 Feb 2012 05:45:46 -0000
Delivered-To: apmail-hadoop-core-dev@hadoop.apache.org
Received: (qmail 48365 invoked by uid 500); 14 Feb 2012 05:45:45 -0000
Delivered-To: apmail-lucene-hadoop-dev@lucene.apache.org
Received: (qmail 48362 invoked by uid 99); 14 Feb 2012 05:45:45 -0000
Received: from athena.apache.org (HELO athena.apache.org) (140.211.11.136)
by apache.org (qpsmtpd/0.29) with ESMTP; Tue, 14 Feb 2012 05:45:45 +0000
X-ASF-Spam-Status: No, hits=2.0 required=5.0
tests=SPF_NEUTRAL,URI_HEX
X-Spam-Check-By: apache.org
Received-SPF: neutral (athena.apache.org: 216.139.236.26 is neither permitted nor denied by domain of tiangangzhu@gmail.com)
Received: from [216.139.236.26] (HELO sam.nabble.com) (216.139.236.26)
by apache.org (qpsmtpd/0.29) with ESMTP; Tue, 14 Feb 2012 05:45:40 +0000
Received: from ben.nabble.com ([192.168.236.152])
by sam.nabble.com with esmtp (Exim 4.72)
(envelope-from <tiangangzhu@gmail.com>)
id 1RxBCZ-00050c-KD
for hadoop-dev@lucene.apache.org; Mon, 13 Feb 2012 21:45:19 -0800
Date: Mon, 13 Feb 2012 21:45:19 -0800 (PST)
From: 27g <tiangangzhu@gmail.com>
To: hadoop-dev@lucene.apache.org
Message-ID: <1329198319616-3742786.post@n3.nabble.com>
Subject: =?UTF-8?Q?I_need_some_materials_about_a?=
=?UTF-8?Q?nalyzing_mapreduce_sourcecode=EF=BC=81?=
MIME-Version: 1.0
Content-Type: text/plain; charset=UTF-8
Content-Transfer-Encoding: quoted-printable
Please recommend me some some materials about analyzing mapreduce
sourcecode=EF=BC=8Cbook=EF=BC=8Cblogs=EF=BC=8Cpaper and so on=EF=BC=8Call o=
f them are ok! Thanks!
--
View this message in context: http://lucene.472066.n3.nabble.com/I-need-som=
e-materials-about-analyzing-mapreduce-sourcecode-tp3742786p3742786.html
Sent from the Hadoop lucene-dev mailing list archive at Nabble.com.
From common-dev-return-77716-apmail-hadoop-common-dev-archive=hadoop.apache.org@hadoop.apache.org Tue Feb 14 06:25:32 2012
Return-Path: <common-dev-return-77716-apmail-hadoop-common-dev-archive=hadoop.apache.org@hadoop.apache.org>
X-Original-To: apmail-hadoop-common-dev-archive@www.apache.org
Delivered-To: apmail-hadoop-common-dev-archive@www.apache.org
Received: from mail.apache.org (hermes.apache.org [140.211.11.3])
by minotaur.apache.org (Postfix) with SMTP id D3771928C
for <apmail-hadoop-common-dev-archive@www.apache.org>; Tue, 14 Feb 2012 06:25:32 +0000 (UTC)
Received: (qmail 79289 invoked by uid 500); 14 Feb 2012 06:25:30 -0000
Delivered-To: apmail-hadoop-common-dev-archive@hadoop.apache.org
Received: (qmail 78735 invoked by uid 500); 14 Feb 2012 06:25:26 -0000
Mailing-List: contact common-dev-help@hadoop.apache.org; run by ezmlm
Precedence: bulk
List-Help: <mailto:common-dev-help@hadoop.apache.org>
List-Unsubscribe: <mailto:common-dev-unsubscribe@hadoop.apache.org>
List-Post: <mailto:common-dev@hadoop.apache.org>
List-Id: <common-dev.hadoop.apache.org>
Reply-To: common-dev@hadoop.apache.org
Delivered-To: mailing list common-dev@hadoop.apache.org
Received: (qmail 78713 invoked by uid 99); 14 Feb 2012 06:25:23 -0000
Received: from nike.apache.org (HELO nike.apache.org) (192.87.106.230)
by apache.org (qpsmtpd/0.29) with ESMTP; Tue, 14 Feb 2012 06:25:23 +0000
X-ASF-Spam-Status: No, hits=-2000.0 required=5.0
tests=ALL_TRUSTED,T_RP_MATCHES_RCVD
X-Spam-Check-By: apache.org
Received: from [140.211.11.116] (HELO hel.zones.apache.org) (140.211.11.116)
by apache.org (qpsmtpd/0.29) with ESMTP; Tue, 14 Feb 2012 06:25:21 +0000
Received: from hel.zones.apache.org (hel.zones.apache.org [140.211.11.116])
by hel.zones.apache.org (Postfix) with ESMTP id 96D4E1B5832
for <common-dev@hadoop.apache.org>; Tue, 14 Feb 2012 06:24:59 +0000 (UTC)
Date: Tue, 14 Feb 2012 06:24:59 +0000 (UTC)
From: "Matt Foley (Resolved) (JIRA)" <jira@apache.org>
To: common-dev@hadoop.apache.org
Message-ID: <1683803342.35470.1329200699619.JavaMail.tomcat@hel.zones.apache.org>
In-Reply-To: <740714091.13751.1328689919516.JavaMail.tomcat@hel.zones.apache.org>
Subject: [jira] [Resolved] (HADOOP-8037) Binary tarball does not preserve
platform info for native builds, and RPMs fail to provide needed symlinks
for libhadoop.so
MIME-Version: 1.0
Content-Type: text/plain; charset=utf-8
Content-Transfer-Encoding: 7bit
X-JIRA-FingerPrint: 30527f35849b9dde25b450d4833f0394
X-Virus-Checked: Checked by ClamAV on apache.org
[ https://issues.apache.org/jira/browse/HADOOP-8037?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Matt Foley resolved HADOOP-8037.
--------------------------------
Resolution: Fixed
Fix Version/s: 1.0.1
Committed to branch-1 and branch-1.0.
> Binary tarball does not preserve platform info for native builds, and RPMs fail to provide needed symlinks for libhadoop.so
> ---------------------------------------------------------------------------------------------------------------------------
>
> Key: HADOOP-8037
> URL: https://issues.apache.org/jira/browse/HADOOP-8037
> Project: Hadoop Common
> Issue Type: Bug
> Components: build
> Affects Versions: 1.0.1
> Reporter: Matt Foley
> Assignee: Matt Foley
> Priority: Blocker
> Fix For: 1.0.1
>
> Attachments: hadoop-8027-1.patch, hadoop-8037-1.patch, hadoop-8037-2.patch, hadoop-8037.patch
>
>
> The source tarball uses "package" ant target, which includes both sets of native builds (32 and 64 bit libraries), under subdirectories that are named for the supported platform, so you can tell what they are.
> The binary tarball uses the "bin-package" ant target, which projects both sets of native builds into a single directory, stripping out the platform names from the directory paths. Since the native built libraries have identical names, only one of each survives the process. Afterward, there is no way to know whether they are intended for 32 or 64 bit environments.
> It seems to be done this way as a step toward building the rpm and deb artifacts. But the rpms and debs are self-identifying as to the platform they were built for, and contain only one set of libs each, while the binary tarball isn't. The binary tarball should have the same platform-specific subdirectories that the full tarball does; but this means that the rpm and deb builds have to be more careful about include/exclude specs for what goes into those artifacts.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
From common-dev-return-77717-apmail-hadoop-common-dev-archive=hadoop.apache.org@hadoop.apache.org Tue Feb 14 08:02:40 2012
Return-Path: <common-dev-return-77717-apmail-hadoop-common-dev-archive=hadoop.apache.org@hadoop.apache.org>
X-Original-To: apmail-hadoop-common-dev-archive@www.apache.org
Delivered-To: apmail-hadoop-common-dev-archive@www.apache.org
Received: from mail.apache.org (hermes.apache.org [140.211.11.3])
by minotaur.apache.org (Postfix) with SMTP id 3AC899864
for <apmail-hadoop-common-dev-archive@www.apache.org>; Tue, 14 Feb 2012 08:02:40 +0000 (UTC)
Received: (qmail 71709 invoked by uid 500); 14 Feb 2012 08:02:38 -0000
Delivered-To: apmail-hadoop-common-dev-archive@hadoop.apache.org
Received: (qmail 70399 invoked by uid 500); 14 Feb 2012 08:02:26 -0000
Mailing-List: contact common-dev-help@hadoop.apache.org; run by ezmlm
Precedence: bulk
List-Help: <mailto:common-dev-help@hadoop.apache.org>
List-Unsubscribe: <mailto:common-dev-unsubscribe@hadoop.apache.org>
List-Post: <mailto:common-dev@hadoop.apache.org>
List-Id: <common-dev.hadoop.apache.org>
Reply-To: common-dev@hadoop.apache.org
Delivered-To: mailing list common-dev@hadoop.apache.org
Received: (qmail 70319 invoked by uid 99); 14 Feb 2012 08:02:23 -0000
Received: from athena.apache.org (HELO athena.apache.org) (140.211.11.136)
by apache.org (qpsmtpd/0.29) with ESMTP; Tue, 14 Feb 2012 08:02:23 +0000
X-ASF-Spam-Status: No, hits=-2000.0 required=5.0
tests=ALL_TRUSTED,T_RP_MATCHES_RCVD
X-Spam-Check-By: apache.org
Received: from [140.211.11.116] (HELO hel.zones.apache.org) (140.211.11.116)
by apache.org (qpsmtpd/0.29) with ESMTP; Tue, 14 Feb 2012 08:02:22 +0000
Received: from hel.zones.apache.org (hel.zones.apache.org [140.211.11.116])
by hel.zones.apache.org (Postfix) with ESMTP id 6FD811B679D
for <common-dev@hadoop.apache.org>; Tue, 14 Feb 2012 08:02:02 +0000 (UTC)
Date: Tue, 14 Feb 2012 08:02:02 +0000 (UTC)
From: "Matt Foley (Reopened) (JIRA)" <jira@apache.org>
To: common-dev@hadoop.apache.org
Message-ID: <2050181781.35653.1329206522459.JavaMail.tomcat@hel.zones.apache.org>
In-Reply-To: <811467644.12104.1328031550227.JavaMail.tomcat@hel.zones.apache.org>
Subject: [jira] [Reopened] (HADOOP-8009) Create hadoop-client and
hadoop-minicluster artifacts for downstream projects
MIME-Version: 1.0
Content-Type: text/plain; charset=utf-8
Content-Transfer-Encoding: 7bit
X-JIRA-FingerPrint: 30527f35849b9dde25b450d4833f0394
[ https://issues.apache.org/jira/browse/HADOOP-8009?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Matt Foley reopened HADOOP-8009:
--------------------------------
There was a bug in the branch-1 patch. A couple lines were missing in the "sign" target in build.xml, resulting in hadoop-client.jar and hadoop-minicluster.jar not getting signed, and therefore failing the upload. This new patch adds on to the previous one, to resolve the problem.
> Create hadoop-client and hadoop-minicluster artifacts for downstream projects
> ------------------------------------------------------------------------------
>
> Key: HADOOP-8009
> URL: https://issues.apache.org/jira/browse/HADOOP-8009
> Project: Hadoop Common
> Issue Type: Improvement
> Components: build
> Affects Versions: 0.22.0, 0.23.0, 0.24.0, 0.23.1, 1.0.0
> Reporter: Alejandro Abdelnur
> Assignee: Alejandro Abdelnur
> Priority: Critical
> Fix For: 0.23.1, 1.0.1
>
> Attachments: HADOOP-8009-branch-1-add.patch, HADOOP-8009-branch-1.patch, HADOOP-8009-existing-releases.patch, HADOOP-8009.patch
>
>
> Using Hadoop from projects like Pig/Hive/Sqoop/Flume/Oozie or any in-house system that interacts with Hadoop is quite challenging for the following reasons:
> * *Different versions of Hadoop produce different artifacts:* Before Hadoop 0.23 there was a single artifact hadoop-core, starting with Hadoop 0.23 there are several (common, hdfs, mapred*, yarn*)
> * *There are no 'client' artifacts:* Current artifacts include all JARs needed to run the services, thus bringing into clients several JARs that are not used for job submission/monitoring (servlet, jsp, tomcat, jersey, etc.)
> * *Doing testing on the client side is also quite challenging as more artifacts have to be included than the dependencies define:* for example, the history-server artifact has to be explicitly included. If using Hadoop 1 artifacts, jersey-server has to be explicitly included.
> * *3rd party dependencies change in Hadoop from version to version:* This makes things complicated for projects that have to deal with multiple versions of Hadoop as their exclusions list become a huge mix & match of artifacts from different Hadoop versions and it may be break things when a particular version of Hadoop requires a dependency that other version of Hadoop does not require.
> Because of this it would be quite convenient to have the following 'aggregator' artifacts:
> * *org.apache.hadoop:hadoop-client* : it includes all required JARs to use Hadoop client APIs (excluding all JARs that are not needed for it)
> * *org.apache.hadoop:hadoop-minicluster* : it includes all required JARs to run Hadoop Mini Clusters
> These aggregator artifacts would be created for current branches under development (trunk, 0.22, 0.23, 1.0) and for released versions that are still in use.
> For branches under development, these artifacts would be generated as part of the build.
> For released versions we would have a a special branch used only as vehicle for publishing the corresponding 'aggregator' artifacts.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
From common-dev-return-77718-apmail-hadoop-common-dev-archive=hadoop.apache.org@hadoop.apache.org Tue Feb 14 11:59:38 2012
Return-Path: <common-dev-return-77718-apmail-hadoop-common-dev-archive=hadoop.apache.org@hadoop.apache.org>
X-Original-To: apmail-hadoop-common-dev-archive@www.apache.org
Delivered-To: apmail-hadoop-common-dev-archive@www.apache.org
Received: from mail.apache.org (hermes.apache.org [140.211.11.3])
by minotaur.apache.org (Postfix) with SMTP id 5640495DA
for <apmail-hadoop-common-dev-archive@www.apache.org>; Tue, 14 Feb 2012 11:59:38 +0000 (UTC)
Received: (qmail 40487 invoked by uid 500); 14 Feb 2012 11:54:39 -0000
Delivered-To: apmail-hadoop-common-dev-archive@hadoop.apache.org
Received: (qmail 8484 invoked by uid 500); 14 Feb 2012 11:50:47 -0000
Mailing-List: contact common-dev-help@hadoop.apache.org; run by ezmlm
Precedence: bulk
List-Help: <mailto:common-dev-help@hadoop.apache.org>
List-Unsubscribe: <mailto:common-dev-unsubscribe@hadoop.apache.org>
List-Post: <mailto:common-dev@hadoop.apache.org>
List-Id: <common-dev.hadoop.apache.org>
Reply-To: common-dev@hadoop.apache.org
Delivered-To: mailing list common-dev@hadoop.apache.org
Received: (qmail 5045 invoked by uid 99); 14 Feb 2012 09:36:26 -0000
Received: from nike.apache.org (HELO nike.apache.org) (192.87.106.230)
by apache.org (qpsmtpd/0.29) with ESMTP; Tue, 14 Feb 2012 09:36:26 +0000
X-ASF-Spam-Status: No, hits=-2000.0 required=5.0
tests=ALL_TRUSTED
X-Spam-Check-By: apache.org
Received: from [140.211.11.8] (HELO aegis.apache.org) (140.211.11.8)
by apache.org (qpsmtpd/0.29) with ESMTP; Tue, 14 Feb 2012 09:36:21 +0000
Received: from aegis (localhost [127.0.0.1])
by aegis.apache.org (Postfix) with ESMTP id 7C5A3C0005
for <common-dev@hadoop.apache.org>; Tue, 14 Feb 2012 09:35:59 +0000 (UTC)
Date: Tue, 14 Feb 2012 09:35:59 +0000 (UTC)
From: Apache Jenkins Server <jenkins@builds.apache.org>
To: common-dev@hadoop.apache.org
Message-ID: <2121096656.2531329212159492.JavaMail.hudson@aegis>
In-Reply-To: <430324247.591329125620311.JavaMail.hudson@aegis>
References: <430324247.591329125620311.JavaMail.hudson@aegis>
Subject: Build failed in Jenkins: Hadoop-Common-trunk #318
MIME-Version: 1.0
Content-Type: text/plain; charset=UTF-8
Content-Transfer-Encoding: quoted-printable
X-Jenkins-Job: Hadoop-Common-trunk
X-Jenkins-Result: FAILURE
X-Virus-Checked: Checked by ClamAV on apache.org
See <https://builds.apache.org/job/Hadoop-Common-trunk/318/changes>
Changes:
[atm] HDFS-2943. Expose last checkpoint time and transaction stats as JMX m=
etrics. Contributed by Aaron T. Myers.
[vinodkv] MAPREDUCE-3846. Addressed MR AM hanging issues during AM restart =
and then the recovery. (vinodkv)
[shv] MAPREDUCE-3837. Job tracker is not able to recover jobs after crash. =
Contributed by Mayank Bansal.
[atm] HDFS-2944. Typo in hdfs-default.xml causes dfs.client.block.write.rep=
lace-datanode-on-failure.enable to be mistakenly disabled. Contributed by A=
aron T. Myers.
[suresh] HDFS-2815. Namenode sometimes oes not come out of safemode during =
NN crash + restart. Contributed by Uma Maheswara Rao.
[szetszwo] HDFS-776. Fix exception handling in Balancer. Contributed by U=
ma Maheswara Rao G
------------------------------------------
[...truncated 30726 lines...]
[javadoc] 'org.apache.hadoop.tools'
[javadoc] 'org.apache.hadoop.util'
[javadoc] 'org.apache.hadoop.util.bloom'
[javadoc] 'org.apache.hadoop.util.hash'
[javadoc] '<https://builds.apache.org/job/Hadoop-Common-trunk/ws/trunk/ha=
doop-common-project/hadoop-common/dev-support/jdiff/Null.java'>
[javadoc]=20
[javadoc] The ' characters around the executable and arguments are
[javadoc] not part of the command.
[javadoc] Javadoc execution
Execute:Java13CommandLauncher: Executing '/home/jenkins/tools/java/jdk1.6.0=
_27/bin/javadoc' with arguments:
'-d'
'<https://builds.apache.org/job/Hadoop-Common-trunk/ws/trunk/hadoop-common-=
project/hadoop-common/target/site/jdiff/xml'>
'-J-Xmx512m'
'-classpath'
'<https://builds.apache.org/job/Hadoop-Common-trunk/ws/trunk/hadoop-common-=
project/hadoop-common/target/classes>:<https://builds.apache.org/job/Hadoop=
-Common-trunk/ws/trunk/hadoop-common-project/hadoop-annotations/target/hado=
op-annotations-0.24.0-SNAPSHOT.jar>:/home/jenkins/.m2/repository/jdiff/jdif=
f/1.0.9/jdiff-1.0.9.jar:/home/jenkins/.m2/repository/com/google/guava/guava=
/r09/guava-r09.jar:/home/jenkins/.m2/repository/commons-cli/commons-cli/1.2=
/commons-cli-1.2.jar:/home/jenkins/.m2/repository/org/apache/commons/common=
s-math/2.1/commons-math-2.1.jar:/home/jenkins/.m2/repository/xmlenc/xmlenc/=
0.52/xmlenc-0.52.jar:/home/jenkins/.m2/repository/commons-httpclient/common=
s-httpclient/3.1/commons-httpclient-3.1.jar:/home/jenkins/.m2/repository/co=
mmons-codec/commons-codec/1.4/commons-codec-1.4.jar:/home/jenkins/.m2/repos=
itory/commons-net/commons-net/1.4.1/commons-net-1.4.1.jar:/home/jenkins/.m2=
/repository/javax/servlet/servlet-api/2.5/servlet-api-2.5.jar:/home/jenkins=
/.m2/repository/org/mortbay/jetty/jetty/6.1.26/jetty-6.1.26.jar:/home/jenki=
ns/.m2/repository/org/mortbay/jetty/jetty-util/6.1.26/jetty-util-6.1.26.jar=
:/home/jenkins/.m2/repository/asm/asm/3.2/asm-3.2.jar:/home/jenkins/.m2/rep=
ository/com/sun/jersey/jersey-core/1.8/jersey-core-1.8.jar:/home/jenkins/.m=
2/repository/com/sun/jersey/jersey-json/1.8/jersey-json-1.8.jar:/home/jenki=
ns/.m2/repository/org/codehaus/jettison/jettison/1.1/jettison-1.1.jar:/home=
/jenkins/.m2/repository/stax/stax-api/1.0.1/stax-api-1.0.1.jar:/home/jenkin=
s/.m2/repository/com/sun/xml/bind/jaxb-impl/2.2.3-1/jaxb-impl-2.2.3-1.jar:/=
home/jenkins/.m2/repository/javax/xml/bind/jaxb-api/2.2.2/jaxb-api-2.2.2.ja=
r:/home/jenkins/.m2/repository/javax/activation/activation/1.1/activation-1=
.1.jar:/home/jenkins/.m2/repository/org/codehaus/jackson/jackson-core-asl/1=
.7.1/jackson-core-asl-1.7.1.jar:/home/jenkins/.m2/repository/org/codehaus/j=
ackson/jackson-jaxrs/1.7.1/jackson-jaxrs-1.7.1.jar:/home/jenkins/.m2/reposi=
tory/org/codehaus/jackson/jackson-xc/1.7.1/jackson-xc-1.7.1.jar:/home/jenki=
ns/.m2/repository/com/sun/jersey/jersey-server/1.8/jersey-server-1.8.jar:/h=
ome/jenkins/.m2/repository/tomcat/jasper-compiler/5.5.23/jasper-compiler-5.=
5.23.jar:/home/jenkins/.m2/repository/tomcat/jasper-runtime/5.5.23/jasper-r=
untime-5.5.23.jar:/home/jenkins/.m2/repository/javax/servlet/jsp/jsp-api/2.=
1/jsp-api-2.1.jar:/home/jenkins/.m2/repository/commons-el/commons-el/1.0/co=
mmons-el-1.0.jar:/home/jenkins/.m2/repository/commons-logging/commons-loggi=
ng/1.1.1/commons-logging-1.1.1.jar:/home/jenkins/.m2/repository/commons-log=
ging/commons-logging-api/1.1/commons-logging-api-1.1.jar:/home/jenkins/.m2/=
repository/log4j/log4j/1.2.15/log4j-1.2.15.jar:/home/jenkins/.m2/repository=
/net/java/dev/jets3t/jets3t/0.6.1/jets3t-0.6.1.jar:/home/jenkins/.m2/reposi=
tory/commons-lang/commons-lang/2.5/commons-lang-2.5.jar:/home/jenkins/.m2/r=
epository/commons-collections/commons-collections/3.2.1/commons-collections=
-3.2.1.jar:/home/jenkins/.m2/repository/commons-configuration/commons-confi=
guration/1.6/commons-configuration-1.6.jar:/home/jenkins/.m2/repository/com=
mons-digester/commons-digester/1.8/commons-digester-1.8.jar:/home/jenkins/.=
m2/repository/commons-beanutils/commons-beanutils/1.7.0/commons-beanutils-1=
.7.0.jar:/home/jenkins/.m2/repository/commons-beanutils/commons-beanutils-c=
ore/1.8.0/commons-beanutils-core-1.8.0.jar:/home/jenkins/.m2/repository/hsq=
ldb/hsqldb/1.8.0.7/hsqldb-1.8.0.7.jar:/home/jenkins/.m2/repository/org/slf4=
j/slf4j-api/1.6.1/slf4j-api-1.6.1.jar:/home/jenkins/.m2/repository/org/slf4=
j/slf4j-log4j12/1.6.1/slf4j-log4j12-1.6.1.jar:/home/jenkins/.m2/repository/=
org/eclipse/jdt/core/3.1.1/core-3.1.1.jar:/home/jenkins/.m2/repository/oro/=
oro/2.0.8/oro-2.0.8.jar:/home/jenkins/.m2/repository/org/codehaus/jackson/j=
ackson-mapper-asl/1.8.8/jackson-mapper-asl-1.8.8.jar:/home/jenkins/.m2/repo=
sitory/org/aspectj/aspectjrt/1.6.5/aspectjrt-1.6.5.jar:/home/jenkins/.m2/re=
pository/org/apache/avro/avro/1.5.3/avro-1.5.3.jar:/home/jenkins/.m2/reposi=
tory/com/thoughtworks/paranamer/paranamer/2.3/paranamer-2.3.jar:/home/jenki=
ns/.m2/repository/org/xerial/snappy/snappy-java/1.0.3.2/snappy-java-1.0.3.2=
.jar:/home/jenkins/.m2/repository/net/sf/kosmosfs/kfs/0.3/kfs-0.3.jar:/home=
/jenkins/.m2/repository/org/apache/ant/ant/1.8.1/ant-1.8.1.jar:/home/jenkin=
s/.m2/repository/org/apache/ant/ant-launcher/1.8.1/ant-launcher-1.8.1.jar:/=
home/jenkins/.m2/repository/com/google/protobuf/protobuf-java/2.4.0a/protob=
uf-java-2.4.0a.jar:<https://builds.apache.org/job/Hadoop-Common-trunk/ws/tr=
unk/hadoop-common-project/hadoop-auth/target/hadoop-auth-0.24.0-SNAPSHOT.ja=
r>:/home/jenkins/.m2/repository/com/googlecode/json-simple/json-simple/1.1/=
json-simple-1.1.jar:/home/jenkins/tools/java/latest/lib/tools.jar'
'-sourcepath'
'<https://builds.apache.org/job/Hadoop-Common-trunk/ws/trunk/hadoop-common-=
project/hadoop-common/src/main/java'>
'-doclet'
'org.apache.hadoop.classification.tools.ExcludePrivateAnnotationsJDiffDocle=
t'
'-docletpath'
'<https://builds.apache.org/job/Hadoop-Common-trunk/ws/trunk/hadoop-common-=
project/hadoop-common/target/hadoop-annotations.jar>:<https://builds.apache=
.org/job/Hadoop-Common-trunk/ws/trunk/hadoop-common-project/hadoop-common/t=
arget/jdiff.jar'>
'-oldapi'
'hadoop-core 0.20.2'
'-newapi'
'hadoop-core 0.24.0-SNAPSHOT'
'-oldapidir'
'<https://builds.apache.org/job/Hadoop-Common-trunk/ws/trunk/hadoop-common-=
project/hadoop-common/dev-support/jdiff'>
'-newapidir'
'<https://builds.apache.org/job/Hadoop-Common-trunk/ws/trunk/hadoop-common-=
project/hadoop-common/target/site/jdiff/xml'>
'-javadocold'
'http://hadoop.apache.org/docs/0.20.2/api/'
'-javadocnew'
'<https://builds.apache.org/job/Hadoop-Common-trunk/ws/trunk/hadoop-common-=
project/hadoop-common/target/site/api'>
'-stats'
'-unstable'
''
'org.apache.hadoop'
'org.apache.hadoop.conf'
'org.apache.hadoop.fs'
'org.apache.hadoop.fs.ftp'
'org.apache.hadoop.fs.kfs'
'org.apache.hadoop.fs.local'
'org.apache.hadoop.fs.permission'
'org.apache.hadoop.fs.s3'
'org.apache.hadoop.fs.s3native'
'org.apache.hadoop.fs.shell'
'org.apache.hadoop.fs.viewfs'
'org.apache.hadoop.http'
'org.apache.hadoop.http.lib'
'org.apache.hadoop.io'
'org.apache.hadoop.io.compress'
'org.apache.hadoop.io.compress.bzip2'
'org.apache.hadoop.io.compress.lz4'
'org.apache.hadoop.io.compress.snappy'
'org.apache.hadoop.io.compress.zlib'
'org.apache.hadoop.io.file.tfile'
'org.apache.hadoop.io.nativeio'
'org.apache.hadoop.io.retry'
'org.apache.hadoop.io.serializer'
'org.apache.hadoop.io.serializer.avro'
'org.apache.hadoop.ipc'
'org.apache.hadoop.ipc.metrics'
'org.apache.hadoop.jmx'
'org.apache.hadoop.log'
'org.apache.hadoop.log.metrics'
'org.apache.hadoop.metrics'
'org.apache.hadoop.metrics.file'
'org.apache.hadoop.metrics.ganglia'
'org.apache.hadoop.metrics.jvm'
'org.apache.hadoop.metrics.spi'
'org.apache.hadoop.metrics.util'
'org.apache.hadoop.metrics2'
'org.apache.hadoop.metrics2.annotation'
'org.apache.hadoop.metrics2.filter'
'org.apache.hadoop.metrics2.impl'
'org.apache.hadoop.metrics2.lib'
'org.apache.hadoop.metrics2.sink'
'org.apache.hadoop.metrics2.sink.ganglia'
'org.apache.hadoop.metrics2.source'
'org.apache.hadoop.metrics2.util'
'org.apache.hadoop.net'
'org.apache.hadoop.record'
'org.apache.hadoop.record.compiler'
'org.apache.hadoop.record.compiler.ant'
'org.apache.hadoop.record.compiler.generated'
'org.apache.hadoop.record.meta'
'org.apache.hadoop.security'
'org.apache.hadoop.security.authorize'
'org.apache.hadoop.security.token'
'org.apache.hadoop.security.token.delegation'
'org.apache.hadoop.tools'
'org.apache.hadoop.util'
'org.apache.hadoop.util.bloom'
'org.apache.hadoop.util.hash'
'<https://builds.apache.org/job/Hadoop-Common-trunk/ws/trunk/hadoop-common-=
project/hadoop-common/dev-support/jdiff/Null.java'>
The ' characters around the executable and arguments are
not part of the command.
[javadoc] javadoc: error - Illegal package name: ""
[javadoc] javadoc: error - File not found: "<https://builds.apache.org/jo=
b/Hadoop-Common-trunk/ws/trunk/hadoop-common-project/hadoop-common/dev-supp=
ort/jdiff/Null.java">
[javadoc] Loading source files for package org.apache.hadoop...
[javadoc] Loading source files for package org.apache.hadoop.conf...
[javadoc] Loading source files for package org.apache.hadoop.fs...
[javadoc] Loading source files for package org.apache.hadoop.fs.ftp...
[javadoc] Loading source files for package org.apache.hadoop.fs.kfs...
[javadoc] Loading source files for package org.apache.hadoop.fs.local...
[javadoc] Loading source files for package org.apache.hadoop.fs.permissio=
n...
[javadoc] Loading source files for package org.apache.hadoop.fs.s3...
[javadoc] Loading source files for package org.apache.hadoop.fs.s3native.=
..
[javadoc] Loading source files for package org.apache.hadoop.fs.shell...
[javadoc] Loading source files for package org.apache.hadoop.fs.viewfs...
[javadoc] Loading source files for package org.apache.hadoop.http...
[javadoc] Loading source files for package org.apache.hadoop.http.lib...
[javadoc] Loading source files for package org.apache.hadoop.io...
[javadoc] Loading source files for package org.apache.hadoop.io.compress.=
..
[javadoc] Loading source files for package org.apache.hadoop.io.compress.=
bzip2...
[javadoc] Loading source files for package org.apache.hadoop.io.compress.=
lz4...
[javadoc] Loading source files for package org.apache.hadoop.io.compress.=
snappy...
[javadoc] Loading source files for package org.apache.hadoop.io.compress.=
zlib...
[javadoc] Loading source files for package org.apache.hadoop.io.file.tfil=
e...
[javadoc] Loading source files for package org.apache.hadoop.io.nativeio.=
..
[javadoc] Loading source files for package org.apache.hadoop.io.retry...
[javadoc] Loading source files for package org.apache.hadoop.io.serialize=
r...
[javadoc] Loading source files for package org.apache.hadoop.io.serialize=
r.avro...
[javadoc] Loading source files for package org.apache.hadoop.ipc...
[javadoc] Loading source files for package org.apache.hadoop.ipc.metrics.=
..
[javadoc] Loading source files for package org.apache.hadoop.jmx...
[javadoc] Loading source files for package org.apache.hadoop.log...
[javadoc] Loading source files for package org.apache.hadoop.log.metrics.=
..
[javadoc] Loading source files for package org.apache.hadoop.metrics...
[javadoc] Loading source files for package org.apache.hadoop.metrics.file=
...
[javadoc] Loading source files for package org.apache.hadoop.metrics.gang=
lia...
[javadoc] Loading source files for package org.apache.hadoop.metrics.jvm.=
..
[javadoc] Loading source files for package org.apache.hadoop.metrics.spi.=
..
[javadoc] Loading source files for package org.apache.hadoop.metrics.util=
...
[javadoc] Loading source files for package org.apache.hadoop.metrics2...
[javadoc] Loading source files for package org.apache.hadoop.metrics2.ann=
otation...
[javadoc] Loading source files for package org.apache.hadoop.metrics2.fil=
ter...
[javadoc] Loading source files for package org.apache.hadoop.metrics2.imp=
l...
[javadoc] Loading source files for package org.apache.hadoop.metrics2.lib=
...
[javadoc] Loading source files for package org.apache.hadoop.metrics2.sin=
k...
[javadoc] Loading source files for package org.apache.hadoop.metrics2.sin=
k.ganglia...
[javadoc] Loading source files for package org.apache.hadoop.metrics2.sou=
rce...
[javadoc] Loading source files for package org.apache.hadoop.metrics2.uti=
l...
[javadoc] Loading source files for package org.apache.hadoop.net...
[javadoc] Loading source files for package org.apache.hadoop.record...
[javadoc] Loading source files for package org.apache.hadoop.record.compi=
ler...
[javadoc] Loading source files for package org.apache.hadoop.record.compi=
ler.ant...
[javadoc] Loading source files for package org.apache.hadoop.record.compi=
ler.generated...
[javadoc] Loading source files for package org.apache.hadoop.record.meta.=
..
[javadoc] Loading source files for package org.apache.hadoop.security...
[javadoc] Loading source files for package org.apache.hadoop.security.aut=
horize...
[javadoc] Loading source files for package org.apache.hadoop.security.tok=
en...
[javadoc] Loading source files for package org.apache.hadoop.security.tok=
en.delegation...
[javadoc] Loading source files for package org.apache.hadoop.tools...
[javadoc] Loading source files for package org.apache.hadoop.util...
[javadoc] Loading source files for package org.apache.hadoop.util.bloom..=
.
[javadoc] Loading source files for package org.apache.hadoop.util.hash...
[javadoc] 2 errors
[INFO] --------------------------------------------------------------------=
----
[INFO] Reactor Summary:
[INFO]=20
[INFO] Apache Hadoop Annotations ......................... SUCCESS [14.313s=
]
[INFO] Apache Hadoop Auth ................................ SUCCESS [22.003s=
]
[INFO] Apache Hadoop Auth Examples ....................... SUCCESS [8.636s]
[INFO] Apache Hadoop Common .............................. FAILURE [1:30.66=
5s]
[INFO] Apache Hadoop Common Project ...................... SKIPPED
[INFO] --------------------------------------------------------------------=
----
[INFO] BUILD FAILURE
[INFO] --------------------------------------------------------------------=
----
[INFO] Total time: 2:16.685s
[INFO] Finished at: Tue Feb 14 09:21:03 UTC 2012
[INFO] Final Memory: 68M/639M
[INFO] --------------------------------------------------------------------=
----
[ERROR] Failed to execute goal org.apache.maven.plugins:maven-antrun-plugin=
:1.6:run (site) on project hadoop-common: An Ant BuildException has occured=
: input file <https://builds.apache.org/job/Hadoop-Common-trunk/ws/trunk/ha=
doop-common-project/hadoop-common/target/findbugsXml.xml> does not exist ->=
[Help 1]
org.apache.maven.lifecycle.LifecycleExecutionException: Failed to execute g=
oal org.apache.maven.plugins:maven-antrun-plugin:1.6:run (site) on project =
hadoop-common: An Ant BuildException has occured: input file <https://build=
s.apache.org/job/Hadoop-Common-trunk/ws/trunk/hadoop-common-project/hadoop-=
common/target/findbugsXml.xml> does not exist
=09at org.apache.maven.lifecycle.internal.MojoExecutor.execute(MojoExecutor=
.java:217)
=09at org.apache.maven.lifecycle.internal.MojoExecutor.execute(MojoExecutor=
.java:153)
=09at org.apache.maven.lifecycle.internal.MojoExecutor.execute(MojoExecutor=
.java:145)
=09at org.apache.maven.lifecycle.internal.LifecycleModuleBuilder.buildProje=
ct(LifecycleModuleBuilder.java:84)
=09at org.apache.maven.lifecycle.internal.LifecycleModuleBuilder.buildProje=
ct(LifecycleModuleBuilder.java:59)
=09at org.apache.maven.lifecycle.internal.LifecycleStarter.singleThreadedBu=
ild(LifecycleStarter.java:183)
=09at org.apache.maven.lifecycle.internal.LifecycleStarter.execute(Lifecycl=
eStarter.java:161)
=09at org.apache.maven.DefaultMaven.doExecute(DefaultMaven.java:319)
=09at org.apache.maven.DefaultMaven.execute(DefaultMaven.java:156)
=09at org.apache.maven.cli.MavenCli.execute(MavenCli.java:537)
=09at org.apache.maven.cli.MavenCli.doMain(MavenCli.java:196)
=09at org.apache.maven.cli.MavenCli.main(MavenCli.java:141)
=09at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
=09at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.=
java:39)
=09at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAcces=
sorImpl.java:25)
=09at java.lang.reflect.Method.invoke(Method.java:597)
=09at org.codehaus.plexus.classworlds.launcher.Launcher.launchEnhanced(Laun=
cher.java:290)
=09at org.codehaus.plexus.classworlds.launcher.Launcher.launch(Launcher.jav=
a:230)
=09at org.codehaus.plexus.classworlds.launcher.Launcher.mainWithExitCode(La=
uncher.java:409)
=09at org.codehaus.plexus.classworlds.launcher.Launcher.main(Launcher.java:=
352)
Caused by: org.apache.maven.plugin.MojoExecutionException: An Ant BuildExce=
ption has occured: input file <https://builds.apache.org/job/Hadoop-Common-=
trunk/ws/trunk/hadoop-common-project/hadoop-common/target/findbugsXml.xml> =
does not exist
=09at org.apache.maven.plugin.antrun.AntRunMojo.execute(AntRunMojo.java:283=
)
=09at org.apache.maven.plugin.DefaultBuildPluginManager.executeMojo(Default=
BuildPluginManager.java:101)
=09at org.apache.maven.lifecycle.internal.MojoExecutor.execute(MojoExecutor=
.java:209)
=09... 19 more
Caused by: <https://builds.apache.org/job/Hadoop-Common-trunk/ws/trunk/hado=
op-common-project/hadoop-common/target/antrun/build-main.xml>:48: input fil=
e <https://builds.apache.org/job/Hadoop-Common-trunk/ws/trunk/hadoop-common=
-project/hadoop-common/target/findbugsXml.xml> does not exist
=09at org.apache.tools.ant.taskdefs.XSLTProcess.handleError(XSLTProcess.jav=
a:1229)
=09at org.apache.tools.ant.taskdefs.XSLTProcess.execute(XSLTProcess.java:33=
5)
=09at org.apache.tools.ant.UnknownElement.execute(UnknownElement.java:291)
=09at sun.reflect.GeneratedMethodAccessor123.invoke(Unknown Source)
=09at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAcces=
sorImpl.java:25)
=09at java.lang.reflect.Method.invoke(Method.java:597)
=09at org.apache.tools.ant.dispatch.DispatchUtils.execute(DispatchUtils.jav=
a:106)
=09at org.apache.tools.ant.Task.perform(Task.java:348)
=09at org.apache.tools.ant.Target.execute(Target.java:390)
=09at org.apache.tools.ant.Target.performTasks(Target.java:411)
=09at org.apache.tools.ant.Project.executeSortedTargets(Project.java:1397)
=09at org.apache.tools.ant.Project.executeTarget(Project.java:1366)
=09at org.apache.maven.plugin.antrun.AntRunMojo.execute(AntRunMojo.java:270=
)
=09... 21 more
[ERROR]=20
[ERROR]=20
[ERROR] For more information about the errors and possible solutions, pleas=
e read the following articles:
[ERROR] [Help 1] http://cwiki.apache.org/confluence/display/MAVEN/MojoExecu=
tionException
[ERROR]=20
[ERROR] After correcting the problems, you can resume the build with the co=
mmand
[ERROR] mvn <goals> -rf :hadoop-common
+ /home/jenkins/tools/maven/latest/bin/mvn test -Pclover -DcloverLicenseLoc=
ation=3D/home/jenkins/tools/clover/latest/lib/clover.license
[WARNINGS] Parsing warnings in console log with parsers [Java Compiler, Jav=
aDoc]
[WARNINGS] Java Compiler : Found 72 warnings.
[WARNINGS] Java Compiler : Found 17 warnings.
[WARNINGS] JavaDoc : Found 0 warnings.
[WARNINGS] Computing warning deltas based on reference build #316
Archiving artifacts
Recording test results
Publishing Javadoc
ERROR: Publisher hudson.tasks.JavadocArchiver aborted due to exception
<https://builds.apache.org/job/Hadoop-Common-trunk/ws/trunk/hadoop-common-p=
roject/hadoop-common/target/site/api> does not exist.
=09at org.apache.tools.ant.types.AbstractFileSet.getDirectoryScanner(Abstra=
ctFileSet.java:474)
=09at hudson.FilePath$35.hasMatch(FilePath.java:1905)
=09at hudson.FilePath$35.invoke(FilePath.java:1814)
=09at hudson.FilePath$35.invoke(FilePath.java:1805)
=09at hudson.FilePath$FileCallableWrapper.call(FilePath.java:2099)
=09at hudson.remoting.UserRequest.perform(UserRequest.java:118)
=09at hudson.remoting.UserRequest.perform(UserRequest.java:48)
=09at hudson.remoting.Request$2.run(Request.java:287)
=09at hudson.remoting.InterceptingExecutorService$1.call(InterceptingExecut=
orService.java:72)
=09at java.util.concurrent.FutureTask$Sync.innerRun(FutureTask.java:303)
=09at java.util.concurrent.FutureTask.run(FutureTask.java:138)
=09at java.util.concurrent.ThreadPoolExecutor$Worker.runTask(ThreadPoolExec=
utor.java:886)
=09at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor=
.java:908)
=09at java.lang.Thread.run(Thread.java:662)
Recording fingerprints
From common-dev-return-77719-apmail-hadoop-common-dev-archive=hadoop.apache.org@hadoop.apache.org Tue Feb 14 12:18:12 2012
Return-Path: <common-dev-return-77719-apmail-hadoop-common-dev-archive=hadoop.apache.org@hadoop.apache.org>
X-Original-To: apmail-hadoop-common-dev-archive@www.apache.org
Delivered-To: apmail-hadoop-common-dev-archive@www.apache.org
Received: from mail.apache.org (hermes.apache.org [140.211.11.3])
by minotaur.apache.org (Postfix) with SMTP id 622C09A56
for <apmail-hadoop-common-dev-archive@www.apache.org>; Tue, 14 Feb 2012 12:18:12 +0000 (UTC)
Received: (qmail 60041 invoked by uid 500); 14 Feb 2012 11:55:13 -0000
Delivered-To: apmail-hadoop-common-dev-archive@hadoop.apache.org
Received: (qmail 27207 invoked by uid 500); 14 Feb 2012 11:53:13 -0000
Mailing-List: contact common-dev-help@hadoop.apache.org; run by ezmlm
Precedence: bulk
List-Help: <mailto:common-dev-help@hadoop.apache.org>
List-Unsubscribe: <mailto:common-dev-unsubscribe@hadoop.apache.org>
List-Post: <mailto:common-dev@hadoop.apache.org>
List-Id: <common-dev.hadoop.apache.org>
Reply-To: common-dev@hadoop.apache.org
Delivered-To: mailing list common-dev@hadoop.apache.org
Received: (qmail 4496 invoked by uid 99); 14 Feb 2012 09:15:28 -0000
Received: from nike.apache.org (HELO nike.apache.org) (192.87.106.230)
by apache.org (qpsmtpd/0.29) with ESMTP; Tue, 14 Feb 2012 09:15:28 +0000
X-ASF-Spam-Status: No, hits=-2000.0 required=5.0
tests=ALL_TRUSTED
X-Spam-Check-By: apache.org
Received: from [140.211.11.8] (HELO aegis.apache.org) (140.211.11.8)
by apache.org (qpsmtpd/0.29) with ESMTP; Tue, 14 Feb 2012 09:15:22 +0000
Received: from aegis (localhost [127.0.0.1])
by aegis.apache.org (Postfix) with ESMTP id 64945C0005
for <common-dev@hadoop.apache.org>; Tue, 14 Feb 2012 09:15:00 +0000 (UTC)
Date: Tue, 14 Feb 2012 09:15:00 +0000 (UTC)
From: Apache Jenkins Server <jenkins@builds.apache.org>
To: common-dev@hadoop.apache.org
Message-ID: <210555023.2481329210900396.JavaMail.hudson@aegis>
In-Reply-To: <2137512221.571329124581860.JavaMail.hudson@aegis>
References: <2137512221.571329124581860.JavaMail.hudson@aegis>
Subject: Build failed in Jenkins: Hadoop-Common-0.23-Build #164
MIME-Version: 1.0
Content-Type: text/plain; charset=UTF-8
Content-Transfer-Encoding: 7bit
X-Jenkins-Job: Hadoop-Common-0.23-Build
X-Jenkins-Result: FAILURE
X-Virus-Checked: Checked by ClamAV on apache.org
See <https://builds.apache.org/job/Hadoop-Common-0.23-Build/164/changes>
Changes:
[atm] HDFS-2943. Expose last checkpoint time and transaction stats as JMX metrics. Contributed by Aaron T. Myers.
[vinodkv] MAPREDUCE-3846. Addressed MR AM hanging issues during AM restart and then the recovery. (vinodkv)
svn merge --ignore-ancestry -c 1243752 ../../trunk/
[shv] MAPREDUCE-3837. Job tracker is not able to recover jobs after crash. Contributed by Mayank Bansal.
[suresh] HDFS-2815. Merging change r1243673 from trunk to 0.23.
[szetszwo] svn merge -c 1243654 from trunk for HDFS-776.
------------------------------------------
[...truncated 12105 lines...]
[javadoc] [loading sun/net/dns/ResolverConfiguration.class(sun/net/dns:ResolverConfiguration.class)]
[javadoc] [loading sun/net/util/IPAddressUtil.class(sun/net/util:IPAddressUtil.class)]
[javadoc] [loading sun/security/jgss/krb5/Krb5Util.class(sun/security/jgss/krb5:Krb5Util.class)]
[javadoc] [loading sun/security/krb5/Credentials.class(sun/security/krb5:Credentials.class)]
[javadoc] [loading sun/security/krb5/PrincipalName.class(sun/security/krb5:PrincipalName.class)]
[javadoc] [loading javax/security/auth/login/Configuration.class(javax/security/auth/login:Configuration.class)]
[javadoc] [loading sun/security/krb5/Config.class(sun/security/krb5:Config.class)]
[javadoc] [loading sun/security/krb5/KrbException.class(sun/security/krb5:KrbException.class)]
[javadoc] [loading org/apache/avro/reflect/Nullable.class(org/apache/avro/reflect:Nullable.class)]
[javadoc] [loading java/text/DecimalFormat.class(java/text:DecimalFormat.class)]
[javadoc] [loading java/text/NumberFormat.class(java/text:NumberFormat.class)]
[javadoc] [loading java/util/concurrent/ThreadFactory.class(java/util/concurrent:ThreadFactory.class)]
[javadoc] [loading java/lang/ThreadGroup.class(java/lang:ThreadGroup.class)]
[javadoc] [loading java/lang/Package.class(java/lang:Package.class)]
[javadoc] [loading java/util/jar/JarFile.class(java/util/jar:JarFile.class)]
[javadoc] [loading java/util/jar/JarEntry.class(java/util/jar:JarEntry.class)]
[javadoc] [loading java/util/jar/Manifest.class(java/util/jar:Manifest.class)]
[javadoc] [loading java/util/Calendar.class(java/util:Calendar.class)]
[javadoc] [loading org/apache/commons/httpclient/URIException.class(org/apache/commons/httpclient:URIException.class)]
[javadoc] [loading org/apache/commons/httpclient/util/URIUtil.class(org/apache/commons/httpclient/util:URIUtil.class)]
[javadoc] [loading org/apache/commons/cli/CommandLine.class(org/apache/commons/cli:CommandLine.class)]
[javadoc] [loading org/apache/commons/cli/CommandLineParser.class(org/apache/commons/cli:CommandLineParser.class)]
[javadoc] [loading org/apache/commons/cli/GnuParser.class(org/apache/commons/cli:GnuParser.class)]
[javadoc] [loading org/apache/commons/cli/HelpFormatter.class(org/apache/commons/cli:HelpFormatter.class)]
[javadoc] [loading org/apache/commons/cli/Option.class(org/apache/commons/cli:Option.class)]
[javadoc] [loading org/apache/commons/cli/OptionBuilder.class(org/apache/commons/cli:OptionBuilder.class)]
[javadoc] [loading org/apache/commons/cli/Options.class(org/apache/commons/cli:Options.class)]
[javadoc] [loading org/apache/commons/cli/ParseException.class(org/apache/commons/cli:ParseException.class)]
[javadoc] [loading java/lang/SecurityException.class(java/lang:SecurityException.class)]
[javadoc] [loading java/lang/NoSuchMethodException.class(java/lang:NoSuchMethodException.class)]
[javadoc] [loading javax/xml/transform/TransformerConfigurationException.class(javax/xml/transform:TransformerConfigurationException.class)]
[javadoc] [loading java/lang/Override.class(java/lang:Override.class)]
[javadoc] [loading com/google/common/annotations/GwtCompatible.class(com/google/common/annotations:GwtCompatible.class)]
[javadoc] [loading com/google/common/annotations/GwtIncompatible.class(com/google/common/annotations:GwtIncompatible.class)]
[javadoc] [loading <https://builds.apache.org/job/Hadoop-Common-0.23-Build/ws/trunk/hadoop-common-project/hadoop-common/target/classes/org/apache/hadoop/package-info.class]>
[javadoc] [loading <https://builds.apache.org/job/Hadoop-Common-0.23-Build/ws/trunk/hadoop-common-project/hadoop-common/target/classes/org/apache/hadoop/conf/Configuration$1.class]>
[javadoc] [loading <https://builds.apache.org/job/Hadoop-Common-0.23-Build/ws/trunk/hadoop-common-project/hadoop-common/target/classes/org/apache/hadoop/fs/FileContext$16.class]>
[javadoc] [loading <https://builds.apache.org/job/Hadoop-Common-0.23-Build/ws/trunk/hadoop-common-project/hadoop-common/target/classes/org/apache/hadoop/fs/HardLink$1.class]>
[javadoc] [loading <https://builds.apache.org/job/Hadoop-Common-0.23-Build/ws/trunk/hadoop-common-project/hadoop-common/target/classes/org/apache/hadoop/fs/FileSystem$5.class]>
[javadoc] [loading <https://builds.apache.org/job/Hadoop-Common-0.23-Build/ws/trunk/hadoop-common-project/hadoop-common/target/classes/org/apache/hadoop/fs/FileContext$17.class]>
[javadoc] [loading <https://builds.apache.org/job/Hadoop-Common-0.23-Build/ws/trunk/hadoop-common-project/hadoop-common/target/classes/org/apache/hadoop/fs/FileContext$6.class]>
[javadoc] [loading <https://builds.apache.org/job/Hadoop-Common-0.23-Build/ws/trunk/hadoop-common-project/hadoop-common/target/classes/org/apache/hadoop/fs/FileContext$3.class]>
[javadoc] [loading <https://builds.apache.org/job/Hadoop-Common-0.23-Build/ws/trunk/hadoop-common-project/hadoop-common/target/classes/org/apache/hadoop/fs/Options$1.class]>
[javadoc] [loading <https://builds.apache.org/job/Hadoop-Common-0.23-Build/ws/trunk/hadoop-common-project/hadoop-common/target/classes/org/apache/hadoop/fs/FileContext$20.class]>
[javadoc] [loading <https://builds.apache.org/job/Hadoop-Common-0.23-Build/ws/trunk/hadoop-common-project/hadoop-common/target/classes/org/apache/hadoop/fs/FileContext$9.class]>
[javadoc] [loading <https://builds.apache.org/job/Hadoop-Common-0.23-Build/ws/trunk/hadoop-common-project/hadoop-common/target/classes/org/apache/hadoop/fs/BlockLocation$1.class]>
[javadoc] [loading <https://builds.apache.org/job/Hadoop-Common-0.23-Build/ws/trunk/hadoop-common-project/hadoop-common/target/classes/org/apache/hadoop/fs/FileContext$4.class]>
[javadoc] [loading <https://builds.apache.org/job/Hadoop-Common-0.23-Build/ws/trunk/hadoop-common-project/hadoop-common/target/classes/org/apache/hadoop/fs/FileContext$18.class]>
[javadoc] [loading <https://builds.apache.org/job/Hadoop-Common-0.23-Build/ws/trunk/hadoop-common-project/hadoop-common/target/classes/org/apache/hadoop/fs/FileContext$Util$2.class]>
[javadoc] [loading <https://builds.apache.org/job/Hadoop-Common-0.23-Build/ws/trunk/hadoop-common-project/hadoop-common/target/classes/org/apache/hadoop/fs/FileSystem$2.class]>
[javadoc] [loading <https://builds.apache.org/job/Hadoop-Common-0.23-Build/ws/trunk/hadoop-common-project/hadoop-common/target/classes/org/apache/hadoop/fs/FileContext$24.class]>
[javadoc] [loading <https://builds.apache.org/job/Hadoop-Common-0.23-Build/ws/trunk/hadoop-common-project/hadoop-common/target/classes/org/apache/hadoop/fs/LocalDirAllocator$1.class]>
[javadoc] [loading <https://builds.apache.org/job/Hadoop-Common-0.23-Build/ws/trunk/hadoop-common-project/hadoop-common/target/classes/org/apache/hadoop/fs/FsServerDefaults$1.class]>
[javadoc] [loading <https://builds.apache.org/job/Hadoop-Common-0.23-Build/ws/trunk/hadoop-common-project/hadoop-common/target/classes/org/apache/hadoop/fs/FileContext$14.class]>
[javadoc] [loading <https://builds.apache.org/job/Hadoop-Common-0.23-Build/ws/trunk/hadoop-common-project/hadoop-common/target/classes/org/apache/hadoop/fs/FileContext$13.class]>
[javadoc] [loading <https://builds.apache.org/job/Hadoop-Common-0.23-Build/ws/trunk/hadoop-common-project/hadoop-common/target/classes/org/apache/hadoop/fs/TrashPolicyDefault$1.class]>
[javadoc] [loading <https://builds.apache.org/job/Hadoop-Common-0.23-Build/ws/trunk/hadoop-common-project/hadoop-common/target/classes/org/apache/hadoop/fs/FileContext$19.class]>
[javadoc] [loading <https://builds.apache.org/job/Hadoop-Common-0.23-Build/ws/trunk/hadoop-common-project/hadoop-common/target/classes/org/apache/hadoop/fs/RawLocalFileSystem$1.class]>
[javadoc] [loading <https://builds.apache.org/job/Hadoop-Common-0.23-Build/ws/trunk/hadoop-common-project/hadoop-common/target/classes/org/apache/hadoop/fs/FileContext$7.class]>
[javadoc] [loading <https://builds.apache.org/job/Hadoop-Common-0.23-Build/ws/trunk/hadoop-common-project/hadoop-common/target/classes/org/apache/hadoop/fs/FileContext$2.class]>
[javadoc] [loading <https://builds.apache.org/job/Hadoop-Common-0.23-Build/ws/trunk/hadoop-common-project/hadoop-common/target/classes/org/apache/hadoop/fs/GlobFilter$1.class]>
[javadoc] [loading <https://builds.apache.org/job/Hadoop-Common-0.23-Build/ws/trunk/hadoop-common-project/hadoop-common/target/classes/org/apache/hadoop/fs/FileContext$15.class]>
[javadoc] [loading <https://builds.apache.org/job/Hadoop-Common-0.23-Build/ws/trunk/hadoop-common-project/hadoop-common/target/classes/org/apache/hadoop/fs/AbstractFileSystem$1.class]>
[javadoc] [loading <https://builds.apache.org/job/Hadoop-Common-0.23-Build/ws/trunk/hadoop-common-project/hadoop-common/target/classes/org/apache/hadoop/fs/FileContext$8.class]>
[javadoc] [loading <https://builds.apache.org/job/Hadoop-Common-0.23-Build/ws/trunk/hadoop-common-project/hadoop-common/target/classes/org/apache/hadoop/fs/FileContext$25.class]>
[javadoc] [loading <https://builds.apache.org/job/Hadoop-Common-0.23-Build/ws/trunk/hadoop-common-project/hadoop-common/target/classes/org/apache/hadoop/fs/FileContext$1.class]>
[javadoc] [loading <https://builds.apache.org/job/Hadoop-Common-0.23-Build/ws/trunk/hadoop-common-project/hadoop-common/target/classes/org/apache/hadoop/fs/FileSystem$4.class]>
[javadoc] [loading <https://builds.apache.org/job/Hadoop-Common-0.23-Build/ws/trunk/hadoop-common-project/hadoop-common/target/classes/org/apache/hadoop/fs/FileContext$23.class]>
[javadoc] [loading <https://builds.apache.org/job/Hadoop-Common-0.23-Build/ws/trunk/hadoop-common-project/hadoop-common/target/classes/org/apache/hadoop/fs/FileContext$Util$1.class]>
[javadoc] [loading <https://builds.apache.org/job/Hadoop-Common-0.23-Build/ws/trunk/hadoop-common-project/hadoop-common/target/classes/org/apache/hadoop/fs/FileSystem$1.class]>
[javadoc] [loading <https://builds.apache.org/job/Hadoop-Common-0.23-Build/ws/trunk/hadoop-common-project/hadoop-common/target/classes/org/apache/hadoop/fs/FileContext$22.class]>
[javadoc] [loading <https://builds.apache.org/job/Hadoop-Common-0.23-Build/ws/trunk/hadoop-common-project/hadoop-common/target/classes/org/apache/hadoop/fs/ChecksumFileSystem$1.class]>
[javadoc] [loading <https://builds.apache.org/job/Hadoop-Common-0.23-Build/ws/trunk/hadoop-common-project/hadoop-common/target/classes/org/apache/hadoop/fs/AbstractFileSystem$2.class]>
[javadoc] [loading <https://builds.apache.org/job/Hadoop-Common-0.23-Build/ws/trunk/hadoop-common-project/hadoop-common/target/classes/org/apache/hadoop/fs/FileContext$21.class]>
[javadoc] [loading <https://builds.apache.org/job/Hadoop-Common-0.23-Build/ws/trunk/hadoop-common-project/hadoop-common/target/classes/org/apache/hadoop/fs/FileContext$12.class]>
[javadoc] [loading <https://builds.apache.org/job/Hadoop-Common-0.23-Build/ws/trunk/hadoop-common-project/hadoop-common/target/classes/org/apache/hadoop/fs/DF$1.class]>
[javadoc] [loading <https://builds.apache.org/job/Hadoop-Common-0.23-Build/ws/trunk/hadoop-common-project/hadoop-common/target/classes/org/apache/hadoop/fs/FileContext$10.class]>
[javadoc] [loading <https://builds.apache.org/job/Hadoop-Common-0.23-Build/ws/trunk/hadoop-common-project/hadoop-common/target/classes/org/apache/hadoop/fs/FileContext$5.class]>
[javadoc] [loading <https://builds.apache.org/job/Hadoop-Common-0.23-Build/ws/trunk/hadoop-common-project/hadoop-common/target/classes/org/apache/hadoop/fs/FileSystem$3.class]>
[javadoc] [loading <https://builds.apache.org/job/Hadoop-Common-0.23-Build/ws/trunk/hadoop-common-project/hadoop-common/target/classes/org/apache/hadoop/fs/FileContext$11.class]>
[javadoc] [loading <https://builds.apache.org/job/Hadoop-Common-0.23-Build/ws/trunk/hadoop-common-project/hadoop-common/target/classes/org/apache/hadoop/fs/ftp/FTPFileSystem$1.class]>
[javadoc] [loading <https://builds.apache.org/job/Hadoop-Common-0.23-Build/ws/trunk/hadoop-common-project/hadoop-common/target/classes/org/apache/hadoop/fs/permission/PermissionStatus$2.class]>
[javadoc] [loading <https://builds.apache.org/job/Hadoop-Common-0.23-Build/ws/trunk/hadoop-common-project/hadoop-common/target/classes/org/apache/hadoop/fs/permission/FsPermission$1.class]>
[javadoc] [loading <https://builds.apache.org/job/Hadoop-Common-0.23-Build/ws/trunk/hadoop-common-project/hadoop-common/target/classes/org/apache/hadoop/fs/permission/PermissionStatus$1.class]>
[javadoc] [loading <https://builds.apache.org/job/Hadoop-Common-0.23-Build/ws/trunk/hadoop-common-project/hadoop-common/target/classes/org/apache/hadoop/fs/s3/INode$1.class]>
[javadoc] [loading <https://builds.apache.org/job/Hadoop-Common-0.23-Build/ws/trunk/hadoop-common-project/hado>
[javadoc] JDiff: finished (took 0s, not including scanning the source files).
[javadoc] op-common/target/classes/org/apache/hadoop/fs/viewfs/ViewFs$1.class]
[javadoc] [loading <https://builds.apache.org/job/Hadoop-Common-0.23-Build/ws/trunk/hadoop-common-project/hadoop-common/target/classes/org/apache/hadoop/fs/viewfs/ViewFs$2.class]>
[javadoc] [loading <https://builds.apache.org/job/Hadoop-Common-0.23-Build/ws/trunk/hadoop-common-project/hadoop-common/target/classes/org/apache/hadoop/fs/viewfs/ViewFileSystem$1.class]>
[javadoc] [loading <https://builds.apache.org/job/Hadoop-Common-0.23-Build/ws/trunk/hadoop-common-project/hadoop-common/target/classes/org/apache/hadoop/http/lib/StaticUserWebFilter$StaticUserFilter$1.class]>
[javadoc] [loading <https://builds.apache.org/job/Hadoop-Common-0.23-Build/ws/trunk/hadoop-common-project/hadoop-common/target/classes/org/apache/hadoop/io/OutputBuffer$1.class]>
[javadoc] [loading <https://builds.apache.org/job/Hadoop-Common-0.23-Build/ws/trunk/hadoop-common-project/hadoop-common/target/classes/org/apache/hadoop/io/SequenceFile$1.class]>
[javadoc] [loading <https://builds.apache.org/job/Hadoop-Common-0.23-Build/ws/trunk/hadoop-common-project/hadoop-common/target/classes/org/apache/hadoop/io/DataInputByteBuffer$1.class]>
[javadoc] [loading <https://builds.apache.org/job/Hadoop-Common-0.23-Build/ws/trunk/hadoop-common-project/hadoop-common/target/classes/org/apache/hadoop/io/FastByteComparisons$LexicographicalComparerHolder$UnsafeComparer$1.class]>
[javadoc] [loading <https://builds.apache.org/job/Hadoop-Common-0.23-Build/ws/trunk/hadoop-common-project/hadoop-common/target/classes/org/apache/hadoop/io/ReadaheadPool$1.class]>
[javadoc] [loading <https://builds.apache.org/job/Hadoop-Common-0.23-Build/ws/trunk/hadoop-common-project/hadoop-common/target/classes/org/apache/hadoop/io/Text$2.class]>
[javadoc] [loading <https://builds.apache.org/job/Hadoop-Common-0.23-Build/ws/trunk/hadoop-common-project/hadoop-common/target/classes/org/apache/hadoop/io/Text$1.class]>
[javadoc] [loading <https://builds.apache.org/job/Hadoop-Common-0.23-Build/ws/trunk/hadoop-common-project/hadoop-common/target/classes/org/apache/hadoop/io/MD5Hash$1.class]>
[javadoc] [loading <https://builds.apache.org/job/Hadoop-Common-0.23-Build/ws/trunk/hadoop-common-project/hadoop-common/target/classes/org/apache/hadoop/io/EnumSetWritable$1.class]>
[javadoc] [loading <https://builds.apache.org/job/Hadoop-Common-0.23-Build/ws/trunk/hadoop-common-project/hadoop-common/target/classes/org/apache/hadoop/io/UTF8$1.class]>
[javadoc] [loading <https://builds.apache.org/job/Hadoop-Common-0.23-Build/ws/trunk/hadoop-common-project/hadoop-common/target/classes/org/apache/hadoop/io/file/tfile/Compression$Algorithm$1.class]>
[javadoc] [loading <https://builds.apache.org/job/Hadoop-Common-0.23-Build/ws/trunk/hadoop-common-project/hadoop-common/target/classes/org/apache/hadoop/io/file/tfile/Compression$Algorithm$3.class]>
[javadoc] [loading <https://builds.apache.org/job/Hadoop-Common-0.23-Build/ws/trunk/hadoop-common-project/hadoop-common/target/classes/org/apache/hadoop/io/file/tfile/Compression$Algorithm$2.class]>
[javadoc] [loading <https://builds.apache.org/job/Hadoop-Common-0.23-Build/ws/trunk/hadoop-common-project/hadoop-common/target/classes/org/apache/hadoop/io/file/tfile/TFile$Reader$1.class]>
[javadoc] [loading <https://builds.apache.org/job/Hadoop-Common-0.23-Build/ws/trunk/hadoop-common-project/hadoop-common/target/classes/org/apache/hadoop/io/serializer/JavaSerialization$JavaSerializationDeserializer$1.class]>
[javadoc] [loading <https://builds.apache.org/job/Hadoop-Common-0.23-Build/ws/trunk/hadoop-common-project/hadoop-common/target/classes/org/apache/hadoop/io/serializer/JavaSerialization$JavaSerializationSerializer$1.class]>
[javadoc] [loading <https://builds.apache.org/job/Hadoop-Common-0.23-Build/ws/trunk/hadoop-common-project/hadoop-common/target/classes/org/apache/hadoop/log/metrics/EventCounter$1.class]>
[javadoc] [loading <https://builds.apache.org/job/Hadoop-Common-0.23-Build/ws/trunk/hadoop-common-project/hadoop-common/target/classes/org/apache/hadoop/metrics/spi/AbstractMetricsContext$1.class]>
[javadoc] [loading <https://builds.apache.org/job/Hadoop-Common-0.23-Build/ws/trunk/hadoop-common-project/hadoop-common/target/classes/org/apache/hadoop/metrics2/lib/Interns$Info$1.class]>
[javadoc] [loading <https://builds.apache.org/job/Hadoop-Common-0.23-Build/ws/trunk/hadoop-common-project/hadoop-common/target/classes/org/apache/hadoop/metrics2/lib/MethodMetric$3.class]>
[javadoc] [loading <https://builds.apache.org/job/Hadoop-Common-0.23-Build/ws/trunk/hadoop-common-project/hadoop-common/target/classes/org/apache/hadoop/metrics2/lib/MetricsSourceBuilder$1.class]>
[javadoc] [loading <https://builds.apache.org/job/Hadoop-Common-0.23-Build/ws/trunk/hadoop-common-project/hadoop-common/target/classes/org/apache/hadoop/metrics2/lib/MethodMetric$4.class]>
[javadoc] [loading <https://builds.apache.org/job/Hadoop-Common-0.23-Build/ws/trunk/hadoop-common-project/hadoop-common/target/classes/org/apache/hadoop/metrics2/lib/Interns$CacheWith2Keys$2.class]>
[javadoc] [loading <https://builds.apache.org/job/Hadoop-Common-0.23-Build/ws/trunk/hadoop-common-project/hadoop-common/target/classes/org/apache/hadoop/metrics2/lib/Interns$CacheWith2Keys$1.class]>
[javadoc] [loading <https://builds.apache.org/job/Hadoop-Common-0.23-Build/ws/trunk/hadoop-common-project/hadoop-common/target/classes/org/apache/hadoop/metrics2/lib/Interns$Tags$1.class]>
[javadoc] [loading <https://builds.apache.org/job/Hadoop-Common-0.23-Build/ws/trunk/hadoop-common-project/hadoop-common/target/classes/org/apache/hadoop/metrics2/lib/MethodMetric$2.class]>
[javadoc] [loading <https://builds.apache.org/job/Hadoop-Common-0.23-Build/ws/trunk/hadoop-common-project/hadoop-common/target/classes/org/apache/hadoop/metrics2/sink/ganglia/AbstractGangliaSink$1.class]>
[javadoc] [loading <https://builds.apache.org/job/Hadoop-Common-0.23-Build/ws/trunk/hadoop-common-project/hadoop-common/target/classes/org/apache/hadoop/metrics2/source/JvmMetrics$1.class]>
[javadoc] [loading <https://builds.apache.org/job/Hadoop-Common-0.23-Build/ws/trunk/hadoop-common-project/hadoop-common/target/classes/org/apache/hadoop/net/SocketIOWithTimeout$1.class]>
[javadoc] [loading <https://builds.apache.org/job/Hadoop-Common-0.23-Build/ws/trunk/hadoop-common-project/hadoop-common/target/classes/org/apache/hadoop/record/BinaryRecordInput$1.class]>
[javadoc] [loading <https://builds.apache.org/job/Hadoop-Common-0.23-Build/ws/trunk/hadoop-common-project/hadoop-common/target/classes/org/apache/hadoop/record/XmlRecordInput$1.class]>
[javadoc] [loading <https://builds.apache.org/job/Hadoop-Common-0.23-Build/ws/trunk/hadoop-common-project/hadoop-common/target/classes/org/apache/hadoop/record/CsvRecordInput$1.class]>
[javadoc] [loading <https://builds.apache.org/job/Hadoop-Common-0.23-Build/ws/trunk/hadoop-common-project/hadoop-common/target/classes/org/apache/hadoop/record/BinaryRecordOutput$1.class]>
[javadoc] [loading <https://builds.apache.org/job/Hadoop-Common-0.23-Build/ws/trunk/hadoop-common-project/hadoop-common/target/classes/org/apache/hadoop/security/SaslRpcClient$1.class]>
[javadoc] [loading <https://builds.apache.org/job/Hadoop-Common-0.23-Build/ws/trunk/hadoop-common-project/hadoop-common/target/classes/org/apache/hadoop/security/Krb5AndCertsSslSocketConnector$Krb5SslFilter$1.class]>
[javadoc] [loading <https://builds.apache.org/job/Hadoop-Common-0.23-Build/ws/trunk/hadoop-common-project/hadoop-common/target/classes/org/apache/hadoop/security/UserGroupInformation$1.class]>
[javadoc] [loading <https://builds.apache.org/job/Hadoop-Common-0.23-Build/ws/trunk/hadoop-common-project/hadoop-common/target/classes/org/apache/hadoop/util/Shell$1.class]>
[javadoc] [loading <https://builds.apache.org/job/Hadoop-Common-0.23-Build/ws/trunk/hadoop-common-project/hadoop-common/target/classes/org/apache/hadoop/util/StringUtils$1.class]>
[javadoc] [loading <https://builds.apache.org/job/Hadoop-Common-0.23-Build/ws/trunk/hadoop-common-project/hadoop-common/target/classes/org/apache/hadoop/util/AsyncDiskService$1.class]>
[javadoc] [loading <https://builds.apache.org/job/Hadoop-Common-0.23-Build/ws/trunk/hadoop-common-project/hadoop-common/target/classes/org/apache/hadoop/util/RunJar$1.class]>
[javadoc] [loading <https://builds.apache.org/job/Hadoop-Common-0.23-Build/ws/trunk/hadoop-common-project/hadoop-common/target/classes/org/apache/hadoop/util/ReflectionUtils$1.class]>
[javadoc] [loading java/util/zip/CRC32.class(java/util/zip:CRC32.class)]
[javadoc] [done in 3274 ms]
[javadoc] 9 warnings
[javadoc] Generating Javadoc
[javadoc] Javadoc execution
[javadoc] javadoc: error - Illegal package name: ""
[javadoc] javadoc: error - File not found: "<https://builds.apache.org/job/Hadoop-Common-0.23-Build/ws/trunk/hadoop-common-project/hadoop-common/dev-support/jdiff/Null.java">
[javadoc] Loading source files for package org.apache.hadoop...
[javadoc] Loading source files for package org.apache.hadoop.conf...
[javadoc] Loading source files for package org.apache.hadoop.fs...
[javadoc] Loading source files for package org.apache.hadoop.fs.ftp...
[javadoc] Loading source files for package org.apache.hadoop.fs.kfs...
[javadoc] Loading source files for package org.apache.hadoop.fs.local...
[javadoc] Loading source files for package org.apache.hadoop.fs.permission...
[javadoc] Loading source files for package org.apache.hadoop.fs.s3...
[javadoc] Loading source files for package org.apache.hadoop.fs.s3native...
[javadoc] Loading source files for package org.apache.hadoop.fs.shell...
[javadoc] Loading source files for package org.apache.hadoop.fs.viewfs...
[javadoc] Loading source files for package org.apache.hadoop.http...
[javadoc] Loading source files for package org.apache.hadoop.http.lib...
[javadoc] Loading source files for package org.apache.hadoop.io...
[javadoc] Loading source files for package org.apache.hadoop.io.compress...
[javadoc] Loading source files for package org.apache.hadoop.io.compress.bzip2...
[javadoc] Loading source files for package org.apache.hadoop.io.compress.lz4...
[javadoc] Loading source files for package org.apache.hadoop.io.compress.snappy...
[javadoc] Loading source files for package org.apache.hadoop.io.compress.zlib...
[javadoc] Loading source files for package org.apache.hadoop.io.file.tfile...
[javadoc] Loading source files for package org.apache.hadoop.io.nativeio...
[javadoc] Loading source files for package org.apache.hadoop.io.retry...
[javadoc] Loading source files for package org.apache.hadoop.io.serializer...
[javadoc] Loading source files for package org.apache.hadoop.io.serializer.avro...
[javadoc] Loading source files for package org.apache.hadoop.ipc...
[javadoc] Loading source files for package org.apache.hadoop.ipc.metrics...
[javadoc] Loading source files for package org.apache.hadoop.jmx...
[javadoc] Loading source files for package org.apache.hadoop.log...
[javadoc] Loading source files for package org.apache.hadoop.log.metrics...
[javadoc] Loading source files for package org.apache.hadoop.metrics...
[javadoc] Loading source files for package org.apache.hadoop.metrics.file...
[javadoc] Loading source files for package org.apache.hadoop.metrics.ganglia...
[javadoc] Loading source files for package org.apache.hadoop.metrics.jvm...
[javadoc] Loading source files for package org.apache.hadoop.metrics.spi...
[javadoc] Loading source files for package org.apache.hadoop.metrics.util...
[javadoc] Loading source files for package org.apache.hadoop.metrics2...
[javadoc] Loading source files for package org.apache.hadoop.metrics2.annotation...
[javadoc] Loading source files for package org.apache.hadoop.metrics2.filter...
[javadoc] Loading source files for package org.apache.hadoop.metrics2.impl...
[javadoc] Loading source files for package org.apache.hadoop.metrics2.lib...
[javadoc] Loading source files for package org.apache.hadoop.metrics2.sink...
[javadoc] Loading source files for package org.apache.hadoop.metrics2.sink.ganglia...
[javadoc] Loading source files for package org.apache.hadoop.metrics2.source...
[javadoc] Loading source files for package org.apache.hadoop.metrics2.util...
[javadoc] Loading source files for package org.apache.hadoop.net...
[javadoc] Loading source files for package org.apache.hadoop.record...
[javadoc] Loading source files for package org.apache.hadoop.record.compiler...
[javadoc] Loading source files for package org.apache.hadoop.record.compiler.ant...
[javadoc] Loading source files for package org.apache.hadoop.record.compiler.generated...
[javadoc] Loading source files for package org.apache.hadoop.record.meta...
[javadoc] Loading source files for package org.apache.hadoop.security...
[javadoc] Loading source files for package org.apache.hadoop.security.authorize...
[javadoc] Loading source files for package org.apache.hadoop.security.token...
[javadoc] Loading source files for package org.apache.hadoop.security.token.delegation...
[javadoc] Loading source files for package org.apache.hadoop.tools...
[javadoc] Loading source files for package org.apache.hadoop.util...
[javadoc] Loading source files for package org.apache.hadoop.util.bloom...
[javadoc] Loading source files for package org.apache.hadoop.util.hash...
[javadoc] 2 errors
[INFO] ------------------------------------------------------------------------
[INFO] Reactor Summary:
[INFO]
[INFO] Apache Hadoop Annotations ......................... SUCCESS [11.831s]
[INFO] Apache Hadoop Auth ................................ SUCCESS [17.478s]
[INFO] Apache Hadoop Auth Examples ....................... SUCCESS [7.138s]
[INFO] Apache Hadoop Common .............................. FAILURE [56.403s]
[INFO] Apache Hadoop Common Project ...................... SKIPPED
[INFO] ------------------------------------------------------------------------
[INFO] BUILD FAILURE
[INFO] ------------------------------------------------------------------------
[INFO] Total time: 1:33.786s
[INFO] Finished at: Tue Feb 14 09:05:57 UTC 2012
[INFO] Final Memory: 69M/578M
[INFO] ------------------------------------------------------------------------
[ERROR] Failed to execute goal org.apache.maven.plugins:maven-antrun-plugin:1.6:run (site) on project hadoop-common: An Ant BuildException has occured: input file <https://builds.apache.org/job/Hadoop-Common-0.23-Build/ws/trunk/hadoop-common-project/hadoop-common/target/findbugsXml.xml> does not exist -> [Help 1]
[ERROR]
[ERROR] To see the full stack trace of the errors, re-run Maven with the -e switch.
[ERROR] Re-run Maven using the -X switch to enable full debug logging.
[ERROR]
[ERROR] For more information about the errors and possible solutions, please read the following articles:
[ERROR] [Help 1] http://cwiki.apache.org/confluence/display/MAVEN/MojoExecutionException
[ERROR]
[ERROR] After correcting the problems, you can resume the build with the command
[ERROR] mvn <goals> -rf :hadoop-common
+ /home/jenkins/tools/maven/latest/bin/mvn test -Pclover -DcloverLicenseLocation=/home/jenkins/tools/clover/latest/lib/clover.license
[WARNINGS] Parsing warnings in console log with parsers [Java Compiler, JavaDoc]
[WARNINGS] Java Compiler : Found 72 warnings.
[WARNINGS] Java Compiler : Found 17 warnings.
[WARNINGS] JavaDoc : Found 0 warnings.
[WARNINGS] Computing warning deltas based on reference build #162
Archiving artifacts
Recording fingerprints
Publishing Javadoc
ERROR: Publisher hudson.tasks.JavadocArchiver aborted due to exception
<https://builds.apache.org/job/Hadoop-Common-0.23-Build/ws/trunk/hadoop-common-project/hadoop-common/target/site/api> does not exist.
at org.apache.tools.ant.types.AbstractFileSet.getDirectoryScanner(AbstractFileSet.java:474)
at hudson.FilePath$35.hasMatch(FilePath.java:1905)
at hudson.FilePath$35.invoke(FilePath.java:1814)
at hudson.FilePath$35.invoke(FilePath.java:1805)
at hudson.FilePath$FileCallableWrapper.call(FilePath.java:2099)
at hudson.remoting.UserRequest.perform(UserRequest.java:118)
at hudson.remoting.UserRequest.perform(UserRequest.java:48)
at hudson.remoting.Request$2.run(Request.java:287)
at hudson.remoting.InterceptingExecutorService$1.call(InterceptingExecutorService.java:72)
at java.util.concurrent.FutureTask$Sync.innerRun(FutureTask.java:303)
at java.util.concurrent.FutureTask.run(FutureTask.java:138)
at java.util.concurrent.ThreadPoolExecutor$Worker.runTask(ThreadPoolExecutor.java:886)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:908)
at java.lang.Thread.run(Thread.java:662)
Recording test results
From common-dev-return-77720-apmail-hadoop-common-dev-archive=hadoop.apache.org@hadoop.apache.org Tue Feb 14 18:24:24 2012
Return-Path: <common-dev-return-77720-apmail-hadoop-common-dev-archive=hadoop.apache.org@hadoop.apache.org>
X-Original-To: apmail-hadoop-common-dev-archive@www.apache.org
Delivered-To: apmail-hadoop-common-dev-archive@www.apache.org
Received: from mail.apache.org (hermes.apache.org [140.211.11.3])
by minotaur.apache.org (Postfix) with SMTP id 541279FFD
for <apmail-hadoop-common-dev-archive@www.apache.org>; Tue, 14 Feb 2012 18:24:24 +0000 (UTC)
Received: (qmail 55898 invoked by uid 500); 14 Feb 2012 18:24:22 -0000
Delivered-To: apmail-hadoop-common-dev-archive@hadoop.apache.org
Received: (qmail 55804 invoked by uid 500); 14 Feb 2012 18:24:22 -0000
Mailing-List: contact common-dev-help@hadoop.apache.org; run by ezmlm
Precedence: bulk
List-Help: <mailto:common-dev-help@hadoop.apache.org>
List-Unsubscribe: <mailto:common-dev-unsubscribe@hadoop.apache.org>
List-Post: <mailto:common-dev@hadoop.apache.org>
List-Id: <common-dev.hadoop.apache.org>
Reply-To: common-dev@hadoop.apache.org
Delivered-To: mailing list common-dev@hadoop.apache.org
Received: (qmail 55778 invoked by uid 99); 14 Feb 2012 18:24:22 -0000
Received: from athena.apache.org (HELO athena.apache.org) (140.211.11.136)
by apache.org (qpsmtpd/0.29) with ESMTP; Tue, 14 Feb 2012 18:24:22 +0000
X-ASF-Spam-Status: No, hits=-2000.0 required=5.0
tests=ALL_TRUSTED,T_RP_MATCHES_RCVD
X-Spam-Check-By: apache.org
Received: from [140.211.11.116] (HELO hel.zones.apache.org) (140.211.11.116)
by apache.org (qpsmtpd/0.29) with ESMTP; Tue, 14 Feb 2012 18:24:21 +0000
Received: from hel.zones.apache.org (hel.zones.apache.org [140.211.11.116])
by hel.zones.apache.org (Postfix) with ESMTP id D91DC1B7F65
for <common-dev@hadoop.apache.org>; Tue, 14 Feb 2012 18:24:00 +0000 (UTC)
Date: Tue, 14 Feb 2012 18:24:00 +0000 (UTC)
From: "Matt Foley (Resolved) (JIRA)" <jira@apache.org>
To: common-dev@hadoop.apache.org
Message-ID: <255927235.37286.1329243840890.JavaMail.tomcat@hel.zones.apache.org>
In-Reply-To: <811467644.12104.1328031550227.JavaMail.tomcat@hel.zones.apache.org>
Subject: [jira] [Resolved] (HADOOP-8009) Create hadoop-client and
hadoop-minicluster artifacts for downstream projects
MIME-Version: 1.0
Content-Type: text/plain; charset=utf-8
Content-Transfer-Encoding: 7bit
X-JIRA-FingerPrint: 30527f35849b9dde25b450d4833f0394
[ https://issues.apache.org/jira/browse/HADOOP-8009?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Matt Foley resolved HADOOP-8009.
--------------------------------
Resolution: Fixed
Thanks, Alejandro.
Committed to branch-1.0 and branch-1.
> Create hadoop-client and hadoop-minicluster artifacts for downstream projects
> ------------------------------------------------------------------------------
>
> Key: HADOOP-8009
> URL: https://issues.apache.org/jira/browse/HADOOP-8009
> Project: Hadoop Common
> Issue Type: Improvement
> Components: build
> Affects Versions: 0.22.0, 0.23.0, 0.24.0, 0.23.1, 1.0.0
> Reporter: Alejandro Abdelnur
> Assignee: Alejandro Abdelnur
> Priority: Critical
> Fix For: 0.23.1, 1.0.1
>
> Attachments: HADOOP-8009-branch-1-add.patch, HADOOP-8009-branch-1.patch, HADOOP-8009-existing-releases.patch, HADOOP-8009.patch
>
>
> Using Hadoop from projects like Pig/Hive/Sqoop/Flume/Oozie or any in-house system that interacts with Hadoop is quite challenging for the following reasons:
> * *Different versions of Hadoop produce different artifacts:* Before Hadoop 0.23 there was a single artifact hadoop-core, starting with Hadoop 0.23 there are several (common, hdfs, mapred*, yarn*)
> * *There are no 'client' artifacts:* Current artifacts include all JARs needed to run the services, thus bringing into clients several JARs that are not used for job submission/monitoring (servlet, jsp, tomcat, jersey, etc.)
> * *Doing testing on the client side is also quite challenging as more artifacts have to be included than the dependencies define:* for example, the history-server artifact has to be explicitly included. If using Hadoop 1 artifacts, jersey-server has to be explicitly included.
> * *3rd party dependencies change in Hadoop from version to version:* This makes things complicated for projects that have to deal with multiple versions of Hadoop as their exclusions list become a huge mix & match of artifacts from different Hadoop versions and it may be break things when a particular version of Hadoop requires a dependency that other version of Hadoop does not require.
> Because of this it would be quite convenient to have the following 'aggregator' artifacts:
> * *org.apache.hadoop:hadoop-client* : it includes all required JARs to use Hadoop client APIs (excluding all JARs that are not needed for it)
> * *org.apache.hadoop:hadoop-minicluster* : it includes all required JARs to run Hadoop Mini Clusters
> These aggregator artifacts would be created for current branches under development (trunk, 0.22, 0.23, 1.0) and for released versions that are still in use.
> For branches under development, these artifacts would be generated as part of the build.
> For released versions we would have a a special branch used only as vehicle for publishing the corresponding 'aggregator' artifacts.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
From common-dev-return-77721-apmail-hadoop-common-dev-archive=hadoop.apache.org@hadoop.apache.org Tue Feb 14 22:02:25 2012
Return-Path: <common-dev-return-77721-apmail-hadoop-common-dev-archive=hadoop.apache.org@hadoop.apache.org>
X-Original-To: apmail-hadoop-common-dev-archive@www.apache.org
Delivered-To: apmail-hadoop-common-dev-archive@www.apache.org
Received: from mail.apache.org (hermes.apache.org [140.211.11.3])
by minotaur.apache.org (Postfix) with SMTP id 7BF9E9C6C
for <apmail-hadoop-common-dev-archive@www.apache.org>; Tue, 14 Feb 2012 22:02:25 +0000 (UTC)
Received: (qmail 19828 invoked by uid 500); 14 Feb 2012 22:02:23 -0000
Delivered-To: apmail-hadoop-common-dev-archive@hadoop.apache.org
Received: (qmail 19732 invoked by uid 500); 14 Feb 2012 22:02:23 -0000
Mailing-List: contact common-dev-help@hadoop.apache.org; run by ezmlm
Precedence: bulk
List-Help: <mailto:common-dev-help@hadoop.apache.org>
List-Unsubscribe: <mailto:common-dev-unsubscribe@hadoop.apache.org>
List-Post: <mailto:common-dev@hadoop.apache.org>
List-Id: <common-dev.hadoop.apache.org>
Reply-To: common-dev@hadoop.apache.org
Delivered-To: mailing list common-dev@hadoop.apache.org
Received: (qmail 19723 invoked by uid 99); 14 Feb 2012 22:02:23 -0000
Received: from nike.apache.org (HELO nike.apache.org) (192.87.106.230)
by apache.org (qpsmtpd/0.29) with ESMTP; Tue, 14 Feb 2012 22:02:23 +0000
X-ASF-Spam-Status: No, hits=-2000.0 required=5.0
tests=ALL_TRUSTED,T_RP_MATCHES_RCVD
X-Spam-Check-By: apache.org
Received: from [140.211.11.116] (HELO hel.zones.apache.org) (140.211.11.116)
by apache.org (qpsmtpd/0.29) with ESMTP; Tue, 14 Feb 2012 22:02:21 +0000
Received: from hel.zones.apache.org (hel.zones.apache.org [140.211.11.116])
by hel.zones.apache.org (Postfix) with ESMTP id 1A4271B7F90
for <common-dev@hadoop.apache.org>; Tue, 14 Feb 2012 22:02:00 +0000 (UTC)
Date: Tue, 14 Feb 2012 22:02:00 +0000 (UTC)
From: "Peter Linnell (Created) (JIRA)" <jira@apache.org>
To: common-dev@hadoop.apache.org
Message-ID: <1651505758.38158.1329256920109.JavaMail.tomcat@hel.zones.apache.org>
Subject: [jira] [Created] (HADOOP-8072) bin/hadoop leaks pids when running a
non-detached datanode via jsvc
MIME-Version: 1.0
Content-Type: text/plain; charset=utf-8
Content-Transfer-Encoding: 7bit
X-JIRA-FingerPrint: 30527f35849b9dde25b450d4833f0394
X-Virus-Checked: Checked by ClamAV on apache.org
bin/hadoop leaks pids when running a non-detached datanode via jsvc
-------------------------------------------------------------------
Key: HADOOP-8072
URL: https://issues.apache.org/jira/browse/HADOOP-8072
Project: Hadoop Common
Issue Type: Bug
Affects Versions: 1.0.0, 0.20.205.0
Environment: Centos 5 or 6, but affects all platforms
Reporter: Peter Linnell
See: https://issues.cloudera.org/browse/DISTRO-53
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
From common-dev-return-77722-apmail-hadoop-common-dev-archive=hadoop.apache.org@hadoop.apache.org Tue Feb 14 22:30:11 2012
Return-Path: <common-dev-return-77722-apmail-hadoop-common-dev-archive=hadoop.apache.org@hadoop.apache.org>
X-Original-To: apmail-hadoop-common-dev-archive@www.apache.org
Delivered-To: apmail-hadoop-common-dev-archive@www.apache.org
Received: from mail.apache.org (hermes.apache.org [140.211.11.3])
by minotaur.apache.org (Postfix) with SMTP id AB0DE90E3
for <apmail-hadoop-common-dev-archive@www.apache.org>; Tue, 14 Feb 2012 22:30:11 +0000 (UTC)
Received: (qmail 18583 invoked by uid 500); 14 Feb 2012 22:30:10 -0000
Delivered-To: apmail-hadoop-common-dev-archive@hadoop.apache.org
Received: (qmail 18532 invoked by uid 500); 14 Feb 2012 22:30:10 -0000
Mailing-List: contact common-dev-help@hadoop.apache.org; run by ezmlm
Precedence: bulk
List-Help: <mailto:common-dev-help@hadoop.apache.org>
List-Unsubscribe: <mailto:common-dev-unsubscribe@hadoop.apache.org>
List-Post: <mailto:common-dev@hadoop.apache.org>
List-Id: <common-dev.hadoop.apache.org>
Reply-To: common-dev@hadoop.apache.org
Delivered-To: mailing list common-dev@hadoop.apache.org
Received: (qmail 18524 invoked by uid 99); 14 Feb 2012 22:30:10 -0000
Received: from nike.apache.org (HELO nike.apache.org) (192.87.106.230)
by apache.org (qpsmtpd/0.29) with ESMTP; Tue, 14 Feb 2012 22:30:10 +0000
X-ASF-Spam-Status: No, hits=2.9 required=5.0
tests=HTML_MESSAGE,RCVD_IN_DNSWL_NONE,SPF_NEUTRAL
X-Spam-Check-By: apache.org
Received-SPF: neutral (nike.apache.org: local policy)
Received: from [209.85.217.176] (HELO mail-lpp01m020-f176.google.com) (209.85.217.176)
by apache.org (qpsmtpd/0.29) with ESMTP; Tue, 14 Feb 2012 22:30:01 +0000
Received: by lboi15 with SMTP id i15so315982lbo.35
for <common-dev@hadoop.apache.org>; Tue, 14 Feb 2012 14:29:40 -0800 (PST)
Received: by 10.152.122.74 with SMTP id lq10mr17740374lab.7.1329258580244;
Tue, 14 Feb 2012 14:29:40 -0800 (PST)
MIME-Version: 1.0
Reply-To: mattf@apache.org
Sender: mfoley@hortonworks.com
Received: by 10.112.103.132 with HTTP; Tue, 14 Feb 2012 14:29:10 -0800 (PST)
From: Matt Foley <mattf@apache.org>
Date: Tue, 14 Feb 2012 14:29:10 -0800
X-Google-Sender-Auth: 3h9VOgmRD-zXPzBABmEHKWsN1j4
Message-ID: <CA+z3+9HrBBf2___wSEk7M=HrzDRLsvHikqcR3Mx2ra6+3oMuwg@mail.gmail.com>
Subject: [VOTE] Hadoop-1.0.1 Release Candidate 1
To: common-dev@hadoop.apache.org
Content-Type: multipart/alternative; boundary=f46d043c06887d795504b8f421f9
X-Gm-Message-State: ALoCoQkU6PxiuprzwZGKXUUvrUTuxQsost9/ZYs98909zh7UsGwEsYLvBYfIa69e/XqfIQcN8Guk
X-Virus-Checked: Checked by ClamAV on apache.org
--f46d043c06887d795504b8f421f9
Content-Type: text/plain; charset=ISO-8859-1
Hi all,
Hadoop-1.0.1-rc1 is now available at
http://people.apache.org/~mattf/hadoop-1.0.1-rc1/
Please download it, test it, and vote on whether to accept it as Release
1.0.1.
Voting will close at 2:30pm PST on Tuesday 21 February.
Thank you,
--Matt (Release Manager)
This is a maintenance release from 1.0.0, but a number of
production-relevant bug fixes were requested for inclusion in the last week
or so. The complete release notes are available at
http://people.apache.org/~mattf/hadoop-1.0.1-rc1/RELEASE_NOTES_HADOOP-1.0.1.html
The summary list is:
- HADOOP-8009 <https://issues.apache.org/jira/browse/HADOOP-8009>.
Create hadoop-client and hadoop-minicluster artifacts for downstream
projects
- HADOOP-8037 <https://issues.apache.org/jira/browse/HADOOP-8037>. Binary
tarball does not preserve platform info for native builds, and RPMs fail to
provide needed symlinks for libhadoop.so
- MAPREDUCE-3184
<https://issues.apache.org/jira/browse/MAPREDUCE-3184>. Improve
handling of fetch failures when a tasktracker is not responding on HTTP
- HADOOP-7470 <https://issues.apache.org/jira/browse/HADOOP-7470>. move
up to Jackson 1.8.8
- HADOOP-7960 <https://issues.apache.org/jira/browse/HADOOP-7960>. Port
HADOOP-5203 to branch-1, build version comparison is too restrictive
- HADOOP-7964 <https://issues.apache.org/jira/browse/HADOOP-7964>. Deadlock
in class init.
- HADOOP-7987 <https://issues.apache.org/jira/browse/HADOOP-7987>. Support
setting the run-as user in unsecure mode
- HADOOP-7988 <https://issues.apache.org/jira/browse/HADOOP-7988>. Upper
case in hostname part of the principals doesn't work with kerberos.
- HADOOP-8010 <https://issues.apache.org/jira/browse/HADOOP-8010>.
hadoop-config.sh
spews error message when HADOOP_HOME_WARN_SUPPRESS is set to true and
HADOOP_HOME is present
- HADOOP-8052 <https://issues.apache.org/jira/browse/HADOOP-8052>. Hadoop
Metrics2 should emit Float.MAX_VALUE (instead of Double.MAX_VALUE) to avoid
making Ganglia's gmetad core
- HDFS-2379 <https://issues.apache.org/jira/browse/HDFS-2379>. 0.20:
Allow block reports to proceed without holding FSDataset lock
- HDFS-2814 <https://issues.apache.org/jira/browse/HDFS-2814>.
NamenodeMXBean
does not account for svn revision in the version information
- MAPREDUCE-3343
<https://issues.apache.org/jira/browse/MAPREDUCE-3343>. TaskTracker
Out of Memory because of distributed cache
- MAPREDUCE-3607
<https://issues.apache.org/jira/browse/MAPREDUCE-3607>. Port
missing new API mapreduce lib classes to 1.x
--f46d043c06887d795504b8f421f9--
From common-dev-return-77723-apmail-hadoop-common-dev-archive=hadoop.apache.org@hadoop.apache.org Tue Feb 14 23:28:22 2012
Return-Path: <common-dev-return-77723-apmail-hadoop-common-dev-archive=hadoop.apache.org@hadoop.apache.org>
X-Original-To: apmail-hadoop-common-dev-archive@www.apache.org
Delivered-To: apmail-hadoop-common-dev-archive@www.apache.org
Received: from mail.apache.org (hermes.apache.org [140.211.11.3])
by minotaur.apache.org (Postfix) with SMTP id 645149B95
for <apmail-hadoop-common-dev-archive@www.apache.org>; Tue, 14 Feb 2012 23:28:22 +0000 (UTC)
Received: (qmail 77049 invoked by uid 500); 14 Feb 2012 23:28:20 -0000
Delivered-To: apmail-hadoop-common-dev-archive@hadoop.apache.org
Received: (qmail 76900 invoked by uid 500); 14 Feb 2012 23:28:20 -0000
Mailing-List: contact common-dev-help@hadoop.apache.org; run by ezmlm
Precedence: bulk
List-Help: <mailto:common-dev-help@hadoop.apache.org>
List-Unsubscribe: <mailto:common-dev-unsubscribe@hadoop.apache.org>
List-Post: <mailto:common-dev@hadoop.apache.org>
List-Id: <common-dev.hadoop.apache.org>
Reply-To: common-dev@hadoop.apache.org
Delivered-To: mailing list common-dev@hadoop.apache.org
Received: (qmail 76704 invoked by uid 99); 14 Feb 2012 23:28:20 -0000
Received: from athena.apache.org (HELO athena.apache.org) (140.211.11.136)
by apache.org (qpsmtpd/0.29) with ESMTP; Tue, 14 Feb 2012 23:28:20 +0000
X-ASF-Spam-Status: No, hits=-2000.0 required=5.0
tests=ALL_TRUSTED,T_RP_MATCHES_RCVD
X-Spam-Check-By: apache.org
Received: from [140.211.11.116] (HELO hel.zones.apache.org) (140.211.11.116)
by apache.org (qpsmtpd/0.29) with ESMTP; Tue, 14 Feb 2012 23:28:19 +0000
Received: from hel.zones.apache.org (hel.zones.apache.org [140.211.11.116])
by hel.zones.apache.org (Postfix) with ESMTP id 73F151B792C
for <common-dev@hadoop.apache.org>; Tue, 14 Feb 2012 23:27:59 +0000 (UTC)
Date: Tue, 14 Feb 2012 23:27:59 +0000 (UTC)
From: "Kihwal Lee (Created) (JIRA)" <jira@apache.org>
To: common-dev@hadoop.apache.org
Message-ID: <4645604.38377.1329262079476.JavaMail.tomcat@hel.zones.apache.org>
Subject: [jira] [Created] (HADOOP-8073) Add a test for the jmx metrics
serving
MIME-Version: 1.0
Content-Type: text/plain; charset=utf-8
Content-Transfer-Encoding: 7bit
X-JIRA-FingerPrint: 30527f35849b9dde25b450d4833f0394
Add a test for the jmx metrics serving
--------------------------------------
Key: HADOOP-8073
URL: https://issues.apache.org/jira/browse/HADOOP-8073
Project: Hadoop Common
Issue Type: Improvement
Components: metrics
Affects Versions: 1.0.0
Reporter: Kihwal Lee
>From HADOOP-8050,
bq. ...people can run something like jcarder with the unit tests and detect potential deadlocks.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
From common-dev-return-77724-apmail-hadoop-common-dev-archive=hadoop.apache.org@hadoop.apache.org Tue Feb 14 23:38:28 2012
Return-Path: <common-dev-return-77724-apmail-hadoop-common-dev-archive=hadoop.apache.org@hadoop.apache.org>
X-Original-To: apmail-hadoop-common-dev-archive@www.apache.org
Delivered-To: apmail-hadoop-common-dev-archive@www.apache.org
Received: from mail.apache.org (hermes.apache.org [140.211.11.3])
by minotaur.apache.org (Postfix) with SMTP id 30572925F
for <apmail-hadoop-common-dev-archive@www.apache.org>; Tue, 14 Feb 2012 23:38:28 +0000 (UTC)
Received: (qmail 1730 invoked by uid 500); 14 Feb 2012 23:38:26 -0000
Delivered-To: apmail-hadoop-common-dev-archive@hadoop.apache.org
Received: (qmail 1668 invoked by uid 500); 14 Feb 2012 23:38:26 -0000
Mailing-List: contact common-dev-help@hadoop.apache.org; run by ezmlm
Precedence: bulk
List-Help: <mailto:common-dev-help@hadoop.apache.org>
List-Unsubscribe: <mailto:common-dev-unsubscribe@hadoop.apache.org>
List-Post: <mailto:common-dev@hadoop.apache.org>
List-Id: <common-dev.hadoop.apache.org>
Reply-To: common-dev@hadoop.apache.org
Delivered-To: mailing list common-dev@hadoop.apache.org
Received: (qmail 1660 invoked by uid 99); 14 Feb 2012 23:38:26 -0000
Received: from nike.apache.org (HELO nike.apache.org) (192.87.106.230)
by apache.org (qpsmtpd/0.29) with ESMTP; Tue, 14 Feb 2012 23:38:26 +0000
X-ASF-Spam-Status: No, hits=-2000.0 required=5.0
tests=ALL_TRUSTED,T_RP_MATCHES_RCVD
X-Spam-Check-By: apache.org
Received: from [140.211.11.116] (HELO hel.zones.apache.org) (140.211.11.116)
by apache.org (qpsmtpd/0.29) with ESMTP; Tue, 14 Feb 2012 23:38:21 +0000
Received: from hel.zones.apache.org (hel.zones.apache.org [140.211.11.116])
by hel.zones.apache.org (Postfix) with ESMTP id 3B6B81B7F76
for <common-dev@hadoop.apache.org>; Tue, 14 Feb 2012 23:38:00 +0000 (UTC)
Date: Tue, 14 Feb 2012 23:38:00 +0000 (UTC)
From: "Eli Collins (Created) (JIRA)" <jira@apache.org>
To: common-dev@hadoop.apache.org
Message-ID: <1000031246.38429.1329262680244.JavaMail.tomcat@hel.zones.apache.org>
Subject: [jira] [Created] (HADOOP-8074) Small bug in hadoop error message
for unknown commands
MIME-Version: 1.0
Content-Type: text/plain; charset=utf-8
Content-Transfer-Encoding: 7bit
X-JIRA-FingerPrint: 30527f35849b9dde25b450d4833f0394
X-Virus-Checked: Checked by ClamAV on apache.org
Small bug in hadoop error message for unknown commands
------------------------------------------------------
Key: HADOOP-8074
URL: https://issues.apache.org/jira/browse/HADOOP-8074
Project: Hadoop Common
Issue Type: Bug
Components: scripts
Affects Versions: 0.24.0
Reporter: Eli Collins
Assignee: Colin Patrick McCabe
Priority: Trivial
Fix For: 0.23.2
The hadoop fs command should be more user friendly if the user forgets the dash before the command. Also, this should say "cat" rather than "at".
{noformat}
hadoop-0.24.0-SNAPSHOT $ ./bin/hadoop fs cat
at: Unknown command
{noformat}
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
From common-dev-return-77725-apmail-hadoop-common-dev-archive=hadoop.apache.org@hadoop.apache.org Wed Feb 15 13:28:09 2012
Return-Path: <common-dev-return-77725-apmail-hadoop-common-dev-archive=hadoop.apache.org@hadoop.apache.org>
X-Original-To: apmail-hadoop-common-dev-archive@www.apache.org
Delivered-To: apmail-hadoop-common-dev-archive@www.apache.org
Received: from mail.apache.org (hermes.apache.org [140.211.11.3])
by minotaur.apache.org (Postfix) with SMTP id 32C8D96DC
for <apmail-hadoop-common-dev-archive@www.apache.org>; Wed, 15 Feb 2012 13:28:09 +0000 (UTC)
Received: (qmail 7344 invoked by uid 500); 15 Feb 2012 13:28:07 -0000
Delivered-To: apmail-hadoop-common-dev-archive@hadoop.apache.org
Received: (qmail 7257 invoked by uid 500); 15 Feb 2012 13:28:06 -0000
Mailing-List: contact common-dev-help@hadoop.apache.org; run by ezmlm
Precedence: bulk
List-Help: <mailto:common-dev-help@hadoop.apache.org>
List-Unsubscribe: <mailto:common-dev-unsubscribe@hadoop.apache.org>
List-Post: <mailto:common-dev@hadoop.apache.org>
List-Id: <common-dev.hadoop.apache.org>
Reply-To: common-dev@hadoop.apache.org
Delivered-To: mailing list common-dev@hadoop.apache.org
Received: (qmail 7244 invoked by uid 500); 15 Feb 2012 13:28:06 -0000
Delivered-To: apmail-hadoop-core-dev@hadoop.apache.org
Received: (qmail 7240 invoked by uid 500); 15 Feb 2012 13:28:06 -0000
Delivered-To: apmail-lucene-hadoop-dev@lucene.apache.org
Received: (qmail 7237 invoked by uid 99); 15 Feb 2012 13:28:06 -0000
Received: from athena.apache.org (HELO athena.apache.org) (140.211.11.136)
by apache.org (qpsmtpd/0.29) with ESMTP; Wed, 15 Feb 2012 13:28:06 +0000
X-ASF-Spam-Status: No, hits=2.8 required=5.0
tests=HTML_MESSAGE,RCVD_IN_DNSWL_LOW,SPF_PASS,URI_HEX
X-Spam-Check-By: apache.org
Received-SPF: pass (athena.apache.org: domain of ravihadoop@gmail.com designates 209.85.160.48 as permitted sender)
Received: from [209.85.160.48] (HELO mail-pw0-f48.google.com) (209.85.160.48)
by apache.org (qpsmtpd/0.29) with ESMTP; Wed, 15 Feb 2012 13:28:00 +0000
Received: by pbcuo1 with SMTP id uo1so1644221pbc.35
for <hadoop-dev@lucene.apache.org>; Wed, 15 Feb 2012 05:27:40 -0800 (PST)
DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed;
d=gmail.com; s=gamma;
h=mime-version:in-reply-to:references:date:message-id:subject:from:to
:cc:content-type;
bh=yvT1aM1Vjz/mpp77MnLXzKWsCpdiEh89xCLxIyYPvGM=;
b=tZpwt7cIxqjb+vM5hb/JQ+jn60gyMUrq2Qd60OCEBHw+l9r9Pj+vBvckW8DL0U95hp
+XFUsR91fComwpgHZjiHqY9y459qcN0Wm9lIqs7fTAfI7zv3jbumFoDWFSfNRO5YGaUY
shHAPWDU4vOOaxHRoojhfjjkidlxFw6juDlY0=
MIME-Version: 1.0
Received: by 10.68.193.167 with SMTP id hp7mr3909422pbc.3.1329312460208; Wed,
15 Feb 2012 05:27:40 -0800 (PST)
Received: by 10.142.152.35 with HTTP; Wed, 15 Feb 2012 05:27:40 -0800 (PST)
In-Reply-To: <1329010868844-3736421.post@n3.nabble.com>
References: <1329010868844-3736421.post@n3.nabble.com>
Date: Wed, 15 Feb 2012 07:27:40 -0600
Message-ID: <CAMs9kViDTfFYzNYtUqY7-hyiSkErYo_6oyZ0AbtcQGFFMkC5KQ@mail.gmail.com>
Subject: Re: datanode to blocks mapping
From: Ravi Prakash <ravihadoop@gmail.com>
To: common-dev@hadoop.apache.org
Cc: hadoop-dev@lucene.apache.org
Content-Type: multipart/alternative; boundary=047d7b15aebffc78fa04b900acec
--047d7b15aebffc78fa04b900acec
Content-Type: text/plain; charset=ISO-8859-1
Selwa,
You are *creating* a new BlocksMap with the first line. It is NOT an API to
get the blockmap from the namenode. The Namenode stores its blocks in a
Blockmap in the BlockManager (for 0.23) or FSNameSystem (for 0.20)
Which version are you using?
Regards,
Ravi.
On Sat, Feb 11, 2012 at 7:41 PM, Selwa <elhamab99@gmail.com> wrote:
> Hello there,
> currently i am working on research about the block placement policy of
> HDFS.
> I want to find the blocks mapping of the pseudo cluster.
> then i request the name node for this data structure by the following code
>
> BlocksMap blocksMap = new BlocksMap(16, 0.75f);
> Collection<BlockInfo>blocks = blocksMap.getBlocks();
> but the collection does not hold any thing - always it is
> empty
> blocks.isempty() is becoming true even i saved some files on
> the pseudo -cluster.
> what is wrong with this code?
> is there any other way to find block mapping?
>
> thanks
>
> Selwa
>
> --
> View this message in context:
> http://lucene.472066.n3.nabble.com/datanode-to-blocks-mapping-tp3736421p3736421.html
> Sent from the Hadoop lucene-dev mailing list archive at Nabble.com.
>
--047d7b15aebffc78fa04b900acec--
From common-dev-return-77726-apmail-hadoop-common-dev-archive=hadoop.apache.org@hadoop.apache.org Wed Feb 15 13:28:11 2012
Return-Path: <common-dev-return-77726-apmail-hadoop-common-dev-archive=hadoop.apache.org@hadoop.apache.org>
X-Original-To: apmail-hadoop-common-dev-archive@www.apache.org
Delivered-To: apmail-hadoop-common-dev-archive@www.apache.org
Received: from mail.apache.org (hermes.apache.org [140.211.11.3])
by minotaur.apache.org (Postfix) with SMTP id 5E0039733
for <apmail-hadoop-common-dev-archive@www.apache.org>; Wed, 15 Feb 2012 13:28:11 +0000 (UTC)
Received: (qmail 8936 invoked by uid 500); 15 Feb 2012 13:28:09 -0000
Delivered-To: apmail-hadoop-common-dev-archive@hadoop.apache.org
Received: (qmail 8866 invoked by uid 500); 15 Feb 2012 13:28:09 -0000
Mailing-List: contact common-dev-help@hadoop.apache.org; run by ezmlm
Precedence: bulk
List-Help: <mailto:common-dev-help@hadoop.apache.org>
List-Unsubscribe: <mailto:common-dev-unsubscribe@hadoop.apache.org>
List-Post: <mailto:common-dev@hadoop.apache.org>
List-Id: <common-dev.hadoop.apache.org>
Reply-To: common-dev@hadoop.apache.org
Delivered-To: mailing list common-dev@hadoop.apache.org
Received: (qmail 8834 invoked by uid 99); 15 Feb 2012 13:28:09 -0000
Received: from nike.apache.org (HELO nike.apache.org) (192.87.106.230)
by apache.org (qpsmtpd/0.29) with ESMTP; Wed, 15 Feb 2012 13:28:09 +0000
X-ASF-Spam-Status: No, hits=2.8 required=5.0
tests=HTML_MESSAGE,RCVD_IN_DNSWL_LOW,SPF_PASS,URI_HEX
X-Spam-Check-By: apache.org
Received-SPF: pass (nike.apache.org: domain of ravihadoop@gmail.com designates 209.85.160.48 as permitted sender)
Received: from [209.85.160.48] (HELO mail-pw0-f48.google.com) (209.85.160.48)
by apache.org (qpsmtpd/0.29) with ESMTP; Wed, 15 Feb 2012 13:28:01 +0000
Received: by pbcuo1 with SMTP id uo1so1644222pbc.35
for <common-dev@hadoop.apache.org>; Wed, 15 Feb 2012 05:27:40 -0800 (PST)
DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed;
d=gmail.com; s=gamma;
h=mime-version:in-reply-to:references:date:message-id:subject:from:to
:cc:content-type;
bh=yvT1aM1Vjz/mpp77MnLXzKWsCpdiEh89xCLxIyYPvGM=;
b=tZpwt7cIxqjb+vM5hb/JQ+jn60gyMUrq2Qd60OCEBHw+l9r9Pj+vBvckW8DL0U95hp
+XFUsR91fComwpgHZjiHqY9y459qcN0Wm9lIqs7fTAfI7zv3jbumFoDWFSfNRO5YGaUY
shHAPWDU4vOOaxHRoojhfjjkidlxFw6juDlY0=
MIME-Version: 1.0
Received: by 10.68.193.167 with SMTP id hp7mr3909422pbc.3.1329312460208; Wed,
15 Feb 2012 05:27:40 -0800 (PST)
Received: by 10.142.152.35 with HTTP; Wed, 15 Feb 2012 05:27:40 -0800 (PST)
In-Reply-To: <1329010868844-3736421.post@n3.nabble.com>
References: <1329010868844-3736421.post@n3.nabble.com>
Date: Wed, 15 Feb 2012 07:27:40 -0600
Message-ID: <CAMs9kViDTfFYzNYtUqY7-hyiSkErYo_6oyZ0AbtcQGFFMkC5KQ@mail.gmail.com>
Subject: Re: datanode to blocks mapping
From: Ravi Prakash <ravihadoop@gmail.com>
To: common-dev@hadoop.apache.org
Cc: hadoop-dev@lucene.apache.org
Content-Type: multipart/alternative; boundary=047d7b15aebffc78fa04b900acec
X-Virus-Checked: Checked by ClamAV on apache.org
--047d7b15aebffc78fa04b900acec
Content-Type: text/plain; charset=ISO-8859-1
Selwa,
You are *creating* a new BlocksMap with the first line. It is NOT an API to
get the blockmap from the namenode. The Namenode stores its blocks in a
Blockmap in the BlockManager (for 0.23) or FSNameSystem (for 0.20)
Which version are you using?
Regards,
Ravi.
On Sat, Feb 11, 2012 at 7:41 PM, Selwa <elhamab99@gmail.com> wrote:
> Hello there,
> currently i am working on research about the block placement policy of
> HDFS.
> I want to find the blocks mapping of the pseudo cluster.
> then i request the name node for this data structure by the following code
>
> BlocksMap blocksMap = new BlocksMap(16, 0.75f);
> Collection<BlockInfo>blocks = blocksMap.getBlocks();
> but the collection does not hold any thing - always it is
> empty
> blocks.isempty() is becoming true even i saved some files on
> the pseudo -cluster.
> what is wrong with this code?
> is there any other way to find block mapping?
>
> thanks
>
> Selwa
>
> --
> View this message in context:
> http://lucene.472066.n3.nabble.com/datanode-to-blocks-mapping-tp3736421p3736421.html
> Sent from the Hadoop lucene-dev mailing list archive at Nabble.com.
>
--047d7b15aebffc78fa04b900acec--
From common-dev-return-77727-apmail-hadoop-common-dev-archive=hadoop.apache.org@hadoop.apache.org Wed Feb 15 16:36:29 2012
Return-Path: <common-dev-return-77727-apmail-hadoop-common-dev-archive=hadoop.apache.org@hadoop.apache.org>
X-Original-To: apmail-hadoop-common-dev-archive@www.apache.org
Delivered-To: apmail-hadoop-common-dev-archive@www.apache.org
Received: from mail.apache.org (hermes.apache.org [140.211.11.3])
by minotaur.apache.org (Postfix) with SMTP id 2C0D597E9
for <apmail-hadoop-common-dev-archive@www.apache.org>; Wed, 15 Feb 2012 16:36:29 +0000 (UTC)
Received: (qmail 99135 invoked by uid 500); 15 Feb 2012 16:36:27 -0000
Delivered-To: apmail-hadoop-common-dev-archive@hadoop.apache.org
Received: (qmail 99065 invoked by uid 500); 15 Feb 2012 16:36:27 -0000
Mailing-List: contact common-dev-help@hadoop.apache.org; run by ezmlm
Precedence: bulk
List-Help: <mailto:common-dev-help@hadoop.apache.org>
List-Unsubscribe: <mailto:common-dev-unsubscribe@hadoop.apache.org>
List-Post: <mailto:common-dev@hadoop.apache.org>
List-Id: <common-dev.hadoop.apache.org>
Reply-To: common-dev@hadoop.apache.org
Delivered-To: mailing list common-dev@hadoop.apache.org
Delivered-To: moderator for common-dev@hadoop.apache.org
Received: (qmail 17001 invoked by uid 99); 14 Feb 2012 19:01:32 -0000
X-ASF-Spam-Status: No, hits=1.5 required=5.0
tests=HTML_MESSAGE,RCVD_IN_DNSWL_LOW,SPF_PASS
X-Spam-Check-By: apache.org
Received-SPF: pass (nike.apache.org: domain of sriramsrao@gmail.com designates 74.125.82.48 as permitted sender)
DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed;
d=gmail.com; s=gamma;
h=mime-version:date:message-id:subject:from:to:content-type;
bh=qbuw6mGHfBfw4g0joW2NtUAsfeQZUu1EM9H2clOgKwc=;
b=spud6r4tGZJvAr0K5MHO08tJiH74jZXG0xltP+s8j6srzMO57CQR90SRJh7qOJZGos
2HlOcaW6baLr6XHk0DDIefnYeO4eSJvNAZHxUYEj3yjzTvyZYuMMmlVpFz5diOXe8lFk
S0EMI2Ck0sCG+C6Ou5unCyeeRuCc9mYKFHySY=
MIME-Version: 1.0
Date: Tue, 14 Feb 2012 11:01:04 -0800
Message-ID: <CAEsa9_UnLjEPvOk3djTvE7JBFuDREubO+oTWKOnmjd=_kF16Rg@mail.gmail.com>
Subject: .23 compile times
From: Sriram Rao <sriramsrao@gmail.com>
To: common-dev@hadoop.apache.org
Content-Type: multipart/alternative; boundary=0016e6d77c4383f94e04b8f13761
X-Virus-Checked: Checked by ClamAV on apache.org
--0016e6d77c4383f94e04b8f13761
Content-Type: text/plain; charset=ISO-8859-1
Folks,
The build takes forever:
mvn package -Pdist -DskipTests -Dtar
....
[INFO]
------------------------------------------------------------------------
[INFO] BUILD SUCCESS
[INFO]
------------------------------------------------------------------------
[INFO] Total time: 6:25.399s
[INFO] Finished at: Tue Feb 14 10:54:18 PST 2012
[INFO] Final Memory: 56M/123M
[INFO]
------------------------------------------------------------------------
This is on a mac with 8GB RAM. (The above case involved 0-lines of code
change; just making sure I had everything built!).
Is there a faster way to get the thing to build?
Sriram
--0016e6d77c4383f94e04b8f13761--
From common-dev-return-77728-apmail-hadoop-common-dev-archive=hadoop.apache.org@hadoop.apache.org Wed Feb 15 16:53:31 2012
Return-Path: <common-dev-return-77728-apmail-hadoop-common-dev-archive=hadoop.apache.org@hadoop.apache.org>
X-Original-To: apmail-hadoop-common-dev-archive@www.apache.org
Delivered-To: apmail-hadoop-common-dev-archive@www.apache.org
Received: from mail.apache.org (hermes.apache.org [140.211.11.3])
by minotaur.apache.org (Postfix) with SMTP id F31D99E91
for <apmail-hadoop-common-dev-archive@www.apache.org>; Wed, 15 Feb 2012 16:53:30 +0000 (UTC)
Received: (qmail 66891 invoked by uid 500); 15 Feb 2012 16:53:29 -0000
Delivered-To: apmail-hadoop-common-dev-archive@hadoop.apache.org
Received: (qmail 66824 invoked by uid 500); 15 Feb 2012 16:53:29 -0000
Mailing-List: contact common-dev-help@hadoop.apache.org; run by ezmlm
Precedence: bulk
List-Help: <mailto:common-dev-help@hadoop.apache.org>
List-Unsubscribe: <mailto:common-dev-unsubscribe@hadoop.apache.org>
List-Post: <mailto:common-dev@hadoop.apache.org>
List-Id: <common-dev.hadoop.apache.org>
Reply-To: common-dev@hadoop.apache.org
Delivered-To: mailing list common-dev@hadoop.apache.org
Received: (qmail 66816 invoked by uid 99); 15 Feb 2012 16:53:29 -0000
Received: from nike.apache.org (HELO nike.apache.org) (192.87.106.230)
by apache.org (qpsmtpd/0.29) with ESMTP; Wed, 15 Feb 2012 16:53:29 +0000
X-ASF-Spam-Status: No, hits=-0.7 required=5.0
tests=RCVD_IN_DNSWL_LOW,SPF_PASS
X-Spam-Check-By: apache.org
Received-SPF: pass (nike.apache.org: domain of harsh@cloudera.com designates 209.85.160.48 as permitted sender)
Received: from [209.85.160.48] (HELO mail-pw0-f48.google.com) (209.85.160.48)
by apache.org (qpsmtpd/0.29) with ESMTP; Wed, 15 Feb 2012 16:53:22 +0000
Received: by pbcuo1 with SMTP id uo1so1839738pbc.35
for <common-dev@hadoop.apache.org>; Wed, 15 Feb 2012 08:53:01 -0800 (PST)
Received: by 10.68.191.165 with SMTP id gz5mr5331272pbc.59.1329324781136; Wed,
15 Feb 2012 08:53:01 -0800 (PST)
MIME-Version: 1.0
Received: by 10.68.13.69 with HTTP; Wed, 15 Feb 2012 08:52:41 -0800 (PST)
In-Reply-To: <CAEsa9_UnLjEPvOk3djTvE7JBFuDREubO+oTWKOnmjd=_kF16Rg@mail.gmail.com>
References: <CAEsa9_UnLjEPvOk3djTvE7JBFuDREubO+oTWKOnmjd=_kF16Rg@mail.gmail.com>
From: Harsh J <harsh@cloudera.com>
Date: Wed, 15 Feb 2012 22:22:41 +0530
Message-ID: <CAOcnVr1uWPdG0mtaE5xKNdLz9Yy5D-Es39nw8G-FYgiayiQ2xw@mail.gmail.com>
Subject: Re: .23 compile times
To: common-dev@hadoop.apache.org
Content-Type: text/plain; charset=ISO-8859-1
Content-Transfer-Encoding: quoted-printable
X-Gm-Message-State: ALoCoQkkttQaHu1fWL+KxOeTXYzh6L5Ru3m8oUMhYNZzP0PY56sS4Ipv8cyiOwSfyCIw8Wl5cmGv
X-Virus-Checked: Checked by ClamAV on apache.org
Sriram,
My package command didn't take as long with the same command -- where
do you see it getting stuck at most of the times? Which particular
target (right term?) seems to take the highest time to complete?
On Wed, Feb 15, 2012 at 12:31 AM, Sriram Rao <sriramsrao@gmail.com> wrote:
> Folks,
>
> The build takes forever:
>
> =A0mvn package -Pdist -DskipTests -Dtar
>
> ....
>
> [INFO]
> ------------------------------------------------------------------------
> [INFO] BUILD SUCCESS
> [INFO]
> ------------------------------------------------------------------------
> [INFO] Total time: 6:25.399s
> [INFO] Finished at: Tue Feb 14 10:54:18 PST 2012
> [INFO] Final Memory: 56M/123M
> [INFO]
> ------------------------------------------------------------------------
>
> This is on a mac with 8GB RAM. =A0(The above case involved 0-lines of cod=
e
> change; just making sure I had everything built!).
>
> Is there a faster way to get the thing to build?
>
> Sriram
--=20
Harsh J
Customer Ops. Engineer
Cloudera | http://tiny.cloudera.com/about
From common-dev-return-77729-apmail-hadoop-common-dev-archive=hadoop.apache.org@hadoop.apache.org Wed Feb 15 17:57:25 2012
Return-Path: <common-dev-return-77729-apmail-hadoop-common-dev-archive=hadoop.apache.org@hadoop.apache.org>
X-Original-To: apmail-hadoop-common-dev-archive@www.apache.org
Delivered-To: apmail-hadoop-common-dev-archive@www.apache.org
Received: from mail.apache.org (hermes.apache.org [140.211.11.3])
by minotaur.apache.org (Postfix) with SMTP id 150A89A97
for <apmail-hadoop-common-dev-archive@www.apache.org>; Wed, 15 Feb 2012 17:57:25 +0000 (UTC)
Received: (qmail 54100 invoked by uid 500); 15 Feb 2012 17:57:23 -0000
Delivered-To: apmail-hadoop-common-dev-archive@hadoop.apache.org
Received: (qmail 54032 invoked by uid 500); 15 Feb 2012 17:57:23 -0000
Mailing-List: contact common-dev-help@hadoop.apache.org; run by ezmlm
Precedence: bulk
List-Help: <mailto:common-dev-help@hadoop.apache.org>
List-Unsubscribe: <mailto:common-dev-unsubscribe@hadoop.apache.org>
List-Post: <mailto:common-dev@hadoop.apache.org>
List-Id: <common-dev.hadoop.apache.org>
Reply-To: common-dev@hadoop.apache.org
Delivered-To: mailing list common-dev@hadoop.apache.org
Received: (qmail 54022 invoked by uid 99); 15 Feb 2012 17:57:23 -0000
Received: from nike.apache.org (HELO nike.apache.org) (192.87.106.230)
by apache.org (qpsmtpd/0.29) with ESMTP; Wed, 15 Feb 2012 17:57:23 +0000
X-ASF-Spam-Status: No, hits=-2000.0 required=5.0
tests=ALL_TRUSTED,T_RP_MATCHES_RCVD
X-Spam-Check-By: apache.org
Received: from [140.211.11.116] (HELO hel.zones.apache.org) (140.211.11.116)
by apache.org (qpsmtpd/0.29) with ESMTP; Wed, 15 Feb 2012 17:57:20 +0000
Received: from hel.zones.apache.org (hel.zones.apache.org [140.211.11.116])
by hel.zones.apache.org (Postfix) with ESMTP id 8D5DF1B9A05
for <common-dev@hadoop.apache.org>; Wed, 15 Feb 2012 17:56:59 +0000 (UTC)
Date: Wed, 15 Feb 2012 17:56:59 +0000 (UTC)
From: "Harsh J (Resolved) (JIRA)" <jira@apache.org>
To: common-dev@hadoop.apache.org
Message-ID: <901961051.41492.1329328619580.JavaMail.tomcat@hel.zones.apache.org>
In-Reply-To: <1671265044.81906.1327596998558.JavaMail.tomcat@hel.zones.apache.org>
Subject: [jira] [Resolved] (HADOOP-7995) GenericOptionsParser ought to have
better options parsing, and not pick only the options in the front
MIME-Version: 1.0
Content-Type: text/plain; charset=utf-8
Content-Transfer-Encoding: 7bit
X-JIRA-FingerPrint: 30527f35849b9dde25b450d4833f0394
X-Virus-Checked: Checked by ClamAV on apache.org
[ https://issues.apache.org/jira/browse/HADOOP-7995?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Harsh J resolved HADOOP-7995.
-----------------------------
Resolution: Won't Fix
Yes Daryn, that is good enough to close this one out and use as a reference for similar future requests.
> GenericOptionsParser ought to have better options parsing, and not pick only the options in the front
> -----------------------------------------------------------------------------------------------------
>
> Key: HADOOP-7995
> URL: https://issues.apache.org/jira/browse/HADOOP-7995
> Project: Hadoop Common
> Issue Type: Improvement
> Components: util
> Affects Versions: 0.23.0
> Reporter: Harsh J
> Priority: Minor
> Labels: newbie
>
> The ToolRunner provided GenericOptionsParser stops parsing known options when it encounters the first unknown option string in the String[] today.
> Ideally we should have it be more intelligent and sift through the whole array to pick up all opts, and not just the opts that are at the front of the invoked CLI.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
From common-dev-return-77730-apmail-hadoop-common-dev-archive=hadoop.apache.org@hadoop.apache.org Wed Feb 15 18:09:28 2012
Return-Path: <common-dev-return-77730-apmail-hadoop-common-dev-archive=hadoop.apache.org@hadoop.apache.org>
X-Original-To: apmail-hadoop-common-dev-archive@www.apache.org
Delivered-To: apmail-hadoop-common-dev-archive@www.apache.org
Received: from mail.apache.org (hermes.apache.org [140.211.11.3])
by minotaur.apache.org (Postfix) with SMTP id 12CBC9605
for <apmail-hadoop-common-dev-archive@www.apache.org>; Wed, 15 Feb 2012 18:09:28 +0000 (UTC)
Received: (qmail 92190 invoked by uid 500); 15 Feb 2012 18:09:26 -0000
Delivered-To: apmail-hadoop-common-dev-archive@hadoop.apache.org
Received: (qmail 92122 invoked by uid 500); 15 Feb 2012 18:09:26 -0000
Mailing-List: contact common-dev-help@hadoop.apache.org; run by ezmlm
Precedence: bulk
List-Help: <mailto:common-dev-help@hadoop.apache.org>
List-Unsubscribe: <mailto:common-dev-unsubscribe@hadoop.apache.org>
List-Post: <mailto:common-dev@hadoop.apache.org>
List-Id: <common-dev.hadoop.apache.org>
Reply-To: common-dev@hadoop.apache.org
Delivered-To: mailing list common-dev@hadoop.apache.org
Received: (qmail 92019 invoked by uid 99); 15 Feb 2012 18:09:26 -0000
Received: from nike.apache.org (HELO nike.apache.org) (192.87.106.230)
by apache.org (qpsmtpd/0.29) with ESMTP; Wed, 15 Feb 2012 18:09:26 +0000
X-ASF-Spam-Status: No, hits=-2000.0 required=5.0
tests=ALL_TRUSTED,T_RP_MATCHES_RCVD
X-Spam-Check-By: apache.org
Received: from [140.211.11.116] (HELO hel.zones.apache.org) (140.211.11.116)
by apache.org (qpsmtpd/0.29) with ESMTP; Wed, 15 Feb 2012 18:09:20 +0000
Received: from hel.zones.apache.org (hel.zones.apache.org [140.211.11.116])
by hel.zones.apache.org (Postfix) with ESMTP id BA6AA1B9F60
for <common-dev@hadoop.apache.org>; Wed, 15 Feb 2012 18:08:59 +0000 (UTC)
Date: Wed, 15 Feb 2012 18:08:59 +0000 (UTC)
From: "Eli Collins (Created) (JIRA)" <jira@apache.org>
To: common-dev@hadoop.apache.org
Message-ID: <795455816.41516.1329329339764.JavaMail.tomcat@hel.zones.apache.org>
Subject: [jira] [Created] (HADOOP-8075) Lower native-hadoop library log from
info to debug
MIME-Version: 1.0
Content-Type: text/plain; charset=utf-8
Content-Transfer-Encoding: 7bit
X-JIRA-FingerPrint: 30527f35849b9dde25b450d4833f0394
X-Virus-Checked: Checked by ClamAV on apache.org
Lower native-hadoop library log from info to debug
---------------------------------------------------
Key: HADOOP-8075
URL: https://issues.apache.org/jira/browse/HADOOP-8075
Project: Hadoop Common
Issue Type: Improvement
Components: native
Affects Versions: 0.23.0
Reporter: Eli Collins
The following log shows up in all commands. It's useful to have it in the server log, but let's figure out a way so that it isn't logged eg every time you cat a file.
{noformat}
[eli@centos6 ~]$ hadoop fs -cat /user/eli/foo
12/02/12 20:10:20 INFO util.NativeCodeLoader: Loaded the native-hadoop library
{noformat}
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
From common-dev-return-77731-apmail-hadoop-common-dev-archive=hadoop.apache.org@hadoop.apache.org Wed Feb 15 18:21:54 2012
Return-Path: <common-dev-return-77731-apmail-hadoop-common-dev-archive=hadoop.apache.org@hadoop.apache.org>
X-Original-To: apmail-hadoop-common-dev-archive@www.apache.org
Delivered-To: apmail-hadoop-common-dev-archive@www.apache.org
Received: from mail.apache.org (hermes.apache.org [140.211.11.3])
by minotaur.apache.org (Postfix) with SMTP id 3B5009008
for <apmail-hadoop-common-dev-archive@www.apache.org>; Wed, 15 Feb 2012 18:21:54 +0000 (UTC)
Received: (qmail 43153 invoked by uid 500); 15 Feb 2012 18:21:52 -0000
Delivered-To: apmail-hadoop-common-dev-archive@hadoop.apache.org
Received: (qmail 43102 invoked by uid 500); 15 Feb 2012 18:21:52 -0000
Mailing-List: contact common-dev-help@hadoop.apache.org; run by ezmlm
Precedence: bulk
List-Help: <mailto:common-dev-help@hadoop.apache.org>
List-Unsubscribe: <mailto:common-dev-unsubscribe@hadoop.apache.org>
List-Post: <mailto:common-dev@hadoop.apache.org>
List-Id: <common-dev.hadoop.apache.org>
Reply-To: common-dev@hadoop.apache.org
Delivered-To: mailing list common-dev@hadoop.apache.org
Received: (qmail 43094 invoked by uid 99); 15 Feb 2012 18:21:52 -0000
Received: from nike.apache.org (HELO nike.apache.org) (192.87.106.230)
by apache.org (qpsmtpd/0.29) with ESMTP; Wed, 15 Feb 2012 18:21:52 +0000
X-ASF-Spam-Status: No, hits=-2000.0 required=5.0
tests=ALL_TRUSTED,T_RP_MATCHES_RCVD
X-Spam-Check-By: apache.org
Received: from [140.211.11.116] (HELO hel.zones.apache.org) (140.211.11.116)
by apache.org (qpsmtpd/0.29) with ESMTP; Wed, 15 Feb 2012 18:21:47 +0000
Received: from hel.zones.apache.org (hel.zones.apache.org [140.211.11.116])
by hel.zones.apache.org (Postfix) with ESMTP id 5B7B01B973D
for <common-dev@hadoop.apache.org>; Wed, 15 Feb 2012 18:21:06 +0000 (UTC)
Date: Wed, 15 Feb 2012 18:21:06 +0000 (UTC)
From: "Todd Lipcon (Resolved) (JIRA)" <jira@apache.org>
To: common-dev@hadoop.apache.org
Message-ID: <620269120.41648.1329330066376.JavaMail.tomcat@hel.zones.apache.org>
In-Reply-To: <1158260874.34332.1329176339638.JavaMail.tomcat@hel.zones.apache.org>
Subject: [jira] [Resolved] (HADOOP-8068) HA: void methods can swallow
exceptions when going through failover path
MIME-Version: 1.0
Content-Type: text/plain; charset=utf-8
Content-Transfer-Encoding: 7bit
X-JIRA-FingerPrint: 30527f35849b9dde25b450d4833f0394
X-Virus-Checked: Checked by ClamAV on apache.org
[ https://issues.apache.org/jira/browse/HADOOP-8068?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Todd Lipcon resolved HADOOP-8068.
---------------------------------
Resolution: Fixed
Fix Version/s: HA Branch (HDFS-1623)
Hadoop Flags: Reviewed
Committed to branch, thanks for reviewing and cluster testing this.
> HA: void methods can swallow exceptions when going through failover path
> ------------------------------------------------------------------------
>
> Key: HADOOP-8068
> URL: https://issues.apache.org/jira/browse/HADOOP-8068
> Project: Hadoop Common
> Issue Type: Sub-task
> Components: ha, ipc
> Affects Versions: HA Branch (HDFS-1623)
> Reporter: Todd Lipcon
> Assignee: Todd Lipcon
> Priority: Blocker
> Fix For: HA Branch (HDFS-1623)
>
> Attachments: hadoop-8068.txt
>
>
> While running through scale testing, we saw an issue where clients were getting LeaseExpiredExceptions. We eventually tracked it down to the fact that some {{create}} calls had timed out (having been sent to a NN just before it crashed) but the resulting exception was swallowed by the retry policy code paths.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
From common-dev-return-77732-apmail-hadoop-common-dev-archive=hadoop.apache.org@hadoop.apache.org Wed Feb 15 18:48:21 2012
Return-Path: <common-dev-return-77732-apmail-hadoop-common-dev-archive=hadoop.apache.org@hadoop.apache.org>
X-Original-To: apmail-hadoop-common-dev-archive@www.apache.org
Delivered-To: apmail-hadoop-common-dev-archive@www.apache.org
Received: from mail.apache.org (hermes.apache.org [140.211.11.3])
by minotaur.apache.org (Postfix) with SMTP id F2FE49B49
for <apmail-hadoop-common-dev-archive@www.apache.org>; Wed, 15 Feb 2012 18:48:20 +0000 (UTC)
Received: (qmail 29174 invoked by uid 500); 15 Feb 2012 18:48:19 -0000
Delivered-To: apmail-hadoop-common-dev-archive@hadoop.apache.org
Received: (qmail 29120 invoked by uid 500); 15 Feb 2012 18:48:19 -0000
Mailing-List: contact common-dev-help@hadoop.apache.org; run by ezmlm
Precedence: bulk
List-Help: <mailto:common-dev-help@hadoop.apache.org>
List-Unsubscribe: <mailto:common-dev-unsubscribe@hadoop.apache.org>
List-Post: <mailto:common-dev@hadoop.apache.org>
List-Id: <common-dev.hadoop.apache.org>
Reply-To: common-dev@hadoop.apache.org
Delivered-To: mailing list common-dev@hadoop.apache.org
Received: (qmail 29107 invoked by uid 99); 15 Feb 2012 18:48:19 -0000
Received: from athena.apache.org (HELO athena.apache.org) (140.211.11.136)
by apache.org (qpsmtpd/0.29) with ESMTP; Wed, 15 Feb 2012 18:48:19 +0000
X-ASF-Spam-Status: No, hits=-0.7 required=5.0
tests=RCVD_IN_DNSWL_LOW,SPF_PASS
X-Spam-Check-By: apache.org
Received-SPF: pass (athena.apache.org: domain of todd@cloudera.com designates 209.85.215.48 as permitted sender)
Received: from [209.85.215.48] (HELO mail-lpp01m010-f48.google.com) (209.85.215.48)
by apache.org (qpsmtpd/0.29) with ESMTP; Wed, 15 Feb 2012 18:48:13 +0000
Received: by lagw12 with SMTP id w12so1896626lag.35
for <common-dev@hadoop.apache.org>; Wed, 15 Feb 2012 10:47:52 -0800 (PST)
Received: by 10.112.84.170 with SMTP id a10mr9418124lbz.22.1329331672085; Wed,
15 Feb 2012 10:47:52 -0800 (PST)
MIME-Version: 1.0
Received: by 10.112.6.105 with HTTP; Wed, 15 Feb 2012 10:47:32 -0800 (PST)
In-Reply-To: <CAOcnVr1uWPdG0mtaE5xKNdLz9Yy5D-Es39nw8G-FYgiayiQ2xw@mail.gmail.com>
References: <CAEsa9_UnLjEPvOk3djTvE7JBFuDREubO+oTWKOnmjd=_kF16Rg@mail.gmail.com>
<CAOcnVr1uWPdG0mtaE5xKNdLz9Yy5D-Es39nw8G-FYgiayiQ2xw@mail.gmail.com>
From: Todd Lipcon <todd@cloudera.com>
Date: Wed, 15 Feb 2012 10:47:32 -0800
Message-ID: <CADY20s7_tBrGrwLn4NwJ2A4K5MpXNEZ-nk2oZMaRvDXovFN4tA@mail.gmail.com>
Subject: Re: .23 compile times
To: common-dev@hadoop.apache.org
Content-Type: text/plain; charset=ISO-8859-1
Content-Transfer-Encoding: quoted-printable
X-Gm-Message-State: ALoCoQkfHdbtrYRdHDB0k90LjlGZARRjUX0DiWxyaMqHDnxX3t4hLCegzKSiU53LEdDKVVJGIll1
Hi Sriram,
I also do -Dmaven.skip.javadoc=3Dtrue usually and that cuts out a couple
minutes. Unless you need a tarball, you can also drop -Ptar.
When I'm just making quick changes confined to the java code, I
usually just use "mvn -Dskiptests install" from within the hdfs
project, then manually cp the resulting
target/hadoop-hdfs-0.24.0-SNAPSHOT.jar into my install
dir/share/hadoop/hdfs. Much faster than the full rebuild.
-Todd
On Wed, Feb 15, 2012 at 8:52 AM, Harsh J <harsh@cloudera.com> wrote:
> Sriram,
>
> My package command didn't take as long with the same command -- where
> do you see it getting stuck at most of the times? Which particular
> target (right term?) seems to take the highest time to complete?
>
> On Wed, Feb 15, 2012 at 12:31 AM, Sriram Rao <sriramsrao@gmail.com> wrote=
:
>> Folks,
>>
>> The build takes forever:
>>
>> =A0mvn package -Pdist -DskipTests -Dtar
>>
>> ....
>>
>> [INFO]
>> ------------------------------------------------------------------------
>> [INFO] BUILD SUCCESS
>> [INFO]
>> ------------------------------------------------------------------------
>> [INFO] Total time: 6:25.399s
>> [INFO] Finished at: Tue Feb 14 10:54:18 PST 2012
>> [INFO] Final Memory: 56M/123M
>> [INFO]
>> ------------------------------------------------------------------------
>>
>> This is on a mac with 8GB RAM. =A0(The above case involved 0-lines of co=
de
>> change; just making sure I had everything built!).
>>
>> Is there a faster way to get the thing to build?
>>
>> Sriram
>
>
>
> --
> Harsh J
> Customer Ops. Engineer
> Cloudera | http://tiny.cloudera.com/about
--=20
Todd Lipcon
Software Engineer, Cloudera
From common-dev-return-77733-apmail-hadoop-common-dev-archive=hadoop.apache.org@hadoop.apache.org Wed Feb 15 18:53:22 2012
Return-Path: <common-dev-return-77733-apmail-hadoop-common-dev-archive=hadoop.apache.org@hadoop.apache.org>
X-Original-To: apmail-hadoop-common-dev-archive@www.apache.org
Delivered-To: apmail-hadoop-common-dev-archive@www.apache.org
Received: from mail.apache.org (hermes.apache.org [140.211.11.3])
by minotaur.apache.org (Postfix) with SMTP id 7DB1C9D54
for <apmail-hadoop-common-dev-archive@www.apache.org>; Wed, 15 Feb 2012 18:53:22 +0000 (UTC)
Received: (qmail 41446 invoked by uid 500); 15 Feb 2012 18:53:21 -0000
Delivered-To: apmail-hadoop-common-dev-archive@hadoop.apache.org
Received: (qmail 41387 invoked by uid 500); 15 Feb 2012 18:53:21 -0000
Mailing-List: contact common-dev-help@hadoop.apache.org; run by ezmlm
Precedence: bulk
List-Help: <mailto:common-dev-help@hadoop.apache.org>
List-Unsubscribe: <mailto:common-dev-unsubscribe@hadoop.apache.org>
List-Post: <mailto:common-dev@hadoop.apache.org>
List-Id: <common-dev.hadoop.apache.org>
Reply-To: common-dev@hadoop.apache.org
Delivered-To: mailing list common-dev@hadoop.apache.org
Received: (qmail 41378 invoked by uid 99); 15 Feb 2012 18:53:21 -0000
Received: from athena.apache.org (HELO athena.apache.org) (140.211.11.136)
by apache.org (qpsmtpd/0.29) with ESMTP; Wed, 15 Feb 2012 18:53:20 +0000
X-ASF-Spam-Status: No, hits=-2000.0 required=5.0
tests=ALL_TRUSTED,T_RP_MATCHES_RCVD
X-Spam-Check-By: apache.org
Received: from [140.211.11.116] (HELO hel.zones.apache.org) (140.211.11.116)
by apache.org (qpsmtpd/0.29) with ESMTP; Wed, 15 Feb 2012 18:53:19 +0000
Received: from hel.zones.apache.org (hel.zones.apache.org [140.211.11.116])
by hel.zones.apache.org (Postfix) with ESMTP id 881781B9DE9
for <common-dev@hadoop.apache.org>; Wed, 15 Feb 2012 18:52:59 +0000 (UTC)
Date: Wed, 15 Feb 2012 18:52:59 +0000 (UTC)
From: "Alejandro Abdelnur (Created) (JIRA)" <jira@apache.org>
To: common-dev@hadoop.apache.org
Message-ID: <2040767801.41825.1329331979558.JavaMail.tomcat@hel.zones.apache.org>
Subject: [jira] [Created] (HADOOP-8076) hadoop (1.x) ant build fetches ivy
JAR every time
MIME-Version: 1.0
Content-Type: text/plain; charset=utf-8
Content-Transfer-Encoding: 7bit
X-JIRA-FingerPrint: 30527f35849b9dde25b450d4833f0394
hadoop (1.x) ant build fetches ivy JAR every time
-------------------------------------------------
Key: HADOOP-8076
URL: https://issues.apache.org/jira/browse/HADOOP-8076
Project: Hadoop Common
Issue Type: Improvement
Components: build
Affects Versions: 1.0.0
Reporter: Alejandro Abdelnur
Assignee: Alejandro Abdelnur
the <get ..> task does a timestamp check, as ivy JAR is final release it should use the skip if already downloaded check.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
From common-dev-return-77734-apmail-hadoop-common-dev-archive=hadoop.apache.org@hadoop.apache.org Wed Feb 15 19:01:26 2012
Return-Path: <common-dev-return-77734-apmail-hadoop-common-dev-archive=hadoop.apache.org@hadoop.apache.org>
X-Original-To: apmail-hadoop-common-dev-archive@www.apache.org
Delivered-To: apmail-hadoop-common-dev-archive@www.apache.org
Received: from mail.apache.org (hermes.apache.org [140.211.11.3])
by minotaur.apache.org (Postfix) with SMTP id 2337D9646
for <apmail-hadoop-common-dev-archive@www.apache.org>; Wed, 15 Feb 2012 19:01:26 +0000 (UTC)
Received: (qmail 70121 invoked by uid 500); 15 Feb 2012 19:01:24 -0000
Delivered-To: apmail-hadoop-common-dev-archive@hadoop.apache.org
Received: (qmail 70061 invoked by uid 500); 15 Feb 2012 19:01:24 -0000
Mailing-List: contact common-dev-help@hadoop.apache.org; run by ezmlm
Precedence: bulk
List-Help: <mailto:common-dev-help@hadoop.apache.org>
List-Unsubscribe: <mailto:common-dev-unsubscribe@hadoop.apache.org>
List-Post: <mailto:common-dev@hadoop.apache.org>
List-Id: <common-dev.hadoop.apache.org>
Reply-To: common-dev@hadoop.apache.org
Delivered-To: mailing list common-dev@hadoop.apache.org
Received: (qmail 70053 invoked by uid 99); 15 Feb 2012 19:01:24 -0000
Received: from athena.apache.org (HELO athena.apache.org) (140.211.11.136)
by apache.org (qpsmtpd/0.29) with ESMTP; Wed, 15 Feb 2012 19:01:24 +0000
X-ASF-Spam-Status: No, hits=-2000.0 required=5.0
tests=ALL_TRUSTED,T_RP_MATCHES_RCVD
X-Spam-Check-By: apache.org
Received: from [140.211.11.116] (HELO hel.zones.apache.org) (140.211.11.116)
by apache.org (qpsmtpd/0.29) with ESMTP; Wed, 15 Feb 2012 19:01:20 +0000
Received: from hel.zones.apache.org (hel.zones.apache.org [140.211.11.116])
by hel.zones.apache.org (Postfix) with ESMTP id 2B9781B94A0
for <common-dev@hadoop.apache.org>; Wed, 15 Feb 2012 19:01:00 +0000 (UTC)
Date: Wed, 15 Feb 2012 19:01:00 +0000 (UTC)
From: "Todd Lipcon (Created) (JIRA)" <jira@apache.org>
To: common-dev@hadoop.apache.org
Message-ID: <1474739718.41919.1329332460180.JavaMail.tomcat@hel.zones.apache.org>
Subject: [jira] [Created] (HADOOP-8077) fencing method should be able to be
configured on a per-NN or per-NS basis
MIME-Version: 1.0
Content-Type: text/plain; charset=utf-8
Content-Transfer-Encoding: 7bit
X-JIRA-FingerPrint: 30527f35849b9dde25b450d4833f0394
fencing method should be able to be configured on a per-NN or per-NS basis
--------------------------------------------------------------------------
Key: HADOOP-8077
URL: https://issues.apache.org/jira/browse/HADOOP-8077
Project: Hadoop Common
Issue Type: Sub-task
Components: ha
Affects Versions: HA Branch (HDFS-1623)
Reporter: Todd Lipcon
Currently, the fencing method configuration is global. Given that different nameservices may use different underlying storage mechanisms or different types of PDUs, it would be preferable to allow the fencing method configuration to be scoped by namenode or nameservice.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
From common-dev-return-77735-apmail-hadoop-common-dev-archive=hadoop.apache.org@hadoop.apache.org Wed Feb 15 19:07:27 2012
Return-Path: <common-dev-return-77735-apmail-hadoop-common-dev-archive=hadoop.apache.org@hadoop.apache.org>
X-Original-To: apmail-hadoop-common-dev-archive@www.apache.org
Delivered-To: apmail-hadoop-common-dev-archive@www.apache.org
Received: from mail.apache.org (hermes.apache.org [140.211.11.3])
by minotaur.apache.org (Postfix) with SMTP id 5FFC19B47
for <apmail-hadoop-common-dev-archive@www.apache.org>; Wed, 15 Feb 2012 19:07:27 +0000 (UTC)
Received: (qmail 93790 invoked by uid 500); 15 Feb 2012 19:07:25 -0000
Delivered-To: apmail-hadoop-common-dev-archive@hadoop.apache.org
Received: (qmail 93742 invoked by uid 500); 15 Feb 2012 19:07:25 -0000
Mailing-List: contact common-dev-help@hadoop.apache.org; run by ezmlm
Precedence: bulk
List-Help: <mailto:common-dev-help@hadoop.apache.org>
List-Unsubscribe: <mailto:common-dev-unsubscribe@hadoop.apache.org>
List-Post: <mailto:common-dev@hadoop.apache.org>
List-Id: <common-dev.hadoop.apache.org>
Reply-To: common-dev@hadoop.apache.org
Delivered-To: mailing list common-dev@hadoop.apache.org
Received: (qmail 93724 invoked by uid 99); 15 Feb 2012 19:07:25 -0000
Received: from athena.apache.org (HELO athena.apache.org) (140.211.11.136)
by apache.org (qpsmtpd/0.29) with ESMTP; Wed, 15 Feb 2012 19:07:25 +0000
X-ASF-Spam-Status: No, hits=-2000.0 required=5.0
tests=ALL_TRUSTED,T_RP_MATCHES_RCVD
X-Spam-Check-By: apache.org
Received: from [140.211.11.116] (HELO hel.zones.apache.org) (140.211.11.116)
by apache.org (qpsmtpd/0.29) with ESMTP; Wed, 15 Feb 2012 19:07:20 +0000
Received: from hel.zones.apache.org (hel.zones.apache.org [140.211.11.116])
by hel.zones.apache.org (Postfix) with ESMTP id 39B611B983D
for <common-dev@hadoop.apache.org>; Wed, 15 Feb 2012 19:07:00 +0000 (UTC)
Date: Wed, 15 Feb 2012 19:07:00 +0000 (UTC)
From: "John Lewis (Resolved) (JIRA)" <jira@apache.org>
To: common-dev@hadoop.apache.org
Message-ID: <596529854.41955.1329332820237.JavaMail.tomcat@hel.zones.apache.org>
In-Reply-To: <981108191.33810.1329171539770.JavaMail.tomcat@hel.zones.apache.org>
Subject: [jira] [Resolved] (HADOOP-8067) Errors building
hadoop-gpl-compression with Hadoop 1.0.0 and HBase 0.92.0
MIME-Version: 1.0
Content-Type: text/plain; charset=utf-8
Content-Transfer-Encoding: 7bit
X-JIRA-FingerPrint: 30527f35849b9dde25b450d4833f0394
[ https://issues.apache.org/jira/browse/HADOOP-8067?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
John Lewis resolved HADOOP-8067.
--------------------------------
Tags: LZO, Hadoop-1.0.0, HBase-0.92.0
Resolution: Fixed
Fix Version/s: 1.0.0
Target Version/s: 1.0.0
Using the hadoop-lzo-0.4.15.jar and native files from the build provided from https://github.com/hortonworks/hadoop-lzo we were able to enable LZO and get it functioning with Hadoop 1.0.0 and HBase 0.92.0 without any errors.
> Errors building hadoop-gpl-compression with Hadoop 1.0.0 and HBase 0.92.0
> -------------------------------------------------------------------------
>
> Key: HADOOP-8067
> URL: https://issues.apache.org/jira/browse/HADOOP-8067
> Project: Hadoop Common
> Issue Type: Bug
> Components: build
> Affects Versions: 1.0.0
> Environment: Red Hat 5.5 64bit
> Reporter: John Lewis
> Fix For: 1.0.0
>
>
> We were able to successfully configure and run HBase 0.92.0 on top of Hadoop 1.0.0. But when we were following the directions stated on http://wiki.apache.org/hadoop/UsingLzoCompression on enabling LZO compression in HBase we are getting errors building hadoop-gpl-compression with the hadoop-core-1.0.0.jar. These errors seem to be a result of different classes being deprecated.
> When we use an older version of hadoop core jar such as hadoop-core-0.20.2.jar, we are able to build the hadoop-gpl-compression-0.1.0-dev.jar and native folder with no errors. Also after copying those files to the HBase library LZO functions without any errors even with HBase being on top of Hadoop 1.0.0.
> Is there an LZO build compatible with Hadoop 1.0.0?
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
From common-dev-return-77736-apmail-hadoop-common-dev-archive=hadoop.apache.org@hadoop.apache.org Wed Feb 15 21:03:35 2012
Return-Path: <common-dev-return-77736-apmail-hadoop-common-dev-archive=hadoop.apache.org@hadoop.apache.org>
X-Original-To: apmail-hadoop-common-dev-archive@www.apache.org
Delivered-To: apmail-hadoop-common-dev-archive@www.apache.org
Received: from mail.apache.org (hermes.apache.org [140.211.11.3])
by minotaur.apache.org (Postfix) with SMTP id B8DE49109
for <apmail-hadoop-common-dev-archive@www.apache.org>; Wed, 15 Feb 2012 21:03:35 +0000 (UTC)
Received: (qmail 80583 invoked by uid 500); 15 Feb 2012 21:03:34 -0000
Delivered-To: apmail-hadoop-common-dev-archive@hadoop.apache.org
Received: (qmail 80505 invoked by uid 500); 15 Feb 2012 21:03:34 -0000
Mailing-List: contact common-dev-help@hadoop.apache.org; run by ezmlm
Precedence: bulk
List-Help: <mailto:common-dev-help@hadoop.apache.org>
List-Unsubscribe: <mailto:common-dev-unsubscribe@hadoop.apache.org>
List-Post: <mailto:common-dev@hadoop.apache.org>
List-Id: <common-dev.hadoop.apache.org>
Reply-To: common-dev@hadoop.apache.org
Delivered-To: mailing list common-dev@hadoop.apache.org
Received: (qmail 80496 invoked by uid 99); 15 Feb 2012 21:03:34 -0000
Received: from nike.apache.org (HELO nike.apache.org) (192.87.106.230)
by apache.org (qpsmtpd/0.29) with ESMTP; Wed, 15 Feb 2012 21:03:34 +0000
X-ASF-Spam-Status: No, hits=0.4 required=5.0
tests=NO_RDNS_DOTCOM_HELO,RCVD_IN_DNSWL_LOW,SPF_NEUTRAL
X-Spam-Check-By: apache.org
Received-SPF: neutral (nike.apache.org: 216.145.54.172 is neither permitted nor denied by domain of daryn@yahoo-inc.com)
Received: from [216.145.54.172] (HELO mrout2.yahoo.com) (216.145.54.172)
by apache.org (qpsmtpd/0.29) with ESMTP; Wed, 15 Feb 2012 21:03:25 +0000
Received: from SP1-EX07CAS04.ds.corp.yahoo.com (sp1-ex07cas04.corp.sp1.yahoo.com [216.252.116.155])
by mrout2.yahoo.com (8.14.4/8.14.4/y.out) with ESMTP id q1FL2qqW092330
for <common-dev@hadoop.apache.org>; Wed, 15 Feb 2012 13:02:52 -0800 (PST)
DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/simple; d=yahoo-inc.com;
s=cobra; t=1329339772;
bh=M2/apUE4Rg6DG507Bgo30YnEF3h+TJC8FjLpCaaVYtk=;
h=From:To:Date:Subject:Message-ID:References:In-Reply-To:
Content-Type:Content-Transfer-Encoding:MIME-Version;
b=Vltj2nkrQLuI+suDHMYlarzuRMM3W/+qbW68UOhsOm62cxnDgZQY3qG41cORC+4fY
FDOG8Wes7Zozpuky1tWUvHZ330bvQke2xPi5m6yofBs4N9gipL6ausvCKAvKwG+oT4
NEYTaOoiDrI5i2nO6wiaQrURzOnv1DWLRqzlL6lI=
Received: from SP1-EX07VS02.ds.corp.yahoo.com ([216.252.116.136]) by
SP1-EX07CAS04.ds.corp.yahoo.com ([216.252.116.155]) with mapi; Wed, 15 Feb
2012 15:02:52 -0600
From: Daryn Sharp <daryn@yahoo-inc.com>
To: "common-dev@hadoop.apache.org" <common-dev@hadoop.apache.org>
Date: Wed, 15 Feb 2012 15:02:52 -0600
Subject: Re: .23 compile times
Thread-Topic: .23 compile times
Thread-Index: AczsJS6wsHoWVc+bQV+Qf0I0vj2jiA==
Message-ID: <22102138-E9FE-4443-B0E4-153EAA3D2F47@yahoo-inc.com>
References: <CAEsa9_UnLjEPvOk3djTvE7JBFuDREubO+oTWKOnmjd=_kF16Rg@mail.gmail.com>
<CAOcnVr1uWPdG0mtaE5xKNdLz9Yy5D-Es39nw8G-FYgiayiQ2xw@mail.gmail.com>
<CADY20s7_tBrGrwLn4NwJ2A4K5MpXNEZ-nk2oZMaRvDXovFN4tA@mail.gmail.com>
In-Reply-To: <CADY20s7_tBrGrwLn4NwJ2A4K5MpXNEZ-nk2oZMaRvDXovFN4tA@mail.gmail.com>
Accept-Language: en-US
Content-Language: en-US
X-MS-Has-Attach:
X-MS-TNEF-Correlator:
acceptlanguage: en-US
Content-Type: text/plain; charset="us-ascii"
Content-Transfer-Encoding: quoted-printable
MIME-Version: 1.0
X-Virus-Checked: Checked by ClamAV on apache.org
Hi Sriram,
You may want to try adding your source tree to Spotlight's privacy list, ot=
herwise it's busy trying to index files as fast as the build is writing the=
m. If you are (un)fortunate enough to be running anti-virus sw, then it to=
o is scurrying along behind your build checking every file. That's enough =
to turn a normally silent MBP into a hair dryer.
If you don't want to omit the entire project, because perhaps you want to u=
se mdfind, then you can rename dirs to end with ".noindex". The trick/hack=
is you can symlink the original dir name to the renamed dir.noindex.
But yes, I think the build is way to slow to be productive when used as int=
ended. The fact that people have to use custom tricks to build & test in a=
"reasonable" amount of time is a symptom of a problem...
Daryn
On Feb 15, 2012, at 12:47 PM, Todd Lipcon wrote:
> Hi Sriram,
>=20
> I also do -Dmaven.skip.javadoc=3Dtrue usually and that cuts out a couple
> minutes. Unless you need a tarball, you can also drop -Ptar.
>=20
> When I'm just making quick changes confined to the java code, I
> usually just use "mvn -Dskiptests install" from within the hdfs
> project, then manually cp the resulting
> target/hadoop-hdfs-0.24.0-SNAPSHOT.jar into my install
> dir/share/hadoop/hdfs. Much faster than the full rebuild.
>=20
> -Todd
>=20
> On Wed, Feb 15, 2012 at 8:52 AM, Harsh J <harsh@cloudera.com> wrote:
>> Sriram,
>>=20
>> My package command didn't take as long with the same command -- where
>> do you see it getting stuck at most of the times? Which particular
>> target (right term?) seems to take the highest time to complete?
>>=20
>> On Wed, Feb 15, 2012 at 12:31 AM, Sriram Rao <sriramsrao@gmail.com> wrot=
e:
>>> Folks,
>>>=20
>>> The build takes forever:
>>>=20
>>> mvn package -Pdist -DskipTests -Dtar
>>>=20
>>> ....
>>>=20
>>> [INFO]
>>> -----------------------------------------------------------------------=
-
>>> [INFO] BUILD SUCCESS
>>> [INFO]
>>> -----------------------------------------------------------------------=
-
>>> [INFO] Total time: 6:25.399s
>>> [INFO] Finished at: Tue Feb 14 10:54:18 PST 2012
>>> [INFO] Final Memory: 56M/123M
>>> [INFO]
>>> -----------------------------------------------------------------------=
-
>>>=20
>>> This is on a mac with 8GB RAM. (The above case involved 0-lines of cod=
e
>>> change; just making sure I had everything built!).
>>>=20
>>> Is there a faster way to get the thing to build?
>>>=20
>>> Sriram
>>=20
>>=20
>>=20
>> --
>> Harsh J
>> Customer Ops. Engineer
>> Cloudera | http://tiny.cloudera.com/about
>=20
>=20
>=20
> --=20
> Todd Lipcon
> Software Engineer, Cloudera
From common-dev-return-77737-apmail-hadoop-common-dev-archive=hadoop.apache.org@hadoop.apache.org Wed Feb 15 21:25:27 2012
Return-Path: <common-dev-return-77737-apmail-hadoop-common-dev-archive=hadoop.apache.org@hadoop.apache.org>
X-Original-To: apmail-hadoop-common-dev-archive@www.apache.org
Delivered-To: apmail-hadoop-common-dev-archive@www.apache.org
Received: from mail.apache.org (hermes.apache.org [140.211.11.3])
by minotaur.apache.org (Postfix) with SMTP id E732A9327
for <apmail-hadoop-common-dev-archive@www.apache.org>; Wed, 15 Feb 2012 21:25:27 +0000 (UTC)
Received: (qmail 58111 invoked by uid 500); 15 Feb 2012 21:25:26 -0000
Delivered-To: apmail-hadoop-common-dev-archive@hadoop.apache.org
Received: (qmail 58058 invoked by uid 500); 15 Feb 2012 21:25:26 -0000
Mailing-List: contact common-dev-help@hadoop.apache.org; run by ezmlm
Precedence: bulk
List-Help: <mailto:common-dev-help@hadoop.apache.org>
List-Unsubscribe: <mailto:common-dev-unsubscribe@hadoop.apache.org>
List-Post: <mailto:common-dev@hadoop.apache.org>
List-Id: <common-dev.hadoop.apache.org>
Reply-To: common-dev@hadoop.apache.org
Delivered-To: mailing list common-dev@hadoop.apache.org
Received: (qmail 58049 invoked by uid 99); 15 Feb 2012 21:25:26 -0000
Received: from nike.apache.org (HELO nike.apache.org) (192.87.106.230)
by apache.org (qpsmtpd/0.29) with ESMTP; Wed, 15 Feb 2012 21:25:26 +0000
X-ASF-Spam-Status: No, hits=-2000.0 required=5.0
tests=ALL_TRUSTED,T_RP_MATCHES_RCVD
X-Spam-Check-By: apache.org
Received: from [140.211.11.116] (HELO hel.zones.apache.org) (140.211.11.116)
by apache.org (qpsmtpd/0.29) with ESMTP; Wed, 15 Feb 2012 21:25:20 +0000
Received: from hel.zones.apache.org (hel.zones.apache.org [140.211.11.116])
by hel.zones.apache.org (Postfix) with ESMTP id CC9121B9163
for <common-dev@hadoop.apache.org>; Wed, 15 Feb 2012 21:24:59 +0000 (UTC)
Date: Wed, 15 Feb 2012 21:24:59 +0000 (UTC)
From: "Jitendra Nath Pandey (Created) (JIRA)" <jira@apache.org>
To: common-dev@hadoop.apache.org
Message-ID: <1972265258.42623.1329341099839.JavaMail.tomcat@hel.zones.apache.org>
Subject: [jira] [Created] (HADOOP-8078) Add capability to turn on security
in unit tests.
MIME-Version: 1.0
Content-Type: text/plain; charset=utf-8
Content-Transfer-Encoding: 7bit
X-JIRA-FingerPrint: 30527f35849b9dde25b450d4833f0394
X-Virus-Checked: Checked by ClamAV on apache.org
Add capability to turn on security in unit tests.
-------------------------------------------------
Key: HADOOP-8078
URL: https://issues.apache.org/jira/browse/HADOOP-8078
Project: Hadoop Common
Issue Type: Improvement
Reporter: Jitendra Nath Pandey
Assignee: Jaimin D Jetly
We should be able to start a kdc server for unit tests, so that security could be turned on. This will greatly improve the coverage of unit tests.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
From common-dev-return-77738-apmail-hadoop-common-dev-archive=hadoop.apache.org@hadoop.apache.org Thu Feb 16 00:57:25 2012
Return-Path: <common-dev-return-77738-apmail-hadoop-common-dev-archive=hadoop.apache.org@hadoop.apache.org>
X-Original-To: apmail-hadoop-common-dev-archive@www.apache.org
Delivered-To: apmail-hadoop-common-dev-archive@www.apache.org
Received: from mail.apache.org (hermes.apache.org [140.211.11.3])
by minotaur.apache.org (Postfix) with SMTP id 1CDD39028
for <apmail-hadoop-common-dev-archive@www.apache.org>; Thu, 16 Feb 2012 00:57:25 +0000 (UTC)
Received: (qmail 80186 invoked by uid 500); 16 Feb 2012 00:57:23 -0000
Delivered-To: apmail-hadoop-common-dev-archive@hadoop.apache.org
Received: (qmail 80080 invoked by uid 500); 16 Feb 2012 00:57:23 -0000
Mailing-List: contact common-dev-help@hadoop.apache.org; run by ezmlm
Precedence: bulk
List-Help: <mailto:common-dev-help@hadoop.apache.org>
List-Unsubscribe: <mailto:common-dev-unsubscribe@hadoop.apache.org>
List-Post: <mailto:common-dev@hadoop.apache.org>
List-Id: <common-dev.hadoop.apache.org>
Reply-To: common-dev@hadoop.apache.org
Delivered-To: mailing list common-dev@hadoop.apache.org
Received: (qmail 80071 invoked by uid 500); 16 Feb 2012 00:57:23 -0000
Delivered-To: apmail-hadoop-core-dev@hadoop.apache.org
Received: (qmail 80068 invoked by uid 500); 16 Feb 2012 00:57:23 -0000
Delivered-To: apmail-lucene-hadoop-dev@lucene.apache.org
Received: (qmail 80063 invoked by uid 99); 16 Feb 2012 00:57:23 -0000
Received: from nike.apache.org (HELO nike.apache.org) (192.87.106.230)
by apache.org (qpsmtpd/0.29) with ESMTP; Thu, 16 Feb 2012 00:57:23 +0000
X-ASF-Spam-Status: No, hits=2.2 required=5.0
tests=FREEMAIL_ENVFROM_END_DIGIT,SPF_NEUTRAL,URI_HEX
X-Spam-Check-By: apache.org
Received-SPF: neutral (nike.apache.org: 216.139.236.26 is neither permitted nor denied by domain of elhamab99@gmail.com)
Received: from [216.139.236.26] (HELO sam.nabble.com) (216.139.236.26)
by apache.org (qpsmtpd/0.29) with ESMTP; Thu, 16 Feb 2012 00:57:16 +0000
Received: from ben.nabble.com ([192.168.236.152])
by sam.nabble.com with esmtp (Exim 4.72)
(envelope-from <elhamab99@gmail.com>)
id 1RxpeZ-0001pv-DL
for hadoop-dev@lucene.apache.org; Wed, 15 Feb 2012 16:56:55 -0800
Date: Wed, 15 Feb 2012 16:56:55 -0800 (PST)
From: Selwa <elhamab99@gmail.com>
To: hadoop-dev@lucene.apache.org
Message-ID: <1329353815406-3748957.post@n3.nabble.com>
In-Reply-To: <CAMs9kViDTfFYzNYtUqY7-hyiSkErYo_6oyZ0AbtcQGFFMkC5KQ@mail.gmail.com>
References: <1329010868844-3736421.post@n3.nabble.com> <CAMs9kViDTfFYzNYtUqY7-hyiSkErYo_6oyZ0AbtcQGFFMkC5KQ@mail.gmail.com>
Subject: Re: datanode to blocks mapping
MIME-Version: 1.0
Content-Type: text/plain; charset=us-ascii
Content-Transfer-Encoding: 7bit
X-Virus-Checked: Checked by ClamAV on apache.org
Ravi,
thank u very much for your reply.
i am using version 0.21.0 . hope your comment will help me a lot.
BTW, after i got the blocksMap, can i request this blocksMap to return
blocks of a given file.
i mean how to map a filename to its blocks?
Best wishes,
Selwa
--
View this message in context: http://lucene.472066.n3.nabble.com/datanode-to-blocks-mapping-tp3736421p3748957.html
Sent from the Hadoop lucene-dev mailing list archive at Nabble.com.
From common-dev-return-77739-apmail-hadoop-common-dev-archive=hadoop.apache.org@hadoop.apache.org Thu Feb 16 00:59:27 2012
Return-Path: <common-dev-return-77739-apmail-hadoop-common-dev-archive=hadoop.apache.org@hadoop.apache.org>
X-Original-To: apmail-hadoop-common-dev-archive@www.apache.org
Delivered-To: apmail-hadoop-common-dev-archive@www.apache.org
Received: from mail.apache.org (hermes.apache.org [140.211.11.3])
by minotaur.apache.org (Postfix) with SMTP id 6B869921B
for <apmail-hadoop-common-dev-archive@www.apache.org>; Thu, 16 Feb 2012 00:59:27 +0000 (UTC)
Received: (qmail 89014 invoked by uid 500); 16 Feb 2012 00:59:25 -0000
Delivered-To: apmail-hadoop-common-dev-archive@hadoop.apache.org
Received: (qmail 88933 invoked by uid 500); 16 Feb 2012 00:59:25 -0000
Mailing-List: contact common-dev-help@hadoop.apache.org; run by ezmlm
Precedence: bulk
List-Help: <mailto:common-dev-help@hadoop.apache.org>
List-Unsubscribe: <mailto:common-dev-unsubscribe@hadoop.apache.org>
List-Post: <mailto:common-dev@hadoop.apache.org>
List-Id: <common-dev.hadoop.apache.org>
Reply-To: common-dev@hadoop.apache.org
Delivered-To: mailing list common-dev@hadoop.apache.org
Received: (qmail 88843 invoked by uid 99); 16 Feb 2012 00:59:24 -0000
Received: from athena.apache.org (HELO athena.apache.org) (140.211.11.136)
by apache.org (qpsmtpd/0.29) with ESMTP; Thu, 16 Feb 2012 00:59:24 +0000
X-ASF-Spam-Status: No, hits=-2000.0 required=5.0
tests=ALL_TRUSTED,T_RP_MATCHES_RCVD
X-Spam-Check-By: apache.org
Received: from [140.211.11.116] (HELO hel.zones.apache.org) (140.211.11.116)
by apache.org (qpsmtpd/0.29) with ESMTP; Thu, 16 Feb 2012 00:59:20 +0000
Received: from hel.zones.apache.org (hel.zones.apache.org [140.211.11.116])
by hel.zones.apache.org (Postfix) with ESMTP id 723EB1B9D27
for <common-dev@hadoop.apache.org>; Thu, 16 Feb 2012 00:59:00 +0000 (UTC)
Date: Thu, 16 Feb 2012 00:59:00 +0000 (UTC)
From: "Alexander Stojanovic (Created) (JIRA)" <jira@apache.org>
To: common-dev@hadoop.apache.org
Message-ID: <502273531.44288.1329353940469.JavaMail.tomcat@hel.zones.apache.org>
Subject: [jira] [Created] (HADOOP-8079) Proposal for enhancements to Hadoop
for Windows Server and Windows Azure development and runtime environments
MIME-Version: 1.0
Content-Type: text/plain; charset=utf-8
Content-Transfer-Encoding: 7bit
X-JIRA-FingerPrint: 30527f35849b9dde25b450d4833f0394
Proposal for enhancements to Hadoop for Windows Server and Windows Azure development and runtime environments
-------------------------------------------------------------------------------------------------------------
Key: HADOOP-8079
URL: https://issues.apache.org/jira/browse/HADOOP-8079
Project: Hadoop Common
Issue Type: Improvement
Components: native
Affects Versions: 1.0.0
Reporter: Alexander Stojanovic
Fix For: 1.0.0
This JIRA is intended to capture discussion around proposed work to enhance Apache Hadoop to run well on Windows. Apache Hadoop has worked on Microsoft Windows since its inception, but Windows support has never been a priority. Currently Windows works as a development and testing platform for Hadoop, but Hadoop is not natively integrated, full-featured or performance and scalability tuned for Windows Server or Windows Azure. We would like to change this and engage in a dialog with the broader community on the architectural design points for making Windows (enterprise and cloud) an excellent runtime and deployment environment for Hadoop.
The Isotope team at Microsoft (names below) has developed an Apache Hadoop 1.0 patch set that addresses these performance, integration and feature gaps, allowing Apache Hadoop to be used with Azure and Windows Server without recourse to virtualization technologies such as Cygwin. We have significant interest in the deployment of Hadoop across many multi-tenant, PaaS and IaaS environments - which bring their own unique requirements.
Microsoft has recently completed a CCLA with Apache and would like to contribute these enhancements back to the Apache Hadoop community.
In the interest of improving Apache Hadoop so that it runs more smoothly on all platforms, including Windows, we propose first contributing this work to the Apache community by attaching it to this JIRA. From there we would like to work with the community to refine the patch set until it is ready to be merged into the Apache trunk.
Your feedback solicited,
Alexander Stojanovic
Min Wei
David Lao
Lengning Liu
David Zhang
Asad Khan
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
From common-dev-return-77740-apmail-hadoop-common-dev-archive=hadoop.apache.org@hadoop.apache.org Thu Feb 16 07:35:34 2012
Return-Path: <common-dev-return-77740-apmail-hadoop-common-dev-archive=hadoop.apache.org@hadoop.apache.org>
X-Original-To: apmail-hadoop-common-dev-archive@www.apache.org
Delivered-To: apmail-hadoop-common-dev-archive@www.apache.org
Received: from mail.apache.org (hermes.apache.org [140.211.11.3])
by minotaur.apache.org (Postfix) with SMTP id 8AD8698D3
for <apmail-hadoop-common-dev-archive@www.apache.org>; Thu, 16 Feb 2012 07:35:34 +0000 (UTC)
Received: (qmail 99971 invoked by uid 500); 16 Feb 2012 07:35:32 -0000
Delivered-To: apmail-hadoop-common-dev-archive@hadoop.apache.org
Received: (qmail 99520 invoked by uid 500); 16 Feb 2012 07:35:31 -0000
Mailing-List: contact common-dev-help@hadoop.apache.org; run by ezmlm
Precedence: bulk
List-Help: <mailto:common-dev-help@hadoop.apache.org>
List-Unsubscribe: <mailto:common-dev-unsubscribe@hadoop.apache.org>
List-Post: <mailto:common-dev@hadoop.apache.org>
List-Id: <common-dev.hadoop.apache.org>
Reply-To: common-dev@hadoop.apache.org
Delivered-To: mailing list common-dev@hadoop.apache.org
Received: (qmail 99487 invoked by uid 99); 16 Feb 2012 07:35:31 -0000
Received: from athena.apache.org (HELO athena.apache.org) (140.211.11.136)
by apache.org (qpsmtpd/0.29) with ESMTP; Thu, 16 Feb 2012 07:35:31 +0000
X-ASF-Spam-Status: No, hits=-1996.5 required=5.0
tests=ALL_TRUSTED,T_RP_MATCHES_RCVD,URIBL_BLACK
X-Spam-Check-By: apache.org
Received: from [140.211.11.116] (HELO hel.zones.apache.org) (140.211.11.116)
by apache.org (qpsmtpd/0.29) with ESMTP; Thu, 16 Feb 2012 07:35:26 +0000
Received: from hel.zones.apache.org (hel.zones.apache.org [140.211.11.116])
by hel.zones.apache.org (Postfix) with ESMTP id 446E91BAFAC
for <common-dev@hadoop.apache.org>; Thu, 16 Feb 2012 07:35:06 +0000 (UTC)
Date: Thu, 16 Feb 2012 07:35:06 +0000 (UTC)
From: "Changming Sun (Created) (JIRA)" <jira@apache.org>
To: common-dev@hadoop.apache.org
Message-ID: <1803379195.45240.1329377706281.JavaMail.tomcat@hel.zones.apache.org>
Subject: [jira] [Created] (HADOOP-8080) hadoop-common/src/main/native does
not have a directory which name is "m4"
MIME-Version: 1.0
Content-Type: text/plain; charset=utf-8
Content-Transfer-Encoding: 7bit
X-JIRA-FingerPrint: 30527f35849b9dde25b450d4833f0394
hadoop-common/src/main/native does not have a directory which name is "m4"
--------------------------------------------------------------------------
Key: HADOOP-8080
URL: https://issues.apache.org/jira/browse/HADOOP-8080
Project: Hadoop Common
Issue Type: Bug
Components: native
Environment: FreeBSD 9.0
automake --version
automake (GNU automake) 1.11.1
Copyright (C) 2009 Free Software Foundation, Inc.
License GPLv2+: GNU GPL version 2 or later <http://gnu.org/licenses/gpl-2.0.html>
This is free software: you are free to change and redistribute it.
There is NO WARRANTY, to the extent permitted by law.
Written by Tom Tromey <tromey@redhat.com>
and Alexandre Duret-Lutz <adl@gnu.org>.
Reporter: Changming Sun
Priority: Trivial
There is a such line in configure.ac
AC_CONFIG_MACRO_DIR([m4])
But there doesn't have such a directory, so if the version of automake is too high, autoreconf will fail.
Here is a minor patch for it:
===================================================================
--- hadoop-common-project/hadoop-common/src/main/native/configure.ac (revision 1244865)
+++ hadoop-common-project/hadoop-common/src/main/native/configure.ac (working copy)
@@ -37,7 +37,7 @@
AC_INIT(src/org_apache_hadoop.h)
AC_CONFIG_SRCDIR([src/org_apache_hadoop.h])
AC_CONFIG_AUX_DIR([config])
-AC_CONFIG_MACRO_DIR([m4])
+#AC_CONFIG_MACRO_DIR([m4])
AC_CONFIG_HEADER([config.h])
AC_SYS_LARGEFILE
AC_GNU_SOURCE
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
From common-dev-return-77741-apmail-hadoop-common-dev-archive=hadoop.apache.org@hadoop.apache.org Thu Feb 16 09:17:21 2012
Return-Path: <common-dev-return-77741-apmail-hadoop-common-dev-archive=hadoop.apache.org@hadoop.apache.org>
X-Original-To: apmail-hadoop-common-dev-archive@www.apache.org
Delivered-To: apmail-hadoop-common-dev-archive@www.apache.org
Received: from mail.apache.org (hermes.apache.org [140.211.11.3])
by minotaur.apache.org (Postfix) with SMTP id C5D5D9BC3
for <apmail-hadoop-common-dev-archive@www.apache.org>; Thu, 16 Feb 2012 09:17:21 +0000 (UTC)
Received: (qmail 68122 invoked by uid 500); 16 Feb 2012 09:17:20 -0000
Delivered-To: apmail-hadoop-common-dev-archive@hadoop.apache.org
Received: (qmail 68055 invoked by uid 500); 16 Feb 2012 09:17:19 -0000
Mailing-List: contact common-dev-help@hadoop.apache.org; run by ezmlm
Precedence: bulk
List-Help: <mailto:common-dev-help@hadoop.apache.org>
List-Unsubscribe: <mailto:common-dev-unsubscribe@hadoop.apache.org>
List-Post: <mailto:common-dev@hadoop.apache.org>
List-Id: <common-dev.hadoop.apache.org>
Reply-To: common-dev@hadoop.apache.org
Delivered-To: mailing list common-dev@hadoop.apache.org
Received: (qmail 68038 invoked by uid 99); 16 Feb 2012 09:17:19 -0000
Received: from athena.apache.org (HELO athena.apache.org) (140.211.11.136)
by apache.org (qpsmtpd/0.29) with ESMTP; Thu, 16 Feb 2012 09:17:19 +0000
X-ASF-Spam-Status: No, hits=-2000.0 required=5.0
tests=ALL_TRUSTED
X-Spam-Check-By: apache.org
Received: from [140.211.11.8] (HELO aegis.apache.org) (140.211.11.8)
by apache.org (qpsmtpd/0.29) with ESMTP; Thu, 16 Feb 2012 09:17:17 +0000
Received: from aegis (localhost [127.0.0.1])
by aegis.apache.org (Postfix) with ESMTP id D72F0C00A0
for <common-dev@hadoop.apache.org>; Thu, 16 Feb 2012 09:16:56 +0000 (UTC)
Date: Thu, 16 Feb 2012 09:16:56 +0000 (UTC)
From: Apache Jenkins Server <jenkins@builds.apache.org>
To: common-dev@hadoop.apache.org
Message-ID: <1401094400.111329383816865.JavaMail.hudson@aegis>
In-Reply-To: <210555023.2481329210900396.JavaMail.hudson@aegis>
References: <210555023.2481329210900396.JavaMail.hudson@aegis>
Subject: Build failed in Jenkins: Hadoop-Common-0.23-Build #165
MIME-Version: 1.0
Content-Type: text/plain; charset=UTF-8
Content-Transfer-Encoding: 7bit
X-Jenkins-Job: Hadoop-Common-0.23-Build
X-Jenkins-Result: FAILURE
See <https://builds.apache.org/job/Hadoop-Common-0.23-Build/165/changes>
Changes:
[todd] MAPREDUCE-3864. Fix cluster setup docs for correct SecondaryNameNode HTTPS parameters. Contributed by Todd Lipcon.
[eli] HADOOP-8074. svn merge -c 1244766 from trunk
[suresh] HDFS-2938. Merging change 1244752 from trunk to 0.23
[jitendra] Merged 1244640 from trunk for HDFS-2525.
[todd] HDFS-2950. Secondary NN HTTPS address should be listed as a NAMESERVICE_SPECIFIC_KEY. Contributed by Todd Lipcon.
[todd] HADOOP-6502. Improve the performance of Configuration.getClassByName when the class is not found by caching negative results. Contributed by Sharad Agarwal and Todd Lipcon.
[tucu] Merge -r 1244263:1244264 from trunk to branch. FIXES: MAPREDUCE-3736
[mahadev] MAPREDUCE-3858. Task attempt failure during commit results in task never completing. (Tom White via mahadev) - Merging r1244254 from trunk.
[vinodkv] MAPREDUCE-3854. Fixed and reenabled tests related to MR child JVM's environmental variables in TestMiniMRChildTask. (Tom White via vinodkv)
svn merge --ignore-ancestry -c 1244223 ../../trunk/
[todd] HADOOP-8071. Avoid an extra packet in client code when nagling is disabled. Contributed by Todd Lipcon.
[vinodkv] MAPREDUCE-3802. Added test to validate that AM can crash multiple times and still can recover successfully after MAPREDUCE-3846. (vinodkv)
svn merge --ignore-ancestry -c 1244178 ../../trunk/
------------------------------------------
[...truncated 24070 lines...]
[javadoc] [loading sun/security/krb5/Credentials.class(sun/security/krb5:Credentials.class)]
[javadoc] [loading sun/security/krb5/PrincipalName.class(sun/security/krb5:PrincipalName.class)]
[javadoc] [loading javax/security/auth/login/Configuration.class(javax/security/auth/login:Configuration.class)]
[javadoc] [loading sun/security/krb5/Config.class(sun/security/krb5:Config.class)]
[javadoc] [loading sun/security/krb5/KrbException.class(sun/security/krb5:KrbException.class)]
[javadoc] [loading org/apache/hadoop/security/authentication/server/AuthenticationFilter.class(org/apache/hadoop/security/authentication/server:AuthenticationFilter.class)]
[javadoc] [loading org/apache/avro/reflect/Nullable.class(org/apache/avro/reflect:Nullable.class)]
[javadoc] [loading java/text/DecimalFormat.class(java/text:DecimalFormat.class)]
[javadoc] [loading java/text/NumberFormat.class(java/text:NumberFormat.class)]
[javadoc] [loading javax/xml/transform/TransformerConfigurationException.class(javax/xml/transform:TransformerConfigurationException.class)]
[javadoc] [loading java/util/concurrent/ThreadFactory.class(java/util/concurrent:ThreadFactory.class)]
[javadoc] [loading java/lang/ThreadGroup.class(java/lang:ThreadGroup.class)]
[javadoc] [loading java/util/jar/JarFile.class(java/util/jar:JarFile.class)]
[javadoc] [loading java/util/jar/JarEntry.class(java/util/jar:JarEntry.class)]
[javadoc] [loading java/util/jar/Manifest.class(java/util/jar:Manifest.class)]
[javadoc] [loading java/util/Calendar.class(java/util:Calendar.class)]
[javadoc] [loading org/apache/commons/httpclient/URIException.class(org/apache/commons/httpclient:URIException.class)]
[javadoc] [loading org/apache/commons/httpclient/util/URIUtil.class(org/apache/commons/httpclient/util:URIUtil.class)]
[javadoc] [loading java/lang/Package.class(java/lang:Package.class)]
[javadoc] [loading org/apache/commons/cli/CommandLine.class(org/apache/commons/cli:CommandLine.class)]
[javadoc] [loading org/apache/commons/cli/CommandLineParser.class(org/apache/commons/cli:CommandLineParser.class)]
[javadoc] [loading org/apache/commons/cli/GnuParser.class(org/apache/commons/cli:GnuParser.class)]
[javadoc] [loading org/apache/commons/cli/HelpFormatter.class(org/apache/commons/cli:HelpFormatter.class)]
[javadoc] [loading org/apache/commons/cli/Option.class(org/apache/commons/cli:Option.class)]
[javadoc] [loading org/apache/commons/cli/OptionBuilder.class(org/apache/commons/cli:OptionBuilder.class)]
[javadoc] [loading org/apache/commons/cli/Options.class(org/apache/commons/cli:Options.class)]
[javadoc] [loading org/apache/commons/cli/ParseException.class(org/apache/commons/cli:ParseException.class)]
[javadoc] [loading java/lang/SecurityException.class(java/lang:SecurityException.class)]
[javadoc] [loading java/lang/NoSuchMethodException.class(java/lang:NoSuchMethodException.class)]
[javadoc] [loading java/lang/Override.class(java/lang:Override.class)]
[javadoc] [loading com/google/common/annotations/GwtCompatible.class(com/google/common/annotations:GwtCompatible.class)]
[javadoc] [loading com/google/common/annotations/GwtIncompatible.class(com/google/common/annotations:GwtIncompatible.class)]
[javadoc] [loading <https://builds.apache.org/job/Hadoop-Common-0.23-Build/ws/trunk/hadoop-common-project/hadoop-common/target/classes/org/apache/hadoop/package-info.class]>
[javadoc] [loading <https://builds.apache.org/job/Hadoop-Common-0.23-Build/ws/trunk/hadoop-common-project/hadoop-common/target/classes/org/apache/hadoop/conf/Configuration$1.class]>
[javadoc] [loading <https://builds.apache.org/job/Hadoop-Common-0.23-Build/ws/trunk/hadoop-common-project/hadoop-common/target/classes/org/apache/hadoop/fs/FileContext$13.class]>
[javadoc] [loading <https://builds.apache.org/job/Hadoop-Common-0.23-Build/ws/trunk/hadoop-common-project/hadoop-common/target/classes/org/apache/hadoop/fs/AbstractFileSystem$1.class]>
[javadoc] [loading /home/jenkins/jenkins-slave/wor
[javadoc] kspace/Hadoop-Common-0.23-Build/trunk/hadoop-common-project/hadoop-common/target/classes/org/apache/hadoop/fs/FileContext$20.class]
[javadoc] [loading <https://builds.apache.org/job/Hadoop-Common-0.23-Build/ws/trunk/hadoop-common-project/hadoop-common/target/classes/org/apache/hadoop/fs/FileContext$25.class]>
[javadoc] [loading <https://builds.apache.org/job/Hadoop-Common-0.23-Build/ws/trunk/hadoop-common-project/hadoop-common/target/classes/org/apache/hadoop/fs/AbstractFileSystem$2.class]>
[javadoc] [loading <https://builds.apache.org/job/Hadoop-Common-0.23-Build/ws/trunk/hadoop-common-project/hadoop-common/target/classes/org/apache/hadoop/fs/LocalDirAllocator$1.class]>
[javadoc] [loading <https://builds.apache.org/job/Hadoop-Common-0.23-Build/ws/trunk/hadoop-common-project/hadoop-common/target/classes/org/apache/hadoop/fs/FileContext$Util$2.class]>
[javadoc] [loading <https://builds.apache.org/job/Hadoop-Common-0.23-Build/ws/trunk/hadoop-common-project/hadoop-common/target/classes/org/apache/hadoop/fs/FileContext$22.class]>
[javadoc] [loading <https://builds.apache.org/job/Hadoop-Common-0.23-Build/ws/trunk/hadoop-common-project/hadoop-common/target/classes/org/apache/hadoop/fs/FileContext$10.class]>
[javadoc] [loading <https://builds.apache.org/job/Hadoop-Common-0.23-Build/ws/trunk/hadoop-common-project/hadoop-common/target/classes/org/apache/hadoop/fs/RawLocalFileSystem$1.class]>
[javadoc] [loading <https://builds.apache.org/job/Hadoop-Common-0.23-Build/ws/trunk/hadoop-common-project/hadoop-common/target/classes/org/apache/hadoop/fs/FileContext$1.class]>
[javadoc] [loading <https://builds.apache.org/job/Hadoop-Common-0.23-Build/ws/trunk/hadoop-common-project/hadoop-common/target/classes/org/apache/hadoop/fs/FileContext$7.class]>
[javadoc] [loading <https://builds.apache.org/job/Hadoop-Common-0.23-Build/ws/trunk/hadoop-common-project/hadoop-common/target/classes/org/apache/hadoop/fs/FileContext$15.class]>
[javadoc] [loading <https://builds.apache.org/job/Hadoop-Common-0.23-Build/ws/trunk/hadoop-common-project/hadoop-common/target/classes/org/apache/hadoop/fs/HardLink$1.class]>
[javadoc] [loading <https://builds.apache.org/job/Hadoop-Common-0.23-Build/ws/trunk/hadoop-common-project/hadoop-common/target/classes/org/apache/hadoop/fs/FileSystem$1.class]>
[javadoc] [loading <https://builds.apache.org/job/Hadoop-Common-0.23-Build/ws/trunk/hadoop-common-project/hadoop-common/target/classes/org/apache/hadoop/fs/FileContext$17.class]>
[javadoc] [loading <https://builds.apache.org/job/Hadoop-Common-0.23-Build/ws/trunk/hadoop-common-project/hadoop-common/target/classes/org/apache/hadoop/fs/FileContext$19.class]>
[javadoc] [loading <https://builds.apache.org/job/Hadoop-Common-0.23-Build/ws/trunk/hadoop-common-project/hadoop-common/target/classes/org/apache/hadoop/fs/FileContext$18.class]>
[javadoc] [loading <https://builds.apache.org/job/Hadoop-Common-0.23-Build/ws/trunk/hadoop-common-project/hadoop-common/target/classes/org/apache/hadoop/fs/FileSystem$2.class]>
[javadoc] [loading <https://builds.apache.org/job/Hadoop-Common-0.23-Build/ws/trunk/hadoop-common-project/hadoop-common/target/classes/org/apache/hadoop/fs/TrashPolicyDefault$1.class]>
[javadoc] [loading <https://builds.apache.org/job/Hadoop-Common-0.23-Build/ws/trunk/hadoop-common-project/hadoop-common/target/classes/org/apache/hadoop/fs/FileContext$Util$1.class]>
[javadoc] [loading <https://builds.apache.org/job/Hadoop-Common-0.23-Build/ws/trunk/hadoop-common-project/hadoop-common/target/classes/org/apache/hadoop/fs/FileContext$8.class]>
[javadoc] [loading <https://builds.apache.org/job/Hadoop-Common-0.23-Build/ws/trunk/hadoop-common-project/hadoop-common/target/classes/org/apache/hadoop/fs/ChecksumFileSystem$1.class]>
[javadoc] [loading <https://builds.apache.org/job/Hadoop-Common-0.23-Build/ws/trunk/hadoop-common-project/hadoop-common/target/classes/org/apache/hadoop/fs/FileContext$11.class]>
[javadoc] [loading <https://builds.apache.org/job/Hadoop-Common-0.23-Build/ws/trunk/hadoop-common-project/hadoop-common/target/classes/org/apache/hadoop/fs/FileContext$21.class]>
[javadoc] [loading <https://builds.apache.org/job/Hadoop-Common-0.23-Build/ws/trunk/hadoop-common-project/hadoop-common/target/classes/org/apache/hadoop/fs/FsServerDefaults$1.class]>
[javadoc] [loading <https://builds.apache.org/job/Hadoop-Common-0.23-Build/ws/trunk/hadoop-common-project/hadoop-common/target/classes/org/apache/hadoop/fs/FileContext$6.class]>
[javadoc] [loading <https://builds.apache.org/job/Hadoop-Common-0.23-Build/ws/trunk/hadoop-common-project/hadoop-common/target/classes/org/apache/hadoop/fs/FileContext$2.class]>
[javadoc] [loading <https://builds.apache.org/job/Hadoop-Common-0.23-Build/ws/trunk/hadoop-common-project/hadoop-common/target/classes/org/apache/hadoop/fs/BlockLocation$1.class]>
[javadoc] [loading <https://builds.apache.org/job/Hadoop-Common-0.23-Build/ws/trunk/hadoop-common-project/hadoop-common/target/classes/org/apache/hadoop/fs/Options$1.class]>
[javadoc] [loading <https://builds.apache.org/job/Hadoop-Common-0.23-Build/ws/trunk/hadoop-common-project/hadoop-common/target/classes/org/apache/hadoop/fs/GlobFilter$1.class]>
[javadoc] [loading <https://builds.apache.org/job/Hadoop-Common-0.23-Build/ws/trunk/hadoop-common-project/hadoop-common/target/classes/org/apache/hadoop/fs/FileContext$4.class]>
[javadoc] [loading <https://builds.apache.org/job/Hadoop-Common-0.23-Build/ws/trunk/hadoop-common-project/hadoop-common/target/classes/org/apache/hadoop/fs/FileContext$12.class]>
[javadoc] [loading <https://builds.apache.org/job/Hadoop-Common-0.23-Build/ws/trunk/hadoop-common-project/hadoop-common/target/classes/org/apache/hadoop/fs/FileSystem$5.class]>
[javadoc] [loading <https://builds.apache.org/job/Hadoop-Common-0.23-Build/ws/trunk/hadoop-common-project/hadoop-common/target/classes/org/apache/hadoop/fs/FileContext$9.class]>
[javadoc] [loading <https://builds.apache.org/job/Hadoop-Common-0.23-Build/ws/trunk/hadoop-common-project/hadoop-common/target/classes/org/apache/hadoop/fs/FileContext$24.class]>
[javadoc] [loading <https://builds.apache.org/job/Hadoop-Common-0.23-Build/ws/trunk/hadoop-common-project/hadoop-common/target/classes/org/apache/hadoop/fs/FileContext$3.class]>
[javadoc] [loading <https://builds.apache.org/job/Hadoop-Common-0.23-Build/ws/trunk/hadoop-common-project/hadoop-common/target/classes/org/apache/hadoop/fs/FileContext$5.class]>
[javadoc] [loading <https://builds.apache.org/job/Hadoop-Common-0.23-Build/ws/trunk/hadoop-common-project/hadoop-common/target/classes/org/apache/hadoop/fs/FileSystem$3.class]>
[javadoc] [loading <https://builds.apache.org/job/Hadoop-Common-0.23-Build/ws/trunk/hadoop-common-project/hadoop-common/target/classes/org/apache/hadoop/fs/FileContext$16.class]>
[javadoc] [loading <https://builds.apache.org/job/Hadoop-Common-0.23-Build/ws/trunk/hadoop-common-project/hadoop-common/target/classes/org/apache/hadoop/fs/FileContext$23.class]>
[javadoc] [loading <https://builds.apache.org/job/Hadoop-Common-0.23-Build/ws/trunk/hadoop-common-project/hadoop-common/target/classes/org/apache/hadoop/fs/FileContext$14.class]>
[javadoc] [loading <https://builds.apache.org/job/Hadoop-Common-0.23-Build/ws/trunk/hadoop-common-project/hadoop-common/target/classes/org/apache/hadoop/fs/FileSystem$4.class]>
[javadoc] [loading <https://builds.apache.org/job/Hadoop-Common-0.23-Build/ws/trunk/hadoop-common-project/hadoop-common/target/classes/org/apache/hadoop/fs/DF$1.class]>
[javadoc] [loading <https://builds.apache.org/job/Hadoop-Common-0.23-Build/ws/trunk/hadoop-common-project/hadoop-common/target/classes/org/apache/hadoop/fs/ftp/FTPFileSystem$1.class]>
[javadoc] [loading <https://builds.apache.org/job/Hadoop-Common-0.23-Build/ws/trunk/hadoop-common-project/hadoop-common/target/classes/org/apache/hadoop/fs/permission/FsPermission$1.class]>
[javadoc] [loading <https://builds.apache.org/job/Hadoop-Common-0.23-Build/ws/trunk/hadoop-common-project/hadoop-common/target/classes/org/apache/hadoop/fs/permission/PermissionStatus$2.class]>
[javadoc] [loading <https://builds.apache.org/job/Hadoop-Common-0.23-Build/ws/trunk/hadoop-common-project/hadoop-common/target/classes/org/apache/hadoop/fs/permission/PermissionStatus$1.class]>
[javadoc] [loading <https://builds.apache.org/job/Hadoop-Common-0.23-Build/ws/trunk/hadoop-common-project/hadoop-common/target/classes/org/apache/hadoop/fs/s3/INode$1.class]>
[javadoc] [loading <https://builds.apache.org/job/Hadoop-Common-0.23-Build/ws/trunk/hadoop-common-project/hadoJDiff>: finished (took 0s, not including scanning the source files).
[javadoc] op-common/target/classes/org/apache/hadoop/fs/viewfs/ViewFileSystem$1.class]
[javadoc] [loading <https://builds.apache.org/job/Hadoop-Common-0.23-Build/ws/trunk/hadoop-common-project/hadoop-common/target/classes/org/apache/hadoop/fs/viewfs/ViewFs$1.class]>
[javadoc] [loading <https://builds.apache.org/job/Hadoop-Common-0.23-Build/ws/trunk/hadoop-common-project/hadoop-common/target/classes/org/apache/hadoop/fs/viewfs/ViewFs$2.class]>
[javadoc] [loading <https://builds.apache.org/job/Hadoop-Common-0.23-Build/ws/trunk/hadoop-common-project/hadoop-common/target/classes/org/apache/hadoop/http/lib/StaticUserWebFilter$StaticUserFilter$1.class]>
[javadoc] [loading <https://builds.apache.org/job/Hadoop-Common-0.23-Build/ws/trunk/hadoop-common-project/hadoop-common/target/classes/org/apache/hadoop/io/OutputBuffer$1.class]>
[javadoc] [loading <https://builds.apache.org/job/Hadoop-Common-0.23-Build/ws/trunk/hadoop-common-project/hadoop-common/target/classes/org/apache/hadoop/io/UTF8$1.class]>
[javadoc] [loading <https://builds.apache.org/job/Hadoop-Common-0.23-Build/ws/trunk/hadoop-common-project/hadoop-common/target/classes/org/apache/hadoop/io/FastByteComparisons$LexicographicalComparerHolder$UnsafeComparer$1.class]>
[javadoc] [loading <https://builds.apache.org/job/Hadoop-Common-0.23-Build/ws/trunk/hadoop-common-project/hadoop-common/target/classes/org/apache/hadoop/io/EnumSetWritable$1.class]>
[javadoc] [loading <https://builds.apache.org/job/Hadoop-Common-0.23-Build/ws/trunk/hadoop-common-project/hadoop-common/target/classes/org/apache/hadoop/io/Text$1.class]>
[javadoc] [loading <https://builds.apache.org/job/Hadoop-Common-0.23-Build/ws/trunk/hadoop-common-project/hadoop-common/target/classes/org/apache/hadoop/io/MD5Hash$1.class]>
[javadoc] [loading <https://builds.apache.org/job/Hadoop-Common-0.23-Build/ws/trunk/hadoop-common-project/hadoop-common/target/classes/org/apache/hadoop/io/DataInputByteBuffer$1.class]>
[javadoc] [loading <https://builds.apache.org/job/Hadoop-Common-0.23-Build/ws/trunk/hadoop-common-project/hadoop-common/target/classes/org/apache/hadoop/io/Text$2.class]>
[javadoc] [loading <https://builds.apache.org/job/Hadoop-Common-0.23-Build/ws/trunk/hadoop-common-project/hadoop-common/target/classes/org/apache/hadoop/io/ReadaheadPool$1.class]>
[javadoc] [loading <https://builds.apache.org/job/Hadoop-Common-0.23-Build/ws/trunk/hadoop-common-project/hadoop-common/target/classes/org/apache/hadoop/io/SequenceFile$1.class]>
[javadoc] [loading <https://builds.apache.org/job/Hadoop-Common-0.23-Build/ws/trunk/hadoop-common-project/hadoop-common/target/classes/org/apache/hadoop/io/file/tfile/Compression$Algorithm$1.class]>
[javadoc] [loading <https://builds.apache.org/job/Hadoop-Common-0.23-Build/ws/trunk/hadoop-common-project/hadoop-common/target/classes/org/apache/hadoop/io/file/tfile/Compression$Algorithm$2.class]>
[javadoc] [loading <https://builds.apache.org/job/Hadoop-Common-0.23-Build/ws/trunk/hadoop-common-project/hadoop-common/target/classes/org/apache/hadoop/io/file/tfile/Compression$Algorithm$3.class]>
[javadoc] [loading <https://builds.apache.org/job/Hadoop-Common-0.23-Build/ws/trunk/hadoop-common-project/hadoop-common/target/classes/org/apache/hadoop/io/file/tfile/TFile$Reader$1.class]>
[javadoc] [loading <https://builds.apache.org/job/Hadoop-Common-0.23-Build/ws/trunk/hadoop-common-project/hadoop-common/target/classes/org/apache/hadoop/io/serializer/JavaSerialization$JavaSerializationDeserializer$1.class]>
[javadoc] [loading <https://builds.apache.org/job/Hadoop-Common-0.23-Build/ws/trunk/hadoop-common-project/hadoop-common/target/classes/org/apache/hadoop/io/serializer/JavaSerialization$JavaSerializationSerializer$1.class]>
[javadoc] [loading <https://builds.apache.org/job/Hadoop-Common-0.23-Build/ws/trunk/hadoop-common-project/hadoop-common/target/classes/org/apache/hadoop/log/metrics/EventCounter$1.class]>
[javadoc] [loading <https://builds.apache.org/job/Hadoop-Common-0.23-Build/ws/trunk/hadoop-common-project/hadoop-common/target/classes/org/apache/hadoop/metrics/spi/AbstractMetricsContext$1.class]>
[javadoc] [loading <https://builds.apache.org/job/Hadoop-Common-0.23-Build/ws/trunk/hadoop-common-project/hadoop-common/target/classes/org/apache/hadoop/metrics2/lib/Interns$1.class]>
[javadoc] [loading <https://builds.apache.org/job/Hadoop-Common-0.23-Build/ws/trunk/hadoop-common-project/hadoop-common/target/classes/org/apache/hadoop/metrics2/lib/Interns$Info$1.class]>
[javadoc] [loading <https://builds.apache.org/job/Hadoop-Common-0.23-Build/ws/trunk/hadoop-common-project/hadoop-common/target/classes/org/apache/hadoop/metrics2/lib/MethodMetric$1.class]>
[javadoc] [loading <https://builds.apache.org/job/Hadoop-Common-0.23-Build/ws/trunk/hadoop-common-project/hadoop-common/target/classes/org/apache/hadoop/metrics2/lib/MethodMetric$2.class]>
[javadoc] [loading <https://builds.apache.org/job/Hadoop-Common-0.23-Build/ws/trunk/hadoop-common-project/hadoop-common/target/classes/org/apache/hadoop/metrics2/lib/MethodMetric$4.class]>
[javadoc] [loading <https://builds.apache.org/job/Hadoop-Common-0.23-Build/ws/trunk/hadoop-common-project/hadoop-common/target/classes/org/apache/hadoop/metrics2/lib/MetricsSourceBuilder$1.class]>
[javadoc] [loading <https://builds.apache.org/job/Hadoop-Common-0.23-Build/ws/trunk/hadoop-common-project/hadoop-common/target/classes/org/apache/hadoop/metrics2/lib/Interns$CacheWith2Keys$1.class]>
[javadoc] [loading <https://builds.apache.org/job/Hadoop-Common-0.23-Build/ws/trunk/hadoop-common-project/hadoop-common/target/classes/org/apache/hadoop/metrics2/lib/MethodMetric$3.class]>
[javadoc] [loading <https://builds.apache.org/job/Hadoop-Common-0.23-Build/ws/trunk/hadoop-common-project/hadoop-common/target/classes/org/apache/hadoop/metrics2/lib/Interns$CacheWith2Keys$2.class]>
[javadoc] [loading <https://builds.apache.org/job/Hadoop-Common-0.23-Build/ws/trunk/hadoop-common-project/hadoop-common/target/classes/org/apache/hadoop/metrics2/lib/Interns$Tags$1.class]>
[javadoc] [loading <https://builds.apache.org/job/Hadoop-Common-0.23-Build/ws/trunk/hadoop-common-project/hadoop-common/target/classes/org/apache/hadoop/metrics2/sink/ganglia/AbstractGangliaSink$1.class]>
[javadoc] [loading <https://builds.apache.org/job/Hadoop-Common-0.23-Build/ws/trunk/hadoop-common-project/hadoop-common/target/classes/org/apache/hadoop/metrics2/source/JvmMetrics$1.class]>
[javadoc] [loading <https://builds.apache.org/job/Hadoop-Common-0.23-Build/ws/trunk/hadoop-common-project/hadoop-common/target/classes/org/apache/hadoop/net/SocketIOWithTimeout$1.class]>
[javadoc] [loading <https://builds.apache.org/job/Hadoop-Common-0.23-Build/ws/trunk/hadoop-common-project/hadoop-common/target/classes/org/apache/hadoop/record/BinaryRecordInput$1.class]>
[javadoc] [loading <https://builds.apache.org/job/Hadoop-Common-0.23-Build/ws/trunk/hadoop-common-project/hadoop-common/target/classes/org/apache/hadoop/record/CsvRecordInput$1.class]>
[javadoc] [loading <https://builds.apache.org/job/Hadoop-Common-0.23-Build/ws/trunk/hadoop-common-project/hadoop-common/target/classes/org/apache/hadoop/record/XmlRecordInput$1.class]>
[javadoc] [loading <https://builds.apache.org/job/Hadoop-Common-0.23-Build/ws/trunk/hadoop-common-project/hadoop-common/target/classes/org/apache/hadoop/record/BinaryRecordOutput$1.class]>
[javadoc] [loading <https://builds.apache.org/job/Hadoop-Common-0.23-Build/ws/trunk/hadoop-common-project/hadoop-common/target/classes/org/apache/hadoop/security/SaslRpcClient$1.class]>
[javadoc] [loading <https://builds.apache.org/job/Hadoop-Common-0.23-Build/ws/trunk/hadoop-common-project/hadoop-common/target/classes/org/apache/hadoop/security/UserGroupInformation$1.class]>
[javadoc] [loading <https://builds.apache.org/job/Hadoop-Common-0.23-Build/ws/trunk/hadoop-common-project/hadoop-common/target/classes/org/apache/hadoop/security/Krb5AndCertsSslSocketConnector$Krb5SslFilter$1.class]>
[javadoc] [loading <https://builds.apache.org/job/Hadoop-Common-0.23-Build/ws/trunk/hadoop-common-project/hadoop-common/target/classes/org/apache/hadoop/util/AsyncDiskService$1.class]>
[javadoc] [loading <https://builds.apache.org/job/Hadoop-Common-0.23-Build/ws/trunk/hadoop-common-project/hadoop-common/target/classes/org/apache/hadoop/util/Shell$1.class]>
[javadoc] [loading <https://builds.apache.org/job/Hadoop-Common-0.23-Build/ws/trunk/hadoop-common-project/hadoop-common/target/classes/org/apache/hadoop/util/ReflectionUtils$1.class]>
[javadoc] [loading <https://builds.apache.org/job/Hadoop-Common-0.23-Build/ws/trunk/hadoop-common-project/hadoop-common/target/classes/org/apache/hadoop/util/RunJar$1.class]>
[javadoc] [loading <https://builds.apache.org/job/Hadoop-Common-0.23-Build/ws/trunk/hadoop-common-project/hadoop-common/target/classes/org/apache/hadoop/util/StringUtils$1.class]>
[javadoc] [loading java/util/zip/CRC32.class(java/util/zip:CRC32.class)]
[javadoc] [done in 2368 ms]
[javadoc] 9 warnings
[javadoc] Generating Javadoc
[javadoc] Javadoc execution
[javadoc] javadoc: error - Illegal package name: ""
[javadoc] javadoc: error - File not found: "<https://builds.apache.org/job/Hadoop-Common-0.23-Build/ws/trunk/hadoop-common-project/hadoop-common/dev-support/jdiff/Null.java">
[javadoc] Loading source files for package org.apache.hadoop...
[javadoc] Loading source files for package org.apache.hadoop.conf...
[javadoc] Loading source files for package org.apache.hadoop.fs...
[javadoc] Loading source files for package org.apache.hadoop.fs.ftp...
[javadoc] Loading source files for package org.apache.hadoop.fs.kfs...
[javadoc] Loading source files for package org.apache.hadoop.fs.local...
[javadoc] Loading source files for package org.apache.hadoop.fs.permission...
[javadoc] Loading source files for package org.apache.hadoop.fs.s3...
[javadoc] Loading source files for package org.apache.hadoop.fs.s3native...
[javadoc] Loading source files for package org.apache.hadoop.fs.shell...
[javadoc] Loading source files for package org.apache.hadoop.fs.viewfs...
[javadoc] Loading source files for package org.apache.hadoop.http...
[javadoc] Loading source files for package org.apache.hadoop.http.lib...
[javadoc] Loading source files for package org.apache.hadoop.io...
[javadoc] Loading source files for package org.apache.hadoop.io.compress...
[javadoc] Loading source files for package org.apache.hadoop.io.compress.bzip2...
[javadoc] Loading source files for package org.apache.hadoop.io.compress.lz4...
[javadoc] Loading source files for package org.apache.hadoop.io.compress.snappy...
[javadoc] Loading source files for package org.apache.hadoop.io.compress.zlib...
[javadoc] Loading source files for package org.apache.hadoop.io.file.tfile...
[javadoc] Loading source files for package org.apache.hadoop.io.nativeio...
[javadoc] Loading source files for package org.apache.hadoop.io.retry...
[javadoc] Loading source files for package org.apache.hadoop.io.serializer...
[javadoc] Loading source files for package org.apache.hadoop.io.serializer.avro...
[javadoc] Loading source files for package org.apache.hadoop.ipc...
[javadoc] Loading source files for package org.apache.hadoop.ipc.metrics...
[javadoc] Loading source files for package org.apache.hadoop.jmx...
[javadoc] Loading source files for package org.apache.hadoop.log...
[javadoc] Loading source files for package org.apache.hadoop.log.metrics...
[javadoc] Loading source files for package org.apache.hadoop.metrics...
[javadoc] Loading source files for package org.apache.hadoop.metrics.file...
[javadoc] Loading source files for package org.apache.hadoop.metrics.ganglia...
[javadoc] Loading source files for package org.apache.hadoop.metrics.jvm...
[javadoc] Loading source files for package org.apache.hadoop.metrics.spi...
[javadoc] Loading source files for package org.apache.hadoop.metrics.util...
[javadoc] Loading source files for package org.apache.hadoop.metrics2...
[javadoc] Loading source files for package org.apache.hadoop.metrics2.annotation...
[javadoc] Loading source files for package org.apache.hadoop.metrics2.filter...
[javadoc] Loading source files for package org.apache.hadoop.metrics2.impl...
[javadoc] Loading source files for package org.apache.hadoop.metrics2.lib...
[javadoc] Loading source files for package org.apache.hadoop.metrics2.sink...
[javadoc] Loading source files for package org.apache.hadoop.metrics2.sink.ganglia...
[javadoc] Loading source files for package org.apache.hadoop.metrics2.source...
[javadoc] Loading source files for package org.apache.hadoop.metrics2.util...
[javadoc] Loading source files for package org.apache.hadoop.net...
[javadoc] Loading source files for package org.apache.hadoop.record...
[javadoc] Loading source files for package org.apache.hadoop.record.compiler...
[javadoc] Loading source files for package org.apache.hadoop.record.compiler.ant...
[javadoc] Loading source files for package org.apache.hadoop.record.compiler.generated...
[javadoc] Loading source files for package org.apache.hadoop.record.meta...
[javadoc] Loading source files for package org.apache.hadoop.security...
[javadoc] Loading source files for package org.apache.hadoop.security.authorize...
[javadoc] Loading source files for package org.apache.hadoop.security.token...
[javadoc] Loading source files for package org.apache.hadoop.security.token.delegation...
[javadoc] Loading source files for package org.apache.hadoop.tools...
[javadoc] Loading source files for package org.apache.hadoop.util...
[javadoc] Loading source files for package org.apache.hadoop.util.bloom...
[javadoc] Loading source files for package org.apache.hadoop.util.hash...
[javadoc] 2 errors
[INFO] ------------------------------------------------------------------------
[INFO] Reactor Summary:
[INFO]
[INFO] Apache Hadoop Annotations ......................... SUCCESS [17.699s]
[INFO] Apache Hadoop Auth ................................ SUCCESS [1:03.367s]
[INFO] Apache Hadoop Auth Examples ....................... SUCCESS [7.458s]
[INFO] Apache Hadoop Common .............................. FAILURE [1:09.935s]
[INFO] Apache Hadoop Common Project ...................... SKIPPED
[INFO] ------------------------------------------------------------------------
[INFO] BUILD FAILURE
[INFO] ------------------------------------------------------------------------
[INFO] Total time: 2:39.590s
[INFO] Finished at: Thu Feb 16 09:07:29 UTC 2012
[INFO] Final Memory: 67M/774M
[INFO] ------------------------------------------------------------------------
[ERROR] Failed to execute goal org.apache.maven.plugins:maven-antrun-plugin:1.6:run (site) on project hadoop-common: An Ant BuildException has occured: input file <https://builds.apache.org/job/Hadoop-Common-0.23-Build/ws/trunk/hadoop-common-project/hadoop-common/target/findbugsXml.xml> does not exist -> [Help 1]
[ERROR]
[ERROR] To see the full stack trace of the errors, re-run Maven with the -e switch.
[ERROR] Re-run Maven using the -X switch to enable full debug logging.
[ERROR]
[ERROR] For more information about the errors and possible solutions, please read the following articles:
[ERROR] [Help 1] http://cwiki.apache.org/confluence/display/MAVEN/MojoExecutionException
[ERROR]
[ERROR] After correcting the problems, you can resume the build with the command
[ERROR] mvn <goals> -rf :hadoop-common
+ /home/jenkins/tools/maven/latest/bin/mvn test -Pclover -DcloverLicenseLocation=/home/jenkins/tools/clover/latest/lib/clover.license
[WARNINGS] Parsing warnings in console log with parsers [Java Compiler, JavaDoc]
[WARNINGS] Java Compiler : Found 72 warnings.
[WARNINGS] Java Compiler : Found 17 warnings.
[WARNINGS] JavaDoc : Found 0 warnings.
[WARNINGS] Computing warning deltas based on reference build #162
Archiving artifacts
Recording fingerprints
Publishing Javadoc
ERROR: Publisher hudson.tasks.JavadocArchiver aborted due to exception
<https://builds.apache.org/job/Hadoop-Common-0.23-Build/ws/trunk/hadoop-common-project/hadoop-common/target/site/api> does not exist.
at org.apache.tools.ant.types.AbstractFileSet.getDirectoryScanner(AbstractFileSet.java:474)
at hudson.FilePath$35.hasMatch(FilePath.java:1905)
at hudson.FilePath$35.invoke(FilePath.java:1814)
at hudson.FilePath$35.invoke(FilePath.java:1805)
at hudson.FilePath$FileCallableWrapper.call(FilePath.java:2099)
at hudson.remoting.UserRequest.perform(UserRequest.java:118)
at hudson.remoting.UserRequest.perform(UserRequest.java:48)
at hudson.remoting.Request$2.run(Request.java:287)
at hudson.remoting.InterceptingExecutorService$1.call(InterceptingExecutorService.java:72)
at java.util.concurrent.FutureTask$Sync.innerRun(FutureTask.java:303)
at java.util.concurrent.FutureTask.run(FutureTask.java:138)
at java.util.concurrent.ThreadPoolExecutor$Worker.runTask(ThreadPoolExecutor.java:886)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:908)
at java.lang.Thread.run(Thread.java:662)
Recording test results
From common-dev-return-77742-apmail-hadoop-common-dev-archive=hadoop.apache.org@hadoop.apache.org Thu Feb 16 09:22:51 2012
Return-Path: <common-dev-return-77742-apmail-hadoop-common-dev-archive=hadoop.apache.org@hadoop.apache.org>
X-Original-To: apmail-hadoop-common-dev-archive@www.apache.org
Delivered-To: apmail-hadoop-common-dev-archive@www.apache.org
Received: from mail.apache.org (hermes.apache.org [140.211.11.3])
by minotaur.apache.org (Postfix) with SMTP id 7BC0B9C8F
for <apmail-hadoop-common-dev-archive@www.apache.org>; Thu, 16 Feb 2012 09:22:51 +0000 (UTC)
Received: (qmail 83623 invoked by uid 500); 16 Feb 2012 09:22:50 -0000
Delivered-To: apmail-hadoop-common-dev-archive@hadoop.apache.org
Received: (qmail 83567 invoked by uid 500); 16 Feb 2012 09:22:49 -0000
Mailing-List: contact common-dev-help@hadoop.apache.org; run by ezmlm
Precedence: bulk
List-Help: <mailto:common-dev-help@hadoop.apache.org>
List-Unsubscribe: <mailto:common-dev-unsubscribe@hadoop.apache.org>
List-Post: <mailto:common-dev@hadoop.apache.org>
List-Id: <common-dev.hadoop.apache.org>
Reply-To: common-dev@hadoop.apache.org
Delivered-To: mailing list common-dev@hadoop.apache.org
Received: (qmail 83559 invoked by uid 99); 16 Feb 2012 09:22:49 -0000
Received: from nike.apache.org (HELO nike.apache.org) (192.87.106.230)
by apache.org (qpsmtpd/0.29) with ESMTP; Thu, 16 Feb 2012 09:22:49 +0000
X-ASF-Spam-Status: No, hits=-2000.0 required=5.0
tests=ALL_TRUSTED
X-Spam-Check-By: apache.org
Received: from [140.211.11.8] (HELO aegis.apache.org) (140.211.11.8)
by apache.org (qpsmtpd/0.29) with ESMTP; Thu, 16 Feb 2012 09:22:42 +0000
Received: from aegis (localhost [127.0.0.1])
by aegis.apache.org (Postfix) with ESMTP id 536C3C00A0
for <common-dev@hadoop.apache.org>; Thu, 16 Feb 2012 09:22:21 +0000 (UTC)
Date: Thu, 16 Feb 2012 09:22:21 +0000 (UTC)
From: Apache Jenkins Server <jenkins@builds.apache.org>
To: common-dev@hadoop.apache.org
Message-ID: <704252474.141329384141339.JavaMail.hudson@aegis>
In-Reply-To: <2121096656.2531329212159492.JavaMail.hudson@aegis>
References: <2121096656.2531329212159492.JavaMail.hudson@aegis>
Subject: Build failed in Jenkins: Hadoop-Common-trunk #319
MIME-Version: 1.0
Content-Type: text/plain; charset=UTF-8
Content-Transfer-Encoding: quoted-printable
X-Jenkins-Job: Hadoop-Common-trunk
X-Jenkins-Result: FAILURE
X-Virus-Checked: Checked by ClamAV on apache.org
See <https://builds.apache.org/job/Hadoop-Common-trunk/319/changes>
Changes:
[todd] MAPREDUCE-3864. Fix cluster setup docs for correct SecondaryNameNode=
HTTPS parameters. Contributed by Todd Lipcon.
[eli] HADOOP-8074. Small bug in hadoop error message for unknown commands. =
Contributed by Colin Patrick McCabe
[suresh] HDFS-2938. Recursive delete of a large directory make namenode unr=
esponsive. Contributed by Hari Mankude.
[jitendra] HDFS-2525. Race between BlockPoolSliceScanner and append. Contri=
buted by Brandon Li.
[todd] HDFS-2950. Secondary NN HTTPS address should be listed as a NAMESERV=
ICE_SPECIFIC_KEY. Contributed by Todd Lipcon.
[todd] HADOOP-6502. Improve the performance of Configuration.getClassByName=
when the class is not found by caching negative results. Contributed by Sh=
arad Agarwal and Todd Lipcon.
[tucu] MAPREDUCE-3736. Variable substitution depth too large for fs.default=
.name causes jobs to fail (ahmed via tucu)
[mahadev] MAPREDUCE-3858. Task attempt failure during commit results in tas=
k never completing. (Tom White via mahadev)
[vinodkv] MAPREDUCE-3854. Fixed and reenabled tests related to MR child JVM=
's environmental variables in TestMiniMRChildTask. (Tom White via vinodkv)
[todd] HADOOP-8071. Avoid an extra packet in client code when nagling is di=
sabled. Contributed by Todd Lipcon.
[todd] HADOOP-8070. Add a standalone benchmark for RPC call performance. Co=
ntributed by Todd Lipcon.
[vinodkv] MAPREDUCE-3802. Added test to validate that AM can crash multiple=
times and still can recover successfully after MAPREDUCE-3846. (vinodkv)
------------------------------------------
[...truncated 40341 lines...]
[javadoc] 'org.apache.hadoop.tools'
[javadoc] 'org.apache.hadoop.util'
[javadoc] 'org.apache.hadoop.util.bloom'
[javadoc] 'org.apache.hadoop.util.hash'
[javadoc] '<https://builds.apache.org/job/Hadoop-Common-trunk/ws/trunk/ha=
doop-common-project/hadoop-common/dev-support/jdiff/Null.java'>
[javadoc]=20
[javadoc] The ' characters around the executable and arguments are
[javadoc] not part of the command.
[javadoc] Javadoc execution
Execute:Java13CommandLauncher: Executing '/home/jenkins/tools/java/jdk1.6.0=
_26/bin/javadoc' with arguments:
'-d'
'<https://builds.apache.org/job/Hadoop-Common-trunk/ws/trunk/hadoop-common-=
project/hadoop-common/target/site/jdiff/xml'>
'-J-Xmx512m'
'-classpath'
'<https://builds.apache.org/job/Hadoop-Common-trunk/ws/trunk/hadoop-common-=
project/hadoop-common/target/classes>:<https://builds.apache.org/job/Hadoop=
-Common-trunk/ws/trunk/hadoop-common-project/hadoop-annotations/target/hado=
op-annotations-0.24.0-SNAPSHOT.jar>:/home/jenkins/.m2/repository/jdiff/jdif=
f/1.0.9/jdiff-1.0.9.jar:/home/jenkins/.m2/repository/com/google/guava/guava=
/r09/guava-r09.jar:/home/jenkins/.m2/repository/commons-cli/commons-cli/1.2=
/commons-cli-1.2.jar:/home/jenkins/.m2/repository/org/apache/commons/common=
s-math/2.1/commons-math-2.1.jar:/home/jenkins/.m2/repository/xmlenc/xmlenc/=
0.52/xmlenc-0.52.jar:/home/jenkins/.m2/repository/commons-httpclient/common=
s-httpclient/3.1/commons-httpclient-3.1.jar:/home/jenkins/.m2/repository/co=
mmons-codec/commons-codec/1.4/commons-codec-1.4.jar:/home/jenkins/.m2/repos=
itory/commons-net/commons-net/1.4.1/commons-net-1.4.1.jar:/home/jenkins/.m2=
/repository/javax/servlet/servlet-api/2.5/servlet-api-2.5.jar:/home/jenkins=
/.m2/repository/org/mortbay/jetty/jetty/6.1.26/jetty-6.1.26.jar:/home/jenki=
ns/.m2/repository/org/mortbay/jetty/jetty-util/6.1.26/jetty-util-6.1.26.jar=
:/home/jenkins/.m2/repository/asm/asm/3.2/asm-3.2.jar:/home/jenkins/.m2/rep=
ository/com/sun/jersey/jersey-core/1.8/jersey-core-1.8.jar:/home/jenkins/.m=
2/repository/com/sun/jersey/jersey-json/1.8/jersey-json-1.8.jar:/home/jenki=
ns/.m2/repository/org/codehaus/jettison/jettison/1.1/jettison-1.1.jar:/home=
/jenkins/.m2/repository/stax/stax-api/1.0.1/stax-api-1.0.1.jar:/home/jenkin=
s/.m2/repository/com/sun/xml/bind/jaxb-impl/2.2.3-1/jaxb-impl-2.2.3-1.jar:/=
home/jenkins/.m2/repository/javax/xml/bind/jaxb-api/2.2.2/jaxb-api-2.2.2.ja=
r:/home/jenkins/.m2/repository/javax/activation/activation/1.1/activation-1=
.1.jar:/home/jenkins/.m2/repository/org/codehaus/jackson/jackson-core-asl/1=
.7.1/jackson-core-asl-1.7.1.jar:/home/jenkins/.m2/repository/org/codehaus/j=
ackson/jackson-jaxrs/1.7.1/jackson-jaxrs-1.7.1.jar:/home/jenkins/.m2/reposi=
tory/org/codehaus/jackson/jackson-xc/1.7.1/jackson-xc-1.7.1.jar:/home/jenki=
ns/.m2/repository/com/sun/jersey/jersey-server/1.8/jersey-server-1.8.jar:/h=
ome/jenkins/.m2/repository/tomcat/jasper-compiler/5.5.23/jasper-compiler-5.=
5.23.jar:/home/jenkins/.m2/repository/tomcat/jasper-runtime/5.5.23/jasper-r=
untime-5.5.23.jar:/home/jenkins/.m2/repository/javax/servlet/jsp/jsp-api/2.=
1/jsp-api-2.1.jar:/home/jenkins/.m2/repository/commons-el/commons-el/1.0/co=
mmons-el-1.0.jar:/home/jenkins/.m2/repository/commons-logging/commons-loggi=
ng/1.1.1/commons-logging-1.1.1.jar:/home/jenkins/.m2/repository/commons-log=
ging/commons-logging-api/1.1/commons-logging-api-1.1.jar:/home/jenkins/.m2/=
repository/log4j/log4j/1.2.15/log4j-1.2.15.jar:/home/jenkins/.m2/repository=
/net/java/dev/jets3t/jets3t/0.6.1/jets3t-0.6.1.jar:/home/jenkins/.m2/reposi=
tory/commons-lang/commons-lang/2.5/commons-lang-2.5.jar:/home/jenkins/.m2/r=
epository/commons-collections/commons-collections/3.2.1/commons-collections=
-3.2.1.jar:/home/jenkins/.m2/repository/commons-configuration/commons-confi=
guration/1.6/commons-configuration-1.6.jar:/home/jenkins/.m2/repository/com=
mons-digester/commons-digester/1.8/commons-digester-1.8.jar:/home/jenkins/.=
m2/repository/commons-beanutils/commons-beanutils/1.7.0/commons-beanutils-1=
.7.0.jar:/home/jenkins/.m2/repository/commons-beanutils/commons-beanutils-c=
ore/1.8.0/commons-beanutils-core-1.8.0.jar:/home/jenkins/.m2/repository/hsq=
ldb/hsqldb/1.8.0.7/hsqldb-1.8.0.7.jar:/home/jenkins/.m2/repository/org/slf4=
j/slf4j-api/1.6.1/slf4j-api-1.6.1.jar:/home/jenkins/.m2/repository/org/slf4=
j/slf4j-log4j12/1.6.1/slf4j-log4j12-1.6.1.jar:/home/jenkins/.m2/repository/=
org/eclipse/jdt/core/3.1.1/core-3.1.1.jar:/home/jenkins/.m2/repository/oro/=
oro/2.0.8/oro-2.0.8.jar:/home/jenkins/.m2/repository/org/codehaus/jackson/j=
ackson-mapper-asl/1.8.8/jackson-mapper-asl-1.8.8.jar:/home/jenkins/.m2/repo=
sitory/org/aspectj/aspectjrt/1.6.5/aspectjrt-1.6.5.jar:/home/jenkins/.m2/re=
pository/org/apache/avro/avro/1.5.3/avro-1.5.3.jar:/home/jenkins/.m2/reposi=
tory/com/thoughtworks/paranamer/paranamer/2.3/paranamer-2.3.jar:/home/jenki=
ns/.m2/repository/org/xerial/snappy/snappy-java/1.0.3.2/snappy-java-1.0.3.2=
.jar:/home/jenkins/.m2/repository/net/sf/kosmosfs/kfs/0.3/kfs-0.3.jar:/home=
/jenkins/.m2/repository/org/apache/ant/ant/1.8.1/ant-1.8.1.jar:/home/jenkin=
s/.m2/repository/org/apache/ant/ant-launcher/1.8.1/ant-launcher-1.8.1.jar:/=
home/jenkins/.m2/repository/com/google/protobuf/protobuf-java/2.4.0a/protob=
uf-java-2.4.0a.jar:<https://builds.apache.org/job/Hadoop-Common-trunk/ws/tr=
unk/hadoop-common-project/hadoop-auth/target/hadoop-auth-0.24.0-SNAPSHOT.ja=
r>:/home/jenkins/.m2/repository/com/googlecode/json-simple/json-simple/1.1/=
json-simple-1.1.jar:/home/jenkins/tools/java/latest/lib/tools.jar'
'-sourcepath'
'<https://builds.apache.org/job/Hadoop-Common-trunk/ws/trunk/hadoop-common-=
project/hadoop-common/src/main/java'>
'-doclet'
'org.apache.hadoop.classification.tools.ExcludePrivateAnnotationsJDiffDocle=
t'
'-docletpath'
'<https://builds.apache.org/job/Hadoop-Common-trunk/ws/trunk/hadoop-common-=
project/hadoop-common/target/hadoop-annotations.jar>:<https://builds.apache=
.org/job/Hadoop-Common-trunk/ws/trunk/hadoop-common-project/hadoop-common/t=
arget/jdiff.jar'>
'-oldapi'
'hadoop-core 0.20.2'
'-newapi'
'hadoop-core 0.24.0-SNAPSHOT'
'-oldapidir'
'<https://builds.apache.org/job/Hadoop-Common-trunk/ws/trunk/hadoop-common-=
project/hadoop-common/dev-support/jdiff'>
'-newapidir'
'<https://builds.apache.org/job/Hadoop-Common-trunk/ws/trunk/hadoop-common-=
project/hadoop-common/target/site/jdiff/xml'>
'-javadocold'
'http://hadoop.apache.org/docs/0.20.2/api/'
'-javadocnew'
'<https://builds.apache.org/job/Hadoop-Common-trunk/ws/trunk/hadoop-common-=
project/hadoop-common/target/site/api'>
'-stats'
'-unstable'
''
'org.apache.hadoop'
'org.apache.hadoop.conf'
'org.apache.hadoop.fs'
'org.apache.hadoop.fs.ftp'
'org.apache.hadoop.fs.kfs'
'org.apache.hadoop.fs.local'
'org.apache.hadoop.fs.permission'
'org.apache.hadoop.fs.s3'
'org.apache.hadoop.fs.s3native'
'org.apache.hadoop.fs.shell'
'org.apache.hadoop.fs.viewfs'
'org.apache.hadoop.http'
'org.apache.hadoop.http.lib'
'org.apache.hadoop.io'
'org.apache.hadoop.io.compress'
'org.apache.hadoop.io.compress.bzip2'
'org.apache.hadoop.io.compress.lz4'
'org.apache.hadoop.io.compress.snappy'
'org.apache.hadoop.io.compress.zlib'
'org.apache.hadoop.io.file.tfile'
'org.apache.hadoop.io.nativeio'
'org.apache.hadoop.io.retry'
'org.apache.hadoop.io.serializer'
'org.apache.hadoop.io.serializer.avro'
'org.apache.hadoop.ipc'
'org.apache.hadoop.ipc.metrics'
'org.apache.hadoop.jmx'
'org.apache.hadoop.log'
'org.apache.hadoop.log.metrics'
'org.apache.hadoop.metrics'
'org.apache.hadoop.metrics.file'
'org.apache.hadoop.metrics.ganglia'
'org.apache.hadoop.metrics.jvm'
'org.apache.hadoop.metrics.spi'
'org.apache.hadoop.metrics.util'
'org.apache.hadoop.metrics2'
'org.apache.hadoop.metrics2.annotation'
'org.apache.hadoop.metrics2.filter'
'org.apache.hadoop.metrics2.impl'
'org.apache.hadoop.metrics2.lib'
'org.apache.hadoop.metrics2.sink'
'org.apache.hadoop.metrics2.sink.ganglia'
'org.apache.hadoop.metrics2.source'
'org.apache.hadoop.metrics2.util'
'org.apache.hadoop.net'
'org.apache.hadoop.record'
'org.apache.hadoop.record.compiler'
'org.apache.hadoop.record.compiler.ant'
'org.apache.hadoop.record.compiler.generated'
'org.apache.hadoop.record.meta'
'org.apache.hadoop.security'
'org.apache.hadoop.security.authorize'
'org.apache.hadoop.security.token'
'org.apache.hadoop.security.token.delegation'
'org.apache.hadoop.tools'
'org.apache.hadoop.util'
'org.apache.hadoop.util.bloom'
'org.apache.hadoop.util.hash'
'<https://builds.apache.org/job/Hadoop-Common-trunk/ws/trunk/hadoop-common-=
project/hadoop-common/dev-support/jdiff/Null.java'>
The ' characters around the executable and arguments are
not part of the command.
[javadoc] javadoc: error - Illegal package name: ""
[javadoc] javadoc: error - File not found: "<https://builds.apache.org/jo=
b/Hadoop-Common-trunk/ws/trunk/hadoop-common-project/hadoop-common/dev-supp=
ort/jdiff/Null.java">
[javadoc] Loading source files for package org.apache.hadoop...
[javadoc] Loading source files for package org.apache.hadoop.conf...
[javadoc] Loading source files for package org.apache.hadoop.fs...
[javadoc] Loading source files for package org.apache.hadoop.fs.ftp...
[javadoc] Loading source files for package org.apache.hadoop.fs.kfs...
[javadoc] Loading source files for package org.apache.hadoop.fs.local...
[javadoc] Loading source files for package org.apache.hadoop.fs.permissio=
n...
[javadoc] Loading source files for package org.apache.hadoop.fs.s3...
[javadoc] Loading source files for package org.apache.hadoop.fs.s3native.=
..
[javadoc] Loading source files for package org.apache.hadoop.fs.shell...
[javadoc] Loading source files for package org.apache.hadoop.fs.viewfs...
[javadoc] Loading source files for package org.apache.hadoop.http...
[javadoc] Loading source files for package org.apache.hadoop.http.lib...
[javadoc] Loading source files for package org.apache.hadoop.io...
[javadoc] Loading source files for package org.apache.hadoop.io.compress.=
..
[javadoc] Loading source files for package org.apache.hadoop.io.compress.=
bzip2...
[javadoc] Loading source files for package org.apache.hadoop.io.compress.=
lz4...
[javadoc] Loading source files for package org.apache.hadoop.io.compress.=
snappy...
[javadoc] Loading source files for package org.apache.hadoop.io.compress.=
zlib...
[javadoc] Loading source files for package org.apache.hadoop.io.file.tfil=
e...
[javadoc] Loading source files for package org.apache.hadoop.io.nativeio.=
..
[javadoc] Loading source files for package org.apache.hadoop.io.retry...
[javadoc] Loading source files for package org.apache.hadoop.io.serialize=
r...
[javadoc] Loading source files for package org.apache.hadoop.io.serialize=
r.avro...
[javadoc] Loading source files for package org.apache.hadoop.ipc...
[javadoc] Loading source files for package org.apache.hadoop.ipc.metrics.=
..
[javadoc] Loading source files for package org.apache.hadoop.jmx...
[javadoc] Loading source files for package org.apache.hadoop.log...
[javadoc] Loading source files for package org.apache.hadoop.log.metrics.=
..
[javadoc] Loading source files for package org.apache.hadoop.metrics...
[javadoc] Loading source files for package org.apache.hadoop.metrics.file=
...
[javadoc] Loading source files for package org.apache.hadoop.metrics.gang=
lia...
[javadoc] Loading source files for package org.apache.hadoop.metrics.jvm.=
..
[javadoc] Loading source files for package org.apache.hadoop.metrics.spi.=
..
[javadoc] Loading source files for package org.apache.hadoop.metrics.util=
...
[javadoc] Loading source files for package org.apache.hadoop.metrics2...
[javadoc] Loading source files for package org.apache.hadoop.metrics2.ann=
otation...
[javadoc] Loading source files for package org.apache.hadoop.metrics2.fil=
ter...
[javadoc] Loading source files for package org.apache.hadoop.metrics2.imp=
l...
[javadoc] Loading source files for package org.apache.hadoop.metrics2.lib=
...
[javadoc] Loading source files for package org.apache.hadoop.metrics2.sin=
k...
[javadoc] Loading source files for package org.apache.hadoop.metrics2.sin=
k.ganglia...
[javadoc] Loading source files for package org.apache.hadoop.metrics2.sou=
rce...
[javadoc] Loading source files for package org.apache.hadoop.metrics2.uti=
l...
[javadoc] Loading source files for package org.apache.hadoop.net...
[javadoc] Loading source files for package org.apache.hadoop.record...
[javadoc] Loading source files for package org.apache.hadoop.record.compi=
ler...
[javadoc] Loading source files for package org.apache.hadoop.record.compi=
ler.ant...
[javadoc] Loading source files for package org.apache.hadoop.record.compi=
ler.generated...
[javadoc] Loading source files for package org.apache.hadoop.record.meta.=
..
[javadoc] Loading source files for package org.apache.hadoop.security...
[javadoc] Loading source files for package org.apache.hadoop.security.aut=
horize...
[javadoc] Loading source files for package org.apache.hadoop.security.tok=
en...
[javadoc] Loading source files for package org.apache.hadoop.security.tok=
en.delegation...
[javadoc] Loading source files for package org.apache.hadoop.tools...
[javadoc] Loading source files for package org.apache.hadoop.util...
[javadoc] Loading source files for package org.apache.hadoop.util.bloom..=
.
[javadoc] Loading source files for package org.apache.hadoop.util.hash...
[javadoc] 2 errors
[INFO] --------------------------------------------------------------------=
----
[INFO] Reactor Summary:
[INFO]=20
[INFO] Apache Hadoop Annotations ......................... SUCCESS [17.675s=
]
[INFO] Apache Hadoop Auth ................................ SUCCESS [55.496s=
]
[INFO] Apache Hadoop Auth Examples ....................... SUCCESS [7.827s]
[INFO] Apache Hadoop Common .............................. FAILURE [1:02.36=
3s]
[INFO] Apache Hadoop Common Project ...................... SKIPPED
[INFO] --------------------------------------------------------------------=
----
[INFO] BUILD FAILURE
[INFO] --------------------------------------------------------------------=
----
[INFO] Total time: 2:24.502s
[INFO] Finished at: Thu Feb 16 09:07:54 UTC 2012
[INFO] Final Memory: 70M/550M
[INFO] --------------------------------------------------------------------=
----
[ERROR] Failed to execute goal org.apache.maven.plugins:maven-antrun-plugin=
:1.6:run (site) on project hadoop-common: An Ant BuildException has occured=
: input file <https://builds.apache.org/job/Hadoop-Common-trunk/ws/trunk/ha=
doop-common-project/hadoop-common/target/findbugsXml.xml> does not exist ->=
[Help 1]
org.apache.maven.lifecycle.LifecycleExecutionException: Failed to execute g=
oal org.apache.maven.plugins:maven-antrun-plugin:1.6:run (site) on project =
hadoop-common: An Ant BuildException has occured: input file <https://build=
s.apache.org/job/Hadoop-Common-trunk/ws/trunk/hadoop-common-project/hadoop-=
common/target/findbugsXml.xml> does not exist
=09at org.apache.maven.lifecycle.internal.MojoExecutor.execute(MojoExecutor=
.java:217)
=09at org.apache.maven.lifecycle.internal.MojoExecutor.execute(MojoExecutor=
.java:153)
=09at org.apache.maven.lifecycle.internal.MojoExecutor.execute(MojoExecutor=
.java:145)
=09at org.apache.maven.lifecycle.internal.LifecycleModuleBuilder.buildProje=
ct(LifecycleModuleBuilder.java:84)
=09at org.apache.maven.lifecycle.internal.LifecycleModuleBuilder.buildProje=
ct(LifecycleModuleBuilder.java:59)
=09at org.apache.maven.lifecycle.internal.LifecycleStarter.singleThreadedBu=
ild(LifecycleStarter.java:183)
=09at org.apache.maven.lifecycle.internal.LifecycleStarter.execute(Lifecycl=
eStarter.java:161)
=09at org.apache.maven.DefaultMaven.doExecute(DefaultMaven.java:319)
=09at org.apache.maven.DefaultMaven.execute(DefaultMaven.java:156)
=09at org.apache.maven.cli.MavenCli.execute(MavenCli.java:537)
=09at org.apache.maven.cli.MavenCli.doMain(MavenCli.java:196)
=09at org.apache.maven.cli.MavenCli.main(MavenCli.java:141)
=09at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
=09at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.=
java:39)
=09at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAcces=
sorImpl.java:25)
=09at java.lang.reflect.Method.invoke(Method.java:597)
=09at org.codehaus.plexus.classworlds.launcher.Launcher.launchEnhanced(Laun=
cher.java:290)
=09at org.codehaus.plexus.classworlds.launcher.Launcher.launch(Launcher.jav=
a:230)
=09at org.codehaus.plexus.classworlds.launcher.Launcher.mainWithExitCode(La=
uncher.java:409)
=09at org.codehaus.plexus.classworlds.launcher.Launcher.main(Launcher.java:=
352)
Caused by: org.apache.maven.plugin.MojoExecutionException: An Ant BuildExce=
ption has occured: input file <https://builds.apache.org/job/Hadoop-Common-=
trunk/ws/trunk/hadoop-common-project/hadoop-common/target/findbugsXml.xml> =
does not exist
=09at org.apache.maven.plugin.antrun.AntRunMojo.execute(AntRunMojo.java:283=
)
=09at org.apache.maven.plugin.DefaultBuildPluginManager.executeMojo(Default=
BuildPluginManager.java:101)
=09at org.apache.maven.lifecycle.internal.MojoExecutor.execute(MojoExecutor=
.java:209)
=09... 19 more
Caused by: <https://builds.apache.org/job/Hadoop-Common-trunk/ws/trunk/hado=
op-common-project/hadoop-common/target/antrun/build-main.xml>:48: input fil=
e <https://builds.apache.org/job/Hadoop-Common-trunk/ws/trunk/hadoop-common=
-project/hadoop-common/target/findbugsXml.xml> does not exist
=09at org.apache.tools.ant.taskdefs.XSLTProcess.handleError(XSLTProcess.jav=
a:1229)
=09at org.apache.tools.ant.taskdefs.XSLTProcess.execute(XSLTProcess.java:33=
5)
=09at org.apache.tools.ant.UnknownElement.execute(UnknownElement.java:291)
=09at sun.reflect.GeneratedMethodAccessor124.invoke(Unknown Source)
=09at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAcces=
sorImpl.java:25)
=09at java.lang.reflect.Method.invoke(Method.java:597)
=09at org.apache.tools.ant.dispatch.DispatchUtils.execute(DispatchUtils.jav=
a:106)
=09at org.apache.tools.ant.Task.perform(Task.java:348)
=09at org.apache.tools.ant.Target.execute(Target.java:390)
=09at org.apache.tools.ant.Target.performTasks(Target.java:411)
=09at org.apache.tools.ant.Project.executeSortedTargets(Project.java:1397)
=09at org.apache.tools.ant.Project.executeTarget(Project.java:1366)
=09at org.apache.maven.plugin.antrun.AntRunMojo.execute(AntRunMojo.java:270=
)
=09... 21 more
[ERROR]=20
[ERROR]=20
[ERROR] For more information about the errors and possible solutions, pleas=
e read the following articles:
[ERROR] [Help 1] http://cwiki.apache.org/confluence/display/MAVEN/MojoExecu=
tionException
[ERROR]=20
[ERROR] After correcting the problems, you can resume the build with the co=
mmand
[ERROR] mvn <goals> -rf :hadoop-common
+ /home/jenkins/tools/maven/latest/bin/mvn test -Pclover -DcloverLicenseLoc=
ation=3D/home/jenkins/tools/clover/latest/lib/clover.license
[WARNINGS] Parsing warnings in console log with parsers [Java Compiler, Jav=
aDoc]
[WARNINGS] Java Compiler : Found 72 warnings.
[WARNINGS] Java Compiler : Found 17 warnings.
[WARNINGS] JavaDoc : Found 0 warnings.
[WARNINGS] Computing warning deltas based on reference build #316
Archiving artifacts
Recording test results
Publishing Javadoc
ERROR: Publisher hudson.tasks.JavadocArchiver aborted due to exception
<https://builds.apache.org/job/Hadoop-Common-trunk/ws/trunk/hadoop-common-p=
roject/hadoop-common/target/site/api> does not exist.
=09at org.apache.tools.ant.types.AbstractFileSet.getDirectoryScanner(Abstra=
ctFileSet.java:474)
=09at hudson.FilePath$35.hasMatch(FilePath.java:1905)
=09at hudson.FilePath$35.invoke(FilePath.java:1814)
=09at hudson.FilePath$35.invoke(FilePath.java:1805)
=09at hudson.FilePath$FileCallableWrapper.call(FilePath.java:2099)
=09at hudson.remoting.UserRequest.perform(UserRequest.java:118)
=09at hudson.remoting.UserRequest.perform(UserRequest.java:48)
=09at hudson.remoting.Request$2.run(Request.java:287)
=09at hudson.remoting.InterceptingExecutorService$1.call(InterceptingExecut=
orService.java:72)
=09at java.util.concurrent.FutureTask$Sync.innerRun(FutureTask.java:303)
=09at java.util.concurrent.FutureTask.run(FutureTask.java:138)
=09at java.util.concurrent.ThreadPoolExecutor$Worker.runTask(ThreadPoolExec=
utor.java:886)
=09at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor=
.java:908)
=09at java.lang.Thread.run(Thread.java:662)
Recording fingerprints
From common-dev-return-77743-apmail-hadoop-common-dev-archive=hadoop.apache.org@hadoop.apache.org Thu Feb 16 12:19:03 2012
Return-Path: <common-dev-return-77743-apmail-hadoop-common-dev-archive=hadoop.apache.org@hadoop.apache.org>
X-Original-To: apmail-hadoop-common-dev-archive@www.apache.org
Delivered-To: apmail-hadoop-common-dev-archive@www.apache.org
Received: from mail.apache.org (hermes.apache.org [140.211.11.3])
by minotaur.apache.org (Postfix) with SMTP id 0F2199C7B
for <apmail-hadoop-common-dev-archive@www.apache.org>; Thu, 16 Feb 2012 12:19:03 +0000 (UTC)
Received: (qmail 42211 invoked by uid 500); 16 Feb 2012 12:19:01 -0000
Delivered-To: apmail-hadoop-common-dev-archive@hadoop.apache.org
Received: (qmail 42143 invoked by uid 500); 16 Feb 2012 12:19:01 -0000
Mailing-List: contact common-dev-help@hadoop.apache.org; run by ezmlm
Precedence: bulk
List-Help: <mailto:common-dev-help@hadoop.apache.org>
List-Unsubscribe: <mailto:common-dev-unsubscribe@hadoop.apache.org>
List-Post: <mailto:common-dev@hadoop.apache.org>
List-Id: <common-dev.hadoop.apache.org>
Reply-To: common-dev@hadoop.apache.org
Delivered-To: mailing list common-dev@hadoop.apache.org
Received: (qmail 42134 invoked by uid 99); 16 Feb 2012 12:19:01 -0000
Received: from nike.apache.org (HELO nike.apache.org) (192.87.106.230)
by apache.org (qpsmtpd/0.29) with ESMTP; Thu, 16 Feb 2012 12:19:01 +0000
X-ASF-Spam-Status: No, hits=2.8 required=5.0
tests=HTML_MESSAGE,RCVD_IN_DNSWL_LOW,SPF_PASS,URI_HEX
X-Spam-Check-By: apache.org
Received-SPF: pass (nike.apache.org: domain of ducquoc.vn@gmail.com designates 209.85.214.48 as permitted sender)
Received: from [209.85.214.48] (HELO mail-bk0-f48.google.com) (209.85.214.48)
by apache.org (qpsmtpd/0.29) with ESMTP; Thu, 16 Feb 2012 12:18:53 +0000
Received: by bkcjm1 with SMTP id jm1so2654802bkc.35
for <common-dev@hadoop.apache.org>; Thu, 16 Feb 2012 04:18:33 -0800 (PST)
DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed;
d=gmail.com; s=gamma;
h=mime-version:in-reply-to:references:date:message-id:subject:from:to
:content-type;
bh=WoLOHqmd46FhNInY6uBJVT5Oa5nSnPg7WalOm9L53Uc=;
b=tEnFdbteFRMfpaxlAr/xyBrmv+cksRkWT9OLljMuaf7E6dvbaO6zWoSUPbC/43rfsa
55Ar32nRYmM+Z2xuiEPFFtqGLmNj92mYK4n66bhhiMMi8VLJFGUWcJ/WtxiUycXZTHCV
birrPgy9rscaG3HVD+ZUjQJaWp48KkP+MMwMY=
MIME-Version: 1.0
Received: by 10.205.133.196 with SMTP id hz4mr1046465bkc.71.1329394713496;
Thu, 16 Feb 2012 04:18:33 -0800 (PST)
Received: by 10.204.166.15 with HTTP; Thu, 16 Feb 2012 04:18:33 -0800 (PST)
In-Reply-To: <1326353355221-3652889.post@n3.nabble.com>
References: <1326353355221-3652889.post@n3.nabble.com>
Date: Thu, 16 Feb 2012 19:18:33 +0700
Message-ID: <CANJjwCOh3s1HFs6w2+shj2ZXB1HaHBAUwBvaG1d8Ef5Gb+xHwg@mail.gmail.com>
Subject: =?UTF-8?Q?Re=3A_please_recommend_some_materials_of_analyzing_map?=
=?UTF-8?Q?reduce_sourcecode=E3=80=82?=
From: Duc Quoc <ducquoc.vn@gmail.com>
To: common-dev@hadoop.apache.org
Content-Type: multipart/alternative; boundary=000e0ce0d40caa0cf904b913d3db
X-Virus-Checked: Checked by ClamAV on apache.org
--000e0ce0d40caa0cf904b913d3db
Content-Type: text/plain; charset=UTF-8
Content-Transfer-Encoding: quoted-printable
Here are some links that may fit your request:
http://code.google.com/p/hadoop-clusternet/wiki/DebuggingJobsUsingEclipse
http://let-them-c.blogspot.com/2011/07/configurations-of-running-hadoop.htm=
l
http://www.slideshare.net/pacoid/getting-started-on-hadoop
http://wiki.apache.org/hadoop/HowToDebugMapReducePrograms
Books:
+ Hadoop The Definitive Guide (2nd Edition) , OReilly 2010
hope this helps,
--Duc
On Thu, Jan 12, 2012 at 2:29 PM, 27g <tiangangzhu@gmail.com> wrote:
> I=E2=80=98m learning mapreduce=EF=BC=8CPlease recommend some materials of=
analyzing
> mapreduce
> sourcecode. Blogs,paper,or books and so on ,all of them are OK! Thanks=EF=
=BC=81
>
> --
> View this message in context:
> http://lucene.472066.n3.nabble.com/please-recommend-some-materials-of-ana=
lyzing-mapreduce-sourcecode-tp3652889p3652889.html
> Sent from the Hadoop lucene-dev mailing list archive at Nabble.com.
>
--000e0ce0d40caa0cf904b913d3db--
From common-dev-return-77744-apmail-hadoop-common-dev-archive=hadoop.apache.org@hadoop.apache.org Thu Feb 16 12:19:31 2012
Return-Path: <common-dev-return-77744-apmail-hadoop-common-dev-archive=hadoop.apache.org@hadoop.apache.org>
X-Original-To: apmail-hadoop-common-dev-archive@www.apache.org
Delivered-To: apmail-hadoop-common-dev-archive@www.apache.org
Received: from mail.apache.org (hermes.apache.org [140.211.11.3])
by minotaur.apache.org (Postfix) with SMTP id 06C6D9CE2
for <apmail-hadoop-common-dev-archive@www.apache.org>; Thu, 16 Feb 2012 12:19:31 +0000 (UTC)
Received: (qmail 46361 invoked by uid 500); 16 Feb 2012 12:19:28 -0000
Delivered-To: apmail-hadoop-common-dev-archive@hadoop.apache.org
Received: (qmail 46273 invoked by uid 500); 16 Feb 2012 12:19:27 -0000
Mailing-List: contact common-dev-help@hadoop.apache.org; run by ezmlm
Precedence: bulk
List-Help: <mailto:common-dev-help@hadoop.apache.org>
List-Unsubscribe: <mailto:common-dev-unsubscribe@hadoop.apache.org>
List-Post: <mailto:common-dev@hadoop.apache.org>
List-Id: <common-dev.hadoop.apache.org>
Reply-To: common-dev@hadoop.apache.org
Delivered-To: mailing list common-dev@hadoop.apache.org
Received: (qmail 46219 invoked by uid 99); 16 Feb 2012 12:19:27 -0000
Received: from nike.apache.org (HELO nike.apache.org) (192.87.106.230)
by apache.org (qpsmtpd/0.29) with ESMTP; Thu, 16 Feb 2012 12:19:27 +0000
X-ASF-Spam-Status: No, hits=-2000.0 required=5.0
tests=ALL_TRUSTED,T_RP_MATCHES_RCVD
X-Spam-Check-By: apache.org
Received: from [140.211.11.116] (HELO hel.zones.apache.org) (140.211.11.116)
by apache.org (qpsmtpd/0.29) with ESMTP; Thu, 16 Feb 2012 12:19:21 +0000
Received: from hel.zones.apache.org (hel.zones.apache.org [140.211.11.116])
by hel.zones.apache.org (Postfix) with ESMTP id E809E1BAA50
for <common-dev@hadoop.apache.org>; Thu, 16 Feb 2012 12:18:59 +0000 (UTC)
Date: Thu, 16 Feb 2012 12:18:59 +0000 (UTC)
From: "Ben Smithers (Created) (JIRA)" <jira@apache.org>
To: common-dev@hadoop.apache.org
Message-ID: <2045280859.45800.1329394739951.JavaMail.tomcat@hel.zones.apache.org>
Subject: [jira] [Created] (HADOOP-8081) HOD Should Be Less Restrictive Over
Options Passed To Resource Manager
MIME-Version: 1.0
Content-Type: text/plain; charset=utf-8
Content-Transfer-Encoding: 7bit
X-JIRA-FingerPrint: 30527f35849b9dde25b450d4833f0394
X-Virus-Checked: Checked by ClamAV on apache.org
HOD Should Be Less Restrictive Over Options Passed To Resource Manager
----------------------------------------------------------------------
Key: HADOOP-8081
URL: https://issues.apache.org/jira/browse/HADOOP-8081
Project: Hadoop Common
Issue Type: Wish
Components: contrib/hod
Affects Versions: 1.0.0, 0.21.0
Reporter: Ben Smithers
Priority: Minor
At present, HOD requires any extra options passed to the resource manager to be of the form <option>:<sub-option>=<value>
This is quite restrictive. Considering Torque and qsub, this effectively limits the options to a subset of the resource constraints, variable lists and additional attributes. Potentially desirable attributes that cannot (to the best of my knowledge) be expressed:
- Mailing options. Given than it may take some time for a long-running HOD job to be scheduled, it would be useful to exploit the options (-m and -M) for notifying users
- Other resource constraints, such as particular nodes or number of processors per node. The format required by qsub(http://www.clusterresources.com/torquedocs/2.1jobsubmission.shtml#nodeExamples) is incompatible with the format required by HOD. In practice, it would probably be desirable to have these options specified via the command line as these may change per HOD job
I imagine some thought would be needed to balance flexibility whist not breaking the options HOD sets by default.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
From common-dev-return-77745-apmail-hadoop-common-dev-archive=hadoop.apache.org@hadoop.apache.org Thu Feb 16 16:27:25 2012
Return-Path: <common-dev-return-77745-apmail-hadoop-common-dev-archive=hadoop.apache.org@hadoop.apache.org>
X-Original-To: apmail-hadoop-common-dev-archive@www.apache.org
Delivered-To: apmail-hadoop-common-dev-archive@www.apache.org
Received: from mail.apache.org (hermes.apache.org [140.211.11.3])
by minotaur.apache.org (Postfix) with SMTP id E7BED9C96
for <apmail-hadoop-common-dev-archive@www.apache.org>; Thu, 16 Feb 2012 16:27:25 +0000 (UTC)
Received: (qmail 46845 invoked by uid 500); 16 Feb 2012 16:27:24 -0000
Delivered-To: apmail-hadoop-common-dev-archive@hadoop.apache.org
Received: (qmail 46751 invoked by uid 500); 16 Feb 2012 16:27:24 -0000
Mailing-List: contact common-dev-help@hadoop.apache.org; run by ezmlm
Precedence: bulk
List-Help: <mailto:common-dev-help@hadoop.apache.org>
List-Unsubscribe: <mailto:common-dev-unsubscribe@hadoop.apache.org>
List-Post: <mailto:common-dev@hadoop.apache.org>
List-Id: <common-dev.hadoop.apache.org>
Reply-To: common-dev@hadoop.apache.org
Delivered-To: mailing list common-dev@hadoop.apache.org
Received: (qmail 46655 invoked by uid 99); 16 Feb 2012 16:27:23 -0000
Received: from athena.apache.org (HELO athena.apache.org) (140.211.11.136)
by apache.org (qpsmtpd/0.29) with ESMTP; Thu, 16 Feb 2012 16:27:23 +0000
X-ASF-Spam-Status: No, hits=-2000.0 required=5.0
tests=ALL_TRUSTED,T_RP_MATCHES_RCVD
X-Spam-Check-By: apache.org
Received: from [140.211.11.116] (HELO hel.zones.apache.org) (140.211.11.116)
by apache.org (qpsmtpd/0.29) with ESMTP; Thu, 16 Feb 2012 16:27:19 +0000
Received: from hel.zones.apache.org (hel.zones.apache.org [140.211.11.116])
by hel.zones.apache.org (Postfix) with ESMTP id 7A35C1BB45E
for <common-dev@hadoop.apache.org>; Thu, 16 Feb 2012 16:26:59 +0000 (UTC)
Date: Thu, 16 Feb 2012 16:26:59 +0000 (UTC)
From: "Alejandro Abdelnur (Created) (JIRA)" <jira@apache.org>
To: common-dev@hadoop.apache.org
Message-ID: <1190290406.46637.1329409619501.JavaMail.tomcat@hel.zones.apache.org>
Subject: [jira] [Created] (HADOOP-8082) add hadoop-client and
hadoop-minicluster to the dependency-management section
MIME-Version: 1.0
Content-Type: text/plain; charset=utf-8
Content-Transfer-Encoding: 7bit
X-JIRA-FingerPrint: 30527f35849b9dde25b450d4833f0394
add hadoop-client and hadoop-minicluster to the dependency-management section
-----------------------------------------------------------------------------
Key: HADOOP-8082
URL: https://issues.apache.org/jira/browse/HADOOP-8082
Project: Hadoop Common
Issue Type: Bug
Components: build
Affects Versions: 0.24.0, 0.23.2
Reporter: Alejandro Abdelnur
Assignee: Alejandro Abdelnur
Fix For: 0.23.2
Attachments: HADOOP-8082.patch
This will allow other Hadoop sub-projects to use those artifacts without having to specify the version.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
From common-dev-return-77746-apmail-hadoop-common-dev-archive=hadoop.apache.org@hadoop.apache.org Thu Feb 16 16:59:39 2012
Return-Path: <common-dev-return-77746-apmail-hadoop-common-dev-archive=hadoop.apache.org@hadoop.apache.org>
X-Original-To: apmail-hadoop-common-dev-archive@www.apache.org
Delivered-To: apmail-hadoop-common-dev-archive@www.apache.org
Received: from mail.apache.org (hermes.apache.org [140.211.11.3])
by minotaur.apache.org (Postfix) with SMTP id 5FF1C9E98
for <apmail-hadoop-common-dev-archive@www.apache.org>; Thu, 16 Feb 2012 16:59:39 +0000 (UTC)
Received: (qmail 77195 invoked by uid 500); 16 Feb 2012 16:59:35 -0000
Delivered-To: apmail-hadoop-common-dev-archive@hadoop.apache.org
Received: (qmail 77113 invoked by uid 500); 16 Feb 2012 16:59:35 -0000
Mailing-List: contact common-dev-help@hadoop.apache.org; run by ezmlm
Precedence: bulk
List-Help: <mailto:common-dev-help@hadoop.apache.org>
List-Unsubscribe: <mailto:common-dev-unsubscribe@hadoop.apache.org>
List-Post: <mailto:common-dev@hadoop.apache.org>
List-Id: <common-dev.hadoop.apache.org>
Reply-To: common-dev@hadoop.apache.org
Delivered-To: mailing list common-dev@hadoop.apache.org
Received: (qmail 77097 invoked by uid 500); 16 Feb 2012 16:59:35 -0000
Delivered-To: apmail-hadoop-core-dev@hadoop.apache.org
Received: (qmail 77094 invoked by uid 500); 16 Feb 2012 16:59:35 -0000
Delivered-To: apmail-lucene-hadoop-dev@lucene.apache.org
Received: (qmail 77091 invoked by uid 99); 16 Feb 2012 16:59:35 -0000
Received: from athena.apache.org (HELO athena.apache.org) (140.211.11.136)
by apache.org (qpsmtpd/0.29) with ESMTP; Thu, 16 Feb 2012 16:59:35 +0000
X-ASF-Spam-Status: No, hits=2.8 required=5.0
tests=HTML_MESSAGE,RCVD_IN_DNSWL_LOW,SPF_PASS,URI_HEX
X-Spam-Check-By: apache.org
Received-SPF: pass (athena.apache.org: domain of ravihadoop@gmail.com designates 209.85.160.48 as permitted sender)
Received: from [209.85.160.48] (HELO mail-pw0-f48.google.com) (209.85.160.48)
by apache.org (qpsmtpd/0.29) with ESMTP; Thu, 16 Feb 2012 16:59:29 +0000
Received: by pbcxa12 with SMTP id xa12so1139970pbc.35
for <hadoop-dev@lucene.apache.org>; Thu, 16 Feb 2012 08:59:09 -0800 (PST)
DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed;
d=gmail.com; s=gamma;
h=mime-version:in-reply-to:references:date:message-id:subject:from:to
:cc:content-type;
bh=6crx8s+baBAnHhvPr9+gaXe/FaQPZP16iVZSFYvezgw=;
b=m5vn9i4+BdCuPlDz4WwygWLWrHTx7sOYCnDJlavRQnIpPLahsjn6YJLlcCym9adV+8
2mRNtGlg6N10Bpmjtu6wrvoV8s4H2nMWIvexp9IuOmqoH9uZ03PZQdF/ESPa/y7H1QGW
SL4G39ECNi/beYfymd1danlZmEZGKOd5YUCSQ=
MIME-Version: 1.0
Received: by 10.68.130.40 with SMTP id ob8mr15219803pbb.106.1329411544491;
Thu, 16 Feb 2012 08:59:04 -0800 (PST)
Received: by 10.142.152.35 with HTTP; Thu, 16 Feb 2012 08:59:04 -0800 (PST)
In-Reply-To: <1329353815406-3748957.post@n3.nabble.com>
References: <1329010868844-3736421.post@n3.nabble.com>
<CAMs9kViDTfFYzNYtUqY7-hyiSkErYo_6oyZ0AbtcQGFFMkC5KQ@mail.gmail.com>
<1329353815406-3748957.post@n3.nabble.com>
Date: Thu, 16 Feb 2012 10:59:04 -0600
Message-ID: <CAMs9kVgj5==jb0qopsgv_P7FGKDczqsHmy=oiD4Oj4ju1X6NbQ@mail.gmail.com>
Subject: Re: datanode to blocks mapping
From: Ravi Prakash <ravihadoop@gmail.com>
To: common-dev@hadoop.apache.org
Cc: hadoop-dev@lucene.apache.org
Content-Type: multipart/alternative; boundary=047d7b10ccdbdea7ec04b917beba
--047d7b10ccdbdea7ec04b917beba
Content-Type: text/plain; charset=ISO-8859-1
Selwa,
I'm glad I could help. I suggest you import the source code in an IDE (we
use Eclipse) and navigate around it. The outline view in Eclipse is a
lifesaver :)
BlocksMap does not seem to have that API. I would try FSNamesystem on the
namenode. On the client side, the DFSClient class is what opens a file (and
takes care of all the block-mapping).
Hope this helps,
Ravi.
On Wed, Feb 15, 2012 at 6:56 PM, Selwa <elhamab99@gmail.com> wrote:
> Ravi,
>
> thank u very much for your reply.
> i am using version 0.21.0 . hope your comment will help me a lot.
> BTW, after i got the blocksMap, can i request this blocksMap to return
> blocks of a given file.
> i mean how to map a filename to its blocks?
>
> Best wishes,
> Selwa
>
> --
> View this message in context:
> http://lucene.472066.n3.nabble.com/datanode-to-blocks-mapping-tp3736421p3748957.html
> Sent from the Hadoop lucene-dev mailing list archive at Nabble.com.
>
--047d7b10ccdbdea7ec04b917beba--
From common-dev-return-77747-apmail-hadoop-common-dev-archive=hadoop.apache.org@hadoop.apache.org Thu Feb 16 16:59:39 2012
Return-Path: <common-dev-return-77747-apmail-hadoop-common-dev-archive=hadoop.apache.org@hadoop.apache.org>
X-Original-To: apmail-hadoop-common-dev-archive@www.apache.org
Delivered-To: apmail-hadoop-common-dev-archive@www.apache.org
Received: from mail.apache.org (hermes.apache.org [140.211.11.3])
by minotaur.apache.org (Postfix) with SMTP id A9D009EBB
for <apmail-hadoop-common-dev-archive@www.apache.org>; Thu, 16 Feb 2012 16:59:39 +0000 (UTC)
Received: (qmail 77279 invoked by uid 500); 16 Feb 2012 16:59:35 -0000
Delivered-To: apmail-hadoop-common-dev-archive@hadoop.apache.org
Received: (qmail 77116 invoked by uid 500); 16 Feb 2012 16:59:35 -0000
Mailing-List: contact common-dev-help@hadoop.apache.org; run by ezmlm
Precedence: bulk
List-Help: <mailto:common-dev-help@hadoop.apache.org>
List-Unsubscribe: <mailto:common-dev-unsubscribe@hadoop.apache.org>
List-Post: <mailto:common-dev@hadoop.apache.org>
List-Id: <common-dev.hadoop.apache.org>
Reply-To: common-dev@hadoop.apache.org
Delivered-To: mailing list common-dev@hadoop.apache.org
Received: (qmail 77100 invoked by uid 99); 16 Feb 2012 16:59:35 -0000
Received: from athena.apache.org (HELO athena.apache.org) (140.211.11.136)
by apache.org (qpsmtpd/0.29) with ESMTP; Thu, 16 Feb 2012 16:59:35 +0000
X-ASF-Spam-Status: No, hits=2.8 required=5.0
tests=HTML_MESSAGE,RCVD_IN_DNSWL_LOW,SPF_PASS,URI_HEX
X-Spam-Check-By: apache.org
Received-SPF: pass (athena.apache.org: domain of ravihadoop@gmail.com designates 209.85.160.48 as permitted sender)
Received: from [209.85.160.48] (HELO mail-pw0-f48.google.com) (209.85.160.48)
by apache.org (qpsmtpd/0.29) with ESMTP; Thu, 16 Feb 2012 16:59:29 +0000
Received: by pbcxa12 with SMTP id xa12so1139969pbc.35
for <common-dev@hadoop.apache.org>; Thu, 16 Feb 2012 08:59:09 -0800 (PST)
DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed;
d=gmail.com; s=gamma;
h=mime-version:in-reply-to:references:date:message-id:subject:from:to
:cc:content-type;
bh=6crx8s+baBAnHhvPr9+gaXe/FaQPZP16iVZSFYvezgw=;
b=m5vn9i4+BdCuPlDz4WwygWLWrHTx7sOYCnDJlavRQnIpPLahsjn6YJLlcCym9adV+8
2mRNtGlg6N10Bpmjtu6wrvoV8s4H2nMWIvexp9IuOmqoH9uZ03PZQdF/ESPa/y7H1QGW
SL4G39ECNi/beYfymd1danlZmEZGKOd5YUCSQ=
MIME-Version: 1.0
Received: by 10.68.130.40 with SMTP id ob8mr15219803pbb.106.1329411544491;
Thu, 16 Feb 2012 08:59:04 -0800 (PST)
Received: by 10.142.152.35 with HTTP; Thu, 16 Feb 2012 08:59:04 -0800 (PST)
In-Reply-To: <1329353815406-3748957.post@n3.nabble.com>
References: <1329010868844-3736421.post@n3.nabble.com>
<CAMs9kViDTfFYzNYtUqY7-hyiSkErYo_6oyZ0AbtcQGFFMkC5KQ@mail.gmail.com>
<1329353815406-3748957.post@n3.nabble.com>
Date: Thu, 16 Feb 2012 10:59:04 -0600
Message-ID: <CAMs9kVgj5==jb0qopsgv_P7FGKDczqsHmy=oiD4Oj4ju1X6NbQ@mail.gmail.com>
Subject: Re: datanode to blocks mapping
From: Ravi Prakash <ravihadoop@gmail.com>
To: common-dev@hadoop.apache.org
Cc: hadoop-dev@lucene.apache.org
Content-Type: multipart/alternative; boundary=047d7b10ccdbdea7ec04b917beba
--047d7b10ccdbdea7ec04b917beba
Content-Type: text/plain; charset=ISO-8859-1
Selwa,
I'm glad I could help. I suggest you import the source code in an IDE (we
use Eclipse) and navigate around it. The outline view in Eclipse is a
lifesaver :)
BlocksMap does not seem to have that API. I would try FSNamesystem on the
namenode. On the client side, the DFSClient class is what opens a file (and
takes care of all the block-mapping).
Hope this helps,
Ravi.
On Wed, Feb 15, 2012 at 6:56 PM, Selwa <elhamab99@gmail.com> wrote:
> Ravi,
>
> thank u very much for your reply.
> i am using version 0.21.0 . hope your comment will help me a lot.
> BTW, after i got the blocksMap, can i request this blocksMap to return
> blocks of a given file.
> i mean how to map a filename to its blocks?
>
> Best wishes,
> Selwa
>
> --
> View this message in context:
> http://lucene.472066.n3.nabble.com/datanode-to-blocks-mapping-tp3736421p3748957.html
> Sent from the Hadoop lucene-dev mailing list archive at Nabble.com.
>
--047d7b10ccdbdea7ec04b917beba--
From common-dev-return-77748-apmail-hadoop-common-dev-archive=hadoop.apache.org@hadoop.apache.org Thu Feb 16 18:30:59 2012
Return-Path: <common-dev-return-77748-apmail-hadoop-common-dev-archive=hadoop.apache.org@hadoop.apache.org>
X-Original-To: apmail-hadoop-common-dev-archive@www.apache.org
Delivered-To: apmail-hadoop-common-dev-archive@www.apache.org
Received: from mail.apache.org (hermes.apache.org [140.211.11.3])
by minotaur.apache.org (Postfix) with SMTP id 0CD599D3E
for <apmail-hadoop-common-dev-archive@www.apache.org>; Thu, 16 Feb 2012 18:30:59 +0000 (UTC)
Received: (qmail 6502 invoked by uid 500); 16 Feb 2012 18:30:57 -0000
Delivered-To: apmail-hadoop-common-dev-archive@hadoop.apache.org
Received: (qmail 6420 invoked by uid 500); 16 Feb 2012 18:30:57 -0000
Mailing-List: contact common-dev-help@hadoop.apache.org; run by ezmlm
Precedence: bulk
List-Help: <mailto:common-dev-help@hadoop.apache.org>
List-Unsubscribe: <mailto:common-dev-unsubscribe@hadoop.apache.org>
List-Post: <mailto:common-dev@hadoop.apache.org>
List-Id: <common-dev.hadoop.apache.org>
Reply-To: common-dev@hadoop.apache.org
Delivered-To: mailing list common-dev@hadoop.apache.org
Delivered-To: moderator for common-dev@hadoop.apache.org
Received: (qmail 73228 invoked by uid 99); 16 Feb 2012 17:50:31 -0000
X-ASF-Spam-Status: No, hits=2.2 required=5.0
tests=HTML_MESSAGE,RCVD_IN_DNSWL_NONE,SPF_PASS
X-Spam-Check-By: apache.org
Received-SPF: pass (athena.apache.org: domain of ext-fabio.almeida@nokia.com designates 147.243.128.26 as permitted sender)
From: <ext-fabio.almeida@nokia.com>
To: <mapreduce-user@hadoop.apache.org>, <common-dev@hadoop.apache.org>
Subject: Partitioners - How to know if they are working
Thread-Topic: Partitioners - How to know if they are working
Thread-Index: Aczsq1M+ia5k+sonSX2haZfqI6lamg==
Date: Thu, 16 Feb 2012 17:49:49 +0000
Message-ID: <36AACAA2CA05C74C942B45F8D90515FFFA4B71@008-AM1MPN1-026.mgdnok.nokia.com>
Accept-Language: en-US
Content-Language: en-US
X-MS-Has-Attach:
X-MS-TNEF-Correlator:
x-originating-ip: [189.2.128.130]
Content-Type: multipart/alternative;
boundary="_000_36AACAA2CA05C74C942B45F8D90515FFFA4B71008AM1MPN1026mgdn_"
MIME-Version: 1.0
X-OriginalArrivalTime: 16 Feb 2012 17:49:57.0400 (UTC) FILETIME=[659DD980:01CCECD3]
X-Nokia-AV: Clean
--_000_36AACAA2CA05C74C942B45F8D90515FFFA4B71008AM1MPN1026mgdn_
Content-Type: text/plain; charset="us-ascii"
Content-Transfer-Encoding: quoted-printable
Hello All,
I wrote my own partitioner and I would like to see if it's working.
By printing the return of method getPartition I could see that the partitio=
ns were different, but were they really working? To answer that I got the k=
eys that every reducer task processed and that was what I expected. It seem=
s my partitioner is working properly. But not easy to discover though.
Does anyone know if there is an easier way to see if your customized partit=
ioner is working? For instance, a counter that shows how many partitioners =
a map generated or a reducer received?
Thanks in advance,
Fabio Almeida
--_000_36AACAA2CA05C74C942B45F8D90515FFFA4B71008AM1MPN1026mgdn_--
From common-dev-return-77749-apmail-hadoop-common-dev-archive=hadoop.apache.org@hadoop.apache.org Thu Feb 16 18:34:58 2012
Return-Path: <common-dev-return-77749-apmail-hadoop-common-dev-archive=hadoop.apache.org@hadoop.apache.org>
X-Original-To: apmail-hadoop-common-dev-archive@www.apache.org
Delivered-To: apmail-hadoop-common-dev-archive@www.apache.org
Received: from mail.apache.org (hermes.apache.org [140.211.11.3])
by minotaur.apache.org (Postfix) with SMTP id A40B29FEA
for <apmail-hadoop-common-dev-archive@www.apache.org>; Thu, 16 Feb 2012 18:34:58 +0000 (UTC)
Received: (qmail 23873 invoked by uid 500); 16 Feb 2012 18:34:55 -0000
Delivered-To: apmail-hadoop-common-dev-archive@hadoop.apache.org
Received: (qmail 23751 invoked by uid 500); 16 Feb 2012 18:34:55 -0000
Mailing-List: contact common-dev-help@hadoop.apache.org; run by ezmlm
Precedence: bulk
List-Help: <mailto:common-dev-help@hadoop.apache.org>
List-Unsubscribe: <mailto:common-dev-unsubscribe@hadoop.apache.org>
List-Post: <mailto:common-dev@hadoop.apache.org>
List-Id: <common-dev.hadoop.apache.org>
Reply-To: common-dev@hadoop.apache.org
Delivered-To: mailing list common-dev@hadoop.apache.org
Received: (qmail 23734 invoked by uid 99); 16 Feb 2012 18:34:55 -0000
Received: from nike.apache.org (HELO nike.apache.org) (192.87.106.230)
by apache.org (qpsmtpd/0.29) with ESMTP; Thu, 16 Feb 2012 18:34:55 +0000
X-ASF-Spam-Status: No, hits=-0.7 required=5.0
tests=RCVD_IN_DNSWL_LOW,SPF_PASS
X-Spam-Check-By: apache.org
Received-SPF: pass (nike.apache.org: domain of harsh@cloudera.com designates 209.85.210.48 as permitted sender)
Received: from [209.85.210.48] (HELO mail-pz0-f48.google.com) (209.85.210.48)
by apache.org (qpsmtpd/0.29) with ESMTP; Thu, 16 Feb 2012 18:34:48 +0000
Received: by dadp13 with SMTP id p13so2796588dad.35
for <multiple recipients>; Thu, 16 Feb 2012 10:34:27 -0800 (PST)
Received: by 10.68.240.164 with SMTP id wb4mr16153740pbc.57.1329417267171;
Thu, 16 Feb 2012 10:34:27 -0800 (PST)
MIME-Version: 1.0
Received: by 10.68.13.69 with HTTP; Thu, 16 Feb 2012 10:34:07 -0800 (PST)
In-Reply-To: <36AACAA2CA05C74C942B45F8D90515FFFA4B71@008-AM1MPN1-026.mgdnok.nokia.com>
References: <36AACAA2CA05C74C942B45F8D90515FFFA4B71@008-AM1MPN1-026.mgdnok.nokia.com>
From: Harsh J <harsh@cloudera.com>
Date: Fri, 17 Feb 2012 00:04:07 +0530
Message-ID: <CAOcnVr2FZOoO8HiuUbsoD1izZy3HVdyw+4Q5RP72c4pQXQrYHw@mail.gmail.com>
Subject: Re: Partitioners - How to know if they are working
To: mapreduce-user@hadoop.apache.org
Cc: common-dev@hadoop.apache.org
Content-Type: text/plain; charset=windows-1252
Content-Transfer-Encoding: quoted-printable
X-Gm-Message-State: ALoCoQmtFXk8SHZ9wjjoTpZYTfr0cWH3BpvmColMBb8YohF8bG7KlIgzkrcG5pk1vHbjbO7zONow
X-Virus-Checked: Checked by ClamAV on apache.org
Hi Fabio,
There are test cases in the MapReduce project releases that test
setting a custom partitioner and ensuring it works as intended.
But if you still wish to assert/assure self, you should be able to add
a LOG statement to your custom Partitioner class's initialization
methods, that may indicate its being initialized - so that you can see
it on each map task's user logs.
There are other ways as well but essentially, there is no "fallback"
partitioner in case a user-specified partitioner is not initializable
- tasks would fail if you've misconfigured the partitioner.
For counters - there are no per-partition counters at the map end
(they could end up being too many depending on the number of reducers
you have for the job) but there are per-reduce-task input record
counters in each reduce task you can use to get the count of number of
keys that came into a specific partition.
For generally testing your MR code end to end, I recommend using the
Apache MRUnit library available at http://incubator.apache.org/mrunit/
On Thu, Feb 16, 2012 at 11:19 PM, <ext-fabio.almeida@nokia.com> wrote:
> Hello All,
>
> I wrote my own partitioner and I would like to see if it=92s working.
>
> By printing the return of method getPartition I could see that the
> partitions were different, but were they really working? To answer that I
> got the keys that every reducer task processed and that was what I expect=
ed.
> It seems my partitioner is working properly. But not easy to discover
> though.
>
> Does anyone know if there is an easier way to see if your customized
> partitioner is working? For instance, a counter that shows how many
> partitioners a map generated or a reducer received?
>
> Thanks in advance,
>
> Fabio Almeida
--=20
Harsh J
Customer Ops. Engineer
Cloudera | http://tiny.cloudera.com/about
From common-dev-return-77750-apmail-hadoop-common-dev-archive=hadoop.apache.org@hadoop.apache.org Thu Feb 16 19:55:27 2012
Return-Path: <common-dev-return-77750-apmail-hadoop-common-dev-archive=hadoop.apache.org@hadoop.apache.org>
X-Original-To: apmail-hadoop-common-dev-archive@www.apache.org
Delivered-To: apmail-hadoop-common-dev-archive@www.apache.org
Received: from mail.apache.org (hermes.apache.org [140.211.11.3])
by minotaur.apache.org (Postfix) with SMTP id C11D2909B
for <apmail-hadoop-common-dev-archive@www.apache.org>; Thu, 16 Feb 2012 19:55:27 +0000 (UTC)
Received: (qmail 15703 invoked by uid 500); 16 Feb 2012 19:55:26 -0000
Delivered-To: apmail-hadoop-common-dev-archive@hadoop.apache.org
Received: (qmail 15652 invoked by uid 500); 16 Feb 2012 19:55:26 -0000
Mailing-List: contact common-dev-help@hadoop.apache.org; run by ezmlm
Precedence: bulk
List-Help: <mailto:common-dev-help@hadoop.apache.org>
List-Unsubscribe: <mailto:common-dev-unsubscribe@hadoop.apache.org>
List-Post: <mailto:common-dev@hadoop.apache.org>
List-Id: <common-dev.hadoop.apache.org>
Reply-To: common-dev@hadoop.apache.org
Delivered-To: mailing list common-dev@hadoop.apache.org
Received: (qmail 15644 invoked by uid 99); 16 Feb 2012 19:55:26 -0000
Received: from nike.apache.org (HELO nike.apache.org) (192.87.106.230)
by apache.org (qpsmtpd/0.29) with ESMTP; Thu, 16 Feb 2012 19:55:26 +0000
X-ASF-Spam-Status: No, hits=-2000.0 required=5.0
tests=ALL_TRUSTED,T_RP_MATCHES_RCVD
X-Spam-Check-By: apache.org
Received: from [140.211.11.116] (HELO hel.zones.apache.org) (140.211.11.116)
by apache.org (qpsmtpd/0.29) with ESMTP; Thu, 16 Feb 2012 19:55:20 +0000
Received: from hel.zones.apache.org (hel.zones.apache.org [140.211.11.116])
by hel.zones.apache.org (Postfix) with ESMTP id 951561BB9DE
for <common-dev@hadoop.apache.org>; Thu, 16 Feb 2012 19:54:59 +0000 (UTC)
Date: Thu, 16 Feb 2012 19:54:59 +0000 (UTC)
From: "Alejandro Abdelnur (Created) (JIRA)" <jira@apache.org>
To: common-dev@hadoop.apache.org
Message-ID: <569310697.47560.1329422099611.JavaMail.tomcat@hel.zones.apache.org>
Subject: [jira] [Created] (HADOOP-8083) javadoc generation for some modules
is not done under target/
MIME-Version: 1.0
Content-Type: text/plain; charset=utf-8
Content-Transfer-Encoding: 7bit
X-JIRA-FingerPrint: 30527f35849b9dde25b450d4833f0394
X-Virus-Checked: Checked by ClamAV on apache.org
javadoc generation for some modules is not done under target/
-------------------------------------------------------------
Key: HADOOP-8083
URL: https://issues.apache.org/jira/browse/HADOOP-8083
Project: Hadoop Common
Issue Type: Bug
Components: build
Affects Versions: 0.24.0, 0.23.2
Reporter: Alejandro Abdelnur
Assignee: Alejandro Abdelnur
Fix For: 0.23.2
Attachments: HADOOP-8083.patch
After running a clean build/dist in some modules an 'api/' directory shows up at module root level.
The javadoc plugin should be configured to work under 'target/'
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
From common-dev-return-77751-apmail-hadoop-common-dev-archive=hadoop.apache.org@hadoop.apache.org Thu Feb 16 21:25:51 2012
Return-Path: <common-dev-return-77751-apmail-hadoop-common-dev-archive=hadoop.apache.org@hadoop.apache.org>
X-Original-To: apmail-hadoop-common-dev-archive@www.apache.org
Delivered-To: apmail-hadoop-common-dev-archive@www.apache.org
Received: from mail.apache.org (hermes.apache.org [140.211.11.3])
by minotaur.apache.org (Postfix) with SMTP id D4DD39B79
for <apmail-hadoop-common-dev-archive@www.apache.org>; Thu, 16 Feb 2012 21:25:51 +0000 (UTC)
Received: (qmail 21615 invoked by uid 500); 16 Feb 2012 21:25:50 -0000
Delivered-To: apmail-hadoop-common-dev-archive@hadoop.apache.org
Received: (qmail 21556 invoked by uid 500); 16 Feb 2012 21:25:50 -0000
Mailing-List: contact common-dev-help@hadoop.apache.org; run by ezmlm
Precedence: bulk
List-Help: <mailto:common-dev-help@hadoop.apache.org>
List-Unsubscribe: <mailto:common-dev-unsubscribe@hadoop.apache.org>
List-Post: <mailto:common-dev@hadoop.apache.org>
List-Id: <common-dev.hadoop.apache.org>
Reply-To: common-dev@hadoop.apache.org
Delivered-To: mailing list common-dev@hadoop.apache.org
Received: (qmail 21548 invoked by uid 99); 16 Feb 2012 21:25:50 -0000
Received: from nike.apache.org (HELO nike.apache.org) (192.87.106.230)
by apache.org (qpsmtpd/0.29) with ESMTP; Thu, 16 Feb 2012 21:25:50 +0000
X-ASF-Spam-Status: No, hits=1.5 required=5.0
tests=HTML_MESSAGE,RCVD_IN_DNSWL_LOW,SPF_PASS
X-Spam-Check-By: apache.org
Received-SPF: pass (nike.apache.org: domain of nhatzop@gmail.com designates 209.85.160.48 as permitted sender)
Received: from [209.85.160.48] (HELO mail-pw0-f48.google.com) (209.85.160.48)
by apache.org (qpsmtpd/0.29) with ESMTP; Thu, 16 Feb 2012 21:25:42 +0000
Received: by pbcxa12 with SMTP id xa12so1452619pbc.35
for <common-dev@hadoop.apache.org>; Thu, 16 Feb 2012 13:25:21 -0800 (PST)
DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed;
d=gmail.com; s=gamma;
h=mime-version:date:message-id:subject:from:to:content-type;
bh=dlFnMwHrlP/jssm5N5MqsbeTdxrv0GvJTahvLU0zPGg=;
b=r22p1rBYzf+Uv/BMFBBlcnSLk/zxpJ8VVB85e1V+/sMPjy61teYQk/ZzqApGZM2z/c
A0OrHRe5mYfHnflc80DPYMs6yh+3gydc1+tGMdzR7xD6tqQH45X7JRzZWvZSsbLeMDAh
8vPlHulkR7wyb4kn8pKKpzaw3Ji1bKrhdt30c=
MIME-Version: 1.0
Received: by 10.68.238.136 with SMTP id vk8mr17898508pbc.14.1329427520975;
Thu, 16 Feb 2012 13:25:20 -0800 (PST)
Received: by 10.68.49.201 with HTTP; Thu, 16 Feb 2012 13:25:20 -0800 (PST)
Date: Thu, 16 Feb 2012 13:25:20 -0800
Message-ID: <CALDJGKBUGf=cSedwMA0T_y4K4rWi0cNQfX-Pd6SaGFojjff4LQ@mail.gmail.com>
Subject: FUSE compile
From: Nikolaos Hatzopoulos <nhatzop@gmail.com>
To: common-dev@hadoop.apache.org
Content-Type: multipart/alternative; boundary=047d7b33cf7824712b04b91b7769
X-Virus-Checked: Checked by ClamAV on apache.org
--047d7b33cf7824712b04b91b7769
Content-Type: text/plain; charset=ISO-8859-1
Hi People,
the secrete recipe to compile FUSE is for Centos x86_64:
I download hadoop stable: 0.20.203
compile script:
#!/bin/bash
export CFLAGS=-m64
export CXXFLAGS=-m64
ant \
-Dforrest.home=/home/arion/forrest/apache-forrest-0.9 \
-Djava5.home=/home/arion/java/jdk1.5.0_22 \
-Dfindbugs.home=/home/arion/findbugs/findbugs-2.0.0 \
-Dversion=20.203.0 \
-Dhadoop.version=20.203.0 \
-Dcompile.native=true \
-Dcompile.c++=true \
-Dlibhdfs=true \
-Dfusedfs=true \
-Dlibrecordio=true \
compile-core-native compile-c++ compile-c++-libhdfs compile-contrib
and you have to link the libraries to a directory:
cd hadoop-0.20.203.0/build/libhdfs
ln -s ../c++/Linux-amd64-64/lib/lib*
and also apply this patch because there is an error on compiling for my
version:
1267-1.patch
Index: src/contrib/fuse-dfs/src/fuse_connect.c
===================================================================
--- src/contrib/fuse-dfs/src/fuse_connect.c (revision 957810)
+++ src/contrib/fuse-dfs/src/fuse_connect.c (working copy)
@@ -37,7 +37,7 @@
return NULL;
int numgroups = 0;
char **groups = getGroups(uid, &numgroups);
- hdfsFS fs = hdfsConnectAsUser(hostname, port, user, (const char
**)groups, numgroups);
+ hdfsFS fs = hdfsConnectAsUser(hostname, port, user);
freeGroups(groups, numgroups);
if (user)
free(user);
If someone can uploaded as a documentation for FUSE I'll be glad
--Nikos Hatzopoulos
--047d7b33cf7824712b04b91b7769--
From common-dev-return-77752-apmail-hadoop-common-dev-archive=hadoop.apache.org@hadoop.apache.org Thu Feb 16 21:26:39 2012
Return-Path: <common-dev-return-77752-apmail-hadoop-common-dev-archive=hadoop.apache.org@hadoop.apache.org>
X-Original-To: apmail-hadoop-common-dev-archive@www.apache.org
Delivered-To: apmail-hadoop-common-dev-archive@www.apache.org
Received: from mail.apache.org (hermes.apache.org [140.211.11.3])
by minotaur.apache.org (Postfix) with SMTP id 560DD9FE0
for <apmail-hadoop-common-dev-archive@www.apache.org>; Thu, 16 Feb 2012 21:26:39 +0000 (UTC)
Received: (qmail 24351 invoked by uid 500); 16 Feb 2012 21:26:37 -0000
Delivered-To: apmail-hadoop-common-dev-archive@hadoop.apache.org
Received: (qmail 24268 invoked by uid 500); 16 Feb 2012 21:26:37 -0000
Mailing-List: contact common-dev-help@hadoop.apache.org; run by ezmlm
Precedence: bulk
List-Help: <mailto:common-dev-help@hadoop.apache.org>
List-Unsubscribe: <mailto:common-dev-unsubscribe@hadoop.apache.org>
List-Post: <mailto:common-dev@hadoop.apache.org>
List-Id: <common-dev.hadoop.apache.org>
Reply-To: common-dev@hadoop.apache.org
Delivered-To: mailing list common-dev@hadoop.apache.org
Received: (qmail 24259 invoked by uid 99); 16 Feb 2012 21:26:37 -0000
Received: from nike.apache.org (HELO nike.apache.org) (192.87.106.230)
by apache.org (qpsmtpd/0.29) with ESMTP; Thu, 16 Feb 2012 21:26:37 +0000
X-ASF-Spam-Status: No, hits=1.5 required=5.0
tests=HTML_MESSAGE,RCVD_IN_DNSWL_LOW,SPF_PASS
X-Spam-Check-By: apache.org
Received-SPF: pass (nike.apache.org: domain of tucu@cloudera.com designates 209.85.214.176 as permitted sender)
Received: from [209.85.214.176] (HELO mail-tul01m020-f176.google.com) (209.85.214.176)
by apache.org (qpsmtpd/0.29) with ESMTP; Thu, 16 Feb 2012 21:26:30 +0000
Received: by obbwd18 with SMTP id wd18so4997497obb.35
for <common-dev@hadoop.apache.org>; Thu, 16 Feb 2012 13:26:09 -0800 (PST)
Received: by 10.182.182.100 with SMTP id ed4mr3146755obc.24.1329427569141;
Thu, 16 Feb 2012 13:26:09 -0800 (PST)
MIME-Version: 1.0
Received: by 10.182.5.103 with HTTP; Thu, 16 Feb 2012 13:25:39 -0800 (PST)
In-Reply-To: <22102138-E9FE-4443-B0E4-153EAA3D2F47@yahoo-inc.com>
References: <CAEsa9_UnLjEPvOk3djTvE7JBFuDREubO+oTWKOnmjd=_kF16Rg@mail.gmail.com>
<CAOcnVr1uWPdG0mtaE5xKNdLz9Yy5D-Es39nw8G-FYgiayiQ2xw@mail.gmail.com>
<CADY20s7_tBrGrwLn4NwJ2A4K5MpXNEZ-nk2oZMaRvDXovFN4tA@mail.gmail.com> <22102138-E9FE-4443-B0E4-153EAA3D2F47@yahoo-inc.com>
From: Alejandro Abdelnur <tucu@cloudera.com>
Date: Thu, 16 Feb 2012 13:25:39 -0800
Message-ID: <CAJs-t7MwcyWLQw9sXF5Lz34KEWJ-4TDZF0TOyoAo7DsoANukfA@mail.gmail.com>
Subject: Re: .23 compile times
To: common-dev@hadoop.apache.org
Content-Type: multipart/alternative; boundary=14dae939965d03685404b91b7af1
X-Gm-Message-State: ALoCoQkCWI0e20dqtjM/oCHzY0fyIEbWV+jw3PJryBCnNlsDhdOciBa77SC7qQ/ZBxk2ifMCSAsb
X-Virus-Checked: Checked by ClamAV on apache.org
--14dae939965d03685404b91b7af1
Content-Type: text/plain; charset=ISO-8859-1
I've just done some tweaks in the POMs and I'm cutting the 8.30min full
dist build down to 3.45min. I'm removing all javadoc stuff from the dist
profile.
I think we should introduce a developer profile that does this.
Also, the 'mvn install -DskipTests', to get the JARs in your m2 cache is
taking 2mins. But we are building source JARs, the developer profile could
skip the generation of the source JARs, this would cut several seconds.
Finally, note that to just build all JARs 'mvn clean test -DskipTests' it
is taking 1.55mins.
If folk agree I'll open a JIRA to optmize the build based on these findings.
Thxs.
Alejandro
On Wed, Feb 15, 2012 at 1:02 PM, Daryn Sharp <daryn@yahoo-inc.com> wrote:
> Hi Sriram,
>
> You may want to try adding your source tree to Spotlight's privacy list,
> otherwise it's busy trying to index files as fast as the build is writing
> them. If you are (un)fortunate enough to be running anti-virus sw, then it
> too is scurrying along behind your build checking every file. That's
> enough to turn a normally silent MBP into a hair dryer.
>
> If you don't want to omit the entire project, because perhaps you want to
> use mdfind, then you can rename dirs to end with ".noindex". The
> trick/hack is you can symlink the original dir name to the renamed
> dir.noindex.
>
> But yes, I think the build is way to slow to be productive when used as
> intended. The fact that people have to use custom tricks to build & test
> in a "reasonable" amount of time is a symptom of a problem...
>
> Daryn
>
>
> On Feb 15, 2012, at 12:47 PM, Todd Lipcon wrote:
>
> > Hi Sriram,
> >
> > I also do -Dmaven.skip.javadoc=true usually and that cuts out a couple
> > minutes. Unless you need a tarball, you can also drop -Ptar.
> >
> > When I'm just making quick changes confined to the java code, I
> > usually just use "mvn -Dskiptests install" from within the hdfs
> > project, then manually cp the resulting
> > target/hadoop-hdfs-0.24.0-SNAPSHOT.jar into my install
> > dir/share/hadoop/hdfs. Much faster than the full rebuild.
> >
> > -Todd
> >
> > On Wed, Feb 15, 2012 at 8:52 AM, Harsh J <harsh@cloudera.com> wrote:
> >> Sriram,
> >>
> >> My package command didn't take as long with the same command -- where
> >> do you see it getting stuck at most of the times? Which particular
> >> target (right term?) seems to take the highest time to complete?
> >>
> >> On Wed, Feb 15, 2012 at 12:31 AM, Sriram Rao <sriramsrao@gmail.com>
> wrote:
> >>> Folks,
> >>>
> >>> The build takes forever:
> >>>
> >>> mvn package -Pdist -DskipTests -Dtar
> >>>
> >>> ....
> >>>
> >>> [INFO]
> >>>
> ------------------------------------------------------------------------
> >>> [INFO] BUILD SUCCESS
> >>> [INFO]
> >>>
> ------------------------------------------------------------------------
> >>> [INFO] Total time: 6:25.399s
> >>> [INFO] Finished at: Tue Feb 14 10:54:18 PST 2012
> >>> [INFO] Final Memory: 56M/123M
> >>> [INFO]
> >>>
> ------------------------------------------------------------------------
> >>>
> >>> This is on a mac with 8GB RAM. (The above case involved 0-lines of
> code
> >>> change; just making sure I had everything built!).
> >>>
> >>> Is there a faster way to get the thing to build?
> >>>
> >>> Sriram
> >>
> >>
> >>
> >> --
> >> Harsh J
> >> Customer Ops. Engineer
> >> Cloudera | http://tiny.cloudera.com/about
> >
> >
> >
> > --
> > Todd Lipcon
> > Software Engineer, Cloudera
>
>
--14dae939965d03685404b91b7af1--
From common-dev-return-77753-apmail-hadoop-common-dev-archive=hadoop.apache.org@hadoop.apache.org Thu Feb 16 22:14:41 2012
Return-Path: <common-dev-return-77753-apmail-hadoop-common-dev-archive=hadoop.apache.org@hadoop.apache.org>
X-Original-To: apmail-hadoop-common-dev-archive@www.apache.org
Delivered-To: apmail-hadoop-common-dev-archive@www.apache.org
Received: from mail.apache.org (hermes.apache.org [140.211.11.3])
by minotaur.apache.org (Postfix) with SMTP id 135B79EBC
for <apmail-hadoop-common-dev-archive@www.apache.org>; Thu, 16 Feb 2012 22:14:41 +0000 (UTC)
Received: (qmail 5838 invoked by uid 500); 16 Feb 2012 22:14:39 -0000
Delivered-To: apmail-hadoop-common-dev-archive@hadoop.apache.org
Received: (qmail 5775 invoked by uid 500); 16 Feb 2012 22:14:39 -0000
Mailing-List: contact common-dev-help@hadoop.apache.org; run by ezmlm
Precedence: bulk
List-Help: <mailto:common-dev-help@hadoop.apache.org>
List-Unsubscribe: <mailto:common-dev-unsubscribe@hadoop.apache.org>
List-Post: <mailto:common-dev@hadoop.apache.org>
List-Id: <common-dev.hadoop.apache.org>
Reply-To: common-dev@hadoop.apache.org
Delivered-To: mailing list common-dev@hadoop.apache.org
Received: (qmail 5767 invoked by uid 99); 16 Feb 2012 22:14:39 -0000
Received: from athena.apache.org (HELO athena.apache.org) (140.211.11.136)
by apache.org (qpsmtpd/0.29) with ESMTP; Thu, 16 Feb 2012 22:14:39 +0000
X-ASF-Spam-Status: No, hits=1.1 required=5.0
tests=NO_RDNS_DOTCOM_HELO,RCVD_IN_DNSWL_NONE,SPF_NEUTRAL
X-Spam-Check-By: apache.org
Received-SPF: neutral (athena.apache.org: 98.139.253.105 is neither permitted nor denied by domain of daryn@yahoo-inc.com)
Received: from [98.139.253.105] (HELO mrout2-b.corp.bf1.yahoo.com) (98.139.253.105)
by apache.org (qpsmtpd/0.29) with ESMTP; Thu, 16 Feb 2012 22:14:32 +0000
Received: from SP1-EX07CAS02.ds.corp.yahoo.com (sp1-ex07cas02.ds.corp.yahoo.com [216.252.116.138])
by mrout2-b.corp.bf1.yahoo.com (8.14.4/8.14.4/y.out) with ESMTP id q1GMDrdn097603
for <common-dev@hadoop.apache.org>; Thu, 16 Feb 2012 14:13:53 -0800 (PST)
DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/simple; d=yahoo-inc.com;
s=cobra; t=1329430433;
bh=7cOHiEqszFJQLTBjNLZSkamVh1QUCe4ypGpUHhOdyyU=;
h=From:To:Date:Subject:Message-ID:References:In-Reply-To:
Content-Type:Content-Transfer-Encoding:MIME-Version;
b=nAkBdqGHxbu4LpbaurvL1kI/aBM4brmc+u1TdNj+PI+051qETX7E/TEax2SDCQK84
mp22XmnrxgVulNQjb1AHyDQBx7M5keQ3GMqx4Q59CHpk06+ib7oabULIy4G5Odp0bp
kbBSsW2OpYuHM0JmBJc7agS4f3LfTf5MkfHjFjMY=
Received: from SP1-EX07VS02.ds.corp.yahoo.com ([216.252.116.136]) by
SP1-EX07CAS02.ds.corp.yahoo.com ([216.252.116.167]) with mapi; Thu, 16 Feb
2012 14:13:53 -0800
From: Daryn Sharp <daryn@yahoo-inc.com>
To: "common-dev@hadoop.apache.org" <common-dev@hadoop.apache.org>
Date: Thu, 16 Feb 2012 14:13:51 -0800
Subject: Re: .23 compile times
Thread-Topic: .23 compile times
Thread-Index: Aczs+ERyIdFq3f6jRraCUYYMjohumA==
Message-ID: <98E6117B-D0A1-4F57-95BC-87F504281008@yahoo-inc.com>
References: <CAEsa9_UnLjEPvOk3djTvE7JBFuDREubO+oTWKOnmjd=_kF16Rg@mail.gmail.com>
<CAOcnVr1uWPdG0mtaE5xKNdLz9Yy5D-Es39nw8G-FYgiayiQ2xw@mail.gmail.com>
<CADY20s7_tBrGrwLn4NwJ2A4K5MpXNEZ-nk2oZMaRvDXovFN4tA@mail.gmail.com>
<22102138-E9FE-4443-B0E4-153EAA3D2F47@yahoo-inc.com>
<CAJs-t7MwcyWLQw9sXF5Lz34KEWJ-4TDZF0TOyoAo7DsoANukfA@mail.gmail.com>
In-Reply-To: <CAJs-t7MwcyWLQw9sXF5Lz34KEWJ-4TDZF0TOyoAo7DsoANukfA@mail.gmail.com>
Accept-Language: en-US
Content-Language: en-US
X-MS-Has-Attach:
X-MS-TNEF-Correlator:
acceptlanguage: en-US
Content-Type: text/plain; charset="us-ascii"
Content-Transfer-Encoding: quoted-printable
MIME-Version: 1.0
Wow, nice! How long is a rebuild with no changes?
I'd be delighted if there was a dev profile that just did the bare minimum =
to produce a working env.
Daryn
On Feb 16, 2012, at 3:25 PM, Alejandro Abdelnur wrote:
> I've just done some tweaks in the POMs and I'm cutting the 8.30min full
> dist build down to 3.45min. I'm removing all javadoc stuff from the dist
> profile.
>=20
> I think we should introduce a developer profile that does this.
>=20
> Also, the 'mvn install -DskipTests', to get the JARs in your m2 cache is
> taking 2mins. But we are building source JARs, the developer profile coul=
d
> skip the generation of the source JARs, this would cut several seconds.
>=20
> Finally, note that to just build all JARs 'mvn clean test -DskipTests' it
> is taking 1.55mins.
>=20
> If folk agree I'll open a JIRA to optmize the build based on these findin=
gs.
>=20
> Thxs.
>=20
> Alejandro
>=20
> On Wed, Feb 15, 2012 at 1:02 PM, Daryn Sharp <daryn@yahoo-inc.com> wrote:
>=20
>> Hi Sriram,
>>=20
>> You may want to try adding your source tree to Spotlight's privacy list,
>> otherwise it's busy trying to index files as fast as the build is writin=
g
>> them. If you are (un)fortunate enough to be running anti-virus sw, then=
it
>> too is scurrying along behind your build checking every file. That's
>> enough to turn a normally silent MBP into a hair dryer.
>>=20
>> If you don't want to omit the entire project, because perhaps you want t=
o
>> use mdfind, then you can rename dirs to end with ".noindex". The
>> trick/hack is you can symlink the original dir name to the renamed
>> dir.noindex.
>>=20
>> But yes, I think the build is way to slow to be productive when used as
>> intended. The fact that people have to use custom tricks to build & tes=
t
>> in a "reasonable" amount of time is a symptom of a problem...
>>=20
>> Daryn
>>=20
>>=20
>> On Feb 15, 2012, at 12:47 PM, Todd Lipcon wrote:
>>=20
>>> Hi Sriram,
>>>=20
>>> I also do -Dmaven.skip.javadoc=3Dtrue usually and that cuts out a coupl=
e
>>> minutes. Unless you need a tarball, you can also drop -Ptar.
>>>=20
>>> When I'm just making quick changes confined to the java code, I
>>> usually just use "mvn -Dskiptests install" from within the hdfs
>>> project, then manually cp the resulting
>>> target/hadoop-hdfs-0.24.0-SNAPSHOT.jar into my install
>>> dir/share/hadoop/hdfs. Much faster than the full rebuild.
>>>=20
>>> -Todd
>>>=20
>>> On Wed, Feb 15, 2012 at 8:52 AM, Harsh J <harsh@cloudera.com> wrote:
>>>> Sriram,
>>>>=20
>>>> My package command didn't take as long with the same command -- where
>>>> do you see it getting stuck at most of the times? Which particular
>>>> target (right term?) seems to take the highest time to complete?
>>>>=20
>>>> On Wed, Feb 15, 2012 at 12:31 AM, Sriram Rao <sriramsrao@gmail.com>
>> wrote:
>>>>> Folks,
>>>>>=20
>>>>> The build takes forever:
>>>>>=20
>>>>> mvn package -Pdist -DskipTests -Dtar
>>>>>=20
>>>>> ....
>>>>>=20
>>>>> [INFO]
>>>>>=20
>> ------------------------------------------------------------------------
>>>>> [INFO] BUILD SUCCESS
>>>>> [INFO]
>>>>>=20
>> ------------------------------------------------------------------------
>>>>> [INFO] Total time: 6:25.399s
>>>>> [INFO] Finished at: Tue Feb 14 10:54:18 PST 2012
>>>>> [INFO] Final Memory: 56M/123M
>>>>> [INFO]
>>>>>=20
>> ------------------------------------------------------------------------
>>>>>=20
>>>>> This is on a mac with 8GB RAM. (The above case involved 0-lines of
>> code
>>>>> change; just making sure I had everything built!).
>>>>>=20
>>>>> Is there a faster way to get the thing to build?
>>>>>=20
>>>>> Sriram
>>>>=20
>>>>=20
>>>>=20
>>>> --
>>>> Harsh J
>>>> Customer Ops. Engineer
>>>> Cloudera | http://tiny.cloudera.com/about
>>>=20
>>>=20
>>>=20
>>> --
>>> Todd Lipcon
>>> Software Engineer, Cloudera
>>=20
>>=20
From common-dev-return-77754-apmail-hadoop-common-dev-archive=hadoop.apache.org@hadoop.apache.org Thu Feb 16 23:10:51 2012
Return-Path: <common-dev-return-77754-apmail-hadoop-common-dev-archive=hadoop.apache.org@hadoop.apache.org>
X-Original-To: apmail-hadoop-common-dev-archive@www.apache.org
Delivered-To: apmail-hadoop-common-dev-archive@www.apache.org
Received: from mail.apache.org (hermes.apache.org [140.211.11.3])
by minotaur.apache.org (Postfix) with SMTP id C1A2597FA
for <apmail-hadoop-common-dev-archive@www.apache.org>; Thu, 16 Feb 2012 23:10:51 +0000 (UTC)
Received: (qmail 85242 invoked by uid 500); 16 Feb 2012 23:10:50 -0000
Delivered-To: apmail-hadoop-common-dev-archive@hadoop.apache.org
Received: (qmail 85191 invoked by uid 500); 16 Feb 2012 23:10:50 -0000
Mailing-List: contact common-dev-help@hadoop.apache.org; run by ezmlm
Precedence: bulk
List-Help: <mailto:common-dev-help@hadoop.apache.org>
List-Unsubscribe: <mailto:common-dev-unsubscribe@hadoop.apache.org>
List-Post: <mailto:common-dev@hadoop.apache.org>
List-Id: <common-dev.hadoop.apache.org>
Reply-To: common-dev@hadoop.apache.org
Delivered-To: mailing list common-dev@hadoop.apache.org
Received: (qmail 85183 invoked by uid 99); 16 Feb 2012 23:10:50 -0000
Received: from athena.apache.org (HELO athena.apache.org) (140.211.11.136)
by apache.org (qpsmtpd/0.29) with ESMTP; Thu, 16 Feb 2012 23:10:50 +0000
X-ASF-Spam-Status: No, hits=-0.0 required=5.0
tests=SPF_PASS
X-Spam-Check-By: apache.org
Received-SPF: pass (athena.apache.org: domain of jayhawk@cs.ucsc.edu designates 128.114.48.32 as permitted sender)
Received: from [128.114.48.32] (HELO mail-01.cse.ucsc.edu) (128.114.48.32)
by apache.org (qpsmtpd/0.29) with ESMTP; Thu, 16 Feb 2012 23:10:42 +0000
Received: from [131.106.59.173] (205.158.58.247.ptr.us.xo.net [205.158.58.247])
by mail-01.cse.ucsc.edu (Postfix) with ESMTPSA id 9A4421009B90;
Thu, 16 Feb 2012 15:10:21 -0800 (PST)
Subject: Re: Trunk build failure
Mime-Version: 1.0 (Apple Message framework v1257)
Content-Type: text/plain; charset=us-ascii
From: Noah Watkins <jayhawk@cs.ucsc.edu>
In-Reply-To: <44A69A91-98E3-439B-ACFF-A0C02225254E@open-mpi.org>
Date: Thu, 16 Feb 2012 15:10:19 -0800
Cc: Ralph Castain <rhc@open-mpi.org>
Content-Transfer-Encoding: quoted-printable
Message-Id: <C9CBF79A-942D-4BC2-9684-03BE8BF95F33@cs.ucsc.edu>
References: <44A69A91-98E3-439B-ACFF-A0C02225254E@open-mpi.org>
To: common-dev@hadoop.apache.org
X-Mailer: Apple Mail (2.1257)
Could you try mvn -X compile? That should show the exact commands that =
are being executed which seem to be coming from =
hadoop-project-dist/pom.xml.
On Lion the following worked me:
git clone git://git.apache.org/hadoop-common.git
cd hadoop-common
mvn compile
I had a very similar error:
[ERROR] Failed to execute goal =
org.apache.maven.plugins:maven-antrun-plugin:1.6:run (compile-proto) on =
project hadoop-common: An Ant BuildException has occured: exec returned: =
127 -> [Help 1]
which was caused by a missing dependency, in this case the protocol =
buffers compiler. In your case the goal was (tar) so -X should help.
-Noah
On Feb 10, 2012, at 9:42 AM, Ralph Castain wrote:
> Hi folks
>=20
> I'm a newbie to the Hadoop code and am trying to build the svn trunk =
per instructions on the wiki and the mailing list. I'm hitting a =
failure and would appreciate any suggestions:
>=20
> main:
> [exec] tar: Failed to open =
'hadoop-project-dist-0.24.0-SNAPSHOT.tar.gz'
>=20
>=20
> It looks like this file isn't getting created, but I don't know why. I =
used the -e option for mvn, and saw this:
>=20
> [INFO] --- maven-antrun-plugin:1.6:run (pre-dist) @ =
hadoop-project-dist ---
> [INFO] Executing tasks
>=20
> main:
> [exec] ./dist-copynativelibs.sh: line 10: [: too many arguments
> [INFO] Executed tasks
> [INFO]=20
> [INFO] --- maven-assembly-plugin:2.2.1:single (dist) @ =
hadoop-project-dist ---
> [WARNING] The following patterns were never triggered in this artifact =
exclusion filter:
> o 'org.apache.ant:*:jar'
> o 'jdiff:jdiff:jar'
>=20
> [INFO] Copying files to /Volumes/Macintosh HD =
2/rhc/hadoop/svn-trunk/hadoop-project-dist/target/hadoop-project-dist-0.24=
.0-SNAPSHOT
> [INFO]=20
> [INFO] --- maven-source-plugin:2.1.2:jar-no-fork (hadoop-java-sources) =
@ hadoop-project-dist ---
> [INFO]=20
> [INFO] --- maven-enforcer-plugin:1.0:enforce (dist-enforce) @ =
hadoop-project-dist ---
> [INFO]=20
> [INFO] --- maven-site-plugin:3.0:attach-descriptor (attach-descriptor) =
@ hadoop-project-dist ---
> [INFO]=20
> [INFO] --- maven-javadoc-plugin:2.8.1:jar (module-javadocs) @ =
hadoop-project-dist ---
> [INFO] Not executing Javadoc as the project is not a Java =
classpath-capable package
> [INFO]=20
> [INFO] --- maven-antrun-plugin:1.6:run (tar) @ hadoop-project-dist ---
> [INFO] Executing tasks
>=20
> main:
> [exec] tar: Failed to open =
'hadoop-project-dist-0.24.0-SNAPSHOT.tar.gz'
>=20
>=20
> The detailed error report:
>=20
> [ERROR] Failed to execute goal =
org.apache.maven.plugins:maven-antrun-plugin:1.6:run (tar) on project =
hadoop-project-dist: An Ant BuildException has occured: exec returned: 1 =
-> [Help 1]
> org.apache.maven.lifecycle.LifecycleExecutionException: Failed to =
execute goal org.apache.maven.plugins:maven-antrun-plugin:1.6:run (tar) =
on project hadoop-project-dist: An Ant BuildException has occured: exec =
returned: 1
> at =
org.apache.maven.lifecycle.internal.MojoExecutor.execute(MojoExecutor.java=
:217)
> at =
org.apache.maven.lifecycle.internal.MojoExecutor.execute(MojoExecutor.java=
:153)
> at =
org.apache.maven.lifecycle.internal.MojoExecutor.execute(MojoExecutor.java=
:145)
> at =
org.apache.maven.lifecycle.internal.LifecycleModuleBuilder.buildProject(Li=
fecycleModuleBuilder.java:84)
> at =
org.apache.maven.lifecycle.internal.LifecycleModuleBuilder.buildProject(Li=
fecycleModuleBuilder.java:59)
> at =
org.apache.maven.lifecycle.internal.LifecycleStarter.singleThreadedBuild(L=
ifecycleStarter.java:183)
> at =
org.apache.maven.lifecycle.internal.LifecycleStarter.execute(LifecycleStar=
ter.java:161)
> at =
org.apache.maven.DefaultMaven.doExecute(DefaultMaven.java:319)
> at org.apache.maven.DefaultMaven.execute(DefaultMaven.java:156)
> at org.apache.maven.cli.MavenCli.execute(MavenCli.java:537)
> at org.apache.maven.cli.MavenCli.doMain(MavenCli.java:196)
> at org.apache.maven.cli.MavenCli.main(MavenCli.java:141)
> at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
> at =
sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:=
39)
> at =
sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorIm=
pl.java:25)
> at java.lang.reflect.Method.invoke(Method.java:597)
> at =
org.codehaus.plexus.classworlds.launcher.Launcher.launchEnhanced(Launcher.=
java:290)
> at =
org.codehaus.plexus.classworlds.launcher.Launcher.launch(Launcher.java:230=
)
> at =
org.codehaus.plexus.classworlds.launcher.Launcher.mainWithExitCode(Launche=
r.java:409)
> at =
org.codehaus.plexus.classworlds.launcher.Launcher.main(Launcher.java:352)
> Caused by: org.apache.maven.plugin.MojoExecutionException: An Ant =
BuildException has occured: exec returned: 1
> at =
org.apache.maven.plugin.antrun.AntRunMojo.execute(AntRunMojo.java:283)
> at =
org.apache.maven.plugin.DefaultBuildPluginManager.executeMojo(DefaultBuild=
PluginManager.java:101)
> at =
org.apache.maven.lifecycle.internal.MojoExecutor.execute(MojoExecutor.java=
:209)
> ... 19 more
> Caused by: /Volumes/Macintosh HD =
2/rhc/hadoop/svn-trunk/hadoop-project-dist/target/antrun/build-main.xml:12=
: exec returned: 1
> at =
org.apache.tools.ant.taskdefs.ExecTask.runExecute(ExecTask.java:650)
> at =
org.apache.tools.ant.taskdefs.ExecTask.runExec(ExecTask.java:676)
> at =
org.apache.tools.ant.taskdefs.ExecTask.execute(ExecTask.java:502)
> at =
org.apache.tools.ant.UnknownElement.execute(UnknownElement.java:291)
> at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
> at =
sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:=
39)
> at =
sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorIm=
pl.java:25)
> at java.lang.reflect.Method.invoke(Method.java:597)
> at =
org.apache.tools.ant.dispatch.DispatchUtils.execute(DispatchUtils.java:106=
)
> at org.apache.tools.ant.Task.perform(Task.java:348)
> at org.apache.tools.ant.Target.execute(Target.java:390)
> at org.apache.tools.ant.Target.performTasks(Target.java:411)
> at =
org.apache.tools.ant.Project.executeSortedTargets(Project.java:1397)
> at org.apache.tools.ant.Project.executeTarget(Project.java:1366)
> at =
org.apache.maven.plugin.antrun.AntRunMojo.execute(AntRunMojo.java:270)
> ... 21 more
> [
>=20
> Any ideas what may be going wrong? This is on Mac OSX/Lion, and the =
Maven cmd line was:
>=20
> mvn clean package -Pdist -Dtar -DskipTests -P-native
>=20
> Thanks
> Ralph
>=20
From common-dev-return-77755-apmail-hadoop-common-dev-archive=hadoop.apache.org@hadoop.apache.org Fri Feb 17 00:16:03 2012
Return-Path: <common-dev-return-77755-apmail-hadoop-common-dev-archive=hadoop.apache.org@hadoop.apache.org>
X-Original-To: apmail-hadoop-common-dev-archive@www.apache.org
Delivered-To: apmail-hadoop-common-dev-archive@www.apache.org
Received: from mail.apache.org (hermes.apache.org [140.211.11.3])
by minotaur.apache.org (Postfix) with SMTP id 941AE9CB1
for <apmail-hadoop-common-dev-archive@www.apache.org>; Fri, 17 Feb 2012 00:16:03 +0000 (UTC)
Received: (qmail 48462 invoked by uid 500); 17 Feb 2012 00:16:02 -0000
Delivered-To: apmail-hadoop-common-dev-archive@hadoop.apache.org
Received: (qmail 48408 invoked by uid 500); 17 Feb 2012 00:16:02 -0000
Mailing-List: contact common-dev-help@hadoop.apache.org; run by ezmlm
Precedence: bulk
List-Help: <mailto:common-dev-help@hadoop.apache.org>
List-Unsubscribe: <mailto:common-dev-unsubscribe@hadoop.apache.org>
List-Post: <mailto:common-dev@hadoop.apache.org>
List-Id: <common-dev.hadoop.apache.org>
Reply-To: common-dev@hadoop.apache.org
Delivered-To: mailing list common-dev@hadoop.apache.org
Received: (qmail 48400 invoked by uid 99); 17 Feb 2012 00:16:02 -0000
Received: from nike.apache.org (HELO nike.apache.org) (192.87.106.230)
by apache.org (qpsmtpd/0.29) with ESMTP; Fri, 17 Feb 2012 00:16:02 +0000
X-ASF-Spam-Status: No, hits=1.5 required=5.0
tests=HTML_MESSAGE,RCVD_IN_DNSWL_LOW,SPF_PASS
X-Spam-Check-By: apache.org
Received-SPF: pass (nike.apache.org: domain of tucu@cloudera.com designates 209.85.214.176 as permitted sender)
Received: from [209.85.214.176] (HELO mail-tul01m020-f176.google.com) (209.85.214.176)
by apache.org (qpsmtpd/0.29) with ESMTP; Fri, 17 Feb 2012 00:15:55 +0000
Received: by obbwd18 with SMTP id wd18so5278265obb.35
for <common-dev@hadoop.apache.org>; Thu, 16 Feb 2012 16:15:34 -0800 (PST)
Received: by 10.182.76.169 with SMTP id l9mr3500030obw.34.1329437734347; Thu,
16 Feb 2012 16:15:34 -0800 (PST)
MIME-Version: 1.0
Received: by 10.182.5.103 with HTTP; Thu, 16 Feb 2012 16:15:03 -0800 (PST)
In-Reply-To: <98E6117B-D0A1-4F57-95BC-87F504281008@yahoo-inc.com>
References: <CAEsa9_UnLjEPvOk3djTvE7JBFuDREubO+oTWKOnmjd=_kF16Rg@mail.gmail.com>
<CAOcnVr1uWPdG0mtaE5xKNdLz9Yy5D-Es39nw8G-FYgiayiQ2xw@mail.gmail.com>
<CADY20s7_tBrGrwLn4NwJ2A4K5MpXNEZ-nk2oZMaRvDXovFN4tA@mail.gmail.com>
<22102138-E9FE-4443-B0E4-153EAA3D2F47@yahoo-inc.com> <CAJs-t7MwcyWLQw9sXF5Lz34KEWJ-4TDZF0TOyoAo7DsoANukfA@mail.gmail.com>
<98E6117B-D0A1-4F57-95BC-87F504281008@yahoo-inc.com>
From: Alejandro Abdelnur <tucu@cloudera.com>
Date: Thu, 16 Feb 2012 16:15:03 -0800
Message-ID: <CAJs-t7Ovpb5gK-_0mSLG09evr0E9vG=jodcWFBZdYg+px4=hEw@mail.gmail.com>
Subject: Re: .23 compile times
To: common-dev@hadoop.apache.org
Content-Type: multipart/alternative; boundary=f46d0447877de824b004b91dd77d
X-Gm-Message-State: ALoCoQlVX0ozr9ymP7PdzT1thkw72EzD0/WHaBW134/knot4rMgqzPWoHu0q2qKptYZeQWdKwq/S
X-Virus-Checked: Checked by ClamAV on apache.org
--f46d0447877de824b004b91dd77d
Content-Type: text/plain; charset=ISO-8859-1
A 'mvn package -DskipTests -Pdist' (developer) with no changes takes
3.35mins
The biggest offenders are:
[INFO] Apache Hadoop Common .............................. SUCCESS [43.299s]
[INFO] Apache Hadoop HDFS ................................ SUCCESS [54.776s]
[INFO] hadoop-yarn-api ................................... SUCCESS [15.466s]
[INFO] hadoop-mapreduce .................................. SUCCESS [16.154s]
[INFO] Apache Hadoop Distributed Copy .................... SUCCESS [9.657s]
Everybody else is below 5secs
A 'mvn test -DskipTests' with no changes 1.05mins (this should go down
making the some codegen to be smart instead just compiling again)
The biggest offenders are:
[INFO] Apache Hadoop Common .............................. SUCCESS [9.121s]
[INFO] Apache Hadoop HDFS ................................ SUCCESS [20.887s]
[INFO] hadoop-yarn-api ................................... SUCCESS [6.664s]
A few 2sec modules and the rest below 1sec
Thanks.
Alejandro
On Thu, Feb 16, 2012 at 2:13 PM, Daryn Sharp <daryn@yahoo-inc.com> wrote:
> Wow, nice! How long is a rebuild with no changes?
>
> I'd be delighted if there was a dev profile that just did the bare minimum
> to produce a working env.
>
> Daryn
>
>
> On Feb 16, 2012, at 3:25 PM, Alejandro Abdelnur wrote:
>
> > I've just done some tweaks in the POMs and I'm cutting the 8.30min full
> > dist build down to 3.45min. I'm removing all javadoc stuff from the dist
> > profile.
> >
> > I think we should introduce a developer profile that does this.
> >
> > Also, the 'mvn install -DskipTests', to get the JARs in your m2 cache is
> > taking 2mins. But we are building source JARs, the developer profile
> could
> > skip the generation of the source JARs, this would cut several seconds.
> >
> > Finally, note that to just build all JARs 'mvn clean test -DskipTests' it
> > is taking 1.55mins.
> >
> > If folk agree I'll open a JIRA to optmize the build based on these
> findings.
> >
> > Thxs.
> >
> > Alejandro
> >
> > On Wed, Feb 15, 2012 at 1:02 PM, Daryn Sharp <daryn@yahoo-inc.com>
> wrote:
> >
> >> Hi Sriram,
> >>
> >> You may want to try adding your source tree to Spotlight's privacy list,
> >> otherwise it's busy trying to index files as fast as the build is
> writing
> >> them. If you are (un)fortunate enough to be running anti-virus sw,
> then it
> >> too is scurrying along behind your build checking every file. That's
> >> enough to turn a normally silent MBP into a hair dryer.
> >>
> >> If you don't want to omit the entire project, because perhaps you want
> to
> >> use mdfind, then you can rename dirs to end with ".noindex". The
> >> trick/hack is you can symlink the original dir name to the renamed
> >> dir.noindex.
> >>
> >> But yes, I think the build is way to slow to be productive when used as
> >> intended. The fact that people have to use custom tricks to build &
> test
> >> in a "reasonable" amount of time is a symptom of a problem...
> >>
> >> Daryn
> >>
> >>
> >> On Feb 15, 2012, at 12:47 PM, Todd Lipcon wrote:
> >>
> >>> Hi Sriram,
> >>>
> >>> I also do -Dmaven.skip.javadoc=true usually and that cuts out a couple
> >>> minutes. Unless you need a tarball, you can also drop -Ptar.
> >>>
> >>> When I'm just making quick changes confined to the java code, I
> >>> usually just use "mvn -Dskiptests install" from within the hdfs
> >>> project, then manually cp the resulting
> >>> target/hadoop-hdfs-0.24.0-SNAPSHOT.jar into my install
> >>> dir/share/hadoop/hdfs. Much faster than the full rebuild.
> >>>
> >>> -Todd
> >>>
> >>> On Wed, Feb 15, 2012 at 8:52 AM, Harsh J <harsh@cloudera.com> wrote:
> >>>> Sriram,
> >>>>
> >>>> My package command didn't take as long with the same command -- where
> >>>> do you see it getting stuck at most of the times? Which particular
> >>>> target (right term?) seems to take the highest time to complete?
> >>>>
> >>>> On Wed, Feb 15, 2012 at 12:31 AM, Sriram Rao <sriramsrao@gmail.com>
> >> wrote:
> >>>>> Folks,
> >>>>>
> >>>>> The build takes forever:
> >>>>>
> >>>>> mvn package -Pdist -DskipTests -Dtar
> >>>>>
> >>>>> ....
> >>>>>
> >>>>> [INFO]
> >>>>>
> >> ------------------------------------------------------------------------
> >>>>> [INFO] BUILD SUCCESS
> >>>>> [INFO]
> >>>>>
> >> ------------------------------------------------------------------------
> >>>>> [INFO] Total time: 6:25.399s
> >>>>> [INFO] Finished at: Tue Feb 14 10:54:18 PST 2012
> >>>>> [INFO] Final Memory: 56M/123M
> >>>>> [INFO]
> >>>>>
> >> ------------------------------------------------------------------------
> >>>>>
> >>>>> This is on a mac with 8GB RAM. (The above case involved 0-lines of
> >> code
> >>>>> change; just making sure I had everything built!).
> >>>>>
> >>>>> Is there a faster way to get the thing to build?
> >>>>>
> >>>>> Sriram
> >>>>
> >>>>
> >>>>
> >>>> --
> >>>> Harsh J
> >>>> Customer Ops. Engineer
> >>>> Cloudera | http://tiny.cloudera.com/about
> >>>
> >>>
> >>>
> >>> --
> >>> Todd Lipcon
> >>> Software Engineer, Cloudera
> >>
> >>
>
>
--f46d0447877de824b004b91dd77d--
From common-dev-return-77756-apmail-hadoop-common-dev-archive=hadoop.apache.org@hadoop.apache.org Fri Feb 17 01:32:27 2012
Return-Path: <common-dev-return-77756-apmail-hadoop-common-dev-archive=hadoop.apache.org@hadoop.apache.org>
X-Original-To: apmail-hadoop-common-dev-archive@www.apache.org
Delivered-To: apmail-hadoop-common-dev-archive@www.apache.org
Received: from mail.apache.org (hermes.apache.org [140.211.11.3])
by minotaur.apache.org (Postfix) with SMTP id 2A60999B8
for <apmail-hadoop-common-dev-archive@www.apache.org>; Fri, 17 Feb 2012 01:32:27 +0000 (UTC)
Received: (qmail 26148 invoked by uid 500); 17 Feb 2012 01:32:25 -0000
Delivered-To: apmail-hadoop-common-dev-archive@hadoop.apache.org
Received: (qmail 26078 invoked by uid 500); 17 Feb 2012 01:32:25 -0000
Mailing-List: contact common-dev-help@hadoop.apache.org; run by ezmlm
Precedence: bulk
List-Help: <mailto:common-dev-help@hadoop.apache.org>
List-Unsubscribe: <mailto:common-dev-unsubscribe@hadoop.apache.org>
List-Post: <mailto:common-dev@hadoop.apache.org>
List-Id: <common-dev.hadoop.apache.org>
Reply-To: common-dev@hadoop.apache.org
Delivered-To: mailing list common-dev@hadoop.apache.org
Received: (qmail 26064 invoked by uid 99); 17 Feb 2012 01:32:25 -0000
Received: from athena.apache.org (HELO athena.apache.org) (140.211.11.136)
by apache.org (qpsmtpd/0.29) with ESMTP; Fri, 17 Feb 2012 01:32:25 +0000
X-ASF-Spam-Status: No, hits=-2000.0 required=5.0
tests=ALL_TRUSTED,T_RP_MATCHES_RCVD
X-Spam-Check-By: apache.org
Received: from [140.211.11.116] (HELO hel.zones.apache.org) (140.211.11.116)
by apache.org (qpsmtpd/0.29) with ESMTP; Fri, 17 Feb 2012 01:32:20 +0000
Received: from hel.zones.apache.org (hel.zones.apache.org [140.211.11.116])
by hel.zones.apache.org (Postfix) with ESMTP id DA5C41BBA3D
for <common-dev@hadoop.apache.org>; Fri, 17 Feb 2012 01:32:00 +0000 (UTC)
Date: Fri, 17 Feb 2012 01:32:00 +0000 (UTC)
From: "Devaraj Das (Created) (JIRA)" <jira@apache.org>
To: common-dev@hadoop.apache.org
Message-ID: <1933737736.49202.1329442320895.JavaMail.tomcat@hel.zones.apache.org>
Subject: [jira] [Created] (HADOOP-8084) Protobuf RPC engine can be optimized
to not do copying for the RPC request/response
MIME-Version: 1.0
Content-Type: text/plain; charset=utf-8
Content-Transfer-Encoding: 7bit
X-JIRA-FingerPrint: 30527f35849b9dde25b450d4833f0394
Protobuf RPC engine can be optimized to not do copying for the RPC request/response
-----------------------------------------------------------------------------------
Key: HADOOP-8084
URL: https://issues.apache.org/jira/browse/HADOOP-8084
Project: Hadoop Common
Issue Type: Improvement
Reporter: Devaraj Das
Assignee: Devaraj Das
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
From common-dev-return-77757-apmail-hadoop-common-dev-archive=hadoop.apache.org@hadoop.apache.org Fri Feb 17 09:21:22 2012
Return-Path: <common-dev-return-77757-apmail-hadoop-common-dev-archive=hadoop.apache.org@hadoop.apache.org>
X-Original-To: apmail-hadoop-common-dev-archive@www.apache.org
Delivered-To: apmail-hadoop-common-dev-archive@www.apache.org
Received: from mail.apache.org (hermes.apache.org [140.211.11.3])
by minotaur.apache.org (Postfix) with SMTP id 556BC91A6
for <apmail-hadoop-common-dev-archive@www.apache.org>; Fri, 17 Feb 2012 09:21:22 +0000 (UTC)
Received: (qmail 40728 invoked by uid 500); 17 Feb 2012 09:21:20 -0000
Delivered-To: apmail-hadoop-common-dev-archive@hadoop.apache.org
Received: (qmail 40630 invoked by uid 500); 17 Feb 2012 09:21:19 -0000
Mailing-List: contact common-dev-help@hadoop.apache.org; run by ezmlm
Precedence: bulk
List-Help: <mailto:common-dev-help@hadoop.apache.org>
List-Unsubscribe: <mailto:common-dev-unsubscribe@hadoop.apache.org>
List-Post: <mailto:common-dev@hadoop.apache.org>
List-Id: <common-dev.hadoop.apache.org>
Reply-To: common-dev@hadoop.apache.org
Delivered-To: mailing list common-dev@hadoop.apache.org
Received: (qmail 40608 invoked by uid 99); 17 Feb 2012 09:21:19 -0000
Received: from athena.apache.org (HELO athena.apache.org) (140.211.11.136)
by apache.org (qpsmtpd/0.29) with ESMTP; Fri, 17 Feb 2012 09:21:19 +0000
X-ASF-Spam-Status: No, hits=-2000.0 required=5.0
tests=ALL_TRUSTED
X-Spam-Check-By: apache.org
Received: from [140.211.11.8] (HELO aegis.apache.org) (140.211.11.8)
by apache.org (qpsmtpd/0.29) with ESMTP; Fri, 17 Feb 2012 09:21:18 +0000
Received: from aegis (localhost [127.0.0.1])
by aegis.apache.org (Postfix) with ESMTP id E274AC00E8
for <common-dev@hadoop.apache.org>; Fri, 17 Feb 2012 09:20:57 +0000 (UTC)
Date: Fri, 17 Feb 2012 09:20:57 +0000 (UTC)
From: Apache Jenkins Server <jenkins@builds.apache.org>
To: common-dev@hadoop.apache.org
Message-ID: <1452484829.1231329470457919.JavaMail.hudson@aegis>
In-Reply-To: <1401094400.111329383816865.JavaMail.hudson@aegis>
References: <1401094400.111329383816865.JavaMail.hudson@aegis>
Subject: Jenkins build is back to normal : Hadoop-Common-0.23-Build #166
MIME-Version: 1.0
Content-Type: text/plain; charset=UTF-8
Content-Transfer-Encoding: 7bit
X-Jenkins-Job: Hadoop-Common-0.23-Build
X-Jenkins-Result: SUCCESS
See <https://builds.apache.org/job/Hadoop-Common-0.23-Build/166/changes>
From common-dev-return-77758-apmail-hadoop-common-dev-archive=hadoop.apache.org@hadoop.apache.org Fri Feb 17 09:27:05 2012
Return-Path: <common-dev-return-77758-apmail-hadoop-common-dev-archive=hadoop.apache.org@hadoop.apache.org>
X-Original-To: apmail-hadoop-common-dev-archive@www.apache.org
Delivered-To: apmail-hadoop-common-dev-archive@www.apache.org
Received: from mail.apache.org (hermes.apache.org [140.211.11.3])
by minotaur.apache.org (Postfix) with SMTP id 949B296B2
for <apmail-hadoop-common-dev-archive@www.apache.org>; Fri, 17 Feb 2012 09:27:05 +0000 (UTC)
Received: (qmail 58786 invoked by uid 500); 17 Feb 2012 09:27:04 -0000
Delivered-To: apmail-hadoop-common-dev-archive@hadoop.apache.org
Received: (qmail 58682 invoked by uid 500); 17 Feb 2012 09:27:04 -0000
Mailing-List: contact common-dev-help@hadoop.apache.org; run by ezmlm
Precedence: bulk
List-Help: <mailto:common-dev-help@hadoop.apache.org>
List-Unsubscribe: <mailto:common-dev-unsubscribe@hadoop.apache.org>
List-Post: <mailto:common-dev@hadoop.apache.org>
List-Id: <common-dev.hadoop.apache.org>
Reply-To: common-dev@hadoop.apache.org
Delivered-To: mailing list common-dev@hadoop.apache.org
Received: (qmail 58674 invoked by uid 99); 17 Feb 2012 09:27:04 -0000
Received: from athena.apache.org (HELO athena.apache.org) (140.211.11.136)
by apache.org (qpsmtpd/0.29) with ESMTP; Fri, 17 Feb 2012 09:27:04 +0000
X-ASF-Spam-Status: No, hits=-2000.0 required=5.0
tests=ALL_TRUSTED
X-Spam-Check-By: apache.org
Received: from [140.211.11.8] (HELO aegis.apache.org) (140.211.11.8)
by apache.org (qpsmtpd/0.29) with ESMTP; Fri, 17 Feb 2012 09:27:03 +0000
Received: from aegis (localhost [127.0.0.1])
by aegis.apache.org (Postfix) with ESMTP id 36AF7C00E8
for <common-dev@hadoop.apache.org>; Fri, 17 Feb 2012 09:26:43 +0000 (UTC)
Date: Fri, 17 Feb 2012 09:26:43 +0000 (UTC)
From: Apache Jenkins Server <jenkins@builds.apache.org>
To: common-dev@hadoop.apache.org
Message-ID: <761298178.1251329470803221.JavaMail.hudson@aegis>
In-Reply-To: <704252474.141329384141339.JavaMail.hudson@aegis>
References: <704252474.141329384141339.JavaMail.hudson@aegis>
Subject: Jenkins build is back to normal : Hadoop-Common-trunk #320
MIME-Version: 1.0
Content-Type: text/plain; charset=UTF-8
Content-Transfer-Encoding: 7bit
X-Jenkins-Job: Hadoop-Common-trunk
X-Jenkins-Result: SUCCESS
See <https://builds.apache.org/job/Hadoop-Common-trunk/320/changes>
From common-dev-return-77759-apmail-hadoop-common-dev-archive=hadoop.apache.org@hadoop.apache.org Fri Feb 17 10:01:43 2012
Return-Path: <common-dev-return-77759-apmail-hadoop-common-dev-archive=hadoop.apache.org@hadoop.apache.org>
X-Original-To: apmail-hadoop-common-dev-archive@www.apache.org
Delivered-To: apmail-hadoop-common-dev-archive@www.apache.org
Received: from mail.apache.org (hermes.apache.org [140.211.11.3])
by minotaur.apache.org (Postfix) with SMTP id 0E22B97BB
for <apmail-hadoop-common-dev-archive@www.apache.org>; Fri, 17 Feb 2012 10:01:43 +0000 (UTC)
Received: (qmail 52206 invoked by uid 500); 17 Feb 2012 10:01:41 -0000
Delivered-To: apmail-hadoop-common-dev-archive@hadoop.apache.org
Received: (qmail 52112 invoked by uid 500); 17 Feb 2012 10:01:41 -0000
Mailing-List: contact common-dev-help@hadoop.apache.org; run by ezmlm
Precedence: bulk
List-Help: <mailto:common-dev-help@hadoop.apache.org>
List-Unsubscribe: <mailto:common-dev-unsubscribe@hadoop.apache.org>
List-Post: <mailto:common-dev@hadoop.apache.org>
List-Id: <common-dev.hadoop.apache.org>
Reply-To: common-dev@hadoop.apache.org
Delivered-To: mailing list common-dev@hadoop.apache.org
Received: (qmail 52102 invoked by uid 99); 17 Feb 2012 10:01:41 -0000
Received: from athena.apache.org (HELO athena.apache.org) (140.211.11.136)
by apache.org (qpsmtpd/0.29) with ESMTP; Fri, 17 Feb 2012 10:01:41 +0000
X-ASF-Spam-Status: No, hits=-0.7 required=5.0
tests=RCVD_IN_DNSWL_LOW,SPF_PASS
X-Spam-Check-By: apache.org
Received-SPF: pass (athena.apache.org: domain of fabio.pitzolu@gmail.com designates 209.85.215.176 as permitted sender)
Received: from [209.85.215.176] (HELO mail-ey0-f176.google.com) (209.85.215.176)
by apache.org (qpsmtpd/0.29) with ESMTP; Fri, 17 Feb 2012 10:01:33 +0000
Received: by eaai11 with SMTP id i11so1374153eaa.35
for <common-dev@hadoop.apache.org>; Fri, 17 Feb 2012 02:01:12 -0800 (PST)
DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed;
d=gmail.com; s=gamma;
h=from:content-type:content-transfer-encoding:subject:date:message-id
:to:mime-version:x-mailer;
bh=SxbGPxOEpCLChUZGKx2X8hUrDIEAY6k0omwVBTNT2ng=;
b=qxqwQ6w18Tb/85umHo/FB7+RiyyDs1pJcceJFpQ/F8sUtwKCwDdDfq8pFx8Qi1yf4w
OyOVBEwbx820eUDkKOsd/E8aAaKiJotR4QpzE5YDb0EbRWszg1uPlIIsuNYedlxfFJWY
7Tn0YdsSIPJg4wfCfDknec/nHL5jc8+yI7DEs=
Received: by 10.14.28.134 with SMTP id g6mr3514940eea.15.1329472872240;
Fri, 17 Feb 2012 02:01:12 -0800 (PST)
Received: from 1-167-191-121.dynamic.hinet.net ([94.161.242.54])
by mx.google.com with ESMTPS id n17sm36779591eei.3.2012.02.17.02.01.09
(version=TLSv1/SSLv3 cipher=OTHER);
Fri, 17 Feb 2012 02:01:11 -0800 (PST)
From: fabio.pitzolu@gmail.com
Content-Type: text/plain; charset=us-ascii
Content-Transfer-Encoding: quoted-printable
Subject: Building Hadoop UI
Date: Fri, 17 Feb 2012 11:01:03 +0100
Message-Id: <BD34C036-EC9F-41A2-9A52-70745DE0BFB6@gmail.com>
To: common-dev@hadoop.apache.org
Mime-Version: 1.0 (Apple Message framework v1257)
X-Mailer: Apple Mail (2.1257)
Hello everyone,
in order to provide our clients a custom UI for their MapReduce jobs and =
HDFS files, what is the best solution to create a web-based UI for =
Hadoop?
We are not going to use Cloudera HUE, we need something more =
user-friendly and shaped for our clients needs.
Thanks,
Fabio Pitzolu=
From common-dev-return-77760-apmail-hadoop-common-dev-archive=hadoop.apache.org@hadoop.apache.org Fri Feb 17 14:07:47 2012
Return-Path: <common-dev-return-77760-apmail-hadoop-common-dev-archive=hadoop.apache.org@hadoop.apache.org>
X-Original-To: apmail-hadoop-common-dev-archive@www.apache.org
Delivered-To: apmail-hadoop-common-dev-archive@www.apache.org
Received: from mail.apache.org (hermes.apache.org [140.211.11.3])
by minotaur.apache.org (Postfix) with SMTP id AE2939E18
for <apmail-hadoop-common-dev-archive@www.apache.org>; Fri, 17 Feb 2012 14:07:47 +0000 (UTC)
Received: (qmail 56862 invoked by uid 500); 17 Feb 2012 14:07:46 -0000
Delivered-To: apmail-hadoop-common-dev-archive@hadoop.apache.org
Received: (qmail 56812 invoked by uid 500); 17 Feb 2012 14:07:46 -0000
Mailing-List: contact common-dev-help@hadoop.apache.org; run by ezmlm
Precedence: bulk
List-Help: <mailto:common-dev-help@hadoop.apache.org>
List-Unsubscribe: <mailto:common-dev-unsubscribe@hadoop.apache.org>
List-Post: <mailto:common-dev@hadoop.apache.org>
List-Id: <common-dev.hadoop.apache.org>
Reply-To: common-dev@hadoop.apache.org
Delivered-To: mailing list common-dev@hadoop.apache.org
Received: (qmail 56803 invoked by uid 99); 17 Feb 2012 14:07:46 -0000
Received: from nike.apache.org (HELO nike.apache.org) (192.87.106.230)
by apache.org (qpsmtpd/0.29) with ESMTP; Fri, 17 Feb 2012 14:07:46 +0000
X-ASF-Spam-Status: No, hits=-0.7 required=5.0
tests=RCVD_IN_DNSWL_LOW,SPF_PASS
X-Spam-Check-By: apache.org
Received-SPF: pass (nike.apache.org: domain of harsh@cloudera.com designates 209.85.210.48 as permitted sender)
Received: from [209.85.210.48] (HELO mail-pz0-f48.google.com) (209.85.210.48)
by apache.org (qpsmtpd/0.29) with ESMTP; Fri, 17 Feb 2012 14:07:40 +0000
Received: by dadp13 with SMTP id p13so3941443dad.35
for <common-dev@hadoop.apache.org>; Fri, 17 Feb 2012 06:07:19 -0800 (PST)
Received: by 10.68.240.164 with SMTP id wb4mr24548456pbc.57.1329487639116;
Fri, 17 Feb 2012 06:07:19 -0800 (PST)
MIME-Version: 1.0
Received: by 10.68.13.69 with HTTP; Fri, 17 Feb 2012 06:06:59 -0800 (PST)
In-Reply-To: <BD34C036-EC9F-41A2-9A52-70745DE0BFB6@gmail.com>
References: <BD34C036-EC9F-41A2-9A52-70745DE0BFB6@gmail.com>
From: Harsh J <harsh@cloudera.com>
Date: Fri, 17 Feb 2012 19:36:59 +0530
Message-ID: <CAOcnVr0usYnrRqtGGvadDDBBRzW=zBe_FNTGxoMfh_yE2_xU=A@mail.gmail.com>
Subject: Re: Building Hadoop UI
To: common-dev@hadoop.apache.org
Content-Type: text/plain; charset=ISO-8859-1
X-Gm-Message-State: ALoCoQnOiPDBC4CPAhxlVSr+DYVVlNlJzUIVtRD6AFoaCBBew9U9YhUTbnz6a9e93jM2q0d2oD//
X-Virus-Checked: Checked by ClamAV on apache.org
Hi Fabio,
Hue is OSS and ASL-ed, and you can re-use the thrift bindings it uses
to communicate with the various daemons via plugins, and then feed
information into its UIs.
I do think you can easily separate out the desktop UI and the backend
(thrift binding) parts, and plug in your own UI layers if you
absolutely need to do that. If you are still interested in doing that,
you are welcome to ask your questions at
https://groups.google.com/a/cloudera.org/group/hue-dev lists. The hue
community also welcomes any feedback you may have that can help
improve Hue to address your issues.
But to answer your specific question, you essentially would need to
load a plugin at each daemon that you can communicate to, and your UI
project should use the plugin to fetch what it needs. This is how HUE
does it and the sources are all at http://github.com/cloudera/hue
Note: Hue is undergoing a look and feel change (and ditching the
desktop model, which may be the pain for you here?), which you may
want to check further at
https://groups.google.com/a/cloudera.org/group/hue-user/browse_thread/thread/cea3cf743d230d9d#
-- This work is already available in the hue2 git branch for
testing/consumption.
On Fri, Feb 17, 2012 at 3:31 PM, <fabio.pitzolu@gmail.com> wrote:
> Hello everyone,
>
> in order to provide our clients a custom UI for their MapReduce jobs and HDFS files, what is the best solution to create a web-based UI for Hadoop?
> We are not going to use Cloudera HUE, we need something more user-friendly and shaped for our clients needs.
>
> Thanks,
>
> Fabio Pitzolu
--
Harsh J
Customer Ops. Engineer
Cloudera | http://tiny.cloudera.com/about
From common-dev-return-77761-apmail-hadoop-common-dev-archive=hadoop.apache.org@hadoop.apache.org Fri Feb 17 14:17:07 2012
Return-Path: <common-dev-return-77761-apmail-hadoop-common-dev-archive=hadoop.apache.org@hadoop.apache.org>
X-Original-To: apmail-hadoop-common-dev-archive@www.apache.org
Delivered-To: apmail-hadoop-common-dev-archive@www.apache.org
Received: from mail.apache.org (hermes.apache.org [140.211.11.3])
by minotaur.apache.org (Postfix) with SMTP id 4074A9231
for <apmail-hadoop-common-dev-archive@www.apache.org>; Fri, 17 Feb 2012 14:17:07 +0000 (UTC)
Received: (qmail 90924 invoked by uid 500); 17 Feb 2012 14:17:05 -0000
Delivered-To: apmail-hadoop-common-dev-archive@hadoop.apache.org
Received: (qmail 90860 invoked by uid 500); 17 Feb 2012 14:17:05 -0000
Mailing-List: contact common-dev-help@hadoop.apache.org; run by ezmlm
Precedence: bulk
List-Help: <mailto:common-dev-help@hadoop.apache.org>
List-Unsubscribe: <mailto:common-dev-unsubscribe@hadoop.apache.org>
List-Post: <mailto:common-dev@hadoop.apache.org>
List-Id: <common-dev.hadoop.apache.org>
Reply-To: common-dev@hadoop.apache.org
Delivered-To: mailing list common-dev@hadoop.apache.org
Received: (qmail 90851 invoked by uid 99); 17 Feb 2012 14:17:05 -0000
Received: from nike.apache.org (HELO nike.apache.org) (192.87.106.230)
by apache.org (qpsmtpd/0.29) with ESMTP; Fri, 17 Feb 2012 14:17:05 +0000
X-ASF-Spam-Status: No, hits=2.2 required=5.0
tests=HTML_MESSAGE,RCVD_IN_DNSWL_LOW,SPF_NEUTRAL
X-Spam-Check-By: apache.org
Received-SPF: neutral (nike.apache.org: local policy)
Received: from [209.85.160.48] (HELO mail-pw0-f48.google.com) (209.85.160.48)
by apache.org (qpsmtpd/0.29) with ESMTP; Fri, 17 Feb 2012 14:16:57 +0000
Received: by pbcxa12 with SMTP id xa12so2409753pbc.35
for <common-dev@hadoop.apache.org>; Fri, 17 Feb 2012 06:16:35 -0800 (PST)
Received: by 10.68.196.199 with SMTP id io7mr24556879pbc.113.1329488195929;
Fri, 17 Feb 2012 06:16:35 -0800 (PST)
Received: from [192.168.1.4] ([122.167.21.211])
by mx.google.com with ESMTPS id f5sm5279532pbe.26.2012.02.17.06.16.32
(version=TLSv1/SSLv3 cipher=OTHER);
Fri, 17 Feb 2012 06:16:34 -0800 (PST)
From: Arun C Murthy <acm@hortonworks.com>
Mime-Version: 1.0 (Apple Message framework v1084)
Content-Type: multipart/alternative; boundary=Apple-Mail-38--1006330864
Subject: Re: Building Hadoop UI
Date: Fri, 17 Feb 2012 06:16:27 -0800
In-Reply-To: <BD34C036-EC9F-41A2-9A52-70745DE0BFB6@gmail.com>
To: common-dev@hadoop.apache.org
References: <BD34C036-EC9F-41A2-9A52-70745DE0BFB6@gmail.com>
Message-Id: <EE2C472A-BA22-4DF5-A326-C004EB927A22@hortonworks.com>
X-Mailer: Apple Mail (2.1084)
X-Gm-Message-State: ALoCoQmn7AfgHxsEa9ODnJz4cFmTXq0RJJ3F+lclNtj6E1FGvu7WTqfqt5MqZy9lTWNb5R1X3x34
X-Virus-Checked: Checked by ClamAV on apache.org
--Apple-Mail-38--1006330864
Content-Transfer-Encoding: quoted-printable
Content-Type: text/plain;
charset=us-ascii
You might want to get involved in Apache Ambari:
http://incubator.apache.org/ambari/
Ambari aims to provide install, configuration and management (including =
dashboards etc.).
For what you are looking for, Ambari uses metrics from various projects =
in Hadoop ecosystem (hadoop, hbase etc.) to draw dashboard UI etc., it =
might be something useful for you.
Arun
On Feb 17, 2012, at 2:01 AM, fabio.pitzolu@gmail.com wrote:
> Hello everyone,
>=20
> in order to provide our clients a custom UI for their MapReduce jobs =
and HDFS files, what is the best solution to create a web-based UI for =
Hadoop?
> We are not going to use Cloudera HUE, we need something more =
user-friendly and shaped for our clients needs.
>=20
> Thanks,
>=20
> Fabio Pitzolu
--
Arun C. Murthy
Hortonworks Inc.
http://hortonworks.com/
--Apple-Mail-38--1006330864--
From common-dev-return-77762-apmail-hadoop-common-dev-archive=hadoop.apache.org@hadoop.apache.org Fri Feb 17 15:04:20 2012
Return-Path: <common-dev-return-77762-apmail-hadoop-common-dev-archive=hadoop.apache.org@hadoop.apache.org>
X-Original-To: apmail-hadoop-common-dev-archive@www.apache.org
Delivered-To: apmail-hadoop-common-dev-archive@www.apache.org
Received: from mail.apache.org (hermes.apache.org [140.211.11.3])
by minotaur.apache.org (Postfix) with SMTP id 232C89211
for <apmail-hadoop-common-dev-archive@www.apache.org>; Fri, 17 Feb 2012 15:04:20 +0000 (UTC)
Received: (qmail 16642 invoked by uid 500); 17 Feb 2012 15:04:18 -0000
Delivered-To: apmail-hadoop-common-dev-archive@hadoop.apache.org
Received: (qmail 16567 invoked by uid 500); 17 Feb 2012 15:04:18 -0000
Mailing-List: contact common-dev-help@hadoop.apache.org; run by ezmlm
Precedence: bulk
List-Help: <mailto:common-dev-help@hadoop.apache.org>
List-Unsubscribe: <mailto:common-dev-unsubscribe@hadoop.apache.org>
List-Post: <mailto:common-dev@hadoop.apache.org>
List-Id: <common-dev.hadoop.apache.org>
Reply-To: common-dev@hadoop.apache.org
Delivered-To: mailing list common-dev@hadoop.apache.org
Received: (qmail 16559 invoked by uid 99); 17 Feb 2012 15:04:18 -0000
Received: from nike.apache.org (HELO nike.apache.org) (192.87.106.230)
by apache.org (qpsmtpd/0.29) with ESMTP; Fri, 17 Feb 2012 15:04:18 +0000
X-ASF-Spam-Status: No, hits=0.4 required=5.0
tests=NO_RDNS_DOTCOM_HELO,RCVD_IN_DNSWL_LOW,SPF_NEUTRAL
X-Spam-Check-By: apache.org
Received-SPF: neutral (nike.apache.org: 216.145.54.173 is neither permitted nor denied by domain of daryn@yahoo-inc.com)
Received: from [216.145.54.173] (HELO mrout3.yahoo.com) (216.145.54.173)
by apache.org (qpsmtpd/0.29) with ESMTP; Fri, 17 Feb 2012 15:04:10 +0000
Received: from SP1-EX07CAS04.ds.corp.yahoo.com (sp1-ex07cas04.corp.sp1.yahoo.com [216.252.116.155])
by mrout3.yahoo.com (8.14.4/8.14.4/y.out) with ESMTP id q1HF3C24062696
for <common-dev@hadoop.apache.org>; Fri, 17 Feb 2012 07:03:12 -0800 (PST)
DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/simple; d=yahoo-inc.com;
s=cobra; t=1329490993;
bh=3rMQK9sdlf6D50Nqcul1XqtTUuF6NG/zdAeh1/LWxt8=;
h=From:To:Date:Subject:Message-ID:References:In-Reply-To:
Content-Type:Content-Transfer-Encoding:MIME-Version;
b=hdqkY8pMqwM3RlEhi1S32fMCfvgotEhS3zS4gNURicqreVpWY3W0tB/12t34Fyocc
dM8QOC5qiAjSdstbMVOA19zY1E1xotrmFTon/fV8kWfNVmo44kRO+40eL8sVyQg8r8
EpULqmnrGWug6HZ2gmEB5Ham7ltO7Zyo4JOAQCf0=
Received: from SP1-EX07VS02.ds.corp.yahoo.com ([216.252.116.136]) by
SP1-EX07CAS04.ds.corp.yahoo.com ([216.252.116.155]) with mapi; Fri, 17 Feb
2012 09:03:12 -0600
From: Daryn Sharp <daryn@yahoo-inc.com>
To: "common-dev@hadoop.apache.org" <common-dev@hadoop.apache.org>
Date: Fri, 17 Feb 2012 09:03:11 -0600
Subject: Re: .23 compile times
Thread-Topic: .23 compile times
Thread-Index: AczthUT3kK3TbYfoQSefn6ZF0FbIzQ==
Message-ID: <9418257B-EFFC-489C-BD19-CB4F2EC56AAC@yahoo-inc.com>
References: <CAEsa9_UnLjEPvOk3djTvE7JBFuDREubO+oTWKOnmjd=_kF16Rg@mail.gmail.com>
<CAOcnVr1uWPdG0mtaE5xKNdLz9Yy5D-Es39nw8G-FYgiayiQ2xw@mail.gmail.com>
<CADY20s7_tBrGrwLn4NwJ2A4K5MpXNEZ-nk2oZMaRvDXovFN4tA@mail.gmail.com>
<22102138-E9FE-4443-B0E4-153EAA3D2F47@yahoo-inc.com>
<CAJs-t7MwcyWLQw9sXF5Lz34KEWJ-4TDZF0TOyoAo7DsoANukfA@mail.gmail.com>
<98E6117B-D0A1-4F57-95BC-87F504281008@yahoo-inc.com>
<CAJs-t7Ovpb5gK-_0mSLG09evr0E9vG=jodcWFBZdYg+px4=hEw@mail.gmail.com>
In-Reply-To: <CAJs-t7Ovpb5gK-_0mSLG09evr0E9vG=jodcWFBZdYg+px4=hEw@mail.gmail.com>
Accept-Language: en-US
Content-Language: en-US
X-MS-Has-Attach:
X-MS-TNEF-Correlator:
acceptlanguage: en-US
Content-Type: text/plain; charset="us-ascii"
Content-Transfer-Encoding: quoted-printable
MIME-Version: 1.0
X-Virus-Checked: Checked by ClamAV on apache.org
Very nice improvement! How long is "mvn install -DskipTests -Dmaven.javado=
c.skip"? Assuming that's fast, is there possibly a way to allow hadoop to =
run out of the checkedout tree? Maybe through the CLASSPATH, or by subproj=
ects copying the built jars into the dist area? The ideal would be to run =
a full maven build, followed by just a mvn build within a specific subproje=
ct.
Daryn
On Feb 16, 2012, at 6:15 PM, Alejandro Abdelnur wrote:
> A 'mvn package -DskipTests -Pdist' (developer) with no changes takes
> 3.35mins
>=20
> The biggest offenders are:
>=20
> [INFO] Apache Hadoop Common .............................. SUCCESS [43.29=
9s]
> [INFO] Apache Hadoop HDFS ................................ SUCCESS [54.77=
6s]
> [INFO] hadoop-yarn-api ................................... SUCCESS [15.46=
6s]
> [INFO] hadoop-mapreduce .................................. SUCCESS [16.15=
4s]
> [INFO] Apache Hadoop Distributed Copy .................... SUCCESS [9.657=
s]
>=20
> Everybody else is below 5secs
>=20
> A 'mvn test -DskipTests' with no changes 1.05mins (this should go down
> making the some codegen to be smart instead just compiling again)
>=20
> The biggest offenders are:
>=20
> [INFO] Apache Hadoop Common .............................. SUCCESS [9.121=
s]
> [INFO] Apache Hadoop HDFS ................................ SUCCESS [20.88=
7s]
> [INFO] hadoop-yarn-api ................................... SUCCESS [6.664=
s]
>=20
> A few 2sec modules and the rest below 1sec
>=20
> Thanks.
>=20
> Alejandro
>=20
>=20
> On Thu, Feb 16, 2012 at 2:13 PM, Daryn Sharp <daryn@yahoo-inc.com> wrote:
>=20
>> Wow, nice! How long is a rebuild with no changes?
>>=20
>> I'd be delighted if there was a dev profile that just did the bare minim=
um
>> to produce a working env.
>>=20
>> Daryn
>>=20
>>=20
>> On Feb 16, 2012, at 3:25 PM, Alejandro Abdelnur wrote:
>>=20
>>> I've just done some tweaks in the POMs and I'm cutting the 8.30min full
>>> dist build down to 3.45min. I'm removing all javadoc stuff from the dis=
t
>>> profile.
>>>=20
>>> I think we should introduce a developer profile that does this.
>>>=20
>>> Also, the 'mvn install -DskipTests', to get the JARs in your m2 cache i=
s
>>> taking 2mins. But we are building source JARs, the developer profile
>> could
>>> skip the generation of the source JARs, this would cut several seconds.
>>>=20
>>> Finally, note that to just build all JARs 'mvn clean test -DskipTests' =
it
>>> is taking 1.55mins.
>>>=20
>>> If folk agree I'll open a JIRA to optmize the build based on these
>> findings.
>>>=20
>>> Thxs.
>>>=20
>>> Alejandro
>>>=20
>>> On Wed, Feb 15, 2012 at 1:02 PM, Daryn Sharp <daryn@yahoo-inc.com>
>> wrote:
>>>=20
>>>> Hi Sriram,
>>>>=20
>>>> You may want to try adding your source tree to Spotlight's privacy lis=
t,
>>>> otherwise it's busy trying to index files as fast as the build is
>> writing
>>>> them. If you are (un)fortunate enough to be running anti-virus sw,
>> then it
>>>> too is scurrying along behind your build checking every file. That's
>>>> enough to turn a normally silent MBP into a hair dryer.
>>>>=20
>>>> If you don't want to omit the entire project, because perhaps you want
>> to
>>>> use mdfind, then you can rename dirs to end with ".noindex". The
>>>> trick/hack is you can symlink the original dir name to the renamed
>>>> dir.noindex.
>>>>=20
>>>> But yes, I think the build is way to slow to be productive when used a=
s
>>>> intended. The fact that people have to use custom tricks to build &
>> test
>>>> in a "reasonable" amount of time is a symptom of a problem...
>>>>=20
>>>> Daryn
>>>>=20
>>>>=20
>>>> On Feb 15, 2012, at 12:47 PM, Todd Lipcon wrote:
>>>>=20
>>>>> Hi Sriram,
>>>>>=20
>>>>> I also do -Dmaven.skip.javadoc=3Dtrue usually and that cuts out a cou=
ple
>>>>> minutes. Unless you need a tarball, you can also drop -Ptar.
>>>>>=20
>>>>> When I'm just making quick changes confined to the java code, I
>>>>> usually just use "mvn -Dskiptests install" from within the hdfs
>>>>> project, then manually cp the resulting
>>>>> target/hadoop-hdfs-0.24.0-SNAPSHOT.jar into my install
>>>>> dir/share/hadoop/hdfs. Much faster than the full rebuild.
>>>>>=20
>>>>> -Todd
>>>>>=20
>>>>> On Wed, Feb 15, 2012 at 8:52 AM, Harsh J <harsh@cloudera.com> wrote:
>>>>>> Sriram,
>>>>>>=20
>>>>>> My package command didn't take as long with the same command -- wher=
e
>>>>>> do you see it getting stuck at most of the times? Which particular
>>>>>> target (right term?) seems to take the highest time to complete?
>>>>>>=20
>>>>>> On Wed, Feb 15, 2012 at 12:31 AM, Sriram Rao <sriramsrao@gmail.com>
>>>> wrote:
>>>>>>> Folks,
>>>>>>>=20
>>>>>>> The build takes forever:
>>>>>>>=20
>>>>>>> mvn package -Pdist -DskipTests -Dtar
>>>>>>>=20
>>>>>>> ....
>>>>>>>=20
>>>>>>> [INFO]
>>>>>>>=20
>>>> ----------------------------------------------------------------------=
--
>>>>>>> [INFO] BUILD SUCCESS
>>>>>>> [INFO]
>>>>>>>=20
>>>> ----------------------------------------------------------------------=
--
>>>>>>> [INFO] Total time: 6:25.399s
>>>>>>> [INFO] Finished at: Tue Feb 14 10:54:18 PST 2012
>>>>>>> [INFO] Final Memory: 56M/123M
>>>>>>> [INFO]
>>>>>>>=20
>>>> ----------------------------------------------------------------------=
--
>>>>>>>=20
>>>>>>> This is on a mac with 8GB RAM. (The above case involved 0-lines of
>>>> code
>>>>>>> change; just making sure I had everything built!).
>>>>>>>=20
>>>>>>> Is there a faster way to get the thing to build?
>>>>>>>=20
>>>>>>> Sriram
>>>>>>=20
>>>>>>=20
>>>>>>=20
>>>>>> --
>>>>>> Harsh J
>>>>>> Customer Ops. Engineer
>>>>>> Cloudera | http://tiny.cloudera.com/about
>>>>>=20
>>>>>=20
>>>>>=20
>>>>> --
>>>>> Todd Lipcon
>>>>> Software Engineer, Cloudera
>>>>=20
>>>>=20
>>=20
>>=20
From common-dev-return-77763-apmail-hadoop-common-dev-archive=hadoop.apache.org@hadoop.apache.org Fri Feb 17 15:24:55 2012
Return-Path: <common-dev-return-77763-apmail-hadoop-common-dev-archive=hadoop.apache.org@hadoop.apache.org>
X-Original-To: apmail-hadoop-common-dev-archive@www.apache.org
Delivered-To: apmail-hadoop-common-dev-archive@www.apache.org
Received: from mail.apache.org (hermes.apache.org [140.211.11.3])
by minotaur.apache.org (Postfix) with SMTP id 786DD9862
for <apmail-hadoop-common-dev-archive@www.apache.org>; Fri, 17 Feb 2012 15:24:55 +0000 (UTC)
Received: (qmail 4430 invoked by uid 500); 17 Feb 2012 15:24:52 -0000
Delivered-To: apmail-hadoop-common-dev-archive@hadoop.apache.org
Received: (qmail 4163 invoked by uid 500); 17 Feb 2012 15:24:52 -0000
Mailing-List: contact common-dev-help@hadoop.apache.org; run by ezmlm
Precedence: bulk
List-Help: <mailto:common-dev-help@hadoop.apache.org>
List-Unsubscribe: <mailto:common-dev-unsubscribe@hadoop.apache.org>
List-Post: <mailto:common-dev@hadoop.apache.org>
List-Id: <common-dev.hadoop.apache.org>
Reply-To: common-dev@hadoop.apache.org
Delivered-To: mailing list common-dev@hadoop.apache.org
Received: (qmail 4061 invoked by uid 99); 17 Feb 2012 15:24:52 -0000
Received: from nike.apache.org (HELO nike.apache.org) (192.87.106.230)
by apache.org (qpsmtpd/0.29) with ESMTP; Fri, 17 Feb 2012 15:24:52 +0000
X-ASF-Spam-Status: No, hits=-0.0 required=5.0
tests=RCVD_IN_DNSWL_NONE,SPF_PASS
X-Spam-Check-By: apache.org
Received-SPF: pass (nike.apache.org: domain of ext-fabio.almeida@nokia.com designates 147.243.1.48 as permitted sender)
Received: from [147.243.1.48] (HELO mgw-sa02.nokia.com) (147.243.1.48)
by apache.org (qpsmtpd/0.29) with ESMTP; Fri, 17 Feb 2012 15:24:44 +0000
Received: from vaebh101.NOE.Nokia.com (in-mx.nokia.com [10.160.244.22])
by mgw-sa02.nokia.com (Switch-3.4.4/Switch-3.4.4) with ESMTP id q1HFOMZ5002046;
Fri, 17 Feb 2012 17:24:23 +0200
Received: from smtp.mgd.nokia.com ([65.54.30.26]) by vaebh101.NOE.Nokia.com over TLS secured channel with Microsoft SMTPSVC(6.0.3790.4675);
Fri, 17 Feb 2012 17:24:22 +0200
Received: from 008-AM1MPN1-026.mgdnok.nokia.com ([169.254.6.199]) by
008-AM1MMR1-010.mgdnok.nokia.com ([65.54.30.26]) with mapi id 14.01.0355.003;
Fri, 17 Feb 2012 16:24:22 +0100
From: <ext-fabio.almeida@nokia.com>
To: <mapreduce-user@hadoop.apache.org>
CC: <common-dev@hadoop.apache.org>
Subject: RE: Partitioners - How to know if they are working
Thread-Topic: Partitioners - How to know if they are working
Thread-Index: Aczsq1M+ia5k+sonSX2haZfqI6lamgAdyR4AABjS1fA=
Date: Fri, 17 Feb 2012 15:24:21 +0000
Message-ID: <36AACAA2CA05C74C942B45F8D90515FFFA4DDC@008-AM1MPN1-026.mgdnok.nokia.com>
References: <36AACAA2CA05C74C942B45F8D90515FFFA4B71@008-AM1MPN1-026.mgdnok.nokia.com>
<4F3DD47E.3040608@darose.net>
In-Reply-To: <4F3DD47E.3040608@darose.net>
Accept-Language: en-US
Content-Language: en-US
X-MS-Has-Attach:
X-MS-TNEF-Correlator:
x-originating-ip: [189.2.128.130]
Content-Type: text/plain; charset="utf-8"
Content-Transfer-Encoding: base64
MIME-Version: 1.0
X-OriginalArrivalTime: 17 Feb 2012 15:24:22.0611 (UTC) FILETIME=[39B09230:01CCED88]
X-Nokia-AV: Clean
X-Virus-Checked: Checked by ClamAV on apache.org
SGVsbG8gRGF2aWQsDQoNCkkgYW0gZm9sbG93aW5nIHlvdXIgdGlwISBUaGFua3MuDQoNCkFsc28s
IEkgY29uZmlndXJlZCBhIHNtYWxsIGNsdXN0ZXIgd2l0aCB0aHJlZSBkYXRhbm9kZXMgYW5kIG9u
IG15IE1SIHByb2dyYW0gSSBwcmludGVkIGV2ZXJ5IHNpbmdsZSBrZXkgdGhhdCB0aGUgcmVkdWNl
cnMgcmVjZWl2ZWQuIEkgc2V0IHRocmVlIHJlZHVjZXJzKHNldE51bVJlZHVjZVRhc2tzKS4NCg0K
QW5hbHl6aW5nIHRoZSByZWR1Y2VyIG91dHB1dHMgSSBjb3VsZCBzZWUgdGhhdCB0aGUga2V5cyB3
ZXJlIGRpc3RyaWJ1dGVkIGFzIG15IHBhcnRpdGlvbmVyIG9yZGVyZWQuDQoNCk9mIGNvdXJzZSwg
SSBoYWQgdG8gbWFrZSB0aGluZ3MgbXVjaCBtdWNoIHNtYWxsZXIgdGhhbiByZWFsLiBJIHByZXBh
cmVkIGFuIGlucHV0LCBidWlsdCBhIHNtYWxsIGNsdXN0ZXIgYW5kIHNvIG9uIC4uLi4gdG8gYXNz
dXJlIGEgbWluaW1hbCBjb250cm9sLiANCg0KTm90IHRoYXQgSSBkb3VidCBoYWRvb3AsIEkgZG91
YnQgbXkgY29kZSwgYWx3YXlzISA6LSkNCg0KQnIsDQpGYWJpbyBBbG1laWRhIA0KDQoNCg0KLS0t
LS1PcmlnaW5hbCBNZXNzYWdlLS0tLS0NCkZyb206IGV4dCBEYXZpZCBSb3NlbnN0cmF1Y2ggW21h
aWx0bzpkYXJvc2VAZGFyb3NlLm5ldF0gDQpTZW50OiBGcmlkYXksIEZlYnJ1YXJ5IDE3LCAyMDEy
IDEyOjE2IEFNDQpUbzogbWFwcmVkdWNlLXVzZXJAaGFkb29wLmFwYWNoZS5vcmcNClN1YmplY3Q6
IFJlOiBQYXJ0aXRpb25lcnMgLSBIb3cgdG8ga25vdyBpZiB0aGV5IGFyZSB3b3JraW5nDQoNCk9u
IDAyLzE2LzIwMTIgMTI6NDkgUE0sIGV4dC1mYWJpby5hbG1laWRhQG5va2lhLmNvbSB3cm90ZToN
Cj4gSGVsbG8gQWxsLA0KPiBJIHdyb3RlIG15IG93biBwYXJ0aXRpb25lciBhbmQgSSB3b3VsZCBs
aWtlIHRvIHNlZSBpZiBpdCdzIHdvcmtpbmcuDQo+IEJ5IHByaW50aW5nIHRoZSByZXR1cm4gb2Yg
bWV0aG9kIGdldFBhcnRpdGlvbiBJIGNvdWxkIHNlZSB0aGF0IHRoZSBwYXJ0aXRpb25zIHdlcmUg
ZGlmZmVyZW50LCBidXQgd2VyZSB0aGV5IHJlYWxseSB3b3JraW5nPyBUbyBhbnN3ZXIgdGhhdCBJ
IGdvdCB0aGUga2V5cyB0aGF0IGV2ZXJ5IHJlZHVjZXIgdGFzayBwcm9jZXNzZWQgYW5kIHRoYXQg
d2FzIHdoYXQgSSBleHBlY3RlZC4gSXQgc2VlbXMgbXkgcGFydGl0aW9uZXIgaXMgd29ya2luZyBw
cm9wZXJseS4gQnV0IG5vdCBlYXN5IHRvIGRpc2NvdmVyIHRob3VnaC4NCj4gRG9lcyBhbnlvbmUg
a25vdyBpZiB0aGVyZSBpcyBhbiBlYXNpZXIgd2F5IHRvIHNlZSBpZiB5b3VyIGN1c3RvbWl6ZWQg
cGFydGl0aW9uZXIgaXMgd29ya2luZz8gRm9yIGluc3RhbmNlLCBhIGNvdW50ZXIgdGhhdCBzaG93
cyBob3cgbWFueSBwYXJ0aXRpb25lcnMgYSBtYXAgZ2VuZXJhdGVkIG9yIGEgcmVkdWNlciByZWNl
aXZlZD8NCj4gVGhhbmtzIGluIGFkdmFuY2UsDQo+IEZhYmlvIEFsbWVpZGENCg0KQXQgbXkgbGFz
dCBqb2Igd2Ugd3JvdGUgYSBjdXN0b20gcGFydGl0aW9uZXIsIGFuZCB3ZSB0ZXN0ZWQgaXQgb3V0
IGNvbXBsZXRlbHkgb3V0c2lkZSBvZiBIYWRvb3AgdXNpbmcgc3RhbmRhcmQgSlVuaXQgdW5pdCB0
ZXN0cy4NCg0KSFRILA0KDQpEUg0KDQo=
From common-dev-return-77764-apmail-hadoop-common-dev-archive=hadoop.apache.org@hadoop.apache.org Fri Feb 17 16:01:58 2012
Return-Path: <common-dev-return-77764-apmail-hadoop-common-dev-archive=hadoop.apache.org@hadoop.apache.org>
X-Original-To: apmail-hadoop-common-dev-archive@www.apache.org
Delivered-To: apmail-hadoop-common-dev-archive@www.apache.org
Received: from mail.apache.org (hermes.apache.org [140.211.11.3])
by minotaur.apache.org (Postfix) with SMTP id 1BDF39EC5
for <apmail-hadoop-common-dev-archive@www.apache.org>; Fri, 17 Feb 2012 16:01:58 +0000 (UTC)
Received: (qmail 58553 invoked by uid 500); 17 Feb 2012 16:01:56 -0000
Delivered-To: apmail-hadoop-common-dev-archive@hadoop.apache.org
Received: (qmail 58495 invoked by uid 500); 17 Feb 2012 16:01:56 -0000
Mailing-List: contact common-dev-help@hadoop.apache.org; run by ezmlm
Precedence: bulk
List-Help: <mailto:common-dev-help@hadoop.apache.org>
List-Unsubscribe: <mailto:common-dev-unsubscribe@hadoop.apache.org>
List-Post: <mailto:common-dev@hadoop.apache.org>
List-Id: <common-dev.hadoop.apache.org>
Reply-To: common-dev@hadoop.apache.org
Delivered-To: mailing list common-dev@hadoop.apache.org
Received: (qmail 58486 invoked by uid 99); 17 Feb 2012 16:01:56 -0000
Received: from athena.apache.org (HELO athena.apache.org) (140.211.11.136)
by apache.org (qpsmtpd/0.29) with ESMTP; Fri, 17 Feb 2012 16:01:56 +0000
X-ASF-Spam-Status: No, hits=1.5 required=5.0
tests=HTML_MESSAGE,RCVD_IN_DNSWL_LOW,SPF_PASS
X-Spam-Check-By: apache.org
Received-SPF: pass (athena.apache.org: domain of fabio.pitzolu@gmail.com designates 209.85.215.176 as permitted sender)
Received: from [209.85.215.176] (HELO mail-ey0-f176.google.com) (209.85.215.176)
by apache.org (qpsmtpd/0.29) with ESMTP; Fri, 17 Feb 2012 16:01:51 +0000
Received: by eaai11 with SMTP id i11so1496584eaa.35
for <common-dev@hadoop.apache.org>; Fri, 17 Feb 2012 08:01:29 -0800 (PST)
DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed;
d=gmail.com; s=gamma;
h=from:mime-version:content-type:subject:date:in-reply-to:to
:references:message-id:x-mailer;
bh=5ODciZs0RjzBw3xZBWAl2wk4nXaDQcAS8NELwyGbnK0=;
b=PRu4q4tvIPa52au+Xk/i+0+lTbH0MMRxaWRLXYlrY2KBLIA1jTB0pDOxS3rMsctdY3
v18K+I5yI4nw8KqkSDHEuxYfsyTKCWBsc9xlPMQxyoetr77cKGlqkPjTp+5CvgYkwNpP
Y1mUtN2di32Z0eL78YpMSODtDMp0mU+HYwpKQ=
Received: by 10.213.13.206 with SMTP id d14mr1266712eba.4.1329494489854;
Fri, 17 Feb 2012 08:01:29 -0800 (PST)
Received: from 1-167-210-237.dynamic.hinet.net ([176.206.104.2])
by mx.google.com with ESMTPS id s48sm37356266eem.0.2012.02.17.08.01.23
(version=TLSv1/SSLv3 cipher=OTHER);
Fri, 17 Feb 2012 08:01:28 -0800 (PST)
From: fabio.pitzolu@gmail.com
Mime-Version: 1.0 (Apple Message framework v1257)
Content-Type: multipart/alternative; boundary="Apple-Mail=_4F7421FC-81DA-4BBD-B57C-4B0DE0EF10E3"
Subject: Re: Building Hadoop UI
Date: Fri, 17 Feb 2012 17:01:18 +0100
In-Reply-To: <CAOcnVr0usYnrRqtGGvadDDBBRzW=zBe_FNTGxoMfh_yE2_xU=A@mail.gmail.com>
To: common-dev@hadoop.apache.org
References: <BD34C036-EC9F-41A2-9A52-70745DE0BFB6@gmail.com> <CAOcnVr0usYnrRqtGGvadDDBBRzW=zBe_FNTGxoMfh_yE2_xU=A@mail.gmail.com>
Message-Id: <1ACC52B0-B89D-4455-8DCB-E65DA4899BF6@gmail.com>
X-Mailer: Apple Mail (2.1257)
--Apple-Mail=_4F7421FC-81DA-4BBD-B57C-4B0DE0EF10E3
Content-Transfer-Encoding: quoted-printable
Content-Type: text/plain;
charset=iso-8859-1
Hi Harsh,
thanks for your feedback, I'm really interested in the new HUE branch.
Our clients are always looking for something customized, which is =
difficult to achieve sometimes if we don't have something that we can =
re-use. Our goal is to create a sort of template structure and build our =
app on top of it.
I'll let you know about the development, also take a look at the HUE dev =
community list.
Thanks,
Fabio Pitzolu
fabio.pitzolu@gmail.com
Il giorno 17/feb/2012, alle ore 15:06, Harsh J ha scritto:
> Hi Fabio,
>=20
> Hue is OSS and ASL-ed, and you can re-use the thrift bindings it uses
> to communicate with the various daemons via plugins, and then feed
> information into its UIs.
>=20
> I do think you can easily separate out the desktop UI and the backend
> (thrift binding) parts, and plug in your own UI layers if you
> absolutely need to do that. If you are still interested in doing that,
> you are welcome to ask your questions at
> https://groups.google.com/a/cloudera.org/group/hue-dev lists. The hue
> community also welcomes any feedback you may have that can help
> improve Hue to address your issues.
>=20
> But to answer your specific question, you essentially would need to
> load a plugin at each daemon that you can communicate to, and your UI
> project should use the plugin to fetch what it needs. This is how HUE
> does it and the sources are all at http://github.com/cloudera/hue
>=20
> Note: Hue is undergoing a look and feel change (and ditching the
> desktop model, which may be the pain for you here?), which you may
> want to check further at
> =
https://groups.google.com/a/cloudera.org/group/hue-user/browse_thread/thre=
ad/cea3cf743d230d9d#
> -- This work is already available in the hue2 git branch for
> testing/consumption.
>=20
> On Fri, Feb 17, 2012 at 3:31 PM, <fabio.pitzolu@gmail.com> wrote:
>> Hello everyone,
>>=20
>> in order to provide our clients a custom UI for their MapReduce jobs =
and HDFS files, what is the best solution to create a web-based UI for =
Hadoop?
>> We are not going to use Cloudera HUE, we need something more =
user-friendly and shaped for our clients needs.
>>=20
>> Thanks,
>>=20
>> Fabio Pitzolu
>=20
>=20
>=20
> --=20
> Harsh J
> Customer Ops. Engineer
> Cloudera | http://tiny.cloudera.com/about
--Apple-Mail=_4F7421FC-81DA-4BBD-B57C-4B0DE0EF10E3--
From common-dev-return-77765-apmail-hadoop-common-dev-archive=hadoop.apache.org@hadoop.apache.org Fri Feb 17 16:16:23 2012
Return-Path: <common-dev-return-77765-apmail-hadoop-common-dev-archive=hadoop.apache.org@hadoop.apache.org>
X-Original-To: apmail-hadoop-common-dev-archive@www.apache.org
Delivered-To: apmail-hadoop-common-dev-archive@www.apache.org
Received: from mail.apache.org (hermes.apache.org [140.211.11.3])
by minotaur.apache.org (Postfix) with SMTP id 0A6E3989B
for <apmail-hadoop-common-dev-archive@www.apache.org>; Fri, 17 Feb 2012 16:16:23 +0000 (UTC)
Received: (qmail 45812 invoked by uid 500); 17 Feb 2012 16:16:21 -0000
Delivered-To: apmail-hadoop-common-dev-archive@hadoop.apache.org
Received: (qmail 45715 invoked by uid 500); 17 Feb 2012 16:16:20 -0000
Mailing-List: contact common-dev-help@hadoop.apache.org; run by ezmlm
Precedence: bulk
List-Help: <mailto:common-dev-help@hadoop.apache.org>
List-Unsubscribe: <mailto:common-dev-unsubscribe@hadoop.apache.org>
List-Post: <mailto:common-dev@hadoop.apache.org>
List-Id: <common-dev.hadoop.apache.org>
Reply-To: common-dev@hadoop.apache.org
Delivered-To: mailing list common-dev@hadoop.apache.org
Received: (qmail 45586 invoked by uid 99); 17 Feb 2012 16:16:20 -0000
Received: from athena.apache.org (HELO athena.apache.org) (140.211.11.136)
by apache.org (qpsmtpd/0.29) with ESMTP; Fri, 17 Feb 2012 16:16:20 +0000
X-ASF-Spam-Status: No, hits=-2000.0 required=5.0
tests=ALL_TRUSTED,T_RP_MATCHES_RCVD
X-Spam-Check-By: apache.org
Received: from [140.211.11.116] (HELO hel.zones.apache.org) (140.211.11.116)
by apache.org (qpsmtpd/0.29) with ESMTP; Fri, 17 Feb 2012 16:16:19 +0000
Received: from hel.zones.apache.org (hel.zones.apache.org [140.211.11.116])
by hel.zones.apache.org (Postfix) with ESMTP id D48AA1BC83D
for <common-dev@hadoop.apache.org>; Fri, 17 Feb 2012 16:15:59 +0000 (UTC)
Date: Fri, 17 Feb 2012 16:15:59 +0000 (UTC)
From: "Suresh Srinivas (Created) (JIRA)" <jira@apache.org>
To: common-dev@hadoop.apache.org
Message-ID: <1193557971.51079.1329495359872.JavaMail.tomcat@hel.zones.apache.org>
Subject: [jira] [Created] (HADOOP-8085) Add RPC metrics to
ProtobufRpcEnginer
MIME-Version: 1.0
Content-Type: text/plain; charset=utf-8
Content-Transfer-Encoding: 7bit
X-JIRA-FingerPrint: 30527f35849b9dde25b450d4833f0394
Add RPC metrics to ProtobufRpcEnginer
-------------------------------------
Key: HADOOP-8085
URL: https://issues.apache.org/jira/browse/HADOOP-8085
Project: Hadoop Common
Issue Type: Improvement
Components: ipc, metrics
Affects Versions: 0.24.0, 0.23.2
Reporter: Suresh Srinivas
Assignee: Suresh Srinivas
ProtobufRpcEngine is missing the RPC metrics compared to WritableRpcEngine. It is important information for monitoring the cluster and understanding the server performance.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
From common-dev-return-77766-apmail-hadoop-common-dev-archive=hadoop.apache.org@hadoop.apache.org Fri Feb 17 19:16:22 2012
Return-Path: <common-dev-return-77766-apmail-hadoop-common-dev-archive=hadoop.apache.org@hadoop.apache.org>
X-Original-To: apmail-hadoop-common-dev-archive@www.apache.org
Delivered-To: apmail-hadoop-common-dev-archive@www.apache.org
Received: from mail.apache.org (hermes.apache.org [140.211.11.3])
by minotaur.apache.org (Postfix) with SMTP id 0FBA19E58
for <apmail-hadoop-common-dev-archive@www.apache.org>; Fri, 17 Feb 2012 19:16:22 +0000 (UTC)
Received: (qmail 57502 invoked by uid 500); 17 Feb 2012 19:16:20 -0000
Delivered-To: apmail-hadoop-common-dev-archive@hadoop.apache.org
Received: (qmail 57440 invoked by uid 500); 17 Feb 2012 19:16:20 -0000
Mailing-List: contact common-dev-help@hadoop.apache.org; run by ezmlm
Precedence: bulk
List-Help: <mailto:common-dev-help@hadoop.apache.org>
List-Unsubscribe: <mailto:common-dev-unsubscribe@hadoop.apache.org>
List-Post: <mailto:common-dev@hadoop.apache.org>
List-Id: <common-dev.hadoop.apache.org>
Reply-To: common-dev@hadoop.apache.org
Delivered-To: mailing list common-dev@hadoop.apache.org
Received: (qmail 57432 invoked by uid 99); 17 Feb 2012 19:16:20 -0000
Received: from athena.apache.org (HELO athena.apache.org) (140.211.11.136)
by apache.org (qpsmtpd/0.29) with ESMTP; Fri, 17 Feb 2012 19:16:20 +0000
X-ASF-Spam-Status: No, hits=-2000.0 required=5.0
tests=ALL_TRUSTED,T_RP_MATCHES_RCVD
X-Spam-Check-By: apache.org
Received: from [140.211.11.116] (HELO hel.zones.apache.org) (140.211.11.116)
by apache.org (qpsmtpd/0.29) with ESMTP; Fri, 17 Feb 2012 19:16:19 +0000
Received: from hel.zones.apache.org (hel.zones.apache.org [140.211.11.116])
by hel.zones.apache.org (Postfix) with ESMTP id 72BBC1BD67F
for <common-dev@hadoop.apache.org>; Fri, 17 Feb 2012 19:15:59 +0000 (UTC)
Date: Fri, 17 Feb 2012 19:15:59 +0000 (UTC)
From: "Alejandro Abdelnur (Created) (JIRA)" <jira@apache.org>
To: common-dev@hadoop.apache.org
Message-ID: <1618690800.51622.1329506159471.JavaMail.tomcat@hel.zones.apache.org>
Subject: [jira] [Created] (HADOOP-8086) KerberosName silently sets
defaultRealm to "" if the Kerberos config is not found, it should log a
WARN
MIME-Version: 1.0
Content-Type: text/plain; charset=utf-8
Content-Transfer-Encoding: 7bit
X-JIRA-FingerPrint: 30527f35849b9dde25b450d4833f0394
KerberosName silently sets defaultRealm to "" if the Kerberos config is not found, it should log a WARN
-------------------------------------------------------------------------------------------------------
Key: HADOOP-8086
URL: https://issues.apache.org/jira/browse/HADOOP-8086
Project: Hadoop Common
Issue Type: Improvement
Components: security
Affects Versions: 0.24.0, 0.23.2
Reporter: Alejandro Abdelnur
Assignee: Alejandro Abdelnur
Fix For: 0.23.2
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
From common-dev-return-77767-apmail-hadoop-common-dev-archive=hadoop.apache.org@hadoop.apache.org Fri Feb 17 21:41:20 2012
Return-Path: <common-dev-return-77767-apmail-hadoop-common-dev-archive=hadoop.apache.org@hadoop.apache.org>
X-Original-To: apmail-hadoop-common-dev-archive@www.apache.org
Delivered-To: apmail-hadoop-common-dev-archive@www.apache.org
Received: from mail.apache.org (hermes.apache.org [140.211.11.3])
by minotaur.apache.org (Postfix) with SMTP id 767A29A0B
for <apmail-hadoop-common-dev-archive@www.apache.org>; Fri, 17 Feb 2012 21:41:20 +0000 (UTC)
Received: (qmail 91721 invoked by uid 500); 17 Feb 2012 21:41:18 -0000
Delivered-To: apmail-hadoop-common-dev-archive@hadoop.apache.org
Received: (qmail 91655 invoked by uid 500); 17 Feb 2012 21:41:18 -0000
Mailing-List: contact common-dev-help@hadoop.apache.org; run by ezmlm
Precedence: bulk
List-Help: <mailto:common-dev-help@hadoop.apache.org>
List-Unsubscribe: <mailto:common-dev-unsubscribe@hadoop.apache.org>
List-Post: <mailto:common-dev@hadoop.apache.org>
List-Id: <common-dev.hadoop.apache.org>
Reply-To: common-dev@hadoop.apache.org
Delivered-To: mailing list common-dev@hadoop.apache.org
Received: (qmail 91639 invoked by uid 99); 17 Feb 2012 21:41:18 -0000
Received: from athena.apache.org (HELO athena.apache.org) (140.211.11.136)
by apache.org (qpsmtpd/0.29) with ESMTP; Fri, 17 Feb 2012 21:41:18 +0000
X-ASF-Spam-Status: No, hits=-2000.0 required=5.0
tests=ALL_TRUSTED,T_RP_MATCHES_RCVD
X-Spam-Check-By: apache.org
Received: from [140.211.11.116] (HELO hel.zones.apache.org) (140.211.11.116)
by apache.org (qpsmtpd/0.29) with ESMTP; Fri, 17 Feb 2012 21:41:17 +0000
Received: from hel.zones.apache.org (hel.zones.apache.org [140.211.11.116])
by hel.zones.apache.org (Postfix) with ESMTP id 3BB221BD953
for <common-dev@hadoop.apache.org>; Fri, 17 Feb 2012 21:40:57 +0000 (UTC)
Date: Fri, 17 Feb 2012 21:40:57 +0000 (UTC)
From: "Daryn Sharp (Created) (JIRA)" <jira@apache.org>
To: common-dev@hadoop.apache.org
Message-ID: <40880926.52244.1329514857245.JavaMail.tomcat@hel.zones.apache.org>
Subject: [jira] [Created] (HADOOP-8087) Path parsing is flawed
MIME-Version: 1.0
Content-Type: text/plain; charset=utf-8
Content-Transfer-Encoding: 7bit
X-JIRA-FingerPrint: 30527f35849b9dde25b450d4833f0394
Path parsing is flawed
----------------------
Key: HADOOP-8087
URL: https://issues.apache.org/jira/browse/HADOOP-8087
Project: Hadoop Common
Issue Type: Bug
Affects Versions: 0.23.0, 0.24.0
Reporter: Daryn Sharp
Assignee: Daryn Sharp
{{Path}} is incorrectly parsing {{//dir/path}} in a very unexpected way. While it should translate to the directory {{$fs.default.name}/dir/path}}, it instead discards the {{//dir}} and returns
{{$fs.default.name/path}}. The problem is {{Path}} is trying to parsing an authority even when a scheme is not present.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
From common-dev-return-77768-apmail-hadoop-common-dev-archive=hadoop.apache.org@hadoop.apache.org Fri Feb 17 22:07:25 2012
Return-Path: <common-dev-return-77768-apmail-hadoop-common-dev-archive=hadoop.apache.org@hadoop.apache.org>
X-Original-To: apmail-hadoop-common-dev-archive@www.apache.org
Delivered-To: apmail-hadoop-common-dev-archive@www.apache.org
Received: from mail.apache.org (hermes.apache.org [140.211.11.3])
by minotaur.apache.org (Postfix) with SMTP id 18B589563
for <apmail-hadoop-common-dev-archive@www.apache.org>; Fri, 17 Feb 2012 22:07:25 +0000 (UTC)
Received: (qmail 72015 invoked by uid 500); 17 Feb 2012 22:07:23 -0000
Delivered-To: apmail-hadoop-common-dev-archive@hadoop.apache.org
Received: (qmail 71951 invoked by uid 500); 17 Feb 2012 22:07:23 -0000
Mailing-List: contact common-dev-help@hadoop.apache.org; run by ezmlm
Precedence: bulk
List-Help: <mailto:common-dev-help@hadoop.apache.org>
List-Unsubscribe: <mailto:common-dev-unsubscribe@hadoop.apache.org>
List-Post: <mailto:common-dev@hadoop.apache.org>
List-Id: <common-dev.hadoop.apache.org>
Reply-To: common-dev@hadoop.apache.org
Delivered-To: mailing list common-dev@hadoop.apache.org
Received: (qmail 71943 invoked by uid 99); 17 Feb 2012 22:07:23 -0000
Received: from nike.apache.org (HELO nike.apache.org) (192.87.106.230)
by apache.org (qpsmtpd/0.29) with ESMTP; Fri, 17 Feb 2012 22:07:23 +0000
X-ASF-Spam-Status: No, hits=-2000.0 required=5.0
tests=ALL_TRUSTED,T_RP_MATCHES_RCVD
X-Spam-Check-By: apache.org
Received: from [140.211.11.116] (HELO hel.zones.apache.org) (140.211.11.116)
by apache.org (qpsmtpd/0.29) with ESMTP; Fri, 17 Feb 2012 22:07:19 +0000
Received: from hel.zones.apache.org (hel.zones.apache.org [140.211.11.116])
by hel.zones.apache.org (Postfix) with ESMTP id 662FE1BD5B0
for <common-dev@hadoop.apache.org>; Fri, 17 Feb 2012 22:06:58 +0000 (UTC)
Date: Fri, 17 Feb 2012 22:06:58 +0000 (UTC)
From: "John George (Resolved) (JIRA)" <jira@apache.org>
To: common-dev@hadoop.apache.org
Message-ID: <1616320628.52327.1329516418419.JavaMail.tomcat@hel.zones.apache.org>
Subject: [jira] [Resolved] (HADOOP-5404) GenericOptionsParser should parse
generic options even if they appear after Tool-specific options
MIME-Version: 1.0
Content-Type: text/plain; charset=utf-8
Content-Transfer-Encoding: 7bit
X-JIRA-FingerPrint: 30527f35849b9dde25b450d4833f0394
X-Virus-Checked: Checked by ClamAV on apache.org
[ https://issues.apache.org/jira/browse/HADOOP-5404?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
John George resolved HADOOP-5404.
---------------------------------
Resolution: Duplicate
Marking this as a dupe of HADOOP-7995
> GenericOptionsParser should parse generic options even if they appear after Tool-specific options
> -------------------------------------------------------------------------------------------------
>
> Key: HADOOP-5404
> URL: https://issues.apache.org/jira/browse/HADOOP-5404
> Project: Hadoop Common
> Issue Type: Improvement
> Components: util
> Affects Versions: 0.19.1
> Environment: All
> Reporter: Milind Bhandarkar
> Labels: newbie
>
> Currently, when GenericOptionsParser encounters an unrecognized option, it stops processing command-line arguments, and returns the rest to the specific Tool. This forces users to remember the order of arguments, and leads to errors such as following:
> org.apache.commons.cli.UnrecognizedOptionException: Unrecognized option:
> -Dmapred.reduce.tasks=4
> at org.apache.commons.cli.Parser.processOption(Parser.java:368)
> at org.apache.commons.cli.Parser.parse(Parser.java:185)
> at org.apache.commons.cli.Parser.parse(Parser.java:70)
> at
> MyTool.run(MyTool.java.java:290)
> at org.apache.hadoop.util.ToolRunner.run(ToolRunner.java:65)
> at
> MyTool.main(MyTool.java:19)
> In Hadoop-streaming as well, -D parameters should appear before streaming-specific arguments, such as -mapper, -reducer etc.
> If GenericOptionsParser were to scan the entire command-line, ignoring unrecognized (tool-specific) options, and returning all unrecognized options back to the tool, this problem would be solved.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
From common-dev-return-77769-apmail-hadoop-common-dev-archive=hadoop.apache.org@hadoop.apache.org Fri Feb 17 22:13:22 2012
Return-Path: <common-dev-return-77769-apmail-hadoop-common-dev-archive=hadoop.apache.org@hadoop.apache.org>
X-Original-To: apmail-hadoop-common-dev-archive@www.apache.org
Delivered-To: apmail-hadoop-common-dev-archive@www.apache.org
Received: from mail.apache.org (hermes.apache.org [140.211.11.3])
by minotaur.apache.org (Postfix) with SMTP id AF9A19711
for <apmail-hadoop-common-dev-archive@www.apache.org>; Fri, 17 Feb 2012 22:13:22 +0000 (UTC)
Received: (qmail 87394 invoked by uid 500); 17 Feb 2012 22:13:20 -0000
Delivered-To: apmail-hadoop-common-dev-archive@hadoop.apache.org
Received: (qmail 87293 invoked by uid 500); 17 Feb 2012 22:13:20 -0000
Mailing-List: contact common-dev-help@hadoop.apache.org; run by ezmlm
Precedence: bulk
List-Help: <mailto:common-dev-help@hadoop.apache.org>
List-Unsubscribe: <mailto:common-dev-unsubscribe@hadoop.apache.org>
List-Post: <mailto:common-dev@hadoop.apache.org>
List-Id: <common-dev.hadoop.apache.org>
Reply-To: common-dev@hadoop.apache.org
Delivered-To: mailing list common-dev@hadoop.apache.org
Received: (qmail 87155 invoked by uid 99); 17 Feb 2012 22:13:20 -0000
Received: from nike.apache.org (HELO nike.apache.org) (192.87.106.230)
by apache.org (qpsmtpd/0.29) with ESMTP; Fri, 17 Feb 2012 22:13:20 +0000
X-ASF-Spam-Status: No, hits=-2000.0 required=5.0
tests=ALL_TRUSTED,T_RP_MATCHES_RCVD
X-Spam-Check-By: apache.org
Received: from [140.211.11.116] (HELO hel.zones.apache.org) (140.211.11.116)
by apache.org (qpsmtpd/0.29) with ESMTP; Fri, 17 Feb 2012 22:13:18 +0000
Received: from hel.zones.apache.org (hel.zones.apache.org [140.211.11.116])
by hel.zones.apache.org (Postfix) with ESMTP id 8010E1BD914
for <common-dev@hadoop.apache.org>; Fri, 17 Feb 2012 22:12:57 +0000 (UTC)
Date: Fri, 17 Feb 2012 22:12:57 +0000 (UTC)
From: "Kihwal Lee (Created) (JIRA)" <jira@apache.org>
To: common-dev@hadoop.apache.org
Message-ID: <38057983.52361.1329516777525.JavaMail.tomcat@hel.zones.apache.org>
Subject: [jira] [Created] (HADOOP-8088) User-group mapping cache incorrectly
does negative caching on transient failures
MIME-Version: 1.0
Content-Type: text/plain; charset=utf-8
Content-Transfer-Encoding: 7bit
X-JIRA-FingerPrint: 30527f35849b9dde25b450d4833f0394
X-Virus-Checked: Checked by ClamAV on apache.org
User-group mapping cache incorrectly does negative caching on transient failures
--------------------------------------------------------------------------------
Key: HADOOP-8088
URL: https://issues.apache.org/jira/browse/HADOOP-8088
Project: Hadoop Common
Issue Type: Bug
Components: security
Affects Versions: 1.0.0, 0.20.205.0, 0.24.0, 0.23.1, 1.1.0
Reporter: Kihwal Lee
Fix For: 0.24.0, 1.1.0, 0.23.2
We've seen a case where some getGroups calls fail when the ldap server or the network has a transient issue. Looking the code, the shell-based and the JNI-based implementation swallow exceptions and return an empty or partial list. The caller, Groups#getGroups() adds this likely empty list into the mapping cache for the user. This will function as negative caching until the cach expires. I don't think we want negative caching here, but even if we do, it should be intelligent enough to distinguish transient failures from ENOENT. The log message in the jni-based imple also needs an improvement. It should print what exception it encountered instead of just saying one happened.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
From common-dev-return-77770-apmail-hadoop-common-dev-archive=hadoop.apache.org@hadoop.apache.org Sat Feb 18 00:26:22 2012
Return-Path: <common-dev-return-77770-apmail-hadoop-common-dev-archive=hadoop.apache.org@hadoop.apache.org>
X-Original-To: apmail-hadoop-common-dev-archive@www.apache.org
Delivered-To: apmail-hadoop-common-dev-archive@www.apache.org
Received: from mail.apache.org (hermes.apache.org [140.211.11.3])
by minotaur.apache.org (Postfix) with SMTP id 45B2D9D6B
for <apmail-hadoop-common-dev-archive@www.apache.org>; Sat, 18 Feb 2012 00:26:22 +0000 (UTC)
Received: (qmail 92679 invoked by uid 500); 18 Feb 2012 00:26:20 -0000
Delivered-To: apmail-hadoop-common-dev-archive@hadoop.apache.org
Received: (qmail 92625 invoked by uid 500); 18 Feb 2012 00:26:20 -0000
Mailing-List: contact common-dev-help@hadoop.apache.org; run by ezmlm
Precedence: bulk
List-Help: <mailto:common-dev-help@hadoop.apache.org>
List-Unsubscribe: <mailto:common-dev-unsubscribe@hadoop.apache.org>
List-Post: <mailto:common-dev@hadoop.apache.org>
List-Id: <common-dev.hadoop.apache.org>
Reply-To: common-dev@hadoop.apache.org
Delivered-To: mailing list common-dev@hadoop.apache.org
Received: (qmail 92617 invoked by uid 99); 18 Feb 2012 00:26:20 -0000
Received: from athena.apache.org (HELO athena.apache.org) (140.211.11.136)
by apache.org (qpsmtpd/0.29) with ESMTP; Sat, 18 Feb 2012 00:26:20 +0000
X-ASF-Spam-Status: No, hits=-2000.0 required=5.0
tests=ALL_TRUSTED,T_RP_MATCHES_RCVD
X-Spam-Check-By: apache.org
Received: from [140.211.11.116] (HELO hel.zones.apache.org) (140.211.11.116)
by apache.org (qpsmtpd/0.29) with ESMTP; Sat, 18 Feb 2012 00:26:19 +0000
Received: from hel.zones.apache.org (hel.zones.apache.org [140.211.11.116])
by hel.zones.apache.org (Postfix) with ESMTP id B5FFC1BB25B
for <common-dev@hadoop.apache.org>; Sat, 18 Feb 2012 00:25:59 +0000 (UTC)
Date: Sat, 18 Feb 2012 00:25:59 +0000 (UTC)
From: "Tsz Wo (Nicholas), SZE (Resolved) (JIRA)" <jira@apache.org>
To: common-dev@hadoop.apache.org
Message-ID: <1122066289.52776.1329524759746.JavaMail.tomcat@hel.zones.apache.org>
In-Reply-To: <1404282534.22724.1328840999358.JavaMail.tomcat@hel.zones.apache.org>
Subject: [jira] [Resolved] (HADOOP-8053) "har://hdfs-/foo" is not a valid
URI
MIME-Version: 1.0
Content-Type: text/plain; charset=utf-8
Content-Transfer-Encoding: 7bit
X-JIRA-FingerPrint: 30527f35849b9dde25b450d4833f0394
[ https://issues.apache.org/jira/browse/HADOOP-8053?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Tsz Wo (Nicholas), SZE resolved HADOOP-8053.
--------------------------------------------
Resolution: Not A Problem
I believe this is not a problem. Please feel free to reopen if not.
> "har://hdfs-/foo" is not a valid URI
> ------------------------------------
>
> Key: HADOOP-8053
> URL: https://issues.apache.org/jira/browse/HADOOP-8053
> Project: Hadoop Common
> Issue Type: Bug
> Components: fs
> Affects Versions: 0.21.0, 0.23.0
> Reporter: Carl Steinbach
>
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
From common-dev-return-77771-apmail-hadoop-common-dev-archive=hadoop.apache.org@hadoop.apache.org Sat Feb 18 01:54:24 2012
Return-Path: <common-dev-return-77771-apmail-hadoop-common-dev-archive=hadoop.apache.org@hadoop.apache.org>
X-Original-To: apmail-hadoop-common-dev-archive@www.apache.org
Delivered-To: apmail-hadoop-common-dev-archive@www.apache.org
Received: from mail.apache.org (hermes.apache.org [140.211.11.3])
by minotaur.apache.org (Postfix) with SMTP id A9D679879
for <apmail-hadoop-common-dev-archive@www.apache.org>; Sat, 18 Feb 2012 01:54:24 +0000 (UTC)
Received: (qmail 67889 invoked by uid 500); 18 Feb 2012 01:54:23 -0000
Delivered-To: apmail-hadoop-common-dev-archive@hadoop.apache.org
Received: (qmail 67788 invoked by uid 500); 18 Feb 2012 01:54:23 -0000
Mailing-List: contact common-dev-help@hadoop.apache.org; run by ezmlm
Precedence: bulk
List-Help: <mailto:common-dev-help@hadoop.apache.org>
List-Unsubscribe: <mailto:common-dev-unsubscribe@hadoop.apache.org>
List-Post: <mailto:common-dev@hadoop.apache.org>
List-Id: <common-dev.hadoop.apache.org>
Reply-To: common-dev@hadoop.apache.org
Delivered-To: mailing list common-dev@hadoop.apache.org
Received: (qmail 67780 invoked by uid 99); 18 Feb 2012 01:54:22 -0000
Received: from nike.apache.org (HELO nike.apache.org) (192.87.106.230)
by apache.org (qpsmtpd/0.29) with ESMTP; Sat, 18 Feb 2012 01:54:22 +0000
X-ASF-Spam-Status: No, hits=-2000.0 required=5.0
tests=ALL_TRUSTED,T_RP_MATCHES_RCVD
X-Spam-Check-By: apache.org
Received: from [140.211.11.116] (HELO hel.zones.apache.org) (140.211.11.116)
by apache.org (qpsmtpd/0.29) with ESMTP; Sat, 18 Feb 2012 01:54:20 +0000
Received: from hel.zones.apache.org (hel.zones.apache.org [140.211.11.116])
by hel.zones.apache.org (Postfix) with ESMTP id A84671BD7EF
for <common-dev@hadoop.apache.org>; Sat, 18 Feb 2012 01:53:59 +0000 (UTC)
Date: Sat, 18 Feb 2012 01:53:59 +0000 (UTC)
From: "Weili Shao (Created) (JIRA)" <jira@apache.org>
To: common-dev@hadoop.apache.org
Message-ID: <355849269.53132.1329530039690.JavaMail.tomcat@hel.zones.apache.org>
Subject: [jira] [Created] (HADOOP-8089) cannot submit job from Eclipse
plugin running on Windows
MIME-Version: 1.0
Content-Type: text/plain; charset=utf-8
Content-Transfer-Encoding: 7bit
X-JIRA-FingerPrint: 30527f35849b9dde25b450d4833f0394
X-Virus-Checked: Checked by ClamAV on apache.org
cannot submit job from Eclipse plugin running on Windows
--------------------------------------------------------
Key: HADOOP-8089
URL: https://issues.apache.org/jira/browse/HADOOP-8089
Project: Hadoop Common
Issue Type: Bug
Components: contrib/eclipse-plugin
Affects Versions: 1.0.0
Environment: Windows XP
Reporter: Weili Shao
Built eclipse plugin for 1.0.0 on Windows and using it to submit a job, I got the following error:
12/02/17 17:14:24 ERROR security.UserGroupInformation: PriviledgedActionException as:weilis cause:java.io.IOException: Failed to set permissions of path: \tmp\hadoop-weilis\mapred\staging\weilis753422487\.staging to 0700
Exception in thread "main" java.io.IOException: Failed to set permissions of path: \tmp\hadoop-weilis\mapred\staging\weilis753422487\.staging to 0700
at org.apache.hadoop.fs.FileUtil.checkReturnValue(FileUtil.java:682)
at org.apache.hadoop.fs.FileUtil.setPermission(FileUtil.java:655)
at org.apache.hadoop.fs.RawLocalFileSystem.setPermission(RawLocalFileSystem.java:509)
at org.apache.hadoop.fs.RawLocalFileSystem.mkdirs(RawLocalFileSystem.java:344)
at org.apache.hadoop.fs.FilterFileSystem.mkdirs(FilterFileSystem.java:189)
at org.apache.hadoop.mapreduce.JobSubmissionFiles.getStagingDir(JobSubmissionFiles.java:116)
at org.apache.hadoop.mapred.JobClient$2.run(JobClient.java:856)
at org.apache.hadoop.mapred.JobClient$2.run(JobClient.java:850)
at java.security.AccessController.doPrivileged(Native Method)
at javax.security.auth.Subject.doAs(Subject.java:396)
at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1083)
at org.apache.hadoop.mapred.JobClient.submitJobInternal(JobClient.java:850)
at org.apache.hadoop.mapreduce.Job.submit(Job.java:465)
at org.apache.hadoop.mapreduce.Job.waitForCompletion(Job.java:495)
The job staging area local on Windows system and I don't think there is a way to set a local file's permission to 0700 anyway. Please have a look.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
From common-dev-return-77772-apmail-hadoop-common-dev-archive=hadoop.apache.org@hadoop.apache.org Sat Feb 18 04:30:30 2012
Return-Path: <common-dev-return-77772-apmail-hadoop-common-dev-archive=hadoop.apache.org@hadoop.apache.org>
X-Original-To: apmail-hadoop-common-dev-archive@www.apache.org
Delivered-To: apmail-hadoop-common-dev-archive@www.apache.org
Received: from mail.apache.org (hermes.apache.org [140.211.11.3])
by minotaur.apache.org (Postfix) with SMTP id 35ECC9ECA
for <apmail-hadoop-common-dev-archive@www.apache.org>; Sat, 18 Feb 2012 04:30:30 +0000 (UTC)
Received: (qmail 47279 invoked by uid 500); 18 Feb 2012 04:30:27 -0000
Delivered-To: apmail-hadoop-common-dev-archive@hadoop.apache.org
Received: (qmail 47171 invoked by uid 500); 18 Feb 2012 04:30:25 -0000
Mailing-List: contact common-dev-help@hadoop.apache.org; run by ezmlm
Precedence: bulk
List-Help: <mailto:common-dev-help@hadoop.apache.org>
List-Unsubscribe: <mailto:common-dev-unsubscribe@hadoop.apache.org>
List-Post: <mailto:common-dev@hadoop.apache.org>
List-Id: <common-dev.hadoop.apache.org>
Reply-To: common-dev@hadoop.apache.org
Delivered-To: mailing list common-dev@hadoop.apache.org
Received: (qmail 47155 invoked by uid 99); 18 Feb 2012 04:30:24 -0000
Received: from athena.apache.org (HELO athena.apache.org) (140.211.11.136)
by apache.org (qpsmtpd/0.29) with ESMTP; Sat, 18 Feb 2012 04:30:24 +0000
X-ASF-Spam-Status: No, hits=-2000.0 required=5.0
tests=ALL_TRUSTED,T_RP_MATCHES_RCVD
X-Spam-Check-By: apache.org
Received: from [140.211.11.116] (HELO hel.zones.apache.org) (140.211.11.116)
by apache.org (qpsmtpd/0.29) with ESMTP; Sat, 18 Feb 2012 04:30:24 +0000
Received: from hel.zones.apache.org (hel.zones.apache.org [140.211.11.116])
by hel.zones.apache.org (Postfix) with ESMTP id 953F11BD3C5
for <common-dev@hadoop.apache.org>; Sat, 18 Feb 2012 04:30:03 +0000 (UTC)
Date: Sat, 18 Feb 2012 04:30:03 +0000 (UTC)
From: "Giridharan Kesavan (Created) (JIRA)" <jira@apache.org>
To: common-dev@hadoop.apache.org
Message-ID: <403439400.53478.1329539403633.JavaMail.tomcat@hel.zones.apache.org>
Subject: [jira] [Created] (HADOOP-8090) rename hadoop 64 bit rpm/deb package
name
MIME-Version: 1.0
Content-Type: text/plain; charset=utf-8
Content-Transfer-Encoding: 7bit
X-JIRA-FingerPrint: 30527f35849b9dde25b450d4833f0394
rename hadoop 64 bit rpm/deb package name
-----------------------------------------
Key: HADOOP-8090
URL: https://issues.apache.org/jira/browse/HADOOP-8090
Project: Hadoop Common
Issue Type: Improvement
Reporter: Giridharan Kesavan
Assignee: Giridharan Kesavan
change hadoop rpm/deb name from hadoop-<version>.amd64.rpm/deb hadoop-<version>.x86_64.rpm/deb
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
From common-dev-return-77773-apmail-hadoop-common-dev-archive=hadoop.apache.org@hadoop.apache.org Sat Feb 18 07:42:58 2012
Return-Path: <common-dev-return-77773-apmail-hadoop-common-dev-archive=hadoop.apache.org@hadoop.apache.org>
X-Original-To: apmail-hadoop-common-dev-archive@www.apache.org
Delivered-To: apmail-hadoop-common-dev-archive@www.apache.org
Received: from mail.apache.org (hermes.apache.org [140.211.11.3])
by minotaur.apache.org (Postfix) with SMTP id C1DDE9652
for <apmail-hadoop-common-dev-archive@www.apache.org>; Sat, 18 Feb 2012 07:42:58 +0000 (UTC)
Received: (qmail 172 invoked by uid 500); 18 Feb 2012 07:42:56 -0000
Delivered-To: apmail-hadoop-common-dev-archive@hadoop.apache.org
Received: (qmail 99923 invoked by uid 500); 18 Feb 2012 07:42:55 -0000
Mailing-List: contact common-dev-help@hadoop.apache.org; run by ezmlm
Precedence: bulk
List-Help: <mailto:common-dev-help@hadoop.apache.org>
List-Unsubscribe: <mailto:common-dev-unsubscribe@hadoop.apache.org>
List-Post: <mailto:common-dev@hadoop.apache.org>
List-Id: <common-dev.hadoop.apache.org>
Reply-To: common-dev@hadoop.apache.org
Delivered-To: mailing list common-dev@hadoop.apache.org
Received: (qmail 99913 invoked by uid 99); 18 Feb 2012 07:42:55 -0000
Received: from nike.apache.org (HELO nike.apache.org) (192.87.106.230)
by apache.org (qpsmtpd/0.29) with ESMTP; Sat, 18 Feb 2012 07:42:55 +0000
X-ASF-Spam-Status: No, hits=2.2 required=5.0
tests=HTML_MESSAGE,RCVD_IN_DNSWL_LOW,SPF_NEUTRAL
X-Spam-Check-By: apache.org
Received-SPF: neutral (nike.apache.org: local policy)
Received: from [209.85.160.48] (HELO mail-pw0-f48.google.com) (209.85.160.48)
by apache.org (qpsmtpd/0.29) with ESMTP; Sat, 18 Feb 2012 07:42:47 +0000
Received: by pbcxa12 with SMTP id xa12so3324508pbc.35
for <common-dev@hadoop.apache.org>; Fri, 17 Feb 2012 23:42:26 -0800 (PST)
Received-SPF: pass (google.com: domain of acm@hortonworks.com designates 10.68.219.232 as permitted sender) client-ip=10.68.219.232;
Authentication-Results: mr.google.com; spf=pass (google.com: domain of acm@hortonworks.com designates 10.68.219.232 as permitted sender) smtp.mail=acm@hortonworks.com
Received: from mr.google.com ([10.68.219.232])
by 10.68.219.232 with SMTP id pr8mr39015547pbc.12.1329550946259 (num_hops = 1);
Fri, 17 Feb 2012 23:42:26 -0800 (PST)
Received: by 10.68.219.232 with SMTP id pr8mr31582851pbc.12.1329550946200;
Fri, 17 Feb 2012 23:42:26 -0800 (PST)
Received: from [192.168.1.4] ([122.167.21.211])
by mx.google.com with ESMTPS id f8sm7283456pbe.42.2012.02.17.23.42.21
(version=TLSv1/SSLv3 cipher=OTHER);
Fri, 17 Feb 2012 23:42:25 -0800 (PST)
From: Arun C Murthy <acm@hortonworks.com>
Mime-Version: 1.0 (Apple Message framework v1084)
Content-Type: multipart/alternative; boundary=Apple-Mail-49--943581820
Subject: Re: [VOTE] Hadoop-1.0.1 Release Candidate 1
Date: Sat, 18 Feb 2012 13:12:16 +0530
In-Reply-To: <CA+z3+9HrBBf2___wSEk7M=HrzDRLsvHikqcR3Mx2ra6+3oMuwg@mail.gmail.com>
To: common-dev@hadoop.apache.org
References: <CA+z3+9HrBBf2___wSEk7M=HrzDRLsvHikqcR3Mx2ra6+3oMuwg@mail.gmail.com>
Message-Id: <2C3E6D73-9701-4F90-AC64-C1C35E95F8FF@hortonworks.com>
X-Mailer: Apple Mail (2.1084)
X-Gm-Message-State: ALoCoQlhp41mnobgl6ycosB9Xjp8sxUheZRP4x9LINjL5TX9s+qVaJS5fo56QUp12DWWXyE23bBc
X-Virus-Checked: Checked by ClamAV on apache.org
--Apple-Mail-49--943581820
Content-Transfer-Encoding: quoted-printable
Content-Type: text/plain;
charset=us-ascii
+1 downloaded, checked sigs and ran a single node cluster.
Arun
On Feb 15, 2012, at 3:59 AM, Matt Foley wrote:
> Hi all,
> Hadoop-1.0.1-rc1 is now available at
> http://people.apache.org/~mattf/hadoop-1.0.1-rc1/
> Please download it, test it, and vote on whether to accept it as =
Release
> 1.0.1.
> Voting will close at 2:30pm PST on Tuesday 21 February.
>=20
> Thank you,
> --Matt (Release Manager)
>=20
> This is a maintenance release from 1.0.0, but a number of
> production-relevant bug fixes were requested for inclusion in the last =
week
> or so. The complete release notes are available at
>=20
> =
http://people.apache.org/~mattf/hadoop-1.0.1-rc1/RELEASE_NOTES_HADOOP-1.0.=
1.html
> The summary list is:
>=20
> - HADOOP-8009 <https://issues.apache.org/jira/browse/HADOOP-8009>.
> Create hadoop-client and hadoop-minicluster artifacts for downstream
> projects
> - HADOOP-8037 <https://issues.apache.org/jira/browse/HADOOP-8037>. =
Binary
> tarball does not preserve platform info for native builds, and RPMs =
fail to
> provide needed symlinks for libhadoop.so
> - MAPREDUCE-3184
> <https://issues.apache.org/jira/browse/MAPREDUCE-3184>. Improve
> handling of fetch failures when a tasktracker is not responding on =
HTTP
> - HADOOP-7470 <https://issues.apache.org/jira/browse/HADOOP-7470>. =
move
> up to Jackson 1.8.8
> - HADOOP-7960 <https://issues.apache.org/jira/browse/HADOOP-7960>. =
Port
> HADOOP-5203 to branch-1, build version comparison is too restrictive
> - HADOOP-7964 <https://issues.apache.org/jira/browse/HADOOP-7964>. =
Deadlock
> in class init.
> - HADOOP-7987 <https://issues.apache.org/jira/browse/HADOOP-7987>. =
Support
> setting the run-as user in unsecure mode
> - HADOOP-7988 <https://issues.apache.org/jira/browse/HADOOP-7988>. =
Upper
> case in hostname part of the principals doesn't work with kerberos.
> - HADOOP-8010 <https://issues.apache.org/jira/browse/HADOOP-8010>.
> hadoop-config.sh
> spews error message when HADOOP_HOME_WARN_SUPPRESS is set to true =
and
> HADOOP_HOME is present
> - HADOOP-8052 <https://issues.apache.org/jira/browse/HADOOP-8052>. =
Hadoop
> Metrics2 should emit Float.MAX_VALUE (instead of Double.MAX_VALUE) =
to avoid
> making Ganglia's gmetad core
> - HDFS-2379 <https://issues.apache.org/jira/browse/HDFS-2379>. 0.20:
> Allow block reports to proceed without holding FSDataset lock
> - HDFS-2814 <https://issues.apache.org/jira/browse/HDFS-2814>.
> NamenodeMXBean
> does not account for svn revision in the version information
> - MAPREDUCE-3343
> <https://issues.apache.org/jira/browse/MAPREDUCE-3343>. TaskTracker
> Out of Memory because of distributed cache
> - MAPREDUCE-3607
> <https://issues.apache.org/jira/browse/MAPREDUCE-3607>. Port
> missing new API mapreduce lib classes to 1.x
--
Arun C. Murthy
Hortonworks Inc.
http://hortonworks.com/
--Apple-Mail-49--943581820--
From common-dev-return-77774-apmail-hadoop-common-dev-archive=hadoop.apache.org@hadoop.apache.org Sat Feb 18 13:45:22 2012
Return-Path: <common-dev-return-77774-apmail-hadoop-common-dev-archive=hadoop.apache.org@hadoop.apache.org>
X-Original-To: apmail-hadoop-common-dev-archive@www.apache.org
Delivered-To: apmail-hadoop-common-dev-archive@www.apache.org
Received: from mail.apache.org (hermes.apache.org [140.211.11.3])
by minotaur.apache.org (Postfix) with SMTP id 3E0319D1F
for <apmail-hadoop-common-dev-archive@www.apache.org>; Sat, 18 Feb 2012 13:45:22 +0000 (UTC)
Received: (qmail 74970 invoked by uid 500); 18 Feb 2012 13:45:20 -0000
Delivered-To: apmail-hadoop-common-dev-archive@hadoop.apache.org
Received: (qmail 74892 invoked by uid 500); 18 Feb 2012 13:45:20 -0000
Mailing-List: contact common-dev-help@hadoop.apache.org; run by ezmlm
Precedence: bulk
List-Help: <mailto:common-dev-help@hadoop.apache.org>
List-Unsubscribe: <mailto:common-dev-unsubscribe@hadoop.apache.org>
List-Post: <mailto:common-dev@hadoop.apache.org>
List-Id: <common-dev.hadoop.apache.org>
Reply-To: common-dev@hadoop.apache.org
Delivered-To: mailing list common-dev@hadoop.apache.org
Received: (qmail 74875 invoked by uid 99); 18 Feb 2012 13:45:20 -0000
Received: from athena.apache.org (HELO athena.apache.org) (140.211.11.136)
by apache.org (qpsmtpd/0.29) with ESMTP; Sat, 18 Feb 2012 13:45:20 +0000
X-ASF-Spam-Status: No, hits=-2000.0 required=5.0
tests=ALL_TRUSTED,T_RP_MATCHES_RCVD
X-Spam-Check-By: apache.org
Received: from [140.211.11.116] (HELO hel.zones.apache.org) (140.211.11.116)
by apache.org (qpsmtpd/0.29) with ESMTP; Sat, 18 Feb 2012 13:45:19 +0000
Received: from hel.zones.apache.org (hel.zones.apache.org [140.211.11.116])
by hel.zones.apache.org (Postfix) with ESMTP id 6C6641BE2D2
for <common-dev@hadoop.apache.org>; Sat, 18 Feb 2012 13:44:59 +0000 (UTC)
Date: Sat, 18 Feb 2012 13:44:59 +0000 (UTC)
From: "Steve Loughran (Created) (JIRA)" <jira@apache.org>
To: common-dev@hadoop.apache.org
Message-ID: <613333825.54154.1329572699445.JavaMail.tomcat@hel.zones.apache.org>
Subject: [jira] [Created] (HADOOP-8091) Add a topology mapper that reads
hostname to rack mappings from a Java properties file
MIME-Version: 1.0
Content-Type: text/plain; charset=utf-8
Content-Transfer-Encoding: 7bit
X-JIRA-FingerPrint: 30527f35849b9dde25b450d4833f0394
Add a topology mapper that reads hostname to rack mappings from a Java properties file
--------------------------------------------------------------------------------------
Key: HADOOP-8091
URL: https://issues.apache.org/jira/browse/HADOOP-8091
Project: Hadoop Common
Issue Type: New Feature
Components: util
Affects Versions: 0.24.0
Reporter: Steve Loughran
Priority: Minor
Getting mapping scripts right is surprisingly hard -and if its wrong in production bad things happen. It would be good to have something simpler for beginners -and one that is trivial to generate by a machine based on infrastructure data.
I propose adding an alternative mapper, one driven by a java property file
# the specific topology mapper must be identified for loading
# it uses another key to identify the property file to load. This is checked for on startup -if missing, fail.
# one property, perhaps "default-rack" identifies the default rack mapping for any host not in the list
# every other entry lists a hostname to rack mapping
# hostname mapping is done on the first entry in the FQDN, to be less brittle to domain resolution.
Example
{code}
default-rack=/rack1
host1=/rack1
host2=/rack1
host3=/rack2
host4=/rack2
{code}
Implementation
* add a new mapper that builds a concurrent hash map
* read in every entry in the specified property file, add it to the map
* when queried, extract the hostname (i.e. everything before any ".")
* match that in the hash table, return if found
* if not found: return the default rack
Feature creep would be to poll this file for changes at a (specified) frequency, and pick up the changes when they occur. This would require removing the caching topology mapper that wraps all others in the NN and RM.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
From common-dev-return-77775-apmail-hadoop-common-dev-archive=hadoop.apache.org@hadoop.apache.org Sat Feb 18 16:19:25 2012
Return-Path: <common-dev-return-77775-apmail-hadoop-common-dev-archive=hadoop.apache.org@hadoop.apache.org>
X-Original-To: apmail-hadoop-common-dev-archive@www.apache.org
Delivered-To: apmail-hadoop-common-dev-archive@www.apache.org
Received: from mail.apache.org (hermes.apache.org [140.211.11.3])
by minotaur.apache.org (Postfix) with SMTP id 3F2749D6A
for <apmail-hadoop-common-dev-archive@www.apache.org>; Sat, 18 Feb 2012 16:19:25 +0000 (UTC)
Received: (qmail 22023 invoked by uid 500); 18 Feb 2012 16:19:23 -0000
Delivered-To: apmail-hadoop-common-dev-archive@hadoop.apache.org
Received: (qmail 21897 invoked by uid 500); 18 Feb 2012 16:19:23 -0000
Mailing-List: contact common-dev-help@hadoop.apache.org; run by ezmlm
Precedence: bulk
List-Help: <mailto:common-dev-help@hadoop.apache.org>
List-Unsubscribe: <mailto:common-dev-unsubscribe@hadoop.apache.org>
List-Post: <mailto:common-dev@hadoop.apache.org>
List-Id: <common-dev.hadoop.apache.org>
Reply-To: common-dev@hadoop.apache.org
Delivered-To: mailing list common-dev@hadoop.apache.org
Received: (qmail 21708 invoked by uid 99); 18 Feb 2012 16:19:23 -0000
Received: from nike.apache.org (HELO nike.apache.org) (192.87.106.230)
by apache.org (qpsmtpd/0.29) with ESMTP; Sat, 18 Feb 2012 16:19:23 +0000
X-ASF-Spam-Status: No, hits=-2000.0 required=5.0
tests=ALL_TRUSTED,T_RP_MATCHES_RCVD
X-Spam-Check-By: apache.org
Received: from [140.211.11.116] (HELO hel.zones.apache.org) (140.211.11.116)
by apache.org (qpsmtpd/0.29) with ESMTP; Sat, 18 Feb 2012 16:19:20 +0000
Received: from hel.zones.apache.org (hel.zones.apache.org [140.211.11.116])
by hel.zones.apache.org (Postfix) with ESMTP id 08FDE1BF6A0
for <common-dev@hadoop.apache.org>; Sat, 18 Feb 2012 16:19:00 +0000 (UTC)
Date: Sat, 18 Feb 2012 16:19:00 +0000 (UTC)
From: "Steve Loughran (Resolved) (JIRA)" <jira@apache.org>
To: common-dev@hadoop.apache.org
Message-ID: <965543209.54548.1329581940038.JavaMail.tomcat@hel.zones.apache.org>
Subject: [jira] [Resolved] (HADOOP-6194) Add service base class and tests to
hadoop-common/util
MIME-Version: 1.0
Content-Type: text/plain; charset=utf-8
Content-Transfer-Encoding: 7bit
X-JIRA-FingerPrint: 30527f35849b9dde25b450d4833f0394
X-Virus-Checked: Checked by ClamAV on apache.org
[ https://issues.apache.org/jira/browse/HADOOP-6194?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Steve Loughran resolved HADOOP-6194.
------------------------------------
Resolution: Won't Fix
superceded by the YARN services, though work needs to be done there to make its lifecycle more robust. the YARN service lifecycle could also be moved into hadoop-common at some point
> Add service base class and tests to hadoop-common/util
> ------------------------------------------------------
>
> Key: HADOOP-6194
> URL: https://issues.apache.org/jira/browse/HADOOP-6194
> Project: Hadoop Common
> Issue Type: New Feature
> Components: util
> Affects Versions: 0.21.0
> Reporter: Steve Loughran
> Assignee: Steve Loughran
> Attachments: HADOOP-6194-1.patch, HADOOP-6194.patch, HADOOP-6194.patch, find-new-warnings
>
>
> For a service base class, we need to add to common
> # The Service class
> # A mock Service class (it's not in test, its in src/, because it helps in functional tests downstream)
> # Unit tests
> This is the issue to cover this work
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
From common-dev-return-77776-apmail-hadoop-common-dev-archive=hadoop.apache.org@hadoop.apache.org Sat Feb 18 16:23:23 2012
Return-Path: <common-dev-return-77776-apmail-hadoop-common-dev-archive=hadoop.apache.org@hadoop.apache.org>
X-Original-To: apmail-hadoop-common-dev-archive@www.apache.org
Delivered-To: apmail-hadoop-common-dev-archive@www.apache.org
Received: from mail.apache.org (hermes.apache.org [140.211.11.3])
by minotaur.apache.org (Postfix) with SMTP id EF5FD9012
for <apmail-hadoop-common-dev-archive@www.apache.org>; Sat, 18 Feb 2012 16:23:23 +0000 (UTC)
Received: (qmail 37719 invoked by uid 500); 18 Feb 2012 16:23:21 -0000
Delivered-To: apmail-hadoop-common-dev-archive@hadoop.apache.org
Received: (qmail 37650 invoked by uid 500); 18 Feb 2012 16:23:21 -0000
Mailing-List: contact common-dev-help@hadoop.apache.org; run by ezmlm
Precedence: bulk
List-Help: <mailto:common-dev-help@hadoop.apache.org>
List-Unsubscribe: <mailto:common-dev-unsubscribe@hadoop.apache.org>
List-Post: <mailto:common-dev@hadoop.apache.org>
List-Id: <common-dev.hadoop.apache.org>
Reply-To: common-dev@hadoop.apache.org
Delivered-To: mailing list common-dev@hadoop.apache.org
Received: (qmail 37640 invoked by uid 99); 18 Feb 2012 16:23:21 -0000
Received: from athena.apache.org (HELO athena.apache.org) (140.211.11.136)
by apache.org (qpsmtpd/0.29) with ESMTP; Sat, 18 Feb 2012 16:23:21 +0000
X-ASF-Spam-Status: No, hits=-2000.0 required=5.0
tests=ALL_TRUSTED,T_RP_MATCHES_RCVD
X-Spam-Check-By: apache.org
Received: from [140.211.11.116] (HELO hel.zones.apache.org) (140.211.11.116)
by apache.org (qpsmtpd/0.29) with ESMTP; Sat, 18 Feb 2012 16:23:21 +0000
Received: from hel.zones.apache.org (hel.zones.apache.org [140.211.11.116])
by hel.zones.apache.org (Postfix) with ESMTP id EA6E01BF889
for <common-dev@hadoop.apache.org>; Sat, 18 Feb 2012 16:23:00 +0000 (UTC)
Date: Sat, 18 Feb 2012 16:23:00 +0000 (UTC)
From: "Steve Loughran (Resolved) (JIRA)" <jira@apache.org>
To: common-dev@hadoop.apache.org
Message-ID: <1099275720.54606.1329582180961.JavaMail.tomcat@hel.zones.apache.org>
Subject: [jira] [Resolved] (HADOOP-6200) glue together the different
projects to make local builds easier
MIME-Version: 1.0
Content-Type: text/plain; charset=utf-8
Content-Transfer-Encoding: 7bit
X-JIRA-FingerPrint: 30527f35849b9dde25b450d4833f0394
[ https://issues.apache.org/jira/browse/HADOOP-6200?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Steve Loughran resolved HADOOP-6200.
------------------------------------
Resolution: Won't Fix
migration to maven supercedes this
> glue together the different projects to make local builds easier
> ----------------------------------------------------------------
>
> Key: HADOOP-6200
> URL: https://issues.apache.org/jira/browse/HADOOP-6200
> Project: Hadoop Common
> Issue Type: Bug
> Components: build
> Affects Versions: 0.21.0
> Reporter: Steve Loughran
> Assignee: Steve Loughran
> Priority: Minor
>
> It's currently fairly tricky to get everything building/up to date in a single machine. We can and should improve this.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
From common-dev-return-77777-apmail-hadoop-common-dev-archive=hadoop.apache.org@hadoop.apache.org Sat Feb 18 16:25:23 2012
Return-Path: <common-dev-return-77777-apmail-hadoop-common-dev-archive=hadoop.apache.org@hadoop.apache.org>
X-Original-To: apmail-hadoop-common-dev-archive@www.apache.org
Delivered-To: apmail-hadoop-common-dev-archive@www.apache.org
Received: from mail.apache.org (hermes.apache.org [140.211.11.3])
by minotaur.apache.org (Postfix) with SMTP id BFB159A79
for <apmail-hadoop-common-dev-archive@www.apache.org>; Sat, 18 Feb 2012 16:25:23 +0000 (UTC)
Received: (qmail 46562 invoked by uid 500); 18 Feb 2012 16:25:20 -0000
Delivered-To: apmail-hadoop-common-dev-archive@hadoop.apache.org
Received: (qmail 46447 invoked by uid 500); 18 Feb 2012 16:25:20 -0000
Mailing-List: contact common-dev-help@hadoop.apache.org; run by ezmlm
Precedence: bulk
List-Help: <mailto:common-dev-help@hadoop.apache.org>
List-Unsubscribe: <mailto:common-dev-unsubscribe@hadoop.apache.org>
List-Post: <mailto:common-dev@hadoop.apache.org>
List-Id: <common-dev.hadoop.apache.org>
Reply-To: common-dev@hadoop.apache.org
Delivered-To: mailing list common-dev@hadoop.apache.org
Received: (qmail 46398 invoked by uid 99); 18 Feb 2012 16:25:20 -0000
Received: from athena.apache.org (HELO athena.apache.org) (140.211.11.136)
by apache.org (qpsmtpd/0.29) with ESMTP; Sat, 18 Feb 2012 16:25:20 +0000
X-ASF-Spam-Status: No, hits=-2000.0 required=5.0
tests=ALL_TRUSTED,T_RP_MATCHES_RCVD
X-Spam-Check-By: apache.org
Received: from [140.211.11.116] (HELO hel.zones.apache.org) (140.211.11.116)
by apache.org (qpsmtpd/0.29) with ESMTP; Sat, 18 Feb 2012 16:25:19 +0000
Received: from hel.zones.apache.org (hel.zones.apache.org [140.211.11.116])
by hel.zones.apache.org (Postfix) with ESMTP id 897731BF94F
for <common-dev@hadoop.apache.org>; Sat, 18 Feb 2012 16:24:59 +0000 (UTC)
Date: Sat, 18 Feb 2012 16:24:59 +0000 (UTC)
From: "Steve Loughran (Resolved) (JIRA)" <jira@apache.org>
To: common-dev@hadoop.apache.org
Message-ID: <1475382881.54612.1329582299564.JavaMail.tomcat@hel.zones.apache.org>
Subject: [jira] [Resolved] (HADOOP-5622) add a Pingable interface with a
Ping() method for checking the health of things
MIME-Version: 1.0
Content-Type: text/plain; charset=utf-8
Content-Transfer-Encoding: 7bit
X-JIRA-FingerPrint: 30527f35849b9dde25b450d4833f0394
[ https://issues.apache.org/jira/browse/HADOOP-5622?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Steve Loughran resolved HADOOP-5622.
------------------------------------
Resolution: Won't Fix
closing as a wontfix, unless it goes into the new yarn service interface
> add a Pingable interface with a Ping() method for checking the health of things
> -------------------------------------------------------------------------------
>
> Key: HADOOP-5622
> URL: https://issues.apache.org/jira/browse/HADOOP-5622
> Project: Hadoop Common
> Issue Type: Improvement
> Components: util
> Affects Versions: 0.21.0
> Reporter: Steve Loughran
> Assignee: Steve Loughran
> Priority: Minor
>
> I'm filing this as part of the plan for getting HADOOP-3628 checked in: separate Ping() from everything else so that it can go in later/separately, and apply to more bits of the code than just the node root threads . The various helper classes that they use underneath could be marked as Pingable so that the health check operations could move the workload down.
> Use cases
> # Pingable Filesystem and MapReduce services: namenode, datanode, job-tracker, task-tracker, etc
> # Eventually : Pingable pig/cascading,HBase services
> # Implementation of the ping operation in the services by calling their in-JVM classes and aggregating the results
> # in JVM-health checks (JMX operations etc)
> # Over RMI/REST Smartfrog health checks (my use case)
> # Thrift and other wire format health checks
> # Public HTTP checks that return an error code with XML or JSON output.
> # Command line tools (that could check the HTTP pages)
> # Make it easy to test
> The current HADOOP-3628 ping() operation includes the service state from the proposed service lifecycle, and a list of nested exceptions; it only works in -VM. To work in more use cases
> # It needs to move to a serialized exception format - the ThrowableWritable of HADOOP-5348.
> # We need to consider how best to return the far-end's state.
> I'm going offline for two weeks; here is somewhere for people to add their thoughts and work for me when I get back.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
From common-dev-return-77778-apmail-hadoop-common-dev-archive=hadoop.apache.org@hadoop.apache.org Sat Feb 18 16:53:24 2012
Return-Path: <common-dev-return-77778-apmail-hadoop-common-dev-archive=hadoop.apache.org@hadoop.apache.org>
X-Original-To: apmail-hadoop-common-dev-archive@www.apache.org
Delivered-To: apmail-hadoop-common-dev-archive@www.apache.org
Received: from mail.apache.org (hermes.apache.org [140.211.11.3])
by minotaur.apache.org (Postfix) with SMTP id 44C779EE5
for <apmail-hadoop-common-dev-archive@www.apache.org>; Sat, 18 Feb 2012 16:53:24 +0000 (UTC)
Received: (qmail 3385 invoked by uid 500); 18 Feb 2012 16:53:22 -0000
Delivered-To: apmail-hadoop-common-dev-archive@hadoop.apache.org
Received: (qmail 3328 invoked by uid 500); 18 Feb 2012 16:53:22 -0000
Mailing-List: contact common-dev-help@hadoop.apache.org; run by ezmlm
Precedence: bulk
List-Help: <mailto:common-dev-help@hadoop.apache.org>
List-Unsubscribe: <mailto:common-dev-unsubscribe@hadoop.apache.org>
List-Post: <mailto:common-dev@hadoop.apache.org>
List-Id: <common-dev.hadoop.apache.org>
Reply-To: common-dev@hadoop.apache.org
Delivered-To: mailing list common-dev@hadoop.apache.org
Received: (qmail 3318 invoked by uid 99); 18 Feb 2012 16:53:22 -0000
Received: from nike.apache.org (HELO nike.apache.org) (192.87.106.230)
by apache.org (qpsmtpd/0.29) with ESMTP; Sat, 18 Feb 2012 16:53:22 +0000
X-ASF-Spam-Status: No, hits=-2000.0 required=5.0
tests=ALL_TRUSTED,T_RP_MATCHES_RCVD
X-Spam-Check-By: apache.org
Received: from [140.211.11.116] (HELO hel.zones.apache.org) (140.211.11.116)
by apache.org (qpsmtpd/0.29) with ESMTP; Sat, 18 Feb 2012 16:53:20 +0000
Received: from hel.zones.apache.org (hel.zones.apache.org [140.211.11.116])
by hel.zones.apache.org (Postfix) with ESMTP id 7D7811BFF21
for <common-dev@hadoop.apache.org>; Sat, 18 Feb 2012 16:52:59 +0000 (UTC)
Date: Sat, 18 Feb 2012 16:52:59 +0000 (UTC)
From: "Istvan Szegedi (Created) (JIRA)" <jira@apache.org>
To: common-dev@hadoop.apache.org
Message-ID: <301744060.54635.1329583979515.JavaMail.tomcat@hel.zones.apache.org>
Subject: [jira] [Created] (HADOOP-8092) Hadoop DataNode cannot start up in
Pseudo-Distributed mode using start-all.sh if it is run as root
MIME-Version: 1.0
Content-Type: text/plain; charset=utf-8
Content-Transfer-Encoding: 7bit
X-JIRA-FingerPrint: 30527f35849b9dde25b450d4833f0394
X-Virus-Checked: Checked by ClamAV on apache.org
Hadoop DataNode cannot start up in Pseudo-Distributed mode using start-all.sh if it is run as root
--------------------------------------------------------------------------------------------------
Key: HADOOP-8092
URL: https://issues.apache.org/jira/browse/HADOOP-8092
Project: Hadoop Common
Issue Type: Bug
Components: scripts
Affects Versions: 0.20.203.0
Environment: Centos 5.6, Java 1.6 (Sun JDK)
# java -version
java version "1.6.0_31"
Java(TM) SE Runtime Environment (build 1.6.0_31-b04)
Java HotSpot(TM) 64-Bit Server VM (build 20.6-b01, mixed mode)
# uname -a
Linux server-56164 2.6.18-238.19.1.el5 #1 SMP Fri Jul 15 07:31:24 EDT 2011 x86_64 x86_64 x86_64 GNU/Linux
Pseudo-Distributed mode
Reporter: Istvan Szegedi
Hadoop DataNode cannot start-up if you run start-all.sh (or start-dfs.sh) as root.
There is a HADOOP_OPTS setting in bin/hadoop file in case EUID equals 0 :
...
elif [ "$COMMAND" = "datanode" ] ; then
CLASS='org.apache.hadoop.hdfs.server.datanode.DataNode'
if [[ $EUID -eq 0 ]]; then
HADOOP_OPTS="$HADOOP_OPTS -jvm server $HADOOP_DATANODE_OPTS"
else
HADOOP_OPTS="$HADOOP_OPTS -server $HADOOP_DATANODE_OPTS"
fi
elif ...
Since -jvm is not a recognized option by Sun HotSpot Java JVM (64-bit), an error message is generated:
Unrecognized option: -jvm
Could not create the Java virtual machine.
If you replace -jvm server option with -server, DataNode will start up.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
From common-dev-return-77779-apmail-hadoop-common-dev-archive=hadoop.apache.org@hadoop.apache.org Sat Feb 18 21:30:24 2012
Return-Path: <common-dev-return-77779-apmail-hadoop-common-dev-archive=hadoop.apache.org@hadoop.apache.org>
X-Original-To: apmail-hadoop-common-dev-archive@www.apache.org
Delivered-To: apmail-hadoop-common-dev-archive@www.apache.org
Received: from mail.apache.org (hermes.apache.org [140.211.11.3])
by minotaur.apache.org (Postfix) with SMTP id 7BC379D60
for <apmail-hadoop-common-dev-archive@www.apache.org>; Sat, 18 Feb 2012 21:30:24 +0000 (UTC)
Received: (qmail 42632 invoked by uid 500); 18 Feb 2012 21:30:22 -0000
Delivered-To: apmail-hadoop-common-dev-archive@hadoop.apache.org
Received: (qmail 42568 invoked by uid 500); 18 Feb 2012 21:30:22 -0000
Mailing-List: contact common-dev-help@hadoop.apache.org; run by ezmlm
Precedence: bulk
List-Help: <mailto:common-dev-help@hadoop.apache.org>
List-Unsubscribe: <mailto:common-dev-unsubscribe@hadoop.apache.org>
List-Post: <mailto:common-dev@hadoop.apache.org>
List-Id: <common-dev.hadoop.apache.org>
Reply-To: common-dev@hadoop.apache.org
Delivered-To: mailing list common-dev@hadoop.apache.org
Received: (qmail 42559 invoked by uid 99); 18 Feb 2012 21:30:22 -0000
Received: from nike.apache.org (HELO nike.apache.org) (192.87.106.230)
by apache.org (qpsmtpd/0.29) with ESMTP; Sat, 18 Feb 2012 21:30:22 +0000
X-ASF-Spam-Status: No, hits=-2000.0 required=5.0
tests=ALL_TRUSTED,T_RP_MATCHES_RCVD
X-Spam-Check-By: apache.org
Received: from [140.211.11.116] (HELO hel.zones.apache.org) (140.211.11.116)
by apache.org (qpsmtpd/0.29) with ESMTP; Sat, 18 Feb 2012 21:30:20 +0000
Received: from hel.zones.apache.org (hel.zones.apache.org [140.211.11.116])
by hel.zones.apache.org (Postfix) with ESMTP id AD4671BF6FD
for <common-dev@hadoop.apache.org>; Sat, 18 Feb 2012 21:29:59 +0000 (UTC)
Date: Sat, 18 Feb 2012 21:29:59 +0000 (UTC)
From: "Steve Loughran (Resolved) (JIRA)" <jira@apache.org>
To: common-dev@hadoop.apache.org
Message-ID: <536980847.54976.1329600599711.JavaMail.tomcat@hel.zones.apache.org>
Subject: [jira] [Resolved] (HADOOP-3456) IPC.Client connect timeout should
be configurable
MIME-Version: 1.0
Content-Type: text/plain; charset=utf-8
Content-Transfer-Encoding: 7bit
X-JIRA-FingerPrint: 30527f35849b9dde25b450d4833f0394
X-Virus-Checked: Checked by ClamAV on apache.org
[ https://issues.apache.org/jira/browse/HADOOP-3456?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Steve Loughran resolved HADOOP-3456.
------------------------------------
Resolution: Duplicate
> IPC.Client connect timeout should be configurable
> -------------------------------------------------
>
> Key: HADOOP-3456
> URL: https://issues.apache.org/jira/browse/HADOOP-3456
> Project: Hadoop Common
> Issue Type: Improvement
> Components: ipc
> Affects Versions: 0.18.0
> Reporter: Steve Loughran
> Assignee: Steve Loughran
> Priority: Minor
>
> In ipc.Client.setupIOStreams, the connect timeout is hard-coded to 20 seconds
> // connection time out is 20s
> this.socket.connect(remoteId.getAddress(), 20000);
> This could be made configurable for deployments where a longer connect time is desired, or where a shorter connect time would detect failure faster.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
From common-dev-return-77780-apmail-hadoop-common-dev-archive=hadoop.apache.org@hadoop.apache.org Sun Feb 19 09:19:59 2012
Return-Path: <common-dev-return-77780-apmail-hadoop-common-dev-archive=hadoop.apache.org@hadoop.apache.org>
X-Original-To: apmail-hadoop-common-dev-archive@www.apache.org
Delivered-To: apmail-hadoop-common-dev-archive@www.apache.org
Received: from mail.apache.org (hermes.apache.org [140.211.11.3])
by minotaur.apache.org (Postfix) with SMTP id C11459A69
for <apmail-hadoop-common-dev-archive@www.apache.org>; Sun, 19 Feb 2012 09:19:59 +0000 (UTC)
Received: (qmail 43691 invoked by uid 500); 19 Feb 2012 09:19:58 -0000
Delivered-To: apmail-hadoop-common-dev-archive@hadoop.apache.org
Received: (qmail 43602 invoked by uid 500); 19 Feb 2012 09:19:57 -0000
Mailing-List: contact common-dev-help@hadoop.apache.org; run by ezmlm
Precedence: bulk
List-Help: <mailto:common-dev-help@hadoop.apache.org>
List-Unsubscribe: <mailto:common-dev-unsubscribe@hadoop.apache.org>
List-Post: <mailto:common-dev@hadoop.apache.org>
List-Id: <common-dev.hadoop.apache.org>
Reply-To: common-dev@hadoop.apache.org
Delivered-To: mailing list common-dev@hadoop.apache.org
Received: (qmail 43586 invoked by uid 99); 19 Feb 2012 09:19:57 -0000
Received: from athena.apache.org (HELO athena.apache.org) (140.211.11.136)
by apache.org (qpsmtpd/0.29) with ESMTP; Sun, 19 Feb 2012 09:19:57 +0000
X-ASF-Spam-Status: No, hits=-2000.0 required=5.0
tests=ALL_TRUSTED
X-Spam-Check-By: apache.org
Received: from [140.211.11.8] (HELO aegis.apache.org) (140.211.11.8)
by apache.org (qpsmtpd/0.29) with ESMTP; Sun, 19 Feb 2012 09:19:55 +0000
Received: from aegis (localhost [127.0.0.1])
by aegis.apache.org (Postfix) with ESMTP id 3D487C00E8
for <common-dev@hadoop.apache.org>; Sun, 19 Feb 2012 09:19:35 +0000 (UTC)
Date: Sun, 19 Feb 2012 09:19:35 +0000 (UTC)
From: Apache Jenkins Server <jenkins@builds.apache.org>
To: common-dev@hadoop.apache.org
Message-ID: <316508270.3411329643175235.JavaMail.hudson@aegis>
Subject: Build failed in Jenkins: Hadoop-Common-0.23-Build #168
MIME-Version: 1.0
Content-Type: text/plain; charset=UTF-8
Content-Transfer-Encoding: 7bit
X-Jenkins-Job: Hadoop-Common-0.23-Build
X-Jenkins-Result: FAILURE
See <https://builds.apache.org/job/Hadoop-Common-0.23-Build/168/changes>
Changes:
[stevel] HADOOP-7680 TestHardLink fails on Mac OS X, when gnu stat is in path.
[stevel] HADOOP-8057 hadoop-setup-conf.sh not working because of some extra spaces.
[stevel] HDFS-2725 script to mention dfs command
[stevel] revert accidental indentation
[stevel] MAPREDUCE-3877 Add a test to formalise the current state transitions of the yarn lifecycle
[stevel] MAPREDUCE-3877 Add a test to formalise the current state transitions of the yarn lifecycle
[stevel] HADOOP-8046 Revert StaticMapping semantics to the existing ones, add DNS mapping diagnostics in progress
------------------------------------------
[...truncated 12269 lines...]
[javadoc] Loading source files for package org.apache.hadoop.fs.permission...
[javadoc] Loading source files for package org.apache.hadoop.fs.s3...
[javadoc] Loading source files for package org.apache.hadoop.fs.s3native...
[javadoc] Loading source files for package org.apache.hadoop.fs.shell...
[javadoc] Loading source files for package org.apache.hadoop.fs.viewfs...
[javadoc] Loading source files for package org.apache.hadoop.http...
[javadoc] Loading source files for package org.apache.hadoop.http.lib...
[javadoc] Loading source files for package org.apache.hadoop.io...
[javadoc] Loading source files for package org.apache.hadoop.io.compress...
[javadoc] Loading source files for package org.apache.hadoop.io.compress.bzip2...
[javadoc] Loading source files for package org.apache.hadoop.io.compress.lz4...
[javadoc] Loading source files for package org.apache.hadoop.io.compress.snappy...
[javadoc] Loading source files for package org.apache.hadoop.io.compress.zlib...
[javadoc] Loading source files for package org.apache.hadoop.io.file.tfile...
[javadoc] Loading source files for package org.apache.hadoop.io.nativeio...
[javadoc] Loading source files for package org.apache.hadoop.io.retry...
[javadoc] Loading source files for package org.apache.hadoop.io.serializer...
[javadoc] Loading source files for package org.apache.hadoop.io.serializer.avro...
[javadoc] Loading source files for package org.apache.hadoop.ipc...
[javadoc] Loading source files for package org.apache.hadoop.ipc.metrics...
[javadoc] Loading source files for package org.apache.hadoop.jmx...
[javadoc] Loading source files for package org.apache.hadoop.log...
[javadoc] Loading source files for package org.apache.hadoop.log.metrics...
[javadoc] Loading source files for package org.apache.hadoop.metrics...
[javadoc] Loading source files for package org.apache.hadoop.metrics.file...
[javadoc] Loading source files for package org.apache.hadoop.metrics.ganglia...
[javadoc] Loading source files for package org.apache.hadoop.metrics.jvm...
[javadoc] Loading source files for package org.apache.hadoop.metrics.spi...
[javadoc] Loading source files for package org.apache.hadoop.metrics.util...
[javadoc] Loading source files for package org.apache.hadoop.metrics2...
[javadoc] Loading source files for package org.apache.hadoop.metrics2.annotation...
[javadoc] Loading source files for package org.apache.hadoop.metrics2.filter...
[javadoc] Loading source files for package org.apache.hadoop.metrics2.impl...
[javadoc] Loading source files for package org.apache.hadoop.metrics2.lib...
[javadoc] Loading source files for package org.apache.hadoop.metrics2.sink...
[javadoc] Loading source files for package org.apache.hadoop.metrics2.sink.ganglia...
[javadoc] Loading source files for package org.apache.hadoop.metrics2.source...
[javadoc] Loading source files for package org.apache.hadoop.metrics2.util...
[javadoc] Loading source files for package org.apache.hadoop.net...
[javadoc] Loading source files for package org.apache.hadoop.record...
[javadoc] Loading source files for package org.apache.hadoop.record.compiler...
[javadoc] Loading source files for package org.apache.hadoop.record.compiler.ant...
[javadoc] Loading source files for package org.apache.hadoop.record.compiler.generated...
[javadoc] Loading source files for package org.apache.hadoop.record.meta...
[javadoc] Loading source files for package org.apache.hadoop.security...
[javadoc] Loading source files for package org.apache.hadoop.security.authorize...
[javadoc] Loading source files for package org.apache.hadoop.security.token...
[javadoc] Loading source files for package org.apache.hadoop.security.token.delegation...
[javadoc] Loading source files for package org.apache.hadoop.tools...
[javadoc] Loading source files for package org.apache.hadoop.util...
[javadoc] Loading source files for package org.apache.hadoop.util.bloom...
[javadoc] Loading source files for package org.apache.hadoop.util.hash...
[javadoc] 2 errors
[xslt] Processing <https://builds.apache.org/job/Hadoop-Common-0.23-Build/ws/trunk/hadoop-common-project/hadoop-common/target/findbugsXml.xml> to <https://builds.apache.org/job/Hadoop-Common-0.23-Build/ws/trunk/hadoop-common-project/hadoop-common/target/site/findbugs.html>
[xslt] Loading stylesheet /home/jenkins/tools/findbugs/latest/src/xsl/default.xsl
[INFO] Executed tasks
[INFO]
[INFO] --- maven-antrun-plugin:1.6:run (pre-dist) @ hadoop-common ---
[INFO] Executing tasks
main:
[INFO] Executed tasks
[INFO]
[INFO] >>> maven-javadoc-plugin:2.8.1:javadoc (default) @ hadoop-common >>>
[INFO]
[INFO] --- maven-antrun-plugin:1.6:run (create-testdirs) @ hadoop-common ---
[INFO] Executing tasks
main:
[INFO] Executed tasks
[INFO]
[INFO] --- build-helper-maven-plugin:1.5:add-source (add-source) @ hadoop-common ---
[INFO] Source directory: <https://builds.apache.org/job/Hadoop-Common-0.23-Build/ws/trunk/hadoop-common-project/hadoop-common/target/generated-sources/java> added.
[INFO]
[INFO] --- maven-antrun-plugin:1.6:run (compile-proto) @ hadoop-common ---
[INFO] Executing tasks
main:
[INFO] Executed tasks
[INFO]
[INFO] --- maven-antrun-plugin:1.6:run (save-version) @ hadoop-common ---
[INFO] Executing tasks
main:
[INFO] Executed tasks
[INFO]
[INFO] <<< maven-javadoc-plugin:2.8.1:javadoc (default) @ hadoop-common <<<
[INFO]
[INFO] --- maven-javadoc-plugin:2.8.1:javadoc (default) @ hadoop-common ---
[INFO]
ExcludePrivateAnnotationsStandardDoclet
9 warnings
[WARNING] Javadoc Warnings
[WARNING] <https://builds.apache.org/job/Hadoop-Common-0.23-Build/ws/trunk/hadoop-common-project/hadoop-common/src/main/java/org/apache/hadoop/security/SecurityUtil.java>:49: warning: sun.net.dns.ResolverConfiguration is Sun proprietary API and may be removed in a future release
[WARNING] import sun.net.dns.ResolverConfiguration;
[WARNING] ^
[WARNING] <https://builds.apache.org/job/Hadoop-Common-0.23-Build/ws/trunk/hadoop-common-project/hadoop-common/src/main/java/org/apache/hadoop/security/SecurityUtil.java>:50: warning: sun.net.util.IPAddressUtil is Sun proprietary API and may be removed in a future release
[WARNING] import sun.net.util.IPAddressUtil;
[WARNING] ^
[WARNING] <https://builds.apache.org/job/Hadoop-Common-0.23-Build/ws/trunk/hadoop-common-project/hadoop-common/src/main/java/org/apache/hadoop/security/SecurityUtil.java>:51: warning: sun.security.jgss.krb5.Krb5Util is Sun proprietary API and may be removed in a future release
[WARNING] import sun.security.jgss.krb5.Krb5Util;
[WARNING] ^
[WARNING] <https://builds.apache.org/job/Hadoop-Common-0.23-Build/ws/trunk/hadoop-common-project/hadoop-common/src/main/java/org/apache/hadoop/security/SecurityUtil.java>:52: warning: sun.security.krb5.Credentials is Sun proprietary API and may be removed in a future release
[WARNING] import sun.security.krb5.Credentials;
[WARNING] ^
[WARNING] <https://builds.apache.org/job/Hadoop-Common-0.23-Build/ws/trunk/hadoop-common-project/hadoop-common/src/main/java/org/apache/hadoop/security/SecurityUtil.java>:53: warning: sun.security.krb5.PrincipalName is Sun proprietary API and may be removed in a future release
[WARNING] import sun.security.krb5.PrincipalName;
[WARNING] ^
[WARNING] <https://builds.apache.org/job/Hadoop-Common-0.23-Build/ws/trunk/hadoop-common-project/hadoop-common/src/main/java/org/apache/hadoop/security/HadoopKerberosName.java>:28: warning: sun.security.krb5.Config is Sun proprietary API and may be removed in a future release
[WARNING] import sun.security.krb5.Config;
[WARNING] ^
[WARNING] <https://builds.apache.org/job/Hadoop-Common-0.23-Build/ws/trunk/hadoop-common-project/hadoop-common/src/main/java/org/apache/hadoop/security/HadoopKerberosName.java>:29: warning: sun.security.krb5.KrbException is Sun proprietary API and may be removed in a future release
[WARNING] import sun.security.krb5.KrbException;
[WARNING] ^
[WARNING] <https://builds.apache.org/job/Hadoop-Common-0.23-Build/ws/trunk/hadoop-common-project/hadoop-common/src/main/java/org/apache/hadoop/io/FastByteComparisons.java>:25: warning: sun.misc.Unsafe is Sun proprietary API and may be removed in a future release
[WARNING] import sun.misc.Unsafe;
[WARNING] ^
[WARNING] <https://builds.apache.org/job/Hadoop-Common-0.23-Build/ws/trunk/hadoop-common-project/hadoop-common/src/main/java/org/apache/hadoop/io/FastByteComparisons.java>:117: warning: sun.misc.Unsafe is Sun proprietary API and may be removed in a future release
[WARNING] static final Unsafe theUnsafe;
[WARNING] ^
[INFO]
[INFO] --- maven-assembly-plugin:2.2.1:single (dist) @ hadoop-common ---
[WARNING] The following patterns were never triggered in this artifact exclusion filter:
o 'org.apache.ant:*:jar'
o 'jdiff:jdiff:jar'
[INFO] share/hadoop/common/jdiff/ already added, skipping
[INFO] Copying files to <https://builds.apache.org/job/Hadoop-Common-0.23-Build/ws/trunk/hadoop-common-project/hadoop-common/target/hadoop-common-0.23.2-SNAPSHOT>
[INFO] share/hadoop/common/jdiff/ already added, skipping
[INFO]
[INFO] --- maven-jar-plugin:2.3.1:jar (default-jar) @ hadoop-common ---
[INFO]
[INFO] --- maven-source-plugin:2.1.2:jar-no-fork (hadoop-java-sources) @ hadoop-common ---
[INFO] org already added, skipping
[INFO] org/apache already added, skipping
[INFO] org/apache/hadoop already added, skipping
[INFO] Building jar: <https://builds.apache.org/job/Hadoop-Common-0.23-Build/ws/trunk/hadoop-common-project/hadoop-common/target/hadoop-common-0.23.2-SNAPSHOT-sources.jar>
[INFO] org already added, skipping
[INFO] org/apache already added, skipping
[INFO] org/apache/hadoop already added, skipping
[WARNING] Artifact org.apache.hadoop:hadoop-common:java-source:sources:0.23.2-SNAPSHOT already attached to project, ignoring duplicate
[INFO]
[INFO] --- maven-site-plugin:3.0:attach-descriptor (attach-descriptor) @ hadoop-common ---
[INFO]
[INFO] --- maven-antrun-plugin:1.6:run (tar) @ hadoop-common ---
[INFO] Executing tasks
main:
[INFO] Executed tasks
[INFO]
[INFO] --- maven-javadoc-plugin:2.8.1:jar (module-javadocs) @ hadoop-common ---
[INFO]
ExcludePrivateAnnotationsStandardDoclet
9 warnings
[WARNING] Javadoc Warnings
[WARNING] <https://builds.apache.org/job/Hadoop-Common-0.23-Build/ws/trunk/hadoop-common-project/hadoop-common/src/main/java/org/apache/hadoop/security/SecurityUtil.java>:49: warning: sun.net.dns.ResolverConfiguration is Sun proprietary API and may be removed in a future release
[WARNING] import sun.net.dns.ResolverConfiguration;
[WARNING] ^
[WARNING] <https://builds.apache.org/job/Hadoop-Common-0.23-Build/ws/trunk/hadoop-common-project/hadoop-common/src/main/java/org/apache/hadoop/security/SecurityUtil.java>:50: warning: sun.net.util.IPAddressUtil is Sun proprietary API and may be removed in a future release
[WARNING] import sun.net.util.IPAddressUtil;
[WARNING] ^
[WARNING] <https://builds.apache.org/job/Hadoop-Common-0.23-Build/ws/trunk/hadoop-common-project/hadoop-common/src/main/java/org/apache/hadoop/security/SecurityUtil.java>:51: warning: sun.security.jgss.krb5.Krb5Util is Sun proprietary API and may be removed in a future release
[WARNING] import sun.security.jgss.krb5.Krb5Util;
[WARNING] ^
[WARNING] <https://builds.apache.org/job/Hadoop-Common-0.23-Build/ws/trunk/hadoop-common-project/hadoop-common/src/main/java/org/apache/hadoop/security/SecurityUtil.java>:52: warning: sun.security.krb5.Credentials is Sun proprietary API and may be removed in a future release
[WARNING] import sun.security.krb5.Credentials;
[WARNING] ^
[WARNING] <https://builds.apache.org/job/Hadoop-Common-0.23-Build/ws/trunk/hadoop-common-project/hadoop-common/src/main/java/org/apache/hadoop/security/SecurityUtil.java>:53: warning: sun.security.krb5.PrincipalName is Sun proprietary API and may be removed in a future release
[WARNING] import sun.security.krb5.PrincipalName;
[WARNING] ^
[WARNING] <https://builds.apache.org/job/Hadoop-Common-0.23-Build/ws/trunk/hadoop-common-project/hadoop-common/src/main/java/org/apache/hadoop/security/HadoopKerberosName.java>:28: warning: sun.security.krb5.Config is Sun proprietary API and may be removed in a future release
[WARNING] import sun.security.krb5.Config;
[WARNING] ^
[WARNING] <https://builds.apache.org/job/Hadoop-Common-0.23-Build/ws/trunk/hadoop-common-project/hadoop-common/src/main/java/org/apache/hadoop/security/HadoopKerberosName.java>:29: warning: sun.security.krb5.KrbException is Sun proprietary API and may be removed in a future release
[WARNING] import sun.security.krb5.KrbException;
[WARNING] ^
[WARNING] <https://builds.apache.org/job/Hadoop-Common-0.23-Build/ws/trunk/hadoop-common-project/hadoop-common/src/main/java/org/apache/hadoop/io/FastByteComparisons.java>:25: warning: sun.misc.Unsafe is Sun proprietary API and may be removed in a future release
[WARNING] import sun.misc.Unsafe;
[WARNING] ^
[WARNING] <https://builds.apache.org/job/Hadoop-Common-0.23-Build/ws/trunk/hadoop-common-project/hadoop-common/src/main/java/org/apache/hadoop/io/FastByteComparisons.java>:117: warning: sun.misc.Unsafe is Sun proprietary API and may be removed in a future release
[WARNING] static final Unsafe theUnsafe;
[WARNING] ^
[INFO] Building jar: <https://builds.apache.org/job/Hadoop-Common-0.23-Build/ws/trunk/hadoop-common-project/hadoop-common/target/hadoop-common-0.23.2-SNAPSHOT-javadoc.jar>
[INFO]
[INFO] --- maven-checkstyle-plugin:2.6:checkstyle (default-cli) @ hadoop-common ---
[INFO]
[INFO] There are 8471 checkstyle errors.
[WARNING] Unable to locate Source XRef to link to - DISABLED
[INFO]
[INFO] --- findbugs-maven-plugin:2.3.2:findbugs (default-cli) @ hadoop-common ---
[INFO] ****** FindBugsMojo execute *******
[INFO] canGenerate is true
[INFO] ****** FindBugsMojo executeFindbugs *******
[INFO] Temp File is <https://builds.apache.org/job/Hadoop-Common-0.23-Build/ws/trunk/hadoop-common-project/hadoop-common/target/findbugsTemp.xml>
[INFO] Fork Value is true
[java] The following classes needed for analysis were missing:
[java] org.codehaus.jackson.FormatSchema
[java] org.codehaus.jackson.format.InputAccessor
[java] Missing classes: 1
[INFO] xmlOutput is false
[INFO]
[INFO] ------------------------------------------------------------------------
[INFO] Building Apache Hadoop Common Project 0.23.2-SNAPSHOT
[INFO] ------------------------------------------------------------------------
[INFO]
[INFO] --- maven-clean-plugin:2.4.1:clean (default-clean) @ hadoop-common-project ---
[INFO] Deleting <https://builds.apache.org/job/Hadoop-Common-0.23-Build/ws/trunk/hadoop-common-project/target>
[INFO]
[INFO] --- maven-antrun-plugin:1.6:run (create-testdirs) @ hadoop-common-project ---
[INFO] Executing tasks
main:
[mkdir] Created dir: <https://builds.apache.org/job/Hadoop-Common-0.23-Build/ws/trunk/hadoop-common-project/target/test-dir>
[INFO] Executed tasks
[INFO]
[INFO] --- maven-source-plugin:2.1.2:jar-no-fork (hadoop-java-sources) @ hadoop-common-project ---
[INFO]
[INFO] --- maven-site-plugin:3.0:attach-descriptor (attach-descriptor) @ hadoop-common-project ---
[INFO]
[INFO] --- maven-javadoc-plugin:2.8.1:jar (module-javadocs) @ hadoop-common-project ---
[INFO] Not executing Javadoc as the project is not a Java classpath-capable package
[INFO]
[INFO] --- maven-checkstyle-plugin:2.6:checkstyle (default-cli) @ hadoop-common-project ---
[INFO]
[INFO] --- findbugs-maven-plugin:2.3.2:findbugs (default-cli) @ hadoop-common-project ---
[INFO] ****** FindBugsMojo execute *******
[INFO] canGenerate is false
[INFO] ------------------------------------------------------------------------
[INFO] Reactor Summary:
[INFO]
[INFO] Apache Hadoop Annotations ......................... SUCCESS [13.468s]
[INFO] Apache Hadoop Auth ................................ SUCCESS [18.323s]
[INFO] Apache Hadoop Auth Examples ....................... SUCCESS [7.886s]
[INFO] Apache Hadoop Common .............................. SUCCESS [4:00.285s]
[INFO] Apache Hadoop Common Project ...................... SUCCESS [0.032s]
[INFO] ------------------------------------------------------------------------
[INFO] BUILD SUCCESS
[INFO] ------------------------------------------------------------------------
[INFO] Total time: 4:41.194s
[INFO] Finished at: Sun Feb 19 09:09:54 UTC 2012
[INFO] Final Memory: 82M/809M
[INFO] ------------------------------------------------------------------------
+ /home/jenkins/tools/maven/latest/bin/mvn test -Pclover -DcloverLicenseLocation=/home/jenkins/tools/clover/latest/lib/clover.license
Build step 'Execute shell' marked build as failure
[WARNINGS] Skipping publisher since build result is FAILURE
Archiving artifacts
Recording fingerprints
Publishing Javadoc
Recording test results
From common-dev-return-77781-apmail-hadoop-common-dev-archive=hadoop.apache.org@hadoop.apache.org Sun Feb 19 09:20:43 2012
Return-Path: <common-dev-return-77781-apmail-hadoop-common-dev-archive=hadoop.apache.org@hadoop.apache.org>
X-Original-To: apmail-hadoop-common-dev-archive@www.apache.org
Delivered-To: apmail-hadoop-common-dev-archive@www.apache.org
Received: from mail.apache.org (hermes.apache.org [140.211.11.3])
by minotaur.apache.org (Postfix) with SMTP id 8155E9AA0
for <apmail-hadoop-common-dev-archive@www.apache.org>; Sun, 19 Feb 2012 09:20:43 +0000 (UTC)
Received: (qmail 46383 invoked by uid 500); 19 Feb 2012 09:20:42 -0000
Delivered-To: apmail-hadoop-common-dev-archive@hadoop.apache.org
Received: (qmail 46218 invoked by uid 500); 19 Feb 2012 09:20:41 -0000
Mailing-List: contact common-dev-help@hadoop.apache.org; run by ezmlm
Precedence: bulk
List-Help: <mailto:common-dev-help@hadoop.apache.org>
List-Unsubscribe: <mailto:common-dev-unsubscribe@hadoop.apache.org>
List-Post: <mailto:common-dev@hadoop.apache.org>
List-Id: <common-dev.hadoop.apache.org>
Reply-To: common-dev@hadoop.apache.org
Delivered-To: mailing list common-dev@hadoop.apache.org
Received: (qmail 46177 invoked by uid 99); 19 Feb 2012 09:20:41 -0000
Received: from athena.apache.org (HELO athena.apache.org) (140.211.11.136)
by apache.org (qpsmtpd/0.29) with ESMTP; Sun, 19 Feb 2012 09:20:41 +0000
X-ASF-Spam-Status: No, hits=-2000.0 required=5.0
tests=ALL_TRUSTED
X-Spam-Check-By: apache.org
Received: from [140.211.11.8] (HELO aegis.apache.org) (140.211.11.8)
by apache.org (qpsmtpd/0.29) with ESMTP; Sun, 19 Feb 2012 09:20:39 +0000
Received: from aegis (localhost [127.0.0.1])
by aegis.apache.org (Postfix) with ESMTP id 4B2FBC00E8
for <common-dev@hadoop.apache.org>; Sun, 19 Feb 2012 09:20:19 +0000 (UTC)
Date: Sun, 19 Feb 2012 09:20:19 +0000 (UTC)
From: Apache Jenkins Server <jenkins@builds.apache.org>
To: common-dev@hadoop.apache.org
Message-ID: <594173252.3421329643219306.JavaMail.hudson@aegis>
Subject: Build failed in Jenkins: Hadoop-Common-trunk #322
MIME-Version: 1.0
Content-Type: text/plain; charset=UTF-8
Content-Transfer-Encoding: quoted-printable
X-Jenkins-Job: Hadoop-Common-trunk
X-Jenkins-Result: FAILURE
See <https://builds.apache.org/job/Hadoop-Common-trunk/322/changes>
Changes:
[stevel] HADOOP-7680 TestHardLink fails on Mac OS X, when gnu stat is in pa=
th.
[stevel] HADOOP-8057 hadoop-setup-conf.sh not working because of some extra=
spaces.
[stevel] HDFS-2725 script to mention dfs command
[stevel] MAPREDUCE-3877 Add a test to formalise the current state transitio=
ns of the yarn lifecycle
[stevel] HADOOP-8046 Revert StaticMapping semantics to the existing ones, a=
dd DNS mapping diagnostics in progress
------------------------------------------
[...truncated 43867 lines...]
[DEBUG] (f) reactorProjects =3D [MavenProject: org.apache.hadoop:hadoop-a=
nnotations:0.24.0-SNAPSHOT @ <https://builds.apache.org/job/Hadoop-Common-t=
runk/ws/trunk/hadoop-common-project/hadoop-annotations/pom.xml,> MavenProje=
ct: org.apache.hadoop:hadoop-auth:0.24.0-SNAPSHOT @ <https://builds.apache.=
org/job/Hadoop-Common-trunk/ws/trunk/hadoop-common-project/hadoop-auth/pom.=
xml,> MavenProject: org.apache.hadoop:hadoop-auth-examples:0.24.0-SNAPSHOT =
@ <https://builds.apache.org/job/Hadoop-Common-trunk/ws/trunk/hadoop-common=
-project/hadoop-auth-examples/pom.xml,> MavenProject: org.apache.hadoop:had=
oop-common:0.24.0-SNAPSHOT @ <https://builds.apache.org/job/Hadoop-Common-t=
runk/ws/trunk/hadoop-common-project/hadoop-common/pom.xml,> MavenProject: o=
rg.apache.hadoop:hadoop-common-project:0.24.0-SNAPSHOT @ <https://builds.ap=
ache.org/job/Hadoop-Common-trunk/ws/trunk/hadoop-common-project/pom.xml]>
[DEBUG] (f) useDefaultExcludes =3D true
[DEBUG] (f) useDefaultManifestFile =3D false
[DEBUG] -- end configuration --
[INFO]=20
[INFO] --- maven-enforcer-plugin:1.0:enforce (dist-enforce) @ hadoop-common=
-project ---
[DEBUG] Configuring mojo org.apache.maven.plugins:maven-enforcer-plugin:1.0=
:enforce from plugin realm ClassRealm[plugin>org.apache.maven.plugins:maven=
-enforcer-plugin:1.0, parent: sun.misc.Launcher$AppClassLoader@126b249]
[DEBUG] Configuring mojo 'org.apache.maven.plugins:maven-enforcer-plugin:1.=
0:enforce' with basic configurator -->
[DEBUG] (s) fail =3D true
[DEBUG] (s) failFast =3D false
[DEBUG] (f) ignoreCache =3D false
[DEBUG] (s) project =3D MavenProject: org.apache.hadoop:hadoop-common-pro=
ject:0.24.0-SNAPSHOT @ <https://builds.apache.org/job/Hadoop-Common-trunk/w=
s/trunk/hadoop-common-project/pom.xml>
[DEBUG] (s) version =3D [3.0.2,)
[DEBUG] (s) version =3D 1.6
[DEBUG] (s) rules =3D [org.apache.maven.plugins.enforcer.RequireMavenVers=
ion@131a06e, org.apache.maven.plugins.enforcer.RequireJavaVersion@11b9b7f]
[DEBUG] (s) session =3D org.apache.maven.execution.MavenSession@12ddfe4
[DEBUG] (s) skip =3D false
[DEBUG] -- end configuration --
[DEBUG] Executing rule: org.apache.maven.plugins.enforcer.RequireMavenVersi=
on
[DEBUG] Rule org.apache.maven.plugins.enforcer.RequireMavenVersion is cache=
able.
[DEBUG] Key org.apache.maven.plugins.enforcer.RequireMavenVersion -93731219=
7 was found in the cache
[DEBUG] The cached results are still valid. Skipping the rule: org.apache.m=
aven.plugins.enforcer.RequireMavenVersion
[DEBUG] Executing rule: org.apache.maven.plugins.enforcer.RequireJavaVersio=
n
[DEBUG] Rule org.apache.maven.plugins.enforcer.RequireJavaVersion is cachea=
ble.
[DEBUG] Key org.apache.maven.plugins.enforcer.RequireJavaVersion 48569 was =
found in the cache
[DEBUG] The cached results are still valid. Skipping the rule: org.apache.m=
aven.plugins.enforcer.RequireJavaVersion
[INFO]=20
[INFO] --- maven-site-plugin:3.0:attach-descriptor (attach-descriptor) @ ha=
doop-common-project ---
[DEBUG] Configuring mojo org.apache.maven.plugins:maven-site-plugin:3.0:att=
ach-descriptor from plugin realm ClassRealm[plugin>org.apache.maven.plugins=
:maven-site-plugin:3.0, parent: sun.misc.Launcher$AppClassLoader@126b249]
[DEBUG] Configuring mojo 'org.apache.maven.plugins:maven-site-plugin:3.0:at=
tach-descriptor' with basic configurator -->
[DEBUG] (f) basedir =3D <https://builds.apache.org/job/Hadoop-Common-trun=
k/ws/trunk/hadoop-common-project>
[DEBUG] (f) inputEncoding =3D UTF-8
[DEBUG] (f) localRepository =3D id: local
url: file:///home/jenkins/.m2/repository/
layout: none
[DEBUG] (f) outputEncoding =3D UTF-8
[DEBUG] (f) pomPackagingOnly =3D true
[DEBUG] (f) project =3D MavenProject: org.apache.hadoop:hadoop-common-pro=
ject:0.24.0-SNAPSHOT @ <https://builds.apache.org/job/Hadoop-Common-trunk/w=
s/trunk/hadoop-common-project/pom.xml>
[DEBUG] (f) reactorProjects =3D [MavenProject: org.apache.hadoop:hadoop-a=
nnotations:0.24.0-SNAPSHOT @ <https://builds.apache.org/job/Hadoop-Common-t=
runk/ws/trunk/hadoop-common-project/hadoop-annotations/pom.xml,> MavenProje=
ct: org.apache.hadoop:hadoop-auth:0.24.0-SNAPSHOT @ <https://builds.apache.=
org/job/Hadoop-Common-trunk/ws/trunk/hadoop-common-project/hadoop-auth/pom.=
xml,> MavenProject: org.apache.hadoop:hadoop-auth-examples:0.24.0-SNAPSHOT =
@ <https://builds.apache.org/job/Hadoop-Common-trunk/ws/trunk/hadoop-common=
-project/hadoop-auth-examples/pom.xml,> MavenProject: org.apache.hadoop:had=
oop-common:0.24.0-SNAPSHOT @ <https://builds.apache.org/job/Hadoop-Common-t=
runk/ws/trunk/hadoop-common-project/hadoop-common/pom.xml,> MavenProject: o=
rg.apache.hadoop:hadoop-common-project:0.24.0-SNAPSHOT @ <https://builds.ap=
ache.org/job/Hadoop-Common-trunk/ws/trunk/hadoop-common-project/pom.xml]>
[DEBUG] (f) siteDirectory =3D <https://builds.apache.org/job/Hadoop-Commo=
n-trunk/ws/trunk/hadoop-common-project/src/site>
[DEBUG] -- end configuration --
[DEBUG] Mapped url: <https://builds.apache.org/job/Hadoop-Common-trunk/ws/t=
runk/hadoop-common-project/src/site> to relative path: src/site
[INFO]=20
[INFO] --- maven-javadoc-plugin:2.8.1:jar (module-javadocs) @ hadoop-common=
-project ---
[DEBUG] Configuring mojo org.apache.maven.plugins:maven-javadoc-plugin:2.8.=
1:jar from plugin realm ClassRealm[plugin>org.apache.maven.plugins:maven-ja=
vadoc-plugin:2.8.1, parent: sun.misc.Launcher$AppClassLoader@126b249]
[DEBUG] Configuring mojo 'org.apache.maven.plugins:maven-javadoc-plugin:2.8=
.1:jar' with basic configurator -->
[DEBUG] (f) aggregate =3D false
[DEBUG] (f) attach =3D true
[DEBUG] (f) author =3D true
[DEBUG] (f) bootclasspathArtifacts =3D []
[DEBUG] (f) bottom =3D Copyright &#169; {inceptionYear}-{currentYear} {or=
ganizationName}. All Rights Reserved.
[DEBUG] (f) breakiterator =3D false
[DEBUG] (f) debug =3D false
[DEBUG] (f) defaultManifestFile =3D <https://builds.apache.org/job/Hadoop=
-Common-trunk/ws/trunk/hadoop-common-project/target/classes/META-INF/MANIFE=
ST.MF>
[DEBUG] (f) destDir =3D <https://builds.apache.org/job/Hadoop-Common-trun=
k/ws/trunk/hadoop-common-project/target>
[DEBUG] (f) detectJavaApiLink =3D true
[DEBUG] (f) detectLinks =3D false
[DEBUG] (f) detectOfflineLinks =3D true
[DEBUG] (f) docencoding =3D UTF-8
[DEBUG] (f) docfilessubdirs =3D false
[DEBUG] (f) docletArtifact =3D groupId =3D 'null'
artifactId =3D 'null'
version =3D 'null'
[DEBUG] (f) docletArtifacts =3D []
[DEBUG] (f) doctitle =3D Apache Hadoop Common Project 0.24.0-SNAPSHOT API
[DEBUG] (f) encoding =3D UTF-8
[DEBUG] (f) failOnError =3D true
[DEBUG] (f) finalName =3D hadoop-common-project-0.24.0-SNAPSHOT
[DEBUG] (f) groups =3D []
[DEBUG] (f) includeDependencySources =3D false
[DEBUG] (f) includeTransitiveDependencySources =3D false
[DEBUG] (f) isOffline =3D false
[DEBUG] (f) jarOutputDirectory =3D <https://builds.apache.org/job/Hadoop-=
Common-trunk/ws/trunk/hadoop-common-project/target>
[DEBUG] (f) javaApiLinks =3D {}
[DEBUG] (f) javadocDirectory =3D <https://builds.apache.org/job/Hadoop-Co=
mmon-trunk/ws/trunk/hadoop-common-project/src/main/javadoc>
[DEBUG] (f) javadocOptionsDir =3D <https://builds.apache.org/job/Hadoop-C=
ommon-trunk/ws/trunk/hadoop-common-project/target/javadoc-bundle-options>
[DEBUG] (f) keywords =3D false
[DEBUG] (f) links =3D []
[DEBUG] (f) linksource =3D false
[DEBUG] (f) localRepository =3D id: local
url: file:///home/jenkins/.m2/repository/
layout: none
[DEBUG] (f) nocomment =3D false
[DEBUG] (f) nodeprecated =3D false
[DEBUG] (f) nodeprecatedlist =3D false
[DEBUG] (f) nohelp =3D false
[DEBUG] (f) noindex =3D false
[DEBUG] (f) nonavbar =3D false
[DEBUG] (f) nooverview =3D false
[DEBUG] (f) nosince =3D false
[DEBUG] (f) notimestamp =3D false
[DEBUG] (f) notree =3D false
[DEBUG] (f) offlineLinks =3D []
[DEBUG] (f) old =3D false
[DEBUG] (f) outputDirectory =3D <https://builds.apache.org/job/Hadoop-Com=
mon-trunk/ws/trunk/hadoop-common-project/target>
[DEBUG] (f) overview =3D <https://builds.apache.org/job/Hadoop-Common-tru=
nk/ws/trunk/hadoop-common-project/src/main/javadoc/overview.html>
[DEBUG] (f) project =3D MavenProject: org.apache.hadoop:hadoop-common-pro=
ject:0.24.0-SNAPSHOT @ <https://builds.apache.org/job/Hadoop-Common-trunk/w=
s/trunk/hadoop-common-project/pom.xml>
[DEBUG] (f) quiet =3D false
[DEBUG] (f) reactorProjects =3D [MavenProject: org.apache.hadoop:hadoop-a=
nnotations:0.24.0-SNAPSHOT @ <https://builds.apache.org/job/Hadoop-Common-t=
runk/ws/trunk/hadoop-common-project/hadoop-annotations/pom.xml,> MavenProje=
ct: org.apache.hadoop:hadoop-auth:0.24.0-SNAPSHOT @ <https://builds.apache.=
org/job/Hadoop-Common-trunk/ws/trunk/hadoop-common-project/hadoop-auth/pom.=
xml,> MavenProject: org.apache.hadoop:hadoop-auth-examples:0.24.0-SNAPSHOT =
@ <https://builds.apache.org/job/Hadoop-Common-trunk/ws/trunk/hadoop-common=
-project/hadoop-auth-examples/pom.xml,> MavenProject: org.apache.hadoop:had=
oop-common:0.24.0-SNAPSHOT @ <https://builds.apache.org/job/Hadoop-Common-t=
runk/ws/trunk/hadoop-common-project/hadoop-common/pom.xml,> MavenProject: o=
rg.apache.hadoop:hadoop-common-project:0.24.0-SNAPSHOT @ <https://builds.ap=
ache.org/job/Hadoop-Common-trunk/ws/trunk/hadoop-common-project/pom.xml]>
[DEBUG] (f) remoteRepositories =3D [ id: apache.snapshots.https
url: https://repository.apache.org/content/repositories/snapshots
layout: default
snapshots: [enabled =3D> true, update =3D> daily]
releases: [enabled =3D> true, update =3D> daily]
, id: repository.jboss.org
url: http://repository.jboss.org/nexus/content/groups/public/
layout: default
snapshots: [enabled =3D> false, update =3D> daily]
releases: [enabled =3D> true, update =3D> daily]
, id: central
url: http://repo1.maven.org/maven2
layout: default
snapshots: [enabled =3D> false, update =3D> daily]
releases: [enabled =3D> true, update =3D> daily]
]
[DEBUG] (f) resourcesArtifacts =3D []
[DEBUG] (f) serialwarn =3D false
[DEBUG] (f) session =3D org.apache.maven.execution.MavenSession@12ddfe4
[DEBUG] (f) settings =3D org.apache.maven.execution.SettingsAdapter@121dc=
ac
[DEBUG] (f) show =3D protected
[DEBUG] (f) skip =3D false
[DEBUG] (f) sourceDependencyCacheDir =3D <https://builds.apache.org/job/H=
adoop-Common-trunk/ws/trunk/hadoop-common-project/target/distro-javadoc-sou=
rces>
[DEBUG] (f) splitindex =3D false
[DEBUG] (f) stylesheet =3D java
[DEBUG] (f) tagletArtifact =3D groupId =3D 'null'
artifactId =3D 'null'
version =3D 'null'
[DEBUG] (f) tagletArtifacts =3D []
[DEBUG] (f) taglets =3D []
[DEBUG] (f) tags =3D []
[DEBUG] (f) use =3D true
[DEBUG] (f) useDefaultManifestFile =3D false
[DEBUG] (f) useStandardDocletOptions =3D true
[DEBUG] (f) validateLinks =3D false
[DEBUG] (f) verbose =3D false
[DEBUG] (f) version =3D true
[DEBUG] (f) windowtitle =3D Apache Hadoop Common Project 0.24.0-SNAPSHOT =
API
[DEBUG] -- end configuration --
[INFO] Not executing Javadoc as the project is not a Java classpath-capable=
package
[INFO]=20
[INFO] --- maven-checkstyle-plugin:2.6:checkstyle (default-cli) @ hadoop-co=
mmon-project ---
[DEBUG] Configuring mojo org.apache.maven.plugins:maven-checkstyle-plugin:2=
.6:checkstyle from plugin realm ClassRealm[plugin>org.apache.maven.plugins:=
maven-checkstyle-plugin:2.6, parent: sun.misc.Launcher$AppClassLoader@126b2=
49]
[DEBUG] Configuring mojo 'org.apache.maven.plugins:maven-checkstyle-plugin:=
2.6:checkstyle' with basic configurator -->
[DEBUG] (f) cacheFile =3D <https://builds.apache.org/job/Hadoop-Common-tr=
unk/ws/trunk/hadoop-common-project/target/checkstyle-cachefile>
[DEBUG] (f) configLocation =3D config/sun_checks.xml
[DEBUG] (f) consoleOutput =3D false
[DEBUG] (f) enableFilesSummary =3D true
[DEBUG] (f) enableRSS =3D true
[DEBUG] (f) enableRulesSummary =3D true
[DEBUG] (f) enableSeveritySummary =3D true
[DEBUG] (f) encoding =3D UTF-8
[DEBUG] (f) failsOnError =3D false
[DEBUG] (f) format =3D sun
[DEBUG] (f) headerFile =3D <https://builds.apache.org/job/Hadoop-Common-t=
runk/ws/trunk/hadoop-common-project/LICENSE.txt>
[DEBUG] (f) headerLocation =3D LICENSE.txt
[DEBUG] (f) includes =3D **/*.java
[DEBUG] (f) linkXRef =3D true
[DEBUG] (f) outputDirectory =3D <https://builds.apache.org/job/Hadoop-Com=
mon-trunk/ws/trunk/hadoop-common-project/target/site>
[DEBUG] (f) outputFile =3D <https://builds.apache.org/job/Hadoop-Common-t=
runk/ws/trunk/hadoop-common-project/target/checkstyle-result.xml>
[DEBUG] (f) outputFileFormat =3D xml
[DEBUG] (f) project =3D MavenProject: org.apache.hadoop:hadoop-common-pro=
ject:0.24.0-SNAPSHOT @ <https://builds.apache.org/job/Hadoop-Common-trunk/w=
s/trunk/hadoop-common-project/pom.xml>
[DEBUG] (f) skip =3D false
[DEBUG] (f) sourceDirectory =3D <https://builds.apache.org/job/Hadoop-Com=
mon-trunk/ws/trunk/hadoop-common-project/src/main/java>
[DEBUG] (f) suppressionsFileExpression =3D checkstyle.suppressions.file
[DEBUG] (f) testSourceDirectory =3D <https://builds.apache.org/job/Hadoop=
-Common-trunk/ws/trunk/hadoop-common-project/src/test/java>
[DEBUG] (f) xrefLocation =3D <https://builds.apache.org/job/Hadoop-Common=
-trunk/ws/trunk/hadoop-common-project/target/site/xref>
[DEBUG] -- end configuration --
[INFO]=20
[INFO] --- findbugs-maven-plugin:2.3.2:findbugs (default-cli) @ hadoop-comm=
on-project ---
[DEBUG] Configuring mojo org.codehaus.mojo:findbugs-maven-plugin:2.3.2:find=
bugs from plugin realm ClassRealm[plugin>org.codehaus.mojo:findbugs-maven-p=
lugin:2.3.2, parent: sun.misc.Launcher$AppClassLoader@126b249]
[DEBUG] Configuring mojo 'org.codehaus.mojo:findbugs-maven-plugin:2.3.2:fin=
dbugs' with basic configurator -->
[DEBUG] (s) classFilesDirectory =3D <https://builds.apache.org/job/Hadoop=
-Common-trunk/ws/trunk/hadoop-common-project/target/classes>
[DEBUG] (s) compileSourceRoots =3D [<https://builds.apache.org/job/Hadoop=
-Common-trunk/ws/trunk/hadoop-common-project/src/main/java]>
[DEBUG] (s) debug =3D false
[DEBUG] (s) effort =3D Default
[DEBUG] (s) failOnError =3D true
[DEBUG] (s) findbugsXmlOutput =3D false
[DEBUG] (s) findbugsXmlOutputDirectory =3D <https://builds.apache.org/job=
/Hadoop-Common-trunk/ws/trunk/hadoop-common-project/target>
[DEBUG] (s) fork =3D true
[DEBUG] (s) includeTests =3D false
[DEBUG] (s) localRepository =3D id: local
url: file:///home/jenkins/.m2/repository/
layout: none
[DEBUG] (s) maxHeap =3D 512
[DEBUG] (s) nested =3D false
[DEBUG] (s) outputDirectory =3D <https://builds.apache.org/job/Hadoop-Com=
mon-trunk/ws/trunk/hadoop-common-project/target/site>
[DEBUG] (s) outputEncoding =3D UTF-8
[DEBUG] (s) pluginArtifacts =3D [org.codehaus.mojo:findbugs-maven-plugin:=
maven-plugin:2.3.2:, com.google.code.findbugs:bcel:jar:1.3.9:compile, org.c=
odehaus.gmaven:gmaven-mojo:jar:1.3:compile, org.codehaus.gmaven.runtime:gma=
ven-runtime-api:jar:1.3:compile, org.codehaus.gmaven.feature:gmaven-feature=
-api:jar:1.3:compile, org.codehaus.gmaven.runtime:gmaven-runtime-1.5:jar:1.=
3:compile, org.codehaus.gmaven.feature:gmaven-feature-support:jar:1.3:compi=
le, org.codehaus.groovy:groovy-all-minimal:jar:1.5.8:compile, org.apache.an=
t:ant:jar:1.7.1:compile, org.apache.ant:ant-launcher:jar:1.7.1:compile, jli=
ne:jline:jar:0.9.94:compile, org.codehaus.plexus:plexus-interpolation:jar:1=
.1:compile, org.codehaus.gmaven:gmaven-plugin:jar:1.3:compile, org.codehaus=
.gmaven.runtime:gmaven-runtime-loader:jar:1.3:compile, org.codehaus.gmaven.=
runtime:gmaven-runtime-support:jar:1.3:compile, org.sonatype.gshell:gshell-=
io:jar:2.0:compile, com.thoughtworks.qdox:qdox:jar:1.10:compile, org.apache=
.maven.shared:file-management:jar:1.2.1:compile, org.apache.maven.shared:ma=
ven-shared-io:jar:1.1:compile, commons-lang:commons-lang:jar:2.4:compile, o=
rg.slf4j:slf4j-api:jar:1.5.10:compile, org.sonatype.gossip:gossip:jar:1.2:c=
ompile, org.apache.maven.reporting:maven-reporting-impl:jar:2.1:compile, co=
mmons-validator:commons-validator:jar:1.2.0:compile, commons-beanutils:comm=
ons-beanutils:jar:1.7.0:compile, commons-digester:commons-digester:jar:1.6:=
compile, commons-logging:commons-logging:jar:1.0.4:compile, oro:oro:jar:2.0=
.8:compile, xml-apis:xml-apis:jar:1.0.b2:compile, org.codehaus.groovy:groov=
y-all:jar:1.7.4:compile, org.apache.maven.reporting:maven-reporting-api:jar=
:3.0:compile, org.apache.maven.doxia:doxia-core:jar:1.1.3:compile, org.apac=
he.maven.doxia:doxia-logging-api:jar:1.1.3:compile, xerces:xercesImpl:jar:2=
.9.1:compile, commons-httpclient:commons-httpclient:jar:3.1:compile, common=
s-codec:commons-codec:jar:1.2:compile, org.apache.maven.doxia:doxia-sink-ap=
i:jar:1.1.3:compile, org.apache.maven.doxia:doxia-decoration-model:jar:1.1.=
3:compile, org.apache.maven.doxia:doxia-site-renderer:jar:1.1.3:compile, or=
g.apache.maven.doxia:doxia-module-xhtml:jar:1.1.3:compile, org.apache.maven=
.doxia:doxia-module-fml:jar:1.1.3:compile, org.codehaus.plexus:plexus-i18n:=
jar:1.0-beta-7:compile, org.codehaus.plexus:plexus-velocity:jar:1.1.7:compi=
le, org.apache.velocity:velocity:jar:1.5:compile, commons-collections:commo=
ns-collections:jar:3.2:compile, org.apache.maven.shared:maven-doxia-tools:j=
ar:1.2.1:compile, commons-io:commons-io:jar:1.4:compile, com.google.code.fi=
ndbugs:findbugs-ant:jar:1.3.9:compile, com.google.code.findbugs:findbugs:ja=
r:1.3.9:compile, com.google.code.findbugs:jsr305:jar:1.3.9:compile, com.goo=
gle.code.findbugs:jFormatString:jar:1.3.9:compile, com.google.code.findbugs=
:annotations:jar:1.3.9:compile, dom4j:dom4j:jar:1.6.1:compile, jaxen:jaxen:=
jar:1.1.1:compile, jdom:jdom:jar:1.0:compile, xom:xom:jar:1.0:compile, xerc=
es:xmlParserAPIs:jar:2.6.2:compile, xalan:xalan:jar:2.6.0:compile, com.ibm.=
icu:icu4j:jar:2.6.1:compile, asm:asm:jar:3.1:compile, asm:asm-analysis:jar:=
3.1:compile, asm:asm-commons:jar:3.1:compile, asm:asm-util:jar:3.1:compile,=
asm:asm-tree:jar:3.1:compile, asm:asm-xml:jar:3.1:compile, jgoodies:plasti=
c:jar:1.2.0:compile, org.codehaus.plexus:plexus-resources:jar:1.0-alpha-4:c=
ompile, org.codehaus.plexus:plexus-utils:jar:1.5.1:compile]
[DEBUG] (s) project =3D MavenProject: org.apache.hadoop:hadoop-common-pro=
ject:0.24.0-SNAPSHOT @ <https://builds.apache.org/job/Hadoop-Common-trunk/w=
s/trunk/hadoop-common-project/pom.xml>
[DEBUG] (s) relaxed =3D false
[DEBUG] (s) remoteArtifactRepositories =3D [ id: apache.snapshots.h=
ttps
url: https://repository.apache.org/content/repositories/snapshots
layout: default
snapshots: [enabled =3D> true, update =3D> daily]
releases: [enabled =3D> true, update =3D> daily]
, id: repository.jboss.org
url: http://repository.jboss.org/nexus/content/groups/public/
layout: default
snapshots: [enabled =3D> false, update =3D> daily]
releases: [enabled =3D> true, update =3D> daily]
, id: central
url: http://repo1.maven.org/maven2
layout: default
snapshots: [enabled =3D> false, update =3D> daily]
releases: [enabled =3D> true, update =3D> daily]
]
[DEBUG] (s) skip =3D false
[DEBUG] (s) sourceEncoding =3D UTF-8
[DEBUG] (s) testClassFilesDirectory =3D <https://builds.apache.org/job/Ha=
doop-Common-trunk/ws/trunk/hadoop-common-project/target/test-classes>
[DEBUG] (s) testSourceRoots =3D [<https://builds.apache.org/job/Hadoop-Co=
mmon-trunk/ws/trunk/hadoop-common-project/src/test/java]>
[DEBUG] (s) threshold =3D Default
[DEBUG] (s) timeout =3D 600000
[DEBUG] (s) trace =3D false
[DEBUG] (s) xmlEncoding =3D UTF-8
[DEBUG] (s) xmlOutput =3D false
[DEBUG] (s) xmlOutputDirectory =3D <https://builds.apache.org/job/Hadoop-=
Common-trunk/ws/trunk/hadoop-common-project/target>
[DEBUG] (s) xrefLocation =3D <https://builds.apache.org/job/Hadoop-Common=
-trunk/ws/trunk/hadoop-common-project/target/site/xref>
[DEBUG] (s) xrefTestLocation =3D <https://builds.apache.org/job/Hadoop-Co=
mmon-trunk/ws/trunk/hadoop-common-project/target/site/xref-test>
[DEBUG] -- end configuration --
[INFO] ****** FindBugsMojo execute *******
[DEBUG] XML outputFile is <https://builds.apache.org/job/Hadoop-Common-trun=
k/ws/trunk/hadoop-common-project/target/findbugsXml.xml>
[DEBUG] Generating Findbugs XML
[DEBUG] Inside canGenerateReport..... false=20
[INFO] canGenerate is false
[INFO] --------------------------------------------------------------------=
----
[INFO] Reactor Summary:
[INFO]=20
[INFO] Apache Hadoop Annotations ......................... SUCCESS [12.872s=
]
[INFO] Apache Hadoop Auth ................................ SUCCESS [18.596s=
]
[INFO] Apache Hadoop Auth Examples ....................... SUCCESS [7.828s]
[INFO] Apache Hadoop Common .............................. SUCCESS [4:22.65=
4s]
[INFO] Apache Hadoop Common Project ...................... SUCCESS [0.053s]
[INFO] --------------------------------------------------------------------=
----
[INFO] BUILD SUCCESS
[INFO] --------------------------------------------------------------------=
----
[INFO] Total time: 5:03.180s
[INFO] Finished at: Sun Feb 19 09:10:18 UTC 2012
[INFO] Final Memory: 82M/795M
[INFO] --------------------------------------------------------------------=
----
+ /home/jenkins/tools/maven/latest/bin/mvn test -Pclover -DcloverLicenseLoc=
ation=3D/home/jenkins/tools/clover/latest/lib/clover.license
Build step 'Execute shell' marked build as failure
[WARNINGS] Skipping publisher since build result is FAILURE
Archiving artifacts
Recording test results
Publishing Javadoc
Recording fingerprints
From common-dev-return-77782-apmail-hadoop-common-dev-archive=hadoop.apache.org@hadoop.apache.org Sun Feb 19 10:32:57 2012
Return-Path: <common-dev-return-77782-apmail-hadoop-common-dev-archive=hadoop.apache.org@hadoop.apache.org>
X-Original-To: apmail-hadoop-common-dev-archive@www.apache.org
Delivered-To: apmail-hadoop-common-dev-archive@www.apache.org
Received: from mail.apache.org (hermes.apache.org [140.211.11.3])
by minotaur.apache.org (Postfix) with SMTP id 9B80E98A8
for <apmail-hadoop-common-dev-archive@www.apache.org>; Sun, 19 Feb 2012 10:32:57 +0000 (UTC)
Received: (qmail 72020 invoked by uid 500); 19 Feb 2012 10:32:56 -0000
Delivered-To: apmail-hadoop-common-dev-archive@hadoop.apache.org
Received: (qmail 71938 invoked by uid 500); 19 Feb 2012 10:32:55 -0000
Mailing-List: contact common-dev-help@hadoop.apache.org; run by ezmlm
Precedence: bulk
List-Help: <mailto:common-dev-help@hadoop.apache.org>
List-Unsubscribe: <mailto:common-dev-unsubscribe@hadoop.apache.org>
List-Post: <mailto:common-dev@hadoop.apache.org>
List-Id: <common-dev.hadoop.apache.org>
Reply-To: common-dev@hadoop.apache.org
Delivered-To: mailing list common-dev@hadoop.apache.org
Received: (qmail 71924 invoked by uid 99); 19 Feb 2012 10:32:55 -0000
Received: from athena.apache.org (HELO athena.apache.org) (140.211.11.136)
by apache.org (qpsmtpd/0.29) with ESMTP; Sun, 19 Feb 2012 10:32:55 +0000
X-ASF-Spam-Status: No, hits=-2000.0 required=5.0
tests=ALL_TRUSTED,T_RP_MATCHES_RCVD
X-Spam-Check-By: apache.org
Received: from [140.211.11.116] (HELO hel.zones.apache.org) (140.211.11.116)
by apache.org (qpsmtpd/0.29) with ESMTP; Sun, 19 Feb 2012 10:32:54 +0000
Received: from hel.zones.apache.org (hel.zones.apache.org [140.211.11.116])
by hel.zones.apache.org (Postfix) with ESMTP id B4092185006
for <common-dev@hadoop.apache.org>; Sun, 19 Feb 2012 10:32:34 +0000 (UTC)
Date: Sun, 19 Feb 2012 10:32:34 +0000 (UTC)
From: "Steve Loughran (Reopened) (JIRA)" <jira@apache.org>
To: common-dev@hadoop.apache.org
Message-ID: <2123443765.101.1329647554738.JavaMail.tomcat@hel.zones.apache.org>
In-Reply-To: <449361787.7946.1316809046299.JavaMail.tomcat@hel.zones.apache.org>
Subject: [jira] [Reopened] (HADOOP-7680) TestHardLink fails on Mac OS X,
when gnu stat is in path
MIME-Version: 1.0
Content-Type: text/plain; charset=utf-8
Content-Transfer-Encoding: 7bit
X-JIRA-FingerPrint: 30527f35849b9dde25b450d4833f0394
[ https://issues.apache.org/jira/browse/HADOOP-7680?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Steve Loughran reopened HADOOP-7680:
------------------------------------
re-opening as the RESULT = ABORTED statement on the integration comments look worrying; something may have failed
> TestHardLink fails on Mac OS X, when gnu stat is in path
> --------------------------------------------------------
>
> Key: HADOOP-7680
> URL: https://issues.apache.org/jira/browse/HADOOP-7680
> Project: Hadoop Common
> Issue Type: Bug
> Affects Versions: 0.22.0, 0.23.0, 0.24.0
> Environment: Mac OS X, where `which stat` = /opt/local/libexec/gnubin/stat
> Reporter: Milind Bhandarkar
> Assignee: Milind Bhandarkar
> Fix For: 0.24.0, 0.22.1, 0.23.2
>
> Attachments: 7680-0.22.patch, 7680-0.23.patch
>
>
> For a specific reason, `which stat` = /opt/local/libexec/gnubin/stat, on my Mac. o.a.h.f.HardLink checks for os.name, detects it's a MacOSX, and assumes that stat points to /usr/bin/stat, and uses -f%l as arguments, which fails. The upcoming patch explicitly sets stat to use /usr/bin/stat on Mac OS. In 0.22, this code is part of o.a.h.f.FileUtil, and in 0.23 and trunk it is in o.a.h.f.HardLink. Both patches forthcoming.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
From common-dev-return-77783-apmail-hadoop-common-dev-archive=hadoop.apache.org@hadoop.apache.org Mon Feb 20 00:24:08 2012
Return-Path: <common-dev-return-77783-apmail-hadoop-common-dev-archive=hadoop.apache.org@hadoop.apache.org>
X-Original-To: apmail-hadoop-common-dev-archive@www.apache.org
Delivered-To: apmail-hadoop-common-dev-archive@www.apache.org
Received: from mail.apache.org (hermes.apache.org [140.211.11.3])
by minotaur.apache.org (Postfix) with SMTP id 971839DEF
for <apmail-hadoop-common-dev-archive@www.apache.org>; Mon, 20 Feb 2012 00:24:08 +0000 (UTC)
Received: (qmail 86227 invoked by uid 500); 20 Feb 2012 00:24:07 -0000
Delivered-To: apmail-hadoop-common-dev-archive@hadoop.apache.org
Received: (qmail 86179 invoked by uid 500); 20 Feb 2012 00:24:06 -0000
Mailing-List: contact common-dev-help@hadoop.apache.org; run by ezmlm
Precedence: bulk
List-Help: <mailto:common-dev-help@hadoop.apache.org>
List-Unsubscribe: <mailto:common-dev-unsubscribe@hadoop.apache.org>
List-Post: <mailto:common-dev@hadoop.apache.org>
List-Id: <common-dev.hadoop.apache.org>
Reply-To: common-dev@hadoop.apache.org
Delivered-To: mailing list common-dev@hadoop.apache.org
Received: (qmail 86171 invoked by uid 99); 20 Feb 2012 00:24:06 -0000
Received: from nike.apache.org (HELO nike.apache.org) (192.87.106.230)
by apache.org (qpsmtpd/0.29) with ESMTP; Mon, 20 Feb 2012 00:24:06 +0000
X-ASF-Spam-Status: No, hits=2.2 required=5.0
tests=HTML_MESSAGE,RCVD_IN_DNSWL_LOW,SPF_NEUTRAL
X-Spam-Check-By: apache.org
Received-SPF: neutral (nike.apache.org: local policy)
Received: from [209.85.215.48] (HELO mail-lpp01m010-f48.google.com) (209.85.215.48)
by apache.org (qpsmtpd/0.29) with ESMTP; Mon, 20 Feb 2012 00:23:59 +0000
Received: by lagw12 with SMTP id w12so7866472lag.35
for <common-dev@hadoop.apache.org>; Sun, 19 Feb 2012 16:23:38 -0800 (PST)
Received-SPF: pass (google.com: domain of niels@basj.es designates 10.112.27.165 as permitted sender) client-ip=10.112.27.165;
Authentication-Results: mr.google.com; spf=pass (google.com: domain of niels@basj.es designates 10.112.27.165 as permitted sender) smtp.mail=niels@basj.es
Received: from mr.google.com ([10.112.27.165])
by 10.112.27.165 with SMTP id u5mr6946496lbg.48.1329697418290 (num_hops = 1);
Sun, 19 Feb 2012 16:23:38 -0800 (PST)
MIME-Version: 1.0
Received: by 10.112.27.165 with SMTP id u5mr5844183lbg.48.1329697417695; Sun,
19 Feb 2012 16:23:37 -0800 (PST)
Sender: niels@basj.es
Received: by 10.112.29.170 with HTTP; Sun, 19 Feb 2012 16:23:37 -0800 (PST)
X-Originating-IP: [2001:980:91c0:1:216:eaff:fe5f:3cc6]
Date: Mon, 20 Feb 2012 01:23:37 +0100
X-Google-Sender-Auth: kpPdL1yrFUM-aMSXxFhSxES9RxA
Message-ID: <CADoiZqrPmt9c1JWvvg-_TJzP5GmxR6XU-bi3d8hLVLSYnQq40w@mail.gmail.com>
Subject: Making Gzip splittable
From: Niels Basjes <Niels@basjes.nl>
To: common-dev <common-dev@hadoop.apache.org>
Content-Type: multipart/alternative; boundary=bcaec55405be3d932904b95a4e7a
X-Gm-Message-State: ALoCoQk7+eV7jvzPoyzPPwhFCCBYsewX9B/wWB3bGbhhkZ0HCZdz/c0S/0mXRB4/OeMjYGFkFsrC
X-Virus-Checked: Checked by ClamAV on apache.org
--bcaec55405be3d932904b95a4e7a
Content-Type: text/plain; charset=ISO-8859-1
Hi,
As some of you know I've created a patch that effectively makes Gzip
splittable.
https://issues.apache.org/jira/browse/HADOOP-7076
What this does is for a split somewhere in the middle of the file it will
read from the start of the file up until the point where the split starts.
This is a useful waste of resources because it creates room to run a heavy
lifting mapper in parallel.
Due to this balance between the waste being useful and the waste being
wasteful I've included extensive documentation in the patch on how it works
and how to use it.
I've seen that there are quite a few real life situations where I expect my
solution can be useful.
What I created is as far as I can tell the only way you can split a gzipped
file without prior knowledge about the actual file.
If you do have prior information then other directions with a similar goal
are possible:
- Analyzing the file beforehand:
HADOOP-6153<https://issues.apache.org/jira/browse/HADOOP-6153>
- Create a specially crafted gzipped file:
HADOOP-7909<https://issues.apache.org/jira/browse/HADOOP-7909>
Over the last year I've had review comments from Chris Douglas (until he
stopped being involved in Hadoop) and later from Luke Lu.
Now the last feedback I got from Luke is this:
> Niels, I'm ambivalent about this patch. It has clean code and
> documentation, OTOH, it has really confusing usage/semantics and
> dubious general utility that the community might not want to maintain
> as part of an official release. After having to explain many finer
> points of Hadoop to new users/developers these days, I think the
> downside of this patch might out weight its benefits. I'm -0 on it.
> i.e., you need somebody else to +1 on this.
So after consulting Eli I'm asking this group.
My views on this feature:
- I think this feature should go in because I think others can benefit from
it.
- I also think that it should remain disabled by default. It can then be
used by those that read the documentation.
- The implementation does not contain any decompression code at all. It
only does the splitting smartness. (It could even be refactored to make any
codec splittable). It has been tested with both the java and the native
decompressors.
What do you think?
Is this a feature that should go in the official release or not?
--
Best regards
Niels Basjes
--bcaec55405be3d932904b95a4e7a--
From common-dev-return-77784-apmail-hadoop-common-dev-archive=hadoop.apache.org@hadoop.apache.org Mon Feb 20 02:37:08 2012
Return-Path: <common-dev-return-77784-apmail-hadoop-common-dev-archive=hadoop.apache.org@hadoop.apache.org>
X-Original-To: apmail-hadoop-common-dev-archive@www.apache.org
Delivered-To: apmail-hadoop-common-dev-archive@www.apache.org
Received: from mail.apache.org (hermes.apache.org [140.211.11.3])
by minotaur.apache.org (Postfix) with SMTP id 729969751
for <apmail-hadoop-common-dev-archive@www.apache.org>; Mon, 20 Feb 2012 02:37:08 +0000 (UTC)
Received: (qmail 97120 invoked by uid 500); 20 Feb 2012 02:37:06 -0000
Delivered-To: apmail-hadoop-common-dev-archive@hadoop.apache.org
Received: (qmail 97064 invoked by uid 500); 20 Feb 2012 02:37:06 -0000
Mailing-List: contact common-dev-help@hadoop.apache.org; run by ezmlm
Precedence: bulk
List-Help: <mailto:common-dev-help@hadoop.apache.org>
List-Unsubscribe: <mailto:common-dev-unsubscribe@hadoop.apache.org>
List-Post: <mailto:common-dev@hadoop.apache.org>
List-Id: <common-dev.hadoop.apache.org>
Reply-To: common-dev@hadoop.apache.org
Delivered-To: mailing list common-dev@hadoop.apache.org
Received: (qmail 97056 invoked by uid 99); 20 Feb 2012 02:37:06 -0000
Received: from nike.apache.org (HELO nike.apache.org) (192.87.106.230)
by apache.org (qpsmtpd/0.29) with ESMTP; Mon, 20 Feb 2012 02:37:06 +0000
X-ASF-Spam-Status: No, hits=1.5 required=5.0
tests=HTML_MESSAGE,RCVD_IN_DNSWL_LOW,SPF_PASS
X-Spam-Check-By: apache.org
Received-SPF: pass (nike.apache.org: domain of aagohary@gmail.com designates 74.125.83.48 as permitted sender)
Received: from [74.125.83.48] (HELO mail-ee0-f48.google.com) (74.125.83.48)
by apache.org (qpsmtpd/0.29) with ESMTP; Mon, 20 Feb 2012 02:36:59 +0000
Received: by eekd4 with SMTP id d4so2190710eek.35
for <common-dev@hadoop.apache.org>; Sun, 19 Feb 2012 18:36:39 -0800 (PST)
Received-SPF: pass (google.com: domain of aagohary@gmail.com designates 10.14.53.74 as permitted sender) client-ip=10.14.53.74;
Authentication-Results: mr.google.com; spf=pass (google.com: domain of aagohary@gmail.com designates 10.14.53.74 as permitted sender) smtp.mail=aagohary@gmail.com; dkim=pass header.i=aagohary@gmail.com
Received: from mr.google.com ([10.14.53.74])
by 10.14.53.74 with SMTP id f50mr9693973eec.5.1329705399112 (num_hops = 1);
Sun, 19 Feb 2012 18:36:39 -0800 (PST)
DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed;
d=gmail.com; s=gamma;
h=mime-version:from:date:message-id:subject:to:content-type;
bh=LorGTrdJlEFhU8z2mMOrDz2IUefcNqMrSbuTcn1PAg8=;
b=Lhd65nRedSfw6/qOOvxQiRTrs/q3U4z3wN0f+tsh3o5/mk9f1MG21KXpVW60lP3h1w
pO101+IbHQv6S3t16RhfoTDf+sYUyyxcX15NEgbvFH/H35NtoLXGJ4tgC8facVUPVCA9
dsVNJsKIp7YAiVx2FQZXV4SZ7J+7KHtMu6HcI=
Received: by 10.14.53.74 with SMTP id f50mr7737386eec.5.1329705398137; Sun, 19
Feb 2012 18:36:38 -0800 (PST)
MIME-Version: 1.0
Received: by 10.14.127.66 with HTTP; Sun, 19 Feb 2012 18:36:18 -0800 (PST)
From: Ahmed Elgohary <aagohary@gmail.com>
Date: Sun, 19 Feb 2012 21:36:18 -0500
Message-ID: <CAAo2Vhr6NwmV3xJJi3cBCpx8sf1q-NmFkk-XL+VFFbb65hyurw@mail.gmail.com>
Subject: Install an environment for hadoop development
To: common-dev@hadoop.apache.org
Content-Type: multipart/alternative; boundary=90e6ba6150c6e9754904b95c29e7
X-Virus-Checked: Checked by ClamAV on apache.org
--90e6ba6150c6e9754904b95c29e7
Content-Type: text/plain; charset=ISO-8859-1
Hi,
I am trying to install an environment to start trying out some
modifications to hadoop. All what I need is to have an eclipse project than
I can modify, build, and generate a new hadoop jar file (like
hadoop-core.jar). I followed the instructions in this page (
http://wiki.apache.org/hadoop/EclipseEnvironment) till getting all the
builds performed successfully. Then, I added the 4 projects
(hadoop-common-project, hadoop-assemblies, hadoop-hdfs-project, and
hadoop-mapreduce-project) to eclipse. Then, I found several compilation
errors in the the 3 projects (hadoop-common-project, hadoop-hdfs-project,
and hadoop-mapreduce-project).
I cannot find any clue to figure out what is wrong.
Actually, I am new to hadoop. Is there a simpler way to modify mapreduce
code, build it and get the modified jar?
--ahmed
--90e6ba6150c6e9754904b95c29e7--
From common-dev-return-77785-apmail-hadoop-common-dev-archive=hadoop.apache.org@hadoop.apache.org Mon Feb 20 07:53:37 2012
Return-Path: <common-dev-return-77785-apmail-hadoop-common-dev-archive=hadoop.apache.org@hadoop.apache.org>
X-Original-To: apmail-hadoop-common-dev-archive@www.apache.org
Delivered-To: apmail-hadoop-common-dev-archive@www.apache.org
Received: from mail.apache.org (hermes.apache.org [140.211.11.3])
by minotaur.apache.org (Postfix) with SMTP id 0CAB295AC
for <apmail-hadoop-common-dev-archive@www.apache.org>; Mon, 20 Feb 2012 07:53:37 +0000 (UTC)
Received: (qmail 38277 invoked by uid 500); 20 Feb 2012 07:53:35 -0000
Delivered-To: apmail-hadoop-common-dev-archive@hadoop.apache.org
Received: (qmail 37680 invoked by uid 500); 20 Feb 2012 07:53:35 -0000
Mailing-List: contact common-dev-help@hadoop.apache.org; run by ezmlm
Precedence: bulk
List-Help: <mailto:common-dev-help@hadoop.apache.org>
List-Unsubscribe: <mailto:common-dev-unsubscribe@hadoop.apache.org>
List-Post: <mailto:common-dev@hadoop.apache.org>
List-Id: <common-dev.hadoop.apache.org>
Reply-To: common-dev@hadoop.apache.org
Delivered-To: mailing list common-dev@hadoop.apache.org
Received: (qmail 37614 invoked by uid 99); 20 Feb 2012 07:53:32 -0000
Received: from nike.apache.org (HELO nike.apache.org) (192.87.106.230)
by apache.org (qpsmtpd/0.29) with ESMTP; Mon, 20 Feb 2012 07:53:32 +0000
X-ASF-Spam-Status: No, hits=2.2 required=5.0
tests=HTML_MESSAGE,RCVD_IN_DNSWL_LOW,SPF_NEUTRAL
X-Spam-Check-By: apache.org
Received-SPF: neutral (nike.apache.org: local policy)
Received: from [209.85.215.48] (HELO mail-lpp01m010-f48.google.com) (209.85.215.48)
by apache.org (qpsmtpd/0.29) with ESMTP; Mon, 20 Feb 2012 07:53:24 +0000
Received: by lagw12 with SMTP id w12so8208117lag.35
for <common-dev@hadoop.apache.org>; Sun, 19 Feb 2012 23:53:02 -0800 (PST)
Received-SPF: pass (google.com: domain of mfoley@hortonworks.com designates 10.152.147.1 as permitted sender) client-ip=10.152.147.1;
Authentication-Results: mr.google.com; spf=pass (google.com: domain of mfoley@hortonworks.com designates 10.152.147.1 as permitted sender) smtp.mail=mfoley@hortonworks.com
Received: from mr.google.com ([10.152.147.1])
by 10.152.147.1 with SMTP id tg1mr14653386lab.22.1329724382339 (num_hops = 1);
Sun, 19 Feb 2012 23:53:02 -0800 (PST)
Received: by 10.152.147.1 with SMTP id tg1mr12222317lab.22.1329724382268; Sun,
19 Feb 2012 23:53:02 -0800 (PST)
MIME-Version: 1.0
Received: by 10.112.103.132 with HTTP; Sun, 19 Feb 2012 23:52:32 -0800 (PST)
In-Reply-To: <CA+z3+9HrBBf2___wSEk7M=HrzDRLsvHikqcR3Mx2ra6+3oMuwg@mail.gmail.com>
References: <CA+z3+9HrBBf2___wSEk7M=HrzDRLsvHikqcR3Mx2ra6+3oMuwg@mail.gmail.com>
From: Matt Foley <mfoley@hortonworks.com>
Date: Sun, 19 Feb 2012 23:52:32 -0800
Message-ID: <CA+z3+9Fqe5fA-LM1zD=47jw-Rmj5kBM2+jsBGbiSJgpSsSqFig@mail.gmail.com>
Subject: Re: [VOTE] Hadoop-1.0.1 Release Candidate 1
To: common-dev@hadoop.apache.org
Content-Type: multipart/alternative; boundary=e89a8f235177744cf404b9609563
X-Gm-Message-State: ALoCoQnNS6UKuCZrzgykQRICMzxWwUuiZKBYB+EGI3rkUEWOqJXQ4Fsk7JVIzL+zDGG6gcQdX28F
X-Virus-Checked: Checked by ClamAV on apache.org
--e89a8f235177744cf404b9609563
Content-Type: text/plain; charset=ISO-8859-1
Hi,
Giri found an issue with the naming of the 64-bit RPM and DEB; see
HADOOP-8090 <https://issues.apache.org/jira/browse/HADOOP-8090>. The RPM
is called "hadoop-1.0.1-1.amd64.rpm" but should be called
"hadoop-1.0.1-1.x86_64.rpm". Even though it's been this way for a long
time, apparently it causes an issue when the rpm is used with yum. (BigTop
already uses the "x86_64" form.) To fix this requires a change to
build.xml.
In addition, Nathan has requested patches for the following bugs:
- MAPREDUCE-3824
<https://issues.apache.org/jira/browse/MAPREDUCE-3824>- Distributed
caches are not removed properly
- MAPREDUCE-3851 <https://issues.apache.org/jira/browse/MAPREDUCE-3851> -
Allow more aggressive action in detection of Jetty issues
- HADOOP-8050 <https://issues.apache.org/jira/browse/HADOOP-8050>-
Deadlock in Namenode metrices
and Owen feels this one is pretty important:
- HADOOP-8043 <https://issues.apache.org/jira/browse/HADOOP-8043> -
KerberosAuthenticationFilter
and friends have some problems
So altogether that's five new issues, all raised (or raised in visibility)
since the 1.0.1 vote was called. Two of them, HADOOP-8050 and
MAPREDUCE-3824, already have approved fixes, but the remaining three are
still in discussion.
The thing is that there are people waiting on the 1.0.1 release with some
urgency, including a pending BigTop release. So instead of pulling the
1.0.1 release, waiting for fixes, then waiting an additional week for
another vote, I suggest that we let 1.0.1 proceed as is, and do a 1.0.2
release as soon as the remaining three bugs noted above are fixed.
If you agree with this, please vote in favor of the 1.0.1 release. If you
disagree, please vote against the release, and I'll do a 1.0.1-rc2 instead
of a 1.0.2. As a reminder, the vote closes Tuesday afternoon.
The goal here is to keep everyone fully informed, while providing the most
good to the most people, in the face of conflicting requests.
Thanks,
--Matt
On Tue, Feb 14, 2012 at 2:29 PM, Matt Foley <mattf@apache.org> wrote:
> Hi all,
> Hadoop-1.0.1-rc1 is now available at
> http://people.apache.org/~mattf/hadoop-1.0.1-rc1/
> Please download it, test it, and vote on whether to accept it as Release
> 1.0.1.
> Voting will close at 2:30pm PST on Tuesday 21 February.
>
> Thank you,
> --Matt (Release Manager)
>
> This is a maintenance release from 1.0.0, but a number of
> production-relevant bug fixes were requested for inclusion in the last week
> or so. The complete release notes are available at
>
> http://people.apache.org/~mattf/hadoop-1.0.1-rc1/RELEASE_NOTES_HADOOP-1.0.1.html
> The summary list is:
>
> - HADOOP-8009 <https://issues.apache.org/jira/browse/HADOOP-8009>.
> Create hadoop-client and hadoop-minicluster artifacts for downstream
> projects
> - HADOOP-8037 <https://issues.apache.org/jira/browse/HADOOP-8037>. Binary
> tarball does not preserve platform info for native builds, and RPMs fail to
> provide needed symlinks for libhadoop.so
> - MAPREDUCE-3184 <https://issues.apache.org/jira/browse/MAPREDUCE-3184>. Improve
> handling of fetch failures when a tasktracker is not responding on HTTP
> - HADOOP-7470 <https://issues.apache.org/jira/browse/HADOOP-7470>.
> move up to Jackson 1.8.8
> - HADOOP-7960 <https://issues.apache.org/jira/browse/HADOOP-7960>. Port
> HADOOP-5203 to branch-1, build version comparison is too restrictive
> - HADOOP-7964 <https://issues.apache.org/jira/browse/HADOOP-7964>. Deadlock
> in class init.
> - HADOOP-7987 <https://issues.apache.org/jira/browse/HADOOP-7987>. Support
> setting the run-as user in unsecure mode
> - HADOOP-7988 <https://issues.apache.org/jira/browse/HADOOP-7988>. Upper
> case in hostname part of the principals doesn't work with kerberos.
> - HADOOP-8010 <https://issues.apache.org/jira/browse/HADOOP-8010>. hadoop-config.sh
> spews error message when HADOOP_HOME_WARN_SUPPRESS is set to true and
> HADOOP_HOME is present
> - HADOOP-8052 <https://issues.apache.org/jira/browse/HADOOP-8052>. Hadoop
> Metrics2 should emit Float.MAX_VALUE (instead of Double.MAX_VALUE) to avoid
> making Ganglia's gmetad core
> - HDFS-2379 <https://issues.apache.org/jira/browse/HDFS-2379>. 0.20:
> Allow block reports to proceed without holding FSDataset lock
> - HDFS-2814 <https://issues.apache.org/jira/browse/HDFS-2814>. NamenodeMXBean
> does not account for svn revision in the version information
> - MAPREDUCE-3343 <https://issues.apache.org/jira/browse/MAPREDUCE-3343>. TaskTracker
> Out of Memory because of distributed cache
> - MAPREDUCE-3607 <https://issues.apache.org/jira/browse/MAPREDUCE-3607>. Port
> missing new API mapreduce lib classes to 1.x
>
>
--e89a8f235177744cf404b9609563--
From common-dev-return-77786-apmail-hadoop-common-dev-archive=hadoop.apache.org@hadoop.apache.org Mon Feb 20 08:18:13 2012
Return-Path: <common-dev-return-77786-apmail-hadoop-common-dev-archive=hadoop.apache.org@hadoop.apache.org>
X-Original-To: apmail-hadoop-common-dev-archive@www.apache.org
Delivered-To: apmail-hadoop-common-dev-archive@www.apache.org
Received: from mail.apache.org (hermes.apache.org [140.211.11.3])
by minotaur.apache.org (Postfix) with SMTP id 974D89B85
for <apmail-hadoop-common-dev-archive@www.apache.org>; Mon, 20 Feb 2012 08:18:13 +0000 (UTC)
Received: (qmail 90680 invoked by uid 500); 20 Feb 2012 08:18:11 -0000
Delivered-To: apmail-hadoop-common-dev-archive@hadoop.apache.org
Received: (qmail 90180 invoked by uid 500); 20 Feb 2012 08:18:11 -0000
Mailing-List: contact common-dev-help@hadoop.apache.org; run by ezmlm
Precedence: bulk
List-Help: <mailto:common-dev-help@hadoop.apache.org>
List-Unsubscribe: <mailto:common-dev-unsubscribe@hadoop.apache.org>
List-Post: <mailto:common-dev@hadoop.apache.org>
List-Id: <common-dev.hadoop.apache.org>
Reply-To: common-dev@hadoop.apache.org
Delivered-To: mailing list common-dev@hadoop.apache.org
Received: (qmail 89780 invoked by uid 99); 20 Feb 2012 08:18:09 -0000
Received: from nike.apache.org (HELO nike.apache.org) (192.87.106.230)
by apache.org (qpsmtpd/0.29) with ESMTP; Mon, 20 Feb 2012 08:18:09 +0000
X-ASF-Spam-Status: No, hits=-2000.0 required=5.0
tests=ALL_TRUSTED,T_RP_MATCHES_RCVD
X-Spam-Check-By: apache.org
Received: from [140.211.11.116] (HELO hel.zones.apache.org) (140.211.11.116)
by apache.org (qpsmtpd/0.29) with ESMTP; Mon, 20 Feb 2012 08:18:03 +0000
Received: from hel.zones.apache.org (hel.zones.apache.org [140.211.11.116])
by hel.zones.apache.org (Postfix) with ESMTP id C00F71C17AD
for <common-dev@hadoop.apache.org>; Mon, 20 Feb 2012 08:17:41 +0000 (UTC)
Date: Mon, 20 Feb 2012 08:17:41 +0000 (UTC)
From: "Matt Foley (Reopened) (JIRA)" <jira@apache.org>
To: common-dev@hadoop.apache.org
Message-ID: <1953242678.1860.1329725861800.JavaMail.tomcat@hel.zones.apache.org>
In-Reply-To: <1832977634.21006.1328819457350.JavaMail.tomcat@hel.zones.apache.org>
Subject: [jira] [Reopened] (HADOOP-8050) Deadlock in metrics
MIME-Version: 1.0
Content-Type: text/plain; charset=utf-8
Content-Transfer-Encoding: 7bit
X-JIRA-FingerPrint: 30527f35849b9dde25b450d4833f0394
X-Virus-Checked: Checked by ClamAV on apache.org
[ https://issues.apache.org/jira/browse/HADOOP-8050?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Matt Foley reopened HADOOP-8050:
--------------------------------
The Commit integration to both trunk and v0.23 succeeded with common and hdfs, but aborted in mapreduce. The log records:
{code}
ivy-resolve-mapred:
Build timed out (after 45 minutes). Marking the build as aborted.
Build was aborted
Recording test results
None of the test reports contained any result
Updating HADOOP-8050
No emails were triggered.
Finished: ABORTED
{code}
This looks more like a connectivity issue with ivy than a problem with the patch, but re-opening pending investigation.
> Deadlock in metrics
> -------------------
>
> Key: HADOOP-8050
> URL: https://issues.apache.org/jira/browse/HADOOP-8050
> Project: Hadoop Common
> Issue Type: Bug
> Components: metrics
> Affects Versions: 0.20.204.0, 0.20.205.0, 0.23.0, 1.0.0
> Reporter: Kihwal Lee
> Assignee: Kihwal Lee
> Fix For: 1.0.1, 0.23.2
>
> Attachments: hadoop-8050-branch-1.patch.txt, hadoop-8050-branch-1.patch.txt, hadoop-8050-branch-1.patch.txt, hadoop-8050-branch-1.patch.txt, hadoop-8050-trunk.patch.txt, hadoop-8050-trunk.patch.txt, hadoop-8050-trunk.patch.txt, hadoop-8050.patch.txt
>
>
> The metrics serving thread and the periodic snapshot thread can deadlock.
> It happened a few times on one of namenodes we have. When it happens RPC works but the web ui and hftp stop working. I haven't look at the trunk too closely, but it might happen there too.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
From common-dev-return-77787-apmail-hadoop-common-dev-archive=hadoop.apache.org@hadoop.apache.org Mon Feb 20 08:22:44 2012
Return-Path: <common-dev-return-77787-apmail-hadoop-common-dev-archive=hadoop.apache.org@hadoop.apache.org>
X-Original-To: apmail-hadoop-common-dev-archive@www.apache.org
Delivered-To: apmail-hadoop-common-dev-archive@www.apache.org
Received: from mail.apache.org (hermes.apache.org [140.211.11.3])
by minotaur.apache.org (Postfix) with SMTP id 8276F9D5F
for <apmail-hadoop-common-dev-archive@www.apache.org>; Mon, 20 Feb 2012 08:22:44 +0000 (UTC)
Received: (qmail 3752 invoked by uid 500); 20 Feb 2012 08:22:41 -0000
Delivered-To: apmail-hadoop-common-dev-archive@hadoop.apache.org
Received: (qmail 3682 invoked by uid 500); 20 Feb 2012 08:22:41 -0000
Mailing-List: contact common-dev-help@hadoop.apache.org; run by ezmlm
Precedence: bulk
List-Help: <mailto:common-dev-help@hadoop.apache.org>
List-Unsubscribe: <mailto:common-dev-unsubscribe@hadoop.apache.org>
List-Post: <mailto:common-dev@hadoop.apache.org>
List-Id: <common-dev.hadoop.apache.org>
Reply-To: common-dev@hadoop.apache.org
Delivered-To: mailing list common-dev@hadoop.apache.org
Received: (qmail 3664 invoked by uid 99); 20 Feb 2012 08:22:41 -0000
Received: from athena.apache.org (HELO athena.apache.org) (140.211.11.136)
by apache.org (qpsmtpd/0.29) with ESMTP; Mon, 20 Feb 2012 08:22:41 +0000
X-ASF-Spam-Status: No, hits=2.5 required=5.0
tests=FREEMAIL_REPLY,HTML_MESSAGE,RCVD_IN_DNSWL_LOW,SPF_PASS
X-Spam-Check-By: apache.org
Received-SPF: pass (athena.apache.org: domain of jabirahmed@gmail.com designates 209.85.213.176 as permitted sender)
Received: from [209.85.213.176] (HELO mail-yx0-f176.google.com) (209.85.213.176)
by apache.org (qpsmtpd/0.29) with ESMTP; Mon, 20 Feb 2012 08:22:34 +0000
Received: by yenl9 with SMTP id l9so3161942yen.35
for <common-dev@hadoop.apache.org>; Mon, 20 Feb 2012 00:22:13 -0800 (PST)
Received-SPF: pass (google.com: domain of jabirahmed@gmail.com designates 10.236.153.230 as permitted sender) client-ip=10.236.153.230;
Authentication-Results: mr.google.com; spf=pass (google.com: domain of jabirahmed@gmail.com designates 10.236.153.230 as permitted sender) smtp.mail=jabirahmed@gmail.com; dkim=pass header.i=jabirahmed@gmail.com
Received: from mr.google.com ([10.236.153.230])
by 10.236.153.230 with SMTP id f66mr26501141yhk.37.1329726133997 (num_hops = 1);
Mon, 20 Feb 2012 00:22:13 -0800 (PST)
DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed;
d=gmail.com; s=gamma;
h=mime-version:in-reply-to:references:date:message-id:subject:from:to
:content-type;
bh=WK108RITpOXyUp+5HvIx4Rlj0zrHnBxtDkIF1I/tO+8=;
b=i47jCbMSULbIM8nY8xsXkWaxtAy6gv3VypoD19sb+6tACMie8wXuT2w5GY2S68tHut
lEnCnxOLntJta5uEmhUxHqRyYPiHrIX2TR+ncPI9sTC7HPlZs8ENyXJS0z84U1KqPDhI
r10Ljdc1RcA7gljPJeOX6EeTyRq/Mapgij1Uw=
MIME-Version: 1.0
Received: by 10.236.153.230 with SMTP id f66mr20336696yhk.37.1329726133936;
Mon, 20 Feb 2012 00:22:13 -0800 (PST)
Received: by 10.147.168.13 with HTTP; Mon, 20 Feb 2012 00:22:13 -0800 (PST)
In-Reply-To: <CAAo2Vhr6NwmV3xJJi3cBCpx8sf1q-NmFkk-XL+VFFbb65hyurw@mail.gmail.com>
References: <CAAo2Vhr6NwmV3xJJi3cBCpx8sf1q-NmFkk-XL+VFFbb65hyurw@mail.gmail.com>
Date: Mon, 20 Feb 2012 13:52:13 +0530
Message-ID: <CABykE-yoLCxWByM72=w2-F+6ARkLaZfK3HsvBHLYJBUmJvna_w@mail.gmail.com>
Subject: Re: Install an environment for hadoop development
From: Jabir Ahmed <jabirahmed@gmail.com>
To: common-dev@hadoop.apache.org
Content-Type: multipart/alternative; boundary=20cf302d4890dca3b204b960fd14
--20cf302d4890dca3b204b960fd14
Content-Type: text/plain; charset=ISO-8859-1
have you set the classpaths correctly?
what kind of errors do you see?
On Mon, Feb 20, 2012 at 8:06 AM, Ahmed Elgohary <aagohary@gmail.com> wrote:
> Hi,
>
> I am trying to install an environment to start trying out some
> modifications to hadoop. All what I need is to have an eclipse project than
> I can modify, build, and generate a new hadoop jar file (like
> hadoop-core.jar). I followed the instructions in this page (
> http://wiki.apache.org/hadoop/EclipseEnvironment) till getting all the
> builds performed successfully. Then, I added the 4 projects
> (hadoop-common-project, hadoop-assemblies, hadoop-hdfs-project, and
> hadoop-mapreduce-project) to eclipse. Then, I found several compilation
> errors in the the 3 projects (hadoop-common-project, hadoop-hdfs-project,
> and hadoop-mapreduce-project).
>
> I cannot find any clue to figure out what is wrong.
> Actually, I am new to hadoop. Is there a simpler way to modify mapreduce
> code, build it and get the modified jar?
>
>
> --ahmed
>
--
"The best way to make your dreams come true is to wake up." - Paul Valery
--
Phone: +91 99162 93063
IM/e-mail: jabirahmed@yahoo.com , jabirahmed@gmail.com
--20cf302d4890dca3b204b960fd14--
From common-dev-return-77788-apmail-hadoop-common-dev-archive=hadoop.apache.org@hadoop.apache.org Mon Feb 20 08:27:17 2012
Return-Path: <common-dev-return-77788-apmail-hadoop-common-dev-archive=hadoop.apache.org@hadoop.apache.org>
X-Original-To: apmail-hadoop-common-dev-archive@www.apache.org
Delivered-To: apmail-hadoop-common-dev-archive@www.apache.org
Received: from mail.apache.org (hermes.apache.org [140.211.11.3])
by minotaur.apache.org (Postfix) with SMTP id EC5789174
for <apmail-hadoop-common-dev-archive@www.apache.org>; Mon, 20 Feb 2012 08:27:17 +0000 (UTC)
Received: (qmail 13788 invoked by uid 500); 20 Feb 2012 08:27:16 -0000
Delivered-To: apmail-hadoop-common-dev-archive@hadoop.apache.org
Received: (qmail 13624 invoked by uid 500); 20 Feb 2012 08:27:15 -0000
Mailing-List: contact common-dev-help@hadoop.apache.org; run by ezmlm
Precedence: bulk
List-Help: <mailto:common-dev-help@hadoop.apache.org>
List-Unsubscribe: <mailto:common-dev-unsubscribe@hadoop.apache.org>
List-Post: <mailto:common-dev@hadoop.apache.org>
List-Id: <common-dev.hadoop.apache.org>
Reply-To: common-dev@hadoop.apache.org
Delivered-To: mailing list common-dev@hadoop.apache.org
Received: (qmail 13593 invoked by uid 99); 20 Feb 2012 08:27:14 -0000
Received: from nike.apache.org (HELO nike.apache.org) (192.87.106.230)
by apache.org (qpsmtpd/0.29) with ESMTP; Mon, 20 Feb 2012 08:27:14 +0000
X-ASF-Spam-Status: No, hits=1.5 required=5.0
tests=HTML_MESSAGE,RCVD_IN_DNSWL_LOW,SPF_PASS
X-Spam-Check-By: apache.org
Received-SPF: pass (nike.apache.org: domain of jzhang.ch@gmail.com designates 209.85.160.48 as permitted sender)
Received: from [209.85.160.48] (HELO mail-pw0-f48.google.com) (209.85.160.48)
by apache.org (qpsmtpd/0.29) with ESMTP; Mon, 20 Feb 2012 08:27:07 +0000
Received: by pbcxa12 with SMTP id xa12so5102303pbc.35
for <common-dev@hadoop.apache.org>; Mon, 20 Feb 2012 00:26:45 -0800 (PST)
Received-SPF: pass (google.com: domain of jzhang.ch@gmail.com designates 10.68.220.196 as permitted sender) client-ip=10.68.220.196;
Authentication-Results: mr.google.com; spf=pass (google.com: domain of jzhang.ch@gmail.com designates 10.68.220.196 as permitted sender) smtp.mail=jzhang.ch@gmail.com; dkim=pass header.i=jzhang.ch@gmail.com
Received: from mr.google.com ([10.68.220.196])
by 10.68.220.196 with SMTP id py4mr52049436pbc.166.1329726405935 (num_hops = 1);
Mon, 20 Feb 2012 00:26:45 -0800 (PST)
DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed;
d=gmail.com; s=gamma;
h=mime-version:date:message-id:subject:from:to:content-type;
bh=wJTUogaIjUBmIbfwiMHIk7rEUWFwLhRHLSfikHbM5hg=;
b=CHsrU63I0VtV4PC8jbZGHj3DUfvWVwnW63DqyZtQ8rCwuI+HlbGTPxTwlyX9oXpVRe
8AWXSc+ikmqOLzf/isEkJMQ+U2UH4xzLYpvmegRZ9a0oo1+4zkcFHtztHVVwI5VzzUfs
HGwtR4PwUyFd8NK6rRj/mv98Rb55x09ti17wI=
MIME-Version: 1.0
Received: by 10.68.220.196 with SMTP id py4mr43508482pbc.166.1329726405906;
Mon, 20 Feb 2012 00:26:45 -0800 (PST)
Received: by 10.142.52.4 with HTTP; Mon, 20 Feb 2012 00:26:45 -0800 (PST)
Date: Mon, 20 Feb 2012 16:26:45 +0800
Message-ID: <CAHpSMN3fBpC6pGSBqpg-Hg2rp4LDUC1KHfXGK3b9USxAJyDETQ@mail.gmail.com>
Subject: How to launch hadoop from eclipse
From: Zhang Jianfeng <jzhang.ch@gmail.com>
To: common-dev <common-dev@hadoop.apache.org>
Content-Type: multipart/alternative; boundary=047d7b1118cd128edd04b9610ebe
X-Virus-Checked: Checked by ClamAV on apache.org
--047d7b1118cd128edd04b9610ebe
Content-Type: text/plain; charset=UTF-8
Hi Guys,
I downloaded the hadoop source code and imported into my eclipse IDE. I
can compile it without any error. It looks work fine. But I wonder how to
launch hadoop services from eclipse env.
Thanks in advance.
Jian Feng
--047d7b1118cd128edd04b9610ebe--
From common-dev-return-77789-apmail-hadoop-common-dev-archive=hadoop.apache.org@hadoop.apache.org Mon Feb 20 08:29:31 2012
Return-Path: <common-dev-return-77789-apmail-hadoop-common-dev-archive=hadoop.apache.org@hadoop.apache.org>
X-Original-To: apmail-hadoop-common-dev-archive@www.apache.org
Delivered-To: apmail-hadoop-common-dev-archive@www.apache.org
Received: from mail.apache.org (hermes.apache.org [140.211.11.3])
by minotaur.apache.org (Postfix) with SMTP id C7D729ACA
for <apmail-hadoop-common-dev-archive@www.apache.org>; Mon, 20 Feb 2012 08:29:31 +0000 (UTC)
Received: (qmail 20194 invoked by uid 500); 20 Feb 2012 08:29:30 -0000
Delivered-To: apmail-hadoop-common-dev-archive@hadoop.apache.org
Received: (qmail 20140 invoked by uid 500); 20 Feb 2012 08:29:30 -0000
Mailing-List: contact common-dev-help@hadoop.apache.org; run by ezmlm
Precedence: bulk
List-Help: <mailto:common-dev-help@hadoop.apache.org>
List-Unsubscribe: <mailto:common-dev-unsubscribe@hadoop.apache.org>
List-Post: <mailto:common-dev@hadoop.apache.org>
List-Id: <common-dev.hadoop.apache.org>
Reply-To: common-dev@hadoop.apache.org
Delivered-To: mailing list common-dev@hadoop.apache.org
Received: (qmail 20122 invoked by uid 99); 20 Feb 2012 08:29:29 -0000
Received: from athena.apache.org (HELO athena.apache.org) (140.211.11.136)
by apache.org (qpsmtpd/0.29) with ESMTP; Mon, 20 Feb 2012 08:29:29 +0000
X-ASF-Spam-Status: No, hits=0.7 required=5.0
tests=RCVD_IN_DNSWL_NONE,SPF_NEUTRAL
X-Spam-Check-By: apache.org
Received-SPF: neutral (athena.apache.org: local policy)
Received: from [217.70.183.196] (HELO relay4-d.mail.gandi.net) (217.70.183.196)
by apache.org (qpsmtpd/0.29) with ESMTP; Mon, 20 Feb 2012 08:29:22 +0000
X-Originating-IP: 217.70.178.136
Received: from mfilter7-d.gandi.net (mfilter7-d.gandi.net [217.70.178.136])
by relay4-d.mail.gandi.net (Postfix) with ESMTP id 525401720D5
for <common-dev@hadoop.apache.org>; Mon, 20 Feb 2012 09:29:00 +0100 (CET)
X-Virus-Scanned: Debian amavisd-new at mfilter7-d.gandi.net
Received: from relay4-d.mail.gandi.net ([217.70.183.196])
by mfilter7-d.gandi.net (mfilter7-d.gandi.net [10.0.15.180]) (amavisd-new, port 10024)
with ESMTP id MVyrzZOjQMyq for <common-dev@hadoop.apache.org>;
Mon, 20 Feb 2012 09:28:58 +0100 (CET)
X-Originating-IP: 82.238.224.4
Received: from [192.168.134.15] (bre91-1-82-238-224-4.fbx.proxad.net [82.238.224.4])
(Authenticated sender: jb@nanthrax.net)
by relay4-d.mail.gandi.net (Postfix) with ESMTPSA id 46F4D1720C5
for <common-dev@hadoop.apache.org>; Mon, 20 Feb 2012 09:28:58 +0100 (CET)
Message-ID: <4F420448.6030407@nanthrax.net>
Date: Mon, 20 Feb 2012 09:28:56 +0100
From: =?UTF-8?B?SmVhbi1CYXB0aXN0ZSBPbm9mcsOp?= <jb@nanthrax.net>
User-Agent: Mozilla/5.0 (X11; Linux x86_64; rv:10.0.2) Gecko/20120216 Thunderbird/10.0.2
MIME-Version: 1.0
To: common-dev@hadoop.apache.org
Subject: Re: How to launch hadoop from eclipse
References: <CAHpSMN3fBpC6pGSBqpg-Hg2rp4LDUC1KHfXGK3b9USxAJyDETQ@mail.gmail.com>
In-Reply-To: <CAHpSMN3fBpC6pGSBqpg-Hg2rp4LDUC1KHfXGK3b9USxAJyDETQ@mail.gmail.com>
Content-Type: text/plain; charset=UTF-8; format=flowed
Content-Transfer-Encoding: quoted-printable
Hi Jian,
FYI, I just submitted a patch to turn hadoop-common modules as OSGi bundl=
es.
It's still work in progress (I have bunch of other patches in=20
preparation), but basically it means that it can be deployed as Eclipse=20
plugins.
Regards
JB
On 02/20/2012 09:26 AM, Zhang Jianfeng wrote:
> Hi Guys,
>
> I downloaded the hadoop source code and imported into my eclipse I=
DE. I
> can compile it without any error. It looks work fine. But I wonder how =
to
> launch hadoop services from eclipse env.
>
> Thanks in advance.
>
> Jian Feng
>
--=20
Jean-Baptiste Onofr=C3=A9
jbonofre@apache.org
http://blog.nanthrax.net
Talend - http://www.talend.com
From common-dev-return-77790-apmail-hadoop-common-dev-archive=hadoop.apache.org@hadoop.apache.org Mon Feb 20 09:30:04 2012
Return-Path: <common-dev-return-77790-apmail-hadoop-common-dev-archive=hadoop.apache.org@hadoop.apache.org>
X-Original-To: apmail-hadoop-common-dev-archive@www.apache.org
Delivered-To: apmail-hadoop-common-dev-archive@www.apache.org
Received: from mail.apache.org (hermes.apache.org [140.211.11.3])
by minotaur.apache.org (Postfix) with SMTP id 251E39FFC
for <apmail-hadoop-common-dev-archive@www.apache.org>; Mon, 20 Feb 2012 09:30:04 +0000 (UTC)
Received: (qmail 83762 invoked by uid 500); 20 Feb 2012 09:30:02 -0000
Delivered-To: apmail-hadoop-common-dev-archive@hadoop.apache.org
Received: (qmail 83222 invoked by uid 500); 20 Feb 2012 09:30:01 -0000
Mailing-List: contact common-dev-help@hadoop.apache.org; run by ezmlm
Precedence: bulk
List-Help: <mailto:common-dev-help@hadoop.apache.org>
List-Unsubscribe: <mailto:common-dev-unsubscribe@hadoop.apache.org>
List-Post: <mailto:common-dev@hadoop.apache.org>
List-Id: <common-dev.hadoop.apache.org>
Reply-To: common-dev@hadoop.apache.org
Delivered-To: mailing list common-dev@hadoop.apache.org
Received: (qmail 82951 invoked by uid 99); 20 Feb 2012 09:30:01 -0000
Received: from nike.apache.org (HELO nike.apache.org) (192.87.106.230)
by apache.org (qpsmtpd/0.29) with ESMTP; Mon, 20 Feb 2012 09:30:01 +0000
X-ASF-Spam-Status: No, hits=-2000.0 required=5.0
tests=ALL_TRUSTED,T_RP_MATCHES_RCVD
X-Spam-Check-By: apache.org
Received: from [140.211.11.116] (HELO hel.zones.apache.org) (140.211.11.116)
by apache.org (qpsmtpd/0.29) with ESMTP; Mon, 20 Feb 2012 09:29:55 +0000
Received: from hel.zones.apache.org (hel.zones.apache.org [140.211.11.116])
by hel.zones.apache.org (Postfix) with ESMTP id 9115A1C1A86
for <common-dev@hadoop.apache.org>; Mon, 20 Feb 2012 09:29:34 +0000 (UTC)
Date: Mon, 20 Feb 2012 09:29:34 +0000 (UTC)
From: "Changming Sun (Created) (JIRA)" <jira@apache.org>
To: common-dev@hadoop.apache.org
Message-ID: <449193476.1956.1329730174595.JavaMail.tomcat@hel.zones.apache.org>
Subject: [jira] [Created] (HADOOP-8093) HadoopRpcRequestProto should not be
serialize twice
MIME-Version: 1.0
Content-Type: text/plain; charset=utf-8
Content-Transfer-Encoding: 7bit
X-JIRA-FingerPrint: 30527f35849b9dde25b450d4833f0394
X-Virus-Checked: Checked by ClamAV on apache.org
HadoopRpcRequestProto should not be serialize twice
---------------------------------------------------
Key: HADOOP-8093
URL: https://issues.apache.org/jira/browse/HADOOP-8093
Project: Hadoop Common
Issue Type: Improvement
Components: ipc
Affects Versions: 0.24.0
Environment: Windows 7
Reporter: Changming Sun
@Override
public void write(DataOutput out) throws IOException {
out.writeInt(message.toByteArray().length);
out.write(message.toByteArray());
}
The code is not effective.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
From common-dev-return-77791-apmail-hadoop-common-dev-archive=hadoop.apache.org@hadoop.apache.org Mon Feb 20 09:31:22 2012
Return-Path: <common-dev-return-77791-apmail-hadoop-common-dev-archive=hadoop.apache.org@hadoop.apache.org>
X-Original-To: apmail-hadoop-common-dev-archive@www.apache.org
Delivered-To: apmail-hadoop-common-dev-archive@www.apache.org
Received: from mail.apache.org (hermes.apache.org [140.211.11.3])
by minotaur.apache.org (Postfix) with SMTP id 9A2A7902E
for <apmail-hadoop-common-dev-archive@www.apache.org>; Mon, 20 Feb 2012 09:31:22 +0000 (UTC)
Received: (qmail 87261 invoked by uid 500); 20 Feb 2012 09:31:21 -0000
Delivered-To: apmail-hadoop-common-dev-archive@hadoop.apache.org
Received: (qmail 87182 invoked by uid 500); 20 Feb 2012 09:31:21 -0000
Mailing-List: contact common-dev-help@hadoop.apache.org; run by ezmlm
Precedence: bulk
List-Help: <mailto:common-dev-help@hadoop.apache.org>
List-Unsubscribe: <mailto:common-dev-unsubscribe@hadoop.apache.org>
List-Post: <mailto:common-dev@hadoop.apache.org>
List-Id: <common-dev.hadoop.apache.org>
Reply-To: common-dev@hadoop.apache.org
Delivered-To: mailing list common-dev@hadoop.apache.org
Received: (qmail 87173 invoked by uid 99); 20 Feb 2012 09:31:21 -0000
Received: from athena.apache.org (HELO athena.apache.org) (140.211.11.136)
by apache.org (qpsmtpd/0.29) with ESMTP; Mon, 20 Feb 2012 09:31:21 +0000
X-ASF-Spam-Status: No, hits=-2000.0 required=5.0
tests=ALL_TRUSTED
X-Spam-Check-By: apache.org
Received: from [140.211.11.8] (HELO aegis.apache.org) (140.211.11.8)
by apache.org (qpsmtpd/0.29) with ESMTP; Mon, 20 Feb 2012 09:31:16 +0000
Received: from aegis (localhost [127.0.0.1])
by aegis.apache.org (Postfix) with ESMTP id 0C286C00E8
for <common-dev@hadoop.apache.org>; Mon, 20 Feb 2012 09:30:56 +0000 (UTC)
Date: Mon, 20 Feb 2012 09:30:55 +0000 (UTC)
From: Apache Jenkins Server <jenkins@builds.apache.org>
To: common-dev@hadoop.apache.org
Message-ID: <82838688.4051329730256047.JavaMail.hudson@aegis>
In-Reply-To: <316508270.3411329643175235.JavaMail.hudson@aegis>
References: <316508270.3411329643175235.JavaMail.hudson@aegis>
Subject: Build failed in Jenkins: Hadoop-Common-0.23-Build #169
MIME-Version: 1.0
Content-Type: text/plain; charset=UTF-8
Content-Transfer-Encoding: 7bit
X-Jenkins-Job: Hadoop-Common-0.23-Build
X-Jenkins-Result: FAILURE
See <https://builds.apache.org/job/Hadoop-Common-0.23-Build/169/changes>
Changes:
[mattf] HADOOP-8050. Deadlock in metrics. Contributed by Kihwal Lee.
------------------------------------------
[...truncated 204499 lines...]
42 KB 7 KB 7 KB
42 KB 7 KB 7 KB
42 KB 8 KB 7 KB
42 KB 8 KB 7 KB
42 KB 9 KB 7 KB
42 KB 10 KB 7 KB
42 KB 10 KB 7 KB
42 KB 11 KB 7 KB
42 KB 11 KB 7 KB
42 KB 12 KB 7 KB
42 KB 12 KB 7 KB
42 KB 13 KB 7 KB
42 KB 13 KB 7 KB
42 KB 14 KB 7 KB
42 KB 14 KB 7 KB
42 KB 15 KB 7 KB
42 KB 15 KB 7 KB
42 KB 16 KB 7 KB
42 KB 16 KB 7 KB
42 KB 17 KB 7 KB
42 KB 17 KB 7 KB
42 KB 18 KB 7 KB
42 KB 18 KB 7 KB
42 KB 18 KB 7 KB
42 KB 19 KB 7 KB
42 KB 19 KB 7 KB
42 KB 20 KB 7 KB
42 KB 20 KB 7 KB
42 KB 21 KB 7 KB
42 KB 21 KB 7 KB
42 KB 22 KB 7 KB
42 KB 22 KB 7 KB
42 KB 23 KB 7 KB
42 KB 23 KB 7 KB
42 KB 24 KB 7 KB
42 KB 25 KB 7 KB
42 KB 25 KB 7 KB
42 KB 26 KB 7 KB
42 KB 26 KB 7 KB
42 KB 27 KB 7 KB
42 KB 27 KB 7 KB
42 KB 28 KB 7 KB
42 KB 29 KB 7 KB
42 KB 29 KB 7 KB
42 KB 30 KB 7 KB
42 KB 30 KB 7 KB
42 KB 30 KB 7 KB
42 KB 31 KB 7 KB
42 KB 31 KB 7 KB
42 KB 32 KB 7 KB
42 KB 32 KB 7 KB
42 KB 33 KB 7 KB
42 KB 33 KB 7 KB
42 KB 34 KB 7 KB
42 KB 35 KB 7 KB
42 KB 35 KB 7 KB
42 KB 36 KB 7 KB
42 KB 36 KB 7 KB
42 KB 37 KB 7 KB
42 KB 37 KB 7 KB
42 KB 38 KB 7 KB
42 KB 39 KB 7 KB
42 KB 39 KB 7 KB
42 KB 40 KB 7 KB
42 KB 40 KB 7 KB
42 KB 41 KB 7 KB
42 KB 41 KB 7 KB
42 KB 42 KB 7 KB
42 KB 42 KB 7 KB
42 KB 43 KB 7 KB
42 KB 43 KB 7 KB
42 KB 45 KB 7 KB
42 KB 49 KB 7 KB
42 KB 50 KB 7 KB
42 KB 848 B 50 KB 7 KB
42 KB 2 KB 50 KB 7 KB
42 KB 2 KB 50 KB 7 KB
42 KB 3 KB 50 KB 7 KB
42 KB 3 KB 50 KB 7 KB
42 KB 4 KB 50 KB 7 KB
42 KB 4 KB 50 KB 7 KB
42 KB 5 KB 50 KB 7 KB
42 KB 5 KB 50 KB 7 KB
42 KB 6 KB 50 KB 7 KB
42 KB 6 KB 50 KB 7 KB
42 KB 7 KB 50 KB 7 KB
42 KB 7 KB 50 KB 7 KB
42 KB 8 KB 50 KB 7 KB
42 KB 8 KB 50 KB 7 KB
42 KB 9 KB 50 KB 7 KB
42 KB 9 KB 50 KB 7 KB
42 KB 10 KB 50 KB 7 KB
42 KB 10 KB 50 KB 7 KB
42 KB 11 KB 50 KB 7 KB
42 KB 11 KB 50 KB 7 KB
42 KB 12 KB 50 KB 7 KB
42 KB 12 KB 50 KB 7 KB
42 KB 13 KB 50 KB 7 KB
42 KB 13 KB 50 KB 7 KB
42 KB 14 KB 50 KB 7 KB
42 KB 14 KB 50 KB 7 KB
42 KB 15 KB 50 KB 7 KB
42 KB 15 KB 50 KB 7 KB
42 KB 16 KB 50 KB 7 KB
42 KB 16 KB 50 KB 7 KB
42 KB 17 KB 50 KB 7 KB
42 KB 17 KB 50 KB 7 KB
42 KB 18 KB 50 KB 7 KB
42 KB 19 KB 50 KB 7 KB
42 KB 19 KB 50 KB 7 KB
42 KB 20 KB 50 KB 7 KB
42 KB 20 KB 50 KB 7 KB
42 KB 21 KB 50 KB 7 KB
42 KB 23 KB 50 KB 7 KB
Downloaded: http://repo1.maven.org/maven2/org/apache/maven/shared/maven-filtering/1.0/maven-filtering-1.0.jar (42 KB at 18.6 KB/sec)
Downloaded: http://repo1.maven.org/maven2/org/sonatype/plexus/plexus-build-api/0.0.4/plexus-build-api-0.0.4.jar (7 KB at 3.0 KB/sec)
Downloaded: http://repo1.maven.org/maven2/org/codehaus/plexus/plexus-io/1.0.1/plexus-io-1.0.1.jar (50 KB at 21.7 KB/sec)
Downloaded: http://repo1.maven.org/maven2/org/apache/maven/shared/maven-repository-builder/1.0-alpha-2/maven-repository-builder-1.0-alpha-2.jar (23 KB at 10.0 KB/sec)
[WARNING] The following patterns were never triggered in this artifact exclusion filter:
o 'org.apache.ant:*:jar'
o 'jdiff:jdiff:jar'
[INFO] share/hadoop/common/jdiff/ already added, skipping
[INFO] Copying files to <https://builds.apache.org/job/Hadoop-Common-0.23-Build/ws/trunk/hadoop-common-project/hadoop-common/target/hadoop-common-0.23.2-SNAPSHOT>
[INFO] share/hadoop/common/jdiff/ already added, skipping
[INFO]
[INFO] --- maven-jar-plugin:2.3.1:jar (default-jar) @ hadoop-common ---
[INFO]
[INFO] --- maven-source-plugin:2.1.2:jar-no-fork (hadoop-java-sources) @ hadoop-common ---
[INFO] org already added, skipping
[INFO] org/apache already added, skipping
[INFO] org/apache/hadoop already added, skipping
[INFO] Building jar: <https://builds.apache.org/job/Hadoop-Common-0.23-Build/ws/trunk/hadoop-common-project/hadoop-common/target/hadoop-common-0.23.2-SNAPSHOT-sources.jar>
[INFO] org already added, skipping
[INFO] org/apache already added, skipping
[INFO] org/apache/hadoop already added, skipping
[WARNING] Artifact org.apache.hadoop:hadoop-common:java-source:sources:0.23.2-SNAPSHOT already attached to project, ignoring duplicate
[INFO]
[INFO] --- maven-site-plugin:3.0:attach-descriptor (attach-descriptor) @ hadoop-common ---
[INFO]
[INFO] --- maven-antrun-plugin:1.6:run (tar) @ hadoop-common ---
[INFO] Executing tasks
main:
[INFO] Executed tasks
[INFO]
[INFO] --- maven-javadoc-plugin:2.8.1:jar (module-javadocs) @ hadoop-common ---
[INFO]
ExcludePrivateAnnotationsStandardDoclet
9 warnings
[WARNING] Javadoc Warnings
[WARNING] <https://builds.apache.org/job/Hadoop-Common-0.23-Build/ws/trunk/hadoop-common-project/hadoop-common/src/main/java/org/apache/hadoop/security/SecurityUtil.java>:49: warning: sun.net.dns.ResolverConfiguration is Sun proprietary API and may be removed in a future release
[WARNING] import sun.net.dns.ResolverConfiguration;
[WARNING] ^
[WARNING] <https://builds.apache.org/job/Hadoop-Common-0.23-Build/ws/trunk/hadoop-common-project/hadoop-common/src/main/java/org/apache/hadoop/security/SecurityUtil.java>:50: warning: sun.net.util.IPAddressUtil is Sun proprietary API and may be removed in a future release
[WARNING] import sun.net.util.IPAddressUtil;
[WARNING] ^
[WARNING] <https://builds.apache.org/job/Hadoop-Common-0.23-Build/ws/trunk/hadoop-common-project/hadoop-common/src/main/java/org/apache/hadoop/security/SecurityUtil.java>:51: warning: sun.security.jgss.krb5.Krb5Util is Sun proprietary API and may be removed in a future release
[WARNING] import sun.security.jgss.krb5.Krb5Util;
[WARNING] ^
[WARNING] <https://builds.apache.org/job/Hadoop-Common-0.23-Build/ws/trunk/hadoop-common-project/hadoop-common/src/main/java/org/apache/hadoop/security/SecurityUtil.java>:52: warning: sun.security.krb5.Credentials is Sun proprietary API and may be removed in a future release
[WARNING] import sun.security.krb5.Credentials;
[WARNING] ^
[WARNING] <https://builds.apache.org/job/Hadoop-Common-0.23-Build/ws/trunk/hadoop-common-project/hadoop-common/src/main/java/org/apache/hadoop/security/SecurityUtil.java>:53: warning: sun.security.krb5.PrincipalName is Sun proprietary API and may be removed in a future release
[WARNING] import sun.security.krb5.PrincipalName;
[WARNING] ^
[WARNING] <https://builds.apache.org/job/Hadoop-Common-0.23-Build/ws/trunk/hadoop-common-project/hadoop-common/src/main/java/org/apache/hadoop/security/HadoopKerberosName.java>:28: warning: sun.security.krb5.Config is Sun proprietary API and may be removed in a future release
[WARNING] import sun.security.krb5.Config;
[WARNING] ^
[WARNING] <https://builds.apache.org/job/Hadoop-Common-0.23-Build/ws/trunk/hadoop-common-project/hadoop-common/src/main/java/org/apache/hadoop/security/HadoopKerberosName.java>:29: warning: sun.security.krb5.KrbException is Sun proprietary API and may be removed in a future release
[WARNING] import sun.security.krb5.KrbException;
[WARNING] ^
[WARNING] <https://builds.apache.org/job/Hadoop-Common-0.23-Build/ws/trunk/hadoop-common-project/hadoop-common/src/main/java/org/apache/hadoop/io/FastByteComparisons.java>:25: warning: sun.misc.Unsafe is Sun proprietary API and may be removed in a future release
[WARNING] import sun.misc.Unsafe;
[WARNING] ^
[WARNING] <https://builds.apache.org/job/Hadoop-Common-0.23-Build/ws/trunk/hadoop-common-project/hadoop-common/src/main/java/org/apache/hadoop/io/FastByteComparisons.java>:117: warning: sun.misc.Unsafe is Sun proprietary API and may be removed in a future release
[WARNING] static final Unsafe theUnsafe;
[WARNING] ^
[INFO] Building jar: <https://builds.apache.org/job/Hadoop-Common-0.23-Build/ws/trunk/hadoop-common-project/hadoop-common/target/hadoop-common-0.23.2-SNAPSHOT-javadoc.jar>
[INFO]
[INFO] --- maven-checkstyle-plugin:2.6:checkstyle (default-cli) @ hadoop-common ---
[INFO]
[INFO] There are 8472 checkstyle errors.
[WARNING] Unable to locate Source XRef to link to - DISABLED
[INFO]
[INFO] --- findbugs-maven-plugin:2.3.2:findbugs (default-cli) @ hadoop-common ---
[INFO] ****** FindBugsMojo execute *******
[INFO] canGenerate is true
[INFO] ****** FindBugsMojo executeFindbugs *******
[INFO] Temp File is <https://builds.apache.org/job/Hadoop-Common-0.23-Build/ws/trunk/hadoop-common-project/hadoop-common/target/findbugsTemp.xml>
[INFO] Fork Value is true
[java] The following classes needed for analysis were missing:
[java] org.codehaus.jackson.FormatSchema
[java] org.codehaus.jackson.format.InputAccessor
[java] Missing classes: 1
[INFO] xmlOutput is false
[INFO]
[INFO] ------------------------------------------------------------------------
[INFO] Building Apache Hadoop Common Project 0.23.2-SNAPSHOT
[INFO] ------------------------------------------------------------------------
[INFO]
[INFO] --- maven-clean-plugin:2.4.1:clean (default-clean) @ hadoop-common-project ---
[INFO] Deleting <https://builds.apache.org/job/Hadoop-Common-0.23-Build/ws/trunk/hadoop-common-project/target>
[INFO]
[INFO] --- maven-antrun-plugin:1.6:run (create-testdirs) @ hadoop-common-project ---
[INFO] Executing tasks
main:
[mkdir] Created dir: <https://builds.apache.org/job/Hadoop-Common-0.23-Build/ws/trunk/hadoop-common-project/target/test-dir>
[INFO] Executed tasks
[INFO]
[INFO] --- maven-source-plugin:2.1.2:jar-no-fork (hadoop-java-sources) @ hadoop-common-project ---
[INFO]
[INFO] --- maven-site-plugin:3.0:attach-descriptor (attach-descriptor) @ hadoop-common-project ---
[INFO]
[INFO] --- maven-javadoc-plugin:2.8.1:jar (module-javadocs) @ hadoop-common-project ---
[INFO] Not executing Javadoc as the project is not a Java classpath-capable package
[INFO]
[INFO] --- maven-checkstyle-plugin:2.6:checkstyle (default-cli) @ hadoop-common-project ---
[INFO]
[INFO] --- findbugs-maven-plugin:2.3.2:findbugs (default-cli) @ hadoop-common-project ---
[INFO] ****** FindBugsMojo execute *******
[INFO] canGenerate is false
[INFO] ------------------------------------------------------------------------
[INFO] Reactor Summary:
[INFO]
[INFO] Apache Hadoop Annotations ......................... SUCCESS [1:32.806s]
[INFO] Apache Hadoop Auth ................................ SUCCESS [1:20.010s]
[INFO] Apache Hadoop Auth Examples ....................... SUCCESS [7.801s]
[INFO] Apache Hadoop Common .............................. SUCCESS [4:46.560s]
[INFO] Apache Hadoop Common Project ...................... SUCCESS [0.038s]
[INFO] ------------------------------------------------------------------------
[INFO] BUILD SUCCESS
[INFO] ------------------------------------------------------------------------
[INFO] Total time: 7:58.929s
[INFO] Finished at: Mon Feb 20 09:21:06 UTC 2012
[INFO] Final Memory: 80M/774M
[INFO] ------------------------------------------------------------------------
+ /home/jenkins/tools/maven/latest/bin/mvn test -Pclover -DcloverLicenseLocation=/home/jenkins/tools/clover/latest/lib/clover.license
Build step 'Execute shell' marked build as failure
[WARNINGS] Skipping publisher since build result is FAILURE
Archiving artifacts
Recording fingerprints
Publishing Javadoc
Recording test results
From common-dev-return-77792-apmail-hadoop-common-dev-archive=hadoop.apache.org@hadoop.apache.org Mon Feb 20 13:16:06 2012
Return-Path: <common-dev-return-77792-apmail-hadoop-common-dev-archive=hadoop.apache.org@hadoop.apache.org>
X-Original-To: apmail-hadoop-common-dev-archive@www.apache.org
Delivered-To: apmail-hadoop-common-dev-archive@www.apache.org
Received: from mail.apache.org (hermes.apache.org [140.211.11.3])
by minotaur.apache.org (Postfix) with SMTP id 67F7996F9
for <apmail-hadoop-common-dev-archive@www.apache.org>; Mon, 20 Feb 2012 13:16:06 +0000 (UTC)
Received: (qmail 73148 invoked by uid 500); 20 Feb 2012 13:16:04 -0000
Delivered-To: apmail-hadoop-common-dev-archive@hadoop.apache.org
Received: (qmail 73091 invoked by uid 500); 20 Feb 2012 13:16:04 -0000
Mailing-List: contact common-dev-help@hadoop.apache.org; run by ezmlm
Precedence: bulk
List-Help: <mailto:common-dev-help@hadoop.apache.org>
List-Unsubscribe: <mailto:common-dev-unsubscribe@hadoop.apache.org>
List-Post: <mailto:common-dev@hadoop.apache.org>
List-Id: <common-dev.hadoop.apache.org>
Reply-To: common-dev@hadoop.apache.org
Delivered-To: mailing list common-dev@hadoop.apache.org
Received: (qmail 73080 invoked by uid 99); 20 Feb 2012 13:16:04 -0000
Received: from nike.apache.org (HELO nike.apache.org) (192.87.106.230)
by apache.org (qpsmtpd/0.29) with ESMTP; Mon, 20 Feb 2012 13:16:04 +0000
X-ASF-Spam-Status: No, hits=2.5 required=5.0
tests=FREEMAIL_REPLY,HTML_MESSAGE,RCVD_IN_DNSWL_LOW,SPF_PASS,T_FRT_BELOW2
X-Spam-Check-By: apache.org
Received-SPF: pass (nike.apache.org: domain of masmertoz@gmail.com designates 209.85.214.176 as permitted sender)
Received: from [209.85.214.176] (HELO mail-tul01m020-f176.google.com) (209.85.214.176)
by apache.org (qpsmtpd/0.29) with ESMTP; Mon, 20 Feb 2012 13:15:57 +0000
Received: by obbwd18 with SMTP id wd18so9893711obb.35
for <common-dev@hadoop.apache.org>; Mon, 20 Feb 2012 05:15:36 -0800 (PST)
Received-SPF: pass (google.com: domain of masmertoz@gmail.com designates 10.50.95.195 as permitted sender) client-ip=10.50.95.195;
Authentication-Results: mr.google.com; spf=pass (google.com: domain of masmertoz@gmail.com designates 10.50.95.195 as permitted sender) smtp.mail=masmertoz@gmail.com; dkim=pass header.i=masmertoz@gmail.com
Received: from mr.google.com ([10.50.95.195])
by 10.50.95.195 with SMTP id dm3mr12614193igb.9.1329743736365 (num_hops = 1);
Mon, 20 Feb 2012 05:15:36 -0800 (PST)
DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed;
d=gmail.com; s=gamma;
h=mime-version:in-reply-to:references:date:message-id:subject:from:to
:content-type;
bh=RgfNERBpRzgvveQ6L4ElRLesLFCzRgz/3m/29xx06cY=;
b=FGTPbLjEnQhdi3x6p4bfCbSRUHGKvcrKTKj9PVotwQLoZb3m00GfYKbRjNesUPc17Z
EfbV5CZqWexHmx3Y4HigdQdZhkm1cv0Q8rhXC+h3BMm7GDrTaBalFmOSs2qLO8Gy8abc
cp9zL28dBamEUH0EeBl+fVdL5rBUyBhHOkSAU=
MIME-Version: 1.0
Received: by 10.50.95.195 with SMTP id dm3mr10224122igb.9.1329743736233; Mon,
20 Feb 2012 05:15:36 -0800 (PST)
Received: by 10.42.241.132 with HTTP; Mon, 20 Feb 2012 05:15:36 -0800 (PST)
In-Reply-To: <CABykE-yoLCxWByM72=w2-F+6ARkLaZfK3HsvBHLYJBUmJvna_w@mail.gmail.com>
References: <CAAo2Vhr6NwmV3xJJi3cBCpx8sf1q-NmFkk-XL+VFFbb65hyurw@mail.gmail.com>
<CABykE-yoLCxWByM72=w2-F+6ARkLaZfK3HsvBHLYJBUmJvna_w@mail.gmail.com>
Date: Mon, 20 Feb 2012 14:15:36 +0100
Message-ID: <CAENBeZZuu9HWj77T6y=Qx7eOkMLH+-vLgAOCyn=awLqHVsB2Yw@mail.gmail.com>
Subject: Re: Install an environment for hadoop development
From: Merto Mertek <masmertoz@gmail.com>
To: common-dev@hadoop.apache.org
Content-Type: multipart/alternative; boundary=e89a8f2349cb0a5efc04b96517fb
X-Virus-Checked: Checked by ClamAV on apache.org
--e89a8f2349cb0a5efc04b96517fb
Content-Type: text/plain; charset=ISO-8859-1
You can try to see if you find something useful from bellow links.. I think
both of them require svn and not git..
http://www.cloudera.com/blog/2009/04/configuring-eclipse-for-hadoop-development-a-screencast/
http://wiki.apache.org/hadoop/BuildingHadoopFromSVN?highlight=%28svn%29
On 20 February 2012 09:22, Jabir Ahmed <jabirahmed@gmail.com> wrote:
> have you set the classpaths correctly?
> what kind of errors do you see?
>
> On Mon, Feb 20, 2012 at 8:06 AM, Ahmed Elgohary <aagohary@gmail.com>
> wrote:
>
> > Hi,
> >
> > I am trying to install an environment to start trying out some
> > modifications to hadoop. All what I need is to have an eclipse project
> than
> > I can modify, build, and generate a new hadoop jar file (like
> > hadoop-core.jar). I followed the instructions in this page (
> > http://wiki.apache.org/hadoop/EclipseEnvironment) till getting all the
> > builds performed successfully. Then, I added the 4 projects
> > (hadoop-common-project, hadoop-assemblies, hadoop-hdfs-project, and
> > hadoop-mapreduce-project) to eclipse. Then, I found several compilation
> > errors in the the 3 projects (hadoop-common-project, hadoop-hdfs-project,
> > and hadoop-mapreduce-project).
> >
> > I cannot find any clue to figure out what is wrong.
> > Actually, I am new to hadoop. Is there a simpler way to modify mapreduce
> > code, build it and get the modified jar?
> >
> >
> > --ahmed
> >
>
>
>
> --
> "The best way to make your dreams come true is to wake up." - Paul Valery
>
> --
> Phone: +91 99162 93063
> IM/e-mail: jabirahmed@yahoo.com , jabirahmed@gmail.com
>
--e89a8f2349cb0a5efc04b96517fb--
From common-dev-return-77793-apmail-hadoop-common-dev-archive=hadoop.apache.org@hadoop.apache.org Mon Feb 20 13:26:25 2012
Return-Path: <common-dev-return-77793-apmail-hadoop-common-dev-archive=hadoop.apache.org@hadoop.apache.org>
X-Original-To: apmail-hadoop-common-dev-archive@www.apache.org
Delivered-To: apmail-hadoop-common-dev-archive@www.apache.org
Received: from mail.apache.org (hermes.apache.org [140.211.11.3])
by minotaur.apache.org (Postfix) with SMTP id 5A47B9B0C
for <apmail-hadoop-common-dev-archive@www.apache.org>; Mon, 20 Feb 2012 13:26:25 +0000 (UTC)
Received: (qmail 1208 invoked by uid 500); 20 Feb 2012 13:26:23 -0000
Delivered-To: apmail-hadoop-common-dev-archive@hadoop.apache.org
Received: (qmail 1155 invoked by uid 500); 20 Feb 2012 13:26:23 -0000
Mailing-List: contact common-dev-help@hadoop.apache.org; run by ezmlm
Precedence: bulk
List-Help: <mailto:common-dev-help@hadoop.apache.org>
List-Unsubscribe: <mailto:common-dev-unsubscribe@hadoop.apache.org>
List-Post: <mailto:common-dev@hadoop.apache.org>
List-Id: <common-dev.hadoop.apache.org>
Reply-To: common-dev@hadoop.apache.org
Delivered-To: mailing list common-dev@hadoop.apache.org
Received: (qmail 1146 invoked by uid 99); 20 Feb 2012 13:26:23 -0000
Received: from nike.apache.org (HELO nike.apache.org) (192.87.106.230)
by apache.org (qpsmtpd/0.29) with ESMTP; Mon, 20 Feb 2012 13:26:23 +0000
X-ASF-Spam-Status: No, hits=1.5 required=5.0
tests=HTML_MESSAGE,RCVD_IN_DNSWL_LOW,SPF_PASS
X-Spam-Check-By: apache.org
Received-SPF: pass (nike.apache.org: domain of jzhang.ch@gmail.com designates 209.85.210.48 as permitted sender)
Received: from [209.85.210.48] (HELO mail-pz0-f48.google.com) (209.85.210.48)
by apache.org (qpsmtpd/0.29) with ESMTP; Mon, 20 Feb 2012 13:26:16 +0000
Received: by dadp13 with SMTP id p13so6910640dad.35
for <common-dev@hadoop.apache.org>; Mon, 20 Feb 2012 05:25:55 -0800 (PST)
Received-SPF: pass (google.com: domain of jzhang.ch@gmail.com designates 10.68.135.137 as permitted sender) client-ip=10.68.135.137;
Authentication-Results: mr.google.com; spf=pass (google.com: domain of jzhang.ch@gmail.com designates 10.68.135.137 as permitted sender) smtp.mail=jzhang.ch@gmail.com; dkim=pass header.i=jzhang.ch@gmail.com
Received: from mr.google.com ([10.68.135.137])
by 10.68.135.137 with SMTP id ps9mr63269049pbb.40.1329744355135 (num_hops = 1);
Mon, 20 Feb 2012 05:25:55 -0800 (PST)
DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed;
d=gmail.com; s=gamma;
h=mime-version:in-reply-to:references:date:message-id:subject:from:to
:content-type;
bh=r3NHSdDY5ZBbf7dk0VezIHbGdt2d4sT/glp6hT8+ep0=;
b=lklgcit2C6wDXK6SJhoHzWO4mm2lNx2mawwC40XFvBGzN+BO1dcxak9pd3RDAKbqWR
41Xl9rozWB7h2pvkqT5Pn2EuG44amMY3t31WXdUAgRvNFjg/58rf5J0dGESSYFLvJX6+
Hz/Upyf5HlHF8nOj3xOr/W2fSu/2Q5Q7R7L1Q=
MIME-Version: 1.0
Received: by 10.68.135.137 with SMTP id ps9mr52411722pbb.40.1329744355076;
Mon, 20 Feb 2012 05:25:55 -0800 (PST)
Received: by 10.142.52.4 with HTTP; Mon, 20 Feb 2012 05:25:55 -0800 (PST)
In-Reply-To: <4F420448.6030407@nanthrax.net>
References: <CAHpSMN3fBpC6pGSBqpg-Hg2rp4LDUC1KHfXGK3b9USxAJyDETQ@mail.gmail.com>
<4F420448.6030407@nanthrax.net>
Date: Mon, 20 Feb 2012 21:25:55 +0800
Message-ID: <CAHpSMN3keVojYNbs0KcTOXMg27ypUDsWRgn_SPqtKEmKmVuMgA@mail.gmail.com>
Subject: Re: How to launch hadoop from eclipse
From: Zhang Jianfeng <jzhang.ch@gmail.com>
To: common-dev@hadoop.apache.org
Content-Type: multipart/alternative; boundary=047d7b10cbcfed297804b9653b42
X-Virus-Checked: Checked by ClamAV on apache.org
--047d7b10cbcfed297804b9653b42
Content-Type: text/plain; charset=UTF-8
Content-Transfer-Encoding: quoted-printable
Hi JB,
Thanks for your reply. The patch sounds great. Actually I wonder how to
launch the hadoop as a Java project application in eclipse.
Regards,
Jian Feng
2012/2/20 Jean-Baptiste Onofr=C3=A9 <jb@nanthrax.net>
> Hi Jian,
>
> FYI, I just submitted a patch to turn hadoop-common modules as OSGi
> bundles.
>
> It's still work in progress (I have bunch of other patches in
> preparation), but basically it means that it can be deployed as Eclipse
> plugins.
>
> Regards
> JB
>
>
> On 02/20/2012 09:26 AM, Zhang Jianfeng wrote:
>
>> Hi Guys,
>>
>> I downloaded the hadoop source code and imported into my eclipse IDE=
.
>> I
>> can compile it without any error. It looks work fine. But I wonder how t=
o
>> launch hadoop services from eclipse env.
>>
>> Thanks in advance.
>>
>> Jian Feng
>>
>>
> --
> Jean-Baptiste Onofr=C3=A9
> jbonofre@apache.org
> http://blog.nanthrax.net
> Talend - http://www.talend.com
>
--047d7b10cbcfed297804b9653b42--
From common-dev-return-77794-apmail-hadoop-common-dev-archive=hadoop.apache.org@hadoop.apache.org Mon Feb 20 14:14:03 2012
Return-Path: <common-dev-return-77794-apmail-hadoop-common-dev-archive=hadoop.apache.org@hadoop.apache.org>
X-Original-To: apmail-hadoop-common-dev-archive@www.apache.org
Delivered-To: apmail-hadoop-common-dev-archive@www.apache.org
Received: from mail.apache.org (hermes.apache.org [140.211.11.3])
by minotaur.apache.org (Postfix) with SMTP id 2E16E9F3C
for <apmail-hadoop-common-dev-archive@www.apache.org>; Mon, 20 Feb 2012 14:14:03 +0000 (UTC)
Received: (qmail 42338 invoked by uid 500); 20 Feb 2012 14:14:01 -0000
Delivered-To: apmail-hadoop-common-dev-archive@hadoop.apache.org
Received: (qmail 42269 invoked by uid 500); 20 Feb 2012 14:14:01 -0000
Mailing-List: contact common-dev-help@hadoop.apache.org; run by ezmlm
Precedence: bulk
List-Help: <mailto:common-dev-help@hadoop.apache.org>
List-Unsubscribe: <mailto:common-dev-unsubscribe@hadoop.apache.org>
List-Post: <mailto:common-dev@hadoop.apache.org>
List-Id: <common-dev.hadoop.apache.org>
Reply-To: common-dev@hadoop.apache.org
Delivered-To: mailing list common-dev@hadoop.apache.org
Delivered-To: moderator for common-dev@hadoop.apache.org
Received: (qmail 40675 invoked by uid 99); 20 Feb 2012 07:54:10 -0000
X-ASF-Spam-Status: No, hits=1.5 required=5.0
tests=HTML_MESSAGE,RCVD_IN_DNSWL_LOW,SPF_PASS
X-Spam-Check-By: apache.org
Received-SPF: pass (athena.apache.org: domain of kungu.mjh@taobao.com designates 121.0.29.147 as permitted sender)
X-AuditID: 0a14034d-b7beaae000000495-30-4f41fc05dcdd
From: =?gb2312?B?wKS5yA==?= <kungu.mjh@taobao.com>
To: "common-dev@hadoop.apache.org" <common-dev@hadoop.apache.org>
Subject: IFileOutputStream
Thread-Topic: IFileOutputStream
Thread-Index: AczvotuN0o2lCxSXSYytfo6n1NiI0w==
Date: Mon, 20 Feb 2012 07:53:39 +0000
Message-ID: <6B35018DED632F46AA57A324543C5EB74494ED2F@CNHZ-EXMAIL-02.ali.com>
Accept-Language: zh-CN, en-US
Content-Language: zh-CN
X-MS-Has-Attach:
X-MS-TNEF-Correlator:
x-originating-ip: [10.20.8.3]
Content-Type: multipart/alternative;
boundary="_000_6B35018DED632F46AA57A324543C5EB74494ED2FCNHZEXMAIL02ali_"
MIME-Version: 1.0
X-Brightmail-Tracker: AAAAAA==
--_000_6B35018DED632F46AA57A324543C5EB74494ED2FCNHZEXMAIL02ali_
Content-Type: text/plain; charset="gb2312"
Content-Transfer-Encoding: base64
SGkgZXhwZXJ0cywNCg0KSSBoYXZlIGEgcXVlc3Rpb24gb24gSUZpbGVPdXRwdXRTdHJlYW0uDQpJ
IGd1ZXNzIHdoZW4gd3JpdGluZyBrZXkvdmFsdWUgbGVuZ3RoICgxIG9yIDJieXRlcyl0byBJRmls
ZSwgdGhpcyBmdW5jdGlvbiBpcyBpbmVmZmljaWVudDoNCnB1YmxpYyB2b2lkIHdyaXRlKGJ5dGVb
XSBiLCBpbnQgb2ZmLCBpbnQgbGVuKSB0aHJvd3MgSU9FeGNlcHRpb24gew0KICBzdW0udXBkYXRl
KGIsIG9mZixsZW4pOw0KICBvdXQud3JpdGUoYixvZmYsbGVuKTsNCn0NCkkgbWFrZSB0aGUgZm9s
bG93aW5nIGNoYW5nZXMsIGFuZCBzZWUgc29tZSBpbXByb3ZlIHVuZGVyIGNlcnRhaW4gY2lyY3Vt
c3RhbmNlLg0KV2FpdGluZyBmb3IgeW91ciBwcm9mZXNzaW9uYWwgYW5zd2VyLg0KDQpSZWdhcmRz
LA0KS3VuZ3UNCg0KDQoNCkBAIC0zNiw0MyArMzYsMTI4IEBADQogICBwcml2YXRlIGZpbmFsIERh
dGFDaGVja3N1bSBzdW07DQogICBwcml2YXRlIGJ5dGVbXSBiYXJyYXk7DQogICBwcml2YXRlIGJv
b2xlYW4gY2xvc2VkID0gZmFsc2U7DQorDQorICAvKioNCisgICAqIFRoZSBpbnRlcm5hbCBidWZm
ZXIgd2hlcmUgZGF0YSBpcyBzdG9yZWQuDQorICAgKi8NCisgIHByb3RlY3RlZCBieXRlIGJ1Zltd
Ow0KDQogICAvKioNCi0gICAqIENyZWF0ZSBhIGNoZWNrc3VtIG91dHB1dCBzdHJlYW0gdGhhdCB3
cml0ZXMNCi0gICAqIHRoZSBieXRlcyB0byB0aGUgZ2l2ZW4gc3RyZWFtLg0KLSAgICogQHBhcmFt
IG91dA0KKyAgICogVGhlIG51bWJlciBvZiB2YWxpZCBieXRlcyBpbiB0aGUgYnVmZmVyLiBUaGlz
IHZhbHVlIGlzIGFsd2F5cw0KKyAgICogaW4gdGhlIHJhbmdlIDx0dD4wPC90dD4gdGhyb3VnaCA8
dHQ+YnVmLmxlbmd0aDwvdHQ+OyBlbGVtZW50cw0KKyAgICogPHR0PmJ1ZlswXTwvdHQ+IHRocm91
Z2ggPHR0PmJ1Zltjb3VudC0xXTwvdHQ+IGNvbnRhaW4gdmFsaWQNCisgICAqIGJ5dGUgZGF0YS4N
CiAgICAqLw0KKyAgcHJvdGVjdGVkIGludCBjb3VudDsNCisNCisgIC8qKg0KKyAgICogQ3JlYXRl
cyBhIG5ldyBjaGVja3N1bSBidWZmZXJlZCBvdXRwdXQgc3RyZWFtIHRvIHdyaXRlIGRhdGEgdG8N
CisgICAqIHRoZSBzcGVjaWZpZWQgdW5kZXJseWluZyBvdXRwdXQgc3RyZWFtLg0KKyAgICoNCisg
ICAqIEBwYXJhbSAgIG91dCAgIHRoZSB1bmRlcmx5aW5nIG91dHB1dCBzdHJlYW0uDQorICAgKi8N
CiAgIHB1YmxpYyBJRmlsZU91dHB1dFN0cmVhbShPdXRwdXRTdHJlYW0gb3V0KSB7DQotICAgIHN1
cGVyKG91dCk7DQotICAgIHN1bSA9IERhdGFDaGVja3N1bS5uZXdEYXRhQ2hlY2tzdW0oRGF0YUNo
ZWNrc3VtLkNIRUNLU1VNX0NSQzMyLA0KLSAgICAgICAgSW50ZWdlci5NQVhfVkFMVUUpOw0KLSAg
ICBiYXJyYXkgPSBuZXcgYnl0ZVtzdW0uZ2V0Q2hlY2tzdW1TaXplKCldOw0KKyB0aGlzKG91dCwg
ODE5Mik7DQogICB9DQotDQorDQorICAvKioNCisgICAqIENyZWF0ZXMgYSBuZXcgYnVmZmVyZWQg
b3V0cHV0IHN0cmVhbSB0byB3cml0ZSBkYXRhIHRvIHRoZQ0KKyAgICogc3BlY2lmaWVkIHVuZGVy
bHlpbmcgb3V0cHV0IHN0cmVhbSB3aXRoIHRoZSBzcGVjaWZpZWQgYnVmZmVyDQorICAgKiBzaXpl
Lg0KKyAgICoNCisgICAqIEBwYXJhbSAgIG91dCAgICB0aGUgdW5kZXJseWluZyBvdXRwdXQgc3Ry
ZWFtLg0KKyAgICogQHBhcmFtICAgc2l6ZSAgIHRoZSBidWZmZXIgc2l6ZS4NCisgICAqIEBleGNl
cHRpb24gSWxsZWdhbEFyZ3VtZW50RXhjZXB0aW9uIGlmIHNpemUgJmx0Oz0gMC4NCisgICAqLw0K
KyAgcHVibGljIElGaWxlT3V0cHV0U3RyZWFtKE91dHB1dFN0cmVhbSBvdXQsIGludCBzaXplKSB7
DQorIHN1cGVyKG91dCk7DQorICAgIGlmIChzaXplIDw9IDApIHsNCisgICAgICAgICAgdGhyb3cg
bmV3IElsbGVnYWxBcmd1bWVudEV4Y2VwdGlvbigiQnVmZmVyIHNpemUgPD0gMCIpOw0KKyAgICB9
DQorIGJ1ZiA9IG5ldyBieXRlW3NpemVdOw0KKw0KKyBzdW0gPSBEYXRhQ2hlY2tzdW0ubmV3RGF0
YUNoZWNrc3VtKERhdGFDaGVja3N1bS5DSEVDS1NVTV9DUkMzMiwNCisgICAgICAgIEludGVnZXIu
TUFYX1ZBTFVFKTsNCisgYmFycmF5ID0gbmV3IGJ5dGVbc3VtLmdldENoZWNrc3VtU2l6ZSgpXTsN
CisgIH0NCisNCisgIC8qKiBGbHVzaCB0aGUgaW50ZXJuYWwgYnVmZmVyICovDQorICBwcml2YXRl
IHZvaWQgZmx1c2hCdWZmZXIoKSB0aHJvd3MgSU9FeGNlcHRpb24gew0KKyAgICAgIGlmIChjb3Vu
dCA+IDApIHsNCisgICAgIHN1bS51cGRhdGUoYnVmLCAwLCBjb3VudCk7DQorICAgIG91dC53cml0
ZShidWYsIDAsIGNvdW50KTsNCisgICAgY291bnQgPSAwOw0KKyAgICAgIH0NCisgIH0NCisNCisg
IC8qKg0KKyAgICogV3JpdGVzIHRoZSBzcGVjaWZpZWQgYnl0ZSB0byB0aGlzIGJ1ZmZlcmVkIG91
dHB1dCBzdHJlYW0uDQorICAgKg0KKyAgICogQHBhcmFtICAgICAgYiAgIHRoZSBieXRlIHRvIGJl
IHdyaXR0ZW4uDQorICAgKiBAZXhjZXB0aW9uICBJT0V4Y2VwdGlvbiAgaWYgYW4gSS9PIGVycm9y
IG9jY3Vycy4NCisgICAqLw0KKyAgcHVibGljIHZvaWQgd3JpdGUoaW50IGIpIHRocm93cyBJT0V4
Y2VwdGlvbiB7DQorIGlmIChjb3VudCA+PSBidWYubGVuZ3RoKSB7DQorICAgIGZsdXNoQnVmZmVy
KCk7DQorIH0NCisgYnVmW2NvdW50KytdID0gKGJ5dGUpKGIgJiAweEZGKTsNCisgIH0NCisNCisg
IC8qKg0KKyAgICogV3JpdGVzIDxjb2RlPmxlbjwvY29kZT4gYnl0ZXMgZnJvbSB0aGUgc3BlY2lm
aWVkIGJ5dGUgYXJyYXkNCisgICAqIHN0YXJ0aW5nIGF0IG9mZnNldCA8Y29kZT5vZmY8L2NvZGU+
IHRvIHRoaXMgYnVmZmVyZWQgb3V0cHV0IHN0cmVhbS4NCisgICAqDQorICAgKiA8cD4gT3JkaW5h
cmlseSB0aGlzIG1ldGhvZCBzdG9yZXMgYnl0ZXMgZnJvbSB0aGUgZ2l2ZW4gYXJyYXkgaW50byB0
aGlzDQorICAgKiBzdHJlYW0ncyBidWZmZXIsIGZsdXNoaW5nIHRoZSBidWZmZXIgdG8gdGhlIHVu
ZGVybHlpbmcgb3V0cHV0IHN0cmVhbSBhcw0KKyAgICogbmVlZGVkLiAgSWYgdGhlIHJlcXVlc3Rl
ZCBsZW5ndGggaXMgYXQgbGVhc3QgYXMgbGFyZ2UgYXMgdGhpcyBzdHJlYW0ncw0KKyAgICogYnVm
ZmVyLCBob3dldmVyLCB0aGVuIHRoaXMgbWV0aG9kIHdpbGwgZmx1c2ggdGhlIGJ1ZmZlciBhbmQg
d3JpdGUgdGhlDQorICAgKiBieXRlcyBkaXJlY3RseSB0byB0aGUgdW5kZXJseWluZyBvdXRwdXQg
c3RyZWFtLiAgVGh1cyByZWR1bmRhbnQNCisgICAqIDxjb2RlPkJ1ZmZlcmVkT3V0cHV0U3RyZWFt
PC9jb2RlPnMgd2lsbCBub3QgY29weSBkYXRhIHVubmVjZXNzYXJpbHkuDQorICAgKg0KKyAgICog
QHBhcmFtICAgICAgYiAgICAgdGhlIGRhdGEuDQorICAgKiBAcGFyYW0gICAgICBvZmYgICB0aGUg
c3RhcnQgb2Zmc2V0IGluIHRoZSBkYXRhLg0KKyAgICogQHBhcmFtICAgICAgbGVuICAgdGhlIG51
bWJlciBvZiBieXRlcyB0byB3cml0ZS4NCisgICAqIEBleGNlcHRpb24gIElPRXhjZXB0aW9uICBp
ZiBhbiBJL08gZXJyb3Igb2NjdXJzLg0KKyAgICovDQorICBwdWJsaWMgdm9pZCB3cml0ZShieXRl
IGJbXSwgaW50IG9mZiwgaW50IGxlbikgdGhyb3dzIElPRXhjZXB0aW9uIHsNCisgaWYgKGxlbiA+
PSBidWYubGVuZ3RoKSB7DQorICAgIC8qIElmIHRoZSByZXF1ZXN0IGxlbmd0aCBleGNlZWRzIHRo
ZSBzaXplIG9mIHRoZSBvdXRwdXQgYnVmZmVyLA0KKyAgICAgICAgIGZsdXNoIHRoZSBvdXRwdXQg
YnVmZmVyIGFuZCB0aGVuIHdyaXRlIHRoZSBkYXRhIGRpcmVjdGx5Lg0KKyAgICAgICAgIEluIHRo
aXMgd2F5IGJ1ZmZlcmVkIHN0cmVhbXMgd2lsbCBjYXNjYWRlIGhhcm1sZXNzbHkuICovDQorICAg
IGZsdXNoQnVmZmVyKCk7DQorICAgIHN1bS51cGRhdGUoYiwgb2ZmLCBsZW4pOw0KKyAgICBvdXQu
d3JpdGUoYiwgb2ZmLCBsZW4pOw0KKyAgICByZXR1cm47DQorIH0NCisgaWYgKGxlbiA+IGJ1Zi5s
ZW5ndGggLSBjb3VudCkgew0KKyAgICBmbHVzaEJ1ZmZlcigpOw0KKyB9DQorIFN5c3RlbS5hcnJh
eWNvcHkoYiwgb2ZmLCBidWYsIGNvdW50LCBsZW4pOw0KKyBjb3VudCArPSBsZW47DQorICB9DQor
DQorICAvKioNCisgICAqIEZsdXNoZXMgdGhpcyBidWZmZXJlZCBvdXRwdXQgc3RyZWFtLiBUaGlz
IGZvcmNlcyBhbnkgYnVmZmVyZWQNCisgICAqIG91dHB1dCBieXRlcyB0byBiZSB3cml0dGVuIG91
dCB0byB0aGUgdW5kZXJseWluZyBvdXRwdXQgc3RyZWFtLg0KKyAgICoNCisgICAqIEBleGNlcHRp
b24gIElPRXhjZXB0aW9uICBpZiBhbiBJL08gZXJyb3Igb2NjdXJzLg0KKyAgICogQHNlZSAgICAg
ICAgamF2YS5pby5GaWx0ZXJPdXRwdXRTdHJlYW0jb3V0DQorICAgKi8NCisgIHB1YmxpYyB2b2lk
IGZsdXNoKCkgdGhyb3dzIElPRXhjZXB0aW9uIHsNCisgICAgZmx1c2hCdWZmZXIoKTsNCisgb3V0
LmZsdXNoKCk7DQorICB9DQorDQogICBAT3ZlcnJpZGUNCiAgIHB1YmxpYyB2b2lkIGNsb3NlKCkg
dGhyb3dzIElPRXhjZXB0aW9uIHsNCiAgICAgaWYgKGNsb3NlZCkgew0KICAgICAgIHJldHVybjsN
CiAgICAgfQ0KICAgICBjbG9zZWQgPSB0cnVlOw0KKyAgICBmbHVzaEJ1ZmZlcigpOw0KICAgICBz
dW0ud3JpdGVWYWx1ZShiYXJyYXksIDAsIGZhbHNlKTsNCiAgICAgb3V0LndyaXRlIChiYXJyYXks
IDAsIHN1bS5nZXRDaGVja3N1bVNpemUoKSk7DQogICAgIG91dC5mbHVzaCgpOw0KICAgfQ0KLQ0K
LSAgLyoqDQotICAgKiBXcml0ZSBieXRlcyB0byB0aGUgc3RyZWFtLg0KLSAgICovDQotICBAT3Zl
cnJpZGUNCi0gIHB1YmxpYyB2b2lkIHdyaXRlKGJ5dGVbXSBiLCBpbnQgb2ZmLCBpbnQgbGVuKSB0
aHJvd3MgSU9FeGNlcHRpb24gew0KLSAgICBzdW0udXBkYXRlKGIsIG9mZixsZW4pOw0KLSAgICBv
dXQud3JpdGUoYixvZmYsbGVuKTsNCi0gIH0NCi0NCi0gIEBPdmVycmlkZQ0KLSAgcHVibGljIHZv
aWQgd3JpdGUoaW50IGIpIHRocm93cyBJT0V4Y2VwdGlvbiB7DQotICAgIGJhcnJheVswXSA9IChi
eXRlKSAoYiAmIDB4RkYpOw0KLSAgICB3cml0ZShiYXJyYXksMCwxKTsNCi0gIH0NCg0KIH0NCg0K
X19fX19fX19fX19fX19fX19fX19fX19fX19fX19fX18NCg0KVGhpcyBlbWFpbCAoaW5jbHVkaW5n
IGFueSBhdHRhY2htZW50cykgaXMgY29uZmlkZW50aWFsIGFuZCBtYXkgYmUgbGVnYWxseSBwcml2
aWxlZ2VkLiBJZiB5b3UgcmVjZWl2ZWQgdGhpcyBlbWFpbCBpbiBlcnJvciwgcGxlYXNlIGRlbGV0
ZSBpdCBpbW1lZGlhdGVseSBhbmQgZG8gbm90IGNvcHkgaXQgb3IgdXNlIGl0IGZvciBhbnkgcHVy
cG9zZSBvciBkaXNjbG9zZSBpdHMgY29udGVudHMgdG8gYW55IG90aGVyIHBlcnNvbi4gVGhhbmsg
eW91Lg0KDQqxvrXn08oosPzAqMjOus64vbz+Kb/JxNy6rNPQu/rD3NfKwc+yosrct6jCybGju6Sh
o8jnxPqyu8rH1f3It7XEytW8/sjLo6zH68T6waK8tMm+s/2xvtPKvP6ho8frsrvSqr2rsb6159PK
vfjQ0Li01sayotPD1/fIzrrOxuTL+9PDzb6horvyzbjCtrG+08q8/tauxNrI3aGj0LvQu6GjDQo=
--_000_6B35018DED632F46AA57A324543C5EB74494ED2FCNHZEXMAIL02ali_--
From common-dev-return-77795-apmail-hadoop-common-dev-archive=hadoop.apache.org@hadoop.apache.org Mon Feb 20 14:15:57 2012
Return-Path: <common-dev-return-77795-apmail-hadoop-common-dev-archive=hadoop.apache.org@hadoop.apache.org>
X-Original-To: apmail-hadoop-common-dev-archive@www.apache.org
Delivered-To: apmail-hadoop-common-dev-archive@www.apache.org
Received: from mail.apache.org (hermes.apache.org [140.211.11.3])
by minotaur.apache.org (Postfix) with SMTP id 40BB69045
for <apmail-hadoop-common-dev-archive@www.apache.org>; Mon, 20 Feb 2012 14:15:57 +0000 (UTC)
Received: (qmail 48216 invoked by uid 500); 20 Feb 2012 14:15:55 -0000
Delivered-To: apmail-hadoop-common-dev-archive@hadoop.apache.org
Received: (qmail 48136 invoked by uid 500); 20 Feb 2012 14:15:55 -0000
Mailing-List: contact common-dev-help@hadoop.apache.org; run by ezmlm
Precedence: bulk
List-Help: <mailto:common-dev-help@hadoop.apache.org>
List-Unsubscribe: <mailto:common-dev-unsubscribe@hadoop.apache.org>
List-Post: <mailto:common-dev@hadoop.apache.org>
List-Id: <common-dev.hadoop.apache.org>
Reply-To: common-dev@hadoop.apache.org
Delivered-To: mailing list common-dev@hadoop.apache.org
Received: (qmail 48117 invoked by uid 99); 20 Feb 2012 14:15:55 -0000
Received: from athena.apache.org (HELO athena.apache.org) (140.211.11.136)
by apache.org (qpsmtpd/0.29) with ESMTP; Mon, 20 Feb 2012 14:15:55 +0000
X-ASF-Spam-Status: No, hits=2.2 required=5.0
tests=HTML_MESSAGE,RCVD_IN_DNSWL_LOW,SPF_NEUTRAL
X-Spam-Check-By: apache.org
Received-SPF: neutral (athena.apache.org: local policy)
Received: from [209.85.160.48] (HELO mail-pw0-f48.google.com) (209.85.160.48)
by apache.org (qpsmtpd/0.29) with ESMTP; Mon, 20 Feb 2012 14:15:47 +0000
Received: by pbcxa12 with SMTP id xa12so5404233pbc.35
for <common-dev@hadoop.apache.org>; Mon, 20 Feb 2012 06:15:27 -0800 (PST)
Received-SPF: pass (google.com: domain of acm@hortonworks.com designates 10.68.204.106 as permitted sender) client-ip=10.68.204.106;
Authentication-Results: mr.google.com; spf=pass (google.com: domain of acm@hortonworks.com designates 10.68.204.106 as permitted sender) smtp.mail=acm@hortonworks.com
Received: from mr.google.com ([10.68.204.106])
by 10.68.204.106 with SMTP id kx10mr56454059pbc.150.1329747327760 (num_hops = 1);
Mon, 20 Feb 2012 06:15:27 -0800 (PST)
Received: by 10.68.204.106 with SMTP id kx10mr47290719pbc.150.1329747327692;
Mon, 20 Feb 2012 06:15:27 -0800 (PST)
Received: from [192.168.1.4] ([122.167.21.211])
by mx.google.com with ESMTPS id u1sm13307919pbh.75.2012.02.20.06.15.23
(version=TLSv1/SSLv3 cipher=OTHER);
Mon, 20 Feb 2012 06:15:26 -0800 (PST)
From: Arun C Murthy <acm@hortonworks.com>
Mime-Version: 1.0 (Apple Message framework v1084)
Content-Type: multipart/alternative; boundary=Apple-Mail-55--747196777
Subject: Re: IFileOutputStream
Date: Mon, 20 Feb 2012 19:45:21 +0530
In-Reply-To: <6B35018DED632F46AA57A324543C5EB74494ED2F@CNHZ-EXMAIL-02.ali.com>
To: common-dev@hadoop.apache.org
References: <6B35018DED632F46AA57A324543C5EB74494ED2F@CNHZ-EXMAIL-02.ali.com>
Message-Id: <9EEC20EF-5796-4C5A-9FBA-83A046CF248F@hortonworks.com>
X-Mailer: Apple Mail (2.1084)
X-Gm-Message-State: ALoCoQlZumTsgArS73l+Noo0ubYmiHXZQxnMkZb8MoZk5u4FcsMuJkHPbMiDki/dsW9ayJycog0E
--Apple-Mail-55--747196777
Content-Transfer-Encoding: quoted-printable
Content-Type: text/plain;
charset=GB2312
Kungu,
Can you please open a jira and attach this patch there?
More details here: http://wiki.apache.org/hadoop/HowToContribute
thanks!
Arun
On Feb 20, 2012, at 1:23 PM, =C0=A4=B9=C8 wrote:
> Hi experts,
>=20
> I have a question on IFileOutputStream.
> I guess when writing key/value length (1 or 2bytes)to IFile, this =
function is inefficient:
> public void write(byte[] b, int off, int len) throws IOException {
> sum.update(b, off,len);
> out.write(b,off,len);
> }
> I make the following changes, and see some improve under certain =
circumstance.
> Waiting for your professional answer.
>=20
> Regards,
> Kungu
>=20
>=20
>=20
> @@ -36,43 +36,128 @@
> private final DataChecksum sum;
> private byte[] barray;
> private boolean closed =3D false;
> +
> + /**
> + * The internal buffer where data is stored.
> + */
> + protected byte buf[];
>=20
> /**
> - * Create a checksum output stream that writes
> - * the bytes to the given stream.
> - * @param out
> + * The number of valid bytes in the buffer. This value is always
> + * in the range <tt>0</tt> through <tt>buf.length</tt>; elements
> + * <tt>buf[0]</tt> through <tt>buf[count-1]</tt> contain valid
> + * byte data.
> */
> + protected int count;
> +
> + /**
> + * Creates a new checksum buffered output stream to write data to
> + * the specified underlying output stream.
> + *
> + * @param out the underlying output stream.
> + */
> public IFileOutputStream(OutputStream out) {
> - super(out);
> - sum =3D DataChecksum.newDataChecksum(DataChecksum.CHECKSUM_CRC32,
> - Integer.MAX_VALUE);
> - barray =3D new byte[sum.getChecksumSize()];
> + this(out, 8192);
> }
> -
> +
> + /**
> + * Creates a new buffered output stream to write data to the
> + * specified underlying output stream with the specified buffer
> + * size.
> + *
> + * @param out the underlying output stream.
> + * @param size the buffer size.
> + * @exception IllegalArgumentException if size &lt;=3D 0.
> + */
> + public IFileOutputStream(OutputStream out, int size) {
> + super(out);
> + if (size <=3D 0) {
> + throw new IllegalArgumentException("Buffer size <=3D 0");
> + }
> + buf =3D new byte[size];
> +
> + sum =3D DataChecksum.newDataChecksum(DataChecksum.CHECKSUM_CRC32,
> + Integer.MAX_VALUE);
> + barray =3D new byte[sum.getChecksumSize()];
> + }
> +
> + /** Flush the internal buffer */
> + private void flushBuffer() throws IOException {
> + if (count > 0) {
> + sum.update(buf, 0, count);
> + out.write(buf, 0, count);
> + count =3D 0;
> + }
> + }
> +
> + /**
> + * Writes the specified byte to this buffered output stream.
> + *
> + * @param b the byte to be written.
> + * @exception IOException if an I/O error occurs.
> + */
> + public void write(int b) throws IOException {
> + if (count >=3D buf.length) {
> + flushBuffer();
> + }
> + buf[count++] =3D (byte)(b & 0xFF);
> + }
> +
> + /**
> + * Writes <code>len</code> bytes from the specified byte array
> + * starting at offset <code>off</code> to this buffered output =
stream.
> + *
> + * <p> Ordinarily this method stores bytes from the given array =
into this
> + * stream's buffer, flushing the buffer to the underlying output =
stream as
> + * needed. If the requested length is at least as large as this =
stream's
> + * buffer, however, then this method will flush the buffer and =
write the
> + * bytes directly to the underlying output stream. Thus redundant
> + * <code>BufferedOutputStream</code>s will not copy data =
unnecessarily.
> + *
> + * @param b the data.
> + * @param off the start offset in the data.
> + * @param len the number of bytes to write.
> + * @exception IOException if an I/O error occurs.
> + */
> + public void write(byte b[], int off, int len) throws IOException {
> + if (len >=3D buf.length) {
> + /* If the request length exceeds the size of the output buffer,
> + flush the output buffer and then write the data directly.
> + In this way buffered streams will cascade harmlessly. */
> + flushBuffer();
> + sum.update(b, off, len);
> + out.write(b, off, len);
> + return;
> + }
> + if (len > buf.length - count) {
> + flushBuffer();
> + }
> + System.arraycopy(b, off, buf, count, len);
> + count +=3D len;
> + }
> +
> + /**
> + * Flushes this buffered output stream. This forces any buffered
> + * output bytes to be written out to the underlying output stream.
> + *
> + * @exception IOException if an I/O error occurs.
> + * @see java.io.FilterOutputStream#out
> + */
> + public void flush() throws IOException {
> + flushBuffer();
> + out.flush();
> + }
> +
> @Override
> public void close() throws IOException {
> if (closed) {
> return;
> }
> closed =3D true;
> + flushBuffer();
> sum.writeValue(barray, 0, false);
> out.write (barray, 0, sum.getChecksumSize());
> out.flush();
> }
> -
> - /**
> - * Write bytes to the stream.
> - */
> - @Override
> - public void write(byte[] b, int off, int len) throws IOException {
> - sum.update(b, off,len);
> - out.write(b,off,len);
> - }
> -
> - @Override
> - public void write(int b) throws IOException {
> - barray[0] =3D (byte) (b & 0xFF);
> - write(barray,0,1);
> - }
>=20
> }
>=20
> ________________________________
>=20
> This email (including any attachments) is confidential and may be =
legally privileged. If you received this email in error, please delete =
it immediately and do not copy it or use it for any purpose or disclose =
its contents to any other person. Thank you.
>=20
> =
=B1=BE=B5=E7=D3=CA(=B0=FC=C0=A8=C8=CE=BA=CE=B8=BD=BC=FE)=BF=C9=C4=DC=BA=AC=
=D3=D0=BB=FA=C3=DC=D7=CA=C1=CF=B2=A2=CA=DC=B7=A8=C2=C9=B1=A3=BB=A4=A1=A3=C8=
=E7=C4=FA=B2=BB=CA=C7=D5=FD=C8=B7=B5=C4=CA=D5=BC=FE=C8=CB=A3=AC=C7=EB=C4=FA=
=C1=A2=BC=B4=C9=BE=B3=FD=B1=BE=D3=CA=BC=FE=A1=A3=C7=EB=B2=BB=D2=AA=BD=AB=B1=
=BE=B5=E7=D3=CA=BD=F8=D0=D0=B8=B4=D6=C6=B2=A2=D3=C3=D7=F7=C8=CE=BA=CE=C6=E4=
=CB=FB=D3=C3=CD=BE=A1=A2=BB=F2=CD=B8=C2=B6=B1=BE=D3=CA=BC=FE=D6=AE=C4=DA=C8=
=DD=A1=A3=D0=BB=D0=BB=A1=A3
--
Arun C. Murthy
Hortonworks Inc.
http://hortonworks.com/
--Apple-Mail-55--747196777--
From common-dev-return-77796-apmail-hadoop-common-dev-archive=hadoop.apache.org@hadoop.apache.org Mon Feb 20 17:20:01 2012
Return-Path: <common-dev-return-77796-apmail-hadoop-common-dev-archive=hadoop.apache.org@hadoop.apache.org>
X-Original-To: apmail-hadoop-common-dev-archive@www.apache.org
Delivered-To: apmail-hadoop-common-dev-archive@www.apache.org
Received: from mail.apache.org (hermes.apache.org [140.211.11.3])
by minotaur.apache.org (Postfix) with SMTP id 8190B9A98
for <apmail-hadoop-common-dev-archive@www.apache.org>; Mon, 20 Feb 2012 17:20:01 +0000 (UTC)
Received: (qmail 50060 invoked by uid 500); 20 Feb 2012 17:19:59 -0000
Delivered-To: apmail-hadoop-common-dev-archive@hadoop.apache.org
Received: (qmail 49998 invoked by uid 500); 20 Feb 2012 17:19:59 -0000
Mailing-List: contact common-dev-help@hadoop.apache.org; run by ezmlm
Precedence: bulk
List-Help: <mailto:common-dev-help@hadoop.apache.org>
List-Unsubscribe: <mailto:common-dev-unsubscribe@hadoop.apache.org>
List-Post: <mailto:common-dev@hadoop.apache.org>
List-Id: <common-dev.hadoop.apache.org>
Reply-To: common-dev@hadoop.apache.org
Delivered-To: mailing list common-dev@hadoop.apache.org
Received: (qmail 49989 invoked by uid 99); 20 Feb 2012 17:19:59 -0000
Received: from athena.apache.org (HELO athena.apache.org) (140.211.11.136)
by apache.org (qpsmtpd/0.29) with ESMTP; Mon, 20 Feb 2012 17:19:59 +0000
X-ASF-Spam-Status: No, hits=-2000.0 required=5.0
tests=ALL_TRUSTED,T_RP_MATCHES_RCVD
X-Spam-Check-By: apache.org
Received: from [140.211.11.116] (HELO hel.zones.apache.org) (140.211.11.116)
by apache.org (qpsmtpd/0.29) with ESMTP; Mon, 20 Feb 2012 17:19:54 +0000
Received: from hel.zones.apache.org (hel.zones.apache.org [140.211.11.116])
by hel.zones.apache.org (Postfix) with ESMTP id E16861C2F15
for <common-dev@hadoop.apache.org>; Mon, 20 Feb 2012 17:19:34 +0000 (UTC)
Date: Mon, 20 Feb 2012 17:19:34 +0000 (UTC)
From: "Harsh J (Created) (JIRA)" <jira@apache.org>
To: common-dev@hadoop.apache.org
Message-ID: <89766010.2995.1329758374925.JavaMail.tomcat@hel.zones.apache.org>
Subject: [jira] [Created] (HADOOP-8094) Make maven-eclipse-plugin use the
spring project nature
MIME-Version: 1.0
Content-Type: text/plain; charset=utf-8
Content-Transfer-Encoding: 7bit
X-JIRA-FingerPrint: 30527f35849b9dde25b450d4833f0394
Make maven-eclipse-plugin use the spring project nature
-------------------------------------------------------
Key: HADOOP-8094
URL: https://issues.apache.org/jira/browse/HADOOP-8094
Project: Hadoop Common
Issue Type: Improvement
Components: build
Affects Versions: 0.23.0
Reporter: Harsh J
Assignee: Harsh J
If I want to have multiple versions of Apache Hadoop loaded into my Eclipse IDE today (or any other IDE maybe), I'm supposed to do the following when generating eclipse files, such that the version name is appended to the project name and thereby resolves conflict in project names when I import another version in:
{{mvn -Declipse.addVersionToProjectName=true eclipse:eclipse}}
But this does not work presently due to a lack of configuration in Apache Hadoop, which https://jira.codehaus.org/browse/MECLIPSE-702 demands. The problem being that though the project names are indeed named with version suffixes, the "related project" name it carries for dependencies do not carry the same suffix and therefore you have a broken import of projects errors everywhere about 'dependent project <regularname> not found'.
The fix is as Carlo details on https://jira.codehaus.org/browse/MECLIPSE-702 and it works perfectly. I'll attach a patch adding in the same configuration for Apache Hadoop so that the above mechanism is then possible.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
From common-dev-return-77797-apmail-hadoop-common-dev-archive=hadoop.apache.org@hadoop.apache.org Tue Feb 21 10:31:44 2012
Return-Path: <common-dev-return-77797-apmail-hadoop-common-dev-archive=hadoop.apache.org@hadoop.apache.org>
X-Original-To: apmail-hadoop-common-dev-archive@www.apache.org
Delivered-To: apmail-hadoop-common-dev-archive@www.apache.org
Received: from mail.apache.org (hermes.apache.org [140.211.11.3])
by minotaur.apache.org (Postfix) with SMTP id 4B1969076
for <apmail-hadoop-common-dev-archive@www.apache.org>; Tue, 21 Feb 2012 10:31:44 +0000 (UTC)
Received: (qmail 72983 invoked by uid 500); 21 Feb 2012 10:31:42 -0000
Delivered-To: apmail-hadoop-common-dev-archive@hadoop.apache.org
Received: (qmail 72901 invoked by uid 500); 21 Feb 2012 10:31:41 -0000
Mailing-List: contact common-dev-help@hadoop.apache.org; run by ezmlm
Precedence: bulk
List-Help: <mailto:common-dev-help@hadoop.apache.org>
List-Unsubscribe: <mailto:common-dev-unsubscribe@hadoop.apache.org>
List-Post: <mailto:common-dev@hadoop.apache.org>
List-Id: <common-dev.hadoop.apache.org>
Reply-To: common-dev@hadoop.apache.org
Delivered-To: mailing list common-dev@hadoop.apache.org
Received: (qmail 72885 invoked by uid 99); 21 Feb 2012 10:31:41 -0000
Received: from nike.apache.org (HELO nike.apache.org) (192.87.106.230)
by apache.org (qpsmtpd/0.29) with ESMTP; Tue, 21 Feb 2012 10:31:41 +0000
X-ASF-Spam-Status: No, hits=-2000.0 required=5.0
tests=ALL_TRUSTED
X-Spam-Check-By: apache.org
Received: from [140.211.11.8] (HELO aegis.apache.org) (140.211.11.8)
by apache.org (qpsmtpd/0.29) with ESMTP; Tue, 21 Feb 2012 10:31:35 +0000
Received: from aegis (localhost [127.0.0.1])
by aegis.apache.org (Postfix) with ESMTP id 67E8FC00A0
for <common-dev@hadoop.apache.org>; Tue, 21 Feb 2012 10:31:13 +0000 (UTC)
Date: Tue, 21 Feb 2012 10:31:13 +0000 (UTC)
From: Apache Jenkins Server <jenkins@builds.apache.org>
To: common-dev@hadoop.apache.org
Message-ID: <572130923.5201329820273416.JavaMail.hudson@aegis>
Subject: Build failed in Jenkins: Hadoop-Common-trunk #324
MIME-Version: 1.0
Content-Type: text/plain; charset=UTF-8
Content-Transfer-Encoding: quoted-printable
X-Jenkins-Job: Hadoop-Common-trunk
X-Jenkins-Result: FAILURE
X-Virus-Checked: Checked by ClamAV on apache.org
See <https://builds.apache.org/job/Hadoop-Common-trunk/324/changes>
Changes:
[vinodkv] MAPREDUCE-3798. Fixed failing TestJobCleanup.testCusomCleanup() a=
nd moved it to the maven build. Contributed by Ravi Prakash.
[ddas] HADOOP-8084. Updates ProtoBufRpc engine to not do an unnecessary cop=
y for RPC request/response. Contributed by Devaraj Das.
[vinodkv] MAPREDUCE-3634. Fixed all daemons to crash instead of hanging aro=
und when their EventHandlers get exceptions. (vinodkv)
------------------------------------------
[...truncated 43856 lines...]
[DEBUG] (f) reactorProjects =3D [MavenProject: org.apache.hadoop:hadoop-a=
nnotations:0.24.0-SNAPSHOT @ <https://builds.apache.org/job/Hadoop-Common-t=
runk/ws/trunk/hadoop-common-project/hadoop-annotations/pom.xml,> MavenProje=
ct: org.apache.hadoop:hadoop-auth:0.24.0-SNAPSHOT @ <https://builds.apache.=
org/job/Hadoop-Common-trunk/ws/trunk/hadoop-common-project/hadoop-auth/pom.=
xml,> MavenProject: org.apache.hadoop:hadoop-auth-examples:0.24.0-SNAPSHOT =
@ <https://builds.apache.org/job/Hadoop-Common-trunk/ws/trunk/hadoop-common=
-project/hadoop-auth-examples/pom.xml,> MavenProject: org.apache.hadoop:had=
oop-common:0.24.0-SNAPSHOT @ <https://builds.apache.org/job/Hadoop-Common-t=
runk/ws/trunk/hadoop-common-project/hadoop-common/pom.xml,> MavenProject: o=
rg.apache.hadoop:hadoop-common-project:0.24.0-SNAPSHOT @ <https://builds.ap=
ache.org/job/Hadoop-Common-trunk/ws/trunk/hadoop-common-project/pom.xml]>
[DEBUG] (f) useDefaultExcludes =3D true
[DEBUG] (f) useDefaultManifestFile =3D false
[DEBUG] -- end configuration --
[INFO]=20
[INFO] --- maven-enforcer-plugin:1.0:enforce (dist-enforce) @ hadoop-common=
-project ---
[DEBUG] Configuring mojo org.apache.maven.plugins:maven-enforcer-plugin:1.0=
:enforce from plugin realm ClassRealm[plugin>org.apache.maven.plugins:maven=
-enforcer-plugin:1.0, parent: sun.misc.Launcher$AppClassLoader@126b249]
[DEBUG] Configuring mojo 'org.apache.maven.plugins:maven-enforcer-plugin:1.=
0:enforce' with basic configurator -->
[DEBUG] (s) fail =3D true
[DEBUG] (s) failFast =3D false
[DEBUG] (f) ignoreCache =3D false
[DEBUG] (s) project =3D MavenProject: org.apache.hadoop:hadoop-common-pro=
ject:0.24.0-SNAPSHOT @ <https://builds.apache.org/job/Hadoop-Common-trunk/w=
s/trunk/hadoop-common-project/pom.xml>
[DEBUG] (s) version =3D [3.0.2,)
[DEBUG] (s) version =3D 1.6
[DEBUG] (s) rules =3D [org.apache.maven.plugins.enforcer.RequireMavenVers=
ion@1e6e950, org.apache.maven.plugins.enforcer.RequireJavaVersion@dfb87a]
[DEBUG] (s) session =3D org.apache.maven.execution.MavenSession@53d3cf
[DEBUG] (s) skip =3D false
[DEBUG] -- end configuration --
[DEBUG] Executing rule: org.apache.maven.plugins.enforcer.RequireMavenVersi=
on
[DEBUG] Rule org.apache.maven.plugins.enforcer.RequireMavenVersion is cache=
able.
[DEBUG] Key org.apache.maven.plugins.enforcer.RequireMavenVersion -93731219=
7 was found in the cache
[DEBUG] The cached results are still valid. Skipping the rule: org.apache.m=
aven.plugins.enforcer.RequireMavenVersion
[DEBUG] Executing rule: org.apache.maven.plugins.enforcer.RequireJavaVersio=
n
[DEBUG] Rule org.apache.maven.plugins.enforcer.RequireJavaVersion is cachea=
ble.
[DEBUG] Key org.apache.maven.plugins.enforcer.RequireJavaVersion 48569 was =
found in the cache
[DEBUG] The cached results are still valid. Skipping the rule: org.apache.m=
aven.plugins.enforcer.RequireJavaVersion
[INFO]=20
[INFO] --- maven-site-plugin:3.0:attach-descriptor (attach-descriptor) @ ha=
doop-common-project ---
[DEBUG] Configuring mojo org.apache.maven.plugins:maven-site-plugin:3.0:att=
ach-descriptor from plugin realm ClassRealm[plugin>org.apache.maven.plugins=
:maven-site-plugin:3.0, parent: sun.misc.Launcher$AppClassLoader@126b249]
[DEBUG] Configuring mojo 'org.apache.maven.plugins:maven-site-plugin:3.0:at=
tach-descriptor' with basic configurator -->
[DEBUG] (f) basedir =3D <https://builds.apache.org/job/Hadoop-Common-trun=
k/ws/trunk/hadoop-common-project>
[DEBUG] (f) inputEncoding =3D UTF-8
[DEBUG] (f) localRepository =3D id: local
url: file:///home/jenkins/.m2/repository/
layout: none
[DEBUG] (f) outputEncoding =3D UTF-8
[DEBUG] (f) pomPackagingOnly =3D true
[DEBUG] (f) project =3D MavenProject: org.apache.hadoop:hadoop-common-pro=
ject:0.24.0-SNAPSHOT @ <https://builds.apache.org/job/Hadoop-Common-trunk/w=
s/trunk/hadoop-common-project/pom.xml>
[DEBUG] (f) reactorProjects =3D [MavenProject: org.apache.hadoop:hadoop-a=
nnotations:0.24.0-SNAPSHOT @ <https://builds.apache.org/job/Hadoop-Common-t=
runk/ws/trunk/hadoop-common-project/hadoop-annotations/pom.xml,> MavenProje=
ct: org.apache.hadoop:hadoop-auth:0.24.0-SNAPSHOT @ <https://builds.apache.=
org/job/Hadoop-Common-trunk/ws/trunk/hadoop-common-project/hadoop-auth/pom.=
xml,> MavenProject: org.apache.hadoop:hadoop-auth-examples:0.24.0-SNAPSHOT =
@ <https://builds.apache.org/job/Hadoop-Common-trunk/ws/trunk/hadoop-common=
-project/hadoop-auth-examples/pom.xml,> MavenProject: org.apache.hadoop:had=
oop-common:0.24.0-SNAPSHOT @ <https://builds.apache.org/job/Hadoop-Common-t=
runk/ws/trunk/hadoop-common-project/hadoop-common/pom.xml,> MavenProject: o=
rg.apache.hadoop:hadoop-common-project:0.24.0-SNAPSHOT @ <https://builds.ap=
ache.org/job/Hadoop-Common-trunk/ws/trunk/hadoop-common-project/pom.xml]>
[DEBUG] (f) siteDirectory =3D <https://builds.apache.org/job/Hadoop-Commo=
n-trunk/ws/trunk/hadoop-common-project/src/site>
[DEBUG] -- end configuration --
[DEBUG] Mapped url: <https://builds.apache.org/job/Hadoop-Common-trunk/ws/t=
runk/hadoop-common-project/src/site> to relative path: src/site
[INFO]=20
[INFO] --- maven-javadoc-plugin:2.8.1:jar (module-javadocs) @ hadoop-common=
-project ---
[DEBUG] Configuring mojo org.apache.maven.plugins:maven-javadoc-plugin:2.8.=
1:jar from plugin realm ClassRealm[plugin>org.apache.maven.plugins:maven-ja=
vadoc-plugin:2.8.1, parent: sun.misc.Launcher$AppClassLoader@126b249]
[DEBUG] Configuring mojo 'org.apache.maven.plugins:maven-javadoc-plugin:2.8=
.1:jar' with basic configurator -->
[DEBUG] (f) aggregate =3D false
[DEBUG] (f) attach =3D true
[DEBUG] (f) author =3D true
[DEBUG] (f) bootclasspathArtifacts =3D []
[DEBUG] (f) bottom =3D Copyright &#169; {inceptionYear}-{currentYear} {or=
ganizationName}. All Rights Reserved.
[DEBUG] (f) breakiterator =3D false
[DEBUG] (f) debug =3D false
[DEBUG] (f) defaultManifestFile =3D <https://builds.apache.org/job/Hadoop=
-Common-trunk/ws/trunk/hadoop-common-project/target/classes/META-INF/MANIFE=
ST.MF>
[DEBUG] (f) destDir =3D <https://builds.apache.org/job/Hadoop-Common-trun=
k/ws/trunk/hadoop-common-project/target>
[DEBUG] (f) detectJavaApiLink =3D true
[DEBUG] (f) detectLinks =3D false
[DEBUG] (f) detectOfflineLinks =3D true
[DEBUG] (f) docencoding =3D UTF-8
[DEBUG] (f) docfilessubdirs =3D false
[DEBUG] (f) docletArtifact =3D groupId =3D 'null'
artifactId =3D 'null'
version =3D 'null'
[DEBUG] (f) docletArtifacts =3D []
[DEBUG] (f) doctitle =3D Apache Hadoop Common Project 0.24.0-SNAPSHOT API
[DEBUG] (f) encoding =3D UTF-8
[DEBUG] (f) failOnError =3D true
[DEBUG] (f) finalName =3D hadoop-common-project-0.24.0-SNAPSHOT
[DEBUG] (f) groups =3D []
[DEBUG] (f) includeDependencySources =3D false
[DEBUG] (f) includeTransitiveDependencySources =3D false
[DEBUG] (f) isOffline =3D false
[DEBUG] (f) jarOutputDirectory =3D <https://builds.apache.org/job/Hadoop-=
Common-trunk/ws/trunk/hadoop-common-project/target>
[DEBUG] (f) javaApiLinks =3D {}
[DEBUG] (f) javadocDirectory =3D <https://builds.apache.org/job/Hadoop-Co=
mmon-trunk/ws/trunk/hadoop-common-project/src/main/javadoc>
[DEBUG] (f) javadocOptionsDir =3D <https://builds.apache.org/job/Hadoop-C=
ommon-trunk/ws/trunk/hadoop-common-project/target/javadoc-bundle-options>
[DEBUG] (f) keywords =3D false
[DEBUG] (f) links =3D []
[DEBUG] (f) linksource =3D false
[DEBUG] (f) localRepository =3D id: local
url: file:///home/jenkins/.m2/repository/
layout: none
[DEBUG] (f) nocomment =3D false
[DEBUG] (f) nodeprecated =3D false
[DEBUG] (f) nodeprecatedlist =3D false
[DEBUG] (f) nohelp =3D false
[DEBUG] (f) noindex =3D false
[DEBUG] (f) nonavbar =3D false
[DEBUG] (f) nooverview =3D false
[DEBUG] (f) nosince =3D false
[DEBUG] (f) notimestamp =3D false
[DEBUG] (f) notree =3D false
[DEBUG] (f) offlineLinks =3D []
[DEBUG] (f) old =3D false
[DEBUG] (f) outputDirectory =3D <https://builds.apache.org/job/Hadoop-Com=
mon-trunk/ws/trunk/hadoop-common-project/target>
[DEBUG] (f) overview =3D <https://builds.apache.org/job/Hadoop-Common-tru=
nk/ws/trunk/hadoop-common-project/src/main/javadoc/overview.html>
[DEBUG] (f) project =3D MavenProject: org.apache.hadoop:hadoop-common-pro=
ject:0.24.0-SNAPSHOT @ <https://builds.apache.org/job/Hadoop-Common-trunk/w=
s/trunk/hadoop-common-project/pom.xml>
[DEBUG] (f) quiet =3D false
[DEBUG] (f) reactorProjects =3D [MavenProject: org.apache.hadoop:hadoop-a=
nnotations:0.24.0-SNAPSHOT @ <https://builds.apache.org/job/Hadoop-Common-t=
runk/ws/trunk/hadoop-common-project/hadoop-annotations/pom.xml,> MavenProje=
ct: org.apache.hadoop:hadoop-auth:0.24.0-SNAPSHOT @ <https://builds.apache.=
org/job/Hadoop-Common-trunk/ws/trunk/hadoop-common-project/hadoop-auth/pom.=
xml,> MavenProject: org.apache.hadoop:hadoop-auth-examples:0.24.0-SNAPSHOT =
@ <https://builds.apache.org/job/Hadoop-Common-trunk/ws/trunk/hadoop-common=
-project/hadoop-auth-examples/pom.xml,> MavenProject: org.apache.hadoop:had=
oop-common:0.24.0-SNAPSHOT @ <https://builds.apache.org/job/Hadoop-Common-t=
runk/ws/trunk/hadoop-common-project/hadoop-common/pom.xml,> MavenProject: o=
rg.apache.hadoop:hadoop-common-project:0.24.0-SNAPSHOT @ <https://builds.ap=
ache.org/job/Hadoop-Common-trunk/ws/trunk/hadoop-common-project/pom.xml]>
[DEBUG] (f) remoteRepositories =3D [ id: apache.snapshots.https
url: https://repository.apache.org/content/repositories/snapshots
layout: default
snapshots: [enabled =3D> true, update =3D> daily]
releases: [enabled =3D> true, update =3D> daily]
, id: repository.jboss.org
url: http://repository.jboss.org/nexus/content/groups/public/
layout: default
snapshots: [enabled =3D> false, update =3D> daily]
releases: [enabled =3D> true, update =3D> daily]
, id: central
url: http://repo1.maven.org/maven2
layout: default
snapshots: [enabled =3D> false, update =3D> daily]
releases: [enabled =3D> true, update =3D> daily]
]
[DEBUG] (f) resourcesArtifacts =3D []
[DEBUG] (f) serialwarn =3D false
[DEBUG] (f) session =3D org.apache.maven.execution.MavenSession@53d3cf
[DEBUG] (f) settings =3D org.apache.maven.execution.SettingsAdapter@12524=
b0
[DEBUG] (f) show =3D protected
[DEBUG] (f) skip =3D false
[DEBUG] (f) sourceDependencyCacheDir =3D <https://builds.apache.org/job/H=
adoop-Common-trunk/ws/trunk/hadoop-common-project/target/distro-javadoc-sou=
rces>
[DEBUG] (f) splitindex =3D false
[DEBUG] (f) stylesheet =3D java
[DEBUG] (f) tagletArtifact =3D groupId =3D 'null'
artifactId =3D 'null'
version =3D 'null'
[DEBUG] (f) tagletArtifacts =3D []
[DEBUG] (f) taglets =3D []
[DEBUG] (f) tags =3D []
[DEBUG] (f) use =3D true
[DEBUG] (f) useDefaultManifestFile =3D false
[DEBUG] (f) useStandardDocletOptions =3D true
[DEBUG] (f) validateLinks =3D false
[DEBUG] (f) verbose =3D false
[DEBUG] (f) version =3D true
[DEBUG] (f) windowtitle =3D Apache Hadoop Common Project 0.24.0-SNAPSHOT =
API
[DEBUG] -- end configuration --
[INFO] Not executing Javadoc as the project is not a Java classpath-capable=
package
[INFO]=20
[INFO] --- maven-checkstyle-plugin:2.6:checkstyle (default-cli) @ hadoop-co=
mmon-project ---
[DEBUG] Configuring mojo org.apache.maven.plugins:maven-checkstyle-plugin:2=
.6:checkstyle from plugin realm ClassRealm[plugin>org.apache.maven.plugins:=
maven-checkstyle-plugin:2.6, parent: sun.misc.Launcher$AppClassLoader@126b2=
49]
[DEBUG] Configuring mojo 'org.apache.maven.plugins:maven-checkstyle-plugin:=
2.6:checkstyle' with basic configurator -->
[DEBUG] (f) cacheFile =3D <https://builds.apache.org/job/Hadoop-Common-tr=
unk/ws/trunk/hadoop-common-project/target/checkstyle-cachefile>
[DEBUG] (f) configLocation =3D config/sun_checks.xml
[DEBUG] (f) consoleOutput =3D false
[DEBUG] (f) enableFilesSummary =3D true
[DEBUG] (f) enableRSS =3D true
[DEBUG] (f) enableRulesSummary =3D true
[DEBUG] (f) enableSeveritySummary =3D true
[DEBUG] (f) encoding =3D UTF-8
[DEBUG] (f) failsOnError =3D false
[DEBUG] (f) format =3D sun
[DEBUG] (f) headerFile =3D <https://builds.apache.org/job/Hadoop-Common-t=
runk/ws/trunk/hadoop-common-project/LICENSE.txt>
[DEBUG] (f) headerLocation =3D LICENSE.txt
[DEBUG] (f) includes =3D **/*.java
[DEBUG] (f) linkXRef =3D true
[DEBUG] (f) outputDirectory =3D <https://builds.apache.org/job/Hadoop-Com=
mon-trunk/ws/trunk/hadoop-common-project/target/site>
[DEBUG] (f) outputFile =3D <https://builds.apache.org/job/Hadoop-Common-t=
runk/ws/trunk/hadoop-common-project/target/checkstyle-result.xml>
[DEBUG] (f) outputFileFormat =3D xml
[DEBUG] (f) project =3D MavenProject: org.apache.hadoop:hadoop-common-pro=
ject:0.24.0-SNAPSHOT @ <https://builds.apache.org/job/Hadoop-Common-trunk/w=
s/trunk/hadoop-common-project/pom.xml>
[DEBUG] (f) skip =3D false
[DEBUG] (f) sourceDirectory =3D <https://builds.apache.org/job/Hadoop-Com=
mon-trunk/ws/trunk/hadoop-common-project/src/main/java>
[DEBUG] (f) suppressionsFileExpression =3D checkstyle.suppressions.file
[DEBUG] (f) testSourceDirectory =3D <https://builds.apache.org/job/Hadoop=
-Common-trunk/ws/trunk/hadoop-common-project/src/test/java>
[DEBUG] (f) xrefLocation =3D <https://builds.apache.org/job/Hadoop-Common=
-trunk/ws/trunk/hadoop-common-project/target/site/xref>
[DEBUG] -- end configuration --
[INFO]=20
[INFO] --- findbugs-maven-plugin:2.3.2:findbugs (default-cli) @ hadoop-comm=
on-project ---
[DEBUG] Configuring mojo org.codehaus.mojo:findbugs-maven-plugin:2.3.2:find=
bugs from plugin realm ClassRealm[plugin>org.codehaus.mojo:findbugs-maven-p=
lugin:2.3.2, parent: sun.misc.Launcher$AppClassLoader@126b249]
[DEBUG] Configuring mojo 'org.codehaus.mojo:findbugs-maven-plugin:2.3.2:fin=
dbugs' with basic configurator -->
[DEBUG] (s) classFilesDirectory =3D <https://builds.apache.org/job/Hadoop=
-Common-trunk/ws/trunk/hadoop-common-project/target/classes>
[DEBUG] (s) compileSourceRoots =3D [<https://builds.apache.org/job/Hadoop=
-Common-trunk/ws/trunk/hadoop-common-project/src/main/java]>
[DEBUG] (s) debug =3D false
[DEBUG] (s) effort =3D Default
[DEBUG] (s) failOnError =3D true
[DEBUG] (s) findbugsXmlOutput =3D false
[DEBUG] (s) findbugsXmlOutputDirectory =3D <https://builds.apache.org/job=
/Hadoop-Common-trunk/ws/trunk/hadoop-common-project/target>
[DEBUG] (s) fork =3D true
[DEBUG] (s) includeTests =3D false
[DEBUG] (s) localRepository =3D id: local
url: file:///home/jenkins/.m2/repository/
layout: none
[DEBUG] (s) maxHeap =3D 512
[DEBUG] (s) nested =3D false
[DEBUG] (s) outputDirectory =3D <https://builds.apache.org/job/Hadoop-Com=
mon-trunk/ws/trunk/hadoop-common-project/target/site>
[DEBUG] (s) outputEncoding =3D UTF-8
[DEBUG] (s) pluginArtifacts =3D [org.codehaus.mojo:findbugs-maven-plugin:=
maven-plugin:2.3.2:, com.google.code.findbugs:bcel:jar:1.3.9:compile, org.c=
odehaus.gmaven:gmaven-mojo:jar:1.3:compile, org.codehaus.gmaven.runtime:gma=
ven-runtime-api:jar:1.3:compile, org.codehaus.gmaven.feature:gmaven-feature=
-api:jar:1.3:compile, org.codehaus.gmaven.runtime:gmaven-runtime-1.5:jar:1.=
3:compile, org.codehaus.gmaven.feature:gmaven-feature-support:jar:1.3:compi=
le, org.codehaus.groovy:groovy-all-minimal:jar:1.5.8:compile, org.apache.an=
t:ant:jar:1.7.1:compile, org.apache.ant:ant-launcher:jar:1.7.1:compile, jli=
ne:jline:jar:0.9.94:compile, org.codehaus.plexus:plexus-interpolation:jar:1=
.1:compile, org.codehaus.gmaven:gmaven-plugin:jar:1.3:compile, org.codehaus=
.gmaven.runtime:gmaven-runtime-loader:jar:1.3:compile, org.codehaus.gmaven.=
runtime:gmaven-runtime-support:jar:1.3:compile, org.sonatype.gshell:gshell-=
io:jar:2.0:compile, com.thoughtworks.qdox:qdox:jar:1.10:compile, org.apache=
.maven.shared:file-management:jar:1.2.1:compile, org.apache.maven.shared:ma=
ven-shared-io:jar:1.1:compile, commons-lang:commons-lang:jar:2.4:compile, o=
rg.slf4j:slf4j-api:jar:1.5.10:compile, org.sonatype.gossip:gossip:jar:1.2:c=
ompile, org.apache.maven.reporting:maven-reporting-impl:jar:2.1:compile, co=
mmons-validator:commons-validator:jar:1.2.0:compile, commons-beanutils:comm=
ons-beanutils:jar:1.7.0:compile, commons-digester:commons-digester:jar:1.6:=
compile, commons-logging:commons-logging:jar:1.0.4:compile, oro:oro:jar:2.0=
.8:compile, xml-apis:xml-apis:jar:1.0.b2:compile, org.codehaus.groovy:groov=
y-all:jar:1.7.4:compile, org.apache.maven.reporting:maven-reporting-api:jar=
:3.0:compile, org.apache.maven.doxia:doxia-core:jar:1.1.3:compile, org.apac=
he.maven.doxia:doxia-logging-api:jar:1.1.3:compile, xerces:xercesImpl:jar:2=
.9.1:compile, commons-httpclient:commons-httpclient:jar:3.1:compile, common=
s-codec:commons-codec:jar:1.2:compile, org.apache.maven.doxia:doxia-sink-ap=
i:jar:1.1.3:compile, org.apache.maven.doxia:doxia-decoration-model:jar:1.1.=
3:compile, org.apache.maven.doxia:doxia-site-renderer:jar:1.1.3:compile, or=
g.apache.maven.doxia:doxia-module-xhtml:jar:1.1.3:compile, org.apache.maven=
.doxia:doxia-module-fml:jar:1.1.3:compile, org.codehaus.plexus:plexus-i18n:=
jar:1.0-beta-7:compile, org.codehaus.plexus:plexus-velocity:jar:1.1.7:compi=
le, org.apache.velocity:velocity:jar:1.5:compile, commons-collections:commo=
ns-collections:jar:3.2:compile, org.apache.maven.shared:maven-doxia-tools:j=
ar:1.2.1:compile, commons-io:commons-io:jar:1.4:compile, com.google.code.fi=
ndbugs:findbugs-ant:jar:1.3.9:compile, com.google.code.findbugs:findbugs:ja=
r:1.3.9:compile, com.google.code.findbugs:jsr305:jar:1.3.9:compile, com.goo=
gle.code.findbugs:jFormatString:jar:1.3.9:compile, com.google.code.findbugs=
:annotations:jar:1.3.9:compile, dom4j:dom4j:jar:1.6.1:compile, jaxen:jaxen:=
jar:1.1.1:compile, jdom:jdom:jar:1.0:compile, xom:xom:jar:1.0:compile, xerc=
es:xmlParserAPIs:jar:2.6.2:compile, xalan:xalan:jar:2.6.0:compile, com.ibm.=
icu:icu4j:jar:2.6.1:compile, asm:asm:jar:3.1:compile, asm:asm-analysis:jar:=
3.1:compile, asm:asm-commons:jar:3.1:compile, asm:asm-util:jar:3.1:compile,=
asm:asm-tree:jar:3.1:compile, asm:asm-xml:jar:3.1:compile, jgoodies:plasti=
c:jar:1.2.0:compile, org.codehaus.plexus:plexus-resources:jar:1.0-alpha-4:c=
ompile, org.codehaus.plexus:plexus-utils:jar:1.5.1:compile]
[DEBUG] (s) project =3D MavenProject: org.apache.hadoop:hadoop-common-pro=
ject:0.24.0-SNAPSHOT @ <https://builds.apache.org/job/Hadoop-Common-trunk/w=
s/trunk/hadoop-common-project/pom.xml>
[DEBUG] (s) relaxed =3D false
[DEBUG] (s) remoteArtifactRepositories =3D [ id: apache.snapshots.h=
ttps
url: https://repository.apache.org/content/repositories/snapshots
layout: default
snapshots: [enabled =3D> true, update =3D> daily]
releases: [enabled =3D> true, update =3D> daily]
, id: repository.jboss.org
url: http://repository.jboss.org/nexus/content/groups/public/
layout: default
snapshots: [enabled =3D> false, update =3D> daily]
releases: [enabled =3D> true, update =3D> daily]
, id: central
url: http://repo1.maven.org/maven2
layout: default
snapshots: [enabled =3D> false, update =3D> daily]
releases: [enabled =3D> true, update =3D> daily]
]
[DEBUG] (s) skip =3D false
[DEBUG] (s) sourceEncoding =3D UTF-8
[DEBUG] (s) testClassFilesDirectory =3D <https://builds.apache.org/job/Ha=
doop-Common-trunk/ws/trunk/hadoop-common-project/target/test-classes>
[DEBUG] (s) testSourceRoots =3D [<https://builds.apache.org/job/Hadoop-Co=
mmon-trunk/ws/trunk/hadoop-common-project/src/test/java]>
[DEBUG] (s) threshold =3D Default
[DEBUG] (s) timeout =3D 600000
[DEBUG] (s) trace =3D false
[DEBUG] (s) xmlEncoding =3D UTF-8
[DEBUG] (s) xmlOutput =3D false
[DEBUG] (s) xmlOutputDirectory =3D <https://builds.apache.org/job/Hadoop-=
Common-trunk/ws/trunk/hadoop-common-project/target>
[DEBUG] (s) xrefLocation =3D <https://builds.apache.org/job/Hadoop-Common=
-trunk/ws/trunk/hadoop-common-project/target/site/xref>
[DEBUG] (s) xrefTestLocation =3D <https://builds.apache.org/job/Hadoop-Co=
mmon-trunk/ws/trunk/hadoop-common-project/target/site/xref-test>
[DEBUG] -- end configuration --
[INFO] ****** FindBugsMojo execute *******
[DEBUG] XML outputFile is <https://builds.apache.org/job/Hadoop-Common-trun=
k/ws/trunk/hadoop-common-project/target/findbugsXml.xml>
[DEBUG] Generating Findbugs XML
[DEBUG] Inside canGenerateReport..... false=20
[INFO] canGenerate is false
[INFO] --------------------------------------------------------------------=
----
[INFO] Reactor Summary:
[INFO]=20
[INFO] Apache Hadoop Annotations ......................... SUCCESS [16.436s=
]
[INFO] Apache Hadoop Auth ................................ SUCCESS [20.889s=
]
[INFO] Apache Hadoop Auth Examples ....................... SUCCESS [7.542s]
[INFO] Apache Hadoop Common .............................. SUCCESS [5:22.98=
8s]
[INFO] Apache Hadoop Common Project ...................... SUCCESS [0.043s]
[INFO] --------------------------------------------------------------------=
----
[INFO] BUILD SUCCESS
[INFO] --------------------------------------------------------------------=
----
[INFO] Total time: 6:09.102s
[INFO] Finished at: Tue Feb 21 09:13:21 UTC 2012
[INFO] Final Memory: 80M/781M
[INFO] --------------------------------------------------------------------=
----
+ /home/jenkins/tools/maven/latest/bin/mvn test -Pclover -DcloverLicenseLoc=
ation=3D/home/jenkins/tools/clover/latest/lib/clover.license
Build step 'Execute shell' marked build as failure
[WARNINGS] Skipping publisher since build result is FAILURE
Archiving artifacts
Recording test results
Publishing Javadoc
Recording fingerprints
From common-dev-return-77798-apmail-hadoop-common-dev-archive=hadoop.apache.org@hadoop.apache.org Tue Feb 21 10:33:15 2012
Return-Path: <common-dev-return-77798-apmail-hadoop-common-dev-archive=hadoop.apache.org@hadoop.apache.org>
X-Original-To: apmail-hadoop-common-dev-archive@www.apache.org
Delivered-To: apmail-hadoop-common-dev-archive@www.apache.org
Received: from mail.apache.org (hermes.apache.org [140.211.11.3])
by minotaur.apache.org (Postfix) with SMTP id 005A490E5
for <apmail-hadoop-common-dev-archive@www.apache.org>; Tue, 21 Feb 2012 10:33:15 +0000 (UTC)
Received: (qmail 81414 invoked by uid 500); 21 Feb 2012 10:33:13 -0000
Delivered-To: apmail-hadoop-common-dev-archive@hadoop.apache.org
Received: (qmail 81355 invoked by uid 500); 21 Feb 2012 10:33:13 -0000
Mailing-List: contact common-dev-help@hadoop.apache.org; run by ezmlm
Precedence: bulk
List-Help: <mailto:common-dev-help@hadoop.apache.org>
List-Unsubscribe: <mailto:common-dev-unsubscribe@hadoop.apache.org>
List-Post: <mailto:common-dev@hadoop.apache.org>
List-Id: <common-dev.hadoop.apache.org>
Reply-To: common-dev@hadoop.apache.org
Delivered-To: mailing list common-dev@hadoop.apache.org
Received: (qmail 81346 invoked by uid 99); 21 Feb 2012 10:33:13 -0000
Received: from athena.apache.org (HELO athena.apache.org) (140.211.11.136)
by apache.org (qpsmtpd/0.29) with ESMTP; Tue, 21 Feb 2012 10:33:13 +0000
X-ASF-Spam-Status: No, hits=-2000.0 required=5.0
tests=ALL_TRUSTED
X-Spam-Check-By: apache.org
Received: from [140.211.11.8] (HELO aegis.apache.org) (140.211.11.8)
by apache.org (qpsmtpd/0.29) with ESMTP; Tue, 21 Feb 2012 10:33:12 +0000
Received: from aegis (localhost [127.0.0.1])
by aegis.apache.org (Postfix) with ESMTP id 9077FC00A0
for <common-dev@hadoop.apache.org>; Tue, 21 Feb 2012 10:32:52 +0000 (UTC)
Date: Tue, 21 Feb 2012 10:32:52 +0000 (UTC)
From: Apache Jenkins Server <jenkins@builds.apache.org>
To: common-dev@hadoop.apache.org
Message-ID: <718986949.5211329820372590.JavaMail.hudson@aegis>
In-Reply-To: <82838688.4051329730256047.JavaMail.hudson@aegis>
References: <82838688.4051329730256047.JavaMail.hudson@aegis>
Subject: Jenkins build is back to normal : Hadoop-Common-0.23-Build #170
MIME-Version: 1.0
Content-Type: text/plain; charset=UTF-8
Content-Transfer-Encoding: 7bit
X-Jenkins-Job: Hadoop-Common-0.23-Build
X-Jenkins-Result: SUCCESS
See <https://builds.apache.org/job/Hadoop-Common-0.23-Build/170/changes>
From common-dev-return-77799-apmail-hadoop-common-dev-archive=hadoop.apache.org@hadoop.apache.org Tue Feb 21 11:30:00 2012
Return-Path: <common-dev-return-77799-apmail-hadoop-common-dev-archive=hadoop.apache.org@hadoop.apache.org>
X-Original-To: apmail-hadoop-common-dev-archive@www.apache.org
Delivered-To: apmail-hadoop-common-dev-archive@www.apache.org
Received: from mail.apache.org (hermes.apache.org [140.211.11.3])
by minotaur.apache.org (Postfix) with SMTP id E523D99FF
for <apmail-hadoop-common-dev-archive@www.apache.org>; Tue, 21 Feb 2012 11:30:00 +0000 (UTC)
Received: (qmail 14564 invoked by uid 500); 21 Feb 2012 11:29:59 -0000
Delivered-To: apmail-hadoop-common-dev-archive@hadoop.apache.org
Received: (qmail 14497 invoked by uid 500); 21 Feb 2012 11:29:59 -0000
Mailing-List: contact common-dev-help@hadoop.apache.org; run by ezmlm
Precedence: bulk
List-Help: <mailto:common-dev-help@hadoop.apache.org>
List-Unsubscribe: <mailto:common-dev-unsubscribe@hadoop.apache.org>
List-Post: <mailto:common-dev@hadoop.apache.org>
List-Id: <common-dev.hadoop.apache.org>
Reply-To: common-dev@hadoop.apache.org
Delivered-To: mailing list common-dev@hadoop.apache.org
Received: (qmail 14485 invoked by uid 99); 21 Feb 2012 11:29:59 -0000
Received: from nike.apache.org (HELO nike.apache.org) (192.87.106.230)
by apache.org (qpsmtpd/0.29) with ESMTP; Tue, 21 Feb 2012 11:29:59 +0000
X-ASF-Spam-Status: No, hits=-2000.0 required=5.0
tests=ALL_TRUSTED,T_RP_MATCHES_RCVD
X-Spam-Check-By: apache.org
Received: from [140.211.11.116] (HELO hel.zones.apache.org) (140.211.11.116)
by apache.org (qpsmtpd/0.29) with ESMTP; Tue, 21 Feb 2012 11:29:55 +0000
Received: from hel.zones.apache.org (hel.zones.apache.org [140.211.11.116])
by hel.zones.apache.org (Postfix) with ESMTP id 798FF332E79
for <common-dev@hadoop.apache.org>; Tue, 21 Feb 2012 11:29:34 +0000 (UTC)
Date: Tue, 21 Feb 2012 11:29:34 +0000 (UTC)
From: "Andy Doddington (Created) (JIRA)" <jira@apache.org>
To: common-dev@hadoop.apache.org
Message-ID: <89230585.5403.1329823774499.JavaMail.tomcat@hel.zones.apache.org>
Subject: [jira] [Created] (HADOOP-8095) -libjars option does not accept
multiple jar files
MIME-Version: 1.0
Content-Type: text/plain; charset=utf-8
Content-Transfer-Encoding: 7bit
X-JIRA-FingerPrint: 30527f35849b9dde25b450d4833f0394
X-Virus-Checked: Checked by ClamAV on apache.org
-libjars option does not accept multiple jar files
--------------------------------------------------
Key: HADOOP-8095
URL: https://issues.apache.org/jira/browse/HADOOP-8095
Project: Hadoop Common
Issue Type: Bug
Affects Versions: 0.20.203.0
Environment: Linux
Reporter: Andy Doddington
Using the hadoop 'jar' command as an example, the following works fine:
hadoop jar <jarfile0> <main-class> -libjars <jarfile1>
However, adding a second jar file (as shown below) causes ClassNotFoundExceptions, on classes that exist in jarfile1:
hadoop jar <jarfile0> <main-class> -libjars <jarfile1>,<jarfile2>
I have tried putting the lib jars arguments inside a quoted string, but this gives the same results.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
From common-dev-return-77800-apmail-hadoop-common-dev-archive=hadoop.apache.org@hadoop.apache.org Tue Feb 21 12:23:57 2012
Return-Path: <common-dev-return-77800-apmail-hadoop-common-dev-archive=hadoop.apache.org@hadoop.apache.org>
X-Original-To: apmail-hadoop-common-dev-archive@www.apache.org
Delivered-To: apmail-hadoop-common-dev-archive@www.apache.org
Received: from mail.apache.org (hermes.apache.org [140.211.11.3])
by minotaur.apache.org (Postfix) with SMTP id 04DC89A94
for <apmail-hadoop-common-dev-archive@www.apache.org>; Tue, 21 Feb 2012 12:23:57 +0000 (UTC)
Received: (qmail 60791 invoked by uid 500); 21 Feb 2012 12:23:55 -0000
Delivered-To: apmail-hadoop-common-dev-archive@hadoop.apache.org
Received: (qmail 60720 invoked by uid 500); 21 Feb 2012 12:23:55 -0000
Mailing-List: contact common-dev-help@hadoop.apache.org; run by ezmlm
Precedence: bulk
List-Help: <mailto:common-dev-help@hadoop.apache.org>
List-Unsubscribe: <mailto:common-dev-unsubscribe@hadoop.apache.org>
List-Post: <mailto:common-dev@hadoop.apache.org>
List-Id: <common-dev.hadoop.apache.org>
Reply-To: common-dev@hadoop.apache.org
Delivered-To: mailing list common-dev@hadoop.apache.org
Received: (qmail 60712 invoked by uid 99); 21 Feb 2012 12:23:55 -0000
Received: from athena.apache.org (HELO athena.apache.org) (140.211.11.136)
by apache.org (qpsmtpd/0.29) with ESMTP; Tue, 21 Feb 2012 12:23:55 +0000
X-ASF-Spam-Status: No, hits=-2000.0 required=5.0
tests=ALL_TRUSTED,T_RP_MATCHES_RCVD
X-Spam-Check-By: apache.org
Received: from [140.211.11.116] (HELO hel.zones.apache.org) (140.211.11.116)
by apache.org (qpsmtpd/0.29) with ESMTP; Tue, 21 Feb 2012 12:23:54 +0000
Received: from hel.zones.apache.org (hel.zones.apache.org [140.211.11.116])
by hel.zones.apache.org (Postfix) with ESMTP id 86B32332957
for <common-dev@hadoop.apache.org>; Tue, 21 Feb 2012 12:23:34 +0000 (UTC)
Date: Tue, 21 Feb 2012 12:23:34 +0000 (UTC)
From: "Steve Loughran (Created) (JIRA)" <jira@apache.org>
To: common-dev@hadoop.apache.org
Message-ID: <1381246767.5536.1329827014553.JavaMail.tomcat@hel.zones.apache.org>
Subject: [jira] [Created] (HADOOP-8096) add single point where System.exit()
is called for better handling in containers
MIME-Version: 1.0
Content-Type: text/plain; charset=utf-8
Content-Transfer-Encoding: 7bit
X-JIRA-FingerPrint: 30527f35849b9dde25b450d4833f0394
add single point where System.exit() is called for better handling in containers
--------------------------------------------------------------------------------
Key: HADOOP-8096
URL: https://issues.apache.org/jira/browse/HADOOP-8096
Project: Hadoop Common
Issue Type: New Feature
Components: util
Affects Versions: 0.24.0
Reporter: Steve Loughran
Fix For: 0.24.0
with plans for OSGI integration afoot in HADOOP-7977, Hadoop needs unified place where System.exit() calls. When one runs any bit of Hadoop in a containers the container will block those exits with a security manager and convert the calls into security exceptions. A single exit method would enable such exceptions to be logged, and conceivably handled slightly more gracefully (e.g. tell the daemon to die).
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
From common-dev-return-77801-apmail-hadoop-common-dev-archive=hadoop.apache.org@hadoop.apache.org Tue Feb 21 12:48:57 2012
Return-Path: <common-dev-return-77801-apmail-hadoop-common-dev-archive=hadoop.apache.org@hadoop.apache.org>
X-Original-To: apmail-hadoop-common-dev-archive@www.apache.org
Delivered-To: apmail-hadoop-common-dev-archive@www.apache.org
Received: from mail.apache.org (hermes.apache.org [140.211.11.3])
by minotaur.apache.org (Postfix) with SMTP id B54089265
for <apmail-hadoop-common-dev-archive@www.apache.org>; Tue, 21 Feb 2012 12:48:57 +0000 (UTC)
Received: (qmail 43875 invoked by uid 500); 21 Feb 2012 12:48:55 -0000
Delivered-To: apmail-hadoop-common-dev-archive@hadoop.apache.org
Received: (qmail 43777 invoked by uid 500); 21 Feb 2012 12:48:55 -0000
Mailing-List: contact common-dev-help@hadoop.apache.org; run by ezmlm
Precedence: bulk
List-Help: <mailto:common-dev-help@hadoop.apache.org>
List-Unsubscribe: <mailto:common-dev-unsubscribe@hadoop.apache.org>
List-Post: <mailto:common-dev@hadoop.apache.org>
List-Id: <common-dev.hadoop.apache.org>
Reply-To: common-dev@hadoop.apache.org
Delivered-To: mailing list common-dev@hadoop.apache.org
Received: (qmail 43667 invoked by uid 99); 21 Feb 2012 12:48:55 -0000
Received: from athena.apache.org (HELO athena.apache.org) (140.211.11.136)
by apache.org (qpsmtpd/0.29) with ESMTP; Tue, 21 Feb 2012 12:48:55 +0000
X-ASF-Spam-Status: No, hits=-2000.0 required=5.0
tests=ALL_TRUSTED,T_RP_MATCHES_RCVD
X-Spam-Check-By: apache.org
Received: from [140.211.11.116] (HELO hel.zones.apache.org) (140.211.11.116)
by apache.org (qpsmtpd/0.29) with ESMTP; Tue, 21 Feb 2012 12:48:54 +0000
Received: from hel.zones.apache.org (hel.zones.apache.org [140.211.11.116])
by hel.zones.apache.org (Postfix) with ESMTP id C1AF033283C
for <common-dev@hadoop.apache.org>; Tue, 21 Feb 2012 12:48:34 +0000 (UTC)
Date: Tue, 21 Feb 2012 12:48:34 +0000 (UTC)
From: "Steve Loughran (Created) (JIRA)" <jira@apache.org>
To: common-dev@hadoop.apache.org
Message-ID: <109396290.5615.1329828514794.JavaMail.tomcat@hel.zones.apache.org>
Subject: [jira] [Created] (HADOOP-8097) TestRPCCallBenchmark failing w/ port
in use -handling badly
MIME-Version: 1.0
Content-Type: text/plain; charset=utf-8
Content-Transfer-Encoding: 7bit
X-JIRA-FingerPrint: 30527f35849b9dde25b450d4833f0394
TestRPCCallBenchmark failing w/ port in use -handling badly
-----------------------------------------------------------
Key: HADOOP-8097
URL: https://issues.apache.org/jira/browse/HADOOP-8097
Project: Hadoop Common
Issue Type: Bug
Affects Versions: 0.24.0
Reporter: Steve Loughran
Priority: Minor
I'm seeing TestRPCCallBenchmark fail with port in use, which is probably related to some other test (race condition on shutdown?), but which isn't being handled that well in the test itself -although the log shows the binding exception, the test is failing on a connection timeout
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
From common-dev-return-77802-apmail-hadoop-common-dev-archive=hadoop.apache.org@hadoop.apache.org Tue Feb 21 13:40:55 2012
Return-Path: <common-dev-return-77802-apmail-hadoop-common-dev-archive=hadoop.apache.org@hadoop.apache.org>
X-Original-To: apmail-hadoop-common-dev-archive@www.apache.org
Delivered-To: apmail-hadoop-common-dev-archive@www.apache.org
Received: from mail.apache.org (hermes.apache.org [140.211.11.3])
by minotaur.apache.org (Postfix) with SMTP id 985ED933E
for <apmail-hadoop-common-dev-archive@www.apache.org>; Tue, 21 Feb 2012 13:40:55 +0000 (UTC)
Received: (qmail 13305 invoked by uid 500); 21 Feb 2012 13:40:54 -0000
Delivered-To: apmail-hadoop-common-dev-archive@hadoop.apache.org
Received: (qmail 13247 invoked by uid 500); 21 Feb 2012 13:40:54 -0000
Mailing-List: contact common-dev-help@hadoop.apache.org; run by ezmlm
Precedence: bulk
List-Help: <mailto:common-dev-help@hadoop.apache.org>
List-Unsubscribe: <mailto:common-dev-unsubscribe@hadoop.apache.org>
List-Post: <mailto:common-dev@hadoop.apache.org>
List-Id: <common-dev.hadoop.apache.org>
Reply-To: common-dev@hadoop.apache.org
Delivered-To: mailing list common-dev@hadoop.apache.org
Received: (qmail 13237 invoked by uid 500); 21 Feb 2012 13:40:54 -0000
Delivered-To: apmail-hadoop-core-dev@hadoop.apache.org
Received: (qmail 13234 invoked by uid 99); 21 Feb 2012 13:40:54 -0000
Received: from nike.apache.org (HELO nike.apache.org) (192.87.106.230)
by apache.org (qpsmtpd/0.29) with ESMTP; Tue, 21 Feb 2012 13:40:53 +0000
X-ASF-Spam-Status: No, hits=-0.0 required=5.0
tests=SPF_PASS
X-Spam-Check-By: apache.org
Received-SPF: pass (nike.apache.org: domain of lists@nabble.com designates 216.139.236.26 as permitted sender)
Received: from [216.139.236.26] (HELO sam.nabble.com) (216.139.236.26)
by apache.org (qpsmtpd/0.29) with ESMTP; Tue, 21 Feb 2012 13:40:47 +0000
Received: from isper.nabble.com ([192.168.236.156])
by sam.nabble.com with esmtp (Exim 4.72)
(envelope-from <lists@nabble.com>)
id 1RzpxC-0004iS-7A
for core-dev@hadoop.apache.org; Tue, 21 Feb 2012 05:40:26 -0800
Message-ID: <33363940.post@talk.nabble.com>
Date: Tue, 21 Feb 2012 05:40:26 -0800 (PST)
From: Stormz <yasin.mustafa@gmail.com>
To: core-dev@hadoop.apache.org
Subject: Getting the Eclipse MapReduce plugin to work (Hadoop 0.20.2)
MIME-Version: 1.0
Content-Type: text/plain; charset=us-ascii
Content-Transfer-Encoding: 7bit
X-Nabble-From: yasin.mustafa@gmail.com
X-Virus-Checked: Checked by ClamAV on apache.org
Hi Guys,
Has anyone managed to get the eclipse plugin to work?? I downloaded the
plugin from https://issues.apache.org/jira/browse/MAPREDUCE-1280
and have used eclipse Helios 3.6.1 (according to comments in the JIRA this
version of eclipse should work).
I installed hadoop using the cloudera manager (everything on a single
machine). The ports I'm using to set up the hadoop location in eclipse are
the default ones set by Cloudera Manager i.e. 8020 for the NameNode and 8021
for the JobTracker.
However when I try to browse the file structure I get the following
exception:
Error: Call to localhost/127.0.0.1:8020 failed on local
exception:java.io.EOFException
Any help would be appreciated.
Thanks
Stormz
--
View this message in context: http://old.nabble.com/Getting-the-Eclipse-MapReduce-plugin-to-work-%28Hadoop-0.20.2%29-tp33363940p33363940.html
Sent from the Hadoop core-dev mailing list archive at Nabble.com.
From common-dev-return-77803-apmail-hadoop-common-dev-archive=hadoop.apache.org@hadoop.apache.org Tue Feb 21 14:21:01 2012
Return-Path: <common-dev-return-77803-apmail-hadoop-common-dev-archive=hadoop.apache.org@hadoop.apache.org>
X-Original-To: apmail-hadoop-common-dev-archive@www.apache.org
Delivered-To: apmail-hadoop-common-dev-archive@www.apache.org
Received: from mail.apache.org (hermes.apache.org [140.211.11.3])
by minotaur.apache.org (Postfix) with SMTP id ADF0C92D5
for <apmail-hadoop-common-dev-archive@www.apache.org>; Tue, 21 Feb 2012 14:21:01 +0000 (UTC)
Received: (qmail 39930 invoked by uid 500); 21 Feb 2012 14:21:00 -0000
Delivered-To: apmail-hadoop-common-dev-archive@hadoop.apache.org
Received: (qmail 39843 invoked by uid 500); 21 Feb 2012 14:21:00 -0000
Mailing-List: contact common-dev-help@hadoop.apache.org; run by ezmlm
Precedence: bulk
List-Help: <mailto:common-dev-help@hadoop.apache.org>
List-Unsubscribe: <mailto:common-dev-unsubscribe@hadoop.apache.org>
List-Post: <mailto:common-dev@hadoop.apache.org>
List-Id: <common-dev.hadoop.apache.org>
Reply-To: common-dev@hadoop.apache.org
Delivered-To: mailing list common-dev@hadoop.apache.org
Received: (qmail 39832 invoked by uid 99); 21 Feb 2012 14:21:00 -0000
Received: from athena.apache.org (HELO athena.apache.org) (140.211.11.136)
by apache.org (qpsmtpd/0.29) with ESMTP; Tue, 21 Feb 2012 14:21:00 +0000
X-ASF-Spam-Status: No, hits=-2000.0 required=5.0
tests=ALL_TRUSTED,T_RP_MATCHES_RCVD
X-Spam-Check-By: apache.org
Received: from [140.211.11.116] (HELO hel.zones.apache.org) (140.211.11.116)
by apache.org (qpsmtpd/0.29) with ESMTP; Tue, 21 Feb 2012 14:20:57 +0000
Received: from hel.zones.apache.org (hel.zones.apache.org [140.211.11.116])
by hel.zones.apache.org (Postfix) with ESMTP id 8CD99332200
for <common-dev@hadoop.apache.org>; Tue, 21 Feb 2012 14:20:37 +0000 (UTC)
Date: Tue, 21 Feb 2012 14:20:37 +0000 (UTC)
From: "Steve Loughran (Resolved) (JIRA)" <jira@apache.org>
To: common-dev@hadoop.apache.org
Message-ID: <1147819478.5902.1329834037578.JavaMail.tomcat@hel.zones.apache.org>
In-Reply-To: <449361787.7946.1316809046299.JavaMail.tomcat@hel.zones.apache.org>
Subject: [jira] [Resolved] (HADOOP-7680) TestHardLink fails on Mac OS X,
when gnu stat is in path
MIME-Version: 1.0
Content-Type: text/plain; charset=utf-8
Content-Transfer-Encoding: 7bit
X-JIRA-FingerPrint: 30527f35849b9dde25b450d4833f0394
[ https://issues.apache.org/jira/browse/HADOOP-7680?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Steve Loughran resolved HADOOP-7680.
------------------------------------
Resolution: Fixed
it is fixed, it's just jenkins that is complaining about post-build operations
> TestHardLink fails on Mac OS X, when gnu stat is in path
> --------------------------------------------------------
>
> Key: HADOOP-7680
> URL: https://issues.apache.org/jira/browse/HADOOP-7680
> Project: Hadoop Common
> Issue Type: Bug
> Affects Versions: 0.22.0, 0.23.0, 0.24.0
> Environment: Mac OS X, where `which stat` = /opt/local/libexec/gnubin/stat
> Reporter: Milind Bhandarkar
> Assignee: Milind Bhandarkar
> Fix For: 0.24.0, 0.22.1, 0.23.2
>
> Attachments: 7680-0.22.patch, 7680-0.23.patch
>
>
> For a specific reason, `which stat` = /opt/local/libexec/gnubin/stat, on my Mac. o.a.h.f.HardLink checks for os.name, detects it's a MacOSX, and assumes that stat points to /usr/bin/stat, and uses -f%l as arguments, which fails. The upcoming patch explicitly sets stat to use /usr/bin/stat on Mac OS. In 0.22, this code is part of o.a.h.f.FileUtil, and in 0.23 and trunk it is in o.a.h.f.HardLink. Both patches forthcoming.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
From common-dev-return-77804-apmail-hadoop-common-dev-archive=hadoop.apache.org@hadoop.apache.org Tue Feb 21 16:35:50 2012
Return-Path: <common-dev-return-77804-apmail-hadoop-common-dev-archive=hadoop.apache.org@hadoop.apache.org>
X-Original-To: apmail-hadoop-common-dev-archive@www.apache.org
Delivered-To: apmail-hadoop-common-dev-archive@www.apache.org
Received: from mail.apache.org (hermes.apache.org [140.211.11.3])
by minotaur.apache.org (Postfix) with SMTP id F3AFD913A
for <apmail-hadoop-common-dev-archive@www.apache.org>; Tue, 21 Feb 2012 16:35:49 +0000 (UTC)
Received: (qmail 89606 invoked by uid 500); 21 Feb 2012 16:35:48 -0000
Delivered-To: apmail-hadoop-common-dev-archive@hadoop.apache.org
Received: (qmail 89503 invoked by uid 500); 21 Feb 2012 16:35:48 -0000
Mailing-List: contact common-dev-help@hadoop.apache.org; run by ezmlm
Precedence: bulk
List-Help: <mailto:common-dev-help@hadoop.apache.org>
List-Unsubscribe: <mailto:common-dev-unsubscribe@hadoop.apache.org>
List-Post: <mailto:common-dev@hadoop.apache.org>
List-Id: <common-dev.hadoop.apache.org>
Reply-To: common-dev@hadoop.apache.org
Delivered-To: mailing list common-dev@hadoop.apache.org
Received: (qmail 89494 invoked by uid 99); 21 Feb 2012 16:35:48 -0000
Received: from athena.apache.org (HELO athena.apache.org) (140.211.11.136)
by apache.org (qpsmtpd/0.29) with ESMTP; Tue, 21 Feb 2012 16:35:48 +0000
X-ASF-Spam-Status: No, hits=3.3 required=5.0
tests=HTML_MESSAGE,NO_RDNS_DOTCOM_HELO,RCVD_IN_DNSWL_NONE,SPF_NEUTRAL
X-Spam-Check-By: apache.org
Received-SPF: neutral (athena.apache.org: 98.139.253.105 is neither permitted nor denied by domain of nroberts@yahoo-inc.com)
Received: from [98.139.253.105] (HELO mrout2-b.corp.bf1.yahoo.com) (98.139.253.105)
by apache.org (qpsmtpd/0.29) with ESMTP; Tue, 21 Feb 2012 16:35:42 +0000
Received: from sp1-ex07cas01.ds.corp.yahoo.com (sp1-ex07cas01.ds.corp.yahoo.com [216.252.116.137])
by mrout2-b.corp.bf1.yahoo.com (8.14.4/8.14.4/y.out) with ESMTP id q1LGZ15N098834
for <common-dev@hadoop.apache.org>; Tue, 21 Feb 2012 08:35:02 -0800 (PST)
DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/simple; d=yahoo-inc.com;
s=cobra; t=1329842102;
bh=7SV4gi857pMoOn+J6rLurDjNhRi6m+1kER2G/2aUQPM=;
h=From:To:Date:Subject:Message-ID:In-Reply-To:Content-Type:
MIME-Version;
b=NKlekxE2i7E/80cxr2WHr+Q16kohd6vG3PSmsL8SKap08xwENYj264tqiQ9fOdiya
pv5GdxnGCIW5zaCZw5xPkoukGacpTUFhgFkWhGg3tBRauZtJG7xom+BGPlbAwp7D67
lrjsnmnhGtdIAfwENc8Ham0kE2hUEVsf4ogX4sfY=
Received: from SP1-EX07VS01.ds.corp.yahoo.com ([216.252.116.135]) by
sp1-ex07cas01.ds.corp.yahoo.com ([216.252.116.137]) with mapi; Tue, 21 Feb
2012 08:35:01 -0800
From: Nathan Roberts <nroberts@yahoo-inc.com>
To: "common-dev@hadoop.apache.org" <common-dev@hadoop.apache.org>
Date: Tue, 21 Feb 2012 08:34:56 -0800
Subject: Re: [VOTE] Hadoop-1.0.1 Release Candidate 1
Thread-Topic: [VOTE] Hadoop-1.0.1 Release Candidate 1
Thread-Index: AczvpNb/jTJ8dH89Su+l/tYC/VGbLQBEeenA
Message-ID: <CB6923D0.24459%nroberts@yahoo-inc.com>
In-Reply-To: <CA+z3+9Fqe5fA-LM1zD=47jw-Rmj5kBM2+jsBGbiSJgpSsSqFig@mail.gmail.com>
Accept-Language: en-US
Content-Language: en
X-MS-Has-Attach:
X-MS-TNEF-Correlator:
acceptlanguage: en-US
Content-Type: multipart/alternative;
boundary="_000_CB6923D024459nrobertsyahooinccom_"
MIME-Version: 1.0
--_000_CB6923D024459nrobertsyahooinccom_
Content-Type: text/plain; charset="iso-8859-1"
Content-Transfer-Encoding: quoted-printable
+1 on the concept of 1.0.2 =3D 1.0.1 + remaining_three_you_mention
Thanks
On 2/20/12 1:52 AM, "Matt Foley" <mfoley@hortonworks.com> wrote:
Hi,
Giri found an issue with the naming of the 64-bit RPM and DEB; see
HADOOP-8090 <https://issues.apache.org/jira/browse/HADOOP-8090>. The RPM
is called "hadoop-1.0.1-1.amd64.rpm" but should be called
"hadoop-1.0.1-1.x86_64.rpm". Even though it's been this way for a long
time, apparently it causes an issue when the rpm is used with yum. (BigTop
already uses the "x86_64" form.) To fix this requires a change to
build.xml.
In addition, Nathan has requested patches for the following bugs:
- MAPREDUCE-3824
<https://issues.apache.org/jira/browse/MAPREDUCE-3824>- Distributed
caches are not removed properly
- MAPREDUCE-3851 <https://issues.apache.org/jira/browse/MAPREDUCE-3851> =
-
Allow more aggressive action in detection of Jetty issues
- HADOOP-8050 <https://issues.apache.org/jira/browse/HADOOP-8050>-
Deadlock in Namenode metrices
and Owen feels this one is pretty important:
- HADOOP-8043 <https://issues.apache.org/jira/browse/HADOOP-8043> -
KerberosAuthenticationFilter
and friends have some problems
So altogether that's five new issues, all raised (or raised in visibility)
since the 1.0.1 vote was called. Two of them, HADOOP-8050 and
MAPREDUCE-3824, already have approved fixes, but the remaining three are
still in discussion.
The thing is that there are people waiting on the 1.0.1 release with some
urgency, including a pending BigTop release. So instead of pulling the
1.0.1 release, waiting for fixes, then waiting an additional week for
another vote, I suggest that we let 1.0.1 proceed as is, and do a 1.0.2
release as soon as the remaining three bugs noted above are fixed.
If you agree with this, please vote in favor of the 1.0.1 release. If you
disagree, please vote against the release, and I'll do a 1.0.1-rc2 instead
of a 1.0.2. As a reminder, the vote closes Tuesday afternoon.
The goal here is to keep everyone fully informed, while providing the most
good to the most people, in the face of conflicting requests.
Thanks,
--Matt
On Tue, Feb 14, 2012 at 2:29 PM, Matt Foley <mattf@apache.org> wrote:
> Hi all,
> Hadoop-1.0.1-rc1 is now available at
> http://people.apache.org/~mattf/hadoop-1.0.1-rc1/
> Please download it, test it, and vote on whether to accept it as Release
> 1.0.1.
> Voting will close at 2:30pm PST on Tuesday 21 February.
>
> Thank you,
> --Matt (Release Manager)
>
> This is a maintenance release from 1.0.0, but a number of
> production-relevant bug fixes were requested for inclusion in the last we=
ek
> or so. The complete release notes are available at
>
> http://people.apache.org/~mattf/hadoop-1.0.1-rc1/RELEASE_NOTES_HADOOP-1.0=
.1.html
> The summary list is:
>
> - HADOOP-8009 <https://issues.apache.org/jira/browse/HADOOP-8009>.
> Create hadoop-client and hadoop-minicluster artifacts for downstream
> projects
> - HADOOP-8037 <https://issues.apache.org/jira/browse/HADOOP-8037>. Bin=
ary
> tarball does not preserve platform info for native builds, and RPMs fa=
il to
> provide needed symlinks for libhadoop.so
> - MAPREDUCE-3184 <https://issues.apache.org/jira/browse/MAPREDUCE-3184=
>. Improve
> handling of fetch failures when a tasktracker is not responding on HTT=
P
> - HADOOP-7470 <https://issues.apache.org/jira/browse/HADOOP-7470>.
> move up to Jackson 1.8.8
> - HADOOP-7960 <https://issues.apache.org/jira/browse/HADOOP-7960>. Por=
t
> HADOOP-5203 to branch-1, build version comparison is too restrictive
> - HADOOP-7964 <https://issues.apache.org/jira/browse/HADOOP-7964>. Dea=
dlock
> in class init.
> - HADOOP-7987 <https://issues.apache.org/jira/browse/HADOOP-7987>. Sup=
port
> setting the run-as user in unsecure mode
> - HADOOP-7988 <https://issues.apache.org/jira/browse/HADOOP-7988>. Upp=
er
> case in hostname part of the principals doesn't work with kerberos.
> - HADOOP-8010 <https://issues.apache.org/jira/browse/HADOOP-8010>. had=
oop-config.sh
> spews error message when HADOOP_HOME_WARN_SUPPRESS is set to true and
> HADOOP_HOME is present
> - HADOOP-8052 <https://issues.apache.org/jira/browse/HADOOP-8052>. Had=
oop
> Metrics2 should emit Float.MAX_VALUE (instead of Double.MAX_VALUE) to =
avoid
> making Ganglia's gmetad core
> - HDFS-2379 <https://issues.apache.org/jira/browse/HDFS-2379>. 0.20:
> Allow block reports to proceed without holding FSDataset lock
> - HDFS-2814 <https://issues.apache.org/jira/browse/HDFS-2814>. Namenod=
eMXBean
> does not account for svn revision in the version information
> - MAPREDUCE-3343 <https://issues.apache.org/jira/browse/MAPREDUCE-3343=
>. TaskTracker
> Out of Memory because of distributed cache
> - MAPREDUCE-3607 <https://issues.apache.org/jira/browse/MAPREDUCE-3607=
>. Port
> missing new API mapreduce lib classes to 1.x
>
>
--_000_CB6923D024459nrobertsyahooinccom_--
From common-dev-return-77805-apmail-hadoop-common-dev-archive=hadoop.apache.org@hadoop.apache.org Tue Feb 21 17:00:39 2012
Return-Path: <common-dev-return-77805-apmail-hadoop-common-dev-archive=hadoop.apache.org@hadoop.apache.org>
X-Original-To: apmail-hadoop-common-dev-archive@www.apache.org
Delivered-To: apmail-hadoop-common-dev-archive@www.apache.org
Received: from mail.apache.org (hermes.apache.org [140.211.11.3])
by minotaur.apache.org (Postfix) with SMTP id D717A9D21
for <apmail-hadoop-common-dev-archive@www.apache.org>; Tue, 21 Feb 2012 17:00:38 +0000 (UTC)
Received: (qmail 80728 invoked by uid 500); 21 Feb 2012 17:00:37 -0000
Delivered-To: apmail-hadoop-common-dev-archive@hadoop.apache.org
Received: (qmail 80669 invoked by uid 500); 21 Feb 2012 17:00:37 -0000
Mailing-List: contact common-dev-help@hadoop.apache.org; run by ezmlm
Precedence: bulk
List-Help: <mailto:common-dev-help@hadoop.apache.org>
List-Unsubscribe: <mailto:common-dev-unsubscribe@hadoop.apache.org>
List-Post: <mailto:common-dev@hadoop.apache.org>
List-Id: <common-dev.hadoop.apache.org>
Reply-To: common-dev@hadoop.apache.org
Delivered-To: mailing list common-dev@hadoop.apache.org
Received: (qmail 80657 invoked by uid 99); 21 Feb 2012 17:00:37 -0000
Received: from athena.apache.org (HELO athena.apache.org) (140.211.11.136)
by apache.org (qpsmtpd/0.29) with ESMTP; Tue, 21 Feb 2012 17:00:37 +0000
X-ASF-Spam-Status: No, hits=-0.7 required=5.0
tests=RCVD_IN_DNSWL_LOW,SPF_PASS
X-Spam-Check-By: apache.org
Received-SPF: pass (athena.apache.org: domain of shaposhnik@gmail.com designates 209.85.214.48 as permitted sender)
Received: from [209.85.214.48] (HELO mail-bk0-f48.google.com) (209.85.214.48)
by apache.org (qpsmtpd/0.29) with ESMTP; Tue, 21 Feb 2012 17:00:30 +0000
Received: by bkcjm1 with SMTP id jm1so7792640bkc.35
for <common-dev@hadoop.apache.org>; Tue, 21 Feb 2012 09:00:09 -0800 (PST)
Received-SPF: pass (google.com: domain of shaposhnik@gmail.com designates 10.205.127.81 as permitted sender) client-ip=10.205.127.81;
Authentication-Results: mr.google.com; spf=pass (google.com: domain of shaposhnik@gmail.com designates 10.205.127.81 as permitted sender) smtp.mail=shaposhnik@gmail.com; dkim=pass header.i=shaposhnik@gmail.com
Received: from mr.google.com ([10.205.127.81])
by 10.205.127.81 with SMTP id gz17mr4230507bkc.114.1329843609627 (num_hops = 1);
Tue, 21 Feb 2012 09:00:09 -0800 (PST)
DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed;
d=gmail.com; s=gamma;
h=mime-version:sender:in-reply-to:references:date
:x-google-sender-auth:message-id:subject:from:to:content-type
:content-transfer-encoding;
bh=HuubnQgHG3CWOYtt+033xRzYzVcUCQcWG8gevd08NJI=;
b=SZH5DGZKt/FhXGqXAN33uerrZ9rvFA5aln3EUAIHvXyffbqVDejGUTmRHojU0CVoSg
UP3StrzeMavV9YpBClK8kYzpuCLE1erfnxttS4AfBQ5tlXBOVysWVhx2JowZQ35Z+usq
JLt46gISfz6tpsBvxxlVS0nkRcPIDLIPjk3Zk=
MIME-Version: 1.0
Received: by 10.205.127.81 with SMTP id gz17mr3377220bkc.114.1329843609545;
Tue, 21 Feb 2012 09:00:09 -0800 (PST)
Sender: shaposhnik@gmail.com
Received: by 10.204.26.200 with HTTP; Tue, 21 Feb 2012 09:00:09 -0800 (PST)
In-Reply-To: <CA+z3+9HrBBf2___wSEk7M=HrzDRLsvHikqcR3Mx2ra6+3oMuwg@mail.gmail.com>
References: <CA+z3+9HrBBf2___wSEk7M=HrzDRLsvHikqcR3Mx2ra6+3oMuwg@mail.gmail.com>
Date: Tue, 21 Feb 2012 09:00:09 -0800
X-Google-Sender-Auth: y-HBp2pBMJgoe21zWwWckCBnbX4
Message-ID: <CA+ULb+uQFaSgwwpDVz3SdL9Z8UKC=Tw36h-fbwVNcCHcGQfG7Q@mail.gmail.com>
Subject: Re: [VOTE] Hadoop-1.0.1 Release Candidate 1
From: Roman Shaposhnik <roman@shaposhnik.org>
To: common-dev@hadoop.apache.org, mattf@apache.org
Content-Type: text/plain; charset=ISO-8859-1
Content-Transfer-Encoding: quoted-printable
On Tue, Feb 14, 2012 at 2:29 PM, Matt Foley <mattf@apache.org> wrote:
> Hi all,
> Hadoop-1.0.1-rc1 is now available at
> =A0 =A0http://people.apache.org/~mattf/hadoop-1.0.1-rc1/
> Please download it, test it, and vote on whether to accept it as Release
> 1.0.1.
> Voting will close at 2:30pm PST on Tuesday 21 February.
+1 (non-binding) from the Bigtop side. Pulled this RC into an RCs branch,
built packaged artifacts on all the platforms, ran fully distributed tests
on CentOS 5. No regressions.
Thanks,
Roman.
From common-dev-return-77806-apmail-hadoop-common-dev-archive=hadoop.apache.org@hadoop.apache.org Tue Feb 21 17:35:39 2012
Return-Path: <common-dev-return-77806-apmail-hadoop-common-dev-archive=hadoop.apache.org@hadoop.apache.org>
X-Original-To: apmail-hadoop-common-dev-archive@www.apache.org
Delivered-To: apmail-hadoop-common-dev-archive@www.apache.org
Received: from mail.apache.org (hermes.apache.org [140.211.11.3])
by minotaur.apache.org (Postfix) with SMTP id 26EF3993E
for <apmail-hadoop-common-dev-archive@www.apache.org>; Tue, 21 Feb 2012 17:35:39 +0000 (UTC)
Received: (qmail 24329 invoked by uid 500); 21 Feb 2012 17:35:37 -0000
Delivered-To: apmail-hadoop-common-dev-archive@hadoop.apache.org
Received: (qmail 24122 invoked by uid 500); 21 Feb 2012 17:35:37 -0000
Mailing-List: contact common-dev-help@hadoop.apache.org; run by ezmlm
Precedence: bulk
List-Help: <mailto:common-dev-help@hadoop.apache.org>
List-Unsubscribe: <mailto:common-dev-unsubscribe@hadoop.apache.org>
List-Post: <mailto:common-dev@hadoop.apache.org>
List-Id: <common-dev.hadoop.apache.org>
Reply-To: common-dev@hadoop.apache.org
Delivered-To: mailing list common-dev@hadoop.apache.org
Received: (qmail 24114 invoked by uid 99); 21 Feb 2012 17:35:37 -0000
Received: from nike.apache.org (HELO nike.apache.org) (192.87.106.230)
by apache.org (qpsmtpd/0.29) with ESMTP; Tue, 21 Feb 2012 17:35:37 +0000
X-ASF-Spam-Status: No, hits=2.2 required=5.0
tests=HTML_MESSAGE,RCVD_IN_DNSWL_LOW,SPF_NEUTRAL
X-Spam-Check-By: apache.org
Received-SPF: neutral (nike.apache.org: local policy)
Received: from [209.85.160.48] (HELO mail-pw0-f48.google.com) (209.85.160.48)
by apache.org (qpsmtpd/0.29) with ESMTP; Tue, 21 Feb 2012 17:35:28 +0000
Received: by pbcxa12 with SMTP id xa12so6915331pbc.35
for <common-dev@hadoop.apache.org>; Tue, 21 Feb 2012 09:35:06 -0800 (PST)
Received-SPF: pass (google.com: domain of acm@hortonworks.com designates 10.68.134.198 as permitted sender) client-ip=10.68.134.198;
Authentication-Results: mr.google.com; spf=pass (google.com: domain of acm@hortonworks.com designates 10.68.134.198 as permitted sender) smtp.mail=acm@hortonworks.com
Received: from mr.google.com ([10.68.134.198])
by 10.68.134.198 with SMTP id pm6mr77558235pbb.8.1329845706636 (num_hops = 1);
Tue, 21 Feb 2012 09:35:06 -0800 (PST)
Received: by 10.68.134.198 with SMTP id pm6mr63945225pbb.8.1329845706569;
Tue, 21 Feb 2012 09:35:06 -0800 (PST)
Received: from [192.168.1.4] ([122.167.14.89])
by mx.google.com with ESMTPS id j3sm16551432pbb.29.2012.02.21.09.35.01
(version=TLSv1/SSLv3 cipher=OTHER);
Tue, 21 Feb 2012 09:35:04 -0800 (PST)
From: Arun C Murthy <acm@hortonworks.com>
Mime-Version: 1.0 (Apple Message framework v1084)
Content-Type: multipart/alternative; boundary=Apple-Mail-69--648820101
Subject: Re: [VOTE] Hadoop-1.0.1 Release Candidate 1
Date: Tue, 21 Feb 2012 23:04:58 +0530
In-Reply-To: <CA+z3+9Fqe5fA-LM1zD=47jw-Rmj5kBM2+jsBGbiSJgpSsSqFig@mail.gmail.com>
To: common-dev@hadoop.apache.org
References: <CA+z3+9HrBBf2___wSEk7M=HrzDRLsvHikqcR3Mx2ra6+3oMuwg@mail.gmail.com> <CA+z3+9Fqe5fA-LM1zD=47jw-Rmj5kBM2+jsBGbiSJgpSsSqFig@mail.gmail.com>
Message-Id: <77D31DF3-611E-4ECB-AAB1-794CB874F74D@hortonworks.com>
X-Mailer: Apple Mail (2.1084)
X-Gm-Message-State: ALoCoQmipsNqzA/dx0yap1LSHd8XX5lG4clSAIfGFe+7O5I5QcZKiEu0EfJyFB3ZHBKDKTUc5Tp3
X-Virus-Checked: Checked by ClamAV on apache.org
--Apple-Mail-69--648820101
Content-Transfer-Encoding: quoted-printable
Content-Type: text/plain;
charset=us-ascii
+1 on releasing 1.0.1 now and follow with 1.0.2.
Arun
On Feb 20, 2012, at 1:22 PM, Matt Foley wrote:
> Hi,
> Giri found an issue with the naming of the 64-bit RPM and DEB; see
> HADOOP-8090 <https://issues.apache.org/jira/browse/HADOOP-8090>. The =
RPM
> is called "hadoop-1.0.1-1.amd64.rpm" but should be called
> "hadoop-1.0.1-1.x86_64.rpm". Even though it's been this way for a =
long
> time, apparently it causes an issue when the rpm is used with yum. =
(BigTop
> already uses the "x86_64" form.) To fix this requires a change to
> build.xml.
>=20
> In addition, Nathan has requested patches for the following bugs:
>=20
> - MAPREDUCE-3824
> <https://issues.apache.org/jira/browse/MAPREDUCE-3824>- Distributed
> caches are not removed properly
> - MAPREDUCE-3851 =
<https://issues.apache.org/jira/browse/MAPREDUCE-3851> -
> Allow more aggressive action in detection of Jetty issues
> - HADOOP-8050 <https://issues.apache.org/jira/browse/HADOOP-8050>-
> Deadlock in Namenode metrices
>=20
> and Owen feels this one is pretty important:
>=20
> - HADOOP-8043 <https://issues.apache.org/jira/browse/HADOOP-8043> -
> KerberosAuthenticationFilter
> and friends have some problems
>=20
> So altogether that's five new issues, all raised (or raised in =
visibility)
> since the 1.0.1 vote was called. Two of them, HADOOP-8050 and
> MAPREDUCE-3824, already have approved fixes, but the remaining three =
are
> still in discussion.
>=20
> The thing is that there are people waiting on the 1.0.1 release with =
some
> urgency, including a pending BigTop release. So instead of pulling =
the
> 1.0.1 release, waiting for fixes, then waiting an additional week for
> another vote, I suggest that we let 1.0.1 proceed as is, and do a =
1.0.2
> release as soon as the remaining three bugs noted above are fixed.
>=20
> If you agree with this, please vote in favor of the 1.0.1 release. If =
you
> disagree, please vote against the release, and I'll do a 1.0.1-rc2 =
instead
> of a 1.0.2. As a reminder, the vote closes Tuesday afternoon.
>=20
> The goal here is to keep everyone fully informed, while providing the =
most
> good to the most people, in the face of conflicting requests.
> Thanks,
> --Matt
>=20
> On Tue, Feb 14, 2012 at 2:29 PM, Matt Foley <mattf@apache.org> wrote:
>=20
>> Hi all,
>> Hadoop-1.0.1-rc1 is now available at
>> http://people.apache.org/~mattf/hadoop-1.0.1-rc1/
>> Please download it, test it, and vote on whether to accept it as =
Release
>> 1.0.1.
>> Voting will close at 2:30pm PST on Tuesday 21 February.
>>=20
>> Thank you,
>> --Matt (Release Manager)
>>=20
>> This is a maintenance release from 1.0.0, but a number of
>> production-relevant bug fixes were requested for inclusion in the =
last week
>> or so. The complete release notes are available at
>>=20
>> =
http://people.apache.org/~mattf/hadoop-1.0.1-rc1/RELEASE_NOTES_HADOOP-1.0.=
1.html
>> The summary list is:
>>=20
>> - HADOOP-8009 <https://issues.apache.org/jira/browse/HADOOP-8009>.
>> Create hadoop-client and hadoop-minicluster artifacts for =
downstream
>> projects
>> - HADOOP-8037 <https://issues.apache.org/jira/browse/HADOOP-8037>. =
Binary
>> tarball does not preserve platform info for native builds, and RPMs =
fail to
>> provide needed symlinks for libhadoop.so
>> - MAPREDUCE-3184 =
<https://issues.apache.org/jira/browse/MAPREDUCE-3184>. Improve
>> handling of fetch failures when a tasktracker is not responding on =
HTTP
>> - HADOOP-7470 <https://issues.apache.org/jira/browse/HADOOP-7470>.
>> move up to Jackson 1.8.8
>> - HADOOP-7960 <https://issues.apache.org/jira/browse/HADOOP-7960>. =
Port
>> HADOOP-5203 to branch-1, build version comparison is too =
restrictive
>> - HADOOP-7964 <https://issues.apache.org/jira/browse/HADOOP-7964>. =
Deadlock
>> in class init.
>> - HADOOP-7987 <https://issues.apache.org/jira/browse/HADOOP-7987>. =
Support
>> setting the run-as user in unsecure mode
>> - HADOOP-7988 <https://issues.apache.org/jira/browse/HADOOP-7988>. =
Upper
>> case in hostname part of the principals doesn't work with kerberos.
>> - HADOOP-8010 <https://issues.apache.org/jira/browse/HADOOP-8010>. =
hadoop-config.sh
>> spews error message when HADOOP_HOME_WARN_SUPPRESS is set to true =
and
>> HADOOP_HOME is present
>> - HADOOP-8052 <https://issues.apache.org/jira/browse/HADOOP-8052>. =
Hadoop
>> Metrics2 should emit Float.MAX_VALUE (instead of Double.MAX_VALUE) =
to avoid
>> making Ganglia's gmetad core
>> - HDFS-2379 <https://issues.apache.org/jira/browse/HDFS-2379>. =
0.20:
>> Allow block reports to proceed without holding FSDataset lock
>> - HDFS-2814 <https://issues.apache.org/jira/browse/HDFS-2814>. =
NamenodeMXBean
>> does not account for svn revision in the version information
>> - MAPREDUCE-3343 =
<https://issues.apache.org/jira/browse/MAPREDUCE-3343>. TaskTracker
>> Out of Memory because of distributed cache
>> - MAPREDUCE-3607 =
<https://issues.apache.org/jira/browse/MAPREDUCE-3607>. Port
>> missing new API mapreduce lib classes to 1.x
>>=20
>>=20
--
Arun C. Murthy
Hortonworks Inc.
http://hortonworks.com/
--Apple-Mail-69--648820101--
From common-dev-return-77807-apmail-hadoop-common-dev-archive=hadoop.apache.org@hadoop.apache.org Tue Feb 21 18:30:00 2012
Return-Path: <common-dev-return-77807-apmail-hadoop-common-dev-archive=hadoop.apache.org@hadoop.apache.org>
X-Original-To: apmail-hadoop-common-dev-archive@www.apache.org
Delivered-To: apmail-hadoop-common-dev-archive@www.apache.org
Received: from mail.apache.org (hermes.apache.org [140.211.11.3])
by minotaur.apache.org (Postfix) with SMTP id BDE629576
for <apmail-hadoop-common-dev-archive@www.apache.org>; Tue, 21 Feb 2012 18:30:00 +0000 (UTC)
Received: (qmail 82026 invoked by uid 500); 21 Feb 2012 18:29:59 -0000
Delivered-To: apmail-hadoop-common-dev-archive@hadoop.apache.org
Received: (qmail 81941 invoked by uid 500); 21 Feb 2012 18:29:59 -0000
Mailing-List: contact common-dev-help@hadoop.apache.org; run by ezmlm
Precedence: bulk
List-Help: <mailto:common-dev-help@hadoop.apache.org>
List-Unsubscribe: <mailto:common-dev-unsubscribe@hadoop.apache.org>
List-Post: <mailto:common-dev@hadoop.apache.org>
List-Id: <common-dev.hadoop.apache.org>
Reply-To: common-dev@hadoop.apache.org
Delivered-To: mailing list common-dev@hadoop.apache.org
Received: (qmail 81931 invoked by uid 99); 21 Feb 2012 18:29:59 -0000
Received: from nike.apache.org (HELO nike.apache.org) (192.87.106.230)
by apache.org (qpsmtpd/0.29) with ESMTP; Tue, 21 Feb 2012 18:29:59 +0000
X-ASF-Spam-Status: No, hits=2.2 required=5.0
tests=HTML_MESSAGE,RCVD_IN_DNSWL_LOW,SPF_NEUTRAL
X-Spam-Check-By: apache.org
Received-SPF: neutral (nike.apache.org: local policy)
Received: from [209.85.160.48] (HELO mail-pw0-f48.google.com) (209.85.160.48)
by apache.org (qpsmtpd/0.29) with ESMTP; Tue, 21 Feb 2012 18:29:50 +0000
Received: by pbcxa12 with SMTP id xa12so6975866pbc.35
for <common-dev@hadoop.apache.org>; Tue, 21 Feb 2012 10:29:29 -0800 (PST)
Received-SPF: pass (google.com: domain of arpit@hortonworks.com designates 10.68.204.7 as permitted sender) client-ip=10.68.204.7;
Authentication-Results: mr.google.com; spf=pass (google.com: domain of arpit@hortonworks.com designates 10.68.204.7 as permitted sender) smtp.mail=arpit@hortonworks.com
Received: from mr.google.com ([10.68.204.7])
by 10.68.204.7 with SMTP id ku7mr78093853pbc.45.1329848969099 (num_hops = 1);
Tue, 21 Feb 2012 10:29:29 -0800 (PST)
Received: by 10.68.204.7 with SMTP id ku7mr64406536pbc.45.1329848969010;
Tue, 21 Feb 2012 10:29:29 -0800 (PST)
Received: from [192.168.100.169] (70-35-59-5.static.wiline.com. [70.35.59.5])
by mx.google.com with ESMTPS id d7sm16654257pbh.59.2012.02.21.10.29.25
(version=TLSv1/SSLv3 cipher=OTHER);
Tue, 21 Feb 2012 10:29:26 -0800 (PST)
From: Arpit Gupta <arpit@hortonworks.com>
Mime-Version: 1.0 (Apple Message framework v1257)
Content-Type: multipart/alternative; boundary="Apple-Mail=_B1150D23-2155-4F5F-95DA-EEF01B8572A9"
Subject: Re: [VOTE] Hadoop-1.0.1 Release Candidate 1
Date: Tue, 21 Feb 2012 10:29:24 -0800
In-Reply-To: <CA+z3+9HrBBf2___wSEk7M=HrzDRLsvHikqcR3Mx2ra6+3oMuwg@mail.gmail.com>
To: common-dev@hadoop.apache.org,
mattf@apache.org
References: <CA+z3+9HrBBf2___wSEk7M=HrzDRLsvHikqcR3Mx2ra6+3oMuwg@mail.gmail.com>
Message-Id: <66D3CC93-9342-4D7D-9604-1F85975C7793@hortonworks.com>
X-Mailer: Apple Mail (2.1257)
X-Gm-Message-State: ALoCoQmu8PlRQZMy53cAuHsxYSRlvm+XPQ2P8Pd506erSgcY2bXjjCkC04bgCRrfh+dsz2j9Dwl7
X-Virus-Checked: Checked by ClamAV on apache.org
--Apple-Mail=_B1150D23-2155-4F5F-95DA-EEF01B8572A9
Content-Transfer-Encoding: quoted-printable
Content-Type: text/plain;
charset=iso-8859-1
+1 (non binding) tested on secure and non secure clusters and no =
regressions were found.
On Feb 14, 2012, at 2:29 PM, Matt Foley wrote:
> Hi all,
> Hadoop-1.0.1-rc1 is now available at
> http://people.apache.org/~mattf/hadoop-1.0.1-rc1/
> Please download it, test it, and vote on whether to accept it as =
Release
> 1.0.1.
> Voting will close at 2:30pm PST on Tuesday 21 February.
>=20
> Thank you,
> --Matt (Release Manager)
>=20
> This is a maintenance release from 1.0.0, but a number of
> production-relevant bug fixes were requested for inclusion in the last =
week
> or so. The complete release notes are available at
>=20
> =
http://people.apache.org/~mattf/hadoop-1.0.1-rc1/RELEASE_NOTES_HADOOP-1.0.=
1.html
> The summary list is:
>=20
> - HADOOP-8009 <https://issues.apache.org/jira/browse/HADOOP-8009>.
> Create hadoop-client and hadoop-minicluster artifacts for downstream
> projects
> - HADOOP-8037 <https://issues.apache.org/jira/browse/HADOOP-8037>. =
Binary
> tarball does not preserve platform info for native builds, and RPMs =
fail to
> provide needed symlinks for libhadoop.so
> - MAPREDUCE-3184
> <https://issues.apache.org/jira/browse/MAPREDUCE-3184>. Improve
> handling of fetch failures when a tasktracker is not responding on =
HTTP
> - HADOOP-7470 <https://issues.apache.org/jira/browse/HADOOP-7470>. =
move
> up to Jackson 1.8.8
> - HADOOP-7960 <https://issues.apache.org/jira/browse/HADOOP-7960>. =
Port
> HADOOP-5203 to branch-1, build version comparison is too restrictive
> - HADOOP-7964 <https://issues.apache.org/jira/browse/HADOOP-7964>. =
Deadlock
> in class init.
> - HADOOP-7987 <https://issues.apache.org/jira/browse/HADOOP-7987>. =
Support
> setting the run-as user in unsecure mode
> - HADOOP-7988 <https://issues.apache.org/jira/browse/HADOOP-7988>. =
Upper
> case in hostname part of the principals doesn't work with kerberos.
> - HADOOP-8010 <https://issues.apache.org/jira/browse/HADOOP-8010>.
> hadoop-config.sh
> spews error message when HADOOP_HOME_WARN_SUPPRESS is set to true =
and
> HADOOP_HOME is present
> - HADOOP-8052 <https://issues.apache.org/jira/browse/HADOOP-8052>. =
Hadoop
> Metrics2 should emit Float.MAX_VALUE (instead of Double.MAX_VALUE) =
to avoid
> making Ganglia's gmetad core
> - HDFS-2379 <https://issues.apache.org/jira/browse/HDFS-2379>. 0.20:
> Allow block reports to proceed without holding FSDataset lock
> - HDFS-2814 <https://issues.apache.org/jira/browse/HDFS-2814>.
> NamenodeMXBean
> does not account for svn revision in the version information
> - MAPREDUCE-3343
> <https://issues.apache.org/jira/browse/MAPREDUCE-3343>. TaskTracker
> Out of Memory because of distributed cache
> - MAPREDUCE-3607
> <https://issues.apache.org/jira/browse/MAPREDUCE-3607>. Port
> missing new API mapreduce lib classes to 1.x
--
Arpit
Hortonworks, Inc.
email: arpit@hortonworks.com
--Apple-Mail=_B1150D23-2155-4F5F-95DA-EEF01B8572A9
Content-Type: multipart/related;
type="text/html";
boundary="Apple-Mail=_9B329B9D-DBF2-43B8-BA51-C445E633AAA9"
--Apple-Mail=_9B329B9D-DBF2-43B8-BA51-C445E633AAA9
Content-Transfer-Encoding: quoted-printable
Content-Type: text/html;
charset=iso-8859-1
<html><head></head><body style=3D"word-wrap: break-word; =
-webkit-nbsp-mode: space; -webkit-line-break: after-white-space; ">+1 =
(non binding) tested on secure and non secure clusters and no =
regressions were found.<div><br></div><div><br><div><div>On Feb 14, =
2012, at 2:29 PM, Matt Foley wrote:</div><br =
class=3D"Apple-interchange-newline"><blockquote type=3D"cite"><div>Hi =
all,<br>Hadoop-1.0.1-rc1 is now available at<br> &nbsp;&nbsp;&nbsp;<a =
href=3D"http://people.apache.org/~mattf/hadoop-1.0.1-rc1/">http://people.a=
pache.org/~mattf/hadoop-1.0.1-rc1/</a><br>Please download it, test it, =
and vote on whether to accept it as Release<br>1.0.1.<br>Voting will =
close at 2:30pm PST on Tuesday 21 February.<br><br>Thank you,<br>--Matt =
(Release Manager)<br><br>This is a maintenance release from 1.0.0, but a =
number of<br>production-relevant bug fixes were requested for inclusion =
in the last week<br>or so. &nbsp;The complete release notes are =
available at<br><br><a =
href=3D"http://people.apache.org/~mattf/hadoop-1.0.1-rc1/RELEASE_NOTES_HAD=
OOP-1.0.1.html">http://people.apache.org/~mattf/hadoop-1.0.1-rc1/RELEASE_N=
OTES_HADOOP-1.0.1.html</a><br>The summary list is:<br><br> &nbsp;&nbsp;- =
HADOOP-8009 =
&lt;https://issues.apache.org/jira/browse/HADOOP-8009&gt;.<br> =
&nbsp;&nbsp;Create hadoop-client and hadoop-minicluster artifacts for =
downstream<br> &nbsp;&nbsp;projects<br> &nbsp;&nbsp;- HADOOP-8037 =
&lt;https://issues.apache.org/jira/browse/HADOOP-8037&gt;. Binary<br> =
&nbsp;&nbsp;tarball does not preserve platform info for native builds, =
and RPMs fail to<br> &nbsp;&nbsp;provide needed symlinks for =
libhadoop.so<br> &nbsp;&nbsp;- =
MAPREDUCE-3184<br>&lt;https://issues.apache.org/jira/browse/MAPREDUCE-3184=
&gt;. Improve<br> &nbsp;&nbsp;handling of fetch failures when a =
tasktracker is not responding on HTTP<br> &nbsp;&nbsp;- HADOOP-7470 =
&lt;https://issues.apache.org/jira/browse/HADOOP-7470&gt;. move<br> =
&nbsp;&nbsp;up to Jackson 1.8.8<br> &nbsp;&nbsp;- HADOOP-7960 =
&lt;https://issues.apache.org/jira/browse/HADOOP-7960&gt;. Port<br> =
&nbsp;&nbsp;HADOOP-5203 to branch-1, build version comparison is too =
restrictive<br> &nbsp;&nbsp;- HADOOP-7964 =
&lt;https://issues.apache.org/jira/browse/HADOOP-7964&gt;. Deadlock<br> =
&nbsp;&nbsp;in class init.<br> &nbsp;&nbsp;- HADOOP-7987 =
&lt;https://issues.apache.org/jira/browse/HADOOP-7987&gt;. Support<br> =
&nbsp;&nbsp;setting the run-as user in unsecure mode<br> &nbsp;&nbsp;- =
HADOOP-7988 &lt;https://issues.apache.org/jira/browse/HADOOP-7988&gt;. =
Upper<br> &nbsp;&nbsp;case in hostname part of the principals doesn't =
work with kerberos.<br> &nbsp;&nbsp;- HADOOP-8010 =
&lt;https://issues.apache.org/jira/browse/HADOOP-8010&gt;.<br>hadoop-confi=
g.sh<br> &nbsp;&nbsp;spews error message when HADOOP_HOME_WARN_SUPPRESS =
is set to true and<br> &nbsp;&nbsp;HADOOP_HOME is present<br> =
&nbsp;&nbsp;- HADOOP-8052 =
&lt;https://issues.apache.org/jira/browse/HADOOP-8052&gt;. Hadoop<br> =
&nbsp;&nbsp;Metrics2 should emit Float.MAX_VALUE (instead of =
Double.MAX_VALUE) to avoid<br> &nbsp;&nbsp;making Ganglia's gmetad =
core<br> &nbsp;&nbsp;- HDFS-2379 =
&lt;https://issues.apache.org/jira/browse/HDFS-2379&gt;. 0.20:<br> =
&nbsp;&nbsp;Allow block reports to proceed without holding FSDataset =
lock<br> &nbsp;&nbsp;- HDFS-2814 =
&lt;https://issues.apache.org/jira/browse/HDFS-2814&gt;.<br>NamenodeMXBean=
<br> &nbsp;&nbsp;does not account for svn revision in the version =
information<br> &nbsp;&nbsp;- =
MAPREDUCE-3343<br>&lt;https://issues.apache.org/jira/browse/MAPREDUCE-3343=
&gt;. TaskTracker<br> &nbsp;&nbsp;Out of Memory because of distributed =
cache<br> &nbsp;&nbsp;- =
MAPREDUCE-3607<br>&lt;https://issues.apache.org/jira/browse/MAPREDUCE-3607=
&gt;. Port<br> &nbsp;&nbsp;missing new API mapreduce lib classes to =
1.x<br></div></blockquote></div><br><div apple-content-edited=3D"true">
<span class=3D"Apple-style-span" style=3D"border-collapse: separate; =
color: rgb(0, 0, 0); font-family: Monaco; font-style: normal; =
font-variant: normal; font-weight: normal; letter-spacing: normal; =
line-height: normal; orphans: 2; text-align: -webkit-auto; text-indent: =
0px; text-transform: none; white-space: normal; widows: 2; word-spacing: =
0px; -webkit-border-horizontal-spacing: 0px; =
-webkit-border-vertical-spacing: 0px; =
-webkit-text-decorations-in-effect: none; -webkit-text-size-adjust: =
auto; -webkit-text-stroke-width: 0px; font-size: medium; "><span =
class=3D"Apple-style-span" style=3D"border-collapse: separate; color: =
rgb(0, 0, 0); font-family: Monaco; font-style: normal; font-variant: =
normal; font-weight: normal; letter-spacing: normal; line-height: =
normal; orphans: 2; text-align: -webkit-auto; text-indent: 0px; =
text-transform: none; white-space: normal; widows: 2; word-spacing: 0px; =
-webkit-border-horizontal-spacing: 0px; -webkit-border-vertical-spacing: =
0px; -webkit-text-decorations-in-effect: none; -webkit-text-size-adjust: =
auto; -webkit-text-stroke-width: 0px; font-size: medium; "><span =
class=3D"Apple-style-span" style=3D"border-collapse: separate; color: =
rgb(0, 0, 0); font-family: Monaco; font-style: normal; font-variant: =
normal; font-weight: normal; letter-spacing: normal; line-height: =
normal; orphans: 2; text-align: -webkit-auto; text-indent: 0px; =
text-transform: none; white-space: normal; widows: 2; word-spacing: 0px; =
-webkit-border-horizontal-spacing: 0px; -webkit-border-vertical-spacing: =
0px; -webkit-text-decorations-in-effect: none; -webkit-text-size-adjust: =
auto; -webkit-text-stroke-width: 0px; font-size: medium; "><div =
style=3D"word-wrap: break-word; -webkit-nbsp-mode: space; =
-webkit-line-break: after-white-space; "><br>--<br>Arpit</div><div =
style=3D"word-wrap: break-word; -webkit-nbsp-mode: space; =
-webkit-line-break: after-white-space; ">Hortonworks, Inc.<br>email: <a =
href=3D"mailto:arpit@hortonworks.com">arpit@hortonworks.com</a><br><br></d=
iv></span></span><a href=3D"http://www.hadoopsummit.org/"></a></span><a =
href=3D"http://www.hadoopsummit.org/"><br =
class=3D"Apple-interchange-newline"><span><img height=3D"125" =
width=3D"440" id=3D"748035e3-66e4-4a29-b475-6901fae55a7b" =
apple-width=3D"yes" apple-height=3D"yes" =
src=3D"cid:5DFA5CA6-9B85-42AF-9A41-85A4BA0A383C"></span>
</a></div><a href=3D"http://www.hadoopsummit.org/">
</a><br></div></body></html>=
--Apple-Mail=_9B329B9D-DBF2-43B8-BA51-C445E633AAA9
Content-Transfer-Encoding: base64
Content-Disposition: inline;
filename=email-sig.jpg
Content-Type: image/jpeg;
name="email-sig.jpg"
Content-Id: <5DFA5CA6-9B85-42AF-9A41-85A4BA0A383C>
/9j/4QAYRXhpZgAASUkqAAgAAAAAAAAAAAAAAP/sABFEdWNreQABAAQAAAA8AAD/4QMtaHR0cDov
L25zLmFkb2JlLmNvbS94YXAvMS4wLwA8P3hwYWNrZXQgYmVnaW49Iu+7vyIgaWQ9Ilc1TTBNcENl
aGlIenJlU3pOVGN6a2M5ZCI/PiA8eDp4bXBtZXRhIHhtbG5zOng9ImFkb2JlOm5zOm1ldGEvIiB4
OnhtcHRrPSJBZG9iZSBYTVAgQ29yZSA1LjAtYzA2MSA2NC4xNDA5NDksIDIwMTAvMTIvMDctMTA6
NTc6MDEgICAgICAgICI+IDxyZGY6UkRGIHhtbG5zOnJkZj0iaHR0cDovL3d3dy53My5vcmcvMTk5
OS8wMi8yMi1yZGYtc3ludGF4LW5zIyI+IDxyZGY6RGVzY3JpcHRpb24gcmRmOmFib3V0PSIiIHht
bG5zOnhtcD0iaHR0cDovL25zLmFkb2JlLmNvbS94YXAvMS4wLyIgeG1sbnM6eG1wTU09Imh0dHA6
Ly9ucy5hZG9iZS5jb20veGFwLzEuMC9tbS8iIHhtbG5zOnN0UmVmPSJodHRwOi8vbnMuYWRvYmUu
Y29tL3hhcC8xLjAvc1R5cGUvUmVzb3VyY2VSZWYjIiB4bXA6Q3JlYXRvclRvb2w9IkFkb2JlIFBo
b3Rvc2hvcCBDUzUuMSBNYWNpbnRvc2giIHhtcE1NOkluc3RhbmNlSUQ9InhtcC5paWQ6NjhEOUY5
QjE0MTU0MTFFMUEzQUNEN0E5RjlCRDlDRUIiIHhtcE1NOkRvY3VtZW50SUQ9InhtcC5kaWQ6NjhE
OUY5QjI0MTU0MTFFMUEzQUNEN0E5RjlCRDlDRUIiPiA8eG1wTU06RGVyaXZlZEZyb20gc3RSZWY6
aW5zdGFuY2VJRD0ieG1wLmlpZDo2OEQ5RjlBRjQxNTQxMUUxQTNBQ0Q3QTlGOUJEOUNFQiIgc3RS
ZWY6ZG9jdW1lbnRJRD0ieG1wLmRpZDo2OEQ5RjlCMDQxNTQxMUUxQTNBQ0Q3QTlGOUJEOUNFQiIv
PiA8L3JkZjpEZXNjcmlwdGlvbj4gPC9yZGY6UkRGPiA8L3g6eG1wbWV0YT4gPD94cGFja2V0IGVu
ZD0iciI/Pv/uAA5BZG9iZQBkwAAAAAH/2wCEAAYEBAQFBAYFBQYJBgUGCQsIBgYICwwKCgsKCgwQ
DAwMDAwMEAwODxAPDgwTExQUExMcGxsbHB8fHx8fHx8fHx8BBwcHDQwNGBAQGBoVERUaHx8fHx8f
Hx8fHx8fHx8fHx8fHx8fHx8fHx8fHx8fHx8fHx8fHx8fHx8fHx8fHx8fH//AABEIAH0BuAMBEQAC
EQEDEQH/xAC2AAEAAgMBAQEAAAAAAAAAAAAABAYDBQcCAQgBAQADAQEBAQAAAAAAAAAAAAABAgME
BQYHEAABAwMCAgYGBgcECAQHAAABAgMEABEFEgYhEzFBUdEUB2EiMpJTFXGBQlKTVJGhsWKyIwjB
cjMWosJzsyR0NReCQzQ24eJjZEV1NxEAAgECBQMBBQYGAwEBAAAAAAECEQMhMVESBJETBUFhcYEi
MqGxwdFCFeHxciMUNPBSM/JD/9oADAMBAAIRAxEAPwDrxNz23+oED9iB+uoAuT13+0Sf4lejsFAL
kdZFuNzxtf7R/e7BQC5HaLfWQT+1Z/VQC56OP3QEn/RSe37xoBe/pvwsDYEDqHYkdZoBqv13vxue
AIHWexA6u2gN7t/AmURLlpJjXu22rpcP3lD7vYKkFj+UYn8kx+EjuoB8oxP5Jj8JHdQD5RifyTH4
SO6gHyjE/kmPwkd1APlGJ/JMfhI7qAfKMT+SY/CR3UA+UYn8kx+EjuoB8oxP5Jj8JHdQD5RifyTH
4SO6gHyjE/kmPwkd1APlGJ/JMfhI7qAfKMT+SY/CR3UA+UYn8kx+EjuoB8oxP5Jj8JHdQD5RifyT
H4SO6gHyjE/kmPwkd1APlGJ/JMfhI7qAfKMT+SY/CR3UA+UYn8kx+EjuoB8oxP5Jj8JHdQD5Rify
TH4SO6gHyjE/kmPwkd1APlGJ/JMfhI7qAfKMT+SY/CR3UA+UYn8kx+EjuoB8oxP5Jj8JHdQD5Rif
yTH4SO6gHyjE/kmPwkd1APlGJ/JMfhI7qAfKMT+SY/CR3UA+UYn8kx+EjuoB8oxP5Jj8JHdQD5Ri
fyTH4SO6gHyjE/kmPwkd1APlGJ/JMfhI7qAfKMT+SY/CR3UA+UYn8kx+EjuoB8oxP5Jj8JHdQD5R
ifyTH4SO6gPLmFxK0KT4NlNxbUhtKVD0ggXBoCn5bFP46RoVdTK7hlwdJH3R+9940BBvf034WHAE
DqHYkdZqAL367343PAEDrPYgdXbQC56b/vEq/iV/qpoBcjrItx48SCes9qj+qgFz6RbhYcSCeodq
j1mgPoJuB/4QB/Cn0feNAfD0nrvxJPC4H2lejsFAP1W4knqv9pXp7BQGeHClS3eVHbKlDiT1Iv1k
9Go/qoCwwdoNBIVMcJV1NtmwSD1aukntNSDcMYnGsABuM2LCwJSCbfSb0BJDbYFgkAdFrDooDw7D
iOizjKF/3kg/toDKAAAALAcABQCgFAKAUAoBQCgFAKAUAoBQCgFAKAUAoBQCgFAKAUAoBQCgFAKA
UAoBQCgFAKAUAoBQCgFAKAUBgmwmJkZcd8XQr9IPaKAomQgPwZKmHhfrSo8EqSOg+hI7KgEb03/e
JV/EofwpoB0eixvx4kE9Z7VHs6qAdHotw4cSCeodqj1mgHZYfugJ/hT6PvKoAONuu/1AgfsQP10A
PSerjck9X7yvT2CgNhh8O/kHuF22Gz/Mc6SCeodqz+qgLrEhx4jCWY6AhtPUOkntJ6zUgS5sSG0X
ZLqWmx1qPT9HbWV69C2qydEaW7UpukVVlbm78jIJTDjqe7HFnQn9HE14t7zsVhCNffgena8TJ/U6
Gtc3zl1H1W2UDssT+01xS85eeSijqXirWrPTW+8ok/zGWnB18FJP7amHnLqzUWRLxVt5Noy5DzKZ
iQQ4iA47MW4hpqOFDSorNvbtw/RXqcTy9u46SW37jz+R46dtVXzfeesn5l47DtMRZyPG7ikjWzhM
VeW7pPs3UAkDh0qVYdlevCklVPDU86VYujzIaNw+b87+bD2xBx7BPqoyEsqdt6Usiw/TVqIirPf/
AHA3Hg1oO9MCYEBRAVmIDhlRWyfjJ0pcbT+9Yim3QbtS8RZUaVHbkxnUvR3khbTrZCkqSeggjgaq
WMlAKAUAoBQCgFAKAUAoBQCgFAKAUAoBQCgFAKAUAoBQCgFAKAUAoBQCgFAKAUAoBQCgFAQcvi2s
hFLZsHk+sys8bK9PooCiOtuMurbcBQ42bLB4kHtPao9VQDz0eixtYcSCeodqj1nqoB6B/dAT/Cn/
AFlUB86ew3H0AgfsQP10B9HT234knhcD7SuxPYKAk4+C7NmIjt+rxutfToHWT2qoC+xYrEVhDDCd
LaBYD+0+mpBr8/n2MUwOAclOD+U1/rK9Fefz+fGxHWTyR2cTiO89Io59Ony5z5elOFxZ6OxI7Ejq
r5C/fndlum6s+jtWY21SKoR6xNBQCgNG3kMxuF+RB2jj1zn45LassvSiGy4eCrLV7agOpNe/wvCz
lSVx7Yv9Pq1+B4/K8pFVjbxlr6HVNj7S2/t2AWYGh7IrAVkpylJckOuniS4sXNr9CegV9MkkqJUS
PEzdXmWagPLjbbram3EhbawUrQoAgg8CCDQFAd2zuDZkxU7Z7ZnYF1ZcnbZUoAt34qcgqV7JPwzw
PVVq1zKUpkW/C7hxOZxKcpBfCohCuYV+oppSPbQ6k8UKQfaB6Khosmazb3mNs3cORcx2JyKH5baS
tLZStHMQk2K2isJC0g9aaOLQUkza5jcOCwrbbmWyEeA26rS0qQ4lsKV2DUReiQbJD+Sx0eF45+U0
1C0hfiVrSlvSeg6ydNjUEnjH5fFZKOZOPmMy46eCnWXEuJFu0pJtSgqY42ewkmC9Pjz470KPqD8l
DiVNo08Valg2FqmhFT7iM7hczHVIxM5iewhWhbkdxLiQrsJSTRoJk6oJFAKAUAoBQCgFAKAUAoBQ
CgFAKAUAoBQCgFAKAUAoBQCgFAKAUAoBQCgNBufEc5vxrCTzmh/MSnpKe0fvf2UBU+y30AJ/hSf4
lVAHT2G4t2AgfsQP10A/XfiSeFwOs9iewUAHTx7QST/Er09goC3bRg8qAJS+LkgcPQgd54mpBtp0
xqHEdkumyGklR9PYPrrK/eVuDk8kaWrbnJRXqcwnzX50tyS+buOHo6gOpI+ivhb96V2bnLNn1dq0
rcVFehEceZabU444lDaPbWpQCRbtJrNRbdEsS7kkqsxyZ8GNCVOkPobhoTrU+o+ppPQb+nqq0LUp
S2JVloVlcjGO5v5TFhcfvTdCBIw0RGLxK+LeUyKVFbifvMxxY27CoivouP4GKxuvHRfmeLe8s3hb
WGr/ACEjyxl5XOow/wDmWbORHIVnnWwhiM22oXTHSlFzzXOm2r1U8T1V69rg2LeMYKvU865ybs8H
Jlnz205GVQjaeBWrD7dxgjpmoinlKe5qrrbCxxshoXPapQv0V1J+pztehc8LgcNg4aYWKitxGAPZ
QPWUR9pSj6yj6SahsslQzzYKZamQ4tQZaXzFNJJAWpPs6iPsg8bddQSVP/u9spW7UbZalhySVLQ7
LulMZDiRfllxRGpRPD1eurbXSpXcq0LZkVy0wHlQltIlBBLK3wVNhXVqCSkkfQaqWOGbfwe9M/nN
z89xDbb7rLWZxePdQw1K1JVpcW7dzk60os5oBWeitW0jJJstm7tsHA7dxO4TyhldvTGHgqMjlstx
HFpZditJ6eSltXXxJGo8TVUyzVDa+Y0rbGLXHy8mI1kdxSmVY3CQ3lAoWXjdRKVnQlA6XFn7PCoi
TKhWEYbH4ebsXE7hkszNuR4sgIeWQqErJlWpCVk+pZKVKDWrsq1cytMjdxUYYebMZO2g0WF497/M
aYekx73T4bmhHqcy+r02qPTEn1wMO3sVtyRht6xcylDODazUh2SgHlNhtkNrsdNvVuno66P0C9SV
5ZpjZPM5jdcVtmDDyiGWcfjmigLMaOVBMl5tHsqcKvVFuCaiWgjqdDqpcUAoBQCgFAKAUAoBQCgF
AKAUAoBQCgFAKAUAoBQCgFAKAUAoBQCgFAKAEAix6KApG4MV4KYS2n/h37lA6ALcSj0JHTQGr6eP
TfiSeFwOs9iR1CoAJ9NvtG/6lK9PYKADgeyx+kgn9qz+qgOgYcAYmFbh/Ib/AIBUgr+/JhTHjw0n
/FUXFj0I6P1mvA87epGMNceh6/ibdZOWhQMw1Mdxj6IbimpJA5a09N7jhXgceUVNOSrE9e+pODUc
yt53E453a+fElWtzHGLj8Q04uyTKlWW7IXf2lkXsT0C9fV+KUVbd5/VKvwSySPnfIVc+0slTq/Vm
78tdunekuNkMqkOYHApbZbjHi3JnoSNa1DoUhrhbqvW3C4cbLlL9U2/hH0X5mfJ5Lu0j+mK6s6X5
hbjlYLBNIxoT82ychrHYsKtpS8+dIWR2Npuq3oruiqnLJ0Ntt3AxcHiWcfHKnCi65EhfFx55fFx1
w9alq4mjZKVDYIabbKyhISVq1LIFrqta5/RUEmhy812NvDANarMTGprCx1awlt1H+7NSsiHmb9aE
rQpChdKgQoeg8KgkqkPyw2fGyoyHy9hfJJMGPykhpgq4rUE/aUpXG6ujoFqtuZXajfZbFonxuVqK
FpCuUQbJSpQ0hduglF7pv11UlohYPbsXFZOc7DZRHivNRmW2m0hI/khd1G3STzOk1LYSNZ5uFA8t
dxarW8Gu1+3hb9dTHMiWRU/NbNYHB4TAZLJ7eiZ2TLbEcLlgFSEpaDhsSlXSamKqVkyR5T7uxO88
ZkMIvb8SBiselvlwkAOMkOlZPqFISLFN6SVCYupUGPPlnBS5GLxm2IkSO1IW0QwvlhRSso1EJQON
W2VK76HZcjidsDBTnchAjnHPhU/ItLQkoWtKQtTjgPBR9XpNZ1NKI4RiPPHEYV95/C7OgwVvjStx
lXLUtAN0hWlFauHtMlP2HetnblY3LtqBm2U8tMxvUtoG+hYOlaL+hQrJqjNU6o5Tnv6ip+LzmQxq
cK06mFIcYDheUCoNqte2nrq6gUdw9Y3+pqAt5KMlg3WWjbW8w8l0j06FJRf3qdsdw67gdwYjPYtn
KYqQmTCeHquJ4EEdKVA8UqHWDVGqF06nMN5/1D4nFTXYGBiDKOskocmLXojhQ4EIsCpdu3gPpq6g
UczS4X+pmR4lKc3h0CMogKdhrUVoHboc9r9IqXbIVw7Vis7icriGsvBkodxzyC6mReyQke1qv7Om
3G/RWbRomcl3V/UhAiS3Iu3IAyCGyU+OfUUNLI+4hI1FPpJFXVso7hF29/UshcpLW4MUliOs2VKi
KUvQO1TauJH0H6qO2FcLz5h+ZrW2dtY7O41lvKRsi8ltlQcKUFCm1OBYIB+5VYxqWlKhzxP9Tk7U
NWBaKesB9QP8FX7ZTuF48v8AzrwW7cgMW7GXjMotJUwy4oONu6RdQQ4An1gONiKrKFC0Z1Oi1QuK
AUAoBQGp3fPlY/aebnw18qXEgSn47lgrS40ypaFWUCk2UOgipRDNBsjfacixt7E5DmvZzJYVrLvS
ghtLKgSELvpKbKKzewRajQTI6/OfbCcLjct4PILYysl6FEZbZQ48XmCQQUIcVfWRZOm5+im0jcfY
/nNtR3DyJ6o89mXHlCArCORiMgqUsEoaSylSgVKCT9rq42NNo3G42lvzFblelxWYszG5KDoVKxuS
YMaShDnFC9F1eqr6aNEpmj3xufd+L3fteBG8PGw2TyKI7rqF82Q+jQCpC23GQlpNyeKHFE8OjoqU
iGzRebm6t77YeeyqNwxcVAOhGExCIni3Jq0W53iHloAY9q40q9nsNEhJtHU4ciS/i2JBS2ZTrCHC
hK7tFxSAbBxOv1b/AGhfh21UsUrZG6N1ZHf27cRnFMNM4lMMxYcU8xprntlaiHlNsuOFQtfUkC/Q
Ks1gVTxNLhfMbcWb81ocSM6Gtny25aILfLReSYaSFSdZTzAlTtwmygLJ6KUwFcTrNVLCgFAKAUBE
ykBE6EthVtR4tqPQFDoNAUFxC2nFtuDSttXrhXEhQ4XV6fuioB56O0WP0kE/tWf1UAHAjqsdIA6v
3U+ntNAdAxH/AEmF/sGv4BUgp2+Vk5htJ6Espt9ajXyfnH/eX9J9D4pf2n7yu14x6RpsvAlN+LnR
PCuodbS5Mgz44ksOLi3Wy4lOpGlxNyL9le34zyjspW2qpvDHKp5fP4CuPenR060Om+VsdTexMS+4
E+InNGdJUlISFOSlF1RsOA9qvrJZnz0ciRvjbLmdxsZUUpTk8VKayGNK/YLzBvoX+6tJKSeq96hO
hLVTJt7dLG4FKVBSptuIS3kUOJIW1JHBUc3+0jpUR6O2jVAnU31QSVbeST842otH+IMra3WUGK9r
/VVkVZaaqWMapDCHkMKWA84CUN9ZCek/RQGSgFAc981pAy6sXsaIdc3NyG3JqU8eVAYWFvOL7ArT
pFWjqUloVb+ppCUYTb6EiyUyXQB6AzVrZFw5Hs7zB3Fs9UpWGUykzNAe5zfM/wAO+m3EW9o1o41M
1Kho1yHJM8yXbc19/muW4DUteo2H0mpIP0j567k+V+XrePaXpk5gojgDp5KQFun9Fk/XWMFibTeB
+eo+Alv7am51APhYMliK4bcLvJUb/wDhsn3q1riZUwO0f007j1w8ntx1XrMKE2Kk/cc9V0D6F2P1
1ncRpbZx7fH/ALzz3/PyP4zWkcjN5l780fLHb+39oYncGKU4y5J5DcqM4srSpTrWvUi/EEEdFVjK
rLSjRGi2DubKYva28okV1SW3YCHUWPBDinUsqWOwlC7VMliiIvBmq8utrxdzbwx+ElOqZiv61vKQ
QFlDSCopQT1qtUydERFVZbfOryzwWzxjJeGW4hiapbLsZ1fMIUhOoLSo8bEcDVYSqWnGhpsBubJw
/Kzc+LacUI7smGhNj7AkqUl4D++GxepaxITwMPlRszH7t3YjG5B1TcJplb7qGzpW4EEAISerp40k
6IRVWbLzm8vsRs/MQk4lxfg57SliO4rWptTZANlHjpVq4XqISqTONDWOZKTI8o2oLpKmoGdAj3+y
h2ItZT9Gq5qfUj0IG1cltGFFyyNwYxzIvSGAjGFshPKdGq6yrUCnpHQDUtMhUJHlXHlP+YeARHBU
4iUlxZT1IQklaj6NNRLImOZ+wawNxQCgFAKA55vfaHmLkMpkl7fysQ4jNQfATcfklSChjUkoW7FQ
1qQFqQesdPbVk0VaZGleXG7cVkNvT9p5CF4jFYlOFlHJId0qaSQrnNpav6+q50kgdHE0qKEXb/lP
uHG4/aUV+VEdXgMpJnzFpU5/MbeJKeXdsevx4g2Hpo2FEwZ7yazWSyWbyjcmB4qRk2sli2JSFSI7
iUNKaWzLbUiwCtXSnVTcHEtHl7szLYR6dPyzOIiy5YQ23CwcNuNHbbRxuXShL7hWeNlGw6qhslIk
702lkc5m9rzojjKGcJP8ZLS6pQUpvSBZvSlQKvpIomGjQbx2J5h5KZmomKzER3bu4UIRJjZPnuuQ
7DSvwaU6mxq9rjbj9F6lNENM3uM8q9lQcpAzIhF3NY9lhhqep58EiOwmOhRbC+VfloA9moqTtRHg
bDnJ3dvPJzH0Jxu548aOx4dahIbDUcsuKVqRoSeN02KqVFCvYzyQdw+8cDksdnZ7uHxLawpmVKKn
km90MspQylsML/8AMTcXqdxG06vVSwoBQCgFAKAqu7Mdy3UTmxZKzpdt1K6lAdp6KAr30dXAAdX7
qfT2moAHSLcb8ABwuB1J/d7TQHQMR/0mF/sGv4BUgqO/GSnJMPdTjWn60q/+avlvOwpdi9Ynv+Jl
8jWjK1XhnqEDcEluLgshIcOlKI7nH0lJSP210cS253YxXrJGPJmo25N6Mv8A5Sz0TfLrBLHtMxkx
3UnpSti7ZB92vv55nyEMi3VUsc+2nl4W0hkcRuZ/wMt3ISpbE18EMSm5C+YlaHfZ1AeqpJNxarNV
KJ0zNo5vaTl1GNs+L8yWeC8q+FNY9r067anlfutj6SKU1JroS8btfIjJxspm8qvJS4iXBHZS0hiO
2t0BK1oQm6idPqjUo9JqKk0M279wSdvYd7MiMmVChp1zGtfLdCLgamyQUqI+6bX7aJVDdCi+ZG+Y
+W8sF53asl0POyGGucxdEhghetSFgeski3EdFWiscSsnhgaXZW9/ON0Y6JJjxpsjI85URqelUZ7k
R0gqfcUgcEFSghJKOJqWkQmy9qlebsxJZbg4nFFXAynHnZJT6UtJSgK+tQquBbE2G09kRcE/JyMm
S5lM/Pt4/KyLBawOhDaR6rbaepIqG6kpUOdf1Of9HwP/ADT3+6q9spcK/wD09bcwWZezYy0BmaGU
xyzz0BenUXL2v22qZsiCOW5JpDeflNNo0NomLShAHAJDxAA+irooXbzy3GcpvEQG1ao2HYRGTbo5
qgFun9JCfqqsFgWm8SDi/LPzLnbZE6DHUcHLR4rk+JQgOJSLhZZKuKvV4cL1O5VIUXQheV+4/kG+
MVkFKKYzjnh5R6uU/wCoSf7pIV9VJKqEXRkHfAP+dM8P/v5H8ZqY5EPM9ZDPby3UqJCkvScn4ZIb
hxGkEpSAAkWQ2Omw6TSiQq2dq8uPJh6Ls/MM54cjI59jkFoEKMdpPrN6rcCvX6xH1VnKeJpGGBxT
M4Pc+y88luUl2BPiL1xZjdwlWk8HGl9BB/8Aga0TTM2mjxl9xbp3bkGPmEl7KzQOVGZQm5F+pDbY
tc9fCiSQbbO3bT8ln0+WWTxWTIj5rNaH7e0GFs8Y6FW7CTqt2+is3PE0UMDiLzG6tmZ4FwPYnLxC
dDg4XB4EpV7K0K/Qa0wZnij5NyO6t45pC5C38vlXrNtIQnUQOpKUpGlKaYIYs6Dv7ZLu0PKXDwZR
CsjKynip+niEuKjuAIBHToSAL1SLqy0lRELyR2Ntzdk7LM5thb6IjTK2Ala27FalhXskX9kVM5UE
FU75tby+2jtdS14bHoYfcGlchRU46U/d1rJNvQKycmzVRSLFUEigFAKAUBzrfu5NxYzNSEGXNw+F
agpdh5OLBE2MqWVKCkzVBmSttsWQkBABN76qskVbIuZ86W8O/AYfiw5vPYguvPxpou54zSFrjMBt
xZbRqv8AzlNki1qbRuJOP83JUnLxozuFS1j5OakYFEtMvW4H2BcOFnkpGhXD7fD09ag3G38zd0uY
fZ+cfxM9pnOQI6H0NgtOOtpW6lAWppYV6quIBUm1QkS2QH/NByOZcn5aHsHipkbG5PJ8/S6mQ+Gw
pTccNkLQ2p5AUeYk8eANKEVI8Tznxz03KNuxG24uKTMW+kSU+NQIV+LkNxDRs7pOktrXbhq03qdo
3G12T5jRdzZCRj+XGblMxmZiPBTETmy08SkpWtCW+W62oWWix6RYkVDRKZcagkUAoBQCgFAKAUAo
DDNityorkdfsuJIuOkHqNAc8eZcZdWy4my0EoUkcOj7KexPaagHkcT23+oED9iB+ugL/AIVYViYd
vssoSfpSkA/sqQazeeOVKxXObF3Ip12/dPBXfXkeZ4++1uWccfzPR8be2XKPKRQK+RPojXQ4MHOb
8g7fzS9OJLBmx4o4CY+0r/CdV91A9bSOmvp/BWIbXc/WnT3fzPC8tdluUP0Z+8vsBX+Wt5v41z1c
TuRapWOV0JbnISOex6OYhIcT6dVfQZo8fJlyqpYwlyI8tyOooWtu3MbVY2uLi4NAeJE6FEUw04tK
FPuJZZQOkqVewAH0UBJoCpeYENGbagbVJVy8u9qnaDZQhxxzHTcdGpWhH11aOGJWWOBTNhbGRk8C
mVDyUjDZmC6/i8o5HDa2pXhHVIQt5l0KQpem1ldNElHBZDGWLzOgbZ2ZBwb8icqQ/kcvLCUSslLU
FuqQj2W0AAJbbT1JSLVDdSUqFgqCRQFF8z/Mfb+0WYrc6F8znSdS40SybBKeBWpSwdIvw6ONWjGp
WUqGh235yRJOJzk4bacgOYeMmU+lJQhLgKrIRq0pIUb3FxUuJCmeYnm5gpWysjuv/LiEpgzG4iox
U0VLU4Eq169HC2um3GhG7Cp8yPm/t+Ps/Gbmc28hxeWkPMiKS1rHJvqWVlHHjb9NNmNBuwqSZXnl
hYeyMZn2sapRnvuRU4xLiElos313VptYer1ddNmJO/Azt+Y+2leXCt6/JGglDvI8BZrVzOYGwNem
3XfoptxoNypUg47zh2tkNp5jcbuDQ09i3Wm1Q1cpS3VP+wQvTwub9I6qbHUblQlbZ84MVkNp57Ox
sN4T5EErXDStF3QsXBCkpAH6KOGIUsCCn+oSIdtLznyR0JRNTC5HPRclbRc16tPotap2YkbyPh/P
fDbozeOwErbmpvIyEsBT7jbyElV/WKFI49FHCgU6nV4GCwmOUVwMfGiLVwUphpDZI9JSAazqXoTq
EkadjMbkGw3PiMy2x0IfbS4B9AUDQUPGPw2IxwIx8FiJq9rkNIbv9OkC9KihIfjRpCQl9pDyQbhL
iQoA9vGgPLEOHHJMdhtkq9otoSm9u2wFAZqAUAoBQCgFAV7L7Khz8o/k2J8vGS5ccQ5y4ZZAfYSS
UpWHmnrFOogLRpUO2pqRQ0U3yW2tITIajypuPiykQkPRYy2eWTjgEx13dadXdKRYjVpPSRfjTcRt
J0fyu2+w7HcRIllUbMO55u627GS8LKQf5f8Ah9g6f3qVJoZtz+XGE3FPcmS35LBkR0Q57MdTaW5M
dt4Pobd1trVwWOlBSq3C9qJho+TPLbByshIkKflNwpklmdNxDamxDekR9PLcWktlwewnUlKwlVhc
UqKGBzyr27Iya5+Rfl5IlEpptmWttYbRNQW3Uh4NpkrGhRSgOOq0j2bcKVG03OA20MOpajk5+QKm
22WkzHUqQ000LJS220hpu/aspKz1qNKhI3NQSKAUAoBQCgFAKAUAoCp7tg8uSiWkeo8NLnZqT0aj
1JtQGgHTx/vEq/iV6PuioBZtpZBI5kBZsQStofT7Sb9auupBZVJCgUqFwRYg9lQ1UJnOdyYJeMll
bYJhum7Svun7h/sr43yXBdidV9Dy/I+m4XKV2NH9S/5Uq+ZwzWSbZUHVxJ0RYegzmTZ1l0dCk/2i
seFzZ8ee6OK9VqacrixvRo/gzFGym+s7vTbW3czKiSmokgZQyo7SmniiKCLrBOkaiq3CvsOFzY8i
LlFNUwPmuVxZWZKLadTuddJkfnvcjMPdW5t0ZpxjxTMM+BxY1KSFKioOtQ0kXu4a8jyfOlauQhGW
2v1fE9Dg8SNyE5yVaZFz8nfL3abO2sPuQNeMzD7Yk+McWolpxQKVIbSDpSE3Ka9qcsaHmQjhUvm5
N04LbePVPy8pMdniG09LjivuNoHFSvoqqRZuhSNseZexpDj+4crmosbITgG2YTi7LixkElDJH31H
11+n6Ks4sqpIm+UElqXE3HNjXVBl5uW9DdsQlxtQR66CQLpJHTUSJiX+qlhQCgOFf1AnZ8rP42Jk
Jj8LKNRVq8Q02H2UtqX6iHW9SVgkhRBTWkKmc6FR2Jld4ZrAbsw4efyUAYpxSQ5dxSXG1AtpSs3V
6ydVkXq0kisalfg7rgR/LfKbZU24Z07IMy0OWHLS02lAVc3vqujotU0xqVrgSc4mUrbuycE8gtrW
h6QGzwUBNk6UG37yEAii9SX6GBG1co7uHKbYU4os4IT5JT1AMIKtQ/2mlFK+op6H1G4wnyocwesB
SswH9Ha3yNav9O1KYiuB5d2rlo+dxu2W3FaM+iBIA6lc5JUFEf8A09a6V9SKehstoveCxfmDhlK/
/HOEJP3osgNn9S6P0JXqW7yXiRJPl1vDxDLb4aDjjfMSlelYiqspNwbH01WeaLQyZ6/pmiQ35OZd
eYbddYEdTLi0pUpCvX4oJF0n6KXBbP0BWRqKAUAoBQCgFAKAUAoBQCgOa5OFjMz5sTcbudtqTi4u
HQ/iokuxYutwiS+lKvV5ibW19KRVvQr6mua3FKDTeM29uGSxhMbgHMrBycptpb8xSHltpS4ZLI/l
NBsD1UpUQQdXQSoKleyXmZv9yFuLNM5FWPTh42BktYoR46myrJttl9C1ONqd03USPWv6amiIqyxS
N6b0j7qmbbTJU/KxkqZk3lhlkl3EtRUvRmDZAA1vOhsqSArh01FCas0WS8xvMKHs6ZlEy1hx/Exs
ixJf+V62nnZjLSvDR2FuuKjKQ6pOp9GpKhxNzYTREVZ83Rkdyzcjk8Dkc09Jaw2ewAiSQzFbc/40
cxVwlnSeWoXRw/vahRBm4xO484vcDuCjy0YxrJbnysZ/Jx48VDoREjNONtjU0WlOvKVxccQpRtUU
JqaxHmDvrIupZayyoSY2IyssyWY8ZQlO459xtp8B1pwBKwgagnh02t1TQirLJuzcOdmeRrGZQ6pu
bNhwl5GSzdCktPKbEladPs+qo3t0C9QliS3gYd0P7c2W3Lk7PX4XLOQYoVjoiEGH4d6W2wmc4ClL
ReSHCEKW6NX2ri5osQ8CC/u7fYzWNwask9DRIzIhLlODFPT/AA64/MLb7cbxLDTiF30nSLixKeml
CKs0+L3FuPJZva+ZnznJeQx7e4W0pbaYQHvAhJAKUt8C8LIXp6gNOk3JmgqSpPmH5gRdqSsn4pRW
/iY+SYfkfK9bbzkpps+HYjuOuKjLQ6pOp5GpJHE3NgohVnYsFFy0XFMMZecnJZFOovzENJYSoqWV
JCW0kgBCSE9PG1zxqhdE+gFAKAhZmF4zHOsgArA1t34+sniKAoI6ePCxub8SCes9qj1CoB7adcZe
Q60dLjavUKe0fZT/AKxoC+YnJN5CGl9Isoeq4nqCh027RUgzyYrEphbD6A40sWUk1ndtRnFxkqpl
4TcXVYMpGZ2dMiqU7BBkR+nR/wCYn6vtV8vzPDzt42/mj9v8T3eN5KM8J/K/sKXl8EqXKYmR5T+M
y8K4jTWDZxGrpSpJ9pJ7DXNwvIXOM2kqp5pm/K4cL6TrRrJomNbl812WVMnLY2SLaUvuxVpcHVf+
WoJvXsrz9v1hLqjzH4i56SXQj4LFpxWLYhJXzFt3U67a2txaipavrJr5/l8h3rrm/U9jjWVatqK9
D1hZ28NrTnUbZhJzOJmrLruGUvlrZeVxU4ws3ASrpKT119B4zyilFW7ldyydK1954/O4Di3OFNr9
Mix7d8vcplM+vdu9ihzJL4QMShXMZhtDoQD0FX3iK9S7bd3B4Q0/7e/2ew4Lc9mK+vXT3fmXxzEY
l1YW5CYWtPsqU0gkfQSK6FgZEpCEISEoSEpHAJAsBQH2gFAKA12X23t/MpSMrjo83R7Cnm0rUn6F
EXFSmQ0ZcVhsTiY3hsZDZhMXuW2EJQCe06RxPpNQ2Ska97Y2zXpxnO4WEuWVa1OqYQSVfeItYn01
NWRREmZtfbk2aidLxkZ+Y1pDchxpClp0cU2URcaeqlRQyDAYQTZM4QGBMmILUqRy08x1sgApWq11
Dh0GlRQ1/wD2/wBjWt8ggW7PDt91NzG1GwO38GqXGmGBHMuEgNxHy2nW0gCwShVrpAHZSooRk7N2
ml2Q6MPDDksLTJWGUXcS4dSws29bUeJvSrFESIG3cDj4z8WDj48WNJuJDLTaUIcuNJ1ACx4cKVFB
itvYLEcw4vHx4JdtzfDtpb1aei+kC9qNhI2FQSKAUAoBQCgFAKAUAoBQCgIOUwWDyyWk5XHRsglk
lTKZTLbwQo9JTzAqx+igoecht7AZJDCMjjIkxEX/ANMmQw26GugfywtJ09A6KVFBJ27t+UZZk4yI
+Z/K8dzGG18/kf4XN1JOvl29XV0dVKihITjsemevIpispyDjYZcmBtIeU2DcILltRSDxte1AQk7T
2qmPKjJw0ER5yguayIzIQ+pKtYLqdNlkK4+t11NSKGSTtrbsrxXisVDf8eWzO5sdpfPLIs0XdSTr
5Y9nV0dVRUmh8e2ztx+I9DfxUN2JIeMmRHXHaU24+bAurQU6VL4D1jxpUUPZ2/gSUE42KS2wqG2e
Q36sZftMD1eDZ60dFKihJZgwmIaYLMdpqEhHKRFQhKWg3bToCANITbha1ARIW29uwIr8SDi4cSLK
/wDUx2GGm23bi38xCUhKuHDjSoofI+2duRm4zUbFQ2GobheiIbjtISy6rgXGwlICFHrI40qKH1G2
tuILBRioaTFdVIilMdocp5w3W43ZPqrURxUOJpUUPCNqbXbYlR0YeChicQqa0mMyEPKCtQLqQmyz
q4+t10qRQ2lCRQCgFAKAoWaieEyjzYFkFWtu3UF8bJ7VX/RQEAlN+kG/CwNgbdQ7Ejr7ap3I6rqi
2yWj6F3wRixcYyhT7etY1r9ZPSrj+yo7sNV1J7ctGbDxkT47fvJ76d6Gq6jty0Y8ZE+O37ye+neh
quo7ctGRZbGElj/iQw6fvKKb/p6awu27Fz6tr6GtuV2H07ka1zbO11quCEehLth+2uKXjOI//o6l
zuQv5Hpnbm1mzeyHP77t/wC2ph47iLR/EiXN5D/kbSOcVGRojllpPYgpH7K77fagqR2rock+5J1l
VmbxkT47fvJ76070NV1KduWjHjInx2/eT3070NV1Hblox4yJ8dv3k99O9DVdR25aMeMifHb95PfT
vQ1XUduWjHjInx2/eT3070NV1Hblox4yJ8dv3k99O9DVdR25aMeMifHb95PfTvQ1XUduWjHjInx2
/eT3070NV1Hblox4yJ8dv3k99O9DVdR25aMeMifHb95PfTvQ1XUduWjHjInx2/eT3070NV1Hblox
4yJ8dv3k99O9DVdR25aMeMifHb95PfTvQ1XUduWjHjInx2/eT3070NV1Hblox4yJ8dv3k99O9DVd
R25aMeMifHb95PfTvQ1XUduWjHjInx2/eT3070NV1Hblox4yJ8dv3k99O9DVdR25aMeMifHb95Pf
TvQ1XUduWjHjInx2/eT3070NV1Hblox4yJ8dv3k99O9DVdR25aMeMifHb95PfTvQ1XUduWjHjInx
2/eT3070NV1Hblox4yJ8dv3k99O9DVdR25aMeMifHb95PfTvQ1XUduWjHjInx2/eT3070NV1Hblo
x4yJ8dv3k99O9DVdR25aMeMifHb95PfTvQ1XUduWjHjInx2/eT3070NV1Hblox4yJ8dv3k99O9DV
dR25aMeMifHb95PfTvQ1XUduWjHjInx2/eT3070NV1Hblox4yJ8dv3k99O9DVdR25aMeMifHb95P
fTvQ1XUduWjHjInx2/eT3070NV1Hblox4yJ8dv3k99O9DVdR25aMeMifHb95PfTvQ1XUduWjHjIn
x2/eT3070NV1Hblox4yJ8dv3k99O9DVdR25aMeMifHb95PfTvQ1XUduWjHjInx2/eT3070NV1Hbl
ox4yJ8dv3k99O9DVdR25aMeMifHb95PfTvQ1XUduWjHjInx2/eT3070NV1Hblox4yJ8dv3k99O9D
VdR25aMeMifHb95PfTvQ1XUduWjK5u1Mdzw8ltxClAltWlQKrHiLceHpNO7DVdR25aMpJ6TX580f
YVPlh2UoTUWHZSgqLDspQVFh2UoKiw7KUFRYdlKCosOylBUWHZSgqLDspQVFh2UoKiw7KUFRYdlK
CosOylBUWHZSgqLDspQVFh2UoKiw7KUFRYdlKCosOylBUWHZSgqLDspQVFh2UoKiw7KUFRYdlKCo
sOylBUWHZSgqLDspQVFh2UoKiw7KUFRYdlKCosOylBUWHZSgqLDspQVFh2UoKiw7KUFRYdlKCosO
ylBUWHZSgqLDspQVFh2UoKiw7KUFRYdlKCosOylBUWHZSgqLDspQVFh2UoKiw7KUFRYdlKCosOyl
BUWHZSgqLDspQVFh2UoKiw7KUFT6ALiiRFT6ek1LB8qAU/Nf/wBK29/y8r+BVetx/wDTuf1R+886
9/sw9zPnmxb/ACg5cXHPZuB0n1qnwv8AsfBjyv8A4/FETa2N2mnNMOQds5PGymwtTcuW28hpPqkE
EqdWm5BsOFa8y9f7bUrtucX6Rar9xnxbdnenG3OL1dafeVvd2YD+6ZuaZltoXt96OzEiqcSFvaVn
naUXubKJBt1V6HBsbbEbbT/uqTbplocXLvVuuaf/AJtUWuptfMJzGzc5tp1+K9kYEhp1zw0YKU64
hSUqToCVJPYeBrl8WpwtXUmoSTWLyR0c9xlcttpyi08FmRtuoiIzWeaxUeRisc1jVl7FzCoOl1Se
DmhalkWHXfr9Nacpydu27jU5uf1RyppUpx0t81BOMdn0vM12HnysfsqZipirxcpCdl4tfUFoUUvM
/T6uuui/ajPkxnH6oSSl+D/Axs3HCw4SylFuP4r8TpeL/wDZkT/9c3/uBXzt7/Yf9b+89q1/4r+n
8DmW1Z7mO2nloybhzJQ0OxEg8Stx9cJVvr019HzbSuX4P/pKj6Kf5nicW5ssyX/aOHVxM+LclRNs
tYSI+uOnIZ5UF6Sg2WGrISbHqJql5RledySrttbqe3Etabja2J03XNtfZgb7P7fgbQONyuBLkZwy
mY0tnmLWiQ25e+tKiePDqri43Klyt1u7R/K2sMjrv8ePH2zt4YpP2mkfj4F7eG4zlsLNy4Q82WjC
Q4vleqrVzNDjdtXC1+w11xldXHtducYYP6qY+6qZzSjbd65vhKePp6fajA9rX5YRlPLVIiryifDs
BRWtDABAZvw48D+mtI4c10wfbxft1KP/AFVXFb/s0LVtPHbVRmm3YG2snjJTaFqRLmIeQ0LjSRdb
q03IV2V5nNu33bandhOOkaV+5HfxbdrfWNucXq6/mW7GSsjIbeVOheBWh5SGUc1L3MaAGly6badV
z6p415V6EItbZbsNKUeh6FqUmnuW3HWvxKhlt9ZqCczFQwwvIQpbTMJspXZbLyFOpKhruVBDZ6CK
9Wx423PZKr2Si2/esNNWedd50471RboyVPc8dTzkN+Zst5KVi2YzkTHRIkhZcStRUuSErKdSVpFk
oUT0VNrxtusYzct05SXp+n4ai5zp0k4JUjGL6/E9yvMWQ1kMqlLLRx8aIt3HvEK1OSG22lltRCrW
/nDoFRDxScIYve5Ul7FV4/YTLyDUpYLao4e/D8zy7vjPw/EszmI6ZXy1idCQlDiQXXlIaLarrN7O
LtwtUx8danRxctu9xeWSq65aEPm3I1Ukq7E18cNdSbgt4ZLK5PFQwyykPQ3JOUslRLa0OKZ0o9b1
f5iftXrHk8GFqE5VeEko+3Cv3GljlyuSjGixjWX3feRNxuZVHmHjhimmnJq8e4lsyFKS0n11EqXo
BUQLdArTiKD4kt7e3essynIc/wDIjspu2+uR7jb2zb+3npIjw2slGnKgSXH3gzEbKQCXSVqSoj1r
aQb1E/H243VGsnBx3KirJ+zAmPNm7bdI7lLa6ui95ii+Y0pOIyr0pliRNxymEMqiFYYeMq/LKeYN
QAtx7avPxUe5BRbUZ1zzW3PIrHyD2SbSco0yydciO5NzzG9sS/uFqO2tiHLdC4ZWUFAbKlApXx1J
t22q6t2nxpq05Yyivm9/sKOdxX4u4lhGWRI/zrulrHM7hlwYiNvPrSC2hbhlttLVoDiif5Z+gCqf
t9hzdqMpd1e7a3pqX/zLqirjUe2+pNlbk3TMyWRY2/EiLi4lXLkLlqc1uuAalJaCCAm3R61Yw4li
EIu65Vnltpgvaay5F2UpK2o0hr6+4jje2ayK8MjCRo5Xlo7zqhKKwlpxlWlV1INykKSfs3Poq/7f
btqbuOXySWXrUp/mzns2JfOnn6UPD2/stEw09UuGynLY+UiG+UlZjJ5tyl42uvRw6OmrR8Zblcjt
k9ko7lluw9NKkS584wlVLfF09nvPsXe2bOFy0twY6U5AZDrEmE4VsqUTbQ40pQeT9JsDUT8fb7kI
retzo1JY/B5CPNnsk3te1ZrLpmbJ/c89udteOG2tGbbcXKJCrpKGkODl+tw4rPTeuePDi43Xj/ba
p1axN5cmSlbWHz59DQI39u35bHyxhQnILkwwlNpU4l5aySElNyUpHC3G/HqtXc/GWN7t7pbtu70o
ci597ap0jt3U9ak1e89xQxnouQjxBkMVHRJYUxzFMqSu1kqCiFG2rp4ViuBZn25Qcts3R1pU0fMu
R3qSjuiq4ZHlrdm9V5CFB8Fj+bloviYCtboS3ZOpXPPEq4dSR9dS+FxlCUt06QlSWWPu/iQuVfcl
GkfnVVn9pEn7ndyu2YEnIQmFymcy3Eebu6Gw4i/8xGhaVcL/AGiRWtrhq1elGEntdpy9K+54Gc+S
7lqLklVXKev5mw2vM3M7vjPR5r7TkSPytbIW6Uo1IJa5CVHSm4/xPT0VhzLdlca24p7nXT41/A24
07rvzUmqKmvwp+Jsc3n8389bwWCYjrm+HMqQ/MKwyhvVoAs36xJNc/H41vtO7db21olHOvxNr1+f
c7dtLdSuORqZW/cwxhHHVQmRl4mQRj5ke6i0oqBOpsggjVbhcm1dUPG25XKbn25Q3J+vxOeXOmoV
ot6lta/ImS8/u9EyFhWWIBzkhtyU+tSnfDNspUUoHCyyo9B9NZQ43HcZXG59tNJZbm/uNZX7ykoJ
R3vH1pQnbPz+Ty6ckMiw1Hfgy1ReW1cgaAL3USdXHrFqw53Gha27G2pRriacS/K5u3Kji6FhrgOw
UAoBQCgFAKAUAoBQCgFAKA+jpFSgD0mjB8qAVzcO1p+Sy8LKwMp8tlQm1toVyEv35nAmy1BPQbdF
ehxeZG3blCcN8Ze2mRx8jiynNTjLa4+ypHyOz83lMI/jcnnfFOOOtutSfCtt8sN8SnQhSdV+0mtL
XOt27inC3TB4bnj1KXOJOcHGU6457STCwm8GZSHJO5RKYTfWwYLKArgbeslVxx48KzucjjuNFao9
d7Lws3k6u5Vf0oj43y7wsbCuwZjbM6Y/zS7knGEB3U7eykk6lJ034et01pd8pclcUotxiqfLXDAp
b8fBQcZUk3XGmJ5gbFfjP4F17I884MOoR/J0lxDnBIP8xWnQOHXU3fIqSuJRp3KeuVPh6kQ4LTg3
Kuyvp/EmSNpl3cM3MCUE+NgqgKYLd9Oq3rheofd6LVjHm0tRt0+me6tfsyNZcWtxzrnHaQpfl9Gl
bQi7fdlfzYZ1MTg3xCiok+pq6ClRFtVbQ8o48h3UsJZqv4/wMp8BSsq23l6lgi43kYVnGczVyoyY
3N02vpb0atN/rteuCd3dcc6Zyr9p2Rt0go+yhWIvls0wjBpM8q+TqWXSGtPiEl/xCEkazpCV/Tev
Sn5ZvufL/wCnty+XbocMfHJbPm+j2Z411JLewIasLLxkmStwyJq57EltPLWy6q2nTxXfTbprN+Tl
3FOKyjtazqi64Edji3nLdXQRtlT3p0WTnsy5lm4Kg5EjllDCA4noWvSVayPTSfkIqLVqChuzda9N
BHhyck7k9+3JUp/M2WG258tzOYyXiOb82W0vlaNPL5QULatR1X19grnv8ruW4QpTZX41NrPH2TlK
v1mkPly4Nuqw7eS0Hx3jm5HIuUm1ggo5lj9N/qrs/dV3u44/p20r/A5v2/8At7N36q1p/E2mMw27
I85p6duLxsVF+ZF8Ey1rukgeuk6hY8a5r3IsSi1G1tlrub+w3t2bylWVzctNqRtMZFyMdt5M6b45
a3lLZXyks8togaW7Jvq02PrHjXNenCTW2O3DWtXqb2oySe57sdKfA1EzZkaVutnPrfOlDWh2EU3S
4rQttKyrV1JX2V1W+fKNh2qeuemT/A558NSuq5X4GPb+xo+KwU/EuyTLGQ1JcfKNBCC2G0ptqV7I
HDjVuV5F3bsbiW3b6fGpXj8JW7coN13flQ1p8rmVYaBjl5AqVEfW88/yuLqHNIU3bX6o0tpHSeiu
j94fclNR+pUpXL25e1mP7YtijuyemfszNxuDZ7GYy+MyKpBZOPWC40E6g8hK0uJQTqTYBSfTXJxe
e7VucKV3fZ6HRyOIrk4yrTb9phxWy14uTmZUOeUSMkVeEWWgoRQpa3LJSpRCxqX6Oir3vIK4oRlH
CGeP1ZL4ZFbXD2ObjLGWWGRLa23I+eQMxJnc+REhmI6OUEc1RNy76qrJufsgVlLlrtStqNFKVc8v
YaLjvuRm3VqNMs/aahXl24GHORlFMy/mS8nGkBlKg2tYA0FtSiF2t03H0V1LyiqqwrHZsarn8fQ5
/wBvdMJUe/csD2PLxLqMumfkXJasuGFreLaUONvRwdK0lJ02ur2dIsOFR+6UcNsVHZX1wafp/En9
vru3Srvp1Rlh7JnfNo2SyuYXk3GGXY621spbSpt1BRYaFcOk3JuTVZ+Qj23C3DZVp51xRaHClvUp
y3UTWRHb8vH+Wzj38y8/t9hwONYtTSAbJVqCFvA6lJv1Wq78oquaglda+qv4FF494Rc27a/TT8SV
kNmTV5CZKxGYdxbeR4z2EtIdC1WsVIKiktkjpIrO15CKhGNyCns+l1p11NLnDlubhLbuzwr/ACNZ
O2nLj5vAwsO6/CZgxJCEZFDYdShwm/8AMBGg6yTdJtXTb5sZW7kriUnKS+WtOnrgYT4rU4Rg2lGL
x/M2cfZDrOLksoy0hOUlviU/k0DQVOAWCVNA6S3Y+wTauaXkU5p7FsiqKPs9+vtN48JqDW57m67v
4aewww/L1ATkl5Gf4uVkY/hVPNMNxUpb4G/Lb9VSrgcT2Wq9zyn07I7YwdcW5faysOB9W6VXJUyS
PmP2HkGMjiZszNrm/KApDDKmEtp5ZRoSkaVXBHWo3vwpd8lBwnGNvbvzx9f+e4i3wZKUZSnu2ew9
o2DpwDGJ8dfkzhO5/K6bKKtGnX6em/1VD8n/AHXc25w20r9uRK4P9tQrlKuRmyeyvHTszK8Zy/m0
VEXRytXL0afWvrGq+no4VSz5DZGEdv0Srnn9ha7w90puv1qmRJa2toyuHn+Kv8pimLy+X/iXRo1X
1er9FjWb5lYTjT65V9xdcWk4yr9Coa4eX9sWIPj+jKfNOZyvRblW1/6V/qro/c/n3bf/AM9mf25G
P+B8u3d+vdl9mZMO1cg1ncnloGVMU5NpKFslhDmlxtGhtwKUeOnp0241j/mwdqFuUN2x60w9Ua/4
slclOMqbloechtLISJETJRcuuJm48cRn56WG1pfR0nUyTpHrcRx4VNrmwipQlDdbbqo1eHxIucWT
akpUmlStM/gRz5ftnEphmctctc1GQmTnEalOuIvw0hQ0js4m1afub7m7b8u3aloin+Atm2uO7c3q
RN+Rsu1mMdlMWzLQ8024y7OhNJlLCTxDaoy9IUL9CtXDj6K18bO27coTcaNp0k9vx3fwM+dGanGc
FKuqVfsJnlzjMjDx06RPbdacny1yG0SLc8oUAAp0DoUo3uKy8rehOcVFp7Y0wy+Bp4+1KMW5V+aV
cc/iWyvKPQFAKAUAoBQCgFAKAUAoBQCgPo6RUoA2uaMgcKEjhQDhQDhQDhQDhQDhQDhQDhQDhQDh
QDhQDhQDhQDhQDhQDhQDhQDhQDhQDhQDhQDhQDhQDhQDhQDhQDhQDhQDhQDhQDhQDhQDhQDhQDhQ
DhQDhQDhQDhQDhQDhQDhQDhQDhQDhQDhQDhQDhQDhQDhQDhQDhQAWuKIg//Z
--Apple-Mail=_9B329B9D-DBF2-43B8-BA51-C445E633AAA9--
--Apple-Mail=_B1150D23-2155-4F5F-95DA-EEF01B8572A9--
From common-dev-return-77808-apmail-hadoop-common-dev-archive=hadoop.apache.org@hadoop.apache.org Tue Feb 21 18:42:14 2012
Return-Path: <common-dev-return-77808-apmail-hadoop-common-dev-archive=hadoop.apache.org@hadoop.apache.org>
X-Original-To: apmail-hadoop-common-dev-archive@www.apache.org
Delivered-To: apmail-hadoop-common-dev-archive@www.apache.org
Received: from mail.apache.org (hermes.apache.org [140.211.11.3])
by minotaur.apache.org (Postfix) with SMTP id 64D9D9861
for <apmail-hadoop-common-dev-archive@www.apache.org>; Tue, 21 Feb 2012 18:42:14 +0000 (UTC)
Received: (qmail 18438 invoked by uid 500); 21 Feb 2012 18:42:12 -0000
Delivered-To: apmail-hadoop-common-dev-archive@hadoop.apache.org
Received: (qmail 18350 invoked by uid 500); 21 Feb 2012 18:42:12 -0000
Mailing-List: contact common-dev-help@hadoop.apache.org; run by ezmlm
Precedence: bulk
List-Help: <mailto:common-dev-help@hadoop.apache.org>
List-Unsubscribe: <mailto:common-dev-unsubscribe@hadoop.apache.org>
List-Post: <mailto:common-dev@hadoop.apache.org>
List-Id: <common-dev.hadoop.apache.org>
Reply-To: common-dev@hadoop.apache.org
Delivered-To: mailing list common-dev@hadoop.apache.org
Received: (qmail 18189 invoked by uid 99); 21 Feb 2012 18:42:12 -0000
Received: from athena.apache.org (HELO athena.apache.org) (140.211.11.136)
by apache.org (qpsmtpd/0.29) with ESMTP; Tue, 21 Feb 2012 18:42:12 +0000
X-ASF-Spam-Status: No, hits=-2000.0 required=5.0
tests=ALL_TRUSTED,T_RP_MATCHES_RCVD
X-Spam-Check-By: apache.org
Received: from [140.211.11.116] (HELO hel.zones.apache.org) (140.211.11.116)
by apache.org (qpsmtpd/0.29) with ESMTP; Tue, 21 Feb 2012 18:42:07 +0000
Received: from hel.zones.apache.org (hel.zones.apache.org [140.211.11.116])
by hel.zones.apache.org (Postfix) with ESMTP id C7F791C2293
for <common-dev@hadoop.apache.org>; Tue, 21 Feb 2012 18:41:47 +0000 (UTC)
Date: Tue, 21 Feb 2012 18:41:47 +0000 (UTC)
From: "Allen Wittenauer (Resolved) (JIRA)" <jira@apache.org>
To: common-dev@hadoop.apache.org
Message-ID: <1262841172.53.1329849707820.JavaMail.tomcat@hel.zones.apache.org>
In-Reply-To: <345252500.17847.1328756883972.JavaMail.tomcat@hel.zones.apache.org>
Subject: [jira] [Resolved] (HADOOP-8043) KerberosAuthenticationFilter and
friends have some problems
MIME-Version: 1.0
Content-Type: text/plain; charset=utf-8
Content-Transfer-Encoding: 7bit
X-JIRA-FingerPrint: 30527f35849b9dde25b450d4833f0394
[ https://issues.apache.org/jira/browse/HADOOP-8043?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Allen Wittenauer resolved HADOOP-8043.
--------------------------------------
Resolution: Won't Fix
I'm opting to build a different filter for in-house usage. There are just too many problems with this one.
> KerberosAuthenticationFilter and friends have some problems
> -----------------------------------------------------------
>
> Key: HADOOP-8043
> URL: https://issues.apache.org/jira/browse/HADOOP-8043
> Project: Hadoop Common
> Issue Type: Bug
> Components: security
> Affects Versions: 1.0.0
> Reporter: Allen Wittenauer
> Priority: Critical
> Attachments: HADOOP-8043-branch-1.0.txt
>
>
> KerberosAuthenticationFilter and friends have three killer usability issues and bugs:
> 1. Documentation is misleading/wrong.
> 2. Shared secret stored in a world readable file.
> 3. Lacks support for _HOST macro
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
From common-dev-return-77809-apmail-hadoop-common-dev-archive=hadoop.apache.org@hadoop.apache.org Tue Feb 21 18:47:03 2012
Return-Path: <common-dev-return-77809-apmail-hadoop-common-dev-archive=hadoop.apache.org@hadoop.apache.org>
X-Original-To: apmail-hadoop-common-dev-archive@www.apache.org
Delivered-To: apmail-hadoop-common-dev-archive@www.apache.org
Received: from mail.apache.org (hermes.apache.org [140.211.11.3])
by minotaur.apache.org (Postfix) with SMTP id A9E849CD7
for <apmail-hadoop-common-dev-archive@www.apache.org>; Tue, 21 Feb 2012 18:47:03 +0000 (UTC)
Received: (qmail 42574 invoked by uid 500); 21 Feb 2012 18:47:02 -0000
Delivered-To: apmail-hadoop-common-dev-archive@hadoop.apache.org
Received: (qmail 42524 invoked by uid 500); 21 Feb 2012 18:47:02 -0000
Mailing-List: contact common-dev-help@hadoop.apache.org; run by ezmlm
Precedence: bulk
List-Help: <mailto:common-dev-help@hadoop.apache.org>
List-Unsubscribe: <mailto:common-dev-unsubscribe@hadoop.apache.org>
List-Post: <mailto:common-dev@hadoop.apache.org>
List-Id: <common-dev.hadoop.apache.org>
Reply-To: common-dev@hadoop.apache.org
Delivered-To: mailing list common-dev@hadoop.apache.org
Received: (qmail 42515 invoked by uid 99); 21 Feb 2012 18:47:02 -0000
Received: from nike.apache.org (HELO nike.apache.org) (192.87.106.230)
by apache.org (qpsmtpd/0.29) with ESMTP; Tue, 21 Feb 2012 18:47:02 +0000
X-ASF-Spam-Status: No, hits=2.2 required=5.0
tests=HTML_MESSAGE,RCVD_IN_DNSWL_LOW,SPF_NEUTRAL
X-Spam-Check-By: apache.org
Received-SPF: neutral (nike.apache.org: local policy)
Received: from [74.125.82.48] (HELO mail-ww0-f48.google.com) (74.125.82.48)
by apache.org (qpsmtpd/0.29) with ESMTP; Tue, 21 Feb 2012 18:46:53 +0000
Received: by wgbdq13 with SMTP id dq13so5608059wgb.29
for <common-dev@hadoop.apache.org>; Tue, 21 Feb 2012 10:46:33 -0800 (PST)
Received-SPF: pass (google.com: domain of mahadev@hortonworks.com designates 10.180.8.164 as permitted sender) client-ip=10.180.8.164;
Authentication-Results: mr.google.com; spf=pass (google.com: domain of mahadev@hortonworks.com designates 10.180.8.164 as permitted sender) smtp.mail=mahadev@hortonworks.com
Received: from mr.google.com ([10.180.8.164])
by 10.180.8.164 with SMTP id s4mr28173962wia.6.1329849993241 (num_hops = 1);
Tue, 21 Feb 2012 10:46:33 -0800 (PST)
MIME-Version: 1.0
Received: by 10.180.8.164 with SMTP id s4mr23422588wia.6.1329849993110; Tue,
21 Feb 2012 10:46:33 -0800 (PST)
Received: by 10.227.129.145 with HTTP; Tue, 21 Feb 2012 10:46:32 -0800 (PST)
In-Reply-To: <66D3CC93-9342-4D7D-9604-1F85975C7793@hortonworks.com>
References: <CA+z3+9HrBBf2___wSEk7M=HrzDRLsvHikqcR3Mx2ra6+3oMuwg@mail.gmail.com>
<66D3CC93-9342-4D7D-9604-1F85975C7793@hortonworks.com>
Date: Tue, 21 Feb 2012 10:46:32 -0800
Message-ID: <CALF7aMSL71Xruo8-Bs2hRF7u8So0XqeSPwVV2bLrAsoZM=p+yw@mail.gmail.com>
Subject: Re: [VOTE] Hadoop-1.0.1 Release Candidate 1
From: Mahadev Konar <mahadev@hortonworks.com>
To: common-dev@hadoop.apache.org
Cc: mattf@apache.org
Content-Type: multipart/related; boundary=f46d0442807e71a28e04b97dd4fe
X-Gm-Message-State: ALoCoQnjFlQi3VuXJfRuv46om4kJypeiFN9O0PmXo/SrRmF7gtBCVXGG7Wj3gNangW/5OMJJXWoR
X-Virus-Checked: Checked by ClamAV on apache.org
--f46d0442807e71a28e04b97dd4fe
Content-Type: multipart/alternative; boundary=f46d0442807e71a28c04b97dd4fd
--f46d0442807e71a28c04b97dd4fd
Content-Type: text/plain; charset=ISO-8859-1
Downloaded the release. Setup a single node cluster. Ran a couple of jobs
on it.
+1 for the release.
Mahadev Konar
Hortonworks Inc.
http://hortonworks.com/
On Tue, Feb 21, 2012 at 10:29 AM, Arpit Gupta <arpit@hortonworks.com> wrote:
> +1 (non binding) tested on secure and non secure clusters and no
> regressions were found.
>
>
> On Feb 14, 2012, at 2:29 PM, Matt Foley wrote:
>
> Hi all,
> Hadoop-1.0.1-rc1 is now available at
> http://people.apache.org/~mattf/hadoop-1.0.1-rc1/
> Please download it, test it, and vote on whether to accept it as Release
> 1.0.1.
> Voting will close at 2:30pm PST on Tuesday 21 February.
>
> Thank you,
> --Matt (Release Manager)
>
> This is a maintenance release from 1.0.0, but a number of
> production-relevant bug fixes were requested for inclusion in the last week
> or so. The complete release notes are available at
>
>
> http://people.apache.org/~mattf/hadoop-1.0.1-rc1/RELEASE_NOTES_HADOOP-1.0.1.html
> The summary list is:
>
> - HADOOP-8009 <https://issues.apache.org/jira/browse/HADOOP-8009>.
> Create hadoop-client and hadoop-minicluster artifacts for downstream
> projects
> - HADOOP-8037 <https://issues.apache.org/jira/browse/HADOOP-8037>.
> Binary
> tarball does not preserve platform info for native builds, and RPMs fail
> to
> provide needed symlinks for libhadoop.so
> - MAPREDUCE-3184
> <https://issues.apache.org/jira/browse/MAPREDUCE-3184>. Improve
> handling of fetch failures when a tasktracker is not responding on HTTP
> - HADOOP-7470 <https://issues.apache.org/jira/browse/HADOOP-7470>. move
> up to Jackson 1.8.8
> - HADOOP-7960 <https://issues.apache.org/jira/browse/HADOOP-7960>. Port
> HADOOP-5203 to branch-1, build version comparison is too restrictive
> - HADOOP-7964 <https://issues.apache.org/jira/browse/HADOOP-7964>.
> Deadlock
> in class init.
> - HADOOP-7987 <https://issues.apache.org/jira/browse/HADOOP-7987>.
> Support
> setting the run-as user in unsecure mode
> - HADOOP-7988 <https://issues.apache.org/jira/browse/HADOOP-7988>. Upper
> case in hostname part of the principals doesn't work with kerberos.
> - HADOOP-8010 <https://issues.apache.org/jira/browse/HADOOP-8010>.
> hadoop-config.sh
> spews error message when HADOOP_HOME_WARN_SUPPRESS is set to true and
> HADOOP_HOME is present
> - HADOOP-8052 <https://issues.apache.org/jira/browse/HADOOP-8052>.
> Hadoop
> Metrics2 should emit Float.MAX_VALUE (instead of Double.MAX_VALUE) to
> avoid
> making Ganglia's gmetad core
> - HDFS-2379 <https://issues.apache.org/jira/browse/HDFS-2379>. 0.20:
> Allow block reports to proceed without holding FSDataset lock
> - HDFS-2814 <https://issues.apache.org/jira/browse/HDFS-2814>.
> NamenodeMXBean
> does not account for svn revision in the version information
> - MAPREDUCE-3343
> <https://issues.apache.org/jira/browse/MAPREDUCE-3343>. TaskTracker
> Out of Memory because of distributed cache
> - MAPREDUCE-3607
> <https://issues.apache.org/jira/browse/MAPREDUCE-3607>. Port
> missing new API mapreduce lib classes to 1.x
>
>
>
> --
> Arpit
> Hortonworks, Inc.
> email: arpit@hortonworks.com
>
> <http://www.hadoopsummit.org/>
> <http://www.hadoopsummit.org/>
> <http://www.hadoopsummit.org/>
>
--f46d0442807e71a28c04b97dd4fd
Content-Type: text/html; charset=ISO-8859-1
Content-Transfer-Encoding: quoted-printable
Downloaded the release. Setup a single node cluster. Ran a couple of jobs o=
n it.=A0<div><br></div><div>+1 for the release.</div><div><br clear=3D"all"=
>Mahadev Konar<br>Hortonworks Inc.<br><a href=3D"http://hortonworks.com/" t=
arget=3D"_blank">http://hortonworks.com/</a><br>
<br><br><div class=3D"gmail_quote">On Tue, Feb 21, 2012 at 10:29 AM, Arpit =
Gupta <span dir=3D"ltr">&lt;<a href=3D"mailto:arpit@hortonworks.com">arpit@=
hortonworks.com</a>&gt;</span> wrote:<br><blockquote class=3D"gmail_quote" =
style=3D"margin:0 0 0 .8ex;border-left:1px #ccc solid;padding-left:1ex">
<div style=3D"word-wrap:break-word">+1 (non binding) tested on secure and n=
on secure clusters and no regressions were found.<div><br></div><div><div><=
div></div><div class=3D"h5"><br><div><div>On Feb 14, 2012, at 2:29 PM, Matt=
Foley wrote:</div>
<br><blockquote type=3D"cite"><div>Hi all,<br>Hadoop-1.0.1-rc1 is now avail=
able at<br> =A0=A0=A0<a href=3D"http://people.apache.org/~mattf/hadoop-1.0.=
1-rc1/" target=3D"_blank">http://people.apache.org/~mattf/hadoop-1.0.1-rc1/=
</a><br>
Please download it, test it, and vote on whether to accept it as Release<br=
>1.0.1.<br>Voting will close at 2:30pm PST on Tuesday 21 February.<br><br>T=
hank you,<br>--Matt (Release Manager)<br><br>This is a maintenance release =
from 1.0.0, but a number of<br>
production-relevant bug fixes were requested for inclusion in the last week=
<br>or so. =A0The complete release notes are available at<br><br><a href=3D=
"http://people.apache.org/~mattf/hadoop-1.0.1-rc1/RELEASE_NOTES_HADOOP-1.0.=
1.html" target=3D"_blank">http://people.apache.org/~mattf/hadoop-1.0.1-rc1/=
RELEASE_NOTES_HADOOP-1.0.1.html</a><br>
The summary list is:<br><br> =A0=A0- HADOOP-8009 &lt;<a href=3D"https://iss=
ues.apache.org/jira/browse/HADOOP-8009" target=3D"_blank">https://issues.ap=
ache.org/jira/browse/HADOOP-8009</a>&gt;.<br> =A0=A0Create hadoop-client an=
d hadoop-minicluster artifacts for downstream<br>
=A0=A0projects<br> =A0=A0- HADOOP-8037 &lt;<a href=3D"https://issues.apach=
e.org/jira/browse/HADOOP-8037" target=3D"_blank">https://issues.apache.org/=
jira/browse/HADOOP-8037</a>&gt;. Binary<br> =A0=A0tarball does not preserve=
platform info for native builds, and RPMs fail to<br>
=A0=A0provide needed symlinks for libhadoop.so<br> =A0=A0- MAPREDUCE-3184<=
br>&lt;<a href=3D"https://issues.apache.org/jira/browse/MAPREDUCE-3184" tar=
get=3D"_blank">https://issues.apache.org/jira/browse/MAPREDUCE-3184</a>&gt;=
. Improve<br>
=A0=A0handling of fetch failures when a tasktracker is not responding on H=
TTP<br> =A0=A0- HADOOP-7470 &lt;<a href=3D"https://issues.apache.org/jira/b=
rowse/HADOOP-7470" target=3D"_blank">https://issues.apache.org/jira/browse/=
HADOOP-7470</a>&gt;. move<br>
=A0=A0up to Jackson 1.8.8<br> =A0=A0- HADOOP-7960 &lt;<a href=3D"https://i=
ssues.apache.org/jira/browse/HADOOP-7960" target=3D"_blank">https://issues.=
apache.org/jira/browse/HADOOP-7960</a>&gt;. Port<br> =A0=A0HADOOP-5203 to b=
ranch-1, build version comparison is too restrictive<br>
=A0=A0- HADOOP-7964 &lt;<a href=3D"https://issues.apache.org/jira/browse/H=
ADOOP-7964" target=3D"_blank">https://issues.apache.org/jira/browse/HADOOP-=
7964</a>&gt;. Deadlock<br> =A0=A0in class init.<br> =A0=A0- HADOOP-7987 &lt=
;<a href=3D"https://issues.apache.org/jira/browse/HADOOP-7987" target=3D"_b=
lank">https://issues.apache.org/jira/browse/HADOOP-7987</a>&gt;. Support<br=
>
=A0=A0setting the run-as user in unsecure mode<br> =A0=A0- HADOOP-7988 &lt=
;<a href=3D"https://issues.apache.org/jira/browse/HADOOP-7988" target=3D"_b=
lank">https://issues.apache.org/jira/browse/HADOOP-7988</a>&gt;. Upper<br> =
=A0=A0case in hostname part of the principals doesn&#39;t work with kerbero=
s.<br>
=A0=A0- HADOOP-8010 &lt;<a href=3D"https://issues.apache.org/jira/browse/H=
ADOOP-8010" target=3D"_blank">https://issues.apache.org/jira/browse/HADOOP-=
8010</a>&gt;.<br>hadoop-config.sh<br> =A0=A0spews error message when HADOOP=
_HOME_WARN_SUPPRESS is set to true and<br>
=A0=A0HADOOP_HOME is present<br> =A0=A0- HADOOP-8052 &lt;<a href=3D"https:=
//issues.apache.org/jira/browse/HADOOP-8052" target=3D"_blank">https://issu=
es.apache.org/jira/browse/HADOOP-8052</a>&gt;. Hadoop<br> =A0=A0Metrics2 sh=
ould emit Float.MAX_VALUE (instead of Double.MAX_VALUE) to avoid<br>
=A0=A0making Ganglia&#39;s gmetad core<br> =A0=A0- HDFS-2379 &lt;<a href=
=3D"https://issues.apache.org/jira/browse/HDFS-2379" target=3D"_blank">http=
s://issues.apache.org/jira/browse/HDFS-2379</a>&gt;. 0.20:<br> =A0=A0Allow =
block reports to proceed without holding FSDataset lock<br>
=A0=A0- HDFS-2814 &lt;<a href=3D"https://issues.apache.org/jira/browse/HDF=
S-2814" target=3D"_blank">https://issues.apache.org/jira/browse/HDFS-2814</=
a>&gt;.<br>NamenodeMXBean<br> =A0=A0does not account for svn revision in th=
e version information<br>
=A0=A0- MAPREDUCE-3343<br>&lt;<a href=3D"https://issues.apache.org/jira/br=
owse/MAPREDUCE-3343" target=3D"_blank">https://issues.apache.org/jira/brows=
e/MAPREDUCE-3343</a>&gt;. TaskTracker<br> =A0=A0Out of Memory because of di=
stributed cache<br>
=A0=A0- MAPREDUCE-3607<br>&lt;<a href=3D"https://issues.apache.org/jira/br=
owse/MAPREDUCE-3607" target=3D"_blank">https://issues.apache.org/jira/brows=
e/MAPREDUCE-3607</a>&gt;. Port<br> =A0=A0missing new API mapreduce lib clas=
ses to 1.x<br>
</div></blockquote></div><br></div></div><font color=3D"#888888"><div>
<span style=3D"border-collapse:separate;color:rgb(0,0,0);font-family:Monaco=
;font-style:normal;font-variant:normal;font-weight:normal;letter-spacing:no=
rmal;line-height:normal;text-align:-webkit-auto;text-indent:0px;text-transf=
orm:none;white-space:normal;word-spacing:0px;font-size:medium"><span style=
=3D"border-collapse:separate;color:rgb(0,0,0);font-family:Monaco;font-style=
:normal;font-variant:normal;font-weight:normal;letter-spacing:normal;line-h=
eight:normal;text-align:-webkit-auto;text-indent:0px;text-transform:none;wh=
ite-space:normal;word-spacing:0px;font-size:medium"><span style=3D"border-c=
ollapse:separate;color:rgb(0,0,0);font-family:Monaco;font-style:normal;font=
-variant:normal;font-weight:normal;letter-spacing:normal;line-height:normal=
;text-align:-webkit-auto;text-indent:0px;text-transform:none;white-space:no=
rmal;word-spacing:0px;font-size:medium"><div style=3D"word-wrap:break-word"=
>
<br>--<br>Arpit</div><div style=3D"word-wrap:break-word">Hortonworks, Inc.<=
br>email: <a href=3D"mailto:arpit@hortonworks.com" target=3D"_blank">arpit@=
hortonworks.com</a><br><br></div></span></span><a href=3D"http://www.hadoop=
summit.org/" target=3D"_blank"></a></span><a href=3D"http://www.hadoopsummi=
t.org/" target=3D"_blank"><br>
<span><img height=3D"125" width=3D"440" src=3D"cid:5DFA5CA6-9B85-42AF-9A41-=
85A4BA0A383C"></span>
</a></div><a href=3D"http://www.hadoopsummit.org/" target=3D"_blank">
</a><br></font></div></div></blockquote></div><br></div>
--f46d0442807e71a28c04b97dd4fd--
--f46d0442807e71a28e04b97dd4fe--
From common-dev-return-77810-apmail-hadoop-common-dev-archive=hadoop.apache.org@hadoop.apache.org Tue Feb 21 18:49:35 2012
Return-Path: <common-dev-return-77810-apmail-hadoop-common-dev-archive=hadoop.apache.org@hadoop.apache.org>
X-Original-To: apmail-hadoop-common-dev-archive@www.apache.org
Delivered-To: apmail-hadoop-common-dev-archive@www.apache.org
Received: from mail.apache.org (hermes.apache.org [140.211.11.3])
by minotaur.apache.org (Postfix) with SMTP id A26D89E09
for <apmail-hadoop-common-dev-archive@www.apache.org>; Tue, 21 Feb 2012 18:49:35 +0000 (UTC)
Received: (qmail 52671 invoked by uid 500); 21 Feb 2012 18:49:34 -0000
Delivered-To: apmail-hadoop-common-dev-archive@hadoop.apache.org
Received: (qmail 52602 invoked by uid 500); 21 Feb 2012 18:49:34 -0000
Mailing-List: contact common-dev-help@hadoop.apache.org; run by ezmlm
Precedence: bulk
List-Help: <mailto:common-dev-help@hadoop.apache.org>
List-Unsubscribe: <mailto:common-dev-unsubscribe@hadoop.apache.org>
List-Post: <mailto:common-dev@hadoop.apache.org>
List-Id: <common-dev.hadoop.apache.org>
Reply-To: common-dev@hadoop.apache.org
Delivered-To: mailing list common-dev@hadoop.apache.org
Received: (qmail 52588 invoked by uid 99); 21 Feb 2012 18:49:34 -0000
Received: from nike.apache.org (HELO nike.apache.org) (192.87.106.230)
by apache.org (qpsmtpd/0.29) with ESMTP; Tue, 21 Feb 2012 18:49:34 +0000
X-ASF-Spam-Status: No, hits=-0.0 required=5.0
tests=RCVD_IN_DNSWL_LOW,SPF_NEUTRAL
X-Spam-Check-By: apache.org
Received-SPF: neutral (nike.apache.org: local policy)
Received: from [209.85.210.48] (HELO mail-pz0-f48.google.com) (209.85.210.48)
by apache.org (qpsmtpd/0.29) with ESMTP; Tue, 21 Feb 2012 18:49:24 +0000
Received: by dadp13 with SMTP id p13so8572506dad.35
for <common-dev@hadoop.apache.org>; Tue, 21 Feb 2012 10:49:03 -0800 (PST)
Received-SPF: pass (google.com: domain of ddas@hortonworks.com designates 10.68.73.138 as permitted sender) client-ip=10.68.73.138;
Authentication-Results: mr.google.com; spf=pass (google.com: domain of ddas@hortonworks.com designates 10.68.73.138 as permitted sender) smtp.mail=ddas@hortonworks.com
Received: from mr.google.com ([10.68.73.138])
by 10.68.73.138 with SMTP id l10mr78308422pbv.22.1329850143643 (num_hops = 1);
Tue, 21 Feb 2012 10:49:03 -0800 (PST)
Received: by 10.68.73.138 with SMTP id l10mr64556585pbv.22.1329850143599;
Tue, 21 Feb 2012 10:49:03 -0800 (PST)
Received: from [10.10.10.161] (host1.hortonworks.com. [70.35.59.2])
by mx.google.com with ESMTPS id z10sm16691008pbq.55.2012.02.21.10.49.02
(version=TLSv1/SSLv3 cipher=OTHER);
Tue, 21 Feb 2012 10:49:02 -0800 (PST)
Content-Type: text/plain; charset=us-ascii
Mime-Version: 1.0 (Apple Message framework v1084)
Subject: Re: [VOTE] Hadoop-1.0.1 Release Candidate 1
From: Devaraj Das <ddas@hortonworks.com>
In-Reply-To: <CA+z3+9HrBBf2___wSEk7M=HrzDRLsvHikqcR3Mx2ra6+3oMuwg@mail.gmail.com>
Date: Tue, 21 Feb 2012 10:49:02 -0800
Content-Transfer-Encoding: quoted-printable
Message-Id: <099C1BFE-1C23-4FA5-B7F9-493EB835EEB9@hortonworks.com>
References: <CA+z3+9HrBBf2___wSEk7M=HrzDRLsvHikqcR3Mx2ra6+3oMuwg@mail.gmail.com>
To: common-dev@hadoop.apache.org
X-Mailer: Apple Mail (2.1084)
X-Gm-Message-State: ALoCoQmeRWIm+W+cB4cLqcbv4pMGlUC3QGhE2gxlgkJ7O8FdWhGJcWKVbRa/52AniIrCiwADt29g
X-Virus-Checked: Checked by ClamAV on apache.org
+1=20
Downloaded the tar ball and stood up a single-node cluster. Ran a sleep =
job.
On Feb 14, 2012, at 2:29 PM, Matt Foley wrote:
> Hi all,
> Hadoop-1.0.1-rc1 is now available at
> http://people.apache.org/~mattf/hadoop-1.0.1-rc1/
> Please download it, test it, and vote on whether to accept it as =
Release
> 1.0.1.
> Voting will close at 2:30pm PST on Tuesday 21 February.
>=20
> Thank you,
> --Matt (Release Manager)
>=20
> This is a maintenance release from 1.0.0, but a number of
> production-relevant bug fixes were requested for inclusion in the last =
week
> or so. The complete release notes are available at
>=20
> =
http://people.apache.org/~mattf/hadoop-1.0.1-rc1/RELEASE_NOTES_HADOOP-1.0.=
1.html
> The summary list is:
>=20
> - HADOOP-8009 <https://issues.apache.org/jira/browse/HADOOP-8009>.
> Create hadoop-client and hadoop-minicluster artifacts for downstream
> projects
> - HADOOP-8037 <https://issues.apache.org/jira/browse/HADOOP-8037>. =
Binary
> tarball does not preserve platform info for native builds, and RPMs =
fail to
> provide needed symlinks for libhadoop.so
> - MAPREDUCE-3184
> <https://issues.apache.org/jira/browse/MAPREDUCE-3184>. Improve
> handling of fetch failures when a tasktracker is not responding on =
HTTP
> - HADOOP-7470 <https://issues.apache.org/jira/browse/HADOOP-7470>. =
move
> up to Jackson 1.8.8
> - HADOOP-7960 <https://issues.apache.org/jira/browse/HADOOP-7960>. =
Port
> HADOOP-5203 to branch-1, build version comparison is too restrictive
> - HADOOP-7964 <https://issues.apache.org/jira/browse/HADOOP-7964>. =
Deadlock
> in class init.
> - HADOOP-7987 <https://issues.apache.org/jira/browse/HADOOP-7987>. =
Support
> setting the run-as user in unsecure mode
> - HADOOP-7988 <https://issues.apache.org/jira/browse/HADOOP-7988>. =
Upper
> case in hostname part of the principals doesn't work with kerberos.
> - HADOOP-8010 <https://issues.apache.org/jira/browse/HADOOP-8010>.
> hadoop-config.sh
> spews error message when HADOOP_HOME_WARN_SUPPRESS is set to true =
and
> HADOOP_HOME is present
> - HADOOP-8052 <https://issues.apache.org/jira/browse/HADOOP-8052>. =
Hadoop
> Metrics2 should emit Float.MAX_VALUE (instead of Double.MAX_VALUE) =
to avoid
> making Ganglia's gmetad core
> - HDFS-2379 <https://issues.apache.org/jira/browse/HDFS-2379>. 0.20:
> Allow block reports to proceed without holding FSDataset lock
> - HDFS-2814 <https://issues.apache.org/jira/browse/HDFS-2814>.
> NamenodeMXBean
> does not account for svn revision in the version information
> - MAPREDUCE-3343
> <https://issues.apache.org/jira/browse/MAPREDUCE-3343>. TaskTracker
> Out of Memory because of distributed cache
> - MAPREDUCE-3607
> <https://issues.apache.org/jira/browse/MAPREDUCE-3607>. Port
> missing new API mapreduce lib classes to 1.x
From common-dev-return-77811-apmail-hadoop-common-dev-archive=hadoop.apache.org@hadoop.apache.org Tue Feb 21 18:50:14 2012
Return-Path: <common-dev-return-77811-apmail-hadoop-common-dev-archive=hadoop.apache.org@hadoop.apache.org>
X-Original-To: apmail-hadoop-common-dev-archive@www.apache.org
Delivered-To: apmail-hadoop-common-dev-archive@www.apache.org
Received: from mail.apache.org (hermes.apache.org [140.211.11.3])
by minotaur.apache.org (Postfix) with SMTP id 559D99E5D
for <apmail-hadoop-common-dev-archive@www.apache.org>; Tue, 21 Feb 2012 18:50:14 +0000 (UTC)
Received: (qmail 55923 invoked by uid 500); 21 Feb 2012 18:50:12 -0000
Delivered-To: apmail-hadoop-common-dev-archive@hadoop.apache.org
Received: (qmail 55855 invoked by uid 500); 21 Feb 2012 18:50:12 -0000
Mailing-List: contact common-dev-help@hadoop.apache.org; run by ezmlm
Precedence: bulk
List-Help: <mailto:common-dev-help@hadoop.apache.org>
List-Unsubscribe: <mailto:common-dev-unsubscribe@hadoop.apache.org>
List-Post: <mailto:common-dev@hadoop.apache.org>
List-Id: <common-dev.hadoop.apache.org>
Reply-To: common-dev@hadoop.apache.org
Delivered-To: mailing list common-dev@hadoop.apache.org
Received: (qmail 55845 invoked by uid 99); 21 Feb 2012 18:50:12 -0000
Received: from nike.apache.org (HELO nike.apache.org) (192.87.106.230)
by apache.org (qpsmtpd/0.29) with ESMTP; Tue, 21 Feb 2012 18:50:12 +0000
X-ASF-Spam-Status: No, hits=-2000.0 required=5.0
tests=ALL_TRUSTED,T_RP_MATCHES_RCVD
X-Spam-Check-By: apache.org
Received: from [140.211.11.116] (HELO hel.zones.apache.org) (140.211.11.116)
by apache.org (qpsmtpd/0.29) with ESMTP; Tue, 21 Feb 2012 18:50:07 +0000
Received: from hel.zones.apache.org (hel.zones.apache.org [140.211.11.116])
by hel.zones.apache.org (Postfix) with ESMTP id 34CF81C29E1
for <common-dev@hadoop.apache.org>; Tue, 21 Feb 2012 18:49:46 +0000 (UTC)
Date: Tue, 21 Feb 2012 18:49:46 +0000 (UTC)
From: "Alejandro Abdelnur (Created) (JIRA)" <jira@apache.org>
To: common-dev@hadoop.apache.org
Message-ID: <525529476.108.1329850186217.JavaMail.tomcat@hel.zones.apache.org>
Subject: [jira] [Created] (HADOOP-8098) KerberosAuthenticatorHandler should
use _HOST replacement to resolve principal name
MIME-Version: 1.0
Content-Type: text/plain; charset=utf-8
Content-Transfer-Encoding: 7bit
X-JIRA-FingerPrint: 30527f35849b9dde25b450d4833f0394
X-Virus-Checked: Checked by ClamAV on apache.org
KerberosAuthenticatorHandler should use _HOST replacement to resolve principal name
-----------------------------------------------------------------------------------
Key: HADOOP-8098
URL: https://issues.apache.org/jira/browse/HADOOP-8098
Project: Hadoop Common
Issue Type: Improvement
Components: security
Affects Versions: 0.24.0, 0.23.2
Reporter: Alejandro Abdelnur
Assignee: Alejandro Abdelnur
Fix For: 0.23.2
Currently the exact Kerberos principal name has to be set in the configuration of each node.
KerberosAuthenticatorHandler should do similar logic as the RPC ports to support HTTP/_HOST@REALM
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
From common-dev-return-77812-apmail-hadoop-common-dev-archive=hadoop.apache.org@hadoop.apache.org Tue Feb 21 18:52:16 2012
Return-Path: <common-dev-return-77812-apmail-hadoop-common-dev-archive=hadoop.apache.org@hadoop.apache.org>
X-Original-To: apmail-hadoop-common-dev-archive@www.apache.org
Delivered-To: apmail-hadoop-common-dev-archive@www.apache.org
Received: from mail.apache.org (hermes.apache.org [140.211.11.3])
by minotaur.apache.org (Postfix) with SMTP id 2104D9F0D
for <apmail-hadoop-common-dev-archive@www.apache.org>; Tue, 21 Feb 2012 18:52:16 +0000 (UTC)
Received: (qmail 62676 invoked by uid 500); 21 Feb 2012 18:52:14 -0000
Delivered-To: apmail-hadoop-common-dev-archive@hadoop.apache.org
Received: (qmail 62603 invoked by uid 500); 21 Feb 2012 18:52:14 -0000
Mailing-List: contact common-dev-help@hadoop.apache.org; run by ezmlm
Precedence: bulk
List-Help: <mailto:common-dev-help@hadoop.apache.org>
List-Unsubscribe: <mailto:common-dev-unsubscribe@hadoop.apache.org>
List-Post: <mailto:common-dev@hadoop.apache.org>
List-Id: <common-dev.hadoop.apache.org>
Reply-To: common-dev@hadoop.apache.org
Delivered-To: mailing list common-dev@hadoop.apache.org
Received: (qmail 62595 invoked by uid 99); 21 Feb 2012 18:52:14 -0000
Received: from nike.apache.org (HELO nike.apache.org) (192.87.106.230)
by apache.org (qpsmtpd/0.29) with ESMTP; Tue, 21 Feb 2012 18:52:14 +0000
X-ASF-Spam-Status: No, hits=-0.0 required=5.0
tests=RCVD_IN_DNSWL_LOW,SPF_NEUTRAL
X-Spam-Check-By: apache.org
Received-SPF: neutral (nike.apache.org: local policy)
Received: from [209.85.160.48] (HELO mail-pw0-f48.google.com) (209.85.160.48)
by apache.org (qpsmtpd/0.29) with ESMTP; Tue, 21 Feb 2012 18:52:05 +0000
Received: by pbcxa12 with SMTP id xa12so7001079pbc.35
for <common-dev@hadoop.apache.org>; Tue, 21 Feb 2012 10:51:44 -0800 (PST)
Received-SPF: pass (google.com: domain of ddas@hortonworks.com designates 10.68.224.9 as permitted sender) client-ip=10.68.224.9;
Authentication-Results: mr.google.com; spf=pass (google.com: domain of ddas@hortonworks.com designates 10.68.224.9 as permitted sender) smtp.mail=ddas@hortonworks.com
Received: from mr.google.com ([10.68.224.9])
by 10.68.224.9 with SMTP id qy9mr78265414pbc.102.1329850304006 (num_hops = 1);
Tue, 21 Feb 2012 10:51:44 -0800 (PST)
Received: by 10.68.224.9 with SMTP id qy9mr64497534pbc.102.1329850303957;
Tue, 21 Feb 2012 10:51:43 -0800 (PST)
Received: from [10.10.10.161] (host1.hortonworks.com. [70.35.59.2])
by mx.google.com with ESMTPS id l8sm16691759pbd.62.2012.02.21.10.51.41
(version=TLSv1/SSLv3 cipher=OTHER);
Tue, 21 Feb 2012 10:51:41 -0800 (PST)
Content-Type: text/plain; charset=us-ascii
Mime-Version: 1.0 (Apple Message framework v1084)
Subject: Re: [VOTE] Hadoop-1.0.1 Release Candidate 1
From: Devaraj Das <ddas@hortonworks.com>
In-Reply-To: <CA+z3+9Fqe5fA-LM1zD=47jw-Rmj5kBM2+jsBGbiSJgpSsSqFig@mail.gmail.com>
Date: Tue, 21 Feb 2012 10:51:39 -0800
Content-Transfer-Encoding: quoted-printable
Message-Id: <88098025-7E2F-47FA-A278-5653B6DF5911@hortonworks.com>
References: <CA+z3+9HrBBf2___wSEk7M=HrzDRLsvHikqcR3Mx2ra6+3oMuwg@mail.gmail.com> <CA+z3+9Fqe5fA-LM1zD=47jw-Rmj5kBM2+jsBGbiSJgpSsSqFig@mail.gmail.com>
To: common-dev@hadoop.apache.org
X-Mailer: Apple Mail (2.1084)
X-Gm-Message-State: ALoCoQm4X6AdPleYs3bCNbs5eOvhkrYrRtWP50/xFSg1usOqWPxfz9NpkXzy7JTCl0327hroGb8w
X-Virus-Checked: Checked by ClamAV on apache.org
+1 on making a 1.0.1 release now and following up with a 1.0.2
On Feb 19, 2012, at 11:52 PM, Matt Foley wrote:
> Hi,
> Giri found an issue with the naming of the 64-bit RPM and DEB; see
> HADOOP-8090 <https://issues.apache.org/jira/browse/HADOOP-8090>. The =
RPM
> is called "hadoop-1.0.1-1.amd64.rpm" but should be called
> "hadoop-1.0.1-1.x86_64.rpm". Even though it's been this way for a =
long
> time, apparently it causes an issue when the rpm is used with yum. =
(BigTop
> already uses the "x86_64" form.) To fix this requires a change to
> build.xml.
>=20
> In addition, Nathan has requested patches for the following bugs:
>=20
> - MAPREDUCE-3824
> <https://issues.apache.org/jira/browse/MAPREDUCE-3824>- Distributed
> caches are not removed properly
> - MAPREDUCE-3851 =
<https://issues.apache.org/jira/browse/MAPREDUCE-3851> -
> Allow more aggressive action in detection of Jetty issues
> - HADOOP-8050 <https://issues.apache.org/jira/browse/HADOOP-8050>-
> Deadlock in Namenode metrices
>=20
> and Owen feels this one is pretty important:
>=20
> - HADOOP-8043 <https://issues.apache.org/jira/browse/HADOOP-8043> -
> KerberosAuthenticationFilter
> and friends have some problems
>=20
> So altogether that's five new issues, all raised (or raised in =
visibility)
> since the 1.0.1 vote was called. Two of them, HADOOP-8050 and
> MAPREDUCE-3824, already have approved fixes, but the remaining three =
are
> still in discussion.
>=20
> The thing is that there are people waiting on the 1.0.1 release with =
some
> urgency, including a pending BigTop release. So instead of pulling =
the
> 1.0.1 release, waiting for fixes, then waiting an additional week for
> another vote, I suggest that we let 1.0.1 proceed as is, and do a =
1.0.2
> release as soon as the remaining three bugs noted above are fixed.
>=20
> If you agree with this, please vote in favor of the 1.0.1 release. If =
you
> disagree, please vote against the release, and I'll do a 1.0.1-rc2 =
instead
> of a 1.0.2. As a reminder, the vote closes Tuesday afternoon.
>=20
> The goal here is to keep everyone fully informed, while providing the =
most
> good to the most people, in the face of conflicting requests.
> Thanks,
> --Matt
>=20
> On Tue, Feb 14, 2012 at 2:29 PM, Matt Foley <mattf@apache.org> wrote:
>=20
>> Hi all,
>> Hadoop-1.0.1-rc1 is now available at
>> http://people.apache.org/~mattf/hadoop-1.0.1-rc1/
>> Please download it, test it, and vote on whether to accept it as =
Release
>> 1.0.1.
>> Voting will close at 2:30pm PST on Tuesday 21 February.
>>=20
>> Thank you,
>> --Matt (Release Manager)
>>=20
>> This is a maintenance release from 1.0.0, but a number of
>> production-relevant bug fixes were requested for inclusion in the =
last week
>> or so. The complete release notes are available at
>>=20
>> =
http://people.apache.org/~mattf/hadoop-1.0.1-rc1/RELEASE_NOTES_HADOOP-1.0.=
1.html
>> The summary list is:
>>=20
>> - HADOOP-8009 <https://issues.apache.org/jira/browse/HADOOP-8009>.
>> Create hadoop-client and hadoop-minicluster artifacts for =
downstream
>> projects
>> - HADOOP-8037 <https://issues.apache.org/jira/browse/HADOOP-8037>. =
Binary
>> tarball does not preserve platform info for native builds, and RPMs =
fail to
>> provide needed symlinks for libhadoop.so
>> - MAPREDUCE-3184 =
<https://issues.apache.org/jira/browse/MAPREDUCE-3184>. Improve
>> handling of fetch failures when a tasktracker is not responding on =
HTTP
>> - HADOOP-7470 <https://issues.apache.org/jira/browse/HADOOP-7470>.
>> move up to Jackson 1.8.8
>> - HADOOP-7960 <https://issues.apache.org/jira/browse/HADOOP-7960>. =
Port
>> HADOOP-5203 to branch-1, build version comparison is too =
restrictive
>> - HADOOP-7964 <https://issues.apache.org/jira/browse/HADOOP-7964>. =
Deadlock
>> in class init.
>> - HADOOP-7987 <https://issues.apache.org/jira/browse/HADOOP-7987>. =
Support
>> setting the run-as user in unsecure mode
>> - HADOOP-7988 <https://issues.apache.org/jira/browse/HADOOP-7988>. =
Upper
>> case in hostname part of the principals doesn't work with kerberos.
>> - HADOOP-8010 <https://issues.apache.org/jira/browse/HADOOP-8010>. =
hadoop-config.sh
>> spews error message when HADOOP_HOME_WARN_SUPPRESS is set to true =
and
>> HADOOP_HOME is present
>> - HADOOP-8052 <https://issues.apache.org/jira/browse/HADOOP-8052>. =
Hadoop
>> Metrics2 should emit Float.MAX_VALUE (instead of Double.MAX_VALUE) =
to avoid
>> making Ganglia's gmetad core
>> - HDFS-2379 <https://issues.apache.org/jira/browse/HDFS-2379>. =
0.20:
>> Allow block reports to proceed without holding FSDataset lock
>> - HDFS-2814 <https://issues.apache.org/jira/browse/HDFS-2814>. =
NamenodeMXBean
>> does not account for svn revision in the version information
>> - MAPREDUCE-3343 =
<https://issues.apache.org/jira/browse/MAPREDUCE-3343>. TaskTracker
>> Out of Memory because of distributed cache
>> - MAPREDUCE-3607 =
<https://issues.apache.org/jira/browse/MAPREDUCE-3607>. Port
>> missing new API mapreduce lib classes to 1.x
>>=20
>>=20
From common-dev-return-77813-apmail-hadoop-common-dev-archive=hadoop.apache.org@hadoop.apache.org Tue Feb 21 19:59:35 2012
Return-Path: <common-dev-return-77813-apmail-hadoop-common-dev-archive=hadoop.apache.org@hadoop.apache.org>
X-Original-To: apmail-hadoop-common-dev-archive@www.apache.org
Delivered-To: apmail-hadoop-common-dev-archive@www.apache.org
Received: from mail.apache.org (hermes.apache.org [140.211.11.3])
by minotaur.apache.org (Postfix) with SMTP id 132729E19
for <apmail-hadoop-common-dev-archive@www.apache.org>; Tue, 21 Feb 2012 19:59:35 +0000 (UTC)
Received: (qmail 66448 invoked by uid 500); 21 Feb 2012 19:59:33 -0000
Delivered-To: apmail-hadoop-common-dev-archive@hadoop.apache.org
Received: (qmail 66394 invoked by uid 500); 21 Feb 2012 19:59:33 -0000
Mailing-List: contact common-dev-help@hadoop.apache.org; run by ezmlm
Precedence: bulk
List-Help: <mailto:common-dev-help@hadoop.apache.org>
List-Unsubscribe: <mailto:common-dev-unsubscribe@hadoop.apache.org>
List-Post: <mailto:common-dev@hadoop.apache.org>
List-Id: <common-dev.hadoop.apache.org>
Reply-To: common-dev@hadoop.apache.org
Delivered-To: mailing list common-dev@hadoop.apache.org
Received: (qmail 66384 invoked by uid 99); 21 Feb 2012 19:59:33 -0000
Received: from nike.apache.org (HELO nike.apache.org) (192.87.106.230)
by apache.org (qpsmtpd/0.29) with ESMTP; Tue, 21 Feb 2012 19:59:33 +0000
X-ASF-Spam-Status: No, hits=2.2 required=5.0
tests=HTML_MESSAGE,RCVD_IN_DNSWL_LOW,SPF_NEUTRAL
X-Spam-Check-By: apache.org
Received-SPF: neutral (nike.apache.org: local policy)
Received: from [209.85.213.48] (HELO mail-yw0-f48.google.com) (209.85.213.48)
by apache.org (qpsmtpd/0.29) with ESMTP; Tue, 21 Feb 2012 19:59:25 +0000
Received: by yhjj52 with SMTP id j52so3936749yhj.35
for <common-dev@hadoop.apache.org>; Tue, 21 Feb 2012 11:59:04 -0800 (PST)
Received-SPF: pass (google.com: domain of jitendra@hortonworks.com designates 10.236.78.201 as permitted sender) client-ip=10.236.78.201;
Authentication-Results: mr.google.com; spf=pass (google.com: domain of jitendra@hortonworks.com designates 10.236.78.201 as permitted sender) smtp.mail=jitendra@hortonworks.com
Received: from mr.google.com ([10.236.78.201])
by 10.236.78.201 with SMTP id g49mr37913648yhe.33.1329854344130 (num_hops = 1);
Tue, 21 Feb 2012 11:59:04 -0800 (PST)
MIME-Version: 1.0
Received: by 10.236.78.201 with SMTP id g49mr29463222yhe.33.1329854344022;
Tue, 21 Feb 2012 11:59:04 -0800 (PST)
Received: by 10.146.108.18 with HTTP; Tue, 21 Feb 2012 11:59:03 -0800 (PST)
In-Reply-To: <099C1BFE-1C23-4FA5-B7F9-493EB835EEB9@hortonworks.com>
References: <CA+z3+9HrBBf2___wSEk7M=HrzDRLsvHikqcR3Mx2ra6+3oMuwg@mail.gmail.com>
<099C1BFE-1C23-4FA5-B7F9-493EB835EEB9@hortonworks.com>
Date: Tue, 21 Feb 2012 11:59:03 -0800
Message-ID: <CAEfeEE9mthOJ716SCp+Ea2tj6OVtQMwg2SO+Vcc2Y0h6nkHGJA@mail.gmail.com>
Subject: Re: [VOTE] Hadoop-1.0.1 Release Candidate 1
From: Jitendra Pandey <jitendra@hortonworks.com>
To: common-dev@hadoop.apache.org
Content-Type: multipart/alternative; boundary=20cf300fb161c748cb04b97ed7fa
X-Gm-Message-State: ALoCoQkcEXVs8OxmnP6+ZUcappVyLYSs4heDkpLM1f2g8Mvqg0Pngr3Rxqg0nRcDU9ViJqlOCkVe
X-Virus-Checked: Checked by ClamAV on apache.org
--20cf300fb161c748cb04b97ed7fa
Content-Type: text/plain; charset=ISO-8859-1
+1 for 1.0.1
Verified checksums and ran wordcount on single node cluster.
On Tue, Feb 21, 2012 at 10:49 AM, Devaraj Das <ddas@hortonworks.com> wrote:
> +1
>
> Downloaded the tar ball and stood up a single-node cluster. Ran a sleep
> job.
>
> On Feb 14, 2012, at 2:29 PM, Matt Foley wrote:
>
> > Hi all,
> > Hadoop-1.0.1-rc1 is now available at
> > http://people.apache.org/~mattf/hadoop-1.0.1-rc1/
> > Please download it, test it, and vote on whether to accept it as Release
> > 1.0.1.
> > Voting will close at 2:30pm PST on Tuesday 21 February.
> >
> > Thank you,
> > --Matt (Release Manager)
> >
> > This is a maintenance release from 1.0.0, but a number of
> > production-relevant bug fixes were requested for inclusion in the last
> week
> > or so. The complete release notes are available at
> >
> >
> http://people.apache.org/~mattf/hadoop-1.0.1-rc1/RELEASE_NOTES_HADOOP-1.0.1.html
> > The summary list is:
> >
> > - HADOOP-8009 <https://issues.apache.org/jira/browse/HADOOP-8009>.
> > Create hadoop-client and hadoop-minicluster artifacts for downstream
> > projects
> > - HADOOP-8037 <https://issues.apache.org/jira/browse/HADOOP-8037>.
> Binary
> > tarball does not preserve platform info for native builds, and RPMs
> fail to
> > provide needed symlinks for libhadoop.so
> > - MAPREDUCE-3184
> > <https://issues.apache.org/jira/browse/MAPREDUCE-3184>. Improve
> > handling of fetch failures when a tasktracker is not responding on HTTP
> > - HADOOP-7470 <https://issues.apache.org/jira/browse/HADOOP-7470>.
> move
> > up to Jackson 1.8.8
> > - HADOOP-7960 <https://issues.apache.org/jira/browse/HADOOP-7960>.
> Port
> > HADOOP-5203 to branch-1, build version comparison is too restrictive
> > - HADOOP-7964 <https://issues.apache.org/jira/browse/HADOOP-7964>.
> Deadlock
> > in class init.
> > - HADOOP-7987 <https://issues.apache.org/jira/browse/HADOOP-7987>.
> Support
> > setting the run-as user in unsecure mode
> > - HADOOP-7988 <https://issues.apache.org/jira/browse/HADOOP-7988>.
> Upper
> > case in hostname part of the principals doesn't work with kerberos.
> > - HADOOP-8010 <https://issues.apache.org/jira/browse/HADOOP-8010>.
> > hadoop-config.sh
> > spews error message when HADOOP_HOME_WARN_SUPPRESS is set to true and
> > HADOOP_HOME is present
> > - HADOOP-8052 <https://issues.apache.org/jira/browse/HADOOP-8052>.
> Hadoop
> > Metrics2 should emit Float.MAX_VALUE (instead of Double.MAX_VALUE) to
> avoid
> > making Ganglia's gmetad core
> > - HDFS-2379 <https://issues.apache.org/jira/browse/HDFS-2379>. 0.20:
> > Allow block reports to proceed without holding FSDataset lock
> > - HDFS-2814 <https://issues.apache.org/jira/browse/HDFS-2814>.
> > NamenodeMXBean
> > does not account for svn revision in the version information
> > - MAPREDUCE-3343
> > <https://issues.apache.org/jira/browse/MAPREDUCE-3343>. TaskTracker
> > Out of Memory because of distributed cache
> > - MAPREDUCE-3607
> > <https://issues.apache.org/jira/browse/MAPREDUCE-3607>. Port
> > missing new API mapreduce lib classes to 1.x
>
>
--
--20cf300fb161c748cb04b97ed7fa--
From common-dev-return-77814-apmail-hadoop-common-dev-archive=hadoop.apache.org@hadoop.apache.org Tue Feb 21 23:05:53 2012
Return-Path: <common-dev-return-77814-apmail-hadoop-common-dev-archive=hadoop.apache.org@hadoop.apache.org>
X-Original-To: apmail-hadoop-common-dev-archive@www.apache.org
Delivered-To: apmail-hadoop-common-dev-archive@www.apache.org
Received: from mail.apache.org (hermes.apache.org [140.211.11.3])
by minotaur.apache.org (Postfix) with SMTP id 1C1209260
for <apmail-hadoop-common-dev-archive@www.apache.org>; Tue, 21 Feb 2012 23:05:53 +0000 (UTC)
Received: (qmail 82117 invoked by uid 500); 21 Feb 2012 23:05:51 -0000
Delivered-To: apmail-hadoop-common-dev-archive@hadoop.apache.org
Received: (qmail 82052 invoked by uid 500); 21 Feb 2012 23:05:51 -0000
Mailing-List: contact common-dev-help@hadoop.apache.org; run by ezmlm
Precedence: bulk
List-Help: <mailto:common-dev-help@hadoop.apache.org>
List-Unsubscribe: <mailto:common-dev-unsubscribe@hadoop.apache.org>
List-Post: <mailto:common-dev@hadoop.apache.org>
List-Id: <common-dev.hadoop.apache.org>
Reply-To: common-dev@hadoop.apache.org
Delivered-To: mailing list common-dev@hadoop.apache.org
Received: (qmail 82043 invoked by uid 99); 21 Feb 2012 23:05:51 -0000
Received: from nike.apache.org (HELO nike.apache.org) (192.87.106.230)
by apache.org (qpsmtpd/0.29) with ESMTP; Tue, 21 Feb 2012 23:05:51 +0000
X-ASF-Spam-Status: No, hits=-0.7 required=5.0
tests=RCVD_IN_DNSWL_LOW,SPF_PASS
X-Spam-Check-By: apache.org
Received-SPF: pass (nike.apache.org: domain of rhc.openmpi@gmail.com designates 209.85.160.48 as permitted sender)
Received: from [209.85.160.48] (HELO mail-pw0-f48.google.com) (209.85.160.48)
by apache.org (qpsmtpd/0.29) with ESMTP; Tue, 21 Feb 2012 23:05:43 +0000
Received: by pbcxa12 with SMTP id xa12so7270407pbc.35
for <common-dev@hadoop.apache.org>; Tue, 21 Feb 2012 15:05:21 -0800 (PST)
Received-SPF: pass (google.com: domain of rhc.openmpi@gmail.com designates 10.68.135.134 as permitted sender) client-ip=10.68.135.134;
Authentication-Results: mr.google.com; spf=pass (google.com: domain of rhc.openmpi@gmail.com designates 10.68.135.134 as permitted sender) smtp.mail=rhc.openmpi@gmail.com; dkim=pass header.i=rhc.openmpi@gmail.com
Received: from mr.google.com ([10.68.135.134])
by 10.68.135.134 with SMTP id ps6mr81925325pbb.66.1329865521969 (num_hops = 1);
Tue, 21 Feb 2012 15:05:21 -0800 (PST)
DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed;
d=gmail.com; s=gamma;
h=sender:from:content-type:content-transfer-encoding:subject:date
:message-id:to:mime-version:x-mailer;
bh=BnvqyUzE4Opv5P/zR/49PUCTpFVhDa2KC3UphUyctaA=;
b=xqntfC1BGfPfwdA+QxwbXWP7TbER60nFI33CuTr8otJm0TX44iswY51jpDn/NPr34n
MnrbyK7tPgbOTPSHmkddla6YAUKnpAWCGTtNWJqH2TutB971EMVAWTelmQUIO6+4S/jv
LlsrECDYRcMrDcSBfEk046JrBw+tIm293yTtI=
Received: by 10.68.135.134 with SMTP id ps6mr67550729pbb.66.1329865521937;
Tue, 21 Feb 2012 15:05:21 -0800 (PST)
Received: from [192.168.1.10] (c-98-245-155-46.hsd1.co.comcast.net. [98.245.155.46])
by mx.google.com with ESMTPS id ld17sm17179803pbb.37.2012.02.21.15.05.19
(version=TLSv1/SSLv3 cipher=OTHER);
Tue, 21 Feb 2012 15:05:20 -0800 (PST)
Sender: Ralph Castain <rhc.openmpi@gmail.com>
From: Ralph Castain <rhc@open-mpi.org>
Content-Type: text/plain; charset=us-ascii
Content-Transfer-Encoding: quoted-printable
Subject: MPI Java bindings now available
Date: Tue, 21 Feb 2012 16:05:17 -0700
Message-Id: <F354BE80-DAA9-43DE-9503-EB80F2E01CBD@open-mpi.org>
To: Hadoop Devel <common-dev@hadoop.apache.org>
Mime-Version: 1.0 (Apple Message framework v1257)
X-Mailer: Apple Mail (2.1257)
X-Virus-Checked: Checked by ClamAV on apache.org
Hi folks
With support from EMC, several of us in the Open MPI community =
(including LANL, Cisco, HLRS, Oracle, and IBM) have integrated Java =
bindings into the Open MPI code. The new bindings are not part of a =
formal release as this time (will be in the upcoming 1.7 series), but =
can be obtained from the Open MPI web site at:
http://www.open-mpi.org/nightly/trunk/
Instructions on how to build the binding support, build and run =
applications, etc. can be found in our FAQ section:
http://www.open-mpi.org/faq/?category=3Djava
Please feel free to post questions and bug reports to the OMPI User =
mailing list:
http://www.open-mpi.org/community/lists/ompi.php
I hope to release a version of Hamster in the not-too-distant future, =
once I finally get the 0.23 Hadoop release branch to successfully build =
and run on at least one of my machines (I've given up on the trunk). :-/
Ralph
From common-dev-return-77815-apmail-hadoop-common-dev-archive=hadoop.apache.org@hadoop.apache.org Wed Feb 22 01:17:41 2012
Return-Path: <common-dev-return-77815-apmail-hadoop-common-dev-archive=hadoop.apache.org@hadoop.apache.org>
X-Original-To: apmail-hadoop-common-dev-archive@www.apache.org
Delivered-To: apmail-hadoop-common-dev-archive@www.apache.org
Received: from mail.apache.org (hermes.apache.org [140.211.11.3])
by minotaur.apache.org (Postfix) with SMTP id 3FA499551
for <apmail-hadoop-common-dev-archive@www.apache.org>; Wed, 22 Feb 2012 01:17:41 +0000 (UTC)
Received: (qmail 13620 invoked by uid 500); 22 Feb 2012 01:17:39 -0000
Delivered-To: apmail-hadoop-common-dev-archive@hadoop.apache.org
Received: (qmail 13564 invoked by uid 500); 22 Feb 2012 01:17:39 -0000
Mailing-List: contact common-dev-help@hadoop.apache.org; run by ezmlm
Precedence: bulk
List-Help: <mailto:common-dev-help@hadoop.apache.org>
List-Unsubscribe: <mailto:common-dev-unsubscribe@hadoop.apache.org>
List-Post: <mailto:common-dev@hadoop.apache.org>
List-Id: <common-dev.hadoop.apache.org>
Reply-To: common-dev@hadoop.apache.org
Delivered-To: mailing list common-dev@hadoop.apache.org
Received: (qmail 13556 invoked by uid 99); 22 Feb 2012 01:17:39 -0000
Received: from nike.apache.org (HELO nike.apache.org) (192.87.106.230)
by apache.org (qpsmtpd/0.29) with ESMTP; Wed, 22 Feb 2012 01:17:39 +0000
X-ASF-Spam-Status: No, hits=-0.7 required=5.0
tests=RCVD_IN_DNSWL_LOW,SPF_PASS
X-Spam-Check-By: apache.org
Received-SPF: pass (nike.apache.org: domain of tom@cloudera.com designates 209.85.214.176 as permitted sender)
Received: from [209.85.214.176] (HELO mail-tul01m020-f176.google.com) (209.85.214.176)
by apache.org (qpsmtpd/0.29) with ESMTP; Wed, 22 Feb 2012 01:17:31 +0000
Received: by obbwd18 with SMTP id wd18so12946897obb.35
for <common-dev@hadoop.apache.org>; Tue, 21 Feb 2012 17:17:10 -0800 (PST)
Received-SPF: pass (google.com: domain of tom@cloudera.com designates 10.182.14.97 as permitted sender) client-ip=10.182.14.97;
Authentication-Results: mr.google.com; spf=pass (google.com: domain of tom@cloudera.com designates 10.182.14.97 as permitted sender) smtp.mail=tom@cloudera.com
Received: from mr.google.com ([10.182.14.97])
by 10.182.14.97 with SMTP id o1mr16847372obc.57.1329873430314 (num_hops = 1);
Tue, 21 Feb 2012 17:17:10 -0800 (PST)
Received: by 10.182.14.97 with SMTP id o1mr14337974obc.57.1329873430236; Tue,
21 Feb 2012 17:17:10 -0800 (PST)
MIME-Version: 1.0
Received: by 10.60.46.67 with HTTP; Tue, 21 Feb 2012 17:16:50 -0800 (PST)
In-Reply-To: <CA+z3+9HrBBf2___wSEk7M=HrzDRLsvHikqcR3Mx2ra6+3oMuwg@mail.gmail.com>
References: <CA+z3+9HrBBf2___wSEk7M=HrzDRLsvHikqcR3Mx2ra6+3oMuwg@mail.gmail.com>
From: Tom White <tom@cloudera.com>
Date: Tue, 21 Feb 2012 17:16:50 -0800
Message-ID: <CAF-WD4TN+STTBOBgF1F_m1EU_0GCg8t+BTtJ0wJTxkohL8afAw@mail.gmail.com>
Subject: Re: [VOTE] Hadoop-1.0.1 Release Candidate 1
To: common-dev@hadoop.apache.org
Content-Type: text/plain; charset=ISO-8859-1
Content-Transfer-Encoding: quoted-printable
X-Gm-Message-State: ALoCoQnJH9vKr3CAvNDCU/P2wNWMnnH8LOOuCTeczh9JNLb9PeZMPXssDBsIPUa+1M+YWzpvQYXk
X-Virus-Checked: Checked by ClamAV on apache.org
+1
Checked signatures and checksums, also ran a few jobs successfully.
Tom
On Tue, Feb 14, 2012 at 2:29 PM, Matt Foley <mattf@apache.org> wrote:
> Hi all,
> Hadoop-1.0.1-rc1 is now available at
> =A0 =A0http://people.apache.org/~mattf/hadoop-1.0.1-rc1/
> Please download it, test it, and vote on whether to accept it as Release
> 1.0.1.
> Voting will close at 2:30pm PST on Tuesday 21 February.
>
> Thank you,
> --Matt (Release Manager)
>
> This is a maintenance release from 1.0.0, but a number of
> production-relevant bug fixes were requested for inclusion in the last we=
ek
> or so. =A0The complete release notes are available at
>
> http://people.apache.org/~mattf/hadoop-1.0.1-rc1/RELEASE_NOTES_HADOOP-1.0=
.1.html
> The summary list is:
>
> =A0 - HADOOP-8009 <https://issues.apache.org/jira/browse/HADOOP-8009>.
> =A0 Create hadoop-client and hadoop-minicluster artifacts for downstream
> =A0 projects
> =A0 - HADOOP-8037 <https://issues.apache.org/jira/browse/HADOOP-8037>. Bi=
nary
> =A0 tarball does not preserve platform info for native builds, and RPMs f=
ail to
> =A0 provide needed symlinks for libhadoop.so
> =A0 - MAPREDUCE-3184
> <https://issues.apache.org/jira/browse/MAPREDUCE-3184>. Improve
> =A0 handling of fetch failures when a tasktracker is not responding on HT=
TP
> =A0 - HADOOP-7470 <https://issues.apache.org/jira/browse/HADOOP-7470>. mo=
ve
> =A0 up to Jackson 1.8.8
> =A0 - HADOOP-7960 <https://issues.apache.org/jira/browse/HADOOP-7960>. Po=
rt
> =A0 HADOOP-5203 to branch-1, build version comparison is too restrictive
> =A0 - HADOOP-7964 <https://issues.apache.org/jira/browse/HADOOP-7964>. De=
adlock
> =A0 in class init.
> =A0 - HADOOP-7987 <https://issues.apache.org/jira/browse/HADOOP-7987>. Su=
pport
> =A0 setting the run-as user in unsecure mode
> =A0 - HADOOP-7988 <https://issues.apache.org/jira/browse/HADOOP-7988>. Up=
per
> =A0 case in hostname part of the principals doesn't work with kerberos.
> =A0 - HADOOP-8010 <https://issues.apache.org/jira/browse/HADOOP-8010>.
> hadoop-config.sh
> =A0 spews error message when HADOOP_HOME_WARN_SUPPRESS is set to true and
> =A0 HADOOP_HOME is present
> =A0 - HADOOP-8052 <https://issues.apache.org/jira/browse/HADOOP-8052>. Ha=
doop
> =A0 Metrics2 should emit Float.MAX_VALUE (instead of Double.MAX_VALUE) to=
avoid
> =A0 making Ganglia's gmetad core
> =A0 - HDFS-2379 <https://issues.apache.org/jira/browse/HDFS-2379>. 0.20:
> =A0 Allow block reports to proceed without holding FSDataset lock
> =A0 - HDFS-2814 <https://issues.apache.org/jira/browse/HDFS-2814>.
> NamenodeMXBean
> =A0 does not account for svn revision in the version information
> =A0 - MAPREDUCE-3343
> <https://issues.apache.org/jira/browse/MAPREDUCE-3343>. TaskTracker
> =A0 Out of Memory because of distributed cache
> =A0 - MAPREDUCE-3607
> <https://issues.apache.org/jira/browse/MAPREDUCE-3607>. Port
> =A0 missing new API mapreduce lib classes to 1.x
From common-dev-return-77816-apmail-hadoop-common-dev-archive=hadoop.apache.org@hadoop.apache.org Wed Feb 22 01:21:11 2012
Return-Path: <common-dev-return-77816-apmail-hadoop-common-dev-archive=hadoop.apache.org@hadoop.apache.org>
X-Original-To: apmail-hadoop-common-dev-archive@www.apache.org
Delivered-To: apmail-hadoop-common-dev-archive@www.apache.org
Received: from mail.apache.org (hermes.apache.org [140.211.11.3])
by minotaur.apache.org (Postfix) with SMTP id 9930695F0
for <apmail-hadoop-common-dev-archive@www.apache.org>; Wed, 22 Feb 2012 01:21:11 +0000 (UTC)
Received: (qmail 22103 invoked by uid 500); 22 Feb 2012 01:21:09 -0000
Delivered-To: apmail-hadoop-common-dev-archive@hadoop.apache.org
Received: (qmail 22010 invoked by uid 500); 22 Feb 2012 01:21:09 -0000
Mailing-List: contact common-dev-help@hadoop.apache.org; run by ezmlm
Precedence: bulk
List-Help: <mailto:common-dev-help@hadoop.apache.org>
List-Unsubscribe: <mailto:common-dev-unsubscribe@hadoop.apache.org>
List-Post: <mailto:common-dev@hadoop.apache.org>
List-Id: <common-dev.hadoop.apache.org>
Reply-To: common-dev@hadoop.apache.org
Delivered-To: mailing list common-dev@hadoop.apache.org
Received: (qmail 21769 invoked by uid 99); 22 Feb 2012 01:21:09 -0000
Received: from athena.apache.org (HELO athena.apache.org) (140.211.11.136)
by apache.org (qpsmtpd/0.29) with ESMTP; Wed, 22 Feb 2012 01:21:09 +0000
X-ASF-Spam-Status: No, hits=-2000.0 required=5.0
tests=ALL_TRUSTED,T_RP_MATCHES_RCVD
X-Spam-Check-By: apache.org
Received: from [140.211.11.116] (HELO hel.zones.apache.org) (140.211.11.116)
by apache.org (qpsmtpd/0.29) with ESMTP; Wed, 22 Feb 2012 01:21:08 +0000
Received: from hel.zones.apache.org (hel.zones.apache.org [140.211.11.116])
by hel.zones.apache.org (Postfix) with ESMTP id A1CA61C3317
for <common-dev@hadoop.apache.org>; Wed, 22 Feb 2012 01:20:48 +0000 (UTC)
Date: Wed, 22 Feb 2012 01:20:48 +0000 (UTC)
From: "Ralph H Castain (Created) (JIRA)" <jira@apache.org>
To: common-dev@hadoop.apache.org
Message-ID: <105816105.2181.1329873648664.JavaMail.tomcat@hel.zones.apache.org>
Subject: [jira] [Created] (HADOOP-8099) Change to nodemanager build now
requires 32-bit libraries
MIME-Version: 1.0
Content-Type: text/plain; charset=utf-8
Content-Transfer-Encoding: 7bit
X-JIRA-FingerPrint: 30527f35849b9dde25b450d4833f0394
Change to nodemanager build now requires 32-bit libraries
---------------------------------------------------------
Key: HADOOP-8099
URL: https://issues.apache.org/jira/browse/HADOOP-8099
Project: Hadoop Common
Issue Type: Bug
Affects Versions: 0.23.0
Environment: Centos 6, x86_64
Reporter: Ralph H Castain
Sometime during the last week, someone committed a change to:
hadoop-mapreduce-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-nodemanager/pom.xml
that inserted a -m32 in:
<configureEnvironment>
<property>
<name>CFLAGS</name>
<value>-DHADOOP_CONF_DIR=${container-executor.conf.dir} -m32</value>
This breaks the build on 64-bit systems that do not have 32-bit libraries installed. The change was actually not required as 64-bit support for JNI and JVMs is readily available and installed by default on many 64-bit systems. Removing the flag results in a completed and functional build.
If mandating 32-bit builds is desired, then a better solution would be to provide a configure flag such as -DHADOOP_32bit_MODE, perhaps with a corresponding flag for 64-bit. Regardless, locking the system to 32-bit builds seems a tad extreme.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
From common-dev-return-77817-apmail-hadoop-common-dev-archive=hadoop.apache.org@hadoop.apache.org Wed Feb 22 09:19:23 2012
Return-Path: <common-dev-return-77817-apmail-hadoop-common-dev-archive=hadoop.apache.org@hadoop.apache.org>
X-Original-To: apmail-hadoop-common-dev-archive@www.apache.org
Delivered-To: apmail-hadoop-common-dev-archive@www.apache.org
Received: from mail.apache.org (hermes.apache.org [140.211.11.3])
by minotaur.apache.org (Postfix) with SMTP id 50F529617
for <apmail-hadoop-common-dev-archive@www.apache.org>; Wed, 22 Feb 2012 09:19:23 +0000 (UTC)
Received: (qmail 24051 invoked by uid 500); 22 Feb 2012 09:19:21 -0000
Delivered-To: apmail-hadoop-common-dev-archive@hadoop.apache.org
Received: (qmail 23976 invoked by uid 500); 22 Feb 2012 09:19:20 -0000
Mailing-List: contact common-dev-help@hadoop.apache.org; run by ezmlm
Precedence: bulk
List-Help: <mailto:common-dev-help@hadoop.apache.org>
List-Unsubscribe: <mailto:common-dev-unsubscribe@hadoop.apache.org>
List-Post: <mailto:common-dev@hadoop.apache.org>
List-Id: <common-dev.hadoop.apache.org>
Reply-To: common-dev@hadoop.apache.org
Delivered-To: mailing list common-dev@hadoop.apache.org
Received: (qmail 23965 invoked by uid 99); 22 Feb 2012 09:19:20 -0000
Received: from athena.apache.org (HELO athena.apache.org) (140.211.11.136)
by apache.org (qpsmtpd/0.29) with ESMTP; Wed, 22 Feb 2012 09:19:20 +0000
X-ASF-Spam-Status: No, hits=-2000.0 required=5.0
tests=ALL_TRUSTED
X-Spam-Check-By: apache.org
Received: from [140.211.11.8] (HELO aegis.apache.org) (140.211.11.8)
by apache.org (qpsmtpd/0.29) with ESMTP; Wed, 22 Feb 2012 09:19:18 +0000
Received: from aegis (localhost [127.0.0.1])
by aegis.apache.org (Postfix) with ESMTP id 78DFCC0005
for <common-dev@hadoop.apache.org>; Wed, 22 Feb 2012 09:18:58 +0000 (UTC)
Date: Wed, 22 Feb 2012 09:18:58 +0000 (UTC)
From: Apache Jenkins Server <jenkins@builds.apache.org>
To: common-dev@hadoop.apache.org
Message-ID: <938458627.1351329902338479.JavaMail.hudson@aegis>
Subject: Build failed in Jenkins: Hadoop-Common-0.23-Build #171
MIME-Version: 1.0
Content-Type: text/plain; charset=UTF-8
Content-Transfer-Encoding: 7bit
X-Jenkins-Job: Hadoop-Common-0.23-Build
X-Jenkins-Result: FAILURE
See <https://builds.apache.org/job/Hadoop-Common-0.23-Build/171/>
------------------------------------------
[...truncated 12270 lines...]
[javadoc] Loading source files for package org.apache.hadoop.fs.permission...
[javadoc] Loading source files for package org.apache.hadoop.fs.s3...
[javadoc] Loading source files for package org.apache.hadoop.fs.s3native...
[javadoc] Loading source files for package org.apache.hadoop.fs.shell...
[javadoc] Loading source files for package org.apache.hadoop.fs.viewfs...
[javadoc] Loading source files for package org.apache.hadoop.http...
[javadoc] Loading source files for package org.apache.hadoop.http.lib...
[javadoc] Loading source files for package org.apache.hadoop.io...
[javadoc] Loading source files for package org.apache.hadoop.io.compress...
[javadoc] Loading source files for package org.apache.hadoop.io.compress.bzip2...
[javadoc] Loading source files for package org.apache.hadoop.io.compress.lz4...
[javadoc] Loading source files for package org.apache.hadoop.io.compress.snappy...
[javadoc] Loading source files for package org.apache.hadoop.io.compress.zlib...
[javadoc] Loading source files for package org.apache.hadoop.io.file.tfile...
[javadoc] Loading source files for package org.apache.hadoop.io.nativeio...
[javadoc] Loading source files for package org.apache.hadoop.io.retry...
[javadoc] Loading source files for package org.apache.hadoop.io.serializer...
[javadoc] Loading source files for package org.apache.hadoop.io.serializer.avro...
[javadoc] Loading source files for package org.apache.hadoop.ipc...
[javadoc] Loading source files for package org.apache.hadoop.ipc.metrics...
[javadoc] Loading source files for package org.apache.hadoop.jmx...
[javadoc] Loading source files for package org.apache.hadoop.log...
[javadoc] Loading source files for package org.apache.hadoop.log.metrics...
[javadoc] Loading source files for package org.apache.hadoop.metrics...
[javadoc] Loading source files for package org.apache.hadoop.metrics.file...
[javadoc] Loading source files for package org.apache.hadoop.metrics.ganglia...
[javadoc] Loading source files for package org.apache.hadoop.metrics.jvm...
[javadoc] Loading source files for package org.apache.hadoop.metrics.spi...
[javadoc] Loading source files for package org.apache.hadoop.metrics.util...
[javadoc] Loading source files for package org.apache.hadoop.metrics2...
[javadoc] Loading source files for package org.apache.hadoop.metrics2.annotation...
[javadoc] Loading source files for package org.apache.hadoop.metrics2.filter...
[javadoc] Loading source files for package org.apache.hadoop.metrics2.impl...
[javadoc] Loading source files for package org.apache.hadoop.metrics2.lib...
[javadoc] Loading source files for package org.apache.hadoop.metrics2.sink...
[javadoc] Loading source files for package org.apache.hadoop.metrics2.sink.ganglia...
[javadoc] Loading source files for package org.apache.hadoop.metrics2.source...
[javadoc] Loading source files for package org.apache.hadoop.metrics2.util...
[javadoc] Loading source files for package org.apache.hadoop.net...
[javadoc] Loading source files for package org.apache.hadoop.record...
[javadoc] Loading source files for package org.apache.hadoop.record.compiler...
[javadoc] Loading source files for package org.apache.hadoop.record.compiler.ant...
[javadoc] Loading source files for package org.apache.hadoop.record.compiler.generated...
[javadoc] Loading source files for package org.apache.hadoop.record.meta...
[javadoc] Loading source files for package org.apache.hadoop.security...
[javadoc] Loading source files for package org.apache.hadoop.security.authorize...
[javadoc] Loading source files for package org.apache.hadoop.security.token...
[javadoc] Loading source files for package org.apache.hadoop.security.token.delegation...
[javadoc] Loading source files for package org.apache.hadoop.tools...
[javadoc] Loading source files for package org.apache.hadoop.util...
[javadoc] Loading source files for package org.apache.hadoop.util.bloom...
[javadoc] Loading source files for package org.apache.hadoop.util.hash...
[javadoc] 2 errors
[xslt] Processing <https://builds.apache.org/job/Hadoop-Common-0.23-Build/ws/trunk/hadoop-common-project/hadoop-common/target/findbugsXml.xml> to <https://builds.apache.org/job/Hadoop-Common-0.23-Build/ws/trunk/hadoop-common-project/hadoop-common/target/site/findbugs.html>
[xslt] Loading stylesheet /home/jenkins/tools/findbugs/latest/src/xsl/default.xsl
[INFO] Executed tasks
[INFO]
[INFO] --- maven-antrun-plugin:1.6:run (pre-dist) @ hadoop-common ---
[INFO] Executing tasks
main:
[INFO] Executed tasks
[INFO]
[INFO] >>> maven-javadoc-plugin:2.8.1:javadoc (default) @ hadoop-common >>>
[INFO]
[INFO] --- maven-antrun-plugin:1.6:run (create-testdirs) @ hadoop-common ---
[INFO] Executing tasks
main:
[INFO] Executed tasks
[INFO]
[INFO] --- build-helper-maven-plugin:1.5:add-source (add-source) @ hadoop-common ---
[INFO] Source directory: <https://builds.apache.org/job/Hadoop-Common-0.23-Build/ws/trunk/hadoop-common-project/hadoop-common/target/generated-sources/java> added.
[INFO]
[INFO] --- maven-antrun-plugin:1.6:run (compile-proto) @ hadoop-common ---
[INFO] Executing tasks
main:
[INFO] Executed tasks
[INFO]
[INFO] --- maven-antrun-plugin:1.6:run (save-version) @ hadoop-common ---
[INFO] Executing tasks
main:
[INFO] Executed tasks
[INFO]
[INFO] <<< maven-javadoc-plugin:2.8.1:javadoc (default) @ hadoop-common <<<
[INFO]
[INFO] --- maven-javadoc-plugin:2.8.1:javadoc (default) @ hadoop-common ---
[INFO]
ExcludePrivateAnnotationsStandardDoclet
9 warnings
[WARNING] Javadoc Warnings
[WARNING] <https://builds.apache.org/job/Hadoop-Common-0.23-Build/ws/trunk/hadoop-common-project/hadoop-common/src/main/java/org/apache/hadoop/io/FastByteComparisons.java>:25: warning: sun.misc.Unsafe is Sun proprietary API and may be removed in a future release
[WARNING] import sun.misc.Unsafe;
[WARNING] ^
[WARNING] <https://builds.apache.org/job/Hadoop-Common-0.23-Build/ws/trunk/hadoop-common-project/hadoop-common/src/main/java/org/apache/hadoop/io/FastByteComparisons.java>:117: warning: sun.misc.Unsafe is Sun proprietary API and may be removed in a future release
[WARNING] static final Unsafe theUnsafe;
[WARNING] ^
[WARNING] <https://builds.apache.org/job/Hadoop-Common-0.23-Build/ws/trunk/hadoop-common-project/hadoop-common/src/main/java/org/apache/hadoop/security/SecurityUtil.java>:49: warning: sun.net.dns.ResolverConfiguration is Sun proprietary API and may be removed in a future release
[WARNING] import sun.net.dns.ResolverConfiguration;
[WARNING] ^
[WARNING] <https://builds.apache.org/job/Hadoop-Common-0.23-Build/ws/trunk/hadoop-common-project/hadoop-common/src/main/java/org/apache/hadoop/security/SecurityUtil.java>:50: warning: sun.net.util.IPAddressUtil is Sun proprietary API and may be removed in a future release
[WARNING] import sun.net.util.IPAddressUtil;
[WARNING] ^
[WARNING] <https://builds.apache.org/job/Hadoop-Common-0.23-Build/ws/trunk/hadoop-common-project/hadoop-common/src/main/java/org/apache/hadoop/security/SecurityUtil.java>:51: warning: sun.security.jgss.krb5.Krb5Util is Sun proprietary API and may be removed in a future release
[WARNING] import sun.security.jgss.krb5.Krb5Util;
[WARNING] ^
[WARNING] <https://builds.apache.org/job/Hadoop-Common-0.23-Build/ws/trunk/hadoop-common-project/hadoop-common/src/main/java/org/apache/hadoop/security/SecurityUtil.java>:52: warning: sun.security.krb5.Credentials is Sun proprietary API and may be removed in a future release
[WARNING] import sun.security.krb5.Credentials;
[WARNING] ^
[WARNING] <https://builds.apache.org/job/Hadoop-Common-0.23-Build/ws/trunk/hadoop-common-project/hadoop-common/src/main/java/org/apache/hadoop/security/SecurityUtil.java>:53: warning: sun.security.krb5.PrincipalName is Sun proprietary API and may be removed in a future release
[WARNING] import sun.security.krb5.PrincipalName;
[WARNING] ^
[WARNING] <https://builds.apache.org/job/Hadoop-Common-0.23-Build/ws/trunk/hadoop-common-project/hadoop-common/src/main/java/org/apache/hadoop/security/HadoopKerberosName.java>:28: warning: sun.security.krb5.Config is Sun proprietary API and may be removed in a future release
[WARNING] import sun.security.krb5.Config;
[WARNING] ^
[WARNING] <https://builds.apache.org/job/Hadoop-Common-0.23-Build/ws/trunk/hadoop-common-project/hadoop-common/src/main/java/org/apache/hadoop/security/HadoopKerberosName.java>:29: warning: sun.security.krb5.KrbException is Sun proprietary API and may be removed in a future release
[WARNING] import sun.security.krb5.KrbException;
[WARNING] ^
[INFO]
[INFO] --- maven-assembly-plugin:2.2.1:single (dist) @ hadoop-common ---
[WARNING] The following patterns were never triggered in this artifact exclusion filter:
o 'org.apache.ant:*:jar'
o 'jdiff:jdiff:jar'
[INFO] share/hadoop/common/jdiff/ already added, skipping
[INFO] Copying files to <https://builds.apache.org/job/Hadoop-Common-0.23-Build/ws/trunk/hadoop-common-project/hadoop-common/target/hadoop-common-0.23.2-SNAPSHOT>
[INFO] share/hadoop/common/jdiff/ already added, skipping
[INFO]
[INFO] --- maven-jar-plugin:2.3.1:jar (default-jar) @ hadoop-common ---
[INFO]
[INFO] --- maven-source-plugin:2.1.2:jar-no-fork (hadoop-java-sources) @ hadoop-common ---
[INFO] org already added, skipping
[INFO] org/apache already added, skipping
[INFO] org/apache/hadoop already added, skipping
[INFO] Building jar: <https://builds.apache.org/job/Hadoop-Common-0.23-Build/ws/trunk/hadoop-common-project/hadoop-common/target/hadoop-common-0.23.2-SNAPSHOT-sources.jar>
[INFO] org already added, skipping
[INFO] org/apache already added, skipping
[INFO] org/apache/hadoop already added, skipping
[WARNING] Artifact org.apache.hadoop:hadoop-common:java-source:sources:0.23.2-SNAPSHOT already attached to project, ignoring duplicate
[INFO]
[INFO] --- maven-site-plugin:3.0:attach-descriptor (attach-descriptor) @ hadoop-common ---
[INFO]
[INFO] --- maven-antrun-plugin:1.6:run (tar) @ hadoop-common ---
[INFO] Executing tasks
main:
[INFO] Executed tasks
[INFO]
[INFO] --- maven-javadoc-plugin:2.8.1:jar (module-javadocs) @ hadoop-common ---
[INFO]
ExcludePrivateAnnotationsStandardDoclet
9 warnings
[WARNING] Javadoc Warnings
[WARNING] <https://builds.apache.org/job/Hadoop-Common-0.23-Build/ws/trunk/hadoop-common-project/hadoop-common/src/main/java/org/apache/hadoop/io/FastByteComparisons.java>:25: warning: sun.misc.Unsafe is Sun proprietary API and may be removed in a future release
[WARNING] import sun.misc.Unsafe;
[WARNING] ^
[WARNING] <https://builds.apache.org/job/Hadoop-Common-0.23-Build/ws/trunk/hadoop-common-project/hadoop-common/src/main/java/org/apache/hadoop/io/FastByteComparisons.java>:117: warning: sun.misc.Unsafe is Sun proprietary API and may be removed in a future release
[WARNING] static final Unsafe theUnsafe;
[WARNING] ^
[WARNING] <https://builds.apache.org/job/Hadoop-Common-0.23-Build/ws/trunk/hadoop-common-project/hadoop-common/src/main/java/org/apache/hadoop/security/SecurityUtil.java>:49: warning: sun.net.dns.ResolverConfiguration is Sun proprietary API and may be removed in a future release
[WARNING] import sun.net.dns.ResolverConfiguration;
[WARNING] ^
[WARNING] <https://builds.apache.org/job/Hadoop-Common-0.23-Build/ws/trunk/hadoop-common-project/hadoop-common/src/main/java/org/apache/hadoop/security/SecurityUtil.java>:50: warning: sun.net.util.IPAddressUtil is Sun proprietary API and may be removed in a future release
[WARNING] import sun.net.util.IPAddressUtil;
[WARNING] ^
[WARNING] <https://builds.apache.org/job/Hadoop-Common-0.23-Build/ws/trunk/hadoop-common-project/hadoop-common/src/main/java/org/apache/hadoop/security/SecurityUtil.java>:51: warning: sun.security.jgss.krb5.Krb5Util is Sun proprietary API and may be removed in a future release
[WARNING] import sun.security.jgss.krb5.Krb5Util;
[WARNING] ^
[WARNING] <https://builds.apache.org/job/Hadoop-Common-0.23-Build/ws/trunk/hadoop-common-project/hadoop-common/src/main/java/org/apache/hadoop/security/SecurityUtil.java>:52: warning: sun.security.krb5.Credentials is Sun proprietary API and may be removed in a future release
[WARNING] import sun.security.krb5.Credentials;
[WARNING] ^
[WARNING] <https://builds.apache.org/job/Hadoop-Common-0.23-Build/ws/trunk/hadoop-common-project/hadoop-common/src/main/java/org/apache/hadoop/security/SecurityUtil.java>:53: warning: sun.security.krb5.PrincipalName is Sun proprietary API and may be removed in a future release
[WARNING] import sun.security.krb5.PrincipalName;
[WARNING] ^
[WARNING] <https://builds.apache.org/job/Hadoop-Common-0.23-Build/ws/trunk/hadoop-common-project/hadoop-common/src/main/java/org/apache/hadoop/security/HadoopKerberosName.java>:28: warning: sun.security.krb5.Config is Sun proprietary API and may be removed in a future release
[WARNING] import sun.security.krb5.Config;
[WARNING] ^
[WARNING] <https://builds.apache.org/job/Hadoop-Common-0.23-Build/ws/trunk/hadoop-common-project/hadoop-common/src/main/java/org/apache/hadoop/security/HadoopKerberosName.java>:29: warning: sun.security.krb5.KrbException is Sun proprietary API and may be removed in a future release
[WARNING] import sun.security.krb5.KrbException;
[WARNING] ^
[INFO] Building jar: <https://builds.apache.org/job/Hadoop-Common-0.23-Build/ws/trunk/hadoop-common-project/hadoop-common/target/hadoop-common-0.23.2-SNAPSHOT-javadoc.jar>
[INFO]
[INFO] --- maven-checkstyle-plugin:2.6:checkstyle (default-cli) @ hadoop-common ---
[INFO]
[INFO] There are 8472 checkstyle errors.
[WARNING] Unable to locate Source XRef to link to - DISABLED
[INFO]
[INFO] --- findbugs-maven-plugin:2.3.2:findbugs (default-cli) @ hadoop-common ---
[INFO] ****** FindBugsMojo execute *******
[INFO] canGenerate is true
[INFO] ****** FindBugsMojo executeFindbugs *******
[INFO] Temp File is <https://builds.apache.org/job/Hadoop-Common-0.23-Build/ws/trunk/hadoop-common-project/hadoop-common/target/findbugsTemp.xml>
[INFO] Fork Value is true
[java] The following classes needed for analysis were missing:
[java] org.codehaus.jackson.FormatSchema
[java] org.codehaus.jackson.format.InputAccessor
[java] Missing classes: 1
[INFO] xmlOutput is false
[INFO]
[INFO] ------------------------------------------------------------------------
[INFO] Building Apache Hadoop Common Project 0.23.2-SNAPSHOT
[INFO] ------------------------------------------------------------------------
[INFO]
[INFO] --- maven-clean-plugin:2.4.1:clean (default-clean) @ hadoop-common-project ---
[INFO] Deleting <https://builds.apache.org/job/Hadoop-Common-0.23-Build/ws/trunk/hadoop-common-project/target>
[INFO]
[INFO] --- maven-antrun-plugin:1.6:run (create-testdirs) @ hadoop-common-project ---
[INFO] Executing tasks
main:
[mkdir] Created dir: <https://builds.apache.org/job/Hadoop-Common-0.23-Build/ws/trunk/hadoop-common-project/target/test-dir>
[INFO] Executed tasks
[INFO]
[INFO] --- maven-source-plugin:2.1.2:jar-no-fork (hadoop-java-sources) @ hadoop-common-project ---
[INFO]
[INFO] --- maven-site-plugin:3.0:attach-descriptor (attach-descriptor) @ hadoop-common-project ---
[INFO]
[INFO] --- maven-javadoc-plugin:2.8.1:jar (module-javadocs) @ hadoop-common-project ---
[INFO] Not executing Javadoc as the project is not a Java classpath-capable package
[INFO]
[INFO] --- maven-checkstyle-plugin:2.6:checkstyle (default-cli) @ hadoop-common-project ---
[INFO]
[INFO] --- findbugs-maven-plugin:2.3.2:findbugs (default-cli) @ hadoop-common-project ---
[INFO] ****** FindBugsMojo execute *******
[INFO] canGenerate is false
[INFO] ------------------------------------------------------------------------
[INFO] Reactor Summary:
[INFO]
[INFO] Apache Hadoop Annotations ......................... SUCCESS [12.639s]
[INFO] Apache Hadoop Auth ................................ SUCCESS [20.295s]
[INFO] Apache Hadoop Auth Examples ....................... SUCCESS [8.059s]
[INFO] Apache Hadoop Common .............................. SUCCESS [3:56.549s]
[INFO] Apache Hadoop Common Project ...................... SUCCESS [0.036s]
[INFO] ------------------------------------------------------------------------
[INFO] BUILD SUCCESS
[INFO] ------------------------------------------------------------------------
[INFO] Total time: 4:38.606s
[INFO] Finished at: Wed Feb 22 09:09:03 UTC 2012
[INFO] Final Memory: 80M/786M
[INFO] ------------------------------------------------------------------------
+ /home/jenkins/tools/maven/latest/bin/mvn test -Pclover -DcloverLicenseLocation=/home/jenkins/tools/clover/latest/lib/clover.license
Build step 'Execute shell' marked build as failure
[WARNINGS] Skipping publisher since build result is FAILURE
Archiving artifacts
Recording fingerprints
Publishing Javadoc
Recording test results
From common-dev-return-77818-apmail-hadoop-common-dev-archive=hadoop.apache.org@hadoop.apache.org Wed Feb 22 09:25:27 2012
Return-Path: <common-dev-return-77818-apmail-hadoop-common-dev-archive=hadoop.apache.org@hadoop.apache.org>
X-Original-To: apmail-hadoop-common-dev-archive@www.apache.org
Delivered-To: apmail-hadoop-common-dev-archive@www.apache.org
Received: from mail.apache.org (hermes.apache.org [140.211.11.3])
by minotaur.apache.org (Postfix) with SMTP id 3AD279F19
for <apmail-hadoop-common-dev-archive@www.apache.org>; Wed, 22 Feb 2012 09:25:27 +0000 (UTC)
Received: (qmail 42154 invoked by uid 500); 22 Feb 2012 09:25:25 -0000
Delivered-To: apmail-hadoop-common-dev-archive@hadoop.apache.org
Received: (qmail 42104 invoked by uid 500); 22 Feb 2012 09:25:25 -0000
Mailing-List: contact common-dev-help@hadoop.apache.org; run by ezmlm
Precedence: bulk
List-Help: <mailto:common-dev-help@hadoop.apache.org>
List-Unsubscribe: <mailto:common-dev-unsubscribe@hadoop.apache.org>
List-Post: <mailto:common-dev@hadoop.apache.org>
List-Id: <common-dev.hadoop.apache.org>
Reply-To: common-dev@hadoop.apache.org
Delivered-To: mailing list common-dev@hadoop.apache.org
Received: (qmail 42096 invoked by uid 99); 22 Feb 2012 09:25:25 -0000
Received: from athena.apache.org (HELO athena.apache.org) (140.211.11.136)
by apache.org (qpsmtpd/0.29) with ESMTP; Wed, 22 Feb 2012 09:25:25 +0000
X-ASF-Spam-Status: No, hits=-2000.0 required=5.0
tests=ALL_TRUSTED
X-Spam-Check-By: apache.org
Received: from [140.211.11.8] (HELO aegis.apache.org) (140.211.11.8)
by apache.org (qpsmtpd/0.29) with ESMTP; Wed, 22 Feb 2012 09:25:24 +0000
Received: from aegis (localhost [127.0.0.1])
by aegis.apache.org (Postfix) with ESMTP id 69F0AC0005
for <common-dev@hadoop.apache.org>; Wed, 22 Feb 2012 09:25:02 +0000 (UTC)
Date: Wed, 22 Feb 2012 09:25:02 +0000 (UTC)
From: Apache Jenkins Server <jenkins@builds.apache.org>
To: common-dev@hadoop.apache.org
Message-ID: <1198312171.1411329902702432.JavaMail.hudson@aegis>
In-Reply-To: <572130923.5201329820273416.JavaMail.hudson@aegis>
References: <572130923.5201329820273416.JavaMail.hudson@aegis>
Subject: Jenkins build is back to normal : Hadoop-Common-trunk #325
MIME-Version: 1.0
Content-Type: text/plain; charset=UTF-8
Content-Transfer-Encoding: 7bit
X-Jenkins-Job: Hadoop-Common-trunk
X-Jenkins-Result: SUCCESS
See <https://builds.apache.org/job/Hadoop-Common-trunk/325/>
From common-dev-return-77819-apmail-hadoop-common-dev-archive=hadoop.apache.org@hadoop.apache.org Wed Feb 22 14:39:38 2012
Return-Path: <common-dev-return-77819-apmail-hadoop-common-dev-archive=hadoop.apache.org@hadoop.apache.org>
X-Original-To: apmail-hadoop-common-dev-archive@www.apache.org
Delivered-To: apmail-hadoop-common-dev-archive@www.apache.org
Received: from mail.apache.org (hermes.apache.org [140.211.11.3])
by minotaur.apache.org (Postfix) with SMTP id BE9D79B55
for <apmail-hadoop-common-dev-archive@www.apache.org>; Wed, 22 Feb 2012 14:39:38 +0000 (UTC)
Received: (qmail 9679 invoked by uid 500); 22 Feb 2012 14:39:37 -0000
Delivered-To: apmail-hadoop-common-dev-archive@hadoop.apache.org
Received: (qmail 9619 invoked by uid 500); 22 Feb 2012 14:39:37 -0000
Mailing-List: contact common-dev-help@hadoop.apache.org; run by ezmlm
Precedence: bulk
List-Help: <mailto:common-dev-help@hadoop.apache.org>
List-Unsubscribe: <mailto:common-dev-unsubscribe@hadoop.apache.org>
List-Post: <mailto:common-dev@hadoop.apache.org>
List-Id: <common-dev.hadoop.apache.org>
Reply-To: common-dev@hadoop.apache.org
Delivered-To: mailing list common-dev@hadoop.apache.org
Received: (qmail 9611 invoked by uid 500); 22 Feb 2012 14:39:37 -0000
Delivered-To: apmail-hadoop-core-dev@hadoop.apache.org
Received: (qmail 9602 invoked by uid 99); 22 Feb 2012 14:39:37 -0000
Received: from nike.apache.org (HELO nike.apache.org) (192.87.106.230)
by apache.org (qpsmtpd/0.29) with ESMTP; Wed, 22 Feb 2012 14:39:37 +0000
X-ASF-Spam-Status: No, hits=-0.0 required=5.0
tests=SPF_PASS
X-Spam-Check-By: apache.org
Received-SPF: pass (nike.apache.org: domain of lists@nabble.com designates 216.139.236.26 as permitted sender)
Received: from [216.139.236.26] (HELO sam.nabble.com) (216.139.236.26)
by apache.org (qpsmtpd/0.29) with ESMTP; Wed, 22 Feb 2012 14:39:29 +0000
Received: from isper.nabble.com ([192.168.236.156])
by sam.nabble.com with esmtp (Exim 4.72)
(envelope-from <lists@nabble.com>)
id 1S0DLY-0007Wm-IJ
for core-dev@hadoop.apache.org; Wed, 22 Feb 2012 06:39:08 -0800
Message-ID: <33363940.post@talk.nabble.com>
Date: Wed, 22 Feb 2012 06:39:08 -0800 (PST)
From: Stormz <yasin.mustafa@gmail.com>
To: core-dev@hadoop.apache.org
Subject: Getting the Eclipse MapReduce plugin to work (Hadoop 0.20.2)
MIME-Version: 1.0
Content-Type: text/plain; charset=us-ascii
Content-Transfer-Encoding: 7bit
X-Nabble-From: yasin.mustafa@gmail.com
X-Virus-Checked: Checked by ClamAV on apache.org
Hi Guys,
Has anyone managed to get the eclipse plugin to work?? I downloaded the
plugin from https://issues.apache.org/jira/browse/MAPREDUCE-1280
and have used eclipse Helios 3.6.1 (according to comments in the JIRA this
version of eclipse should work).
I installed hadoop using the cloudera manager (everything on a single
machine). The ports I'm using to set up the hadoop location in eclipse are
the default ones set by Cloudera Manager i.e. 8020 for the NameNode and 8021
for the JobTracker.
However when I try to browse the file structure I get the following
exception:
Error: Call to localhost/127.0.0.1:8020 failed on local
exception:java.io.EOFException
Any help would be appreciated.
Thanks
Stormz
--
View this message in context: http://old.nabble.com/Getting-the-Eclipse-MapReduce-plugin-to-work-%28Hadoop-0.20.2%29-tp33363940p33363940.html
Sent from the Hadoop core-dev mailing list archive at Nabble.com.
From common-dev-return-77820-apmail-hadoop-common-dev-archive=hadoop.apache.org@hadoop.apache.org Wed Feb 22 16:14:19 2012
Return-Path: <common-dev-return-77820-apmail-hadoop-common-dev-archive=hadoop.apache.org@hadoop.apache.org>
X-Original-To: apmail-hadoop-common-dev-archive@www.apache.org
Delivered-To: apmail-hadoop-common-dev-archive@www.apache.org
Received: from mail.apache.org (hermes.apache.org [140.211.11.3])
by minotaur.apache.org (Postfix) with SMTP id 0118492DA
for <apmail-hadoop-common-dev-archive@www.apache.org>; Wed, 22 Feb 2012 16:14:19 +0000 (UTC)
Received: (qmail 68339 invoked by uid 500); 22 Feb 2012 16:14:17 -0000
Delivered-To: apmail-hadoop-common-dev-archive@hadoop.apache.org
Received: (qmail 68271 invoked by uid 500); 22 Feb 2012 16:14:17 -0000
Mailing-List: contact common-dev-help@hadoop.apache.org; run by ezmlm
Precedence: bulk
List-Help: <mailto:common-dev-help@hadoop.apache.org>
List-Unsubscribe: <mailto:common-dev-unsubscribe@hadoop.apache.org>
List-Post: <mailto:common-dev@hadoop.apache.org>
List-Id: <common-dev.hadoop.apache.org>
Reply-To: common-dev@hadoop.apache.org
Delivered-To: mailing list common-dev@hadoop.apache.org
Received: (qmail 68259 invoked by uid 99); 22 Feb 2012 16:14:17 -0000
Received: from nike.apache.org (HELO nike.apache.org) (192.87.106.230)
by apache.org (qpsmtpd/0.29) with ESMTP; Wed, 22 Feb 2012 16:14:17 +0000
X-ASF-Spam-Status: No, hits=-2000.0 required=5.0
tests=ALL_TRUSTED,T_RP_MATCHES_RCVD
X-Spam-Check-By: apache.org
Received: from [140.211.11.116] (HELO hel.zones.apache.org) (140.211.11.116)
by apache.org (qpsmtpd/0.29) with ESMTP; Wed, 22 Feb 2012 16:14:10 +0000
Received: from hel.zones.apache.org (hel.zones.apache.org [140.211.11.116])
by hel.zones.apache.org (Postfix) with ESMTP id 8B58A334C87
for <common-dev@hadoop.apache.org>; Wed, 22 Feb 2012 16:13:49 +0000 (UTC)
Date: Wed, 22 Feb 2012 16:13:49 +0000 (UTC)
From: "Kihwal Lee (Resolved) (JIRA)" <jira@apache.org>
To: common-dev@hadoop.apache.org
Message-ID: <1923052813.4713.1329927229572.JavaMail.tomcat@hel.zones.apache.org>
In-Reply-To: <1832977634.21006.1328819457350.JavaMail.tomcat@hel.zones.apache.org>
Subject: [jira] [Resolved] (HADOOP-8050) Deadlock in metrics
MIME-Version: 1.0
Content-Type: text/plain; charset=utf-8
Content-Transfer-Encoding: 7bit
X-JIRA-FingerPrint: 30527f35849b9dde25b450d4833f0394
X-Virus-Checked: Checked by ClamAV on apache.org
[ https://issues.apache.org/jira/browse/HADOOP-8050?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Kihwal Lee resolved HADOOP-8050.
--------------------------------
Resolution: Fixed
> Deadlock in metrics
> -------------------
>
> Key: HADOOP-8050
> URL: https://issues.apache.org/jira/browse/HADOOP-8050
> Project: Hadoop Common
> Issue Type: Bug
> Components: metrics
> Affects Versions: 0.20.204.0, 0.20.205.0, 0.23.0, 1.0.0
> Reporter: Kihwal Lee
> Assignee: Kihwal Lee
> Fix For: 1.0.1, 0.23.2
>
> Attachments: hadoop-8050-branch-1.patch.txt, hadoop-8050-branch-1.patch.txt, hadoop-8050-branch-1.patch.txt, hadoop-8050-branch-1.patch.txt, hadoop-8050-trunk.patch.txt, hadoop-8050-trunk.patch.txt, hadoop-8050-trunk.patch.txt, hadoop-8050.patch.txt
>
>
> The metrics serving thread and the periodic snapshot thread can deadlock.
> It happened a few times on one of namenodes we have. When it happens RPC works but the web ui and hftp stop working. I haven't look at the trunk too closely, but it might happen there too.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
From common-dev-return-77821-apmail-hadoop-common-dev-archive=hadoop.apache.org@hadoop.apache.org Wed Feb 22 18:03:19 2012
Return-Path: <common-dev-return-77821-apmail-hadoop-common-dev-archive=hadoop.apache.org@hadoop.apache.org>
X-Original-To: apmail-hadoop-common-dev-archive@www.apache.org
Delivered-To: apmail-hadoop-common-dev-archive@www.apache.org
Received: from mail.apache.org (hermes.apache.org [140.211.11.3])
by minotaur.apache.org (Postfix) with SMTP id 78027979D
for <apmail-hadoop-common-dev-archive@www.apache.org>; Wed, 22 Feb 2012 18:03:19 +0000 (UTC)
Received: (qmail 58497 invoked by uid 500); 22 Feb 2012 18:03:15 -0000
Delivered-To: apmail-hadoop-common-dev-archive@hadoop.apache.org
Received: (qmail 58407 invoked by uid 500); 22 Feb 2012 18:03:15 -0000
Mailing-List: contact common-dev-help@hadoop.apache.org; run by ezmlm
Precedence: bulk
List-Help: <mailto:common-dev-help@hadoop.apache.org>
List-Unsubscribe: <mailto:common-dev-unsubscribe@hadoop.apache.org>
List-Post: <mailto:common-dev@hadoop.apache.org>
List-Id: <common-dev.hadoop.apache.org>
Reply-To: common-dev@hadoop.apache.org
Delivered-To: mailing list common-dev@hadoop.apache.org
Received: (qmail 58367 invoked by uid 99); 22 Feb 2012 18:03:15 -0000
Received: from athena.apache.org (HELO athena.apache.org) (140.211.11.136)
by apache.org (qpsmtpd/0.29) with ESMTP; Wed, 22 Feb 2012 18:03:15 +0000
X-ASF-Spam-Status: No, hits=-0.0 required=5.0
tests=SPF_PASS
X-Spam-Check-By: apache.org
Received-SPF: pass (athena.apache.org: domain of jayhawk@cs.ucsc.edu designates 128.114.48.32 as permitted sender)
Received: from [128.114.48.32] (HELO mail-01.cse.ucsc.edu) (128.114.48.32)
by apache.org (qpsmtpd/0.29) with ESMTP; Wed, 22 Feb 2012 18:03:09 +0000
Received: from [192.168.50.124] (soenat3.cse.ucsc.edu [128.114.60.41])
by mail-01.cse.ucsc.edu (Postfix) with ESMTPSA id C337F1009C08
for <common-dev@hadoop.apache.org>; Wed, 22 Feb 2012 10:02:48 -0800 (PST)
Content-Type: text/plain; charset=us-ascii
Mime-Version: 1.0 (Apple Message framework v1257)
Subject: Re: MPI Java bindings now available
From: Noah Watkins <jayhawk@cs.ucsc.edu>
In-Reply-To: <F354BE80-DAA9-43DE-9503-EB80F2E01CBD@open-mpi.org>
Date: Wed, 22 Feb 2012 10:02:36 -0800
Content-Transfer-Encoding: quoted-printable
Message-Id: <243D5B28-876D-42B0-99E7-1C3BDC235363@cs.ucsc.edu>
References: <F354BE80-DAA9-43DE-9503-EB80F2E01CBD@open-mpi.org>
To: common-dev@hadoop.apache.org
X-Mailer: Apple Mail (2.1257)
Just gave the nightly release a try and I'm getting an error:
nwatkins@kyoto:~/projects/openmpi_java/openmpi-1.7a1r25994/examples$ =
mpirun -np 1 java Hello
JAVA BINDINGS FAILED TO LOAD REQUIRED LIBRARIES
My setup is on the latest Ubuntu with:
1. Built with contrib/platform/hadoop/linux
2. Compiled example with mpijavac
3. LD_LIBRARY_PATH set to /mpi/java/install/lib
Looks like Java is loading libmpi_java successfully, and something is =
going awry with the library magic in mpi_MPI.c:loadGlobalLibraries()
Thanks,
Noah
On Feb 21, 2012, at 3:05 PM, Ralph Castain wrote:
> Hi folks
>=20
> With support from EMC, several of us in the Open MPI community =
(including LANL, Cisco, HLRS, Oracle, and IBM) have integrated Java =
bindings into the Open MPI code. The new bindings are not part of a =
formal release as this time (will be in the upcoming 1.7 series), but =
can be obtained from the Open MPI web site at:
>=20
> http://www.open-mpi.org/nightly/trunk/
>=20
> Instructions on how to build the binding support, build and run =
applications, etc. can be found in our FAQ section:
>=20
> http://www.open-mpi.org/faq/?category=3Djava
>=20
> Please feel free to post questions and bug reports to the OMPI User =
mailing list:
>=20
> http://www.open-mpi.org/community/lists/ompi.php
>=20
>=20
> I hope to release a version of Hamster in the not-too-distant future, =
once I finally get the 0.23 Hadoop release branch to successfully build =
and run on at least one of my machines (I've given up on the trunk). :-/
>=20
> Ralph
>=20
From common-dev-return-77822-apmail-hadoop-common-dev-archive=hadoop.apache.org@hadoop.apache.org Wed Feb 22 18:15:20 2012
Return-Path: <common-dev-return-77822-apmail-hadoop-common-dev-archive=hadoop.apache.org@hadoop.apache.org>
X-Original-To: apmail-hadoop-common-dev-archive@www.apache.org
Delivered-To: apmail-hadoop-common-dev-archive@www.apache.org
Received: from mail.apache.org (hermes.apache.org [140.211.11.3])
by minotaur.apache.org (Postfix) with SMTP id 0105B9BDE
for <apmail-hadoop-common-dev-archive@www.apache.org>; Wed, 22 Feb 2012 18:15:13 +0000 (UTC)
Received: (qmail 15580 invoked by uid 500); 22 Feb 2012 18:15:12 -0000
Delivered-To: apmail-hadoop-common-dev-archive@hadoop.apache.org
Received: (qmail 15504 invoked by uid 500); 22 Feb 2012 18:15:12 -0000
Mailing-List: contact common-dev-help@hadoop.apache.org; run by ezmlm
Precedence: bulk
List-Help: <mailto:common-dev-help@hadoop.apache.org>
List-Unsubscribe: <mailto:common-dev-unsubscribe@hadoop.apache.org>
List-Post: <mailto:common-dev@hadoop.apache.org>
List-Id: <common-dev.hadoop.apache.org>
Reply-To: common-dev@hadoop.apache.org
Delivered-To: mailing list common-dev@hadoop.apache.org
Received: (qmail 15494 invoked by uid 99); 22 Feb 2012 18:15:12 -0000
Received: from athena.apache.org (HELO athena.apache.org) (140.211.11.136)
by apache.org (qpsmtpd/0.29) with ESMTP; Wed, 22 Feb 2012 18:15:12 +0000
X-ASF-Spam-Status: No, hits=-0.0 required=5.0
tests=SPF_PASS
X-Spam-Check-By: apache.org
Received-SPF: pass (athena.apache.org: local policy)
Received: from [204.154.183.83] (HELO smtp1.exar.com) (204.154.183.83)
by apache.org (qpsmtpd/0.29) with ESMTP; Wed, 22 Feb 2012 18:15:05 +0000
Received: from FRE1EXCH02.hq.exar.com ([fe80::e9a7:6160:4e13:1677]) by
fre1-cas ([10.127.1.162]) with mapi; Wed, 22 Feb 2012 10:14:44 -0800
From: Tim Broberg <Tim.Broberg@exar.com>
To: "common-dev@hadoop.apache.org" <common-dev@hadoop.apache.org>
Date: Wed, 22 Feb 2012 10:14:44 -0800
Subject: RE: Making Gzip splittable
Thread-Topic: Making Gzip splittable
Thread-Index: AczvZilOcimXFYc3TzuHCWMTUy/wdgCJtULD
Message-ID: <FCA91A92EE52B041906A0358FC28FCC3919E0EE923@FRE1EXCH02.hq.exar.com>
References: <CADoiZqrPmt9c1JWvvg-_TJzP5GmxR6XU-bi3d8hLVLSYnQq40w@mail.gmail.com>
In-Reply-To: <CADoiZqrPmt9c1JWvvg-_TJzP5GmxR6XU-bi3d8hLVLSYnQq40w@mail.gmail.com>
Accept-Language: en-US
Content-Language: en-US
X-MS-Has-Attach:
X-MS-TNEF-Correlator:
acceptlanguage: en-US
Content-Type: text/plain; charset="us-ascii"
Content-Transfer-Encoding: quoted-printable
MIME-Version: 1.0
Niels,
There are three options here:
1 - Add your codec, and alternative to the default gzip codec.
2 - Modify the gzip codec to incorporate your feature so that it is pseudo=
-splittable by default (skippable?)
3 - Do nothing
The code uses the normal splittability interface and doesn't invent some ne=
w solution. It seems perfectly well explained.
There is a lot of explanation in there on how to switch over from one codec=
to the other. Does it all get simpler if skippability is implemented by de=
fault but the option is not enabled?
Does this make things any less potentially confusing?
- Tim.
________________________________________
From: niels@basj.es [niels@basj.es] On Behalf Of Niels Basjes [Niels@basjes=
.nl]
Sent: Sunday, February 19, 2012 4:23 PM
To: common-dev
Subject: Making Gzip splittable
Hi,
As some of you know I've created a patch that effectively makes Gzip
splittable.
https://issues.apache.org/jira/browse/HADOOP-7076
What this does is for a split somewhere in the middle of the file it will
read from the start of the file up until the point where the split starts.
This is a useful waste of resources because it creates room to run a heavy
lifting mapper in parallel.
Due to this balance between the waste being useful and the waste being
wasteful I've included extensive documentation in the patch on how it works
and how to use it.
I've seen that there are quite a few real life situations where I expect my
solution can be useful.
What I created is as far as I can tell the only way you can split a gzipped
file without prior knowledge about the actual file.
If you do have prior information then other directions with a similar goal
are possible:
- Analyzing the file beforehand:
HADOOP-6153<https://issues.apache.org/jira/browse/HADOOP-6153>
- Create a specially crafted gzipped file:
HADOOP-7909<https://issues.apache.org/jira/browse/HADOOP-7909>
Over the last year I've had review comments from Chris Douglas (until he
stopped being involved in Hadoop) and later from Luke Lu.
Now the last feedback I got from Luke is this:
> Niels, I'm ambivalent about this patch. It has clean code and
> documentation, OTOH, it has really confusing usage/semantics and
> dubious general utility that the community might not want to maintain
> as part of an official release. After having to explain many finer
> points of Hadoop to new users/developers these days, I think the
> downside of this patch might out weight its benefits. I'm -0 on it.
> i.e., you need somebody else to +1 on this.
So after consulting Eli I'm asking this group.
My views on this feature:
- I think this feature should go in because I think others can benefit from
it.
- I also think that it should remain disabled by default. It can then be
used by those that read the documentation.
- The implementation does not contain any decompression code at all. It
only does the splitting smartness. (It could even be refactored to make any
codec splittable). It has been tested with both the java and the native
decompressors.
What do you think?
Is this a feature that should go in the official release or not?
--
Best regards
Niels Basjes
The information and any attached documents contained in this message
may be confidential and/or legally privileged. The message is
intended solely for the addressee(s). If you are not the intended
recipient, you are hereby notified that any use, dissemination, or
reproduction is strictly prohibited and may be unlawful. If you are
not the intended recipient, please contact the sender immediately by
return e-mail and destroy all copies of the original message.
From common-dev-return-77823-apmail-hadoop-common-dev-archive=hadoop.apache.org@hadoop.apache.org Wed Feb 22 18:22:45 2012
Return-Path: <common-dev-return-77823-apmail-hadoop-common-dev-archive=hadoop.apache.org@hadoop.apache.org>
X-Original-To: apmail-hadoop-common-dev-archive@www.apache.org
Delivered-To: apmail-hadoop-common-dev-archive@www.apache.org
Received: from mail.apache.org (hermes.apache.org [140.211.11.3])
by minotaur.apache.org (Postfix) with SMTP id 25C8E9E3B
for <apmail-hadoop-common-dev-archive@www.apache.org>; Wed, 22 Feb 2012 18:22:45 +0000 (UTC)
Received: (qmail 51304 invoked by uid 500); 22 Feb 2012 18:22:43 -0000
Delivered-To: apmail-hadoop-common-dev-archive@hadoop.apache.org
Received: (qmail 51244 invoked by uid 500); 22 Feb 2012 18:22:43 -0000
Mailing-List: contact common-dev-help@hadoop.apache.org; run by ezmlm
Precedence: bulk
List-Help: <mailto:common-dev-help@hadoop.apache.org>
List-Unsubscribe: <mailto:common-dev-unsubscribe@hadoop.apache.org>
List-Post: <mailto:common-dev@hadoop.apache.org>
List-Id: <common-dev.hadoop.apache.org>
Reply-To: common-dev@hadoop.apache.org
Delivered-To: mailing list common-dev@hadoop.apache.org
Received: (qmail 51236 invoked by uid 99); 22 Feb 2012 18:22:43 -0000
Received: from nike.apache.org (HELO nike.apache.org) (192.87.106.230)
by apache.org (qpsmtpd/0.29) with ESMTP; Wed, 22 Feb 2012 18:22:43 +0000
X-ASF-Spam-Status: No, hits=2.2 required=5.0
tests=HTML_MESSAGE,RCVD_IN_DNSWL_LOW,SPF_NEUTRAL
X-Spam-Check-By: apache.org
Received-SPF: neutral (nike.apache.org: local policy)
Received: from [209.85.215.48] (HELO mail-lpp01m010-f48.google.com) (209.85.215.48)
by apache.org (qpsmtpd/0.29) with ESMTP; Wed, 22 Feb 2012 18:22:36 +0000
Received: by lagw12 with SMTP id w12so546350lag.35
for <common-dev@hadoop.apache.org>; Wed, 22 Feb 2012 10:22:15 -0800 (PST)
Received-SPF: pass (google.com: domain of mfoley@hortonworks.com designates 10.152.133.3 as permitted sender) client-ip=10.152.133.3;
Authentication-Results: mr.google.com; spf=pass (google.com: domain of mfoley@hortonworks.com designates 10.152.133.3 as permitted sender) smtp.mail=mfoley@hortonworks.com
Received: from mr.google.com ([10.152.133.3])
by 10.152.133.3 with SMTP id oy3mr23794083lab.2.1329934935328 (num_hops = 1);
Wed, 22 Feb 2012 10:22:15 -0800 (PST)
Received: by 10.152.133.3 with SMTP id oy3mr19973832lab.2.1329934935257; Wed,
22 Feb 2012 10:22:15 -0800 (PST)
MIME-Version: 1.0
Received: by 10.112.103.132 with HTTP; Wed, 22 Feb 2012 10:21:45 -0800 (PST)
In-Reply-To: <CAF-WD4TN+STTBOBgF1F_m1EU_0GCg8t+BTtJ0wJTxkohL8afAw@mail.gmail.com>
References: <CA+z3+9HrBBf2___wSEk7M=HrzDRLsvHikqcR3Mx2ra6+3oMuwg@mail.gmail.com>
<CAF-WD4TN+STTBOBgF1F_m1EU_0GCg8t+BTtJ0wJTxkohL8afAw@mail.gmail.com>
From: Matt Foley <mfoley@hortonworks.com>
Date: Wed, 22 Feb 2012 10:21:45 -0800
Message-ID: <CA+z3+9G_w2bvW-D-=zebqKftor4pAjvjeDOjsAMN9Z3iXyEXBQ@mail.gmail.com>
Subject: Re: [VOTE] Hadoop-1.0.1 Release Candidate 1
To: common-dev@hadoop.apache.org
Content-Type: multipart/alternative; boundary=f46d0434c34263f31604b9919be0
X-Gm-Message-State: ALoCoQm+Bw2unbedDu3SmLrhoXCrjdx0aknEHDT70JO6v7zA97x/KDqQmOsX6FLl0QkACcN0oM7L
X-Virus-Checked: Checked by ClamAV on apache.org
--f46d0434c34263f31604b9919be0
Content-Type: text/plain; charset=ISO-8859-1
Many thanks to all who voted. The final tally is:
+1 binding : 6 (including myself)
+1 non-binding : 3
-1 : none
The RC passes, and will be announced as release 1.0.1!
Will announce on general@ as soon as I finish the deployment process.
Thanks,
--Matt
--f46d0434c34263f31604b9919be0--
From common-dev-return-77824-apmail-hadoop-common-dev-archive=hadoop.apache.org@hadoop.apache.org Wed Feb 22 18:26:07 2012
Return-Path: <common-dev-return-77824-apmail-hadoop-common-dev-archive=hadoop.apache.org@hadoop.apache.org>
X-Original-To: apmail-hadoop-common-dev-archive@www.apache.org
Delivered-To: apmail-hadoop-common-dev-archive@www.apache.org
Received: from mail.apache.org (hermes.apache.org [140.211.11.3])
by minotaur.apache.org (Postfix) with SMTP id 3A3D29BD2
for <apmail-hadoop-common-dev-archive@www.apache.org>; Wed, 22 Feb 2012 18:26:07 +0000 (UTC)
Received: (qmail 68569 invoked by uid 500); 22 Feb 2012 18:26:05 -0000
Delivered-To: apmail-hadoop-common-dev-archive@hadoop.apache.org
Received: (qmail 68506 invoked by uid 500); 22 Feb 2012 18:26:05 -0000
Mailing-List: contact common-dev-help@hadoop.apache.org; run by ezmlm
Precedence: bulk
List-Help: <mailto:common-dev-help@hadoop.apache.org>
List-Unsubscribe: <mailto:common-dev-unsubscribe@hadoop.apache.org>
List-Post: <mailto:common-dev@hadoop.apache.org>
List-Id: <common-dev.hadoop.apache.org>
Reply-To: common-dev@hadoop.apache.org
Delivered-To: mailing list common-dev@hadoop.apache.org
Received: (qmail 68498 invoked by uid 99); 22 Feb 2012 18:26:05 -0000
Received: from athena.apache.org (HELO athena.apache.org) (140.211.11.136)
by apache.org (qpsmtpd/0.29) with ESMTP; Wed, 22 Feb 2012 18:26:05 +0000
X-ASF-Spam-Status: No, hits=-0.7 required=5.0
tests=RCVD_IN_DNSWL_LOW,SPF_PASS
X-Spam-Check-By: apache.org
Received-SPF: pass (athena.apache.org: domain of rhc.openmpi@gmail.com designates 209.85.210.48 as permitted sender)
Received: from [209.85.210.48] (HELO mail-pz0-f48.google.com) (209.85.210.48)
by apache.org (qpsmtpd/0.29) with ESMTP; Wed, 22 Feb 2012 18:25:58 +0000
Received: by dadp13 with SMTP id p13so376072dad.35
for <common-dev@hadoop.apache.org>; Wed, 22 Feb 2012 10:25:38 -0800 (PST)
Received-SPF: pass (google.com: domain of rhc.openmpi@gmail.com designates 10.68.132.134 as permitted sender) client-ip=10.68.132.134;
Authentication-Results: mr.google.com; spf=pass (google.com: domain of rhc.openmpi@gmail.com designates 10.68.132.134 as permitted sender) smtp.mail=rhc.openmpi@gmail.com; dkim=pass header.i=rhc.openmpi@gmail.com
Received: from mr.google.com ([10.68.132.134])
by 10.68.132.134 with SMTP id ou6mr20202926pbb.141.1329935138227 (num_hops = 1);
Wed, 22 Feb 2012 10:25:38 -0800 (PST)
DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed;
d=gmail.com; s=gamma;
h=sender:content-type:mime-version:subject:from:in-reply-to:date
:content-transfer-encoding:message-id:references:to:x-mailer;
bh=2Ju+r+cf9DUX8Ixd005Nzbdoi9Mt93qXQZ6d8ldA+3Y=;
b=O1fEZFjQH8DhKbAPObAQ3R16f0MozpaVmzynCLPS+bKX3BCVUP5dY++TNyKCJ+5FV7
Rfv2qbiUMZZryxN6vOwurdSyf4AndnLtXIYsCzZWGoMTVhOnFgB3y8OEuspm0+BAtqOv
9MMnO/UcW7qIW8ioz+U+P4i5Le5X/PIESQ9lA=
Received: by 10.68.132.134 with SMTP id ou6mr16597569pbb.141.1329935138150;
Wed, 22 Feb 2012 10:25:38 -0800 (PST)
Received: from [192.168.1.10] (c-98-245-155-46.hsd1.co.comcast.net. [98.245.155.46])
by mx.google.com with ESMTPS id 2sm19578972pbw.57.2012.02.22.10.25.36
(version=TLSv1/SSLv3 cipher=OTHER);
Wed, 22 Feb 2012 10:25:37 -0800 (PST)
Sender: Ralph Castain <rhc.openmpi@gmail.com>
Content-Type: text/plain; charset=us-ascii
Mime-Version: 1.0 (Apple Message framework v1257)
Subject: Re: MPI Java bindings now available
From: Ralph Castain <rhc@open-mpi.org>
In-Reply-To: <243D5B28-876D-42B0-99E7-1C3BDC235363@cs.ucsc.edu>
Date: Wed, 22 Feb 2012 11:25:33 -0700
Content-Transfer-Encoding: quoted-printable
Message-Id: <910E137E-8CD1-4C98-A458-05DAAED9377D@open-mpi.org>
References: <F354BE80-DAA9-43DE-9503-EB80F2E01CBD@open-mpi.org> <243D5B28-876D-42B0-99E7-1C3BDC235363@cs.ucsc.edu>
To: common-dev@hadoop.apache.org
X-Mailer: Apple Mail (2.1257)
Hi Noah
Your LD_LIBRARY_PATH has to include the path to the OMPI libraries so we =
can find libmpi. Did you include your $prefix/lib[64] in it?
On Feb 22, 2012, at 11:02 AM, Noah Watkins wrote:
> Just gave the nightly release a try and I'm getting an error:
>=20
> nwatkins@kyoto:~/projects/openmpi_java/openmpi-1.7a1r25994/examples$ =
mpirun -np 1 java Hello
> JAVA BINDINGS FAILED TO LOAD REQUIRED LIBRARIES
>=20
> My setup is on the latest Ubuntu with:
>=20
> 1. Built with contrib/platform/hadoop/linux
> 2. Compiled example with mpijavac
> 3. LD_LIBRARY_PATH set to /mpi/java/install/lib
>=20
> Looks like Java is loading libmpi_java successfully, and something is =
going awry with the library magic in mpi_MPI.c:loadGlobalLibraries()
>=20
> Thanks,
> Noah
>=20
> On Feb 21, 2012, at 3:05 PM, Ralph Castain wrote:
>=20
>> Hi folks
>>=20
>> With support from EMC, several of us in the Open MPI community =
(including LANL, Cisco, HLRS, Oracle, and IBM) have integrated Java =
bindings into the Open MPI code. The new bindings are not part of a =
formal release as this time (will be in the upcoming 1.7 series), but =
can be obtained from the Open MPI web site at:
>>=20
>> http://www.open-mpi.org/nightly/trunk/
>>=20
>> Instructions on how to build the binding support, build and run =
applications, etc. can be found in our FAQ section:
>>=20
>> http://www.open-mpi.org/faq/?category=3Djava
>>=20
>> Please feel free to post questions and bug reports to the OMPI User =
mailing list:
>>=20
>> http://www.open-mpi.org/community/lists/ompi.php
>>=20
>>=20
>> I hope to release a version of Hamster in the not-too-distant future, =
once I finally get the 0.23 Hadoop release branch to successfully build =
and run on at least one of my machines (I've given up on the trunk). :-/
>>=20
>> Ralph
>>=20
>=20
From common-dev-return-77825-apmail-hadoop-common-dev-archive=hadoop.apache.org@hadoop.apache.org Wed Feb 22 19:52:19 2012
Return-Path: <common-dev-return-77825-apmail-hadoop-common-dev-archive=hadoop.apache.org@hadoop.apache.org>
X-Original-To: apmail-hadoop-common-dev-archive@www.apache.org
Delivered-To: apmail-hadoop-common-dev-archive@www.apache.org
Received: from mail.apache.org (hermes.apache.org [140.211.11.3])
by minotaur.apache.org (Postfix) with SMTP id 563289200
for <apmail-hadoop-common-dev-archive@www.apache.org>; Wed, 22 Feb 2012 19:52:19 +0000 (UTC)
Received: (qmail 4332 invoked by uid 500); 22 Feb 2012 19:52:17 -0000
Delivered-To: apmail-hadoop-common-dev-archive@hadoop.apache.org
Received: (qmail 4260 invoked by uid 500); 22 Feb 2012 19:52:17 -0000
Mailing-List: contact common-dev-help@hadoop.apache.org; run by ezmlm
Precedence: bulk
List-Help: <mailto:common-dev-help@hadoop.apache.org>
List-Unsubscribe: <mailto:common-dev-unsubscribe@hadoop.apache.org>
List-Post: <mailto:common-dev@hadoop.apache.org>
List-Id: <common-dev.hadoop.apache.org>
Reply-To: common-dev@hadoop.apache.org
Delivered-To: mailing list common-dev@hadoop.apache.org
Received: (qmail 4249 invoked by uid 99); 22 Feb 2012 19:52:17 -0000
Received: from nike.apache.org (HELO nike.apache.org) (192.87.106.230)
by apache.org (qpsmtpd/0.29) with ESMTP; Wed, 22 Feb 2012 19:52:17 +0000
X-ASF-Spam-Status: No, hits=-0.0 required=5.0
tests=SPF_PASS
X-Spam-Check-By: apache.org
Received-SPF: pass (nike.apache.org: domain of jayhawk@cs.ucsc.edu designates 128.114.48.32 as permitted sender)
Received: from [128.114.48.32] (HELO mail-01.cse.ucsc.edu) (128.114.48.32)
by apache.org (qpsmtpd/0.29) with ESMTP; Wed, 22 Feb 2012 19:52:11 +0000
Received: from [192.168.50.124] (soenat3.cse.ucsc.edu [128.114.60.41])
by mail-01.cse.ucsc.edu (Postfix) with ESMTPSA id 6755E1009C09
for <common-dev@hadoop.apache.org>; Wed, 22 Feb 2012 11:51:49 -0800 (PST)
Content-Type: text/plain; charset=us-ascii
Mime-Version: 1.0 (Apple Message framework v1257)
Subject: Re: MPI Java bindings now available
From: Noah Watkins <jayhawk@cs.ucsc.edu>
In-Reply-To: <910E137E-8CD1-4C98-A458-05DAAED9377D@open-mpi.org>
Date: Wed, 22 Feb 2012 11:51:48 -0800
Content-Transfer-Encoding: quoted-printable
Message-Id: <4CB3D650-94DC-445A-938B-8612A494E17F@cs.ucsc.edu>
References: <F354BE80-DAA9-43DE-9503-EB80F2E01CBD@open-mpi.org> <243D5B28-876D-42B0-99E7-1C3BDC235363@cs.ucsc.edu> <910E137E-8CD1-4C98-A458-05DAAED9377D@open-mpi.org>
To: common-dev@hadoop.apache.org
X-Mailer: Apple Mail (2.1257)
X-Virus-Checked: Checked by ClamAV on apache.org
I have LD_LIBRARY_PATH pointing to the full OpenMPI installation, which =
seems to include the MPI libraries. Is that what you meant by OMPI =
libraries?
nwatkins@kyoto:~/projects/openmpi_java/openmpi-1.7a1r25994/examples$ =
echo $LD_LIBRARY_PATH=20
/home/nwatkins/projects/openmpi_java/install/lib:
nwatkins@kyoto:~/projects/openmpi_java/openmpi-1.7a1r25994/examples$ ls =
-l /home/nwatkins/projects/openmpi_java/install/lib
total 19372
-rwxr-xr-x 1 nwatkins nwatkins 1027 2012-02-22 09:49 =
libmca_common_sm.la
lrwxrwxrwx 1 nwatkins nwatkins 25 2012-02-22 09:49 =
libmca_common_sm.so -> libmca_common_sm.so.0.0.0
lrwxrwxrwx 1 nwatkins nwatkins 25 2012-02-22 09:49 =
libmca_common_sm.so.0 -> libmca_common_sm.so.0.0.0
-rwxr-xr-x 1 nwatkins nwatkins 77835 2012-02-22 09:49 =
libmca_common_sm.so.0.0.0
-rwxr-xr-x 1 nwatkins nwatkins 1140 2012-02-22 09:49 libmpi_java.la
lrwxrwxrwx 1 nwatkins nwatkins 20 2012-02-22 09:49 libmpi_java.so =
-> libmpi_java.so.0.0.0
lrwxrwxrwx 1 nwatkins nwatkins 20 2012-02-22 09:49 =
libmpi_java.so.0 -> libmpi_java.so.0.0.0
-rwxr-xr-x 1 nwatkins nwatkins 393888 2012-02-22 09:49 =
libmpi_java.so.0.0.0
-rwxr-xr-x 1 nwatkins nwatkins 1051 2012-02-22 09:49 libmpi.la
lrwxrwxrwx 1 nwatkins nwatkins 15 2012-02-22 09:49 libmpi.so -> =
libmpi.so.0.0.0
lrwxrwxrwx 1 nwatkins nwatkins 15 2012-02-22 09:49 libmpi.so.0 -> =
libmpi.so.0.0.0
-rwxr-xr-x 1 nwatkins nwatkins 12002747 2012-02-22 09:49 libmpi.so.0.0.0
-rwxr-xr-x 1 nwatkins nwatkins 1003 2012-02-22 09:49 libompitrace.la
lrwxrwxrwx 1 nwatkins nwatkins 21 2012-02-22 09:49 libompitrace.so =
-> libompitrace.so.0.0.0
lrwxrwxrwx 1 nwatkins nwatkins 21 2012-02-22 09:49 =
libompitrace.so.0 -> libompitrace.so.0.0.0
-rwxr-xr-x 1 nwatkins nwatkins 86113 2012-02-22 09:49 =
libompitrace.so.0.0.0
-rwxr-xr-x 1 nwatkins nwatkins 1081 2012-02-22 09:49 libopen-pal.la
lrwxrwxrwx 1 nwatkins nwatkins 20 2012-02-22 09:49 libopen-pal.so =
-> libopen-pal.so.0.0.0
lrwxrwxrwx 1 nwatkins nwatkins 20 2012-02-22 09:49 =
libopen-pal.so.0 -> libopen-pal.so.0.0.0
-rwxr-xr-x 1 nwatkins nwatkins 2493981 2012-02-22 09:49 =
libopen-pal.so.0.0.0
-rwxr-xr-x 1 nwatkins nwatkins 1081 2012-02-22 09:49 libopen-rte.la
lrwxrwxrwx 1 nwatkins nwatkins 20 2012-02-22 09:49 libopen-rte.so =
-> libopen-rte.so.0.0.0
lrwxrwxrwx 1 nwatkins nwatkins 20 2012-02-22 09:49 =
libopen-rte.so.0 -> libopen-rte.so.0.0.0
-rwxr-xr-x 1 nwatkins nwatkins 4695012 2012-02-22 09:49 =
libopen-rte.so.0.0.0
-rw-r--r-- 1 nwatkins nwatkins 27260 2012-02-22 09:49 mpi.jar
drwxrwxr-x 2 nwatkins nwatkins 12288 2012-02-22 09:49 openmpi
drwxrwxr-x 2 nwatkins nwatkins 4096 2012-02-22 09:49 pkgconfig
On Feb 22, 2012, at 10:25 AM, Ralph Castain wrote:
> Hi Noah
>=20
> Your LD_LIBRARY_PATH has to include the path to the OMPI libraries so =
we can find libmpi. Did you include your $prefix/lib[64] in it?
>=20
> On Feb 22, 2012, at 11:02 AM, Noah Watkins wrote:
>=20
>> Just gave the nightly release a try and I'm getting an error:
>>=20
>> nwatkins@kyoto:~/projects/openmpi_java/openmpi-1.7a1r25994/examples$ =
mpirun -np 1 java Hello
>> JAVA BINDINGS FAILED TO LOAD REQUIRED LIBRARIES
>>=20
>> My setup is on the latest Ubuntu with:
>>=20
>> 1. Built with contrib/platform/hadoop/linux
>> 2. Compiled example with mpijavac
>> 3. LD_LIBRARY_PATH set to /mpi/java/install/lib
>>=20
>> Looks like Java is loading libmpi_java successfully, and something is =
going awry with the library magic in mpi_MPI.c:loadGlobalLibraries()
>>=20
>> Thanks,
>> Noah
>>=20
>> On Feb 21, 2012, at 3:05 PM, Ralph Castain wrote:
>>=20
>>> Hi folks
>>>=20
>>> With support from EMC, several of us in the Open MPI community =
(including LANL, Cisco, HLRS, Oracle, and IBM) have integrated Java =
bindings into the Open MPI code. The new bindings are not part of a =
formal release as this time (will be in the upcoming 1.7 series), but =
can be obtained from the Open MPI web site at:
>>>=20
>>> http://www.open-mpi.org/nightly/trunk/
>>>=20
>>> Instructions on how to build the binding support, build and run =
applications, etc. can be found in our FAQ section:
>>>=20
>>> http://www.open-mpi.org/faq/?category=3Djava
>>>=20
>>> Please feel free to post questions and bug reports to the OMPI User =
mailing list:
>>>=20
>>> http://www.open-mpi.org/community/lists/ompi.php
>>>=20
>>>=20
>>> I hope to release a version of Hamster in the not-too-distant =
future, once I finally get the 0.23 Hadoop release branch to =
successfully build and run on at least one of my machines (I've given up =
on the trunk). :-/
>>>=20
>>> Ralph
>>>=20
>>=20
>=20
From common-dev-return-77826-apmail-hadoop-common-dev-archive=hadoop.apache.org@hadoop.apache.org Wed Feb 22 21:58:12 2012
Return-Path: <common-dev-return-77826-apmail-hadoop-common-dev-archive=hadoop.apache.org@hadoop.apache.org>
X-Original-To: apmail-hadoop-common-dev-archive@www.apache.org
Delivered-To: apmail-hadoop-common-dev-archive@www.apache.org
Received: from mail.apache.org (hermes.apache.org [140.211.11.3])
by minotaur.apache.org (Postfix) with SMTP id 03D159FF5
for <apmail-hadoop-common-dev-archive@www.apache.org>; Wed, 22 Feb 2012 21:58:12 +0000 (UTC)
Received: (qmail 32450 invoked by uid 500); 22 Feb 2012 21:58:10 -0000
Delivered-To: apmail-hadoop-common-dev-archive@hadoop.apache.org
Received: (qmail 32278 invoked by uid 500); 22 Feb 2012 21:58:10 -0000
Mailing-List: contact common-dev-help@hadoop.apache.org; run by ezmlm
Precedence: bulk
List-Help: <mailto:common-dev-help@hadoop.apache.org>
List-Unsubscribe: <mailto:common-dev-unsubscribe@hadoop.apache.org>
List-Post: <mailto:common-dev@hadoop.apache.org>
List-Id: <common-dev.hadoop.apache.org>
Reply-To: common-dev@hadoop.apache.org
Delivered-To: mailing list common-dev@hadoop.apache.org
Received: (qmail 32182 invoked by uid 99); 22 Feb 2012 21:58:09 -0000
Received: from athena.apache.org (HELO athena.apache.org) (140.211.11.136)
by apache.org (qpsmtpd/0.29) with ESMTP; Wed, 22 Feb 2012 21:58:09 +0000
X-ASF-Spam-Status: No, hits=-2000.0 required=5.0
tests=ALL_TRUSTED,T_RP_MATCHES_RCVD
X-Spam-Check-By: apache.org
Received: from [140.211.11.116] (HELO hel.zones.apache.org) (140.211.11.116)
by apache.org (qpsmtpd/0.29) with ESMTP; Wed, 22 Feb 2012 21:58:09 +0000
Received: from hel.zones.apache.org (hel.zones.apache.org [140.211.11.116])
by hel.zones.apache.org (Postfix) with ESMTP id 096413357FB
for <common-dev@hadoop.apache.org>; Wed, 22 Feb 2012 21:57:49 +0000 (UTC)
Date: Wed, 22 Feb 2012 21:57:49 +0000 (UTC)
From: "Allen Wittenauer (Created) (JIRA)" <jira@apache.org>
To: common-dev@hadoop.apache.org
Message-ID: <1845219705.6408.1329947869039.JavaMail.tomcat@hel.zones.apache.org>
Subject: [jira] [Created] (HADOOP-8100) share web server information for
http filters
MIME-Version: 1.0
Content-Type: text/plain; charset=utf-8
Content-Transfer-Encoding: 7bit
X-JIRA-FingerPrint: 30527f35849b9dde25b450d4833f0394
share web server information for http filters
---------------------------------------------
Key: HADOOP-8100
URL: https://issues.apache.org/jira/browse/HADOOP-8100
Project: Hadoop Common
Issue Type: New Feature
Affects Versions: 1.0.0
Reporter: Allen Wittenauer
Attachments: HADOOP-8100-branch-1.0.patch
This is a simple fix which shares the web server bind information for consumption down stream for 3rd party plugins.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
From common-dev-return-77827-apmail-hadoop-common-dev-archive=hadoop.apache.org@hadoop.apache.org Wed Feb 22 22:06:47 2012
Return-Path: <common-dev-return-77827-apmail-hadoop-common-dev-archive=hadoop.apache.org@hadoop.apache.org>
X-Original-To: apmail-hadoop-common-dev-archive@www.apache.org
Delivered-To: apmail-hadoop-common-dev-archive@www.apache.org
Received: from mail.apache.org (hermes.apache.org [140.211.11.3])
by minotaur.apache.org (Postfix) with SMTP id D2D7196E9
for <apmail-hadoop-common-dev-archive@www.apache.org>; Wed, 22 Feb 2012 22:06:47 +0000 (UTC)
Received: (qmail 58325 invoked by uid 500); 22 Feb 2012 22:06:46 -0000
Delivered-To: apmail-hadoop-common-dev-archive@hadoop.apache.org
Received: (qmail 58252 invoked by uid 500); 22 Feb 2012 22:06:46 -0000
Mailing-List: contact common-dev-help@hadoop.apache.org; run by ezmlm
Precedence: bulk
List-Help: <mailto:common-dev-help@hadoop.apache.org>
List-Unsubscribe: <mailto:common-dev-unsubscribe@hadoop.apache.org>
List-Post: <mailto:common-dev@hadoop.apache.org>
List-Id: <common-dev.hadoop.apache.org>
Reply-To: common-dev@hadoop.apache.org
Delivered-To: mailing list common-dev@hadoop.apache.org
Received: (qmail 58242 invoked by uid 99); 22 Feb 2012 22:06:46 -0000
Received: from athena.apache.org (HELO athena.apache.org) (140.211.11.136)
by apache.org (qpsmtpd/0.29) with ESMTP; Wed, 22 Feb 2012 22:06:46 +0000
X-ASF-Spam-Status: No, hits=-0.7 required=5.0
tests=RCVD_IN_DNSWL_LOW,SPF_PASS
X-Spam-Check-By: apache.org
Received-SPF: pass (athena.apache.org: domain of rhc.openmpi@gmail.com designates 209.85.160.48 as permitted sender)
Received: from [209.85.160.48] (HELO mail-pw0-f48.google.com) (209.85.160.48)
by apache.org (qpsmtpd/0.29) with ESMTP; Wed, 22 Feb 2012 22:06:41 +0000
Received: by pbcxa12 with SMTP id xa12so772356pbc.35
for <common-dev@hadoop.apache.org>; Wed, 22 Feb 2012 14:06:20 -0800 (PST)
Received-SPF: pass (google.com: domain of rhc.openmpi@gmail.com designates 10.68.212.73 as permitted sender) client-ip=10.68.212.73;
Authentication-Results: mr.google.com; spf=pass (google.com: domain of rhc.openmpi@gmail.com designates 10.68.212.73 as permitted sender) smtp.mail=rhc.openmpi@gmail.com; dkim=pass header.i=rhc.openmpi@gmail.com
Received: from mr.google.com ([10.68.212.73])
by 10.68.212.73 with SMTP id ni9mr93472863pbc.56.1329948380727 (num_hops = 1);
Wed, 22 Feb 2012 14:06:20 -0800 (PST)
DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed;
d=gmail.com; s=gamma;
h=sender:content-type:mime-version:subject:from:in-reply-to:date
:content-transfer-encoding:message-id:references:to:x-mailer;
bh=bIhQpRbJRRq1ocKhZcdVhb3j6gerGzkLptxMLf5QHqc=;
b=RscO6fBvb/7rdy1G6vNxp6r8oiMYXtxmbS9WC+7VtGE9FrgtlOOmFe0Ul8zJqwkYaU
KI81gCklg/rVCZRowE3IlO42MRhO8hphCkHuCE7pHZVO9SdAVshZcgzMAaHH4LL9U+JC
JjktGiqDBsbSZcHwdhsHhr8c9kQIjeKU9aWd0=
Received: by 10.68.212.73 with SMTP id ni9mr76868994pbc.56.1329948380608;
Wed, 22 Feb 2012 14:06:20 -0800 (PST)
Received: from [192.168.1.10] (c-98-245-155-46.hsd1.co.comcast.net. [98.245.155.46])
by mx.google.com with ESMTPS id e8sm19997352pbg.47.2012.02.22.14.06.18
(version=TLSv1/SSLv3 cipher=OTHER);
Wed, 22 Feb 2012 14:06:19 -0800 (PST)
Sender: Ralph Castain <rhc.openmpi@gmail.com>
Content-Type: text/plain; charset=us-ascii
Mime-Version: 1.0 (Apple Message framework v1257)
Subject: Re: MPI Java bindings now available
From: Ralph Castain <rhc@open-mpi.org>
In-Reply-To: <4CB3D650-94DC-445A-938B-8612A494E17F@cs.ucsc.edu>
Date: Wed, 22 Feb 2012 15:06:16 -0700
Content-Transfer-Encoding: quoted-printable
Message-Id: <DE195675-1477-4E47-94F6-3BD76D759B4A@open-mpi.org>
References: <F354BE80-DAA9-43DE-9503-EB80F2E01CBD@open-mpi.org> <243D5B28-876D-42B0-99E7-1C3BDC235363@cs.ucsc.edu> <910E137E-8CD1-4C98-A458-05DAAED9377D@open-mpi.org> <4CB3D650-94DC-445A-938B-8612A494E17F@cs.ucsc.edu>
To: common-dev@hadoop.apache.org
X-Mailer: Apple Mail (2.1257)
Many thanks to Noah for his off-list help in diagnosing the problem. =
There was an undiagnosed VPATH build issue in OMPI that surfaced with =
the Java bindings. This has been fixed - the tarball generated tonight =
will include the patch.
Thanks again, Noah.
Ralph
On Feb 22, 2012, at 12:51 PM, Noah Watkins wrote:
> I have LD_LIBRARY_PATH pointing to the full OpenMPI installation, =
which seems to include the MPI libraries. Is that what you meant by OMPI =
libraries?
>=20
> nwatkins@kyoto:~/projects/openmpi_java/openmpi-1.7a1r25994/examples$ =
echo $LD_LIBRARY_PATH=20
> /home/nwatkins/projects/openmpi_java/install/lib:
>=20
> nwatkins@kyoto:~/projects/openmpi_java/openmpi-1.7a1r25994/examples$ =
ls -l /home/nwatkins/projects/openmpi_java/install/lib
> total 19372
> -rwxr-xr-x 1 nwatkins nwatkins 1027 2012-02-22 09:49 =
libmca_common_sm.la
> lrwxrwxrwx 1 nwatkins nwatkins 25 2012-02-22 09:49 =
libmca_common_sm.so -> libmca_common_sm.so.0.0.0
> lrwxrwxrwx 1 nwatkins nwatkins 25 2012-02-22 09:49 =
libmca_common_sm.so.0 -> libmca_common_sm.so.0.0.0
> -rwxr-xr-x 1 nwatkins nwatkins 77835 2012-02-22 09:49 =
libmca_common_sm.so.0.0.0
> -rwxr-xr-x 1 nwatkins nwatkins 1140 2012-02-22 09:49 =
libmpi_java.la
> lrwxrwxrwx 1 nwatkins nwatkins 20 2012-02-22 09:49 =
libmpi_java.so -> libmpi_java.so.0.0.0
> lrwxrwxrwx 1 nwatkins nwatkins 20 2012-02-22 09:49 =
libmpi_java.so.0 -> libmpi_java.so.0.0.0
> -rwxr-xr-x 1 nwatkins nwatkins 393888 2012-02-22 09:49 =
libmpi_java.so.0.0.0
> -rwxr-xr-x 1 nwatkins nwatkins 1051 2012-02-22 09:49 libmpi.la
> lrwxrwxrwx 1 nwatkins nwatkins 15 2012-02-22 09:49 libmpi.so -> =
libmpi.so.0.0.0
> lrwxrwxrwx 1 nwatkins nwatkins 15 2012-02-22 09:49 libmpi.so.0 =
-> libmpi.so.0.0.0
> -rwxr-xr-x 1 nwatkins nwatkins 12002747 2012-02-22 09:49 =
libmpi.so.0.0.0
> -rwxr-xr-x 1 nwatkins nwatkins 1003 2012-02-22 09:49 =
libompitrace.la
> lrwxrwxrwx 1 nwatkins nwatkins 21 2012-02-22 09:49 =
libompitrace.so -> libompitrace.so.0.0.0
> lrwxrwxrwx 1 nwatkins nwatkins 21 2012-02-22 09:49 =
libompitrace.so.0 -> libompitrace.so.0.0.0
> -rwxr-xr-x 1 nwatkins nwatkins 86113 2012-02-22 09:49 =
libompitrace.so.0.0.0
> -rwxr-xr-x 1 nwatkins nwatkins 1081 2012-02-22 09:49 =
libopen-pal.la
> lrwxrwxrwx 1 nwatkins nwatkins 20 2012-02-22 09:49 =
libopen-pal.so -> libopen-pal.so.0.0.0
> lrwxrwxrwx 1 nwatkins nwatkins 20 2012-02-22 09:49 =
libopen-pal.so.0 -> libopen-pal.so.0.0.0
> -rwxr-xr-x 1 nwatkins nwatkins 2493981 2012-02-22 09:49 =
libopen-pal.so.0.0.0
> -rwxr-xr-x 1 nwatkins nwatkins 1081 2012-02-22 09:49 =
libopen-rte.la
> lrwxrwxrwx 1 nwatkins nwatkins 20 2012-02-22 09:49 =
libopen-rte.so -> libopen-rte.so.0.0.0
> lrwxrwxrwx 1 nwatkins nwatkins 20 2012-02-22 09:49 =
libopen-rte.so.0 -> libopen-rte.so.0.0.0
> -rwxr-xr-x 1 nwatkins nwatkins 4695012 2012-02-22 09:49 =
libopen-rte.so.0.0.0
> -rw-r--r-- 1 nwatkins nwatkins 27260 2012-02-22 09:49 mpi.jar
> drwxrwxr-x 2 nwatkins nwatkins 12288 2012-02-22 09:49 openmpi
> drwxrwxr-x 2 nwatkins nwatkins 4096 2012-02-22 09:49 pkgconfig
>=20
> On Feb 22, 2012, at 10:25 AM, Ralph Castain wrote:
>=20
>> Hi Noah
>>=20
>> Your LD_LIBRARY_PATH has to include the path to the OMPI libraries so =
we can find libmpi. Did you include your $prefix/lib[64] in it?
>>=20
>> On Feb 22, 2012, at 11:02 AM, Noah Watkins wrote:
>>=20
>>> Just gave the nightly release a try and I'm getting an error:
>>>=20
>>> nwatkins@kyoto:~/projects/openmpi_java/openmpi-1.7a1r25994/examples$ =
mpirun -np 1 java Hello
>>> JAVA BINDINGS FAILED TO LOAD REQUIRED LIBRARIES
>>>=20
>>> My setup is on the latest Ubuntu with:
>>>=20
>>> 1. Built with contrib/platform/hadoop/linux
>>> 2. Compiled example with mpijavac
>>> 3. LD_LIBRARY_PATH set to /mpi/java/install/lib
>>>=20
>>> Looks like Java is loading libmpi_java successfully, and something =
is going awry with the library magic in mpi_MPI.c:loadGlobalLibraries()
>>>=20
>>> Thanks,
>>> Noah
>>>=20
>>> On Feb 21, 2012, at 3:05 PM, Ralph Castain wrote:
>>>=20
>>>> Hi folks
>>>>=20
>>>> With support from EMC, several of us in the Open MPI community =
(including LANL, Cisco, HLRS, Oracle, and IBM) have integrated Java =
bindings into the Open MPI code. The new bindings are not part of a =
formal release as this time (will be in the upcoming 1.7 series), but =
can be obtained from the Open MPI web site at:
>>>>=20
>>>> http://www.open-mpi.org/nightly/trunk/
>>>>=20
>>>> Instructions on how to build the binding support, build and run =
applications, etc. can be found in our FAQ section:
>>>>=20
>>>> http://www.open-mpi.org/faq/?category=3Djava
>>>>=20
>>>> Please feel free to post questions and bug reports to the OMPI User =
mailing list:
>>>>=20
>>>> http://www.open-mpi.org/community/lists/ompi.php
>>>>=20
>>>>=20
>>>> I hope to release a version of Hamster in the not-too-distant =
future, once I finally get the 0.23 Hadoop release branch to =
successfully build and run on at least one of my machines (I've given up =
on the trunk). :-/
>>>>=20
>>>> Ralph
>>>>=20
>>>=20
>>=20
>=20
From common-dev-return-77828-apmail-hadoop-common-dev-archive=hadoop.apache.org@hadoop.apache.org Wed Feb 22 22:10:44 2012
Return-Path: <common-dev-return-77828-apmail-hadoop-common-dev-archive=hadoop.apache.org@hadoop.apache.org>
X-Original-To: apmail-hadoop-common-dev-archive@www.apache.org
Delivered-To: apmail-hadoop-common-dev-archive@www.apache.org
Received: from mail.apache.org (hermes.apache.org [140.211.11.3])
by minotaur.apache.org (Postfix) with SMTP id F23EC97EF
for <apmail-hadoop-common-dev-archive@www.apache.org>; Wed, 22 Feb 2012 22:10:43 +0000 (UTC)
Received: (qmail 73798 invoked by uid 500); 22 Feb 2012 22:10:42 -0000
Delivered-To: apmail-hadoop-common-dev-archive@hadoop.apache.org
Received: (qmail 73740 invoked by uid 500); 22 Feb 2012 22:10:42 -0000
Mailing-List: contact common-dev-help@hadoop.apache.org; run by ezmlm
Precedence: bulk
List-Help: <mailto:common-dev-help@hadoop.apache.org>
List-Unsubscribe: <mailto:common-dev-unsubscribe@hadoop.apache.org>
List-Post: <mailto:common-dev@hadoop.apache.org>
List-Id: <common-dev.hadoop.apache.org>
Reply-To: common-dev@hadoop.apache.org
Delivered-To: mailing list common-dev@hadoop.apache.org
Received: (qmail 73731 invoked by uid 99); 22 Feb 2012 22:10:42 -0000
Received: from athena.apache.org (HELO athena.apache.org) (140.211.11.136)
by apache.org (qpsmtpd/0.29) with ESMTP; Wed, 22 Feb 2012 22:10:42 +0000
X-ASF-Spam-Status: No, hits=-0.0 required=5.0
tests=RCVD_IN_DNSWL_LOW,SPF_NEUTRAL
X-Spam-Check-By: apache.org
Received-SPF: neutral (athena.apache.org: local policy)
Received: from [209.85.210.48] (HELO mail-pz0-f48.google.com) (209.85.210.48)
by apache.org (qpsmtpd/0.29) with ESMTP; Wed, 22 Feb 2012 22:10:37 +0000
Received: by dadp13 with SMTP id p13so626704dad.35
for <common-dev@hadoop.apache.org>; Wed, 22 Feb 2012 14:10:16 -0800 (PST)
Received-SPF: pass (google.com: domain of mahadev@hortonworks.com designates 10.68.216.132 as permitted sender) client-ip=10.68.216.132;
Authentication-Results: mr.google.com; spf=pass (google.com: domain of mahadev@hortonworks.com designates 10.68.216.132 as permitted sender) smtp.mail=mahadev@hortonworks.com
Received: from mr.google.com ([10.68.216.132])
by 10.68.216.132 with SMTP id oq4mr94811496pbc.41.1329948616951 (num_hops = 1);
Wed, 22 Feb 2012 14:10:16 -0800 (PST)
Received: by 10.68.216.132 with SMTP id oq4mr77985058pbc.41.1329948616885;
Wed, 22 Feb 2012 14:10:16 -0800 (PST)
Received: from [10.10.10.116] (host1.hortonworks.com. [70.35.59.2])
by mx.google.com with ESMTPS id t10sm31564619pbb.18.2012.02.22.14.10.14
(version=TLSv1/SSLv3 cipher=OTHER);
Wed, 22 Feb 2012 14:10:15 -0800 (PST)
Content-Type: text/plain; charset=us-ascii
Mime-Version: 1.0 (Apple Message framework v1084)
Subject: Re: MPI Java bindings now available
From: Mahadev Konar <mahadev@hortonworks.com>
In-Reply-To: <DE195675-1477-4E47-94F6-3BD76D759B4A@open-mpi.org>
Date: Wed, 22 Feb 2012 14:10:13 -0800
Content-Transfer-Encoding: quoted-printable
Message-Id: <D689DEDC-86C5-489B-B1E9-800DEBD281B2@hortonworks.com>
References: <F354BE80-DAA9-43DE-9503-EB80F2E01CBD@open-mpi.org> <243D5B28-876D-42B0-99E7-1C3BDC235363@cs.ucsc.edu> <910E137E-8CD1-4C98-A458-05DAAED9377D@open-mpi.org> <4CB3D650-94DC-445A-938B-8612A494E17F@cs.ucsc.edu> <DE195675-1477-4E47-94F6-3BD76D759B4A@open-mpi.org>
To: common-dev@hadoop.apache.org
X-Mailer: Apple Mail (2.1084)
X-Gm-Message-State: ALoCoQkzWJ+5SVwWD5iPCBPgkweLkc9dJNs9bMj8LBNqfOaJ9v4PUURKZ+ETowR6N6jIYStOhEOR
Great to see this Ralph. Looking forward to the Hamster patch!
mahadev
On Feb 22, 2012, at 2:06 PM, Ralph Castain wrote:
> Many thanks to Noah for his off-list help in diagnosing the problem. =
There was an undiagnosed VPATH build issue in OMPI that surfaced with =
the Java bindings. This has been fixed - the tarball generated tonight =
will include the patch.
>=20
> Thanks again, Noah.
> Ralph
>=20
> On Feb 22, 2012, at 12:51 PM, Noah Watkins wrote:
>=20
>> I have LD_LIBRARY_PATH pointing to the full OpenMPI installation, =
which seems to include the MPI libraries. Is that what you meant by OMPI =
libraries?
>>=20
>> nwatkins@kyoto:~/projects/openmpi_java/openmpi-1.7a1r25994/examples$ =
echo $LD_LIBRARY_PATH=20
>> /home/nwatkins/projects/openmpi_java/install/lib:
>>=20
>> nwatkins@kyoto:~/projects/openmpi_java/openmpi-1.7a1r25994/examples$ =
ls -l /home/nwatkins/projects/openmpi_java/install/lib
>> total 19372
>> -rwxr-xr-x 1 nwatkins nwatkins 1027 2012-02-22 09:49 =
libmca_common_sm.la
>> lrwxrwxrwx 1 nwatkins nwatkins 25 2012-02-22 09:49 =
libmca_common_sm.so -> libmca_common_sm.so.0.0.0
>> lrwxrwxrwx 1 nwatkins nwatkins 25 2012-02-22 09:49 =
libmca_common_sm.so.0 -> libmca_common_sm.so.0.0.0
>> -rwxr-xr-x 1 nwatkins nwatkins 77835 2012-02-22 09:49 =
libmca_common_sm.so.0.0.0
>> -rwxr-xr-x 1 nwatkins nwatkins 1140 2012-02-22 09:49 =
libmpi_java.la
>> lrwxrwxrwx 1 nwatkins nwatkins 20 2012-02-22 09:49 =
libmpi_java.so -> libmpi_java.so.0.0.0
>> lrwxrwxrwx 1 nwatkins nwatkins 20 2012-02-22 09:49 =
libmpi_java.so.0 -> libmpi_java.so.0.0.0
>> -rwxr-xr-x 1 nwatkins nwatkins 393888 2012-02-22 09:49 =
libmpi_java.so.0.0.0
>> -rwxr-xr-x 1 nwatkins nwatkins 1051 2012-02-22 09:49 libmpi.la
>> lrwxrwxrwx 1 nwatkins nwatkins 15 2012-02-22 09:49 libmpi.so -> =
libmpi.so.0.0.0
>> lrwxrwxrwx 1 nwatkins nwatkins 15 2012-02-22 09:49 libmpi.so.0 =
-> libmpi.so.0.0.0
>> -rwxr-xr-x 1 nwatkins nwatkins 12002747 2012-02-22 09:49 =
libmpi.so.0.0.0
>> -rwxr-xr-x 1 nwatkins nwatkins 1003 2012-02-22 09:49 =
libompitrace.la
>> lrwxrwxrwx 1 nwatkins nwatkins 21 2012-02-22 09:49 =
libompitrace.so -> libompitrace.so.0.0.0
>> lrwxrwxrwx 1 nwatkins nwatkins 21 2012-02-22 09:49 =
libompitrace.so.0 -> libompitrace.so.0.0.0
>> -rwxr-xr-x 1 nwatkins nwatkins 86113 2012-02-22 09:49 =
libompitrace.so.0.0.0
>> -rwxr-xr-x 1 nwatkins nwatkins 1081 2012-02-22 09:49 =
libopen-pal.la
>> lrwxrwxrwx 1 nwatkins nwatkins 20 2012-02-22 09:49 =
libopen-pal.so -> libopen-pal.so.0.0.0
>> lrwxrwxrwx 1 nwatkins nwatkins 20 2012-02-22 09:49 =
libopen-pal.so.0 -> libopen-pal.so.0.0.0
>> -rwxr-xr-x 1 nwatkins nwatkins 2493981 2012-02-22 09:49 =
libopen-pal.so.0.0.0
>> -rwxr-xr-x 1 nwatkins nwatkins 1081 2012-02-22 09:49 =
libopen-rte.la
>> lrwxrwxrwx 1 nwatkins nwatkins 20 2012-02-22 09:49 =
libopen-rte.so -> libopen-rte.so.0.0.0
>> lrwxrwxrwx 1 nwatkins nwatkins 20 2012-02-22 09:49 =
libopen-rte.so.0 -> libopen-rte.so.0.0.0
>> -rwxr-xr-x 1 nwatkins nwatkins 4695012 2012-02-22 09:49 =
libopen-rte.so.0.0.0
>> -rw-r--r-- 1 nwatkins nwatkins 27260 2012-02-22 09:49 mpi.jar
>> drwxrwxr-x 2 nwatkins nwatkins 12288 2012-02-22 09:49 openmpi
>> drwxrwxr-x 2 nwatkins nwatkins 4096 2012-02-22 09:49 pkgconfig
>>=20
>> On Feb 22, 2012, at 10:25 AM, Ralph Castain wrote:
>>=20
>>> Hi Noah
>>>=20
>>> Your LD_LIBRARY_PATH has to include the path to the OMPI libraries =
so we can find libmpi. Did you include your $prefix/lib[64] in it?
>>>=20
>>> On Feb 22, 2012, at 11:02 AM, Noah Watkins wrote:
>>>=20
>>>> Just gave the nightly release a try and I'm getting an error:
>>>>=20
>>>> =
nwatkins@kyoto:~/projects/openmpi_java/openmpi-1.7a1r25994/examples$ =
mpirun -np 1 java Hello
>>>> JAVA BINDINGS FAILED TO LOAD REQUIRED LIBRARIES
>>>>=20
>>>> My setup is on the latest Ubuntu with:
>>>>=20
>>>> 1. Built with contrib/platform/hadoop/linux
>>>> 2. Compiled example with mpijavac
>>>> 3. LD_LIBRARY_PATH set to /mpi/java/install/lib
>>>>=20
>>>> Looks like Java is loading libmpi_java successfully, and something =
is going awry with the library magic in mpi_MPI.c:loadGlobalLibraries()
>>>>=20
>>>> Thanks,
>>>> Noah
>>>>=20
>>>> On Feb 21, 2012, at 3:05 PM, Ralph Castain wrote:
>>>>=20
>>>>> Hi folks
>>>>>=20
>>>>> With support from EMC, several of us in the Open MPI community =
(including LANL, Cisco, HLRS, Oracle, and IBM) have integrated Java =
bindings into the Open MPI code. The new bindings are not part of a =
formal release as this time (will be in the upcoming 1.7 series), but =
can be obtained from the Open MPI web site at:
>>>>>=20
>>>>> http://www.open-mpi.org/nightly/trunk/
>>>>>=20
>>>>> Instructions on how to build the binding support, build and run =
applications, etc. can be found in our FAQ section:
>>>>>=20
>>>>> http://www.open-mpi.org/faq/?category=3Djava
>>>>>=20
>>>>> Please feel free to post questions and bug reports to the OMPI =
User mailing list:
>>>>>=20
>>>>> http://www.open-mpi.org/community/lists/ompi.php
>>>>>=20
>>>>>=20
>>>>> I hope to release a version of Hamster in the not-too-distant =
future, once I finally get the 0.23 Hadoop release branch to =
successfully build and run on at least one of my machines (I've given up =
on the trunk). :-/
>>>>>=20
>>>>> Ralph
>>>>>=20
>>>>=20
>>>=20
>>=20
>=20
From common-dev-return-77829-apmail-hadoop-common-dev-archive=hadoop.apache.org@hadoop.apache.org Wed Feb 22 22:30:14 2012
Return-Path: <common-dev-return-77829-apmail-hadoop-common-dev-archive=hadoop.apache.org@hadoop.apache.org>
X-Original-To: apmail-hadoop-common-dev-archive@www.apache.org
Delivered-To: apmail-hadoop-common-dev-archive@www.apache.org
Received: from mail.apache.org (hermes.apache.org [140.211.11.3])
by minotaur.apache.org (Postfix) with SMTP id 423859CC8
for <apmail-hadoop-common-dev-archive@www.apache.org>; Wed, 22 Feb 2012 22:30:14 +0000 (UTC)
Received: (qmail 31752 invoked by uid 500); 22 Feb 2012 22:30:12 -0000
Delivered-To: apmail-hadoop-common-dev-archive@hadoop.apache.org
Received: (qmail 31690 invoked by uid 500); 22 Feb 2012 22:30:12 -0000
Mailing-List: contact common-dev-help@hadoop.apache.org; run by ezmlm
Precedence: bulk
List-Help: <mailto:common-dev-help@hadoop.apache.org>
List-Unsubscribe: <mailto:common-dev-unsubscribe@hadoop.apache.org>
List-Post: <mailto:common-dev@hadoop.apache.org>
List-Id: <common-dev.hadoop.apache.org>
Reply-To: common-dev@hadoop.apache.org
Delivered-To: mailing list common-dev@hadoop.apache.org
Received: (qmail 31682 invoked by uid 99); 22 Feb 2012 22:30:12 -0000
Received: from nike.apache.org (HELO nike.apache.org) (192.87.106.230)
by apache.org (qpsmtpd/0.29) with ESMTP; Wed, 22 Feb 2012 22:30:12 +0000
X-ASF-Spam-Status: No, hits=-2000.0 required=5.0
tests=ALL_TRUSTED,T_RP_MATCHES_RCVD
X-Spam-Check-By: apache.org
Received: from [140.211.11.116] (HELO hel.zones.apache.org) (140.211.11.116)
by apache.org (qpsmtpd/0.29) with ESMTP; Wed, 22 Feb 2012 22:30:10 +0000
Received: from hel.zones.apache.org (hel.zones.apache.org [140.211.11.116])
by hel.zones.apache.org (Postfix) with ESMTP id 8585F335C55
for <common-dev@hadoop.apache.org>; Wed, 22 Feb 2012 22:29:49 +0000 (UTC)
Date: Wed, 22 Feb 2012 22:29:49 +0000 (UTC)
From: "Sanjay Radia (Created) (JIRA)" <jira@apache.org>
To: common-dev@hadoop.apache.org
Message-ID: <835270695.6609.1329949789548.JavaMail.tomcat@hel.zones.apache.org>
Subject: [jira] [Created] (HADOOP-8101) Security changes for Hadoop for
Windows
MIME-Version: 1.0
Content-Type: text/plain; charset=utf-8
Content-Transfer-Encoding: 7bit
X-JIRA-FingerPrint: 30527f35849b9dde25b450d4833f0394
X-Virus-Checked: Checked by ClamAV on apache.org
Security changes for Hadoop for Windows
---------------------------------------
Key: HADOOP-8101
URL: https://issues.apache.org/jira/browse/HADOOP-8101
Project: Hadoop Common
Issue Type: Sub-task
Reporter: Sanjay Radia
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
From common-dev-return-77830-apmail-hadoop-common-dev-archive=hadoop.apache.org@hadoop.apache.org Wed Feb 22 22:32:11 2012
Return-Path: <common-dev-return-77830-apmail-hadoop-common-dev-archive=hadoop.apache.org@hadoop.apache.org>
X-Original-To: apmail-hadoop-common-dev-archive@www.apache.org
Delivered-To: apmail-hadoop-common-dev-archive@www.apache.org
Received: from mail.apache.org (hermes.apache.org [140.211.11.3])
by minotaur.apache.org (Postfix) with SMTP id C6F1B9EB7
for <apmail-hadoop-common-dev-archive@www.apache.org>; Wed, 22 Feb 2012 22:32:11 +0000 (UTC)
Received: (qmail 38926 invoked by uid 500); 22 Feb 2012 22:32:10 -0000
Delivered-To: apmail-hadoop-common-dev-archive@hadoop.apache.org
Received: (qmail 38839 invoked by uid 500); 22 Feb 2012 22:32:10 -0000
Mailing-List: contact common-dev-help@hadoop.apache.org; run by ezmlm
Precedence: bulk
List-Help: <mailto:common-dev-help@hadoop.apache.org>
List-Unsubscribe: <mailto:common-dev-unsubscribe@hadoop.apache.org>
List-Post: <mailto:common-dev@hadoop.apache.org>
List-Id: <common-dev.hadoop.apache.org>
Reply-To: common-dev@hadoop.apache.org
Delivered-To: mailing list common-dev@hadoop.apache.org
Received: (qmail 38831 invoked by uid 99); 22 Feb 2012 22:32:10 -0000
Received: from athena.apache.org (HELO athena.apache.org) (140.211.11.136)
by apache.org (qpsmtpd/0.29) with ESMTP; Wed, 22 Feb 2012 22:32:10 +0000
X-ASF-Spam-Status: No, hits=-2000.0 required=5.0
tests=ALL_TRUSTED,T_RP_MATCHES_RCVD
X-Spam-Check-By: apache.org
Received: from [140.211.11.116] (HELO hel.zones.apache.org) (140.211.11.116)
by apache.org (qpsmtpd/0.29) with ESMTP; Wed, 22 Feb 2012 22:32:09 +0000
Received: from hel.zones.apache.org (hel.zones.apache.org [140.211.11.116])
by hel.zones.apache.org (Postfix) with ESMTP id 40C5D335E30
for <common-dev@hadoop.apache.org>; Wed, 22 Feb 2012 22:31:49 +0000 (UTC)
Date: Wed, 22 Feb 2012 22:31:49 +0000 (UTC)
From: "Sanjay Radia (Created) (JIRA)" <jira@apache.org>
To: common-dev@hadoop.apache.org
Message-ID: <1338177245.6615.1329949909266.JavaMail.tomcat@hel.zones.apache.org>
Subject: [jira] [Created] (HADOOP-8102) General Util Changes for Hadoop for
Windows
MIME-Version: 1.0
Content-Type: text/plain; charset=utf-8
Content-Transfer-Encoding: 7bit
X-JIRA-FingerPrint: 30527f35849b9dde25b450d4833f0394
General Util Changes for Hadoop for Windows
--------------------------------------------
Key: HADOOP-8102
URL: https://issues.apache.org/jira/browse/HADOOP-8102
Project: Hadoop Common
Issue Type: Sub-task
Reporter: Sanjay Radia
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
From common-dev-return-77831-apmail-hadoop-common-dev-archive=hadoop.apache.org@hadoop.apache.org Wed Feb 22 22:38:19 2012
Return-Path: <common-dev-return-77831-apmail-hadoop-common-dev-archive=hadoop.apache.org@hadoop.apache.org>
X-Original-To: apmail-hadoop-common-dev-archive@www.apache.org
Delivered-To: apmail-hadoop-common-dev-archive@www.apache.org
Received: from mail.apache.org (hermes.apache.org [140.211.11.3])
by minotaur.apache.org (Postfix) with SMTP id 6D11C9235
for <apmail-hadoop-common-dev-archive@www.apache.org>; Wed, 22 Feb 2012 22:38:19 +0000 (UTC)
Received: (qmail 60684 invoked by uid 500); 22 Feb 2012 22:38:17 -0000
Delivered-To: apmail-hadoop-common-dev-archive@hadoop.apache.org
Received: (qmail 60591 invoked by uid 500); 22 Feb 2012 22:38:17 -0000
Mailing-List: contact common-dev-help@hadoop.apache.org; run by ezmlm
Precedence: bulk
List-Help: <mailto:common-dev-help@hadoop.apache.org>
List-Unsubscribe: <mailto:common-dev-unsubscribe@hadoop.apache.org>
List-Post: <mailto:common-dev@hadoop.apache.org>
List-Id: <common-dev.hadoop.apache.org>
Reply-To: common-dev@hadoop.apache.org
Delivered-To: mailing list common-dev@hadoop.apache.org
Received: (qmail 60579 invoked by uid 99); 22 Feb 2012 22:38:17 -0000
Received: from nike.apache.org (HELO nike.apache.org) (192.87.106.230)
by apache.org (qpsmtpd/0.29) with ESMTP; Wed, 22 Feb 2012 22:38:17 +0000
X-ASF-Spam-Status: No, hits=2.2 required=5.0
tests=HTML_MESSAGE,RCVD_IN_DNSWL_LOW,SPF_NEUTRAL
X-Spam-Check-By: apache.org
Received-SPF: neutral (nike.apache.org: local policy)
Received: from [209.85.210.48] (HELO mail-pz0-f48.google.com) (209.85.210.48)
by apache.org (qpsmtpd/0.29) with ESMTP; Wed, 22 Feb 2012 22:38:11 +0000
Received: by dadp13 with SMTP id p13so654689dad.35
for <common-dev@hadoop.apache.org>; Wed, 22 Feb 2012 14:37:49 -0800 (PST)
Received-SPF: pass (google.com: domain of niels@basj.es designates 10.68.129.137 as permitted sender) client-ip=10.68.129.137;
Authentication-Results: mr.google.com; spf=pass (google.com: domain of niels@basj.es designates 10.68.129.137 as permitted sender) smtp.mail=niels@basj.es
Received: from mr.google.com ([10.68.129.137])
by 10.68.129.137 with SMTP id nw9mr34971693pbb.73.1329950269649 (num_hops = 1);
Wed, 22 Feb 2012 14:37:49 -0800 (PST)
MIME-Version: 1.0
Received: by 10.68.129.137 with SMTP id nw9mr28510059pbb.73.1329950269470;
Wed, 22 Feb 2012 14:37:49 -0800 (PST)
Sender: niels@basj.es
Received: by 10.143.141.16 with HTTP; Wed, 22 Feb 2012 14:37:49 -0800 (PST)
X-Originating-IP: [2001:980:91c0:1:216:eaff:fe5f:3cc6]
In-Reply-To: <FCA91A92EE52B041906A0358FC28FCC3919E0EE923@FRE1EXCH02.hq.exar.com>
References: <CADoiZqrPmt9c1JWvvg-_TJzP5GmxR6XU-bi3d8hLVLSYnQq40w@mail.gmail.com>
<FCA91A92EE52B041906A0358FC28FCC3919E0EE923@FRE1EXCH02.hq.exar.com>
Date: Wed, 22 Feb 2012 23:37:49 +0100
X-Google-Sender-Auth: IczJw0r4xDO572eH6ihJ8eR8dlE
Message-ID: <CADoiZqq93uMdpvFdvjwhQMzCv+8ynFXoXihfk6jYOPjnMSa0Jg@mail.gmail.com>
Subject: Re: Making Gzip splittable
From: Niels Basjes <Niels@basjes.nl>
To: common-dev@hadoop.apache.org
Content-Type: multipart/alternative; boundary=047d7b10d20361772f04b9952dcc
X-Gm-Message-State: ALoCoQlbgvYr+Db88H/Gu85RLA+ldVfHvhxMcrA5/sgLduorbUQ17ooPq7DZ1dq8Gs6ZlrO2KWzG
X-Virus-Checked: Checked by ClamAV on apache.org
--047d7b10d20361772f04b9952dcc
Content-Type: text/plain; charset=ISO-8859-1
Hi,
On Wed, Feb 22, 2012 at 19:14, Tim Broberg <Tim.Broberg@exar.com> wrote:
> There are three options here:
> 1 - Add your codec, and alternative to the default gzip codec.
> 2 - Modify the gzip codec to incorporate your feature so that it is
> pseudo-splittable by default (skippable?)
> 3 - Do nothing
>
> The code uses the normal splittability interface and doesn't invent some
> new solution. It seems perfectly well explained.
>
The choice was made to implement it as a separate 'Codec' that reuses all
decompression functionality from the existing GzipCodec without making any
changes to the original. This way there is no duplicate code and there is
no risk the existing GzipCodec is affected by the new functionality.
This was actually one of the first review comments I got on one of the
first versions (which did have a few minor changes in the GzipCodec).
So that is why option '1' was chosen instead of '2'.
There is a lot of explanation in there on how to switch over from one codec
> to the other.
>
Enabling the codec is only one setting.
There is however a quite a bit of documentation on the matter how to use it.
Does it all get simpler if skippability is implemented by default but the
> option is not enabled?
>
There are two answers to this:
1) No, it won't get simpler.
2) This feature cannot be disabled per codec. The reason is that the
framework creates splits if the applicable codec implements the
SplittableCompressionCodec. This check is done purely by doing an
"instanceof" check. After that the FileInputFormat creates the splits
without consulting the codec class at all. So either a codec is splittable
or not. And the splits are defined independent of the codec.
So there is (unfortunately) currently no way to create a codec that can be
splittable/non-splittable by using a config setting.
Does this make things any less potentially confusing?
>
I don't think this would make it less confusing.
Niels
> - Tim.
>
> ________________________________________
> From: niels@basj.es [niels@basj.es] On Behalf Of Niels Basjes [
> Niels@basjes.nl]
> Sent: Sunday, February 19, 2012 4:23 PM
> To: common-dev
> Subject: Making Gzip splittable
>
> Hi,
>
> As some of you know I've created a patch that effectively makes Gzip
> splittable.
>
> https://issues.apache.org/jira/browse/HADOOP-7076
>
> What this does is for a split somewhere in the middle of the file it will
> read from the start of the file up until the point where the split starts.
> This is a useful waste of resources because it creates room to run a heavy
> lifting mapper in parallel.
> Due to this balance between the waste being useful and the waste being
> wasteful I've included extensive documentation in the patch on how it works
> and how to use it.
>
> I've seen that there are quite a few real life situations where I expect my
> solution can be useful.
>
> What I created is as far as I can tell the only way you can split a gzipped
> file without prior knowledge about the actual file.
> If you do have prior information then other directions with a similar goal
> are possible:
> - Analyzing the file beforehand:
> HADOOP-6153<https://issues.apache.org/jira/browse/HADOOP-6153>
> - Create a specially crafted gzipped file:
> HADOOP-7909<https://issues.apache.org/jira/browse/HADOOP-7909>
>
> Over the last year I've had review comments from Chris Douglas (until he
> stopped being involved in Hadoop) and later from Luke Lu.
>
> Now the last feedback I got from Luke is this:
>
> > Niels, I'm ambivalent about this patch. It has clean code and
> > documentation, OTOH, it has really confusing usage/semantics and
> > dubious general utility that the community might not want to maintain
> > as part of an official release. After having to explain many finer
> > points of Hadoop to new users/developers these days, I think the
> > downside of this patch might out weight its benefits. I'm -0 on it.
> > i.e., you need somebody else to +1 on this.
>
> So after consulting Eli I'm asking this group.
>
> My views on this feature:
> - I think this feature should go in because I think others can benefit from
> it.
> - I also think that it should remain disabled by default. It can then be
> used by those that read the documentation.
> - The implementation does not contain any decompression code at all. It
> only does the splitting smartness. (It could even be refactored to make any
> codec splittable). It has been tested with both the java and the native
> decompressors.
>
> What do you think?
>
> Is this a feature that should go in the official release or not?
>
> --
> Best regards
>
> Niels Basjes
>
> The information and any attached documents contained in this message
> may be confidential and/or legally privileged. The message is
> intended solely for the addressee(s). If you are not the intended
> recipient, you are hereby notified that any use, dissemination, or
> reproduction is strictly prohibited and may be unlawful. If you are
> not the intended recipient, please contact the sender immediately by
> return e-mail and destroy all copies of the original message.
>
--
Best regards / Met vriendelijke groeten,
Niels Basjes
--047d7b10d20361772f04b9952dcc--
From common-dev-return-77832-apmail-hadoop-common-dev-archive=hadoop.apache.org@hadoop.apache.org Thu Feb 23 00:18:11 2012
Return-Path: <common-dev-return-77832-apmail-hadoop-common-dev-archive=hadoop.apache.org@hadoop.apache.org>
X-Original-To: apmail-hadoop-common-dev-archive@www.apache.org
Delivered-To: apmail-hadoop-common-dev-archive@www.apache.org
Received: from mail.apache.org (hermes.apache.org [140.211.11.3])
by minotaur.apache.org (Postfix) with SMTP id 522459D23
for <apmail-hadoop-common-dev-archive@www.apache.org>; Thu, 23 Feb 2012 00:18:11 +0000 (UTC)
Received: (qmail 37592 invoked by uid 500); 23 Feb 2012 00:18:09 -0000
Delivered-To: apmail-hadoop-common-dev-archive@hadoop.apache.org
Received: (qmail 37531 invoked by uid 500); 23 Feb 2012 00:18:09 -0000
Mailing-List: contact common-dev-help@hadoop.apache.org; run by ezmlm
Precedence: bulk
List-Help: <mailto:common-dev-help@hadoop.apache.org>
List-Unsubscribe: <mailto:common-dev-unsubscribe@hadoop.apache.org>
List-Post: <mailto:common-dev@hadoop.apache.org>
List-Id: <common-dev.hadoop.apache.org>
Reply-To: common-dev@hadoop.apache.org
Delivered-To: mailing list common-dev@hadoop.apache.org
Received: (qmail 37522 invoked by uid 99); 23 Feb 2012 00:18:09 -0000
Received: from athena.apache.org (HELO athena.apache.org) (140.211.11.136)
by apache.org (qpsmtpd/0.29) with ESMTP; Thu, 23 Feb 2012 00:18:09 +0000
X-ASF-Spam-Status: No, hits=-2000.0 required=5.0
tests=ALL_TRUSTED,T_RP_MATCHES_RCVD
X-Spam-Check-By: apache.org
Received: from [140.211.11.116] (HELO hel.zones.apache.org) (140.211.11.116)
by apache.org (qpsmtpd/0.29) with ESMTP; Thu, 23 Feb 2012 00:18:08 +0000
Received: from hel.zones.apache.org (hel.zones.apache.org [140.211.11.116])
by hel.zones.apache.org (Postfix) with ESMTP id A2618335E89
for <common-dev@hadoop.apache.org>; Thu, 23 Feb 2012 00:17:48 +0000 (UTC)
Date: Thu, 23 Feb 2012 00:17:48 +0000 (UTC)
From: "Sanjay Radia (Created) (JIRA)" <jira@apache.org>
To: common-dev@hadoop.apache.org
Message-ID: <1868641159.7159.1329956268666.JavaMail.tomcat@hel.zones.apache.org>
Subject: [jira] [Created] (HADOOP-8103) Hadoop-bin commands for windows
MIME-Version: 1.0
Content-Type: text/plain; charset=utf-8
Content-Transfer-Encoding: 7bit
X-JIRA-FingerPrint: 30527f35849b9dde25b450d4833f0394
Hadoop-bin commands for windows
-------------------------------
Key: HADOOP-8103
URL: https://issues.apache.org/jira/browse/HADOOP-8103
Project: Hadoop Common
Issue Type: Sub-task
Reporter: Sanjay Radia
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
From common-dev-return-77833-apmail-hadoop-common-dev-archive=hadoop.apache.org@hadoop.apache.org Thu Feb 23 01:14:15 2012
Return-Path: <common-dev-return-77833-apmail-hadoop-common-dev-archive=hadoop.apache.org@hadoop.apache.org>
X-Original-To: apmail-hadoop-common-dev-archive@www.apache.org
Delivered-To: apmail-hadoop-common-dev-archive@www.apache.org
Received: from mail.apache.org (hermes.apache.org [140.211.11.3])
by minotaur.apache.org (Postfix) with SMTP id 8B7B599D2
for <apmail-hadoop-common-dev-archive@www.apache.org>; Thu, 23 Feb 2012 01:14:15 +0000 (UTC)
Received: (qmail 81040 invoked by uid 500); 23 Feb 2012 01:14:13 -0000
Delivered-To: apmail-hadoop-common-dev-archive@hadoop.apache.org
Received: (qmail 80924 invoked by uid 500); 23 Feb 2012 01:14:13 -0000
Mailing-List: contact common-dev-help@hadoop.apache.org; run by ezmlm
Precedence: bulk
List-Help: <mailto:common-dev-help@hadoop.apache.org>
List-Unsubscribe: <mailto:common-dev-unsubscribe@hadoop.apache.org>
List-Post: <mailto:common-dev@hadoop.apache.org>
List-Id: <common-dev.hadoop.apache.org>
Reply-To: common-dev@hadoop.apache.org
Delivered-To: mailing list common-dev@hadoop.apache.org
Received: (qmail 80632 invoked by uid 99); 23 Feb 2012 01:14:13 -0000
Received: from athena.apache.org (HELO athena.apache.org) (140.211.11.136)
by apache.org (qpsmtpd/0.29) with ESMTP; Thu, 23 Feb 2012 01:14:13 +0000
X-ASF-Spam-Status: No, hits=-2000.0 required=5.0
tests=ALL_TRUSTED,T_RP_MATCHES_RCVD
X-Spam-Check-By: apache.org
Received: from [140.211.11.116] (HELO hel.zones.apache.org) (140.211.11.116)
by apache.org (qpsmtpd/0.29) with ESMTP; Thu, 23 Feb 2012 01:14:09 +0000
Received: from hel.zones.apache.org (hel.zones.apache.org [140.211.11.116])
by hel.zones.apache.org (Postfix) with ESMTP id F38B4334C9F
for <common-dev@hadoop.apache.org>; Thu, 23 Feb 2012 01:13:48 +0000 (UTC)
Date: Thu, 23 Feb 2012 01:13:48 +0000 (UTC)
From: "Colin Patrick McCabe (Created) (JIRA)" <jira@apache.org>
To: common-dev@hadoop.apache.org
Message-ID: <866902499.7424.1329959628998.JavaMail.tomcat@hel.zones.apache.org>
Subject: [jira] [Created] (HADOOP-8104) Inconsistent Jackson versions
MIME-Version: 1.0
Content-Type: text/plain; charset=utf-8
Content-Transfer-Encoding: 7bit
X-JIRA-FingerPrint: 30527f35849b9dde25b450d4833f0394
Inconsistent Jackson versions
-----------------------------
Key: HADOOP-8104
URL: https://issues.apache.org/jira/browse/HADOOP-8104
Project: Hadoop Common
Issue Type: Bug
Reporter: Colin Patrick McCabe
Assignee: Colin Patrick McCabe
This is a maven build issue.
Jersey 1.8 is pulling in version 1.7.1 of Jackson. Meanwhile, we are manually specifying that we want version 1.8 of Jackson in the POM files. This causes a conflict where Jackson produces unexpected results when serializing Map objects.
How to reproduce: try this code:
<code>
ObjectMapper mapper = new ObjectMapper();
Map<String, Object> m = new HashMap<String, Object>();
mapper.writeValue(new File("foo"), m);
</code>
You will get an exception:
<code>
Exception in thread "main" java.lang.NoSuchMethodError: org.codehaus.jackson.type.JavaType.isMapLikeType()Z
at org.codehaus.jackson.map.ser.BasicSerializerFactory.buildContainerSerializer(BasicSerializerFactory.java:396)
at org.codehaus.jackson.map.ser.BeanSerializerFactory.createSerializer(BeanSerializerFactory.java:267)
</code>
Basically the inconsistent versions of various Jackson components are causing this NoSuchMethod error.
As far as I know, this only occurs when serializing maps-- that's why it hasn't been found and fixed yet.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
From common-dev-return-77834-apmail-hadoop-common-dev-archive=hadoop.apache.org@hadoop.apache.org Thu Feb 23 04:28:22 2012
Return-Path: <common-dev-return-77834-apmail-hadoop-common-dev-archive=hadoop.apache.org@hadoop.apache.org>
X-Original-To: apmail-hadoop-common-dev-archive@www.apache.org
Delivered-To: apmail-hadoop-common-dev-archive@www.apache.org
Received: from mail.apache.org (hermes.apache.org [140.211.11.3])
by minotaur.apache.org (Postfix) with SMTP id 2DCA899B8
for <apmail-hadoop-common-dev-archive@www.apache.org>; Thu, 23 Feb 2012 04:28:22 +0000 (UTC)
Received: (qmail 73138 invoked by uid 500); 23 Feb 2012 04:28:19 -0000
Delivered-To: apmail-hadoop-common-dev-archive@hadoop.apache.org
Received: (qmail 73021 invoked by uid 500); 23 Feb 2012 04:28:18 -0000
Mailing-List: contact common-dev-help@hadoop.apache.org; run by ezmlm
Precedence: bulk
List-Help: <mailto:common-dev-help@hadoop.apache.org>
List-Unsubscribe: <mailto:common-dev-unsubscribe@hadoop.apache.org>
List-Post: <mailto:common-dev@hadoop.apache.org>
List-Id: <common-dev.hadoop.apache.org>
Reply-To: common-dev@hadoop.apache.org
Delivered-To: mailing list common-dev@hadoop.apache.org
Received: (qmail 72356 invoked by uid 99); 23 Feb 2012 04:28:12 -0000
Received: from nike.apache.org (HELO nike.apache.org) (192.87.106.230)
by apache.org (qpsmtpd/0.29) with ESMTP; Thu, 23 Feb 2012 04:28:12 +0000
X-ASF-Spam-Status: No, hits=-2000.0 required=5.0
tests=ALL_TRUSTED,T_RP_MATCHES_RCVD
X-Spam-Check-By: apache.org
Received: from [140.211.11.116] (HELO hel.zones.apache.org) (140.211.11.116)
by apache.org (qpsmtpd/0.29) with ESMTP; Thu, 23 Feb 2012 04:28:09 +0000
Received: from hel.zones.apache.org (hel.zones.apache.org [140.211.11.116])
by hel.zones.apache.org (Postfix) with ESMTP id C8340335F69
for <common-dev@hadoop.apache.org>; Thu, 23 Feb 2012 04:27:48 +0000 (UTC)
Date: Thu, 23 Feb 2012 04:27:48 +0000 (UTC)
From: "Eli Collins (Created) (JIRA)" <jira@apache.org>
To: common-dev@hadoop.apache.org
Message-ID: <1227279892.8139.1329971268821.JavaMail.tomcat@hel.zones.apache.org>
Subject: [jira] [Created] (HADOOP-8105) HADOOP-8013 breaks the Hive 0.8
tests
MIME-Version: 1.0
Content-Type: text/plain; charset=utf-8
Content-Transfer-Encoding: 7bit
X-JIRA-FingerPrint: 30527f35849b9dde25b450d4833f0394
X-Virus-Checked: Checked by ClamAV on apache.org
HADOOP-8013 breaks the Hive 0.8 tests
-------------------------------------
Key: HADOOP-8105
URL: https://issues.apache.org/jira/browse/HADOOP-8105
Project: Hadoop Common
Issue Type: Bug
Components: fs
Affects Versions: 0.23.1
Reporter: Eli Collins
Priority: Blocker
The FilterFileSystem javadoc says "The class FilterFileSystem itself simply overrides all methods of FileSystem with versions that pass all requests to the contained file system." initialize(URI, Configuration) is part of the FileSystem API, and before HADOOP-8013 it simply called fs.initialize(). After HADOOP-8013 it calls super.initialize() rather than delegating. Hive's ProxyLocalFileSystem would be able to work around this problem by calling setConf, but unfortunately FilterFileSystem does not override that method. We need to make FilterFileSystem call fs.initialize (instead of using super) and also override setConf.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
From common-dev-return-77835-apmail-hadoop-common-dev-archive=hadoop.apache.org@hadoop.apache.org Thu Feb 23 04:44:16 2012
Return-Path: <common-dev-return-77835-apmail-hadoop-common-dev-archive=hadoop.apache.org@hadoop.apache.org>
X-Original-To: apmail-hadoop-common-dev-archive@www.apache.org
Delivered-To: apmail-hadoop-common-dev-archive@www.apache.org
Received: from mail.apache.org (hermes.apache.org [140.211.11.3])
by minotaur.apache.org (Postfix) with SMTP id 19EC39BC3
for <apmail-hadoop-common-dev-archive@www.apache.org>; Thu, 23 Feb 2012 04:44:16 +0000 (UTC)
Received: (qmail 4828 invoked by uid 500); 23 Feb 2012 04:44:13 -0000
Delivered-To: apmail-hadoop-common-dev-archive@hadoop.apache.org
Received: (qmail 4433 invoked by uid 500); 23 Feb 2012 04:44:13 -0000
Mailing-List: contact common-dev-help@hadoop.apache.org; run by ezmlm
Precedence: bulk
List-Help: <mailto:common-dev-help@hadoop.apache.org>
List-Unsubscribe: <mailto:common-dev-unsubscribe@hadoop.apache.org>
List-Post: <mailto:common-dev@hadoop.apache.org>
List-Id: <common-dev.hadoop.apache.org>
Reply-To: common-dev@hadoop.apache.org
Delivered-To: mailing list common-dev@hadoop.apache.org
Received: (qmail 4198 invoked by uid 99); 23 Feb 2012 04:44:12 -0000
Received: from nike.apache.org (HELO nike.apache.org) (192.87.106.230)
by apache.org (qpsmtpd/0.29) with ESMTP; Thu, 23 Feb 2012 04:44:12 +0000
X-ASF-Spam-Status: No, hits=-2000.0 required=5.0
tests=ALL_TRUSTED,T_RP_MATCHES_RCVD
X-Spam-Check-By: apache.org
Received: from [140.211.11.116] (HELO hel.zones.apache.org) (140.211.11.116)
by apache.org (qpsmtpd/0.29) with ESMTP; Thu, 23 Feb 2012 04:44:09 +0000
Received: from hel.zones.apache.org (hel.zones.apache.org [140.211.11.116])
by hel.zones.apache.org (Postfix) with ESMTP id B5A873356E2
for <common-dev@hadoop.apache.org>; Thu, 23 Feb 2012 04:43:48 +0000 (UTC)
Date: Thu, 23 Feb 2012 04:43:48 +0000 (UTC)
From: "Amareshwari Sriramadasu (Resolved) (JIRA)" <jira@apache.org>
To: common-dev@hadoop.apache.org
Message-ID: <861846751.8175.1329972228745.JavaMail.tomcat@hel.zones.apache.org>
In-Reply-To: <1227279892.8139.1329971268821.JavaMail.tomcat@hel.zones.apache.org>
Subject: [jira] [Resolved] (HADOOP-8105) FilterFileSystem should delegate
initialize rather than use super
MIME-Version: 1.0
Content-Type: text/plain; charset=utf-8
Content-Transfer-Encoding: 7bit
X-JIRA-FingerPrint: 30527f35849b9dde25b450d4833f0394
X-Virus-Checked: Checked by ClamAV on apache.org
[ https://issues.apache.org/jira/browse/HADOOP-8105?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Amareshwari Sriramadasu resolved HADOOP-8105.
---------------------------------------------
Resolution: Duplicate
Eli, This is fixed through HADOOP-8054
> FilterFileSystem should delegate initialize rather than use super
> -----------------------------------------------------------------
>
> Key: HADOOP-8105
> URL: https://issues.apache.org/jira/browse/HADOOP-8105
> Project: Hadoop Common
> Issue Type: Bug
> Components: fs
> Affects Versions: 0.23.1
> Reporter: Eli Collins
> Priority: Blocker
>
> The FilterFileSystem javadoc says "The class FilterFileSystem itself simply overrides all methods of FileSystem with versions that pass all requests to the contained file system." initialize(URI, Configuration) is part of the FileSystem API, and before HADOOP-8013 it simply called fs.initialize(). After HADOOP-8013 it calls super.initialize() rather than delegating. This breaks a number of the Hive tests. Hive's ProxyLocalFileSystem would be able to work around this problem by calling setConf, but unfortunately FilterFileSystem does not override that method. We need to make FilterFileSystem call fs.initialize (instead of using super) and also override setConf.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
From common-dev-return-77836-apmail-hadoop-common-dev-archive=hadoop.apache.org@hadoop.apache.org Thu Feb 23 09:23:20 2012
Return-Path: <common-dev-return-77836-apmail-hadoop-common-dev-archive=hadoop.apache.org@hadoop.apache.org>
X-Original-To: apmail-hadoop-common-dev-archive@www.apache.org
Delivered-To: apmail-hadoop-common-dev-archive@www.apache.org
Received: from mail.apache.org (hermes.apache.org [140.211.11.3])
by minotaur.apache.org (Postfix) with SMTP id 7963E9B50
for <apmail-hadoop-common-dev-archive@www.apache.org>; Thu, 23 Feb 2012 09:23:20 +0000 (UTC)
Received: (qmail 80350 invoked by uid 500); 23 Feb 2012 09:23:18 -0000
Delivered-To: apmail-hadoop-common-dev-archive@hadoop.apache.org
Received: (qmail 80279 invoked by uid 500); 23 Feb 2012 09:23:18 -0000
Mailing-List: contact common-dev-help@hadoop.apache.org; run by ezmlm
Precedence: bulk
List-Help: <mailto:common-dev-help@hadoop.apache.org>
List-Unsubscribe: <mailto:common-dev-unsubscribe@hadoop.apache.org>
List-Post: <mailto:common-dev@hadoop.apache.org>
List-Id: <common-dev.hadoop.apache.org>
Reply-To: common-dev@hadoop.apache.org
Delivered-To: mailing list common-dev@hadoop.apache.org
Received: (qmail 80268 invoked by uid 99); 23 Feb 2012 09:23:18 -0000
Received: from nike.apache.org (HELO nike.apache.org) (192.87.106.230)
by apache.org (qpsmtpd/0.29) with ESMTP; Thu, 23 Feb 2012 09:23:18 +0000
X-ASF-Spam-Status: No, hits=-2000.0 required=5.0
tests=ALL_TRUSTED
X-Spam-Check-By: apache.org
Received: from [140.211.11.8] (HELO aegis.apache.org) (140.211.11.8)
by apache.org (qpsmtpd/0.29) with ESMTP; Thu, 23 Feb 2012 09:23:12 +0000
Received: from aegis (localhost [127.0.0.1])
by aegis.apache.org (Postfix) with ESMTP id 33561C00A0
for <common-dev@hadoop.apache.org>; Thu, 23 Feb 2012 09:22:51 +0000 (UTC)
Date: Thu, 23 Feb 2012 09:22:51 +0000 (UTC)
From: Apache Jenkins Server <jenkins@builds.apache.org>
To: common-dev@hadoop.apache.org
Message-ID: <1862148864.2811329988971193.JavaMail.hudson@aegis>
Subject: Build failed in Jenkins: Hadoop-Common-trunk #326
MIME-Version: 1.0
Content-Type: text/plain; charset=UTF-8
Content-Transfer-Encoding: quoted-printable
X-Jenkins-Job: Hadoop-Common-trunk
X-Jenkins-Result: FAILURE
X-Virus-Checked: Checked by ClamAV on apache.org
See <https://builds.apache.org/job/Hadoop-Common-trunk/326/changes>
Changes:
[szetszwo] HDFS-2981. In hdfs-default.xml, the default value of dfs.client.=
block.write.replace-datanode-on-failure.enable should be true.
[szetszwo] Move HDFS-2944 entry to 0.23 in CHANGES.txt.
[todd] HDFS-2985. Improve logging when replicas are marked as corrupt. Cont=
ributed by Todd Lipcon.
[bobby] HADOOP-7660 Maven generated .classpath doesnot includes "target/gen=
erated-test-source/java" as source directory. (Laxman via bobby)
[tucu] MAPREDUCE-3884. PWD should be first in the classpath of MR tasks (tu=
cu)
[szetszwo] HDFS-2907. Add a conf property dfs.datanode.fsdataset.factory t=
o make FSDataset in Datanode pluggable.
------------------------------------------
[...truncated 90933 lines...]
[DEBUG] (f) reactorProjects =3D [MavenProject: org.apache.hadoop:hadoop-a=
nnotations:0.24.0-SNAPSHOT @ <https://builds.apache.org/job/Hadoop-Common-t=
runk/ws/trunk/hadoop-common-project/hadoop-annotations/pom.xml,> MavenProje=
ct: org.apache.hadoop:hadoop-auth:0.24.0-SNAPSHOT @ <https://builds.apache.=
org/job/Hadoop-Common-trunk/ws/trunk/hadoop-common-project/hadoop-auth/pom.=
xml,> MavenProject: org.apache.hadoop:hadoop-auth-examples:0.24.0-SNAPSHOT =
@ <https://builds.apache.org/job/Hadoop-Common-trunk/ws/trunk/hadoop-common=
-project/hadoop-auth-examples/pom.xml,> MavenProject: org.apache.hadoop:had=
oop-common:0.24.0-SNAPSHOT @ <https://builds.apache.org/job/Hadoop-Common-t=
runk/ws/trunk/hadoop-common-project/hadoop-common/pom.xml,> MavenProject: o=
rg.apache.hadoop:hadoop-common-project:0.24.0-SNAPSHOT @ <https://builds.ap=
ache.org/job/Hadoop-Common-trunk/ws/trunk/hadoop-common-project/pom.xml]>
[DEBUG] (f) useDefaultExcludes =3D true
[DEBUG] (f) useDefaultManifestFile =3D false
[DEBUG] -- end configuration --
[INFO]=20
[INFO] --- maven-enforcer-plugin:1.0:enforce (dist-enforce) @ hadoop-common=
-project ---
[DEBUG] Configuring mojo org.apache.maven.plugins:maven-enforcer-plugin:1.0=
:enforce from plugin realm ClassRealm[plugin>org.apache.maven.plugins:maven=
-enforcer-plugin:1.0, parent: sun.misc.Launcher$AppClassLoader@182f0db]
[DEBUG] Configuring mojo 'org.apache.maven.plugins:maven-enforcer-plugin:1.=
0:enforce' with basic configurator -->
[DEBUG] (s) fail =3D true
[DEBUG] (s) failFast =3D false
[DEBUG] (f) ignoreCache =3D false
[DEBUG] (s) project =3D MavenProject: org.apache.hadoop:hadoop-common-pro=
ject:0.24.0-SNAPSHOT @ <https://builds.apache.org/job/Hadoop-Common-trunk/w=
s/trunk/hadoop-common-project/pom.xml>
[DEBUG] (s) version =3D [3.0.2,)
[DEBUG] (s) version =3D 1.6
[DEBUG] (s) rules =3D [org.apache.maven.plugins.enforcer.RequireMavenVers=
ion@b5cd7f, org.apache.maven.plugins.enforcer.RequireJavaVersion@1c65150]
[DEBUG] (s) session =3D org.apache.maven.execution.MavenSession@18f7701
[DEBUG] (s) skip =3D false
[DEBUG] -- end configuration --
[DEBUG] Executing rule: org.apache.maven.plugins.enforcer.RequireMavenVersi=
on
[DEBUG] Rule org.apache.maven.plugins.enforcer.RequireMavenVersion is cache=
able.
[DEBUG] Key org.apache.maven.plugins.enforcer.RequireMavenVersion -93731219=
7 was found in the cache
[DEBUG] The cached results are still valid. Skipping the rule: org.apache.m=
aven.plugins.enforcer.RequireMavenVersion
[DEBUG] Executing rule: org.apache.maven.plugins.enforcer.RequireJavaVersio=
n
[DEBUG] Rule org.apache.maven.plugins.enforcer.RequireJavaVersion is cachea=
ble.
[DEBUG] Key org.apache.maven.plugins.enforcer.RequireJavaVersion 48569 was =
found in the cache
[DEBUG] The cached results are still valid. Skipping the rule: org.apache.m=
aven.plugins.enforcer.RequireJavaVersion
[INFO]=20
[INFO] --- maven-site-plugin:3.0:attach-descriptor (attach-descriptor) @ ha=
doop-common-project ---
[DEBUG] Configuring mojo org.apache.maven.plugins:maven-site-plugin:3.0:att=
ach-descriptor from plugin realm ClassRealm[plugin>org.apache.maven.plugins=
:maven-site-plugin:3.0, parent: sun.misc.Launcher$AppClassLoader@182f0db]
[DEBUG] Configuring mojo 'org.apache.maven.plugins:maven-site-plugin:3.0:at=
tach-descriptor' with basic configurator -->
[DEBUG] (f) basedir =3D <https://builds.apache.org/job/Hadoop-Common-trun=
k/ws/trunk/hadoop-common-project>
[DEBUG] (f) inputEncoding =3D UTF-8
[DEBUG] (f) localRepository =3D id: local
url: file:///home/jenkins/.m2/repository/
layout: none
[DEBUG] (f) outputEncoding =3D UTF-8
[DEBUG] (f) pomPackagingOnly =3D true
[DEBUG] (f) project =3D MavenProject: org.apache.hadoop:hadoop-common-pro=
ject:0.24.0-SNAPSHOT @ <https://builds.apache.org/job/Hadoop-Common-trunk/w=
s/trunk/hadoop-common-project/pom.xml>
[DEBUG] (f) reactorProjects =3D [MavenProject: org.apache.hadoop:hadoop-a=
nnotations:0.24.0-SNAPSHOT @ <https://builds.apache.org/job/Hadoop-Common-t=
runk/ws/trunk/hadoop-common-project/hadoop-annotations/pom.xml,> MavenProje=
ct: org.apache.hadoop:hadoop-auth:0.24.0-SNAPSHOT @ <https://builds.apache.=
org/job/Hadoop-Common-trunk/ws/trunk/hadoop-common-project/hadoop-auth/pom.=
xml,> MavenProject: org.apache.hadoop:hadoop-auth-examples:0.24.0-SNAPSHOT =
@ <https://builds.apache.org/job/Hadoop-Common-trunk/ws/trunk/hadoop-common=
-project/hadoop-auth-examples/pom.xml,> MavenProject: org.apache.hadoop:had=
oop-common:0.24.0-SNAPSHOT @ <https://builds.apache.org/job/Hadoop-Common-t=
runk/ws/trunk/hadoop-common-project/hadoop-common/pom.xml,> MavenProject: o=
rg.apache.hadoop:hadoop-common-project:0.24.0-SNAPSHOT @ <https://builds.ap=
ache.org/job/Hadoop-Common-trunk/ws/trunk/hadoop-common-project/pom.xml]>
[DEBUG] (f) siteDirectory =3D <https://builds.apache.org/job/Hadoop-Commo=
n-trunk/ws/trunk/hadoop-common-project/src/site>
[DEBUG] -- end configuration --
[DEBUG] Mapped url: <https://builds.apache.org/job/Hadoop-Common-trunk/ws/t=
runk/hadoop-common-project/src/site> to relative path: src/site
[INFO]=20
[INFO] --- maven-javadoc-plugin:2.8.1:jar (module-javadocs) @ hadoop-common=
-project ---
[DEBUG] Configuring mojo org.apache.maven.plugins:maven-javadoc-plugin:2.8.=
1:jar from plugin realm ClassRealm[plugin>org.apache.maven.plugins:maven-ja=
vadoc-plugin:2.8.1, parent: sun.misc.Launcher$AppClassLoader@182f0db]
[DEBUG] Configuring mojo 'org.apache.maven.plugins:maven-javadoc-plugin:2.8=
.1:jar' with basic configurator -->
[DEBUG] (f) aggregate =3D false
[DEBUG] (f) attach =3D true
[DEBUG] (f) author =3D true
[DEBUG] (f) bootclasspathArtifacts =3D []
[DEBUG] (f) bottom =3D Copyright &#169; {inceptionYear}-{currentYear} {or=
ganizationName}. All Rights Reserved.
[DEBUG] (f) breakiterator =3D false
[DEBUG] (f) debug =3D false
[DEBUG] (f) defaultManifestFile =3D <https://builds.apache.org/job/Hadoop=
-Common-trunk/ws/trunk/hadoop-common-project/target/classes/META-INF/MANIFE=
ST.MF>
[DEBUG] (f) destDir =3D <https://builds.apache.org/job/Hadoop-Common-trun=
k/ws/trunk/hadoop-common-project/target>
[DEBUG] (f) detectJavaApiLink =3D true
[DEBUG] (f) detectLinks =3D false
[DEBUG] (f) detectOfflineLinks =3D true
[DEBUG] (f) docencoding =3D UTF-8
[DEBUG] (f) docfilessubdirs =3D false
[DEBUG] (f) docletArtifact =3D groupId =3D 'null'
artifactId =3D 'null'
version =3D 'null'
[DEBUG] (f) docletArtifacts =3D []
[DEBUG] (f) doctitle =3D Apache Hadoop Common Project 0.24.0-SNAPSHOT API
[DEBUG] (f) encoding =3D UTF-8
[DEBUG] (f) failOnError =3D true
[DEBUG] (f) finalName =3D hadoop-common-project-0.24.0-SNAPSHOT
[DEBUG] (f) groups =3D []
[DEBUG] (f) includeDependencySources =3D false
[DEBUG] (f) includeTransitiveDependencySources =3D false
[DEBUG] (f) isOffline =3D false
[DEBUG] (f) jarOutputDirectory =3D <https://builds.apache.org/job/Hadoop-=
Common-trunk/ws/trunk/hadoop-common-project/target>
[DEBUG] (f) javaApiLinks =3D {}
[DEBUG] (f) javadocDirectory =3D <https://builds.apache.org/job/Hadoop-Co=
mmon-trunk/ws/trunk/hadoop-common-project/src/main/javadoc>
[DEBUG] (f) javadocOptionsDir =3D <https://builds.apache.org/job/Hadoop-C=
ommon-trunk/ws/trunk/hadoop-common-project/target/javadoc-bundle-options>
[DEBUG] (f) keywords =3D false
[DEBUG] (f) links =3D []
[DEBUG] (f) linksource =3D false
[DEBUG] (f) localRepository =3D id: local
url: file:///home/jenkins/.m2/repository/
layout: none
[DEBUG] (f) nocomment =3D false
[DEBUG] (f) nodeprecated =3D false
[DEBUG] (f) nodeprecatedlist =3D false
[DEBUG] (f) nohelp =3D false
[DEBUG] (f) noindex =3D false
[DEBUG] (f) nonavbar =3D false
[DEBUG] (f) nooverview =3D false
[DEBUG] (f) nosince =3D false
[DEBUG] (f) notimestamp =3D false
[DEBUG] (f) notree =3D false
[DEBUG] (f) offlineLinks =3D []
[DEBUG] (f) old =3D false
[DEBUG] (f) outputDirectory =3D <https://builds.apache.org/job/Hadoop-Com=
mon-trunk/ws/trunk/hadoop-common-project/target>
[DEBUG] (f) overview =3D <https://builds.apache.org/job/Hadoop-Common-tru=
nk/ws/trunk/hadoop-common-project/src/main/javadoc/overview.html>
[DEBUG] (f) project =3D MavenProject: org.apache.hadoop:hadoop-common-pro=
ject:0.24.0-SNAPSHOT @ <https://builds.apache.org/job/Hadoop-Common-trunk/w=
s/trunk/hadoop-common-project/pom.xml>
[DEBUG] (f) quiet =3D false
[DEBUG] (f) reactorProjects =3D [MavenProject: org.apache.hadoop:hadoop-a=
nnotations:0.24.0-SNAPSHOT @ <https://builds.apache.org/job/Hadoop-Common-t=
runk/ws/trunk/hadoop-common-project/hadoop-annotations/pom.xml,> MavenProje=
ct: org.apache.hadoop:hadoop-auth:0.24.0-SNAPSHOT @ <https://builds.apache.=
org/job/Hadoop-Common-trunk/ws/trunk/hadoop-common-project/hadoop-auth/pom.=
xml,> MavenProject: org.apache.hadoop:hadoop-auth-examples:0.24.0-SNAPSHOT =
@ <https://builds.apache.org/job/Hadoop-Common-trunk/ws/trunk/hadoop-common=
-project/hadoop-auth-examples/pom.xml,> MavenProject: org.apache.hadoop:had=
oop-common:0.24.0-SNAPSHOT @ <https://builds.apache.org/job/Hadoop-Common-t=
runk/ws/trunk/hadoop-common-project/hadoop-common/pom.xml,> MavenProject: o=
rg.apache.hadoop:hadoop-common-project:0.24.0-SNAPSHOT @ <https://builds.ap=
ache.org/job/Hadoop-Common-trunk/ws/trunk/hadoop-common-project/pom.xml]>
[DEBUG] (f) remoteRepositories =3D [ id: apache.snapshots.https
url: https://repository.apache.org/content/repositories/snapshots
layout: default
snapshots: [enabled =3D> true, update =3D> daily]
releases: [enabled =3D> true, update =3D> daily]
, id: repository.jboss.org
url: http://repository.jboss.org/nexus/content/groups/public/
layout: default
snapshots: [enabled =3D> false, update =3D> daily]
releases: [enabled =3D> true, update =3D> daily]
, id: central
url: http://repo1.maven.org/maven2
layout: default
snapshots: [enabled =3D> false, update =3D> daily]
releases: [enabled =3D> true, update =3D> daily]
]
[DEBUG] (f) resourcesArtifacts =3D []
[DEBUG] (f) serialwarn =3D false
[DEBUG] (f) session =3D org.apache.maven.execution.MavenSession@18f7701
[DEBUG] (f) settings =3D org.apache.maven.execution.SettingsAdapter@1de6b=
e9
[DEBUG] (f) show =3D protected
[DEBUG] (f) skip =3D false
[DEBUG] (f) sourceDependencyCacheDir =3D <https://builds.apache.org/job/H=
adoop-Common-trunk/ws/trunk/hadoop-common-project/target/distro-javadoc-sou=
rces>
[DEBUG] (f) splitindex =3D false
[DEBUG] (f) stylesheet =3D java
[DEBUG] (f) tagletArtifact =3D groupId =3D 'null'
artifactId =3D 'null'
version =3D 'null'
[DEBUG] (f) tagletArtifacts =3D []
[DEBUG] (f) taglets =3D []
[DEBUG] (f) tags =3D []
[DEBUG] (f) use =3D true
[DEBUG] (f) useDefaultManifestFile =3D false
[DEBUG] (f) useStandardDocletOptions =3D true
[DEBUG] (f) validateLinks =3D false
[DEBUG] (f) verbose =3D false
[DEBUG] (f) version =3D true
[DEBUG] (f) windowtitle =3D Apache Hadoop Common Project 0.24.0-SNAPSHOT =
API
[DEBUG] -- end configuration --
[INFO] Not executing Javadoc as the project is not a Java classpath-capable=
package
[INFO]=20
[INFO] --- maven-checkstyle-plugin:2.6:checkstyle (default-cli) @ hadoop-co=
mmon-project ---
[DEBUG] Configuring mojo org.apache.maven.plugins:maven-checkstyle-plugin:2=
.6:checkstyle from plugin realm ClassRealm[plugin>org.apache.maven.plugins:=
maven-checkstyle-plugin:2.6, parent: sun.misc.Launcher$AppClassLoader@182f0=
db]
[DEBUG] Configuring mojo 'org.apache.maven.plugins:maven-checkstyle-plugin:=
2.6:checkstyle' with basic configurator -->
[DEBUG] (f) cacheFile =3D <https://builds.apache.org/job/Hadoop-Common-tr=
unk/ws/trunk/hadoop-common-project/target/checkstyle-cachefile>
[DEBUG] (f) configLocation =3D config/sun_checks.xml
[DEBUG] (f) consoleOutput =3D false
[DEBUG] (f) enableFilesSummary =3D true
[DEBUG] (f) enableRSS =3D true
[DEBUG] (f) enableRulesSummary =3D true
[DEBUG] (f) enableSeveritySummary =3D true
[DEBUG] (f) encoding =3D UTF-8
[DEBUG] (f) failsOnError =3D false
[DEBUG] (f) format =3D sun
[DEBUG] (f) headerFile =3D <https://builds.apache.org/job/Hadoop-Common-t=
runk/ws/trunk/hadoop-common-project/LICENSE.txt>
[DEBUG] (f) headerLocation =3D LICENSE.txt
[DEBUG] (f) includes =3D **/*.java
[DEBUG] (f) linkXRef =3D true
[DEBUG] (f) outputDirectory =3D <https://builds.apache.org/job/Hadoop-Com=
mon-trunk/ws/trunk/hadoop-common-project/target/site>
[DEBUG] (f) outputFile =3D <https://builds.apache.org/job/Hadoop-Common-t=
runk/ws/trunk/hadoop-common-project/target/checkstyle-result.xml>
[DEBUG] (f) outputFileFormat =3D xml
[DEBUG] (f) project =3D MavenProject: org.apache.hadoop:hadoop-common-pro=
ject:0.24.0-SNAPSHOT @ <https://builds.apache.org/job/Hadoop-Common-trunk/w=
s/trunk/hadoop-common-project/pom.xml>
[DEBUG] (f) skip =3D false
[DEBUG] (f) sourceDirectory =3D <https://builds.apache.org/job/Hadoop-Com=
mon-trunk/ws/trunk/hadoop-common-project/src/main/java>
[DEBUG] (f) suppressionsFileExpression =3D checkstyle.suppressions.file
[DEBUG] (f) testSourceDirectory =3D <https://builds.apache.org/job/Hadoop=
-Common-trunk/ws/trunk/hadoop-common-project/src/test/java>
[DEBUG] (f) xrefLocation =3D <https://builds.apache.org/job/Hadoop-Common=
-trunk/ws/trunk/hadoop-common-project/target/site/xref>
[DEBUG] -- end configuration --
[INFO]=20
[INFO] --- findbugs-maven-plugin:2.3.2:findbugs (default-cli) @ hadoop-comm=
on-project ---
[DEBUG] Configuring mojo org.codehaus.mojo:findbugs-maven-plugin:2.3.2:find=
bugs from plugin realm ClassRealm[plugin>org.codehaus.mojo:findbugs-maven-p=
lugin:2.3.2, parent: sun.misc.Launcher$AppClassLoader@182f0db]
[DEBUG] Configuring mojo 'org.codehaus.mojo:findbugs-maven-plugin:2.3.2:fin=
dbugs' with basic configurator -->
[DEBUG] (s) classFilesDirectory =3D <https://builds.apache.org/job/Hadoop=
-Common-trunk/ws/trunk/hadoop-common-project/target/classes>
[DEBUG] (s) compileSourceRoots =3D [<https://builds.apache.org/job/Hadoop=
-Common-trunk/ws/trunk/hadoop-common-project/src/main/java]>
[DEBUG] (s) debug =3D false
[DEBUG] (s) effort =3D Default
[DEBUG] (s) failOnError =3D true
[DEBUG] (s) findbugsXmlOutput =3D false
[DEBUG] (s) findbugsXmlOutputDirectory =3D <https://builds.apache.org/job=
/Hadoop-Common-trunk/ws/trunk/hadoop-common-project/target>
[DEBUG] (s) fork =3D true
[DEBUG] (s) includeTests =3D false
[DEBUG] (s) localRepository =3D id: local
url: file:///home/jenkins/.m2/repository/
layout: none
[DEBUG] (s) maxHeap =3D 512
[DEBUG] (s) nested =3D false
[DEBUG] (s) outputDirectory =3D <https://builds.apache.org/job/Hadoop-Com=
mon-trunk/ws/trunk/hadoop-common-project/target/site>
[DEBUG] (s) outputEncoding =3D UTF-8
[DEBUG] (s) pluginArtifacts =3D [org.codehaus.mojo:findbugs-maven-plugin:=
maven-plugin:2.3.2:, com.google.code.findbugs:bcel:jar:1.3.9:compile, org.c=
odehaus.gmaven:gmaven-mojo:jar:1.3:compile, org.codehaus.gmaven.runtime:gma=
ven-runtime-api:jar:1.3:compile, org.codehaus.gmaven.feature:gmaven-feature=
-api:jar:1.3:compile, org.codehaus.gmaven.runtime:gmaven-runtime-1.5:jar:1.=
3:compile, org.codehaus.gmaven.feature:gmaven-feature-support:jar:1.3:compi=
le, org.codehaus.groovy:groovy-all-minimal:jar:1.5.8:compile, org.apache.an=
t:ant:jar:1.7.1:compile, org.apache.ant:ant-launcher:jar:1.7.1:compile, jli=
ne:jline:jar:0.9.94:compile, org.codehaus.plexus:plexus-interpolation:jar:1=
.1:compile, org.codehaus.gmaven:gmaven-plugin:jar:1.3:compile, org.codehaus=
.gmaven.runtime:gmaven-runtime-loader:jar:1.3:compile, org.codehaus.gmaven.=
runtime:gmaven-runtime-support:jar:1.3:compile, org.sonatype.gshell:gshell-=
io:jar:2.0:compile, com.thoughtworks.qdox:qdox:jar:1.10:compile, org.apache=
.maven.shared:file-management:jar:1.2.1:compile, org.apache.maven.shared:ma=
ven-shared-io:jar:1.1:compile, commons-lang:commons-lang:jar:2.4:compile, o=
rg.slf4j:slf4j-api:jar:1.5.10:compile, org.sonatype.gossip:gossip:jar:1.2:c=
ompile, org.apache.maven.reporting:maven-reporting-impl:jar:2.1:compile, co=
mmons-validator:commons-validator:jar:1.2.0:compile, commons-beanutils:comm=
ons-beanutils:jar:1.7.0:compile, commons-digester:commons-digester:jar:1.6:=
compile, commons-logging:commons-logging:jar:1.0.4:compile, oro:oro:jar:2.0=
.8:compile, xml-apis:xml-apis:jar:1.0.b2:compile, org.codehaus.groovy:groov=
y-all:jar:1.7.4:compile, org.apache.maven.reporting:maven-reporting-api:jar=
:3.0:compile, org.apache.maven.doxia:doxia-core:jar:1.1.3:compile, org.apac=
he.maven.doxia:doxia-logging-api:jar:1.1.3:compile, xerces:xercesImpl:jar:2=
.9.1:compile, commons-httpclient:commons-httpclient:jar:3.1:compile, common=
s-codec:commons-codec:jar:1.2:compile, org.apache.maven.doxia:doxia-sink-ap=
i:jar:1.1.3:compile, org.apache.maven.doxia:doxia-decoration-model:jar:1.1.=
3:compile, org.apache.maven.doxia:doxia-site-renderer:jar:1.1.3:compile, or=
g.apache.maven.doxia:doxia-module-xhtml:jar:1.1.3:compile, org.apache.maven=
.doxia:doxia-module-fml:jar:1.1.3:compile, org.codehaus.plexus:plexus-i18n:=
jar:1.0-beta-7:compile, org.codehaus.plexus:plexus-velocity:jar:1.1.7:compi=
le, org.apache.velocity:velocity:jar:1.5:compile, commons-collections:commo=
ns-collections:jar:3.2:compile, org.apache.maven.shared:maven-doxia-tools:j=
ar:1.2.1:compile, commons-io:commons-io:jar:1.4:compile, com.google.code.fi=
ndbugs:findbugs-ant:jar:1.3.9:compile, com.google.code.findbugs:findbugs:ja=
r:1.3.9:compile, com.google.code.findbugs:jsr305:jar:1.3.9:compile, com.goo=
gle.code.findbugs:jFormatString:jar:1.3.9:compile, com.google.code.findbugs=
:annotations:jar:1.3.9:compile, dom4j:dom4j:jar:1.6.1:compile, jaxen:jaxen:=
jar:1.1.1:compile, jdom:jdom:jar:1.0:compile, xom:xom:jar:1.0:compile, xerc=
es:xmlParserAPIs:jar:2.6.2:compile, xalan:xalan:jar:2.6.0:compile, com.ibm.=
icu:icu4j:jar:2.6.1:compile, asm:asm:jar:3.1:compile, asm:asm-analysis:jar:=
3.1:compile, asm:asm-commons:jar:3.1:compile, asm:asm-util:jar:3.1:compile,=
asm:asm-tree:jar:3.1:compile, asm:asm-xml:jar:3.1:compile, jgoodies:plasti=
c:jar:1.2.0:compile, org.codehaus.plexus:plexus-resources:jar:1.0-alpha-4:c=
ompile, org.codehaus.plexus:plexus-utils:jar:1.5.1:compile]
[DEBUG] (s) project =3D MavenProject: org.apache.hadoop:hadoop-common-pro=
ject:0.24.0-SNAPSHOT @ <https://builds.apache.org/job/Hadoop-Common-trunk/w=
s/trunk/hadoop-common-project/pom.xml>
[DEBUG] (s) relaxed =3D false
[DEBUG] (s) remoteArtifactRepositories =3D [ id: apache.snapshots.h=
ttps
url: https://repository.apache.org/content/repositories/snapshots
layout: default
snapshots: [enabled =3D> true, update =3D> daily]
releases: [enabled =3D> true, update =3D> daily]
, id: repository.jboss.org
url: http://repository.jboss.org/nexus/content/groups/public/
layout: default
snapshots: [enabled =3D> false, update =3D> daily]
releases: [enabled =3D> true, update =3D> daily]
, id: central
url: http://repo1.maven.org/maven2
layout: default
snapshots: [enabled =3D> false, update =3D> daily]
releases: [enabled =3D> true, update =3D> daily]
]
[DEBUG] (s) skip =3D false
[DEBUG] (s) sourceEncoding =3D UTF-8
[DEBUG] (s) testClassFilesDirectory =3D <https://builds.apache.org/job/Ha=
doop-Common-trunk/ws/trunk/hadoop-common-project/target/test-classes>
[DEBUG] (s) testSourceRoots =3D [<https://builds.apache.org/job/Hadoop-Co=
mmon-trunk/ws/trunk/hadoop-common-project/src/test/java]>
[DEBUG] (s) threshold =3D Default
[DEBUG] (s) timeout =3D 600000
[DEBUG] (s) trace =3D false
[DEBUG] (s) xmlEncoding =3D UTF-8
[DEBUG] (s) xmlOutput =3D false
[DEBUG] (s) xmlOutputDirectory =3D <https://builds.apache.org/job/Hadoop-=
Common-trunk/ws/trunk/hadoop-common-project/target>
[DEBUG] (s) xrefLocation =3D <https://builds.apache.org/job/Hadoop-Common=
-trunk/ws/trunk/hadoop-common-project/target/site/xref>
[DEBUG] (s) xrefTestLocation =3D <https://builds.apache.org/job/Hadoop-Co=
mmon-trunk/ws/trunk/hadoop-common-project/target/site/xref-test>
[DEBUG] -- end configuration --
[INFO] ****** FindBugsMojo execute *******
[DEBUG] XML outputFile is <https://builds.apache.org/job/Hadoop-Common-trun=
k/ws/trunk/hadoop-common-project/target/findbugsXml.xml>
[DEBUG] Generating Findbugs XML
[DEBUG] Inside canGenerateReport..... false=20
[INFO] canGenerate is false
[INFO] --------------------------------------------------------------------=
----
[INFO] Reactor Summary:
[INFO]=20
[INFO] Apache Hadoop Annotations ......................... SUCCESS [17.881s=
]
[INFO] Apache Hadoop Auth ................................ SUCCESS [1:02.86=
0s]
[INFO] Apache Hadoop Auth Examples ....................... SUCCESS [7.767s]
[INFO] Apache Hadoop Common .............................. SUCCESS [4:42.73=
7s]
[INFO] Apache Hadoop Common Project ...................... SUCCESS [0.042s]
[INFO] --------------------------------------------------------------------=
----
[INFO] BUILD SUCCESS
[INFO] --------------------------------------------------------------------=
----
[INFO] Total time: 6:12.426s
[INFO] Finished at: Thu Feb 23 09:12:47 UTC 2012
[INFO] Final Memory: 77M/799M
[INFO] --------------------------------------------------------------------=
----
+ /home/jenkins/tools/maven/latest/bin/mvn test -Pclover -DcloverLicenseLoc=
ation=3D/home/jenkins/tools/clover/latest/lib/clover.license
Build step 'Execute shell' marked build as failure
[WARNINGS] Skipping publisher since build result is FAILURE
Archiving artifacts
Recording test results
Publishing Javadoc
Recording fingerprints
From common-dev-return-77837-apmail-hadoop-common-dev-archive=hadoop.apache.org@hadoop.apache.org Thu Feb 23 09:28:41 2012
Return-Path: <common-dev-return-77837-apmail-hadoop-common-dev-archive=hadoop.apache.org@hadoop.apache.org>
X-Original-To: apmail-hadoop-common-dev-archive@www.apache.org
Delivered-To: apmail-hadoop-common-dev-archive@www.apache.org
Received: from mail.apache.org (hermes.apache.org [140.211.11.3])
by minotaur.apache.org (Postfix) with SMTP id DB8E798E2
for <apmail-hadoop-common-dev-archive@www.apache.org>; Thu, 23 Feb 2012 09:28:40 +0000 (UTC)
Received: (qmail 2436 invoked by uid 500); 23 Feb 2012 09:28:39 -0000
Delivered-To: apmail-hadoop-common-dev-archive@hadoop.apache.org
Received: (qmail 2380 invoked by uid 500); 23 Feb 2012 09:28:39 -0000
Mailing-List: contact common-dev-help@hadoop.apache.org; run by ezmlm
Precedence: bulk
List-Help: <mailto:common-dev-help@hadoop.apache.org>
List-Unsubscribe: <mailto:common-dev-unsubscribe@hadoop.apache.org>
List-Post: <mailto:common-dev@hadoop.apache.org>
List-Id: <common-dev.hadoop.apache.org>
Reply-To: common-dev@hadoop.apache.org
Delivered-To: mailing list common-dev@hadoop.apache.org
Received: (qmail 2371 invoked by uid 99); 23 Feb 2012 09:28:39 -0000
Received: from athena.apache.org (HELO athena.apache.org) (140.211.11.136)
by apache.org (qpsmtpd/0.29) with ESMTP; Thu, 23 Feb 2012 09:28:39 +0000
X-ASF-Spam-Status: No, hits=-2000.0 required=5.0
tests=ALL_TRUSTED
X-Spam-Check-By: apache.org
Received: from [140.211.11.8] (HELO aegis.apache.org) (140.211.11.8)
by apache.org (qpsmtpd/0.29) with ESMTP; Thu, 23 Feb 2012 09:28:38 +0000
Received: from aegis (localhost [127.0.0.1])
by aegis.apache.org (Postfix) with ESMTP id 264EEC00A0
for <common-dev@hadoop.apache.org>; Thu, 23 Feb 2012 09:28:18 +0000 (UTC)
Date: Thu, 23 Feb 2012 09:28:18 +0000 (UTC)
From: Apache Jenkins Server <jenkins@builds.apache.org>
To: common-dev@hadoop.apache.org
Message-ID: <525230391.2821329989298140.JavaMail.hudson@aegis>
In-Reply-To: <938458627.1351329902338479.JavaMail.hudson@aegis>
References: <938458627.1351329902338479.JavaMail.hudson@aegis>
Subject: Jenkins build is back to normal : Hadoop-Common-0.23-Build #172
MIME-Version: 1.0
Content-Type: text/plain; charset=UTF-8
Content-Transfer-Encoding: 7bit
X-Jenkins-Job: Hadoop-Common-0.23-Build
X-Jenkins-Result: SUCCESS
See <https://builds.apache.org/job/Hadoop-Common-0.23-Build/172/changes>
From common-dev-return-77838-apmail-hadoop-common-dev-archive=hadoop.apache.org@hadoop.apache.org Thu Feb 23 23:16:11 2012
Return-Path: <common-dev-return-77838-apmail-hadoop-common-dev-archive=hadoop.apache.org@hadoop.apache.org>
X-Original-To: apmail-hadoop-common-dev-archive@www.apache.org
Delivered-To: apmail-hadoop-common-dev-archive@www.apache.org
Received: from mail.apache.org (hermes.apache.org [140.211.11.3])
by minotaur.apache.org (Postfix) with SMTP id 8E20F9C69
for <apmail-hadoop-common-dev-archive@www.apache.org>; Thu, 23 Feb 2012 23:16:11 +0000 (UTC)
Received: (qmail 2438 invoked by uid 500); 23 Feb 2012 23:16:09 -0000
Delivered-To: apmail-hadoop-common-dev-archive@hadoop.apache.org
Received: (qmail 2198 invoked by uid 500); 23 Feb 2012 23:16:09 -0000
Mailing-List: contact common-dev-help@hadoop.apache.org; run by ezmlm
Precedence: bulk
List-Help: <mailto:common-dev-help@hadoop.apache.org>
List-Unsubscribe: <mailto:common-dev-unsubscribe@hadoop.apache.org>
List-Post: <mailto:common-dev@hadoop.apache.org>
List-Id: <common-dev.hadoop.apache.org>
Reply-To: common-dev@hadoop.apache.org
Delivered-To: mailing list common-dev@hadoop.apache.org
Received: (qmail 2020 invoked by uid 99); 23 Feb 2012 23:16:09 -0000
Received: from athena.apache.org (HELO athena.apache.org) (140.211.11.136)
by apache.org (qpsmtpd/0.29) with ESMTP; Thu, 23 Feb 2012 23:16:09 +0000
X-ASF-Spam-Status: No, hits=-2000.0 required=5.0
tests=ALL_TRUSTED,T_RP_MATCHES_RCVD
X-Spam-Check-By: apache.org
Received: from [140.211.11.116] (HELO hel.zones.apache.org) (140.211.11.116)
by apache.org (qpsmtpd/0.29) with ESMTP; Thu, 23 Feb 2012 23:16:08 +0000
Received: from hel.zones.apache.org (hel.zones.apache.org [140.211.11.116])
by hel.zones.apache.org (Postfix) with ESMTP id AF3F3337120
for <common-dev@hadoop.apache.org>; Thu, 23 Feb 2012 23:15:48 +0000 (UTC)
Date: Thu, 23 Feb 2012 23:15:48 +0000 (UTC)
From: "Arpit Gupta (Created) (JIRA)" <jira@apache.org>
To: common-dev@hadoop.apache.org
Message-ID: <442120685.12500.1330038948719.JavaMail.tomcat@hel.zones.apache.org>
Subject: [jira] [Created] (HADOOP-8106) hadoop-config.sh script defaults to
/usr/etc/hadoop rather than /etc/hadoop for the default location of the
conf dir
MIME-Version: 1.0
Content-Type: text/plain; charset=utf-8
Content-Transfer-Encoding: 7bit
X-JIRA-FingerPrint: 30527f35849b9dde25b450d4833f0394
hadoop-config.sh script defaults to /usr/etc/hadoop rather than /etc/hadoop for the default location of the conf dir
--------------------------------------------------------------------------------------------------------------------
Key: HADOOP-8106
URL: https://issues.apache.org/jira/browse/HADOOP-8106
Project: Hadoop Common
Issue Type: Bug
Affects Versions: 1.0.0, 0.24.0
Reporter: Arpit Gupta
Assignee: Arpit Gupta
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
From common-dev-return-77839-apmail-hadoop-common-dev-archive=hadoop.apache.org@hadoop.apache.org Thu Feb 23 23:30:12 2012
Return-Path: <common-dev-return-77839-apmail-hadoop-common-dev-archive=hadoop.apache.org@hadoop.apache.org>
X-Original-To: apmail-hadoop-common-dev-archive@www.apache.org
Delivered-To: apmail-hadoop-common-dev-archive@www.apache.org
Received: from mail.apache.org (hermes.apache.org [140.211.11.3])
by minotaur.apache.org (Postfix) with SMTP id 3CB369C23
for <apmail-hadoop-common-dev-archive@www.apache.org>; Thu, 23 Feb 2012 23:30:12 +0000 (UTC)
Received: (qmail 41233 invoked by uid 500); 23 Feb 2012 23:30:10 -0000
Delivered-To: apmail-hadoop-common-dev-archive@hadoop.apache.org
Received: (qmail 41115 invoked by uid 500); 23 Feb 2012 23:30:10 -0000
Mailing-List: contact common-dev-help@hadoop.apache.org; run by ezmlm
Precedence: bulk
List-Help: <mailto:common-dev-help@hadoop.apache.org>
List-Unsubscribe: <mailto:common-dev-unsubscribe@hadoop.apache.org>
List-Post: <mailto:common-dev@hadoop.apache.org>
List-Id: <common-dev.hadoop.apache.org>
Reply-To: common-dev@hadoop.apache.org
Delivered-To: mailing list common-dev@hadoop.apache.org
Received: (qmail 41008 invoked by uid 99); 23 Feb 2012 23:30:10 -0000
Received: from athena.apache.org (HELO athena.apache.org) (140.211.11.136)
by apache.org (qpsmtpd/0.29) with ESMTP; Thu, 23 Feb 2012 23:30:10 +0000
X-ASF-Spam-Status: No, hits=-2000.0 required=5.0
tests=ALL_TRUSTED,T_RP_MATCHES_RCVD
X-Spam-Check-By: apache.org
Received: from [140.211.11.116] (HELO hel.zones.apache.org) (140.211.11.116)
by apache.org (qpsmtpd/0.29) with ESMTP; Thu, 23 Feb 2012 23:30:08 +0000
Received: from hel.zones.apache.org (hel.zones.apache.org [140.211.11.116])
by hel.zones.apache.org (Postfix) with ESMTP id DDD96337926
for <common-dev@hadoop.apache.org>; Thu, 23 Feb 2012 23:29:48 +0000 (UTC)
Date: Thu, 23 Feb 2012 23:29:48 +0000 (UTC)
From: "Viraj Bhat (Created) (JIRA)" <jira@apache.org>
To: common-dev@hadoop.apache.org
Message-ID: <363646818.12565.1330039788910.JavaMail.tomcat@hel.zones.apache.org>
Subject: [jira] [Created] (HADOOP-8107) getPriority() method within the
JobHistoryParser JobInfo class fails
MIME-Version: 1.0
Content-Type: text/plain; charset=utf-8
Content-Transfer-Encoding: 7bit
X-JIRA-FingerPrint: 30527f35849b9dde25b450d4833f0394
getPriority() method within the JobHistoryParser JobInfo class fails
--------------------------------------------------------------------
Key: HADOOP-8107
URL: https://issues.apache.org/jira/browse/HADOOP-8107
Project: Hadoop Common
Issue Type: Bug
Affects Versions: 0.23.0
Reporter: Viraj Bhat
Fix For: 0.23.1
When you use the following set of statements:
{code}
JobHistoryParser.JobInfo jobInfo;
jobInfo.getPriority(); //fails
{code}
The problem is that {code} public String getPriority() { return priority.toString(); } {code} will fail if the "priority" is null.
I was expecting priority to return a "NORMAL" value
Viraj
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
From common-dev-return-77840-apmail-hadoop-common-dev-archive=hadoop.apache.org@hadoop.apache.org Fri Feb 24 00:12:11 2012
Return-Path: <common-dev-return-77840-apmail-hadoop-common-dev-archive=hadoop.apache.org@hadoop.apache.org>
X-Original-To: apmail-hadoop-common-dev-archive@www.apache.org
Delivered-To: apmail-hadoop-common-dev-archive@www.apache.org
Received: from mail.apache.org (hermes.apache.org [140.211.11.3])
by minotaur.apache.org (Postfix) with SMTP id 4C14C9C0F
for <apmail-hadoop-common-dev-archive@www.apache.org>; Fri, 24 Feb 2012 00:12:11 +0000 (UTC)
Received: (qmail 64565 invoked by uid 500); 24 Feb 2012 00:12:09 -0000
Delivered-To: apmail-hadoop-common-dev-archive@hadoop.apache.org
Received: (qmail 64508 invoked by uid 500); 24 Feb 2012 00:12:09 -0000
Mailing-List: contact common-dev-help@hadoop.apache.org; run by ezmlm
Precedence: bulk
List-Help: <mailto:common-dev-help@hadoop.apache.org>
List-Unsubscribe: <mailto:common-dev-unsubscribe@hadoop.apache.org>
List-Post: <mailto:common-dev@hadoop.apache.org>
List-Id: <common-dev.hadoop.apache.org>
Reply-To: common-dev@hadoop.apache.org
Delivered-To: mailing list common-dev@hadoop.apache.org
Received: (qmail 64500 invoked by uid 99); 24 Feb 2012 00:12:09 -0000
Received: from athena.apache.org (HELO athena.apache.org) (140.211.11.136)
by apache.org (qpsmtpd/0.29) with ESMTP; Fri, 24 Feb 2012 00:12:09 +0000
X-ASF-Spam-Status: No, hits=-2000.0 required=5.0
tests=ALL_TRUSTED,T_RP_MATCHES_RCVD
X-Spam-Check-By: apache.org
Received: from [140.211.11.116] (HELO hel.zones.apache.org) (140.211.11.116)
by apache.org (qpsmtpd/0.29) with ESMTP; Fri, 24 Feb 2012 00:12:08 +0000
Received: from hel.zones.apache.org (hel.zones.apache.org [140.211.11.116])
by hel.zones.apache.org (Postfix) with ESMTP id DA10D3352D1
for <common-dev@hadoop.apache.org>; Fri, 24 Feb 2012 00:11:48 +0000 (UTC)
Date: Fri, 24 Feb 2012 00:11:48 +0000 (UTC)
From: "Brandon Li (Created) (JIRA)" <jira@apache.org>
To: common-dev@hadoop.apache.org
Message-ID: <438156976.12787.1330042308894.JavaMail.tomcat@hel.zones.apache.org>
Subject: [jira] [Created] (HADOOP-8108) move method getHostPortString() from
NameNode to NetUtils
MIME-Version: 1.0
Content-Type: text/plain; charset=utf-8
Content-Transfer-Encoding: 7bit
X-JIRA-FingerPrint: 30527f35849b9dde25b450d4833f0394
move method getHostPortString() from NameNode to NetUtils
---------------------------------------------------------
Key: HADOOP-8108
URL: https://issues.apache.org/jira/browse/HADOOP-8108
Project: Hadoop Common
Issue Type: Improvement
Components: util
Affects Versions: 0.24.0
Reporter: Brandon Li
Assignee: Brandon Li
Priority: Trivial
This issue is the counter part of the issue HDFS-3003.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
From common-dev-return-77841-apmail-hadoop-common-dev-archive=hadoop.apache.org@hadoop.apache.org Fri Feb 24 00:44:11 2012
Return-Path: <common-dev-return-77841-apmail-hadoop-common-dev-archive=hadoop.apache.org@hadoop.apache.org>
X-Original-To: apmail-hadoop-common-dev-archive@www.apache.org
Delivered-To: apmail-hadoop-common-dev-archive@www.apache.org
Received: from mail.apache.org (hermes.apache.org [140.211.11.3])
by minotaur.apache.org (Postfix) with SMTP id 81EC99EAF
for <apmail-hadoop-common-dev-archive@www.apache.org>; Fri, 24 Feb 2012 00:44:11 +0000 (UTC)
Received: (qmail 44796 invoked by uid 500); 24 Feb 2012 00:44:10 -0000
Delivered-To: apmail-hadoop-common-dev-archive@hadoop.apache.org
Received: (qmail 44734 invoked by uid 500); 24 Feb 2012 00:44:10 -0000
Mailing-List: contact common-dev-help@hadoop.apache.org; run by ezmlm
Precedence: bulk
List-Help: <mailto:common-dev-help@hadoop.apache.org>
List-Unsubscribe: <mailto:common-dev-unsubscribe@hadoop.apache.org>
List-Post: <mailto:common-dev@hadoop.apache.org>
List-Id: <common-dev.hadoop.apache.org>
Reply-To: common-dev@hadoop.apache.org
Delivered-To: mailing list common-dev@hadoop.apache.org
Received: (qmail 44723 invoked by uid 99); 24 Feb 2012 00:44:09 -0000
Received: from athena.apache.org (HELO athena.apache.org) (140.211.11.136)
by apache.org (qpsmtpd/0.29) with ESMTP; Fri, 24 Feb 2012 00:44:09 +0000
X-ASF-Spam-Status: No, hits=-2000.0 required=5.0
tests=ALL_TRUSTED,T_RP_MATCHES_RCVD
X-Spam-Check-By: apache.org
Received: from [140.211.11.116] (HELO hel.zones.apache.org) (140.211.11.116)
by apache.org (qpsmtpd/0.29) with ESMTP; Fri, 24 Feb 2012 00:44:08 +0000
Received: from hel.zones.apache.org (hel.zones.apache.org [140.211.11.116])
by hel.zones.apache.org (Postfix) with ESMTP id D18B1337700
for <common-dev@hadoop.apache.org>; Fri, 24 Feb 2012 00:43:48 +0000 (UTC)
Date: Fri, 24 Feb 2012 00:43:48 +0000 (UTC)
From: "Tim Broberg (Resolved) (JIRA)" <jira@apache.org>
To: common-dev@hadoop.apache.org
Message-ID: <2005353805.12939.1330044228859.JavaMail.tomcat@hel.zones.apache.org>
In-Reply-To: <600997917.5332.1327821370119.JavaMail.tomcat@hel.zones.apache.org>
Subject: [jira] [Resolved] (HADOOP-8003) Make SplitCompressionInputStream an
interface instead of an abstract class
MIME-Version: 1.0
Content-Type: text/plain; charset=utf-8
Content-Transfer-Encoding: 7bit
X-JIRA-FingerPrint: 30527f35849b9dde25b450d4833f0394
[ https://issues.apache.org/jira/browse/HADOOP-8003?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Tim Broberg resolved HADOOP-8003.
---------------------------------
Resolution: Won't Fix
This is not fixable.
SplitCompressionInputStream is constrained to be an InputStream - Callers read() from it. ...and it's right there in the name.
InputStream does not contain any interfaces with the necessary buttons present that SplitCompressionInputStream can extend, so the available options are:
1 - to extend InputStream or some descendent. This is the current design.
2 - Define an interface containing all the methods of CompressedInputStream, requiring implementing classes to pass them all through. This requires equivalent work to the current design.
3 - Modify InputStream in the java library to make use of interfaces. Madness.
The original design was the correct one given the definition of InputStream in the standard Java library.
> Make SplitCompressionInputStream an interface instead of an abstract class
> --------------------------------------------------------------------------
>
> Key: HADOOP-8003
> URL: https://issues.apache.org/jira/browse/HADOOP-8003
> Project: Hadoop Common
> Issue Type: New Feature
> Components: io
> Affects Versions: 0.21.0, 0.22.0, 0.23.0, 1.0.0
> Reporter: Tim Broberg
>
> To be splittable, a codec must extend SplittableCompressionCodec which has a function returning a SplitCompressionInputStream.
> SplitCompressionInputStream is an abstract class which extends CompressionInputStream, the lowest level compression stream class.
> So, no codec that wants to be splittable can reuse any code from DecompressorStream or BlockDecompressorStream.
> You either have to duplicate that code, or not be splittable.
> SplitCompressionInputStream adds just a few very thin functions. Can we make this an interface rather than an abstract class to allow splittable decompression streams to extend DecompressorStream, BlockDecompressorStream, or whatever else we should scheme up in the future?
> To my knowledge, this would impact only the BZip2 codec. None of the other implement this form of splittability yet.
> LineRecordReader looks only at whether the codec is an instance of SplittableCompressionCodec, and then calls the appropriate version of createInputStream. This would not change, so the application code should not have to change, just BZip and SplitCompressionInputStream.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
From common-dev-return-77842-apmail-hadoop-common-dev-archive=hadoop.apache.org@hadoop.apache.org Fri Feb 24 01:52:13 2012
Return-Path: <common-dev-return-77842-apmail-hadoop-common-dev-archive=hadoop.apache.org@hadoop.apache.org>
X-Original-To: apmail-hadoop-common-dev-archive@www.apache.org
Delivered-To: apmail-hadoop-common-dev-archive@www.apache.org
Received: from mail.apache.org (hermes.apache.org [140.211.11.3])
by minotaur.apache.org (Postfix) with SMTP id EF16B9F27
for <apmail-hadoop-common-dev-archive@www.apache.org>; Fri, 24 Feb 2012 01:52:13 +0000 (UTC)
Received: (qmail 15376 invoked by uid 500); 24 Feb 2012 01:52:12 -0000
Delivered-To: apmail-hadoop-common-dev-archive@hadoop.apache.org
Received: (qmail 15296 invoked by uid 500); 24 Feb 2012 01:52:12 -0000
Mailing-List: contact common-dev-help@hadoop.apache.org; run by ezmlm
Precedence: bulk
List-Help: <mailto:common-dev-help@hadoop.apache.org>
List-Unsubscribe: <mailto:common-dev-unsubscribe@hadoop.apache.org>
List-Post: <mailto:common-dev@hadoop.apache.org>
List-Id: <common-dev.hadoop.apache.org>
Reply-To: common-dev@hadoop.apache.org
Delivered-To: mailing list common-dev@hadoop.apache.org
Received: (qmail 15288 invoked by uid 99); 24 Feb 2012 01:52:12 -0000
Received: from nike.apache.org (HELO nike.apache.org) (192.87.106.230)
by apache.org (qpsmtpd/0.29) with ESMTP; Fri, 24 Feb 2012 01:52:12 +0000
X-ASF-Spam-Status: No, hits=-2000.0 required=5.0
tests=ALL_TRUSTED,T_RP_MATCHES_RCVD
X-Spam-Check-By: apache.org
Received: from [140.211.11.116] (HELO hel.zones.apache.org) (140.211.11.116)
by apache.org (qpsmtpd/0.29) with ESMTP; Fri, 24 Feb 2012 01:52:09 +0000
Received: from hel.zones.apache.org (hel.zones.apache.org [140.211.11.116])
by hel.zones.apache.org (Postfix) with ESMTP id B3D5D337462
for <common-dev@hadoop.apache.org>; Fri, 24 Feb 2012 01:51:48 +0000 (UTC)
Date: Fri, 24 Feb 2012 01:51:48 +0000 (UTC)
From: "Hitesh Shah (Created) (JIRA)" <jira@apache.org>
To: common-dev@hadoop.apache.org
Message-ID: <933647555.13138.1330048308737.JavaMail.tomcat@hel.zones.apache.org>
Subject: [jira] [Created] (HADOOP-8109) Using the default rpms of hadoop,
/usr/etc/hadoop symlink gets removed on upgrade
MIME-Version: 1.0
Content-Type: text/plain; charset=utf-8
Content-Transfer-Encoding: 7bit
X-JIRA-FingerPrint: 30527f35849b9dde25b450d4833f0394
X-Virus-Checked: Checked by ClamAV on apache.org
Using the default rpms of hadoop, /usr/etc/hadoop symlink gets removed on upgrade
----------------------------------------------------------------------------------
Key: HADOOP-8109
URL: https://issues.apache.org/jira/browse/HADOOP-8109
Project: Hadoop Common
Issue Type: Bug
Affects Versions: 1.0.0, 0.23.0
Reporter: Hitesh Shah
Assignee: Hitesh Shah
Priority: Minor
Given that for rpms, the pre-uninstall scripts for the older version run after the post-install scripts of the package being installed, the symlink created from /usr/etc/hadoop to /etc/hadoop gets deleted. This breaks running /usr/bin/hadoop without providing --config.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
From common-dev-return-77843-apmail-hadoop-common-dev-archive=hadoop.apache.org@hadoop.apache.org Fri Feb 24 09:22:18 2012
Return-Path: <common-dev-return-77843-apmail-hadoop-common-dev-archive=hadoop.apache.org@hadoop.apache.org>
X-Original-To: apmail-hadoop-common-dev-archive@www.apache.org
Delivered-To: apmail-hadoop-common-dev-archive@www.apache.org
Received: from mail.apache.org (hermes.apache.org [140.211.11.3])
by minotaur.apache.org (Postfix) with SMTP id 09F63981B
for <apmail-hadoop-common-dev-archive@www.apache.org>; Fri, 24 Feb 2012 09:22:18 +0000 (UTC)
Received: (qmail 17755 invoked by uid 500); 24 Feb 2012 09:22:16 -0000
Delivered-To: apmail-hadoop-common-dev-archive@hadoop.apache.org
Received: (qmail 17678 invoked by uid 500); 24 Feb 2012 09:22:15 -0000
Mailing-List: contact common-dev-help@hadoop.apache.org; run by ezmlm
Precedence: bulk
List-Help: <mailto:common-dev-help@hadoop.apache.org>
List-Unsubscribe: <mailto:common-dev-unsubscribe@hadoop.apache.org>
List-Post: <mailto:common-dev@hadoop.apache.org>
List-Id: <common-dev.hadoop.apache.org>
Reply-To: common-dev@hadoop.apache.org
Delivered-To: mailing list common-dev@hadoop.apache.org
Received: (qmail 17665 invoked by uid 99); 24 Feb 2012 09:22:15 -0000
Received: from nike.apache.org (HELO nike.apache.org) (192.87.106.230)
by apache.org (qpsmtpd/0.29) with ESMTP; Fri, 24 Feb 2012 09:22:15 +0000
X-ASF-Spam-Status: No, hits=-2000.0 required=5.0
tests=ALL_TRUSTED
X-Spam-Check-By: apache.org
Received: from [140.211.11.8] (HELO aegis.apache.org) (140.211.11.8)
by apache.org (qpsmtpd/0.29) with ESMTP; Fri, 24 Feb 2012 09:22:11 +0000
Received: from aegis (localhost [127.0.0.1])
by aegis.apache.org (Postfix) with ESMTP id 79668C00A0
for <common-dev@hadoop.apache.org>; Fri, 24 Feb 2012 09:21:50 +0000 (UTC)
Date: Fri, 24 Feb 2012 09:21:50 +0000 (UTC)
From: Apache Jenkins Server <jenkins@builds.apache.org>
To: common-dev@hadoop.apache.org
Message-ID: <2109105538.3911330075310481.JavaMail.hudson@aegis>
Subject: Build failed in Jenkins: Hadoop-Common-0.23-Build #173
MIME-Version: 1.0
Content-Type: text/plain; charset=UTF-8
Content-Transfer-Encoding: 7bit
X-Jenkins-Job: Hadoop-Common-0.23-Build
X-Jenkins-Result: FAILURE
X-Virus-Checked: Checked by ClamAV on apache.org
See <https://builds.apache.org/job/Hadoop-Common-0.23-Build/173/changes>
Changes:
[sseth] merge MAPREDUCE-3738 from trunk
[tgraves] merge -r 1292830:1292831 from trunk to branch-0.23. FIXES: MAPREDUCE-3878
------------------------------------------
[...truncated 40121 lines...]
42 KB 6 KB
42 KB 6 KB
42 KB 7 KB
42 KB 7 KB
42 KB 8 KB
42 KB 8 KB
42 KB 9 KB
42 KB 10 KB
42 KB 10 KB
42 KB 10 KB
42 KB 11 KB
42 KB 11 KB
42 KB 12 KB
42 KB 12 KB
42 KB 13 KB
42 KB 13 KB
42 KB 14 KB
42 KB 14 KB
42 KB 15 KB
42 KB 15 KB
42 KB 16 KB
42 KB 17 KB
42 KB 17 KB
42 KB 18 KB
42 KB 18 KB
42 KB 18 KB
42 KB 19 KB
42 KB 19 KB
42 KB 19 KB
42 KB 20 KB
42 KB 20 KB
42 KB 21 KB
42 KB 22 KB
42 KB 22 KB
42 KB 23 KB
42 KB 23 KB
42 KB 24 KB
42 KB 24 KB
42 KB 25 KB
42 KB 25 KB
42 KB 26 KB
42 KB 26 KB
42 KB 27 KB
42 KB 27 KB
42 KB 28 KB
42 KB 29 KB
42 KB 29 KB
42 KB 30 KB
42 KB 30 KB
42 KB 31 KB
42 KB 31 KB
42 KB 32 KB
42 KB 32 KB
42 KB 33 KB
42 KB 33 KB
42 KB 34 KB
42 KB 35 KB
42 KB 35 KB
42 KB 36 KB
42 KB 36 KB
42 KB 37 KB
42 KB 38 KB
42 KB 38 KB
42 KB 39 KB
42 KB 39 KB
42 KB 40 KB
42 KB 40 KB
42 KB 41 KB
42 KB 41 KB
42 KB 42 KB
42 KB 42 KB
42 KB 43 KB
42 KB 43 KB
42 KB 45 KB
42 KB 48 KB
42 KB 50 KB
42 KB 50 KB 848 B
42 KB 50 KB 2 KB
42 KB 50 KB 2 KB
42 KB 50 KB 3 KB
42 KB 50 KB 3 KB
42 KB 50 KB 4 KB
42 KB 50 KB 4 KB
42 KB 50 KB 5 KB
42 KB 50 KB 5 KB
42 KB 50 KB 6 KB
42 KB 50 KB 6 KB
42 KB 50 KB 7 KB
42 KB 50 KB 7 KB
42 KB 50 KB 8 KB
42 KB 50 KB 8 KB
42 KB 50 KB 9 KB
42 KB 50 KB 9 KB
42 KB 50 KB 10 KB
42 KB 50 KB 10 KB
42 KB 50 KB 11 KB
42 KB 50 KB 11 KB
42 KB 50 KB 12 KB
42 KB 50 KB 12 KB
42 KB 50 KB 13 KB
42 KB 50 KB 13 KB
42 KB 50 KB 14 KB
42 KB 50 KB 14 KB
42 KB 50 KB 15 KB
42 KB 50 KB 15 KB
42 KB 50 KB 16 KB
42 KB 50 KB 16 KB
42 KB 50 KB 17 KB
42 KB 50 KB 17 KB
42 KB 50 KB 18 KB
42 KB 50 KB 19 KB
42 KB 50 KB 19 KB
42 KB 50 KB 20 KB
42 KB 50 KB 20 KB
42 KB 50 KB 21 KB
42 KB 50 KB 23 KB
Downloaded: http://repo1.maven.org/maven2/org/apache/maven/shared/maven-filtering/1.0/maven-filtering-1.0.jar (42 KB at 21.2 KB/sec)
Downloaded: http://repo1.maven.org/maven2/org/codehaus/plexus/plexus-io/1.0.1/plexus-io-1.0.1.jar (50 KB at 24.8 KB/sec)
Downloaded: http://repo1.maven.org/maven2/org/apache/maven/shared/maven-repository-builder/1.0-alpha-2/maven-repository-builder-1.0-alpha-2.jar (23 KB at 11.9 KB/sec)
[WARNING] The following patterns were never triggered in this artifact exclusion filter:
o 'org.apache.ant:*:jar'
o 'jdiff:jdiff:jar'
[INFO] share/hadoop/common/jdiff/ already added, skipping
[INFO] Copying files to <https://builds.apache.org/job/Hadoop-Common-0.23-Build/ws/trunk/hadoop-common-project/hadoop-common/target/hadoop-common-0.23.2-SNAPSHOT>
[INFO] share/hadoop/common/jdiff/ already added, skipping
[INFO]
[INFO] --- maven-jar-plugin:2.3.1:jar (default-jar) @ hadoop-common ---
[INFO]
[INFO] --- maven-source-plugin:2.1.2:jar-no-fork (hadoop-java-sources) @ hadoop-common ---
[INFO] org already added, skipping
[INFO] org/apache already added, skipping
[INFO] org/apache/hadoop already added, skipping
[INFO] Building jar: <https://builds.apache.org/job/Hadoop-Common-0.23-Build/ws/trunk/hadoop-common-project/hadoop-common/target/hadoop-common-0.23.2-SNAPSHOT-sources.jar>
[INFO] org already added, skipping
[INFO] org/apache already added, skipping
[INFO] org/apache/hadoop already added, skipping
[WARNING] Artifact org.apache.hadoop:hadoop-common:java-source:sources:0.23.2-SNAPSHOT already attached to project, ignoring duplicate
[INFO]
[INFO] --- maven-site-plugin:3.0:attach-descriptor (attach-descriptor) @ hadoop-common ---
[INFO]
[INFO] --- maven-antrun-plugin:1.6:run (tar) @ hadoop-common ---
[INFO] Executing tasks
main:
[INFO] Executed tasks
[INFO]
[INFO] --- maven-javadoc-plugin:2.8.1:jar (module-javadocs) @ hadoop-common ---
[INFO]
ExcludePrivateAnnotationsStandardDoclet
9 warnings
[WARNING] Javadoc Warnings
[WARNING] <https://builds.apache.org/job/Hadoop-Common-0.23-Build/ws/trunk/hadoop-common-project/hadoop-common/src/main/java/org/apache/hadoop/security/SecurityUtil.java>:49: warning: sun.net.dns.ResolverConfiguration is Sun proprietary API and may be removed in a future release
[WARNING] import sun.net.dns.ResolverConfiguration;
[WARNING] ^
[WARNING] <https://builds.apache.org/job/Hadoop-Common-0.23-Build/ws/trunk/hadoop-common-project/hadoop-common/src/main/java/org/apache/hadoop/security/SecurityUtil.java>:50: warning: sun.net.util.IPAddressUtil is Sun proprietary API and may be removed in a future release
[WARNING] import sun.net.util.IPAddressUtil;
[WARNING] ^
[WARNING] <https://builds.apache.org/job/Hadoop-Common-0.23-Build/ws/trunk/hadoop-common-project/hadoop-common/src/main/java/org/apache/hadoop/security/SecurityUtil.java>:51: warning: sun.security.jgss.krb5.Krb5Util is Sun proprietary API and may be removed in a future release
[WARNING] import sun.security.jgss.krb5.Krb5Util;
[WARNING] ^
[WARNING] <https://builds.apache.org/job/Hadoop-Common-0.23-Build/ws/trunk/hadoop-common-project/hadoop-common/src/main/java/org/apache/hadoop/security/SecurityUtil.java>:52: warning: sun.security.krb5.Credentials is Sun proprietary API and may be removed in a future release
[WARNING] import sun.security.krb5.Credentials;
[WARNING] ^
[WARNING] <https://builds.apache.org/job/Hadoop-Common-0.23-Build/ws/trunk/hadoop-common-project/hadoop-common/src/main/java/org/apache/hadoop/security/SecurityUtil.java>:53: warning: sun.security.krb5.PrincipalName is Sun proprietary API and may be removed in a future release
[WARNING] import sun.security.krb5.PrincipalName;
[WARNING] ^
[WARNING] <https://builds.apache.org/job/Hadoop-Common-0.23-Build/ws/trunk/hadoop-common-project/hadoop-common/src/main/java/org/apache/hadoop/security/HadoopKerberosName.java>:28: warning: sun.security.krb5.Config is Sun proprietary API and may be removed in a future release
[WARNING] import sun.security.krb5.Config;
[WARNING] ^
[WARNING] <https://builds.apache.org/job/Hadoop-Common-0.23-Build/ws/trunk/hadoop-common-project/hadoop-common/src/main/java/org/apache/hadoop/security/HadoopKerberosName.java>:29: warning: sun.security.krb5.KrbException is Sun proprietary API and may be removed in a future release
[WARNING] import sun.security.krb5.KrbException;
[WARNING] ^
[WARNING] <https://builds.apache.org/job/Hadoop-Common-0.23-Build/ws/trunk/hadoop-common-project/hadoop-common/src/main/java/org/apache/hadoop/io/FastByteComparisons.java>:25: warning: sun.misc.Unsafe is Sun proprietary API and may be removed in a future release
[WARNING] import sun.misc.Unsafe;
[WARNING] ^
[WARNING] <https://builds.apache.org/job/Hadoop-Common-0.23-Build/ws/trunk/hadoop-common-project/hadoop-common/src/main/java/org/apache/hadoop/io/FastByteComparisons.java>:117: warning: sun.misc.Unsafe is Sun proprietary API and may be removed in a future release
[WARNING] static final Unsafe theUnsafe;
[WARNING] ^
[INFO] Building jar: <https://builds.apache.org/job/Hadoop-Common-0.23-Build/ws/trunk/hadoop-common-project/hadoop-common/target/hadoop-common-0.23.2-SNAPSHOT-javadoc.jar>
[INFO]
[INFO] --- maven-checkstyle-plugin:2.6:checkstyle (default-cli) @ hadoop-common ---
[INFO]
[INFO] There are 8472 checkstyle errors.
[WARNING] Unable to locate Source XRef to link to - DISABLED
[INFO]
[INFO] --- findbugs-maven-plugin:2.3.2:findbugs (default-cli) @ hadoop-common ---
[INFO] ****** FindBugsMojo execute *******
[INFO] canGenerate is true
[INFO] ****** FindBugsMojo executeFindbugs *******
[INFO] Temp File is <https://builds.apache.org/job/Hadoop-Common-0.23-Build/ws/trunk/hadoop-common-project/hadoop-common/target/findbugsTemp.xml>
[INFO] Fork Value is true
[java] The following classes needed for analysis were missing:
[java] org.codehaus.jackson.FormatSchema
[java] org.codehaus.jackson.format.InputAccessor
[java] Missing classes: 1
[INFO] xmlOutput is false
[INFO]
[INFO] ------------------------------------------------------------------------
[INFO] Building Apache Hadoop Common Project 0.23.2-SNAPSHOT
[INFO] ------------------------------------------------------------------------
[INFO]
[INFO] --- maven-clean-plugin:2.4.1:clean (default-clean) @ hadoop-common-project ---
[INFO] Deleting <https://builds.apache.org/job/Hadoop-Common-0.23-Build/ws/trunk/hadoop-common-project/target>
[INFO]
[INFO] --- maven-antrun-plugin:1.6:run (create-testdirs) @ hadoop-common-project ---
[INFO] Executing tasks
main:
[mkdir] Created dir: <https://builds.apache.org/job/Hadoop-Common-0.23-Build/ws/trunk/hadoop-common-project/target/test-dir>
[INFO] Executed tasks
[INFO]
[INFO] --- maven-source-plugin:2.1.2:jar-no-fork (hadoop-java-sources) @ hadoop-common-project ---
[INFO]
[INFO] --- maven-site-plugin:3.0:attach-descriptor (attach-descriptor) @ hadoop-common-project ---
[INFO]
[INFO] --- maven-javadoc-plugin:2.8.1:jar (module-javadocs) @ hadoop-common-project ---
[INFO] Not executing Javadoc as the project is not a Java classpath-capable package
[INFO]
[INFO] --- maven-checkstyle-plugin:2.6:checkstyle (default-cli) @ hadoop-common-project ---
[INFO]
[INFO] --- findbugs-maven-plugin:2.3.2:findbugs (default-cli) @ hadoop-common-project ---
[INFO] ****** FindBugsMojo execute *******
[INFO] canGenerate is false
[INFO] ------------------------------------------------------------------------
[INFO] Reactor Summary:
[INFO]
[INFO] Apache Hadoop Annotations ......................... SUCCESS [43.225s]
[INFO] Apache Hadoop Auth ................................ SUCCESS [1:06.501s]
[INFO] Apache Hadoop Auth Examples ....................... SUCCESS [7.548s]
[INFO] Apache Hadoop Common .............................. SUCCESS [4:44.300s]
[INFO] Apache Hadoop Common Project ...................... SUCCESS [0.034s]
[INFO] ------------------------------------------------------------------------
[INFO] BUILD SUCCESS
[INFO] ------------------------------------------------------------------------
[INFO] Total time: 6:51.119s
[INFO] Finished at: Fri Feb 24 09:11:09 UTC 2012
[INFO] Final Memory: 80M/788M
[INFO] ------------------------------------------------------------------------
+ /home/jenkins/tools/maven/latest/bin/mvn test -Pclover -DcloverLicenseLocation=/home/jenkins/tools/clover/latest/lib/clover.license
Build step 'Execute shell' marked build as failure
[WARNINGS] Skipping publisher since build result is FAILURE
Archiving artifacts
Recording fingerprints
Publishing Javadoc
Recording test results
From common-dev-return-77844-apmail-hadoop-common-dev-archive=hadoop.apache.org@hadoop.apache.org Fri Feb 24 09:29:43 2012
Return-Path: <common-dev-return-77844-apmail-hadoop-common-dev-archive=hadoop.apache.org@hadoop.apache.org>
X-Original-To: apmail-hadoop-common-dev-archive@www.apache.org
Delivered-To: apmail-hadoop-common-dev-archive@www.apache.org
Received: from mail.apache.org (hermes.apache.org [140.211.11.3])
by minotaur.apache.org (Postfix) with SMTP id 8C7369693
for <apmail-hadoop-common-dev-archive@www.apache.org>; Fri, 24 Feb 2012 09:29:43 +0000 (UTC)
Received: (qmail 38919 invoked by uid 500); 24 Feb 2012 09:29:42 -0000
Delivered-To: apmail-hadoop-common-dev-archive@hadoop.apache.org
Received: (qmail 38679 invoked by uid 500); 24 Feb 2012 09:29:41 -0000
Mailing-List: contact common-dev-help@hadoop.apache.org; run by ezmlm
Precedence: bulk
List-Help: <mailto:common-dev-help@hadoop.apache.org>
List-Unsubscribe: <mailto:common-dev-unsubscribe@hadoop.apache.org>
List-Post: <mailto:common-dev@hadoop.apache.org>
List-Id: <common-dev.hadoop.apache.org>
Reply-To: common-dev@hadoop.apache.org
Delivered-To: mailing list common-dev@hadoop.apache.org
Received: (qmail 38670 invoked by uid 99); 24 Feb 2012 09:29:41 -0000
Received: from athena.apache.org (HELO athena.apache.org) (140.211.11.136)
by apache.org (qpsmtpd/0.29) with ESMTP; Fri, 24 Feb 2012 09:29:41 +0000
X-ASF-Spam-Status: No, hits=-2000.0 required=5.0
tests=ALL_TRUSTED
X-Spam-Check-By: apache.org
Received: from [140.211.11.8] (HELO aegis.apache.org) (140.211.11.8)
by apache.org (qpsmtpd/0.29) with ESMTP; Fri, 24 Feb 2012 09:29:40 +0000
Received: from aegis (localhost [127.0.0.1])
by aegis.apache.org (Postfix) with ESMTP id 1D16EC00A0
for <common-dev@hadoop.apache.org>; Fri, 24 Feb 2012 09:29:20 +0000 (UTC)
Date: Fri, 24 Feb 2012 09:29:20 +0000 (UTC)
From: Apache Jenkins Server <jenkins@builds.apache.org>
To: common-dev@hadoop.apache.org
Message-ID: <256402514.3921330075760102.JavaMail.hudson@aegis>
Subject: Build failed in Jenkins: Hadoop-Common-0.23-PB-Build #2
MIME-Version: 1.0
Content-Type: text/plain; charset=UTF-8
Content-Transfer-Encoding: 7bit
X-Jenkins-Job: Hadoop-Common-0.23-PB-Build
X-Jenkins-Result: FAILURE
See <https://builds.apache.org/job/Hadoop-Common-0.23-PB-Build/2/>
------------------------------------------
[...truncated 40194 lines...]
42 KB 8 KB
42 KB 8 KB
42 KB 9 KB
42 KB 10 KB
42 KB 10 KB
42 KB 10 KB
42 KB 11 KB
42 KB 11 KB
42 KB 12 KB
42 KB 12 KB
42 KB 13 KB
42 KB 13 KB
42 KB 14 KB
42 KB 14 KB
42 KB 15 KB
42 KB 15 KB
42 KB 16 KB
42 KB 17 KB
42 KB 17 KB
42 KB 18 KB
42 KB 18 KB
42 KB 18 KB
42 KB 19 KB
42 KB 19 KB
42 KB 20 KB
42 KB 20 KB
42 KB 21 KB
42 KB 21 KB
42 KB 22 KB
42 KB 22 KB
42 KB 23 KB
42 KB 23 KB
42 KB 24 KB
42 KB 24 KB
42 KB 25 KB
42 KB 25 KB
42 KB 26 KB
42 KB 26 KB
42 KB 27 KB
42 KB 27 KB
42 KB 28 KB
42 KB 29 KB
42 KB 29 KB
42 KB 30 KB
42 KB 30 KB
42 KB 31 KB
42 KB 31 KB
42 KB 32 KB
42 KB 32 KB
42 KB 33 KB
42 KB 33 KB
42 KB 34 KB
42 KB 35 KB
42 KB 35 KB
42 KB 36 KB
42 KB 36 KB
42 KB 37 KB
42 KB 37 KB
42 KB 38 KB
42 KB 38 KB
42 KB 39 KB
42 KB 40 KB
42 KB 40 KB
42 KB 41 KB
42 KB 41 KB
42 KB 42 KB
42 KB 42 KB
42 KB 43 KB
42 KB 43 KB
42 KB 45 KB
42 KB 48 KB
42 KB 50 KB
42 KB 50 KB 848 B
42 KB 50 KB 2 KB
42 KB 50 KB 2 KB
42 KB 50 KB 3 KB
42 KB 50 KB 3 KB
42 KB 50 KB 4 KB
42 KB 50 KB 4 KB
42 KB 50 KB 5 KB
42 KB 50 KB 5 KB
42 KB 50 KB 6 KB
42 KB 50 KB 6 KB
42 KB 50 KB 7 KB
42 KB 50 KB 7 KB
42 KB 50 KB 8 KB
42 KB 50 KB 8 KB
42 KB 50 KB 9 KB
42 KB 50 KB 9 KB
42 KB 50 KB 10 KB
42 KB 50 KB 10 KB
42 KB 50 KB 11 KB
42 KB 50 KB 11 KB
42 KB 50 KB 12 KB
42 KB 50 KB 12 KB
42 KB 50 KB 13 KB
42 KB 50 KB 13 KB
42 KB 50 KB 14 KB
42 KB 50 KB 14 KB
42 KB 50 KB 15 KB
42 KB 50 KB 15 KB
42 KB 50 KB 16 KB
42 KB 50 KB 16 KB
42 KB 50 KB 17 KB
42 KB 50 KB 17 KB
42 KB 50 KB 18 KB
42 KB 50 KB 19 KB
42 KB 50 KB 19 KB
42 KB 50 KB 20 KB
42 KB 50 KB 20 KB
42 KB 50 KB 21 KB
42 KB 50 KB 23 KB
Downloaded: http://repo1.maven.org/maven2/org/apache/maven/shared/maven-filtering/1.0/maven-filtering-1.0.jar (42 KB at 20.7 KB/sec)
Downloaded: http://repo1.maven.org/maven2/org/codehaus/plexus/plexus-io/1.0.1/plexus-io-1.0.1.jar (50 KB at 24.7 KB/sec)
Downloaded: http://repo1.maven.org/maven2/org/apache/maven/shared/maven-repository-builder/1.0-alpha-2/maven-repository-builder-1.0-alpha-2.jar (23 KB at 11.3 KB/sec)
[WARNING] The following patterns were never triggered in this artifact exclusion filter:
o 'org.apache.ant:*:jar'
o 'jdiff:jdiff:jar'
[INFO] share/hadoop/common/jdiff/ already added, skipping
[INFO] Copying files to <https://builds.apache.org/job/Hadoop-Common-0.23-PB-Build/ws/trunk/hadoop-common-project/hadoop-common/target/hadoop-common-0.23.2-SNAPSHOT>
[INFO] share/hadoop/common/jdiff/ already added, skipping
[INFO]
[INFO] --- maven-jar-plugin:2.3.1:jar (default-jar) @ hadoop-common ---
[INFO]
[INFO] --- maven-source-plugin:2.1.2:jar-no-fork (hadoop-java-sources) @ hadoop-common ---
[INFO] org already added, skipping
[INFO] org/apache already added, skipping
[INFO] org/apache/hadoop already added, skipping
[INFO] org/apache/hadoop/ipc already added, skipping
[INFO] org/apache/hadoop/ipc/protobuf already added, skipping
[INFO] Building jar: <https://builds.apache.org/job/Hadoop-Common-0.23-PB-Build/ws/trunk/hadoop-common-project/hadoop-common/target/hadoop-common-0.23.2-SNAPSHOT-sources.jar>
[INFO] org already added, skipping
[INFO] org/apache already added, skipping
[INFO] org/apache/hadoop already added, skipping
[INFO] org/apache/hadoop/ipc already added, skipping
[INFO] org/apache/hadoop/ipc/protobuf already added, skipping
[WARNING] Artifact org.apache.hadoop:hadoop-common:java-source:sources:0.23.2-SNAPSHOT already attached to project, ignoring duplicate
[INFO]
[INFO] --- maven-site-plugin:3.0:attach-descriptor (attach-descriptor) @ hadoop-common ---
[INFO]
[INFO] --- maven-antrun-plugin:1.6:run (tar) @ hadoop-common ---
[INFO] Executing tasks
main:
[INFO] Executed tasks
[INFO]
[INFO] --- maven-javadoc-plugin:2.8.1:jar (module-javadocs) @ hadoop-common ---
[INFO]
ExcludePrivateAnnotationsStandardDoclet
9 warnings
[WARNING] Javadoc Warnings
[WARNING] <https://builds.apache.org/job/Hadoop-Common-0.23-PB-Build/ws/trunk/hadoop-common-project/hadoop-common/src/main/java/org/apache/hadoop/io/FastByteComparisons.java>:25: warning: sun.misc.Unsafe is Sun proprietary API and may be removed in a future release
[WARNING] import sun.misc.Unsafe;
[WARNING] ^
[WARNING] <https://builds.apache.org/job/Hadoop-Common-0.23-PB-Build/ws/trunk/hadoop-common-project/hadoop-common/src/main/java/org/apache/hadoop/io/FastByteComparisons.java>:117: warning: sun.misc.Unsafe is Sun proprietary API and may be removed in a future release
[WARNING] static final Unsafe theUnsafe;
[WARNING] ^
[WARNING] <https://builds.apache.org/job/Hadoop-Common-0.23-PB-Build/ws/trunk/hadoop-common-project/hadoop-common/src/main/java/org/apache/hadoop/security/SecurityUtil.java>:49: warning: sun.net.dns.ResolverConfiguration is Sun proprietary API and may be removed in a future release
[WARNING] import sun.net.dns.ResolverConfiguration;
[WARNING] ^
[WARNING] <https://builds.apache.org/job/Hadoop-Common-0.23-PB-Build/ws/trunk/hadoop-common-project/hadoop-common/src/main/java/org/apache/hadoop/security/SecurityUtil.java>:50: warning: sun.net.util.IPAddressUtil is Sun proprietary API and may be removed in a future release
[WARNING] import sun.net.util.IPAddressUtil;
[WARNING] ^
[WARNING] <https://builds.apache.org/job/Hadoop-Common-0.23-PB-Build/ws/trunk/hadoop-common-project/hadoop-common/src/main/java/org/apache/hadoop/security/SecurityUtil.java>:51: warning: sun.security.jgss.krb5.Krb5Util is Sun proprietary API and may be removed in a future release
[WARNING] import sun.security.jgss.krb5.Krb5Util;
[WARNING] ^
[WARNING] <https://builds.apache.org/job/Hadoop-Common-0.23-PB-Build/ws/trunk/hadoop-common-project/hadoop-common/src/main/java/org/apache/hadoop/security/SecurityUtil.java>:52: warning: sun.security.krb5.Credentials is Sun proprietary API and may be removed in a future release
[WARNING] import sun.security.krb5.Credentials;
[WARNING] ^
[WARNING] <https://builds.apache.org/job/Hadoop-Common-0.23-PB-Build/ws/trunk/hadoop-common-project/hadoop-common/src/main/java/org/apache/hadoop/security/SecurityUtil.java>:53: warning: sun.security.krb5.PrincipalName is Sun proprietary API and may be removed in a future release
[WARNING] import sun.security.krb5.PrincipalName;
[WARNING] ^
[WARNING] <https://builds.apache.org/job/Hadoop-Common-0.23-PB-Build/ws/trunk/hadoop-common-project/hadoop-common/src/main/java/org/apache/hadoop/security/HadoopKerberosName.java>:28: warning: sun.security.krb5.Config is Sun proprietary API and may be removed in a future release
[WARNING] import sun.security.krb5.Config;
[WARNING] ^
[WARNING] <https://builds.apache.org/job/Hadoop-Common-0.23-PB-Build/ws/trunk/hadoop-common-project/hadoop-common/src/main/java/org/apache/hadoop/security/HadoopKerberosName.java>:29: warning: sun.security.krb5.KrbException is Sun proprietary API and may be removed in a future release
[WARNING] import sun.security.krb5.KrbException;
[WARNING] ^
[INFO] Building jar: <https://builds.apache.org/job/Hadoop-Common-0.23-PB-Build/ws/trunk/hadoop-common-project/hadoop-common/target/hadoop-common-0.23.2-SNAPSHOT-javadoc.jar>
[INFO]
[INFO] --- maven-checkstyle-plugin:2.6:checkstyle (default-cli) @ hadoop-common ---
[INFO]
[INFO] There are 8670 checkstyle errors.
[WARNING] Unable to locate Source XRef to link to - DISABLED
[INFO]
[INFO] --- findbugs-maven-plugin:2.3.2:findbugs (default-cli) @ hadoop-common ---
[INFO] ****** FindBugsMojo execute *******
[INFO] canGenerate is true
[INFO] ****** FindBugsMojo executeFindbugs *******
[INFO] Temp File is <https://builds.apache.org/job/Hadoop-Common-0.23-PB-Build/ws/trunk/hadoop-common-project/hadoop-common/target/findbugsTemp.xml>
[INFO] Fork Value is true
[java] The following classes needed for analysis were missing:
[java] org.codehaus.jackson.FormatSchema
[java] org.codehaus.jackson.format.InputAccessor
[java] Missing classes: 1
[INFO] xmlOutput is false
[INFO]
[INFO] ------------------------------------------------------------------------
[INFO] Building Apache Hadoop Common Project 0.23.2-SNAPSHOT
[INFO] ------------------------------------------------------------------------
[INFO]
[INFO] --- maven-clean-plugin:2.4.1:clean (default-clean) @ hadoop-common-project ---
[INFO] Deleting <https://builds.apache.org/job/Hadoop-Common-0.23-PB-Build/ws/trunk/hadoop-common-project/target>
[INFO]
[INFO] --- maven-antrun-plugin:1.6:run (create-testdirs) @ hadoop-common-project ---
[INFO] Executing tasks
main:
[mkdir] Created dir: <https://builds.apache.org/job/Hadoop-Common-0.23-PB-Build/ws/trunk/hadoop-common-project/target/test-dir>
[INFO] Executed tasks
[INFO]
[INFO] --- maven-source-plugin:2.1.2:jar-no-fork (hadoop-java-sources) @ hadoop-common-project ---
[INFO]
[INFO] --- maven-site-plugin:3.0:attach-descriptor (attach-descriptor) @ hadoop-common-project ---
[INFO]
[INFO] --- maven-javadoc-plugin:2.8.1:jar (module-javadocs) @ hadoop-common-project ---
[INFO] Not executing Javadoc as the project is not a Java classpath-capable package
[INFO]
[INFO] --- maven-checkstyle-plugin:2.6:checkstyle (default-cli) @ hadoop-common-project ---
[INFO]
[INFO] --- findbugs-maven-plugin:2.3.2:findbugs (default-cli) @ hadoop-common-project ---
[INFO] ****** FindBugsMojo execute *******
[INFO] canGenerate is false
[INFO] ------------------------------------------------------------------------
[INFO] Reactor Summary:
[INFO]
[INFO] Apache Hadoop Annotations ......................... SUCCESS [44.561s]
[INFO] Apache Hadoop Auth ................................ SUCCESS [1:07.030s]
[INFO] Apache Hadoop Auth Examples ....................... SUCCESS [7.962s]
[INFO] Apache Hadoop Common .............................. SUCCESS [5:09.659s]
[INFO] Apache Hadoop Common Project ...................... SUCCESS [0.034s]
[INFO] ------------------------------------------------------------------------
[INFO] BUILD SUCCESS
[INFO] ------------------------------------------------------------------------
[INFO] Total time: 7:18.820s
[INFO] Finished at: Fri Feb 24 09:18:06 UTC 2012
[INFO] Final Memory: 83M/804M
[INFO] ------------------------------------------------------------------------
+ /home/jenkins/tools/maven/latest/bin/mvn test -Pclover -DcloverLicenseLocation=/home/jenkins/tools/clover/latest/lib/clover.license
Build step 'Execute shell' marked build as failure
[WARNINGS] Skipping publisher since build result is FAILURE
Archiving artifacts
Recording test results
Publishing Javadoc
Recording fingerprints
From common-dev-return-77845-apmail-hadoop-common-dev-archive=hadoop.apache.org@hadoop.apache.org Fri Feb 24 09:30:52 2012
Return-Path: <common-dev-return-77845-apmail-hadoop-common-dev-archive=hadoop.apache.org@hadoop.apache.org>
X-Original-To: apmail-hadoop-common-dev-archive@www.apache.org
Delivered-To: apmail-hadoop-common-dev-archive@www.apache.org
Received: from mail.apache.org (hermes.apache.org [140.211.11.3])
by minotaur.apache.org (Postfix) with SMTP id 19A2796FC
for <apmail-hadoop-common-dev-archive@www.apache.org>; Fri, 24 Feb 2012 09:30:52 +0000 (UTC)
Received: (qmail 41968 invoked by uid 500); 24 Feb 2012 09:30:50 -0000
Delivered-To: apmail-hadoop-common-dev-archive@hadoop.apache.org
Received: (qmail 41907 invoked by uid 500); 24 Feb 2012 09:30:50 -0000
Mailing-List: contact common-dev-help@hadoop.apache.org; run by ezmlm
Precedence: bulk
List-Help: <mailto:common-dev-help@hadoop.apache.org>
List-Unsubscribe: <mailto:common-dev-unsubscribe@hadoop.apache.org>
List-Post: <mailto:common-dev@hadoop.apache.org>
List-Id: <common-dev.hadoop.apache.org>
Reply-To: common-dev@hadoop.apache.org
Delivered-To: mailing list common-dev@hadoop.apache.org
Received: (qmail 41898 invoked by uid 99); 24 Feb 2012 09:30:50 -0000
Received: from nike.apache.org (HELO nike.apache.org) (192.87.106.230)
by apache.org (qpsmtpd/0.29) with ESMTP; Fri, 24 Feb 2012 09:30:50 +0000
X-ASF-Spam-Status: No, hits=-2000.0 required=5.0
tests=ALL_TRUSTED
X-Spam-Check-By: apache.org
Received: from [140.211.11.8] (HELO aegis.apache.org) (140.211.11.8)
by apache.org (qpsmtpd/0.29) with ESMTP; Fri, 24 Feb 2012 09:30:45 +0000
Received: from aegis (localhost [127.0.0.1])
by aegis.apache.org (Postfix) with ESMTP id D3578C00A0
for <common-dev@hadoop.apache.org>; Fri, 24 Feb 2012 09:30:23 +0000 (UTC)
Date: Fri, 24 Feb 2012 09:30:23 +0000 (UTC)
From: Apache Jenkins Server <jenkins@builds.apache.org>
To: common-dev@hadoop.apache.org
Message-ID: <1869587314.3931330075823863.JavaMail.hudson@aegis>
In-Reply-To: <1862148864.2811329988971193.JavaMail.hudson@aegis>
References: <1862148864.2811329988971193.JavaMail.hudson@aegis>
Subject: Build failed in Jenkins: Hadoop-Common-trunk #327
MIME-Version: 1.0
Content-Type: text/plain; charset=UTF-8
Content-Transfer-Encoding: quoted-printable
X-Jenkins-Job: Hadoop-Common-trunk
X-Jenkins-Result: FAILURE
X-Virus-Checked: Checked by ClamAV on apache.org
See <https://builds.apache.org/job/Hadoop-Common-trunk/327/changes>
Changes:
[jitendra] HADOOP-8108. Move method getHostPortString() from NameNode to Ne=
tUtils. Contributed by Brandon Li.
[suresh] HADOOP-8085. Add RPC metrics to ProtobufRpcEngine. Contributed by =
Hari Mankude.
[sseth] MAPREDUCE 3738. NM can hang during shutdown if AppLogAggregatorImpl=
thread dies unexpectedly. (Contributed by Jason Lowe)
[tgraves] MAPREDUCE-3878. Null user on filtered jobhistory job page (Jonath=
on Eagles via tgraves)
[amarrk] MAPREDUCE-3787. [Gridmix] Optimize job monitoring and STRESS mode =
for faster job submission. (amarrk)
------------------------------------------
[...truncated 44353 lines...]
[DEBUG] (f) reactorProjects =3D [MavenProject: org.apache.hadoop:hadoop-a=
nnotations:0.24.0-SNAPSHOT @ <https://builds.apache.org/job/Hadoop-Common-t=
runk/ws/trunk/hadoop-common-project/hadoop-annotations/pom.xml,> MavenProje=
ct: org.apache.hadoop:hadoop-auth:0.24.0-SNAPSHOT @ <https://builds.apache.=
org/job/Hadoop-Common-trunk/ws/trunk/hadoop-common-project/hadoop-auth/pom.=
xml,> MavenProject: org.apache.hadoop:hadoop-auth-examples:0.24.0-SNAPSHOT =
@ <https://builds.apache.org/job/Hadoop-Common-trunk/ws/trunk/hadoop-common=
-project/hadoop-auth-examples/pom.xml,> MavenProject: org.apache.hadoop:had=
oop-common:0.24.0-SNAPSHOT @ <https://builds.apache.org/job/Hadoop-Common-t=
runk/ws/trunk/hadoop-common-project/hadoop-common/pom.xml,> MavenProject: o=
rg.apache.hadoop:hadoop-common-project:0.24.0-SNAPSHOT @ <https://builds.ap=
ache.org/job/Hadoop-Common-trunk/ws/trunk/hadoop-common-project/pom.xml]>
[DEBUG] (f) useDefaultExcludes =3D true
[DEBUG] (f) useDefaultManifestFile =3D false
[DEBUG] -- end configuration --
[INFO]=20
[INFO] --- maven-enforcer-plugin:1.0:enforce (dist-enforce) @ hadoop-common=
-project ---
[DEBUG] Configuring mojo org.apache.maven.plugins:maven-enforcer-plugin:1.0=
:enforce from plugin realm ClassRealm[plugin>org.apache.maven.plugins:maven=
-enforcer-plugin:1.0, parent: sun.misc.Launcher$AppClassLoader@6b97fd]
[DEBUG] Configuring mojo 'org.apache.maven.plugins:maven-enforcer-plugin:1.=
0:enforce' with basic configurator -->
[DEBUG] (s) fail =3D true
[DEBUG] (s) failFast =3D false
[DEBUG] (f) ignoreCache =3D false
[DEBUG] (s) project =3D MavenProject: org.apache.hadoop:hadoop-common-pro=
ject:0.24.0-SNAPSHOT @ <https://builds.apache.org/job/Hadoop-Common-trunk/w=
s/trunk/hadoop-common-project/pom.xml>
[DEBUG] (s) version =3D [3.0.2,)
[DEBUG] (s) version =3D 1.6
[DEBUG] (s) rules =3D [org.apache.maven.plugins.enforcer.RequireMavenVers=
ion@117c5ac, org.apache.maven.plugins.enforcer.RequireJavaVersion@1b2b862]
[DEBUG] (s) session =3D org.apache.maven.execution.MavenSession@6cc2a4
[DEBUG] (s) skip =3D false
[DEBUG] -- end configuration --
[DEBUG] Executing rule: org.apache.maven.plugins.enforcer.RequireMavenVersi=
on
[DEBUG] Rule org.apache.maven.plugins.enforcer.RequireMavenVersion is cache=
able.
[DEBUG] Key org.apache.maven.plugins.enforcer.RequireMavenVersion -93731219=
7 was found in the cache
[DEBUG] The cached results are still valid. Skipping the rule: org.apache.m=
aven.plugins.enforcer.RequireMavenVersion
[DEBUG] Executing rule: org.apache.maven.plugins.enforcer.RequireJavaVersio=
n
[DEBUG] Rule org.apache.maven.plugins.enforcer.RequireJavaVersion is cachea=
ble.
[DEBUG] Key org.apache.maven.plugins.enforcer.RequireJavaVersion 48569 was =
found in the cache
[DEBUG] The cached results are still valid. Skipping the rule: org.apache.m=
aven.plugins.enforcer.RequireJavaVersion
[INFO]=20
[INFO] --- maven-site-plugin:3.0:attach-descriptor (attach-descriptor) @ ha=
doop-common-project ---
[DEBUG] Configuring mojo org.apache.maven.plugins:maven-site-plugin:3.0:att=
ach-descriptor from plugin realm ClassRealm[plugin>org.apache.maven.plugins=
:maven-site-plugin:3.0, parent: sun.misc.Launcher$AppClassLoader@6b97fd]
[DEBUG] Configuring mojo 'org.apache.maven.plugins:maven-site-plugin:3.0:at=
tach-descriptor' with basic configurator -->
[DEBUG] (f) basedir =3D <https://builds.apache.org/job/Hadoop-Common-trun=
k/ws/trunk/hadoop-common-project>
[DEBUG] (f) inputEncoding =3D UTF-8
[DEBUG] (f) localRepository =3D id: local
url: file:///home/jenkins/.m2/repository/
layout: none
[DEBUG] (f) outputEncoding =3D UTF-8
[DEBUG] (f) pomPackagingOnly =3D true
[DEBUG] (f) project =3D MavenProject: org.apache.hadoop:hadoop-common-pro=
ject:0.24.0-SNAPSHOT @ <https://builds.apache.org/job/Hadoop-Common-trunk/w=
s/trunk/hadoop-common-project/pom.xml>
[DEBUG] (f) reactorProjects =3D [MavenProject: org.apache.hadoop:hadoop-a=
nnotations:0.24.0-SNAPSHOT @ <https://builds.apache.org/job/Hadoop-Common-t=
runk/ws/trunk/hadoop-common-project/hadoop-annotations/pom.xml,> MavenProje=
ct: org.apache.hadoop:hadoop-auth:0.24.0-SNAPSHOT @ <https://builds.apache.=
org/job/Hadoop-Common-trunk/ws/trunk/hadoop-common-project/hadoop-auth/pom.=
xml,> MavenProject: org.apache.hadoop:hadoop-auth-examples:0.24.0-SNAPSHOT =
@ <https://builds.apache.org/job/Hadoop-Common-trunk/ws/trunk/hadoop-common=
-project/hadoop-auth-examples/pom.xml,> MavenProject: org.apache.hadoop:had=
oop-common:0.24.0-SNAPSHOT @ <https://builds.apache.org/job/Hadoop-Common-t=
runk/ws/trunk/hadoop-common-project/hadoop-common/pom.xml,> MavenProject: o=
rg.apache.hadoop:hadoop-common-project:0.24.0-SNAPSHOT @ <https://builds.ap=
ache.org/job/Hadoop-Common-trunk/ws/trunk/hadoop-common-project/pom.xml]>
[DEBUG] (f) siteDirectory =3D <https://builds.apache.org/job/Hadoop-Commo=
n-trunk/ws/trunk/hadoop-common-project/src/site>
[DEBUG] -- end configuration --
[DEBUG] Mapped url: <https://builds.apache.org/job/Hadoop-Common-trunk/ws/t=
runk/hadoop-common-project/src/site> to relative path: src/site
[INFO]=20
[INFO] --- maven-javadoc-plugin:2.8.1:jar (module-javadocs) @ hadoop-common=
-project ---
[DEBUG] Configuring mojo org.apache.maven.plugins:maven-javadoc-plugin:2.8.=
1:jar from plugin realm ClassRealm[plugin>org.apache.maven.plugins:maven-ja=
vadoc-plugin:2.8.1, parent: sun.misc.Launcher$AppClassLoader@6b97fd]
[DEBUG] Configuring mojo 'org.apache.maven.plugins:maven-javadoc-plugin:2.8=
.1:jar' with basic configurator -->
[DEBUG] (f) aggregate =3D false
[DEBUG] (f) attach =3D true
[DEBUG] (f) author =3D true
[DEBUG] (f) bootclasspathArtifacts =3D []
[DEBUG] (f) bottom =3D Copyright &#169; {inceptionYear}-{currentYear} {or=
ganizationName}. All Rights Reserved.
[DEBUG] (f) breakiterator =3D false
[DEBUG] (f) debug =3D false
[DEBUG] (f) defaultManifestFile =3D <https://builds.apache.org/job/Hadoop=
-Common-trunk/ws/trunk/hadoop-common-project/target/classes/META-INF/MANIFE=
ST.MF>
[DEBUG] (f) destDir =3D <https://builds.apache.org/job/Hadoop-Common-trun=
k/ws/trunk/hadoop-common-project/target>
[DEBUG] (f) detectJavaApiLink =3D true
[DEBUG] (f) detectLinks =3D false
[DEBUG] (f) detectOfflineLinks =3D true
[DEBUG] (f) docencoding =3D UTF-8
[DEBUG] (f) docfilessubdirs =3D false
[DEBUG] (f) docletArtifact =3D groupId =3D 'null'
artifactId =3D 'null'
version =3D 'null'
[DEBUG] (f) docletArtifacts =3D []
[DEBUG] (f) doctitle =3D Apache Hadoop Common Project 0.24.0-SNAPSHOT API
[DEBUG] (f) encoding =3D UTF-8
[DEBUG] (f) failOnError =3D true
[DEBUG] (f) finalName =3D hadoop-common-project-0.24.0-SNAPSHOT
[DEBUG] (f) groups =3D []
[DEBUG] (f) includeDependencySources =3D false
[DEBUG] (f) includeTransitiveDependencySources =3D false
[DEBUG] (f) isOffline =3D false
[DEBUG] (f) jarOutputDirectory =3D <https://builds.apache.org/job/Hadoop-=
Common-trunk/ws/trunk/hadoop-common-project/target>
[DEBUG] (f) javaApiLinks =3D {}
[DEBUG] (f) javadocDirectory =3D <https://builds.apache.org/job/Hadoop-Co=
mmon-trunk/ws/trunk/hadoop-common-project/src/main/javadoc>
[DEBUG] (f) javadocOptionsDir =3D <https://builds.apache.org/job/Hadoop-C=
ommon-trunk/ws/trunk/hadoop-common-project/target/javadoc-bundle-options>
[DEBUG] (f) keywords =3D false
[DEBUG] (f) links =3D []
[DEBUG] (f) linksource =3D false
[DEBUG] (f) localRepository =3D id: local
url: file:///home/jenkins/.m2/repository/
layout: none
[DEBUG] (f) nocomment =3D false
[DEBUG] (f) nodeprecated =3D false
[DEBUG] (f) nodeprecatedlist =3D false
[DEBUG] (f) nohelp =3D false
[DEBUG] (f) noindex =3D false
[DEBUG] (f) nonavbar =3D false
[DEBUG] (f) nooverview =3D false
[DEBUG] (f) nosince =3D false
[DEBUG] (f) notimestamp =3D false
[DEBUG] (f) notree =3D false
[DEBUG] (f) offlineLinks =3D []
[DEBUG] (f) old =3D false
[DEBUG] (f) outputDirectory =3D <https://builds.apache.org/job/Hadoop-Com=
mon-trunk/ws/trunk/hadoop-common-project/target>
[DEBUG] (f) overview =3D <https://builds.apache.org/job/Hadoop-Common-tru=
nk/ws/trunk/hadoop-common-project/src/main/javadoc/overview.html>
[DEBUG] (f) project =3D MavenProject: org.apache.hadoop:hadoop-common-pro=
ject:0.24.0-SNAPSHOT @ <https://builds.apache.org/job/Hadoop-Common-trunk/w=
s/trunk/hadoop-common-project/pom.xml>
[DEBUG] (f) quiet =3D false
[DEBUG] (f) reactorProjects =3D [MavenProject: org.apache.hadoop:hadoop-a=
nnotations:0.24.0-SNAPSHOT @ <https://builds.apache.org/job/Hadoop-Common-t=
runk/ws/trunk/hadoop-common-project/hadoop-annotations/pom.xml,> MavenProje=
ct: org.apache.hadoop:hadoop-auth:0.24.0-SNAPSHOT @ <https://builds.apache.=
org/job/Hadoop-Common-trunk/ws/trunk/hadoop-common-project/hadoop-auth/pom.=
xml,> MavenProject: org.apache.hadoop:hadoop-auth-examples:0.24.0-SNAPSHOT =
@ <https://builds.apache.org/job/Hadoop-Common-trunk/ws/trunk/hadoop-common=
-project/hadoop-auth-examples/pom.xml,> MavenProject: org.apache.hadoop:had=
oop-common:0.24.0-SNAPSHOT @ <https://builds.apache.org/job/Hadoop-Common-t=
runk/ws/trunk/hadoop-common-project/hadoop-common/pom.xml,> MavenProject: o=
rg.apache.hadoop:hadoop-common-project:0.24.0-SNAPSHOT @ <https://builds.ap=
ache.org/job/Hadoop-Common-trunk/ws/trunk/hadoop-common-project/pom.xml]>
[DEBUG] (f) remoteRepositories =3D [ id: apache.snapshots.https
url: https://repository.apache.org/content/repositories/snapshots
layout: default
snapshots: [enabled =3D> true, update =3D> daily]
releases: [enabled =3D> true, update =3D> daily]
, id: repository.jboss.org
url: http://repository.jboss.org/nexus/content/groups/public/
layout: default
snapshots: [enabled =3D> false, update =3D> daily]
releases: [enabled =3D> true, update =3D> daily]
, id: central
url: http://repo1.maven.org/maven2
layout: default
snapshots: [enabled =3D> false, update =3D> daily]
releases: [enabled =3D> true, update =3D> daily]
]
[DEBUG] (f) resourcesArtifacts =3D []
[DEBUG] (f) serialwarn =3D false
[DEBUG] (f) session =3D org.apache.maven.execution.MavenSession@6cc2a4
[DEBUG] (f) settings =3D org.apache.maven.execution.SettingsAdapter@dd7a7
[DEBUG] (f) show =3D protected
[DEBUG] (f) skip =3D false
[DEBUG] (f) sourceDependencyCacheDir =3D <https://builds.apache.org/job/H=
adoop-Common-trunk/ws/trunk/hadoop-common-project/target/distro-javadoc-sou=
rces>
[DEBUG] (f) splitindex =3D false
[DEBUG] (f) stylesheet =3D java
[DEBUG] (f) tagletArtifact =3D groupId =3D 'null'
artifactId =3D 'null'
version =3D 'null'
[DEBUG] (f) tagletArtifacts =3D []
[DEBUG] (f) taglets =3D []
[DEBUG] (f) tags =3D []
[DEBUG] (f) use =3D true
[DEBUG] (f) useDefaultManifestFile =3D false
[DEBUG] (f) useStandardDocletOptions =3D true
[DEBUG] (f) validateLinks =3D false
[DEBUG] (f) verbose =3D false
[DEBUG] (f) version =3D true
[DEBUG] (f) windowtitle =3D Apache Hadoop Common Project 0.24.0-SNAPSHOT =
API
[DEBUG] -- end configuration --
[INFO] Not executing Javadoc as the project is not a Java classpath-capable=
package
[INFO]=20
[INFO] --- maven-checkstyle-plugin:2.6:checkstyle (default-cli) @ hadoop-co=
mmon-project ---
[DEBUG] Configuring mojo org.apache.maven.plugins:maven-checkstyle-plugin:2=
.6:checkstyle from plugin realm ClassRealm[plugin>org.apache.maven.plugins:=
maven-checkstyle-plugin:2.6, parent: sun.misc.Launcher$AppClassLoader@6b97f=
d]
[DEBUG] Configuring mojo 'org.apache.maven.plugins:maven-checkstyle-plugin:=
2.6:checkstyle' with basic configurator -->
[DEBUG] (f) cacheFile =3D <https://builds.apache.org/job/Hadoop-Common-tr=
unk/ws/trunk/hadoop-common-project/target/checkstyle-cachefile>
[DEBUG] (f) configLocation =3D config/sun_checks.xml
[DEBUG] (f) consoleOutput =3D false
[DEBUG] (f) enableFilesSummary =3D true
[DEBUG] (f) enableRSS =3D true
[DEBUG] (f) enableRulesSummary =3D true
[DEBUG] (f) enableSeveritySummary =3D true
[DEBUG] (f) encoding =3D UTF-8
[DEBUG] (f) failsOnError =3D false
[DEBUG] (f) format =3D sun
[DEBUG] (f) headerFile =3D <https://builds.apache.org/job/Hadoop-Common-t=
runk/ws/trunk/hadoop-common-project/LICENSE.txt>
[DEBUG] (f) headerLocation =3D LICENSE.txt
[DEBUG] (f) includes =3D **/*.java
[DEBUG] (f) linkXRef =3D true
[DEBUG] (f) outputDirectory =3D <https://builds.apache.org/job/Hadoop-Com=
mon-trunk/ws/trunk/hadoop-common-project/target/site>
[DEBUG] (f) outputFile =3D <https://builds.apache.org/job/Hadoop-Common-t=
runk/ws/trunk/hadoop-common-project/target/checkstyle-result.xml>
[DEBUG] (f) outputFileFormat =3D xml
[DEBUG] (f) project =3D MavenProject: org.apache.hadoop:hadoop-common-pro=
ject:0.24.0-SNAPSHOT @ <https://builds.apache.org/job/Hadoop-Common-trunk/w=
s/trunk/hadoop-common-project/pom.xml>
[DEBUG] (f) skip =3D false
[DEBUG] (f) sourceDirectory =3D <https://builds.apache.org/job/Hadoop-Com=
mon-trunk/ws/trunk/hadoop-common-project/src/main/java>
[DEBUG] (f) suppressionsFileExpression =3D checkstyle.suppressions.file
[DEBUG] (f) testSourceDirectory =3D <https://builds.apache.org/job/Hadoop=
-Common-trunk/ws/trunk/hadoop-common-project/src/test/java>
[DEBUG] (f) xrefLocation =3D <https://builds.apache.org/job/Hadoop-Common=
-trunk/ws/trunk/hadoop-common-project/target/site/xref>
[DEBUG] -- end configuration --
[INFO]=20
[INFO] --- findbugs-maven-plugin:2.3.2:findbugs (default-cli) @ hadoop-comm=
on-project ---
[DEBUG] Configuring mojo org.codehaus.mojo:findbugs-maven-plugin:2.3.2:find=
bugs from plugin realm ClassRealm[plugin>org.codehaus.mojo:findbugs-maven-p=
lugin:2.3.2, parent: sun.misc.Launcher$AppClassLoader@6b97fd]
[DEBUG] Configuring mojo 'org.codehaus.mojo:findbugs-maven-plugin:2.3.2:fin=
dbugs' with basic configurator -->
[DEBUG] (s) classFilesDirectory =3D <https://builds.apache.org/job/Hadoop=
-Common-trunk/ws/trunk/hadoop-common-project/target/classes>
[DEBUG] (s) compileSourceRoots =3D [<https://builds.apache.org/job/Hadoop=
-Common-trunk/ws/trunk/hadoop-common-project/src/main/java]>
[DEBUG] (s) debug =3D false
[DEBUG] (s) effort =3D Default
[DEBUG] (s) failOnError =3D true
[DEBUG] (s) findbugsXmlOutput =3D false
[DEBUG] (s) findbugsXmlOutputDirectory =3D <https://builds.apache.org/job=
/Hadoop-Common-trunk/ws/trunk/hadoop-common-project/target>
[DEBUG] (s) fork =3D true
[DEBUG] (s) includeTests =3D false
[DEBUG] (s) localRepository =3D id: local
url: file:///home/jenkins/.m2/repository/
layout: none
[DEBUG] (s) maxHeap =3D 512
[DEBUG] (s) nested =3D false
[DEBUG] (s) outputDirectory =3D <https://builds.apache.org/job/Hadoop-Com=
mon-trunk/ws/trunk/hadoop-common-project/target/site>
[DEBUG] (s) outputEncoding =3D UTF-8
[DEBUG] (s) pluginArtifacts =3D [org.codehaus.mojo:findbugs-maven-plugin:=
maven-plugin:2.3.2:, com.google.code.findbugs:bcel:jar:1.3.9:compile, org.c=
odehaus.gmaven:gmaven-mojo:jar:1.3:compile, org.codehaus.gmaven.runtime:gma=
ven-runtime-api:jar:1.3:compile, org.codehaus.gmaven.feature:gmaven-feature=
-api:jar:1.3:compile, org.codehaus.gmaven.runtime:gmaven-runtime-1.5:jar:1.=
3:compile, org.codehaus.gmaven.feature:gmaven-feature-support:jar:1.3:compi=
le, org.codehaus.groovy:groovy-all-minimal:jar:1.5.8:compile, org.apache.an=
t:ant:jar:1.7.1:compile, org.apache.ant:ant-launcher:jar:1.7.1:compile, jli=
ne:jline:jar:0.9.94:compile, org.codehaus.plexus:plexus-interpolation:jar:1=
.1:compile, org.codehaus.gmaven:gmaven-plugin:jar:1.3:compile, org.codehaus=
.gmaven.runtime:gmaven-runtime-loader:jar:1.3:compile, org.codehaus.gmaven.=
runtime:gmaven-runtime-support:jar:1.3:compile, org.sonatype.gshell:gshell-=
io:jar:2.0:compile, com.thoughtworks.qdox:qdox:jar:1.10:compile, org.apache=
.maven.shared:file-management:jar:1.2.1:compile, org.apache.maven.shared:ma=
ven-shared-io:jar:1.1:compile, commons-lang:commons-lang:jar:2.4:compile, o=
rg.slf4j:slf4j-api:jar:1.5.10:compile, org.sonatype.gossip:gossip:jar:1.2:c=
ompile, org.apache.maven.reporting:maven-reporting-impl:jar:2.1:compile, co=
mmons-validator:commons-validator:jar:1.2.0:compile, commons-beanutils:comm=
ons-beanutils:jar:1.7.0:compile, commons-digester:commons-digester:jar:1.6:=
compile, commons-logging:commons-logging:jar:1.0.4:compile, oro:oro:jar:2.0=
.8:compile, xml-apis:xml-apis:jar:1.0.b2:compile, org.codehaus.groovy:groov=
y-all:jar:1.7.4:compile, org.apache.maven.reporting:maven-reporting-api:jar=
:3.0:compile, org.apache.maven.doxia:doxia-core:jar:1.1.3:compile, org.apac=
he.maven.doxia:doxia-logging-api:jar:1.1.3:compile, xerces:xercesImpl:jar:2=
.9.1:compile, commons-httpclient:commons-httpclient:jar:3.1:compile, common=
s-codec:commons-codec:jar:1.2:compile, org.apache.maven.doxia:doxia-sink-ap=
i:jar:1.1.3:compile, org.apache.maven.doxia:doxia-decoration-model:jar:1.1.=
3:compile, org.apache.maven.doxia:doxia-site-renderer:jar:1.1.3:compile, or=
g.apache.maven.doxia:doxia-module-xhtml:jar:1.1.3:compile, org.apache.maven=
.doxia:doxia-module-fml:jar:1.1.3:compile, org.codehaus.plexus:plexus-i18n:=
jar:1.0-beta-7:compile, org.codehaus.plexus:plexus-velocity:jar:1.1.7:compi=
le, org.apache.velocity:velocity:jar:1.5:compile, commons-collections:commo=
ns-collections:jar:3.2:compile, org.apache.maven.shared:maven-doxia-tools:j=
ar:1.2.1:compile, commons-io:commons-io:jar:1.4:compile, com.google.code.fi=
ndbugs:findbugs-ant:jar:1.3.9:compile, com.google.code.findbugs:findbugs:ja=
r:1.3.9:compile, com.google.code.findbugs:jsr305:jar:1.3.9:compile, com.goo=
gle.code.findbugs:jFormatString:jar:1.3.9:compile, com.google.code.findbugs=
:annotations:jar:1.3.9:compile, dom4j:dom4j:jar:1.6.1:compile, jaxen:jaxen:=
jar:1.1.1:compile, jdom:jdom:jar:1.0:compile, xom:xom:jar:1.0:compile, xerc=
es:xmlParserAPIs:jar:2.6.2:compile, xalan:xalan:jar:2.6.0:compile, com.ibm.=
icu:icu4j:jar:2.6.1:compile, asm:asm:jar:3.1:compile, asm:asm-analysis:jar:=
3.1:compile, asm:asm-commons:jar:3.1:compile, asm:asm-util:jar:3.1:compile,=
asm:asm-tree:jar:3.1:compile, asm:asm-xml:jar:3.1:compile, jgoodies:plasti=
c:jar:1.2.0:compile, org.codehaus.plexus:plexus-resources:jar:1.0-alpha-4:c=
ompile, org.codehaus.plexus:plexus-utils:jar:1.5.1:compile]
[DEBUG] (s) project =3D MavenProject: org.apache.hadoop:hadoop-common-pro=
ject:0.24.0-SNAPSHOT @ <https://builds.apache.org/job/Hadoop-Common-trunk/w=
s/trunk/hadoop-common-project/pom.xml>
[DEBUG] (s) relaxed =3D false
[DEBUG] (s) remoteArtifactRepositories =3D [ id: apache.snapshots.h=
ttps
url: https://repository.apache.org/content/repositories/snapshots
layout: default
snapshots: [enabled =3D> true, update =3D> daily]
releases: [enabled =3D> true, update =3D> daily]
, id: repository.jboss.org
url: http://repository.jboss.org/nexus/content/groups/public/
layout: default
snapshots: [enabled =3D> false, update =3D> daily]
releases: [enabled =3D> true, update =3D> daily]
, id: central
url: http://repo1.maven.org/maven2
layout: default
snapshots: [enabled =3D> false, update =3D> daily]
releases: [enabled =3D> true, update =3D> daily]
]
[DEBUG] (s) skip =3D false
[DEBUG] (s) sourceEncoding =3D UTF-8
[DEBUG] (s) testClassFilesDirectory =3D <https://builds.apache.org/job/Ha=
doop-Common-trunk/ws/trunk/hadoop-common-project/target/test-classes>
[DEBUG] (s) testSourceRoots =3D [<https://builds.apache.org/job/Hadoop-Co=
mmon-trunk/ws/trunk/hadoop-common-project/src/test/java]>
[DEBUG] (s) threshold =3D Default
[DEBUG] (s) timeout =3D 600000
[DEBUG] (s) trace =3D false
[DEBUG] (s) xmlEncoding =3D UTF-8
[DEBUG] (s) xmlOutput =3D false
[DEBUG] (s) xmlOutputDirectory =3D <https://builds.apache.org/job/Hadoop-=
Common-trunk/ws/trunk/hadoop-common-project/target>
[DEBUG] (s) xrefLocation =3D <https://builds.apache.org/job/Hadoop-Common=
-trunk/ws/trunk/hadoop-common-project/target/site/xref>
[DEBUG] (s) xrefTestLocation =3D <https://builds.apache.org/job/Hadoop-Co=
mmon-trunk/ws/trunk/hadoop-common-project/target/site/xref-test>
[DEBUG] -- end configuration --
[INFO] ****** FindBugsMojo execute *******
[DEBUG] XML outputFile is <https://builds.apache.org/job/Hadoop-Common-trun=
k/ws/trunk/hadoop-common-project/target/findbugsXml.xml>
[DEBUG] Generating Findbugs XML
[DEBUG] Inside canGenerateReport..... false=20
[INFO] canGenerate is false
[INFO] --------------------------------------------------------------------=
----
[INFO] Reactor Summary:
[INFO]=20
[INFO] Apache Hadoop Annotations ......................... SUCCESS [13.846s=
]
[INFO] Apache Hadoop Auth ................................ SUCCESS [17.994s=
]
[INFO] Apache Hadoop Auth Examples ....................... SUCCESS [7.336s]
[INFO] Apache Hadoop Common .............................. SUCCESS [4:18.98=
1s]
[INFO] Apache Hadoop Common Project ...................... SUCCESS [0.040s]
[INFO] --------------------------------------------------------------------=
----
[INFO] BUILD SUCCESS
[INFO] --------------------------------------------------------------------=
----
[INFO] Total time: 4:59.433s
[INFO] Finished at: Fri Feb 24 09:19:32 UTC 2012
[INFO] Final Memory: 82M/791M
[INFO] --------------------------------------------------------------------=
----
+ /home/jenkins/tools/maven/latest/bin/mvn test -Pclover -DcloverLicenseLoc=
ation=3D/home/jenkins/tools/clover/latest/lib/clover.license
Build step 'Execute shell' marked build as failure
[WARNINGS] Skipping publisher since build result is FAILURE
Archiving artifacts
Recording test results
Publishing Javadoc
Recording fingerprints
From common-dev-return-77846-apmail-hadoop-common-dev-archive=hadoop.apache.org@hadoop.apache.org Fri Feb 24 18:50:11 2012
Return-Path: <common-dev-return-77846-apmail-hadoop-common-dev-archive=hadoop.apache.org@hadoop.apache.org>
X-Original-To: apmail-hadoop-common-dev-archive@www.apache.org
Delivered-To: apmail-hadoop-common-dev-archive@www.apache.org
Received: from mail.apache.org (hermes.apache.org [140.211.11.3])
by minotaur.apache.org (Postfix) with SMTP id 684349DBE
for <apmail-hadoop-common-dev-archive@www.apache.org>; Fri, 24 Feb 2012 18:50:11 +0000 (UTC)
Received: (qmail 55728 invoked by uid 500); 24 Feb 2012 18:50:09 -0000
Delivered-To: apmail-hadoop-common-dev-archive@hadoop.apache.org
Received: (qmail 55654 invoked by uid 500); 24 Feb 2012 18:50:09 -0000
Mailing-List: contact common-dev-help@hadoop.apache.org; run by ezmlm
Precedence: bulk
List-Help: <mailto:common-dev-help@hadoop.apache.org>
List-Unsubscribe: <mailto:common-dev-unsubscribe@hadoop.apache.org>
List-Post: <mailto:common-dev@hadoop.apache.org>
List-Id: <common-dev.hadoop.apache.org>
Reply-To: common-dev@hadoop.apache.org
Delivered-To: mailing list common-dev@hadoop.apache.org
Received: (qmail 55646 invoked by uid 99); 24 Feb 2012 18:50:09 -0000
Received: from athena.apache.org (HELO athena.apache.org) (140.211.11.136)
by apache.org (qpsmtpd/0.29) with ESMTP; Fri, 24 Feb 2012 18:50:09 +0000
X-ASF-Spam-Status: No, hits=-2000.0 required=5.0
tests=ALL_TRUSTED,T_RP_MATCHES_RCVD
X-Spam-Check-By: apache.org
Received: from [140.211.11.116] (HELO hel.zones.apache.org) (140.211.11.116)
by apache.org (qpsmtpd/0.29) with ESMTP; Fri, 24 Feb 2012 18:50:08 +0000
Received: from hel.zones.apache.org (hel.zones.apache.org [140.211.11.116])
by hel.zones.apache.org (Postfix) with ESMTP id 9EFC5338D1B
for <common-dev@hadoop.apache.org>; Fri, 24 Feb 2012 18:49:48 +0000 (UTC)
Date: Fri, 24 Feb 2012 18:49:48 +0000 (UTC)
From: "Tsz Wo (Nicholas), SZE (Created) (JIRA)" <jira@apache.org>
To: common-dev@hadoop.apache.org
Message-ID: <1727252259.16162.1330109388652.JavaMail.tomcat@hel.zones.apache.org>
Subject: [jira] [Created] (HADOOP-8110) TestViewFsTrash occasionally fails
MIME-Version: 1.0
Content-Type: text/plain; charset=utf-8
Content-Transfer-Encoding: 7bit
X-JIRA-FingerPrint: 30527f35849b9dde25b450d4833f0394
TestViewFsTrash occasionally fails
----------------------------------
Key: HADOOP-8110
URL: https://issues.apache.org/jira/browse/HADOOP-8110
Project: Hadoop Common
Issue Type: Bug
Components: fs
Reporter: Tsz Wo (Nicholas), SZE
{noformat}
junit.framework.AssertionFailedError: -expunge failed expected:<0> but was:<1>
at junit.framework.Assert.fail(Assert.java:47)
at junit.framework.Assert.failNotEquals(Assert.java:283)
at junit.framework.Assert.assertEquals(Assert.java:64)
at junit.framework.Assert.assertEquals(Assert.java:195)
at org.apache.hadoop.fs.TestTrash.trashShell(TestTrash.java:322)
at org.apache.hadoop.fs.viewfs.TestViewFsTrash.testTrash(TestViewFsTrash.java:73)
...
{noformat}
See quite a few TestViewFsTrash failures recently. E.g. [build #624 for trunk|https://builds.apache.org/job/PreCommit-HADOOP-Build/624//testReport/org.apache.hadoop.fs.viewfs/TestViewFsTrash/testTrash/] and [build #2 for 0.23-PB|https://builds.apache.org/view/G-L/view/Hadoop/job/Hadoop-Common-0.23-PB-Build/2/testReport/junit/org.apache.hadoop.fs.viewfs/TestViewFsTrash/testTrash/].
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
From common-dev-return-77847-apmail-hadoop-common-dev-archive=hadoop.apache.org@hadoop.apache.org Fri Feb 24 23:26:15 2012
Return-Path: <common-dev-return-77847-apmail-hadoop-common-dev-archive=hadoop.apache.org@hadoop.apache.org>
X-Original-To: apmail-hadoop-common-dev-archive@www.apache.org
Delivered-To: apmail-hadoop-common-dev-archive@www.apache.org
Received: from mail.apache.org (hermes.apache.org [140.211.11.3])
by minotaur.apache.org (Postfix) with SMTP id 1C9D3963D
for <apmail-hadoop-common-dev-archive@www.apache.org>; Fri, 24 Feb 2012 23:26:15 +0000 (UTC)
Received: (qmail 83760 invoked by uid 500); 24 Feb 2012 23:26:13 -0000
Delivered-To: apmail-hadoop-common-dev-archive@hadoop.apache.org
Received: (qmail 83656 invoked by uid 500); 24 Feb 2012 23:26:12 -0000
Mailing-List: contact common-dev-help@hadoop.apache.org; run by ezmlm
Precedence: bulk
List-Help: <mailto:common-dev-help@hadoop.apache.org>
List-Unsubscribe: <mailto:common-dev-unsubscribe@hadoop.apache.org>
List-Post: <mailto:common-dev@hadoop.apache.org>
List-Id: <common-dev.hadoop.apache.org>
Reply-To: common-dev@hadoop.apache.org
Delivered-To: mailing list common-dev@hadoop.apache.org
Received: (qmail 83637 invoked by uid 99); 24 Feb 2012 23:26:12 -0000
Received: from nike.apache.org (HELO nike.apache.org) (192.87.106.230)
by apache.org (qpsmtpd/0.29) with ESMTP; Fri, 24 Feb 2012 23:26:12 +0000
X-ASF-Spam-Status: No, hits=-2000.0 required=5.0
tests=ALL_TRUSTED,T_RP_MATCHES_RCVD
X-Spam-Check-By: apache.org
Received: from [140.211.11.116] (HELO hel.zones.apache.org) (140.211.11.116)
by apache.org (qpsmtpd/0.29) with ESMTP; Fri, 24 Feb 2012 23:26:10 +0000
Received: from hel.zones.apache.org (hel.zones.apache.org [140.211.11.116])
by hel.zones.apache.org (Postfix) with ESMTP id 4A294339AF6
for <common-dev@hadoop.apache.org>; Fri, 24 Feb 2012 23:25:49 +0000 (UTC)
Date: Fri, 24 Feb 2012 23:25:49 +0000 (UTC)
From: "Weili Shao (Created) (JIRA)" <jira@apache.org>
To: common-dev@hadoop.apache.org
Message-ID: <248839919.17656.1330125949305.JavaMail.tomcat@hel.zones.apache.org>
Subject: [jira] [Created] (HADOOP-8111) cannot see userlogs from the web
MIME-Version: 1.0
Content-Type: text/plain; charset=utf-8
Content-Transfer-Encoding: 7bit
X-JIRA-FingerPrint: 30527f35849b9dde25b450d4833f0394
X-Virus-Checked: Checked by ClamAV on apache.org
cannot see userlogs from the web
--------------------------------
Key: HADOOP-8111
URL: https://issues.apache.org/jira/browse/HADOOP-8111
Project: Hadoop Common
Issue Type: Bug
Components: util
Affects Versions: 1.0.0
Environment: Linux
Reporter: Weili Shao
After upgraded from Hadoop 0.20.2 to Hadoop 1.0.0, the userlogs cannot be viewed anymore from the web. The root cause is that the userlogs of the tasks are actually simlinks at level of dir with name pattern like attempt_201202241358_0001_m_000000_0. According to Jetty's documentation, simlinks are not defaultly rederable http://docs.codehaus.org/display/JETTY/How+to+enable+serving+aliased+files. Please check.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
From common-dev-return-77848-apmail-hadoop-common-dev-archive=hadoop.apache.org@hadoop.apache.org Sat Feb 25 01:49:48 2012
Return-Path: <common-dev-return-77848-apmail-hadoop-common-dev-archive=hadoop.apache.org@hadoop.apache.org>
X-Original-To: apmail-hadoop-common-dev-archive@www.apache.org
Delivered-To: apmail-hadoop-common-dev-archive@www.apache.org
Received: from mail.apache.org (hermes.apache.org [140.211.11.3])
by minotaur.apache.org (Postfix) with SMTP id 6FF809201
for <apmail-hadoop-common-dev-archive@www.apache.org>; Sat, 25 Feb 2012 01:49:48 +0000 (UTC)
Received: (qmail 29249 invoked by uid 500); 25 Feb 2012 01:49:46 -0000
Delivered-To: apmail-hadoop-common-dev-archive@hadoop.apache.org
Received: (qmail 29199 invoked by uid 500); 25 Feb 2012 01:49:46 -0000
Mailing-List: contact common-dev-help@hadoop.apache.org; run by ezmlm
Precedence: bulk
List-Help: <mailto:common-dev-help@hadoop.apache.org>
List-Unsubscribe: <mailto:common-dev-unsubscribe@hadoop.apache.org>
List-Post: <mailto:common-dev@hadoop.apache.org>
List-Id: <common-dev.hadoop.apache.org>
Reply-To: common-dev@hadoop.apache.org
Delivered-To: mailing list common-dev@hadoop.apache.org
Delivered-To: moderator for common-dev@hadoop.apache.org
Received: (qmail 3658 invoked by uid 99); 24 Feb 2012 22:23:10 -0000
X-ASF-Spam-Status: No, hits=1.5 required=5.0
tests=HTML_MESSAGE,RCVD_IN_DNSWL_LOW,SPF_PASS
X-Spam-Check-By: apache.org
Received-SPF: pass (athena.apache.org: domain of forzamehlano@gmail.com designates 209.85.215.48 as permitted sender)
Received-SPF: pass (google.com: domain of forzamehlano@gmail.com designates 10.152.135.148 as permitted sender) client-ip=10.152.135.148;
Authentication-Results: mr.google.com; spf=pass (google.com: domain of forzamehlano@gmail.com designates 10.152.135.148 as permitted sender) smtp.mail=forzamehlano@gmail.com; dkim=pass header.i=forzamehlano@gmail.com
DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed;
d=gmail.com; s=gamma;
h=mime-version:date:message-id:subject:from:to:content-type;
bh=VoMgypftIjZyhKBEFxcj9a06kjOWO3gFQ4Qz37EAyCY=;
b=rIINeS5SDZ6m8onUE0/ahQZkDhuAift/YFOqavYaAQJyuUclUjqtRs6GqCTQJIp9rW
pkHzGPZlZbuF6FCBZ73SV1zV+OfYHqm1FuLQ/oAi2YKcMR3lP/GXTveY2q23GiQtleiv
tNCHaTUOr0Enkz6WC5b1T5/COqlmc4qapWExA=
MIME-Version: 1.0
Date: Fri, 24 Feb 2012 22:22:42 +0000
Message-ID: <CALzte2v0QHS8DOC-uzWjALhkM__ksduh_VPG_jEh1oC4T6O9EA@mail.gmail.com>
Subject: hadoop-1.0.0 test failures
From: Forza Mehlano <forzamehlano@gmail.com>
To: common-dev@hadoop.apache.org
Content-Type: multipart/alternative; boundary=f46d042dffb908615c04b9bd333d
--f46d042dffb908615c04b9bd333d
Content-Type: text/plain; charset=ISO-8859-1
Hi,
I'm trying to get involved and contribute to hadoop and have started by
following various guides:
http://wiki.apache.org/hadoop/HowToContribute
http://wiki.apache.org/hadoop/QwertyManiac/BuildingHadoopTrunk
I have (to the best of my knowledge) a decent build environment (the
*requirement* to have ant 1.7.1 installed could be made a little more
visible on the "HowToContribute" page as it would have saved me a lot of
time).
I'm now down to one test failure:
[junit] Test org.apache.hadoop.metrics2.impl.TestGangliaMetrics FAILED
Testsuite: org.apache.hadoop.metrics2.impl.TestGangliaMetrics
Tests run: 1, Failures: 1, Errors: 0, Time elapsed: 0.225 sec
------------- Standard Output ---------------
2012-02-23 01:19:46,432 INFO impl.MetricsConfig
(MetricsConfig.java:loadFirst(99)) - loaded properties from
hadoop-metrics2-test.properties
2012-02-23 01:19:46,453 INFO impl.MetricsSourceAdapter
(MetricsSourceAdapter.java:start(90)) - MBean for source
MetricsSystem,sub=Stats registered.
2012-02-23 01:19:46,463 INFO impl.MetricsSystemImpl
(MetricsSystemImpl.java:startTimer(303)) - Scheduled snapshot period at 10
second(s).
2012-02-23 01:19:46,463 INFO impl.MetricsSystemImpl
(MetricsSystemImpl.java:start(155)) - Test metrics system started
2012-02-23 01:19:46,468 INFO impl.MetricsSourceAdapter
(MetricsSourceAdapter.java:start(90)) - MBean for source s1 registered.
2012-02-23 01:19:46,487 INFO impl.MetricsSinkAdapter
(MetricsSinkAdapter.java:start(175)) - Sink gsink30 started
2012-02-23 01:19:46,488 INFO impl.MetricsSinkAdapter
(MetricsSinkAdapter.java:start(175)) - Sink gsink31 started
2012-02-23 01:19:46,494 INFO impl.MetricsSystemImpl
(MetricsSystemImpl.java:stop(167)) - Stopping Test metrics system...
2012-02-23 01:19:46,495 INFO impl.MetricsSystemImpl
(MetricsSystemImpl.java:stopSources(368)) - Stopping metrics source
s1(org.apache.hadoop.metrics2.impl.TestGangliaMetrics$TestSource)
2012-02-23 01:19:46,495 INFO impl.MetricsSystemImpl
(MetricsSystemImpl.java:stopSinks(379)) - Stopping metrics sink
gsink30(org.apache.hadoop.metrics2.sink.ganglia.GangliaSink30)
2012-02-23 01:19:46,497 INFO impl.MetricsSystemImpl
(MetricsSystemImpl.java:stopSinks(379)) - Stopping metrics sink
gsink31(org.apache.hadoop.metrics2.sink.ganglia.GangliaSink31)
2012-02-23 01:19:46,498 INFO impl.MetricsSystemImpl
(MetricsSystemImpl.java:stop(173)) - Test metrics system stopped.
------------- ---------------- ---------------
Testcase: testGangliaMetrics2 took 0.207 sec
FAILED
Missing metrics: test.s1rec.c1
junit.framework.AssertionFailedError: Missing metrics: test.s1rec.c1
at
org.apache.hadoop.metrics2.impl.TestGangliaMetrics.checkMetrics(TestGangliaMetrics.java:98)
at
org.apache.hadoop.metrics2.impl.TestGangliaMetrics.testGangliaMetrics2(TestGangliaMetrics.java:77)
Any ideas?
Looking through the mailing lists, I'm not the only one with this
particular failure but I've not seen a resolution.
I've submitted a patch for MAPREDUCE-3807 even though I get this one
failure as I get it with or without my patch applied.
*Anyone that can take a look at that patch would be an absolute hero as
it's my first and I'm eager for some feedback
Thanks
F_M
http://hadoopadmin.blogspot.com/
--f46d042dffb908615c04b9bd333d--
From common-dev-return-77849-apmail-hadoop-common-dev-archive=hadoop.apache.org@hadoop.apache.org Sat Feb 25 06:20:22 2012
Return-Path: <common-dev-return-77849-apmail-hadoop-common-dev-archive=hadoop.apache.org@hadoop.apache.org>
X-Original-To: apmail-hadoop-common-dev-archive@www.apache.org
Delivered-To: apmail-hadoop-common-dev-archive@www.apache.org
Received: from mail.apache.org (hermes.apache.org [140.211.11.3])
by minotaur.apache.org (Postfix) with SMTP id E156690B2
for <apmail-hadoop-common-dev-archive@www.apache.org>; Sat, 25 Feb 2012 06:20:22 +0000 (UTC)
Received: (qmail 25617 invoked by uid 500); 25 Feb 2012 06:20:21 -0000
Delivered-To: apmail-hadoop-common-dev-archive@hadoop.apache.org
Received: (qmail 24957 invoked by uid 500); 25 Feb 2012 06:20:10 -0000
Mailing-List: contact common-dev-help@hadoop.apache.org; run by ezmlm
Precedence: bulk
List-Help: <mailto:common-dev-help@hadoop.apache.org>
List-Unsubscribe: <mailto:common-dev-unsubscribe@hadoop.apache.org>
List-Post: <mailto:common-dev@hadoop.apache.org>
List-Id: <common-dev.hadoop.apache.org>
Reply-To: common-dev@hadoop.apache.org
Delivered-To: mailing list common-dev@hadoop.apache.org
Received: (qmail 24871 invoked by uid 99); 25 Feb 2012 06:20:07 -0000
Received: from athena.apache.org (HELO athena.apache.org) (140.211.11.136)
by apache.org (qpsmtpd/0.29) with ESMTP; Sat, 25 Feb 2012 06:20:07 +0000
X-ASF-Spam-Status: No, hits=-2000.0 required=5.0
tests=ALL_TRUSTED,T_RP_MATCHES_RCVD
X-Spam-Check-By: apache.org
Received: from [140.211.11.116] (HELO hel.zones.apache.org) (140.211.11.116)
by apache.org (qpsmtpd/0.29) with ESMTP; Sat, 25 Feb 2012 06:20:06 +0000
Received: from hel.zones.apache.org (hel.zones.apache.org [140.211.11.116])
by hel.zones.apache.org (Postfix) with ESMTP id 2D17E339B8C
for <common-dev@hadoop.apache.org>; Sat, 25 Feb 2012 06:19:46 +0000 (UTC)
Date: Sat, 25 Feb 2012 06:19:46 +0000 (UTC)
From: "Shingo Furuyama (Created) (JIRA)" <jira@apache.org>
To: common-dev@hadoop.apache.org
Message-ID: <1684367309.19118.1330150786186.JavaMail.tomcat@hel.zones.apache.org>
Subject: [jira] [Created] (HADOOP-8112) Add new test class to
org.apache.hadoop.ipc.Client
MIME-Version: 1.0
Content-Type: text/plain; charset=utf-8
Content-Transfer-Encoding: 7bit
X-JIRA-FingerPrint: 30527f35849b9dde25b450d4833f0394
Add new test class to org.apache.hadoop.ipc.Client
--------------------------------------------------
Key: HADOOP-8112
URL: https://issues.apache.org/jira/browse/HADOOP-8112
Project: Hadoop Common
Issue Type: Test
Components: ipc
Affects Versions: 0.23.0
Reporter: Shingo Furuyama
Test class of org.apache.hadoop.ipc.Client dose not exists.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
From common-dev-return-77850-apmail-hadoop-common-dev-archive=hadoop.apache.org@hadoop.apache.org Sat Feb 25 09:30:42 2012
Return-Path: <common-dev-return-77850-apmail-hadoop-common-dev-archive=hadoop.apache.org@hadoop.apache.org>
X-Original-To: apmail-hadoop-common-dev-archive@www.apache.org
Delivered-To: apmail-hadoop-common-dev-archive@www.apache.org
Received: from mail.apache.org (hermes.apache.org [140.211.11.3])
by minotaur.apache.org (Postfix) with SMTP id B2417926A
for <apmail-hadoop-common-dev-archive@www.apache.org>; Sat, 25 Feb 2012 09:30:42 +0000 (UTC)
Received: (qmail 39771 invoked by uid 500); 25 Feb 2012 09:30:41 -0000
Delivered-To: apmail-hadoop-common-dev-archive@hadoop.apache.org
Received: (qmail 39652 invoked by uid 500); 25 Feb 2012 09:30:40 -0000
Mailing-List: contact common-dev-help@hadoop.apache.org; run by ezmlm
Precedence: bulk
List-Help: <mailto:common-dev-help@hadoop.apache.org>
List-Unsubscribe: <mailto:common-dev-unsubscribe@hadoop.apache.org>
List-Post: <mailto:common-dev@hadoop.apache.org>
List-Id: <common-dev.hadoop.apache.org>
Reply-To: common-dev@hadoop.apache.org
Delivered-To: mailing list common-dev@hadoop.apache.org
Received: (qmail 39643 invoked by uid 99); 25 Feb 2012 09:30:40 -0000
Received: from athena.apache.org (HELO athena.apache.org) (140.211.11.136)
by apache.org (qpsmtpd/0.29) with ESMTP; Sat, 25 Feb 2012 09:30:40 +0000
X-ASF-Spam-Status: No, hits=-2000.0 required=5.0
tests=ALL_TRUSTED
X-Spam-Check-By: apache.org
Received: from [140.211.11.8] (HELO aegis.apache.org) (140.211.11.8)
by apache.org (qpsmtpd/0.29) with ESMTP; Sat, 25 Feb 2012 09:30:38 +0000
Received: from aegis (localhost [127.0.0.1])
by aegis.apache.org (Postfix) with ESMTP id 2061FC00A0
for <common-dev@hadoop.apache.org>; Sat, 25 Feb 2012 09:30:18 +0000 (UTC)
Date: Sat, 25 Feb 2012 09:30:18 +0000 (UTC)
From: Apache Jenkins Server <jenkins@builds.apache.org>
To: common-dev@hadoop.apache.org
Message-ID: <1416525504.1121330162218123.JavaMail.hudson@aegis>
In-Reply-To: <2109105538.3911330075310481.JavaMail.hudson@aegis>
References: <2109105538.3911330075310481.JavaMail.hudson@aegis>
Subject: Build failed in Jenkins: Hadoop-Common-0.23-Build #174
MIME-Version: 1.0
Content-Type: text/plain; charset=UTF-8
Content-Transfer-Encoding: 7bit
X-Jenkins-Job: Hadoop-Common-0.23-Build
X-Jenkins-Result: FAILURE
See <https://builds.apache.org/job/Hadoop-Common-0.23-Build/174/changes>
Changes:
[vinodkv] MAPREDUCE-2793. Reneabling commented out test from previous commit.
svn merge --ignore-ancestry -c 1293521 ../../trunk
[vinodkv] MAPREDUCE-2793. Corrected AppIDs, JobIDs, TaskAttemptIDs to be of correct format on the web pages. Contributed by Bikas Saha.
svn merge --ignore-ancestry -c 1293517 ../../trunk
[acmurthy] Moving branch-0.23 to version 0.23.3-SNAPSHOT
[acmurthy] Preparing for 0.23.3 release.
[szetszwo] svn merge -c 1293487 from trunk for HDFS-3006.
[bobby] svn merge -c 1293469 trunk ot branch-0.23 FIXES MAPREDUCE-3918 proc_historyserver no longer in command line arguments for HistoryServer (Jon Eagles via bobby)
[tgraves] merege -r 1293455:1293456 from trunk. FIXES: MAPREDUCE-3904
[vinodkv] MAPREDUCE-3730. Modified RM to allow restarted NMs to be able to join the cluster without waiting for expiry. Contributed by Jason Lowe.
svn merge --ignore-ancestry -c 1293436 ../../trunk
[vinodkv] MAPREDUCE-3866. Fixed the bin/yarn script to not print the command line unnecessarily. (vinodkv)
svn merge --ignore-ancestry -c 1293425 ../../trunk
[eli] HDFS-3008. svn merge -c 1293419 from trunk
------------------------------------------
[...truncated 204614 lines...]
7 KB 7 KB 42 KB
7 KB 7 KB 42 KB
8 KB 7 KB 42 KB
8 KB 7 KB 42 KB
9 KB 7 KB 42 KB
10 KB 7 KB 42 KB
10 KB 7 KB 42 KB
11 KB 7 KB 42 KB
11 KB 7 KB 42 KB
12 KB 7 KB 42 KB
12 KB 7 KB 42 KB
13 KB 7 KB 42 KB
13 KB 7 KB 42 KB
14 KB 7 KB 42 KB
14 KB 7 KB 42 KB
15 KB 7 KB 42 KB
15 KB 7 KB 42 KB
16 KB 7 KB 42 KB
16 KB 7 KB 42 KB
17 KB 7 KB 42 KB
17 KB 7 KB 42 KB
18 KB 7 KB 42 KB
18 KB 7 KB 42 KB
18 KB 7 KB 42 KB
19 KB 7 KB 42 KB
19 KB 7 KB 42 KB
20 KB 7 KB 42 KB
20 KB 7 KB 42 KB
21 KB 7 KB 42 KB
21 KB 7 KB 42 KB
22 KB 7 KB 42 KB
22 KB 7 KB 42 KB
23 KB 7 KB 42 KB
23 KB 7 KB 42 KB
24 KB 7 KB 42 KB
25 KB 7 KB 42 KB
25 KB 7 KB 42 KB
26 KB 7 KB 42 KB
26 KB 7 KB 42 KB
27 KB 7 KB 42 KB
27 KB 7 KB 42 KB
28 KB 7 KB 42 KB
29 KB 7 KB 42 KB
29 KB 7 KB 42 KB
30 KB 7 KB 42 KB
30 KB 7 KB 42 KB
30 KB 7 KB 42 KB
31 KB 7 KB 42 KB
31 KB 7 KB 42 KB
32 KB 7 KB 42 KB
32 KB 7 KB 42 KB
33 KB 7 KB 42 KB
33 KB 7 KB 42 KB
34 KB 7 KB 42 KB
35 KB 7 KB 42 KB
35 KB 7 KB 42 KB
36 KB 7 KB 42 KB
36 KB 7 KB 42 KB
37 KB 7 KB 42 KB
37 KB 7 KB 42 KB
38 KB 7 KB 42 KB
39 KB 7 KB 42 KB
39 KB 7 KB 42 KB
40 KB 7 KB 42 KB
40 KB 7 KB 42 KB
41 KB 7 KB 42 KB
41 KB 7 KB 42 KB
42 KB 7 KB 42 KB
42 KB 7 KB 42 KB
43 KB 7 KB 42 KB
43 KB 7 KB 42 KB
45 KB 7 KB 42 KB
49 KB 7 KB 42 KB
50 KB 7 KB 42 KB
50 KB 7 KB 42 KB 848 B
50 KB 7 KB 42 KB 2 KB
50 KB 7 KB 42 KB 2 KB
50 KB 7 KB 42 KB 3 KB
50 KB 7 KB 42 KB 3 KB
50 KB 7 KB 42 KB 4 KB
50 KB 7 KB 42 KB 4 KB
50 KB 7 KB 42 KB 5 KB
50 KB 7 KB 42 KB 5 KB
50 KB 7 KB 42 KB 6 KB
50 KB 7 KB 42 KB 6 KB
50 KB 7 KB 42 KB 7 KB
50 KB 7 KB 42 KB 7 KB
50 KB 7 KB 42 KB 8 KB
50 KB 7 KB 42 KB 8 KB
50 KB 7 KB 42 KB 9 KB
50 KB 7 KB 42 KB 9 KB
50 KB 7 KB 42 KB 10 KB
50 KB 7 KB 42 KB 10 KB
50 KB 7 KB 42 KB 11 KB
50 KB 7 KB 42 KB 11 KB
50 KB 7 KB 42 KB 12 KB
50 KB 7 KB 42 KB 12 KB
50 KB 7 KB 42 KB 13 KB
50 KB 7 KB 42 KB 13 KB
50 KB 7 KB 42 KB 14 KB
50 KB 7 KB 42 KB 14 KB
50 KB 7 KB 42 KB 15 KB
50 KB 7 KB 42 KB 15 KB
50 KB 7 KB 42 KB 16 KB
50 KB 7 KB 42 KB 16 KB
50 KB 7 KB 42 KB 17 KB
50 KB 7 KB 42 KB 17 KB
50 KB 7 KB 42 KB 18 KB
50 KB 7 KB 42 KB 19 KB
50 KB 7 KB 42 KB 19 KB
50 KB 7 KB 42 KB 20 KB
50 KB 7 KB 42 KB 20 KB
50 KB 7 KB 42 KB 21 KB
50 KB 7 KB 42 KB 23 KB
Downloaded: http://repo1.maven.org/maven2/org/apache/maven/shared/maven-filtering/1.0/maven-filtering-1.0.jar (42 KB at 18.6 KB/sec)
Downloaded: http://repo1.maven.org/maven2/org/sonatype/plexus/plexus-build-api/0.0.4/plexus-build-api-0.0.4.jar (7 KB at 2.9 KB/sec)
Downloaded: http://repo1.maven.org/maven2/org/codehaus/plexus/plexus-io/1.0.1/plexus-io-1.0.1.jar (50 KB at 21.9 KB/sec)
Downloaded: http://repo1.maven.org/maven2/org/apache/maven/shared/maven-repository-builder/1.0-alpha-2/maven-repository-builder-1.0-alpha-2.jar (23 KB at 10.0 KB/sec)
[WARNING] The following patterns were never triggered in this artifact exclusion filter:
o 'org.apache.ant:*:jar'
o 'jdiff:jdiff:jar'
[INFO] share/hadoop/common/jdiff/ already added, skipping
[INFO] Copying files to <https://builds.apache.org/job/Hadoop-Common-0.23-Build/ws/trunk/hadoop-common-project/hadoop-common/target/hadoop-common-0.23.3-SNAPSHOT>
[INFO] share/hadoop/common/jdiff/ already added, skipping
[INFO]
[INFO] --- maven-jar-plugin:2.3.1:jar (default-jar) @ hadoop-common ---
[INFO]
[INFO] --- maven-source-plugin:2.1.2:jar-no-fork (hadoop-java-sources) @ hadoop-common ---
[INFO] org already added, skipping
[INFO] org/apache already added, skipping
[INFO] org/apache/hadoop already added, skipping
[INFO] Building jar: <https://builds.apache.org/job/Hadoop-Common-0.23-Build/ws/trunk/hadoop-common-project/hadoop-common/target/hadoop-common-0.23.3-SNAPSHOT-sources.jar>
[INFO] org already added, skipping
[INFO] org/apache already added, skipping
[INFO] org/apache/hadoop already added, skipping
[WARNING] Artifact org.apache.hadoop:hadoop-common:java-source:sources:0.23.3-SNAPSHOT already attached to project, ignoring duplicate
[INFO]
[INFO] --- maven-site-plugin:3.0:attach-descriptor (attach-descriptor) @ hadoop-common ---
[INFO]
[INFO] --- maven-antrun-plugin:1.6:run (tar) @ hadoop-common ---
[INFO] Executing tasks
main:
[INFO] Executed tasks
[INFO]
[INFO] --- maven-javadoc-plugin:2.8.1:jar (module-javadocs) @ hadoop-common ---
[INFO]
ExcludePrivateAnnotationsStandardDoclet
9 warnings
[WARNING] Javadoc Warnings
[WARNING] <https://builds.apache.org/job/Hadoop-Common-0.23-Build/ws/trunk/hadoop-common-project/hadoop-common/src/main/java/org/apache/hadoop/security/SecurityUtil.java>:49: warning: sun.net.dns.ResolverConfiguration is Sun proprietary API and may be removed in a future release
[WARNING] import sun.net.dns.ResolverConfiguration;
[WARNING] ^
[WARNING] <https://builds.apache.org/job/Hadoop-Common-0.23-Build/ws/trunk/hadoop-common-project/hadoop-common/src/main/java/org/apache/hadoop/security/SecurityUtil.java>:50: warning: sun.net.util.IPAddressUtil is Sun proprietary API and may be removed in a future release
[WARNING] import sun.net.util.IPAddressUtil;
[WARNING] ^
[WARNING] <https://builds.apache.org/job/Hadoop-Common-0.23-Build/ws/trunk/hadoop-common-project/hadoop-common/src/main/java/org/apache/hadoop/security/SecurityUtil.java>:51: warning: sun.security.jgss.krb5.Krb5Util is Sun proprietary API and may be removed in a future release
[WARNING] import sun.security.jgss.krb5.Krb5Util;
[WARNING] ^
[WARNING] <https://builds.apache.org/job/Hadoop-Common-0.23-Build/ws/trunk/hadoop-common-project/hadoop-common/src/main/java/org/apache/hadoop/security/SecurityUtil.java>:52: warning: sun.security.krb5.Credentials is Sun proprietary API and may be removed in a future release
[WARNING] import sun.security.krb5.Credentials;
[WARNING] ^
[WARNING] <https://builds.apache.org/job/Hadoop-Common-0.23-Build/ws/trunk/hadoop-common-project/hadoop-common/src/main/java/org/apache/hadoop/security/SecurityUtil.java>:53: warning: sun.security.krb5.PrincipalName is Sun proprietary API and may be removed in a future release
[WARNING] import sun.security.krb5.PrincipalName;
[WARNING] ^
[WARNING] <https://builds.apache.org/job/Hadoop-Common-0.23-Build/ws/trunk/hadoop-common-project/hadoop-common/src/main/java/org/apache/hadoop/security/HadoopKerberosName.java>:28: warning: sun.security.krb5.Config is Sun proprietary API and may be removed in a future release
[WARNING] import sun.security.krb5.Config;
[WARNING] ^
[WARNING] <https://builds.apache.org/job/Hadoop-Common-0.23-Build/ws/trunk/hadoop-common-project/hadoop-common/src/main/java/org/apache/hadoop/security/HadoopKerberosName.java>:29: warning: sun.security.krb5.KrbException is Sun proprietary API and may be removed in a future release
[WARNING] import sun.security.krb5.KrbException;
[WARNING] ^
[WARNING] <https://builds.apache.org/job/Hadoop-Common-0.23-Build/ws/trunk/hadoop-common-project/hadoop-common/src/main/java/org/apache/hadoop/io/FastByteComparisons.java>:25: warning: sun.misc.Unsafe is Sun proprietary API and may be removed in a future release
[WARNING] import sun.misc.Unsafe;
[WARNING] ^
[WARNING] <https://builds.apache.org/job/Hadoop-Common-0.23-Build/ws/trunk/hadoop-common-project/hadoop-common/src/main/java/org/apache/hadoop/io/FastByteComparisons.java>:117: warning: sun.misc.Unsafe is Sun proprietary API and may be removed in a future release
[WARNING] static final Unsafe theUnsafe;
[WARNING] ^
[INFO] Building jar: <https://builds.apache.org/job/Hadoop-Common-0.23-Build/ws/trunk/hadoop-common-project/hadoop-common/target/hadoop-common-0.23.3-SNAPSHOT-javadoc.jar>
[INFO]
[INFO] --- maven-checkstyle-plugin:2.6:checkstyle (default-cli) @ hadoop-common ---
[INFO]
[INFO] There are 8472 checkstyle errors.
[WARNING] Unable to locate Source XRef to link to - DISABLED
[INFO]
[INFO] --- findbugs-maven-plugin:2.3.2:findbugs (default-cli) @ hadoop-common ---
[INFO] ****** FindBugsMojo execute *******
[INFO] canGenerate is true
[INFO] ****** FindBugsMojo executeFindbugs *******
[INFO] Temp File is <https://builds.apache.org/job/Hadoop-Common-0.23-Build/ws/trunk/hadoop-common-project/hadoop-common/target/findbugsTemp.xml>
[INFO] Fork Value is true
[java] The following classes needed for analysis were missing:
[java] org.codehaus.jackson.FormatSchema
[java] org.codehaus.jackson.format.InputAccessor
[java] Missing classes: 1
[INFO] xmlOutput is false
[INFO]
[INFO] ------------------------------------------------------------------------
[INFO] Building Apache Hadoop Common Project 0.23.3-SNAPSHOT
[INFO] ------------------------------------------------------------------------
[INFO]
[INFO] --- maven-clean-plugin:2.4.1:clean (default-clean) @ hadoop-common-project ---
[INFO] Deleting <https://builds.apache.org/job/Hadoop-Common-0.23-Build/ws/trunk/hadoop-common-project/target>
[INFO]
[INFO] --- maven-antrun-plugin:1.6:run (create-testdirs) @ hadoop-common-project ---
[INFO] Executing tasks
main:
[mkdir] Created dir: <https://builds.apache.org/job/Hadoop-Common-0.23-Build/ws/trunk/hadoop-common-project/target/test-dir>
[INFO] Executed tasks
[INFO]
[INFO] --- maven-source-plugin:2.1.2:jar-no-fork (hadoop-java-sources) @ hadoop-common-project ---
[INFO]
[INFO] --- maven-site-plugin:3.0:attach-descriptor (attach-descriptor) @ hadoop-common-project ---
[INFO]
[INFO] --- maven-javadoc-plugin:2.8.1:jar (module-javadocs) @ hadoop-common-project ---
[INFO] Not executing Javadoc as the project is not a Java classpath-capable package
[INFO]
[INFO] --- maven-checkstyle-plugin:2.6:checkstyle (default-cli) @ hadoop-common-project ---
[INFO]
[INFO] --- findbugs-maven-plugin:2.3.2:findbugs (default-cli) @ hadoop-common-project ---
[INFO] ****** FindBugsMojo execute *******
[INFO] canGenerate is false
[INFO] ------------------------------------------------------------------------
[INFO] Reactor Summary:
[INFO]
[INFO] Apache Hadoop Annotations ......................... SUCCESS [1:31.457s]
[INFO] Apache Hadoop Auth ................................ SUCCESS [1:05.647s]
[INFO] Apache Hadoop Auth Examples ....................... SUCCESS [7.523s]
[INFO] Apache Hadoop Common .............................. SUCCESS [4:32.420s]
[INFO] Apache Hadoop Common Project ...................... SUCCESS [0.032s]
[INFO] ------------------------------------------------------------------------
[INFO] BUILD SUCCESS
[INFO] ------------------------------------------------------------------------
[INFO] Total time: 7:28.916s
[INFO] Finished at: Sat Feb 25 09:20:49 UTC 2012
[INFO] Final Memory: 81M/784M
[INFO] ------------------------------------------------------------------------
+ /home/jenkins/tools/maven/latest/bin/mvn test -Pclover -DcloverLicenseLocation=/home/jenkins/tools/clover/latest/lib/clover.license
Build step 'Execute shell' marked build as failure
[WARNINGS] Skipping publisher since build result is FAILURE
Archiving artifacts
Recording fingerprints
Publishing Javadoc
Recording test results
From common-dev-return-77851-apmail-hadoop-common-dev-archive=hadoop.apache.org@hadoop.apache.org Sat Feb 25 09:47:14 2012
Return-Path: <common-dev-return-77851-apmail-hadoop-common-dev-archive=hadoop.apache.org@hadoop.apache.org>
X-Original-To: apmail-hadoop-common-dev-archive@www.apache.org
Delivered-To: apmail-hadoop-common-dev-archive@www.apache.org
Received: from mail.apache.org (hermes.apache.org [140.211.11.3])
by minotaur.apache.org (Postfix) with SMTP id 15B74958A
for <apmail-hadoop-common-dev-archive@www.apache.org>; Sat, 25 Feb 2012 09:47:14 +0000 (UTC)
Received: (qmail 69847 invoked by uid 500); 25 Feb 2012 09:47:12 -0000
Delivered-To: apmail-hadoop-common-dev-archive@hadoop.apache.org
Received: (qmail 69779 invoked by uid 500); 25 Feb 2012 09:47:12 -0000
Mailing-List: contact common-dev-help@hadoop.apache.org; run by ezmlm
Precedence: bulk
List-Help: <mailto:common-dev-help@hadoop.apache.org>
List-Unsubscribe: <mailto:common-dev-unsubscribe@hadoop.apache.org>
List-Post: <mailto:common-dev@hadoop.apache.org>
List-Id: <common-dev.hadoop.apache.org>
Reply-To: common-dev@hadoop.apache.org
Delivered-To: mailing list common-dev@hadoop.apache.org
Received: (qmail 69770 invoked by uid 99); 25 Feb 2012 09:47:12 -0000
Received: from nike.apache.org (HELO nike.apache.org) (192.87.106.230)
by apache.org (qpsmtpd/0.29) with ESMTP; Sat, 25 Feb 2012 09:47:12 +0000
X-ASF-Spam-Status: No, hits=-2000.0 required=5.0
tests=ALL_TRUSTED
X-Spam-Check-By: apache.org
Received: from [140.211.11.8] (HELO aegis.apache.org) (140.211.11.8)
by apache.org (qpsmtpd/0.29) with ESMTP; Sat, 25 Feb 2012 09:47:10 +0000
Received: from aegis (localhost [127.0.0.1])
by aegis.apache.org (Postfix) with ESMTP id 4E9F6C00A0
for <common-dev@hadoop.apache.org>; Sat, 25 Feb 2012 09:46:49 +0000 (UTC)
Date: Sat, 25 Feb 2012 09:46:49 +0000 (UTC)
From: Apache Jenkins Server <jenkins@builds.apache.org>
To: common-dev@hadoop.apache.org
Message-ID: <486379129.1151330163209306.JavaMail.hudson@aegis>
In-Reply-To: <256402514.3921330075760102.JavaMail.hudson@aegis>
References: <256402514.3921330075760102.JavaMail.hudson@aegis>
Subject: Jenkins build is back to normal : Hadoop-Common-0.23-PB-Build #3
MIME-Version: 1.0
Content-Type: text/plain; charset=UTF-8
Content-Transfer-Encoding: 7bit
X-Jenkins-Job: Hadoop-Common-0.23-PB-Build
X-Jenkins-Result: SUCCESS
X-Virus-Checked: Checked by ClamAV on apache.org
See <https://builds.apache.org/job/Hadoop-Common-0.23-PB-Build/3/changes>
From common-dev-return-77852-apmail-hadoop-common-dev-archive=hadoop.apache.org@hadoop.apache.org Sat Feb 25 09:55:00 2012
Return-Path: <common-dev-return-77852-apmail-hadoop-common-dev-archive=hadoop.apache.org@hadoop.apache.org>
X-Original-To: apmail-hadoop-common-dev-archive@www.apache.org
Delivered-To: apmail-hadoop-common-dev-archive@www.apache.org
Received: from mail.apache.org (hermes.apache.org [140.211.11.3])
by minotaur.apache.org (Postfix) with SMTP id C68AB97B9
for <apmail-hadoop-common-dev-archive@www.apache.org>; Sat, 25 Feb 2012 09:55:00 +0000 (UTC)
Received: (qmail 86785 invoked by uid 500); 25 Feb 2012 09:54:59 -0000
Delivered-To: apmail-hadoop-common-dev-archive@hadoop.apache.org
Received: (qmail 86690 invoked by uid 500); 25 Feb 2012 09:54:59 -0000
Mailing-List: contact common-dev-help@hadoop.apache.org; run by ezmlm
Precedence: bulk
List-Help: <mailto:common-dev-help@hadoop.apache.org>
List-Unsubscribe: <mailto:common-dev-unsubscribe@hadoop.apache.org>
List-Post: <mailto:common-dev@hadoop.apache.org>
List-Id: <common-dev.hadoop.apache.org>
Reply-To: common-dev@hadoop.apache.org
Delivered-To: mailing list common-dev@hadoop.apache.org
Received: (qmail 86677 invoked by uid 99); 25 Feb 2012 09:54:59 -0000
Received: from athena.apache.org (HELO athena.apache.org) (140.211.11.136)
by apache.org (qpsmtpd/0.29) with ESMTP; Sat, 25 Feb 2012 09:54:59 +0000
X-ASF-Spam-Status: No, hits=-2000.0 required=5.0
tests=ALL_TRUSTED
X-Spam-Check-By: apache.org
Received: from [140.211.11.8] (HELO aegis.apache.org) (140.211.11.8)
by apache.org (qpsmtpd/0.29) with ESMTP; Sat, 25 Feb 2012 09:54:58 +0000
Received: from aegis (localhost [127.0.0.1])
by aegis.apache.org (Postfix) with ESMTP id 03FBFC00A0
for <common-dev@hadoop.apache.org>; Sat, 25 Feb 2012 09:54:38 +0000 (UTC)
Date: Sat, 25 Feb 2012 09:54:37 +0000 (UTC)
From: Apache Jenkins Server <jenkins@builds.apache.org>
To: common-dev@hadoop.apache.org
Message-ID: <185290090.1171330163678000.JavaMail.hudson@aegis>
In-Reply-To: <1869587314.3931330075823863.JavaMail.hudson@aegis>
References: <1869587314.3931330075823863.JavaMail.hudson@aegis>
Subject: Jenkins build is back to normal : Hadoop-Common-trunk #328
MIME-Version: 1.0
Content-Type: text/plain; charset=UTF-8
Content-Transfer-Encoding: 7bit
X-Jenkins-Job: Hadoop-Common-trunk
X-Jenkins-Result: SUCCESS
See <https://builds.apache.org/job/Hadoop-Common-trunk/328/changes>
From common-dev-return-77853-apmail-hadoop-common-dev-archive=hadoop.apache.org@hadoop.apache.org Sun Feb 26 09:20:20 2012
Return-Path: <common-dev-return-77853-apmail-hadoop-common-dev-archive=hadoop.apache.org@hadoop.apache.org>
X-Original-To: apmail-hadoop-common-dev-archive@www.apache.org
Delivered-To: apmail-hadoop-common-dev-archive@www.apache.org
Received: from mail.apache.org (hermes.apache.org [140.211.11.3])
by minotaur.apache.org (Postfix) with SMTP id B26049B78
for <apmail-hadoop-common-dev-archive@www.apache.org>; Sun, 26 Feb 2012 09:20:20 +0000 (UTC)
Received: (qmail 75634 invoked by uid 500); 26 Feb 2012 09:20:18 -0000
Delivered-To: apmail-hadoop-common-dev-archive@hadoop.apache.org
Received: (qmail 75280 invoked by uid 500); 26 Feb 2012 09:20:10 -0000
Mailing-List: contact common-dev-help@hadoop.apache.org; run by ezmlm
Precedence: bulk
List-Help: <mailto:common-dev-help@hadoop.apache.org>
List-Unsubscribe: <mailto:common-dev-unsubscribe@hadoop.apache.org>
List-Post: <mailto:common-dev@hadoop.apache.org>
List-Id: <common-dev.hadoop.apache.org>
Reply-To: common-dev@hadoop.apache.org
Delivered-To: mailing list common-dev@hadoop.apache.org
Received: (qmail 75196 invoked by uid 99); 26 Feb 2012 09:20:07 -0000
Received: from athena.apache.org (HELO athena.apache.org) (140.211.11.136)
by apache.org (qpsmtpd/0.29) with ESMTP; Sun, 26 Feb 2012 09:20:07 +0000
X-ASF-Spam-Status: No, hits=-2000.0 required=5.0
tests=ALL_TRUSTED
X-Spam-Check-By: apache.org
Received: from [140.211.11.8] (HELO aegis.apache.org) (140.211.11.8)
by apache.org (qpsmtpd/0.29) with ESMTP; Sun, 26 Feb 2012 09:20:05 +0000
Received: from aegis (localhost [127.0.0.1])
by aegis.apache.org (Postfix) with ESMTP id 12B04C00A0
for <common-dev@hadoop.apache.org>; Sun, 26 Feb 2012 09:19:45 +0000 (UTC)
Date: Sun, 26 Feb 2012 09:19:44 +0000 (UTC)
From: Apache Jenkins Server <jenkins@builds.apache.org>
To: common-dev@hadoop.apache.org
Message-ID: <355028509.711330247985059.JavaMail.hudson@aegis>
Subject: Build failed in Jenkins: Hadoop-Common-trunk #329
MIME-Version: 1.0
Content-Type: text/plain; charset=UTF-8
Content-Transfer-Encoding: quoted-printable
X-Jenkins-Job: Hadoop-Common-trunk
X-Jenkins-Result: FAILURE
See <https://builds.apache.org/job/Hadoop-Common-trunk/329/changes>
Changes:
[vinodkv] MAPREDUCE-3686. Fixed two bugs in Counters because of which web a=
pp displays zero counter values for framework counters. Contributed by Bhal=
lamudi Venkata Siva Kamesh.
[vinodkv] MAPREDUCE-3910. Fixed a bug in CapacityScheduler LeafQueue which =
was causing app-submission to fail. Contributed by John George.
[atm] HDFS-2978. The NameNode should expose name dir statuses via JMX. Cont=
ributed by Aaron T. Myers.
------------------------------------------
[...truncated 43916 lines...]
[DEBUG] (f) reactorProjects =3D [MavenProject: org.apache.hadoop:hadoop-a=
nnotations:0.24.0-SNAPSHOT @ <https://builds.apache.org/job/Hadoop-Common-t=
runk/ws/trunk/hadoop-common-project/hadoop-annotations/pom.xml,> MavenProje=
ct: org.apache.hadoop:hadoop-auth:0.24.0-SNAPSHOT @ <https://builds.apache.=
org/job/Hadoop-Common-trunk/ws/trunk/hadoop-common-project/hadoop-auth/pom.=
xml,> MavenProject: org.apache.hadoop:hadoop-auth-examples:0.24.0-SNAPSHOT =
@ <https://builds.apache.org/job/Hadoop-Common-trunk/ws/trunk/hadoop-common=
-project/hadoop-auth-examples/pom.xml,> MavenProject: org.apache.hadoop:had=
oop-common:0.24.0-SNAPSHOT @ <https://builds.apache.org/job/Hadoop-Common-t=
runk/ws/trunk/hadoop-common-project/hadoop-common/pom.xml,> MavenProject: o=
rg.apache.hadoop:hadoop-common-project:0.24.0-SNAPSHOT @ <https://builds.ap=
ache.org/job/Hadoop-Common-trunk/ws/trunk/hadoop-common-project/pom.xml]>
[DEBUG] (f) useDefaultExcludes =3D true
[DEBUG] (f) useDefaultManifestFile =3D false
[DEBUG] -- end configuration --
[INFO]=20
[INFO] --- maven-enforcer-plugin:1.0:enforce (dist-enforce) @ hadoop-common=
-project ---
[DEBUG] Configuring mojo org.apache.maven.plugins:maven-enforcer-plugin:1.0=
:enforce from plugin realm ClassRealm[plugin>org.apache.maven.plugins:maven=
-enforcer-plugin:1.0, parent: sun.misc.Launcher$AppClassLoader@6b97fd]
[DEBUG] Configuring mojo 'org.apache.maven.plugins:maven-enforcer-plugin:1.=
0:enforce' with basic configurator -->
[DEBUG] (s) fail =3D true
[DEBUG] (s) failFast =3D false
[DEBUG] (f) ignoreCache =3D false
[DEBUG] (s) project =3D MavenProject: org.apache.hadoop:hadoop-common-pro=
ject:0.24.0-SNAPSHOT @ <https://builds.apache.org/job/Hadoop-Common-trunk/w=
s/trunk/hadoop-common-project/pom.xml>
[DEBUG] (s) version =3D [3.0.2,)
[DEBUG] (s) version =3D 1.6
[DEBUG] (s) rules =3D [org.apache.maven.plugins.enforcer.RequireMavenVers=
ion@1bbaa83, org.apache.maven.plugins.enforcer.RequireJavaVersion@1b78fc2]
[DEBUG] (s) session =3D org.apache.maven.execution.MavenSession@b34646
[DEBUG] (s) skip =3D false
[DEBUG] -- end configuration --
[DEBUG] Executing rule: org.apache.maven.plugins.enforcer.RequireMavenVersi=
on
[DEBUG] Rule org.apache.maven.plugins.enforcer.RequireMavenVersion is cache=
able.
[DEBUG] Key org.apache.maven.plugins.enforcer.RequireMavenVersion -93731219=
7 was found in the cache
[DEBUG] The cached results are still valid. Skipping the rule: org.apache.m=
aven.plugins.enforcer.RequireMavenVersion
[DEBUG] Executing rule: org.apache.maven.plugins.enforcer.RequireJavaVersio=
n
[DEBUG] Rule org.apache.maven.plugins.enforcer.RequireJavaVersion is cachea=
ble.
[DEBUG] Key org.apache.maven.plugins.enforcer.RequireJavaVersion 48569 was =
found in the cache
[DEBUG] The cached results are still valid. Skipping the rule: org.apache.m=
aven.plugins.enforcer.RequireJavaVersion
[INFO]=20
[INFO] --- maven-site-plugin:3.0:attach-descriptor (attach-descriptor) @ ha=
doop-common-project ---
[DEBUG] Configuring mojo org.apache.maven.plugins:maven-site-plugin:3.0:att=
ach-descriptor from plugin realm ClassRealm[plugin>org.apache.maven.plugins=
:maven-site-plugin:3.0, parent: sun.misc.Launcher$AppClassLoader@6b97fd]
[DEBUG] Configuring mojo 'org.apache.maven.plugins:maven-site-plugin:3.0:at=
tach-descriptor' with basic configurator -->
[DEBUG] (f) basedir =3D <https://builds.apache.org/job/Hadoop-Common-trun=
k/ws/trunk/hadoop-common-project>
[DEBUG] (f) inputEncoding =3D UTF-8
[DEBUG] (f) localRepository =3D id: local
url: file:///home/jenkins/.m2/repository/
layout: none
[DEBUG] (f) outputEncoding =3D UTF-8
[DEBUG] (f) pomPackagingOnly =3D true
[DEBUG] (f) project =3D MavenProject: org.apache.hadoop:hadoop-common-pro=
ject:0.24.0-SNAPSHOT @ <https://builds.apache.org/job/Hadoop-Common-trunk/w=
s/trunk/hadoop-common-project/pom.xml>
[DEBUG] (f) reactorProjects =3D [MavenProject: org.apache.hadoop:hadoop-a=
nnotations:0.24.0-SNAPSHOT @ <https://builds.apache.org/job/Hadoop-Common-t=
runk/ws/trunk/hadoop-common-project/hadoop-annotations/pom.xml,> MavenProje=
ct: org.apache.hadoop:hadoop-auth:0.24.0-SNAPSHOT @ <https://builds.apache.=
org/job/Hadoop-Common-trunk/ws/trunk/hadoop-common-project/hadoop-auth/pom.=
xml,> MavenProject: org.apache.hadoop:hadoop-auth-examples:0.24.0-SNAPSHOT =
@ <https://builds.apache.org/job/Hadoop-Common-trunk/ws/trunk/hadoop-common=
-project/hadoop-auth-examples/pom.xml,> MavenProject: org.apache.hadoop:had=
oop-common:0.24.0-SNAPSHOT @ <https://builds.apache.org/job/Hadoop-Common-t=
runk/ws/trunk/hadoop-common-project/hadoop-common/pom.xml,> MavenProject: o=
rg.apache.hadoop:hadoop-common-project:0.24.0-SNAPSHOT @ <https://builds.ap=
ache.org/job/Hadoop-Common-trunk/ws/trunk/hadoop-common-project/pom.xml]>
[DEBUG] (f) siteDirectory =3D <https://builds.apache.org/job/Hadoop-Commo=
n-trunk/ws/trunk/hadoop-common-project/src/site>
[DEBUG] -- end configuration --
[DEBUG] Mapped url: <https://builds.apache.org/job/Hadoop-Common-trunk/ws/t=
runk/hadoop-common-project/src/site> to relative path: src/site
[INFO]=20
[INFO] --- maven-javadoc-plugin:2.8.1:jar (module-javadocs) @ hadoop-common=
-project ---
[DEBUG] Configuring mojo org.apache.maven.plugins:maven-javadoc-plugin:2.8.=
1:jar from plugin realm ClassRealm[plugin>org.apache.maven.plugins:maven-ja=
vadoc-plugin:2.8.1, parent: sun.misc.Launcher$AppClassLoader@6b97fd]
[DEBUG] Configuring mojo 'org.apache.maven.plugins:maven-javadoc-plugin:2.8=
.1:jar' with basic configurator -->
[DEBUG] (f) aggregate =3D false
[DEBUG] (f) attach =3D true
[DEBUG] (f) author =3D true
[DEBUG] (f) bootclasspathArtifacts =3D []
[DEBUG] (f) bottom =3D Copyright &#169; {inceptionYear}-{currentYear} {or=
ganizationName}. All Rights Reserved.
[DEBUG] (f) breakiterator =3D false
[DEBUG] (f) debug =3D false
[DEBUG] (f) defaultManifestFile =3D <https://builds.apache.org/job/Hadoop=
-Common-trunk/ws/trunk/hadoop-common-project/target/classes/META-INF/MANIFE=
ST.MF>
[DEBUG] (f) destDir =3D <https://builds.apache.org/job/Hadoop-Common-trun=
k/ws/trunk/hadoop-common-project/target>
[DEBUG] (f) detectJavaApiLink =3D true
[DEBUG] (f) detectLinks =3D false
[DEBUG] (f) detectOfflineLinks =3D true
[DEBUG] (f) docencoding =3D UTF-8
[DEBUG] (f) docfilessubdirs =3D false
[DEBUG] (f) docletArtifact =3D groupId =3D 'null'
artifactId =3D 'null'
version =3D 'null'
[DEBUG] (f) docletArtifacts =3D []
[DEBUG] (f) doctitle =3D Apache Hadoop Common Project 0.24.0-SNAPSHOT API
[DEBUG] (f) encoding =3D UTF-8
[DEBUG] (f) failOnError =3D true
[DEBUG] (f) finalName =3D hadoop-common-project-0.24.0-SNAPSHOT
[DEBUG] (f) groups =3D []
[DEBUG] (f) includeDependencySources =3D false
[DEBUG] (f) includeTransitiveDependencySources =3D false
[DEBUG] (f) isOffline =3D false
[DEBUG] (f) jarOutputDirectory =3D <https://builds.apache.org/job/Hadoop-=
Common-trunk/ws/trunk/hadoop-common-project/target>
[DEBUG] (f) javaApiLinks =3D {}
[DEBUG] (f) javadocDirectory =3D <https://builds.apache.org/job/Hadoop-Co=
mmon-trunk/ws/trunk/hadoop-common-project/src/main/javadoc>
[DEBUG] (f) javadocOptionsDir =3D <https://builds.apache.org/job/Hadoop-C=
ommon-trunk/ws/trunk/hadoop-common-project/target/javadoc-bundle-options>
[DEBUG] (f) keywords =3D false
[DEBUG] (f) links =3D []
[DEBUG] (f) linksource =3D false
[DEBUG] (f) localRepository =3D id: local
url: file:///home/jenkins/.m2/repository/
layout: none
[DEBUG] (f) nocomment =3D false
[DEBUG] (f) nodeprecated =3D false
[DEBUG] (f) nodeprecatedlist =3D false
[DEBUG] (f) nohelp =3D false
[DEBUG] (f) noindex =3D false
[DEBUG] (f) nonavbar =3D false
[DEBUG] (f) nooverview =3D false
[DEBUG] (f) nosince =3D false
[DEBUG] (f) notimestamp =3D false
[DEBUG] (f) notree =3D false
[DEBUG] (f) offlineLinks =3D []
[DEBUG] (f) old =3D false
[DEBUG] (f) outputDirectory =3D <https://builds.apache.org/job/Hadoop-Com=
mon-trunk/ws/trunk/hadoop-common-project/target>
[DEBUG] (f) overview =3D <https://builds.apache.org/job/Hadoop-Common-tru=
nk/ws/trunk/hadoop-common-project/src/main/javadoc/overview.html>
[DEBUG] (f) project =3D MavenProject: org.apache.hadoop:hadoop-common-pro=
ject:0.24.0-SNAPSHOT @ <https://builds.apache.org/job/Hadoop-Common-trunk/w=
s/trunk/hadoop-common-project/pom.xml>
[DEBUG] (f) quiet =3D false
[DEBUG] (f) reactorProjects =3D [MavenProject: org.apache.hadoop:hadoop-a=
nnotations:0.24.0-SNAPSHOT @ <https://builds.apache.org/job/Hadoop-Common-t=
runk/ws/trunk/hadoop-common-project/hadoop-annotations/pom.xml,> MavenProje=
ct: org.apache.hadoop:hadoop-auth:0.24.0-SNAPSHOT @ <https://builds.apache.=
org/job/Hadoop-Common-trunk/ws/trunk/hadoop-common-project/hadoop-auth/pom.=
xml,> MavenProject: org.apache.hadoop:hadoop-auth-examples:0.24.0-SNAPSHOT =
@ <https://builds.apache.org/job/Hadoop-Common-trunk/ws/trunk/hadoop-common=
-project/hadoop-auth-examples/pom.xml,> MavenProject: org.apache.hadoop:had=
oop-common:0.24.0-SNAPSHOT @ <https://builds.apache.org/job/Hadoop-Common-t=
runk/ws/trunk/hadoop-common-project/hadoop-common/pom.xml,> MavenProject: o=
rg.apache.hadoop:hadoop-common-project:0.24.0-SNAPSHOT @ <https://builds.ap=
ache.org/job/Hadoop-Common-trunk/ws/trunk/hadoop-common-project/pom.xml]>
[DEBUG] (f) remoteRepositories =3D [ id: apache.snapshots.https
url: https://repository.apache.org/content/repositories/snapshots
layout: default
snapshots: [enabled =3D> true, update =3D> daily]
releases: [enabled =3D> true, update =3D> daily]
, id: repository.jboss.org
url: http://repository.jboss.org/nexus/content/groups/public/
layout: default
snapshots: [enabled =3D> false, update =3D> daily]
releases: [enabled =3D> true, update =3D> daily]
, id: central
url: http://repo1.maven.org/maven2
layout: default
snapshots: [enabled =3D> false, update =3D> daily]
releases: [enabled =3D> true, update =3D> daily]
]
[DEBUG] (f) resourcesArtifacts =3D []
[DEBUG] (f) serialwarn =3D false
[DEBUG] (f) session =3D org.apache.maven.execution.MavenSession@b34646
[DEBUG] (f) settings =3D org.apache.maven.execution.SettingsAdapter@30e4a=
7
[DEBUG] (f) show =3D protected
[DEBUG] (f) skip =3D false
[DEBUG] (f) sourceDependencyCacheDir =3D <https://builds.apache.org/job/H=
adoop-Common-trunk/ws/trunk/hadoop-common-project/target/distro-javadoc-sou=
rces>
[DEBUG] (f) splitindex =3D false
[DEBUG] (f) stylesheet =3D java
[DEBUG] (f) tagletArtifact =3D groupId =3D 'null'
artifactId =3D 'null'
version =3D 'null'
[DEBUG] (f) tagletArtifacts =3D []
[DEBUG] (f) taglets =3D []
[DEBUG] (f) tags =3D []
[DEBUG] (f) use =3D true
[DEBUG] (f) useDefaultManifestFile =3D false
[DEBUG] (f) useStandardDocletOptions =3D true
[DEBUG] (f) validateLinks =3D false
[DEBUG] (f) verbose =3D false
[DEBUG] (f) version =3D true
[DEBUG] (f) windowtitle =3D Apache Hadoop Common Project 0.24.0-SNAPSHOT =
API
[DEBUG] -- end configuration --
[INFO] Not executing Javadoc as the project is not a Java classpath-capable=
package
[INFO]=20
[INFO] --- maven-checkstyle-plugin:2.6:checkstyle (default-cli) @ hadoop-co=
mmon-project ---
[DEBUG] Configuring mojo org.apache.maven.plugins:maven-checkstyle-plugin:2=
.6:checkstyle from plugin realm ClassRealm[plugin>org.apache.maven.plugins:=
maven-checkstyle-plugin:2.6, parent: sun.misc.Launcher$AppClassLoader@6b97f=
d]
[DEBUG] Configuring mojo 'org.apache.maven.plugins:maven-checkstyle-plugin:=
2.6:checkstyle' with basic configurator -->
[DEBUG] (f) cacheFile =3D <https://builds.apache.org/job/Hadoop-Common-tr=
unk/ws/trunk/hadoop-common-project/target/checkstyle-cachefile>
[DEBUG] (f) configLocation =3D config/sun_checks.xml
[DEBUG] (f) consoleOutput =3D false
[DEBUG] (f) enableFilesSummary =3D true
[DEBUG] (f) enableRSS =3D true
[DEBUG] (f) enableRulesSummary =3D true
[DEBUG] (f) enableSeveritySummary =3D true
[DEBUG] (f) encoding =3D UTF-8
[DEBUG] (f) failsOnError =3D false
[DEBUG] (f) format =3D sun
[DEBUG] (f) headerFile =3D <https://builds.apache.org/job/Hadoop-Common-t=
runk/ws/trunk/hadoop-common-project/LICENSE.txt>
[DEBUG] (f) headerLocation =3D LICENSE.txt
[DEBUG] (f) includes =3D **/*.java
[DEBUG] (f) linkXRef =3D true
[DEBUG] (f) outputDirectory =3D <https://builds.apache.org/job/Hadoop-Com=
mon-trunk/ws/trunk/hadoop-common-project/target/site>
[DEBUG] (f) outputFile =3D <https://builds.apache.org/job/Hadoop-Common-t=
runk/ws/trunk/hadoop-common-project/target/checkstyle-result.xml>
[DEBUG] (f) outputFileFormat =3D xml
[DEBUG] (f) project =3D MavenProject: org.apache.hadoop:hadoop-common-pro=
ject:0.24.0-SNAPSHOT @ <https://builds.apache.org/job/Hadoop-Common-trunk/w=
s/trunk/hadoop-common-project/pom.xml>
[DEBUG] (f) skip =3D false
[DEBUG] (f) sourceDirectory =3D <https://builds.apache.org/job/Hadoop-Com=
mon-trunk/ws/trunk/hadoop-common-project/src/main/java>
[DEBUG] (f) suppressionsFileExpression =3D checkstyle.suppressions.file
[DEBUG] (f) testSourceDirectory =3D <https://builds.apache.org/job/Hadoop=
-Common-trunk/ws/trunk/hadoop-common-project/src/test/java>
[DEBUG] (f) xrefLocation =3D <https://builds.apache.org/job/Hadoop-Common=
-trunk/ws/trunk/hadoop-common-project/target/site/xref>
[DEBUG] -- end configuration --
[INFO]=20
[INFO] --- findbugs-maven-plugin:2.3.2:findbugs (default-cli) @ hadoop-comm=
on-project ---
[DEBUG] Configuring mojo org.codehaus.mojo:findbugs-maven-plugin:2.3.2:find=
bugs from plugin realm ClassRealm[plugin>org.codehaus.mojo:findbugs-maven-p=
lugin:2.3.2, parent: sun.misc.Launcher$AppClassLoader@6b97fd]
[DEBUG] Configuring mojo 'org.codehaus.mojo:findbugs-maven-plugin:2.3.2:fin=
dbugs' with basic configurator -->
[DEBUG] (s) classFilesDirectory =3D <https://builds.apache.org/job/Hadoop=
-Common-trunk/ws/trunk/hadoop-common-project/target/classes>
[DEBUG] (s) compileSourceRoots =3D [<https://builds.apache.org/job/Hadoop=
-Common-trunk/ws/trunk/hadoop-common-project/src/main/java]>
[DEBUG] (s) debug =3D false
[DEBUG] (s) effort =3D Default
[DEBUG] (s) failOnError =3D true
[DEBUG] (s) findbugsXmlOutput =3D false
[DEBUG] (s) findbugsXmlOutputDirectory =3D <https://builds.apache.org/job=
/Hadoop-Common-trunk/ws/trunk/hadoop-common-project/target>
[DEBUG] (s) fork =3D true
[DEBUG] (s) includeTests =3D false
[DEBUG] (s) localRepository =3D id: local
url: file:///home/jenkins/.m2/repository/
layout: none
[DEBUG] (s) maxHeap =3D 512
[DEBUG] (s) nested =3D false
[DEBUG] (s) outputDirectory =3D <https://builds.apache.org/job/Hadoop-Com=
mon-trunk/ws/trunk/hadoop-common-project/target/site>
[DEBUG] (s) outputEncoding =3D UTF-8
[DEBUG] (s) pluginArtifacts =3D [org.codehaus.mojo:findbugs-maven-plugin:=
maven-plugin:2.3.2:, com.google.code.findbugs:bcel:jar:1.3.9:compile, org.c=
odehaus.gmaven:gmaven-mojo:jar:1.3:compile, org.codehaus.gmaven.runtime:gma=
ven-runtime-api:jar:1.3:compile, org.codehaus.gmaven.feature:gmaven-feature=
-api:jar:1.3:compile, org.codehaus.gmaven.runtime:gmaven-runtime-1.5:jar:1.=
3:compile, org.codehaus.gmaven.feature:gmaven-feature-support:jar:1.3:compi=
le, org.codehaus.groovy:groovy-all-minimal:jar:1.5.8:compile, org.apache.an=
t:ant:jar:1.7.1:compile, org.apache.ant:ant-launcher:jar:1.7.1:compile, jli=
ne:jline:jar:0.9.94:compile, org.codehaus.plexus:plexus-interpolation:jar:1=
.1:compile, org.codehaus.gmaven:gmaven-plugin:jar:1.3:compile, org.codehaus=
.gmaven.runtime:gmaven-runtime-loader:jar:1.3:compile, org.codehaus.gmaven.=
runtime:gmaven-runtime-support:jar:1.3:compile, org.sonatype.gshell:gshell-=
io:jar:2.0:compile, com.thoughtworks.qdox:qdox:jar:1.10:compile, org.apache=
.maven.shared:file-management:jar:1.2.1:compile, org.apache.maven.shared:ma=
ven-shared-io:jar:1.1:compile, commons-lang:commons-lang:jar:2.4:compile, o=
rg.slf4j:slf4j-api:jar:1.5.10:compile, org.sonatype.gossip:gossip:jar:1.2:c=
ompile, org.apache.maven.reporting:maven-reporting-impl:jar:2.1:compile, co=
mmons-validator:commons-validator:jar:1.2.0:compile, commons-beanutils:comm=
ons-beanutils:jar:1.7.0:compile, commons-digester:commons-digester:jar:1.6:=
compile, commons-logging:commons-logging:jar:1.0.4:compile, oro:oro:jar:2.0=
.8:compile, xml-apis:xml-apis:jar:1.0.b2:compile, org.codehaus.groovy:groov=
y-all:jar:1.7.4:compile, org.apache.maven.reporting:maven-reporting-api:jar=
:3.0:compile, org.apache.maven.doxia:doxia-core:jar:1.1.3:compile, org.apac=
he.maven.doxia:doxia-logging-api:jar:1.1.3:compile, xerces:xercesImpl:jar:2=
.9.1:compile, commons-httpclient:commons-httpclient:jar:3.1:compile, common=
s-codec:commons-codec:jar:1.2:compile, org.apache.maven.doxia:doxia-sink-ap=
i:jar:1.1.3:compile, org.apache.maven.doxia:doxia-decoration-model:jar:1.1.=
3:compile, org.apache.maven.doxia:doxia-site-renderer:jar:1.1.3:compile, or=
g.apache.maven.doxia:doxia-module-xhtml:jar:1.1.3:compile, org.apache.maven=
.doxia:doxia-module-fml:jar:1.1.3:compile, org.codehaus.plexus:plexus-i18n:=
jar:1.0-beta-7:compile, org.codehaus.plexus:plexus-velocity:jar:1.1.7:compi=
le, org.apache.velocity:velocity:jar:1.5:compile, commons-collections:commo=
ns-collections:jar:3.2:compile, org.apache.maven.shared:maven-doxia-tools:j=
ar:1.2.1:compile, commons-io:commons-io:jar:1.4:compile, com.google.code.fi=
ndbugs:findbugs-ant:jar:1.3.9:compile, com.google.code.findbugs:findbugs:ja=
r:1.3.9:compile, com.google.code.findbugs:jsr305:jar:1.3.9:compile, com.goo=
gle.code.findbugs:jFormatString:jar:1.3.9:compile, com.google.code.findbugs=
:annotations:jar:1.3.9:compile, dom4j:dom4j:jar:1.6.1:compile, jaxen:jaxen:=
jar:1.1.1:compile, jdom:jdom:jar:1.0:compile, xom:xom:jar:1.0:compile, xerc=
es:xmlParserAPIs:jar:2.6.2:compile, xalan:xalan:jar:2.6.0:compile, com.ibm.=
icu:icu4j:jar:2.6.1:compile, asm:asm:jar:3.1:compile, asm:asm-analysis:jar:=
3.1:compile, asm:asm-commons:jar:3.1:compile, asm:asm-util:jar:3.1:compile,=
asm:asm-tree:jar:3.1:compile, asm:asm-xml:jar:3.1:compile, jgoodies:plasti=
c:jar:1.2.0:compile, org.codehaus.plexus:plexus-resources:jar:1.0-alpha-4:c=
ompile, org.codehaus.plexus:plexus-utils:jar:1.5.1:compile]
[DEBUG] (s) project =3D MavenProject: org.apache.hadoop:hadoop-common-pro=
ject:0.24.0-SNAPSHOT @ <https://builds.apache.org/job/Hadoop-Common-trunk/w=
s/trunk/hadoop-common-project/pom.xml>
[DEBUG] (s) relaxed =3D false
[DEBUG] (s) remoteArtifactRepositories =3D [ id: apache.snapshots.h=
ttps
url: https://repository.apache.org/content/repositories/snapshots
layout: default
snapshots: [enabled =3D> true, update =3D> daily]
releases: [enabled =3D> true, update =3D> daily]
, id: repository.jboss.org
url: http://repository.jboss.org/nexus/content/groups/public/
layout: default
snapshots: [enabled =3D> false, update =3D> daily]
releases: [enabled =3D> true, update =3D> daily]
, id: central
url: http://repo1.maven.org/maven2
layout: default
snapshots: [enabled =3D> false, update =3D> daily]
releases: [enabled =3D> true, update =3D> daily]
]
[DEBUG] (s) skip =3D false
[DEBUG] (s) sourceEncoding =3D UTF-8
[DEBUG] (s) testClassFilesDirectory =3D <https://builds.apache.org/job/Ha=
doop-Common-trunk/ws/trunk/hadoop-common-project/target/test-classes>
[DEBUG] (s) testSourceRoots =3D [<https://builds.apache.org/job/Hadoop-Co=
mmon-trunk/ws/trunk/hadoop-common-project/src/test/java]>
[DEBUG] (s) threshold =3D Default
[DEBUG] (s) timeout =3D 600000
[DEBUG] (s) trace =3D false
[DEBUG] (s) xmlEncoding =3D UTF-8
[DEBUG] (s) xmlOutput =3D false
[DEBUG] (s) xmlOutputDirectory =3D <https://builds.apache.org/job/Hadoop-=
Common-trunk/ws/trunk/hadoop-common-project/target>
[DEBUG] (s) xrefLocation =3D <https://builds.apache.org/job/Hadoop-Common=
-trunk/ws/trunk/hadoop-common-project/target/site/xref>
[DEBUG] (s) xrefTestLocation =3D <https://builds.apache.org/job/Hadoop-Co=
mmon-trunk/ws/trunk/hadoop-common-project/target/site/xref-test>
[DEBUG] -- end configuration --
[INFO] ****** FindBugsMojo execute *******
[DEBUG] XML outputFile is <https://builds.apache.org/job/Hadoop-Common-trun=
k/ws/trunk/hadoop-common-project/target/findbugsXml.xml>
[DEBUG] Generating Findbugs XML
[DEBUG] Inside canGenerateReport..... false=20
[INFO] canGenerate is false
[INFO] --------------------------------------------------------------------=
----
[INFO] Reactor Summary:
[INFO]=20
[INFO] Apache Hadoop Annotations ......................... SUCCESS [11.692s=
]
[INFO] Apache Hadoop Auth ................................ SUCCESS [30.401s=
]
[INFO] Apache Hadoop Auth Examples ....................... SUCCESS [7.343s]
[INFO] Apache Hadoop Common .............................. SUCCESS [4:06.56=
4s]
[INFO] Apache Hadoop Common Project ...................... SUCCESS [0.039s]
[INFO] --------------------------------------------------------------------=
----
[INFO] BUILD SUCCESS
[INFO] --------------------------------------------------------------------=
----
[INFO] Total time: 4:57.148s
[INFO] Finished at: Sun Feb 26 09:09:58 UTC 2012
[INFO] Final Memory: 81M/772M
[INFO] --------------------------------------------------------------------=
----
+ /home/jenkins/tools/maven/latest/bin/mvn test -Pclover -DcloverLicenseLoc=
ation=3D/home/jenkins/tools/clover/latest/lib/clover.license
Build step 'Execute shell' marked build as failure
[WARNINGS] Skipping publisher since build result is FAILURE
Archiving artifacts
Recording test results
Publishing Javadoc
Recording fingerprints
From common-dev-return-77854-apmail-hadoop-common-dev-archive=hadoop.apache.org@hadoop.apache.org Sun Feb 26 09:20:51 2012
Return-Path: <common-dev-return-77854-apmail-hadoop-common-dev-archive=hadoop.apache.org@hadoop.apache.org>
X-Original-To: apmail-hadoop-common-dev-archive@www.apache.org
Delivered-To: apmail-hadoop-common-dev-archive@www.apache.org
Received: from mail.apache.org (hermes.apache.org [140.211.11.3])
by minotaur.apache.org (Postfix) with SMTP id F2BDF9BA6
for <apmail-hadoop-common-dev-archive@www.apache.org>; Sun, 26 Feb 2012 09:20:50 +0000 (UTC)
Received: (qmail 77893 invoked by uid 500); 26 Feb 2012 09:20:49 -0000
Delivered-To: apmail-hadoop-common-dev-archive@hadoop.apache.org
Received: (qmail 77807 invoked by uid 500); 26 Feb 2012 09:20:49 -0000
Mailing-List: contact common-dev-help@hadoop.apache.org; run by ezmlm
Precedence: bulk
List-Help: <mailto:common-dev-help@hadoop.apache.org>
List-Unsubscribe: <mailto:common-dev-unsubscribe@hadoop.apache.org>
List-Post: <mailto:common-dev@hadoop.apache.org>
List-Id: <common-dev.hadoop.apache.org>
Reply-To: common-dev@hadoop.apache.org
Delivered-To: mailing list common-dev@hadoop.apache.org
Received: (qmail 77799 invoked by uid 99); 26 Feb 2012 09:20:49 -0000
Received: from athena.apache.org (HELO athena.apache.org) (140.211.11.136)
by apache.org (qpsmtpd/0.29) with ESMTP; Sun, 26 Feb 2012 09:20:49 +0000
X-ASF-Spam-Status: No, hits=-2000.0 required=5.0
tests=ALL_TRUSTED
X-Spam-Check-By: apache.org
Received: from [140.211.11.8] (HELO aegis.apache.org) (140.211.11.8)
by apache.org (qpsmtpd/0.29) with ESMTP; Sun, 26 Feb 2012 09:20:48 +0000
Received: from aegis (localhost [127.0.0.1])
by aegis.apache.org (Postfix) with ESMTP id A0A00C00E8
for <common-dev@hadoop.apache.org>; Sun, 26 Feb 2012 09:20:28 +0000 (UTC)
Date: Sun, 26 Feb 2012 09:20:28 +0000 (UTC)
From: Apache Jenkins Server <jenkins@builds.apache.org>
To: common-dev@hadoop.apache.org
Message-ID: <933682881.741330248028656.JavaMail.hudson@aegis>
In-Reply-To: <1416525504.1121330162218123.JavaMail.hudson@aegis>
References: <1416525504.1121330162218123.JavaMail.hudson@aegis>
Subject: Jenkins build is back to normal : Hadoop-Common-0.23-Build #175
MIME-Version: 1.0
Content-Type: text/plain; charset=UTF-8
Content-Transfer-Encoding: 7bit
X-Jenkins-Job: Hadoop-Common-0.23-Build
X-Jenkins-Result: SUCCESS
See <https://builds.apache.org/job/Hadoop-Common-0.23-Build/175/changes>
From common-dev-return-77855-apmail-hadoop-common-dev-archive=hadoop.apache.org@hadoop.apache.org Sun Feb 26 09:24:58 2012
Return-Path: <common-dev-return-77855-apmail-hadoop-common-dev-archive=hadoop.apache.org@hadoop.apache.org>
X-Original-To: apmail-hadoop-common-dev-archive@www.apache.org
Delivered-To: apmail-hadoop-common-dev-archive@www.apache.org
Received: from mail.apache.org (hermes.apache.org [140.211.11.3])
by minotaur.apache.org (Postfix) with SMTP id A95299116
for <apmail-hadoop-common-dev-archive@www.apache.org>; Sun, 26 Feb 2012 09:24:58 +0000 (UTC)
Received: (qmail 86333 invoked by uid 500); 26 Feb 2012 09:24:56 -0000
Delivered-To: apmail-hadoop-common-dev-archive@hadoop.apache.org
Received: (qmail 86266 invoked by uid 500); 26 Feb 2012 09:24:56 -0000
Mailing-List: contact common-dev-help@hadoop.apache.org; run by ezmlm
Precedence: bulk
List-Help: <mailto:common-dev-help@hadoop.apache.org>
List-Unsubscribe: <mailto:common-dev-unsubscribe@hadoop.apache.org>
List-Post: <mailto:common-dev@hadoop.apache.org>
List-Id: <common-dev.hadoop.apache.org>
Reply-To: common-dev@hadoop.apache.org
Delivered-To: mailing list common-dev@hadoop.apache.org
Received: (qmail 86257 invoked by uid 99); 26 Feb 2012 09:24:56 -0000
Received: from nike.apache.org (HELO nike.apache.org) (192.87.106.230)
by apache.org (qpsmtpd/0.29) with ESMTP; Sun, 26 Feb 2012 09:24:56 +0000
X-ASF-Spam-Status: No, hits=-2000.0 required=5.0
tests=ALL_TRUSTED
X-Spam-Check-By: apache.org
Received: from [140.211.11.8] (HELO aegis.apache.org) (140.211.11.8)
by apache.org (qpsmtpd/0.29) with ESMTP; Sun, 26 Feb 2012 09:24:53 +0000
Received: from aegis (localhost [127.0.0.1])
by aegis.apache.org (Postfix) with ESMTP id 0DDDAC00A0
for <common-dev@hadoop.apache.org>; Sun, 26 Feb 2012 09:24:32 +0000 (UTC)
Date: Sun, 26 Feb 2012 09:24:31 +0000 (UTC)
From: Apache Jenkins Server <jenkins@builds.apache.org>
To: common-dev@hadoop.apache.org
Message-ID: <841917880.761330248272040.JavaMail.hudson@aegis>
Subject: Build failed in Jenkins: Hadoop-Common-0.23-PB-Build #4
MIME-Version: 1.0
Content-Type: text/plain; charset=UTF-8
Content-Transfer-Encoding: 7bit
X-Jenkins-Job: Hadoop-Common-0.23-PB-Build
X-Jenkins-Result: FAILURE
X-Virus-Checked: Checked by ClamAV on apache.org
See <https://builds.apache.org/job/Hadoop-Common-0.23-PB-Build/4/>
------------------------------------------
[...truncated 71381 lines...]
9 KB 42 KB 7 KB
10 KB 42 KB 7 KB
10 KB 42 KB 7 KB
10 KB 42 KB 7 KB
11 KB 42 KB 7 KB
11 KB 42 KB 7 KB
12 KB 42 KB 7 KB
12 KB 42 KB 7 KB
13 KB 42 KB 7 KB
13 KB 42 KB 7 KB
14 KB 42 KB 7 KB
14 KB 42 KB 7 KB
15 KB 42 KB 7 KB
15 KB 42 KB 7 KB
16 KB 42 KB 7 KB
17 KB 42 KB 7 KB
17 KB 42 KB 7 KB
18 KB 42 KB 7 KB
18 KB 42 KB 7 KB
18 KB 42 KB 7 KB
19 KB 42 KB 7 KB
19 KB 42 KB 7 KB
20 KB 42 KB 7 KB
20 KB 42 KB 7 KB
21 KB 42 KB 7 KB
21 KB 42 KB 7 KB
22 KB 42 KB 7 KB
22 KB 42 KB 7 KB
23 KB 42 KB 7 KB
23 KB 42 KB 7 KB
24 KB 42 KB 7 KB
24 KB 42 KB 7 KB
25 KB 42 KB 7 KB
25 KB 42 KB 7 KB
26 KB 42 KB 7 KB
26 KB 42 KB 7 KB
27 KB 42 KB 7 KB
27 KB 42 KB 7 KB
28 KB 42 KB 7 KB
29 KB 42 KB 7 KB
29 KB 42 KB 7 KB
30 KB 42 KB 7 KB
30 KB 42 KB 7 KB
31 KB 42 KB 7 KB
31 KB 42 KB 7 KB
32 KB 42 KB 7 KB
32 KB 42 KB 7 KB
33 KB 42 KB 7 KB
33 KB 42 KB 7 KB
34 KB 42 KB 7 KB
35 KB 42 KB 7 KB
35 KB 42 KB 7 KB
36 KB 42 KB 7 KB
36 KB 42 KB 7 KB
37 KB 42 KB 7 KB
37 KB 42 KB 7 KB
38 KB 42 KB 7 KB
38 KB 42 KB 7 KB
39 KB 42 KB 7 KB
40 KB 42 KB 7 KB
40 KB 42 KB 7 KB
41 KB 42 KB 7 KB
41 KB 42 KB 7 KB
42 KB 42 KB 7 KB
42 KB 42 KB 7 KB
43 KB 42 KB 7 KB
43 KB 42 KB 7 KB
45 KB 42 KB 7 KB
48 KB 42 KB 7 KB
50 KB 42 KB 7 KB
50 KB 848 B 42 KB 7 KB
50 KB 2 KB 42 KB 7 KB
50 KB 2 KB 42 KB 7 KB
50 KB 3 KB 42 KB 7 KB
50 KB 3 KB 42 KB 7 KB
50 KB 4 KB 42 KB 7 KB
50 KB 4 KB 42 KB 7 KB
50 KB 5 KB 42 KB 7 KB
50 KB 5 KB 42 KB 7 KB
50 KB 6 KB 42 KB 7 KB
50 KB 6 KB 42 KB 7 KB
50 KB 7 KB 42 KB 7 KB
50 KB 7 KB 42 KB 7 KB
50 KB 8 KB 42 KB 7 KB
50 KB 8 KB 42 KB 7 KB
50 KB 9 KB 42 KB 7 KB
50 KB 9 KB 42 KB 7 KB
50 KB 10 KB 42 KB 7 KB
50 KB 10 KB 42 KB 7 KB
50 KB 11 KB 42 KB 7 KB
50 KB 11 KB 42 KB 7 KB
50 KB 12 KB 42 KB 7 KB
50 KB 12 KB 42 KB 7 KB
50 KB 13 KB 42 KB 7 KB
50 KB 13 KB 42 KB 7 KB
50 KB 14 KB 42 KB 7 KB
50 KB 14 KB 42 KB 7 KB
50 KB 15 KB 42 KB 7 KB
50 KB 15 KB 42 KB 7 KB
50 KB 16 KB 42 KB 7 KB
50 KB 16 KB 42 KB 7 KB
50 KB 17 KB 42 KB 7 KB
50 KB 17 KB 42 KB 7 KB
50 KB 18 KB 42 KB 7 KB
50 KB 19 KB 42 KB 7 KB
50 KB 19 KB 42 KB 7 KB
50 KB 20 KB 42 KB 7 KB
50 KB 20 KB 42 KB 7 KB
50 KB 21 KB 42 KB 7 KB
50 KB 23 KB 42 KB 7 KB
Downloaded: http://repo1.maven.org/maven2/org/apache/maven/shared/maven-filtering/1.0/maven-filtering-1.0.jar (42 KB at 18.7 KB/sec)
Downloaded: http://repo1.maven.org/maven2/org/sonatype/plexus/plexus-build-api/0.0.4/plexus-build-api-0.0.4.jar (7 KB at 3.0 KB/sec)
Downloaded: http://repo1.maven.org/maven2/org/codehaus/plexus/plexus-io/1.0.1/plexus-io-1.0.1.jar (50 KB at 22.0 KB/sec)
Downloaded: http://repo1.maven.org/maven2/org/apache/maven/shared/maven-repository-builder/1.0-alpha-2/maven-repository-builder-1.0-alpha-2.jar (23 KB at 10.1 KB/sec)
[WARNING] The following patterns were never triggered in this artifact exclusion filter:
o 'org.apache.ant:*:jar'
o 'jdiff:jdiff:jar'
[INFO] share/hadoop/common/jdiff/ already added, skipping
[INFO] Copying files to <https://builds.apache.org/job/Hadoop-Common-0.23-PB-Build/ws/trunk/hadoop-common-project/hadoop-common/target/hadoop-common-0.23.2-SNAPSHOT>
[INFO] share/hadoop/common/jdiff/ already added, skipping
[INFO]
[INFO] --- maven-jar-plugin:2.3.1:jar (default-jar) @ hadoop-common ---
[INFO]
[INFO] --- maven-source-plugin:2.1.2:jar-no-fork (hadoop-java-sources) @ hadoop-common ---
[INFO] org already added, skipping
[INFO] org/apache already added, skipping
[INFO] org/apache/hadoop already added, skipping
[INFO] org/apache/hadoop/ipc already added, skipping
[INFO] org/apache/hadoop/ipc/protobuf already added, skipping
[INFO] Building jar: <https://builds.apache.org/job/Hadoop-Common-0.23-PB-Build/ws/trunk/hadoop-common-project/hadoop-common/target/hadoop-common-0.23.2-SNAPSHOT-sources.jar>
[INFO] org already added, skipping
[INFO] org/apache already added, skipping
[INFO] org/apache/hadoop already added, skipping
[INFO] org/apache/hadoop/ipc already added, skipping
[INFO] org/apache/hadoop/ipc/protobuf already added, skipping
[WARNING] Artifact org.apache.hadoop:hadoop-common:java-source:sources:0.23.2-SNAPSHOT already attached to project, ignoring duplicate
[INFO]
[INFO] --- maven-site-plugin:3.0:attach-descriptor (attach-descriptor) @ hadoop-common ---
[INFO]
[INFO] --- maven-antrun-plugin:1.6:run (tar) @ hadoop-common ---
[INFO] Executing tasks
main:
[INFO] Executed tasks
[INFO]
[INFO] --- maven-javadoc-plugin:2.8.1:jar (module-javadocs) @ hadoop-common ---
[INFO]
ExcludePrivateAnnotationsStandardDoclet
9 warnings
[WARNING] Javadoc Warnings
[WARNING] <https://builds.apache.org/job/Hadoop-Common-0.23-PB-Build/ws/trunk/hadoop-common-project/hadoop-common/src/main/java/org/apache/hadoop/io/FastByteComparisons.java>:25: warning: sun.misc.Unsafe is Sun proprietary API and may be removed in a future release
[WARNING] import sun.misc.Unsafe;
[WARNING] ^
[WARNING] <https://builds.apache.org/job/Hadoop-Common-0.23-PB-Build/ws/trunk/hadoop-common-project/hadoop-common/src/main/java/org/apache/hadoop/io/FastByteComparisons.java>:117: warning: sun.misc.Unsafe is Sun proprietary API and may be removed in a future release
[WARNING] static final Unsafe theUnsafe;
[WARNING] ^
[WARNING] <https://builds.apache.org/job/Hadoop-Common-0.23-PB-Build/ws/trunk/hadoop-common-project/hadoop-common/src/main/java/org/apache/hadoop/security/SecurityUtil.java>:49: warning: sun.net.dns.ResolverConfiguration is Sun proprietary API and may be removed in a future release
[WARNING] import sun.net.dns.ResolverConfiguration;
[WARNING] ^
[WARNING] <https://builds.apache.org/job/Hadoop-Common-0.23-PB-Build/ws/trunk/hadoop-common-project/hadoop-common/src/main/java/org/apache/hadoop/security/SecurityUtil.java>:50: warning: sun.net.util.IPAddressUtil is Sun proprietary API and may be removed in a future release
[WARNING] import sun.net.util.IPAddressUtil;
[WARNING] ^
[WARNING] <https://builds.apache.org/job/Hadoop-Common-0.23-PB-Build/ws/trunk/hadoop-common-project/hadoop-common/src/main/java/org/apache/hadoop/security/SecurityUtil.java>:51: warning: sun.security.jgss.krb5.Krb5Util is Sun proprietary API and may be removed in a future release
[WARNING] import sun.security.jgss.krb5.Krb5Util;
[WARNING] ^
[WARNING] <https://builds.apache.org/job/Hadoop-Common-0.23-PB-Build/ws/trunk/hadoop-common-project/hadoop-common/src/main/java/org/apache/hadoop/security/SecurityUtil.java>:52: warning: sun.security.krb5.Credentials is Sun proprietary API and may be removed in a future release
[WARNING] import sun.security.krb5.Credentials;
[WARNING] ^
[WARNING] <https://builds.apache.org/job/Hadoop-Common-0.23-PB-Build/ws/trunk/hadoop-common-project/hadoop-common/src/main/java/org/apache/hadoop/security/SecurityUtil.java>:53: warning: sun.security.krb5.PrincipalName is Sun proprietary API and may be removed in a future release
[WARNING] import sun.security.krb5.PrincipalName;
[WARNING] ^
[WARNING] <https://builds.apache.org/job/Hadoop-Common-0.23-PB-Build/ws/trunk/hadoop-common-project/hadoop-common/src/main/java/org/apache/hadoop/security/HadoopKerberosName.java>:28: warning: sun.security.krb5.Config is Sun proprietary API and may be removed in a future release
[WARNING] import sun.security.krb5.Config;
[WARNING] ^
[WARNING] <https://builds.apache.org/job/Hadoop-Common-0.23-PB-Build/ws/trunk/hadoop-common-project/hadoop-common/src/main/java/org/apache/hadoop/security/HadoopKerberosName.java>:29: warning: sun.security.krb5.KrbException is Sun proprietary API and may be removed in a future release
[WARNING] import sun.security.krb5.KrbException;
[WARNING] ^
[INFO] Building jar: <https://builds.apache.org/job/Hadoop-Common-0.23-PB-Build/ws/trunk/hadoop-common-project/hadoop-common/target/hadoop-common-0.23.2-SNAPSHOT-javadoc.jar>
[INFO]
[INFO] --- maven-checkstyle-plugin:2.6:checkstyle (default-cli) @ hadoop-common ---
[INFO]
[INFO] There are 8670 checkstyle errors.
[WARNING] Unable to locate Source XRef to link to - DISABLED
[INFO]
[INFO] --- findbugs-maven-plugin:2.3.2:findbugs (default-cli) @ hadoop-common ---
[INFO] ****** FindBugsMojo execute *******
[INFO] canGenerate is true
[INFO] ****** FindBugsMojo executeFindbugs *******
[INFO] Temp File is <https://builds.apache.org/job/Hadoop-Common-0.23-PB-Build/ws/trunk/hadoop-common-project/hadoop-common/target/findbugsTemp.xml>
[INFO] Fork Value is true
[java] The following classes needed for analysis were missing:
[java] org.codehaus.jackson.FormatSchema
[java] org.codehaus.jackson.format.InputAccessor
[java] Missing classes: 1
[INFO] xmlOutput is false
[INFO]
[INFO] ------------------------------------------------------------------------
[INFO] Building Apache Hadoop Common Project 0.23.2-SNAPSHOT
[INFO] ------------------------------------------------------------------------
[INFO]
[INFO] --- maven-clean-plugin:2.4.1:clean (default-clean) @ hadoop-common-project ---
[INFO] Deleting <https://builds.apache.org/job/Hadoop-Common-0.23-PB-Build/ws/trunk/hadoop-common-project/target>
[INFO]
[INFO] --- maven-antrun-plugin:1.6:run (create-testdirs) @ hadoop-common-project ---
[INFO] Executing tasks
main:
[mkdir] Created dir: <https://builds.apache.org/job/Hadoop-Common-0.23-PB-Build/ws/trunk/hadoop-common-project/target/test-dir>
[INFO] Executed tasks
[INFO]
[INFO] --- maven-source-plugin:2.1.2:jar-no-fork (hadoop-java-sources) @ hadoop-common-project ---
[INFO]
[INFO] --- maven-site-plugin:3.0:attach-descriptor (attach-descriptor) @ hadoop-common-project ---
[INFO]
[INFO] --- maven-javadoc-plugin:2.8.1:jar (module-javadocs) @ hadoop-common-project ---
[INFO] Not executing Javadoc as the project is not a Java classpath-capable package
[INFO]
[INFO] --- maven-checkstyle-plugin:2.6:checkstyle (default-cli) @ hadoop-common-project ---
[INFO]
[INFO] --- findbugs-maven-plugin:2.3.2:findbugs (default-cli) @ hadoop-common-project ---
[INFO] ****** FindBugsMojo execute *******
[INFO] canGenerate is false
[INFO] ------------------------------------------------------------------------
[INFO] Reactor Summary:
[INFO]
[INFO] Apache Hadoop Annotations ......................... SUCCESS [1:32.466s]
[INFO] Apache Hadoop Auth ................................ SUCCESS [1:07.194s]
[INFO] Apache Hadoop Auth Examples ....................... SUCCESS [7.694s]
[INFO] Apache Hadoop Common .............................. SUCCESS [5:18.063s]
[INFO] Apache Hadoop Common Project ...................... SUCCESS [0.053s]
[INFO] ------------------------------------------------------------------------
[INFO] BUILD SUCCESS
[INFO] ------------------------------------------------------------------------
[INFO] Total time: 8:16.018s
[INFO] Finished at: Sun Feb 26 09:14:26 UTC 2012
[INFO] Final Memory: 82M/780M
[INFO] ------------------------------------------------------------------------
+ /home/jenkins/tools/maven/latest/bin/mvn test -Pclover -DcloverLicenseLocation=/home/jenkins/tools/clover/latest/lib/clover.license
Build step 'Execute shell' marked build as failure
[WARNINGS] Skipping publisher since build result is FAILURE
Archiving artifacts
Recording test results
Publishing Javadoc
Recording fingerprints
From common-dev-return-77856-apmail-hadoop-common-dev-archive=hadoop.apache.org@hadoop.apache.org Sun Feb 26 17:41:11 2012
Return-Path: <common-dev-return-77856-apmail-hadoop-common-dev-archive=hadoop.apache.org@hadoop.apache.org>
X-Original-To: apmail-hadoop-common-dev-archive@www.apache.org
Delivered-To: apmail-hadoop-common-dev-archive@www.apache.org
Received: from mail.apache.org (hermes.apache.org [140.211.11.3])
by minotaur.apache.org (Postfix) with SMTP id 95C7299C6
for <apmail-hadoop-common-dev-archive@www.apache.org>; Sun, 26 Feb 2012 17:41:11 +0000 (UTC)
Received: (qmail 2740 invoked by uid 500); 26 Feb 2012 17:41:10 -0000
Delivered-To: apmail-hadoop-common-dev-archive@hadoop.apache.org
Received: (qmail 2660 invoked by uid 500); 26 Feb 2012 17:41:10 -0000
Mailing-List: contact common-dev-help@hadoop.apache.org; run by ezmlm
Precedence: bulk
List-Help: <mailto:common-dev-help@hadoop.apache.org>
List-Unsubscribe: <mailto:common-dev-unsubscribe@hadoop.apache.org>
List-Post: <mailto:common-dev@hadoop.apache.org>
List-Id: <common-dev.hadoop.apache.org>
Reply-To: common-dev@hadoop.apache.org
Delivered-To: mailing list common-dev@hadoop.apache.org
Received: (qmail 2651 invoked by uid 99); 26 Feb 2012 17:41:09 -0000
Received: from athena.apache.org (HELO athena.apache.org) (140.211.11.136)
by apache.org (qpsmtpd/0.29) with ESMTP; Sun, 26 Feb 2012 17:41:09 +0000
X-ASF-Spam-Status: No, hits=-2000.0 required=5.0
tests=ALL_TRUSTED,T_RP_MATCHES_RCVD
X-Spam-Check-By: apache.org
Received: from [140.211.11.116] (HELO hel.zones.apache.org) (140.211.11.116)
by apache.org (qpsmtpd/0.29) with ESMTP; Sun, 26 Feb 2012 17:41:09 +0000
Received: from hel.zones.apache.org (hel.zones.apache.org [140.211.11.116])
by hel.zones.apache.org (Postfix) with ESMTP id 0409733BC07
for <common-dev@hadoop.apache.org>; Sun, 26 Feb 2012 17:40:49 +0000 (UTC)
Date: Sun, 26 Feb 2012 17:40:49 +0000 (UTC)
From: "Eugene Koontz (Created) (JIRA)" <jira@apache.org>
To: common-dev@hadoop.apache.org
Message-ID: <633499768.21190.1330278049017.JavaMail.tomcat@hel.zones.apache.org>
Subject: [jira] [Created] (HADOOP-8113) Correction to BUILDING.txt: HDFS
needs ProtocolBuffer, too (not just MapReduce)
MIME-Version: 1.0
Content-Type: text/plain; charset=utf-8
Content-Transfer-Encoding: 7bit
X-JIRA-FingerPrint: 30527f35849b9dde25b450d4833f0394
Correction to BUILDING.txt: HDFS needs ProtocolBuffer, too (not just MapReduce)
-------------------------------------------------------------------------------
Key: HADOOP-8113
URL: https://issues.apache.org/jira/browse/HADOOP-8113
Project: Hadoop Common
Issue Type: Improvement
Components: documentation
Affects Versions: 0.23.2
Reporter: Eugene Koontz
Priority: Trivial
Currently BUILDING.txt states:
{quote}
ProtocolBuffer 2.4.1+ (for MapReduce)
{quote}
But HDFS needs ProtocolBuffer too:
{code}
hadoop-common/hadoop-hdfs-project$ find . -name "*.proto" | wc -l
11
{code}
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
From common-dev-return-77857-apmail-hadoop-common-dev-archive=hadoop.apache.org@hadoop.apache.org Mon Feb 27 02:16:11 2012
Return-Path: <common-dev-return-77857-apmail-hadoop-common-dev-archive=hadoop.apache.org@hadoop.apache.org>
X-Original-To: apmail-hadoop-common-dev-archive@www.apache.org
Delivered-To: apmail-hadoop-common-dev-archive@www.apache.org
Received: from mail.apache.org (hermes.apache.org [140.211.11.3])
by minotaur.apache.org (Postfix) with SMTP id 31A2B9D9C
for <apmail-hadoop-common-dev-archive@www.apache.org>; Mon, 27 Feb 2012 02:16:11 +0000 (UTC)
Received: (qmail 99555 invoked by uid 500); 27 Feb 2012 02:16:09 -0000
Delivered-To: apmail-hadoop-common-dev-archive@hadoop.apache.org
Received: (qmail 99467 invoked by uid 500); 27 Feb 2012 02:16:09 -0000
Mailing-List: contact common-dev-help@hadoop.apache.org; run by ezmlm
Precedence: bulk
List-Help: <mailto:common-dev-help@hadoop.apache.org>
List-Unsubscribe: <mailto:common-dev-unsubscribe@hadoop.apache.org>
List-Post: <mailto:common-dev@hadoop.apache.org>
List-Id: <common-dev.hadoop.apache.org>
Reply-To: common-dev@hadoop.apache.org
Delivered-To: mailing list common-dev@hadoop.apache.org
Received: (qmail 99459 invoked by uid 99); 27 Feb 2012 02:16:09 -0000
Received: from athena.apache.org (HELO athena.apache.org) (140.211.11.136)
by apache.org (qpsmtpd/0.29) with ESMTP; Mon, 27 Feb 2012 02:16:09 +0000
X-ASF-Spam-Status: No, hits=-2000.0 required=5.0
tests=ALL_TRUSTED,T_RP_MATCHES_RCVD
X-Spam-Check-By: apache.org
Received: from [140.211.11.116] (HELO hel.zones.apache.org) (140.211.11.116)
by apache.org (qpsmtpd/0.29) with ESMTP; Mon, 27 Feb 2012 02:16:08 +0000
Received: from hel.zones.apache.org (hel.zones.apache.org [140.211.11.116])
by hel.zones.apache.org (Postfix) with ESMTP id AF74333C806
for <common-dev@hadoop.apache.org>; Mon, 27 Feb 2012 02:15:48 +0000 (UTC)
Date: Mon, 27 Feb 2012 02:15:48 +0000 (UTC)
From: "Eli Collins (Resolved) (JIRA)" <jira@apache.org>
To: common-dev@hadoop.apache.org
Message-ID: <1563199523.21951.1330308948719.JavaMail.tomcat@hel.zones.apache.org>
In-Reply-To: <248839919.17656.1330125949305.JavaMail.tomcat@hel.zones.apache.org>
Subject: [jira] [Resolved] (HADOOP-8111) cannot see userlogs from the web
MIME-Version: 1.0
Content-Type: text/plain; charset=utf-8
Content-Transfer-Encoding: 7bit
X-JIRA-FingerPrint: 30527f35849b9dde25b450d4833f0394
[ https://issues.apache.org/jira/browse/HADOOP-8111?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Eli Collins resolved HADOOP-8111.
---------------------------------
Resolution: Duplicate
Dupe of MAPREDUCE-2920. MAPREDUCE-2415 broke this feature.
> cannot see userlogs from the web
> --------------------------------
>
> Key: HADOOP-8111
> URL: https://issues.apache.org/jira/browse/HADOOP-8111
> Project: Hadoop Common
> Issue Type: Bug
> Components: util
> Affects Versions: 1.0.0
> Environment: Linux
> Reporter: Weili Shao
>
> After upgraded from Hadoop 0.20.2 to Hadoop 1.0.0, the userlogs cannot be viewed anymore from the web. The root cause is that the userlogs of the tasks are actually simlinks at level of dir with name pattern like attempt_201202241358_0001_m_000000_0. According to Jetty's documentation, simlinks are not defaultly rederable http://docs.codehaus.org/display/JETTY/How+to+enable+serving+aliased+files. Please check.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
From common-dev-return-77858-apmail-hadoop-common-dev-archive=hadoop.apache.org@hadoop.apache.org Mon Feb 27 04:40:03 2012
Return-Path: <common-dev-return-77858-apmail-hadoop-common-dev-archive=hadoop.apache.org@hadoop.apache.org>
X-Original-To: apmail-hadoop-common-dev-archive@www.apache.org
Delivered-To: apmail-hadoop-common-dev-archive@www.apache.org
Received: from mail.apache.org (hermes.apache.org [140.211.11.3])
by minotaur.apache.org (Postfix) with SMTP id 0C1659D5D
for <apmail-hadoop-common-dev-archive@www.apache.org>; Mon, 27 Feb 2012 04:40:03 +0000 (UTC)
Received: (qmail 15636 invoked by uid 500); 27 Feb 2012 04:40:00 -0000
Delivered-To: apmail-hadoop-common-dev-archive@hadoop.apache.org
Received: (qmail 15119 invoked by uid 500); 27 Feb 2012 04:39:59 -0000
Mailing-List: contact common-dev-help@hadoop.apache.org; run by ezmlm
Precedence: bulk
List-Help: <mailto:common-dev-help@hadoop.apache.org>
List-Unsubscribe: <mailto:common-dev-unsubscribe@hadoop.apache.org>
List-Post: <mailto:common-dev@hadoop.apache.org>
List-Id: <common-dev.hadoop.apache.org>
Reply-To: common-dev@hadoop.apache.org
Delivered-To: mailing list common-dev@hadoop.apache.org
Received: (qmail 13979 invoked by uid 99); 27 Feb 2012 04:39:57 -0000
Received: from nike.apache.org (HELO nike.apache.org) (192.87.106.230)
by apache.org (qpsmtpd/0.29) with ESMTP; Mon, 27 Feb 2012 04:39:57 +0000
X-ASF-Spam-Status: No, hits=0.5 required=5.0
tests=RCVD_IN_DNSWL_NONE,REPTO_QUOTE_YAHOO,SPF_PASS
X-Spam-Check-By: apache.org
Received-SPF: pass (nike.apache.org: local policy)
Received: from [98.139.52.225] (HELO nm28.bullet.mail.ac4.yahoo.com) (98.139.52.225)
by apache.org (qpsmtpd/0.29) with SMTP; Mon, 27 Feb 2012 04:39:47 +0000
Received: from [98.139.52.193] by nm28.bullet.mail.ac4.yahoo.com with NNFMP; 27 Feb 2012 04:39:26 -0000
Received: from [98.139.52.154] by tm6.bullet.mail.ac4.yahoo.com with NNFMP; 27 Feb 2012 04:39:26 -0000
Received: from [127.0.0.1] by omp1037.mail.ac4.yahoo.com with NNFMP; 27 Feb 2012 04:39:26 -0000
X-Yahoo-Newman-Property: ymail-3
X-Yahoo-Newman-Id: 333187.81216.bm@omp1037.mail.ac4.yahoo.com
Received: (qmail 26357 invoked by uid 60001); 27 Feb 2012 04:39:26 -0000
DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=yahoo.com; s=s1024; t=1330317566; bh=bZ9Mx52Z5ep6w0R6XI8bhHFmLtfu4tDrv2rAKi9w+oc=; h=X-YMail-OSG:Received:X-Mailer:References:Message-ID:Date:From:Reply-To:Subject:To:In-Reply-To:MIME-Version:Content-Type:Content-Transfer-Encoding; b=oujBzE8OP3OmReZWuqe3wOZenLLnRaSp8lgtesoOLzkvBdQPa9tmdl67d27HIkeGG9WozKbFcH3ToKGce6dvvS6mgmp/OW5McLyMM6Nb1PHcTL2tw95eGS2UTD2+BCiLov+TQ57fy9KaZgvgvyEy0gwl2sJabF/dv3IHX4tjQdE=
DomainKey-Signature:a=rsa-sha1; q=dns; c=nofws;
s=s1024; d=yahoo.com;
h=X-YMail-OSG:Received:X-Mailer:References:Message-ID:Date:From:Reply-To:Subject:To:In-Reply-To:MIME-Version:Content-Type:Content-Transfer-Encoding;
b=FiIxV90jFIJnnZD0oOp+1TgKXPAN/GpumY5nyZ2Nld5lwOwxBQKahrrhqk0w+mLJqtvmqAV03LmVRVbwZVocofh5lFw2PyeCjuq0PvgifQPtO9w0YH4KrjtxX4dvgrTyu2FxGigoiryk/z2+LwkMwT6VFoVo+5Hw+5zgJ6vTbFc=;
X-YMail-OSG: KM6_.VYVM1n_Juka1BlaHSRkROeb.BrMJ6ON_tDW7taBlI7
1KrTrfCKq54ySHYOtw9YXq5Mw0Bic1Fwh6ZtfDoby9NcqfvMFtQddzx1XMot
q.Ji899pdD4qGwAe9CdUtLEw7JJq9QCdtA8T0uLdUlgST4JfTR3q9MdvwARD
o0cKsdPnEPjUVYh85gVG6RQmY4aqhZPIWz3aUemkdnlAi0YAcWFQT_4Y0wk.
h09bJ0uAFa0INuOWv1GHBEePO87VZHDU3Ssr6P.240Ygdwuq9zuzkxBFIJzN
zB_qY7Z7y4rfeTmpRfLFYDFffxXHT1yThBJtFi3MkrgFnzH6p4qD8pS9ON.6
DFX5pQ4HCwavBN1Zk9x.05Vg3XIvaeRe2xn_8iNdrbVxr7Jqp0E84AvCEzFJ
AmTn5.aVXdrUOA1HwNmjweGNSeV_56fZWkEsju.1s8bSx_IbSN.sj_XoQnQU
weIBKRW6OykaDcr6fLHk88605XxHVZMafIl92AwcMKMX1VjrFMoMUiHb0KPp
brS3Ikv1P8KBTqdf3do2Ke5sQc4Qs.GW6.4ZzvuHh7pDM
Received: from [71.139.26.60] by web65904.mail.ac4.yahoo.com via HTTP; Sun, 26 Feb 2012 20:39:26 PST
X-Mailer: YahooMailWebService/0.8.116.338427
References: <1329941845.89602.YahooMailNeo@web65901.mail.ac4.yahoo.com> <1329942015.73853.YahooMailNeo@web65903.mail.ac4.yahoo.com> <CALF7aMQuKkSNLUz=2yv6DKriKE5W87WUhO0g0kXKZakrDFWRxA@mail.gmail.com> <1329955071.13478.YahooMailNeo@web65904.mail.ac4.yahoo.com> <1329955330.2043.YahooMailNeo@web65906.mail.ac4.yahoo.com> <1330127722.24215.YahooMailNeo@web65902.mail.ac4.yahoo.com> <1330128067.11284.YahooMailNeo@web65901.mail.ac4.yahoo.com> <1330317477.92236.YahooMailNeo@web65904.mail.ac4.yahoo.com>
Message-ID: <1330317566.15580.YahooMailNeo@web65904.mail.ac4.yahoo.com>
Date: Sun, 26 Feb 2012 20:39:26 -0800 (PST)
From: "Tsz Wo \(Nicholas\), Sze" <s29752-hadoopdev@yahoo.com>
Reply-To: "Tsz Wo \(Nicholas\), Sze" <s29752-hadoopdev@yahoo.com>
Subject: Fw: [RESULT][VOTE] Merging 0.23-PB to 0.23
To: common dev <common-dev@hadoop.apache.org>,
hdfs dev <hdfs-dev@hadoop.apache.org>,
mapreduce-dev hadoop <mapreduce-dev@hadoop.apache.org>
In-Reply-To: <1330317477.92236.YahooMailNeo@web65904.mail.ac4.yahoo.com>
MIME-Version: 1.0
Content-Type: text/plain; charset=iso-8859-1
Content-Transfer-Encoding: quoted-printable
X-Virus-Checked: Checked by ClamAV on apache.org
Hi dev,=0A=0A=0AI am merging 0.23-PB back to 0.23.=A0 Please hold on your c=
ommit to 0.23 for a moment.=A0 Thanks.=0A=0ATsz-Wo Nicholas Sze=0AHortonwor=
ks Inc.=0Ahttp://hortonworks.com/=0A=0A=0A----- Forwarded Message -----=0AF=
rom: "Tsz Wo (Nicholas), Sze" <s29752-hadoopgeneral@yahoo.com>=0ATo: genera=
l hadoop <general@hadoop.apache.org> =0ASent: Friday, February 24, 2012 4:0=
1 PM=0ASubject: [RESULT][VOTE] Merging 0.23-PB to 0.23=0A=0AThere are six +=
1s (Mahadev, Eli, Suresh, Arun, Jitendra and myself) and no -1s.=A0 The vot=
e passed.=0A=0AI will send out emails to the dev mailing lists right before=
the merging.=0A=0AThanks everyone!=0A=0ATsz-Wo Nicholas Sze=0AHortonworks =
Inc.=0Ahttp://hortonworks.com/=0A
From common-dev-return-77859-apmail-hadoop-common-dev-archive=hadoop.apache.org@hadoop.apache.org Mon Feb 27 04:40:33 2012
Return-Path: <common-dev-return-77859-apmail-hadoop-common-dev-archive=hadoop.apache.org@hadoop.apache.org>
X-Original-To: apmail-hadoop-common-dev-archive@www.apache.org
Delivered-To: apmail-hadoop-common-dev-archive@www.apache.org
Received: from mail.apache.org (hermes.apache.org [140.211.11.3])
by minotaur.apache.org (Postfix) with SMTP id 59EBC9E37
for <apmail-hadoop-common-dev-archive@www.apache.org>; Mon, 27 Feb 2012 04:40:33 +0000 (UTC)
Received: (qmail 18808 invoked by uid 500); 27 Feb 2012 04:40:31 -0000
Delivered-To: apmail-hadoop-common-dev-archive@hadoop.apache.org
Received: (qmail 18750 invoked by uid 500); 27 Feb 2012 04:40:31 -0000
Mailing-List: contact common-dev-help@hadoop.apache.org; run by ezmlm
Precedence: bulk
List-Help: <mailto:common-dev-help@hadoop.apache.org>
List-Unsubscribe: <mailto:common-dev-unsubscribe@hadoop.apache.org>
List-Post: <mailto:common-dev@hadoop.apache.org>
List-Id: <common-dev.hadoop.apache.org>
Reply-To: common-dev@hadoop.apache.org
Delivered-To: mailing list common-dev@hadoop.apache.org
Delivered-To: moderator for common-dev@hadoop.apache.org
Received: (qmail 11250 invoked by uid 99); 27 Feb 2012 04:38:27 -0000
X-ASF-Spam-Status: No, hits=0.5 required=5.0
tests=RCVD_IN_DNSWL_NONE,REPTO_QUOTE_YAHOO,SPF_PASS
X-Spam-Check-By: apache.org
Received-SPF: pass (athena.apache.org: local policy)
X-Yahoo-Newman-Property: ymail-3
X-Yahoo-Newman-Id: 745006.50239.bm@omp1054.mail.ac4.yahoo.com
DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=yahoo.com; s=s1024; t=1330317477; bh=UvYUnYSUfZLS5zTc8FnAbwWWvNMQCDDFE6MH8O0VsNI=; h=X-YMail-OSG:Received:X-Mailer:References:Message-ID:Date:From:Reply-To:Subject:To:In-Reply-To:MIME-Version:Content-Type:Content-Transfer-Encoding; b=Mqmobajhgia5PjXBjg7uPPnNB19jlpr/cS/l9ZxzUkGA4hHZVhQHqo0xu2Iu11KGGweJeaLo1JiVlo0hAwXWl83zDvwe2wrCgsu7t4hySq4CpRUxsV68TL4xGlZtXcTb0DOaAUtznDyg1O9RsLqePT/3hSOf2MG3Vafx9WoalZ0=
DomainKey-Signature:a=rsa-sha1; q=dns; c=nofws;
s=s1024; d=yahoo.com;
h=X-YMail-OSG:Received:X-Mailer:References:Message-ID:Date:From:Reply-To:Subject:To:In-Reply-To:MIME-Version:Content-Type:Content-Transfer-Encoding;
b=z/qhyl+Y+bly+AVKI1o9lDX1Uvez3gDcfn0BxLb1LT3ArwMsgYHoH/65VSObIf4dqOh2ocO0VXYEDx89Yz7FXxcKnC1g5v+ZUFH3pBGkJ+8y3jz9uJPqp/cznTfPMC9q9ZIBYEZGMYFtyh7eS6pGk199AOvJN0Vyzfzuz7YJeb8=;
X-YMail-OSG: GKeq7gUVM1mz.wNq0MdZNOP7xAd5zBIqCz28SeFJv6U51bG
.lFId.b7pi_syOVxnQJ4PKHWhXK4VCHGM0QNVjbL3sG6wQwvB.bILMD0ncZe
5kc1S4CLuOpNqgE1dYD_Rg_sphLkfvqvHwjdqG36o_tR38Fk911w2yIPjsTb
LbcydnBr8yvCOmv3ro8sbEU_uYWfWmOTqlDERNVTVYOm2MPEIxvnI_iWpaor
IKuNHsZ_Ysqvs3ygXEMVj7y6shHmBaNZwLsHMHtMfi3CsQnlAJm8H5O2y6rl
oTBQEiZBa1uQzZbWouzL05jT7TBCqOrceHrhoefMQJBEdQbIAptaVWpRVu7_
JlFUdcGCEGUZzZV3Qclsg78oCMV9X4Ob_Eo7NkOAWaaXFLoNADCrScENwogk
JFi_HoB8vCxyqObDqsdJZkvd7t.nPKvJRB1nVPgWzsguPsucoq2gAQ4qyxGL
8xPYoW48BDHgOYPT_GyTIh_Ne3gXOxZUBICFMb5rO2EXArw0mlRHftK8tW8c
C8Z_3bEllKWgv0RMS4G2EnVpD1NjmUJgln6mygfiSKLFN
X-Mailer: YahooMailWebService/0.8.116.338427
References: <1329941845.89602.YahooMailNeo@web65901.mail.ac4.yahoo.com> <1329942015.73853.YahooMailNeo@web65903.mail.ac4.yahoo.com> <CALF7aMQuKkSNLUz=2yv6DKriKE5W87WUhO0g0kXKZakrDFWRxA@mail.gmail.com> <1329955071.13478.YahooMailNeo@web65904.mail.ac4.yahoo.com> <1329955330.2043.YahooMailNeo@web65906.mail.ac4.yahoo.com> <1330127722.24215.YahooMailNeo@web65902.mail.ac4.yahoo.com> <1330128067.11284.YahooMailNeo@web65901.mail.ac4.yahoo.com>
Message-ID: <1330317477.92236.YahooMailNeo@web65904.mail.ac4.yahoo.com>
Date: Sun, 26 Feb 2012 20:37:57 -0800 (PST)
From: "Tsz Wo \(Nicholas\), Sze" <s29752-hadoopgeneral@yahoo.com>
Reply-To: "Tsz Wo \(Nicholas\), Sze" <s29752-hadoopgeneral@yahoo.com>
Subject: Fw: [RESULT][VOTE] Merging 0.23-PB to 0.23
To: common dev <common-dev@hadoop.apache.org>,
hdfs dev <hdfs-dev@hadoop.apache.org>,
mapreduce-dev hadoop <mapreduce-dev@hadoop.apache.org>
In-Reply-To: <1330128067.11284.YahooMailNeo@web65901.mail.ac4.yahoo.com>
MIME-Version: 1.0
Content-Type: text/plain; charset=iso-8859-1
Content-Transfer-Encoding: quoted-printable
Hi dev,=0A=0AI am merging 0.23-PB back to 0.23.=A0 Please hold on your comm=
it to 0.23 for a moment.=A0 Thanks.=0A=0A=0ATsz-Wo Nicholas Sze=0AHortonwor=
ks Inc.=0Ahttp://hortonworks.com/=0A=0A=0A----- Forwarded Message -----=0AF=
rom: "Tsz Wo (Nicholas), Sze" <s29752-hadoopgeneral@yahoo.com>=0ATo: genera=
l hadoop <general@hadoop.apache.org> =0ASent: Friday, February 24, 2012 4:0=
1 PM=0ASubject: [RESULT][VOTE] Merging 0.23-PB to 0.23=0A=0AThere are six +=
1s (Mahadev, Eli, Suresh, Arun, Jitendra and myself) and no -1s.=A0 The vot=
e passed.=0A=0AI will send out emails to the dev mailing lists right before=
the merging.=0A=0AThanks everyone!=0A=0ATsz-Wo Nicholas Sze=0AHortonworks =
Inc.=0Ahttp://hortonworks.com/
From common-dev-return-77860-apmail-hadoop-common-dev-archive=hadoop.apache.org@hadoop.apache.org Mon Feb 27 04:52:13 2012
Return-Path: <common-dev-return-77860-apmail-hadoop-common-dev-archive=hadoop.apache.org@hadoop.apache.org>
X-Original-To: apmail-hadoop-common-dev-archive@www.apache.org
Delivered-To: apmail-hadoop-common-dev-archive@www.apache.org
Received: from mail.apache.org (hermes.apache.org [140.211.11.3])
by minotaur.apache.org (Postfix) with SMTP id CFD0A901D
for <apmail-hadoop-common-dev-archive@www.apache.org>; Mon, 27 Feb 2012 04:52:13 +0000 (UTC)
Received: (qmail 39092 invoked by uid 500); 27 Feb 2012 04:52:11 -0000
Delivered-To: apmail-hadoop-common-dev-archive@hadoop.apache.org
Received: (qmail 38922 invoked by uid 500); 27 Feb 2012 04:52:10 -0000
Mailing-List: contact common-dev-help@hadoop.apache.org; run by ezmlm
Precedence: bulk
List-Help: <mailto:common-dev-help@hadoop.apache.org>
List-Unsubscribe: <mailto:common-dev-unsubscribe@hadoop.apache.org>
List-Post: <mailto:common-dev@hadoop.apache.org>
List-Id: <common-dev.hadoop.apache.org>
Reply-To: common-dev@hadoop.apache.org
Delivered-To: mailing list common-dev@hadoop.apache.org
Received: (qmail 38873 invoked by uid 99); 27 Feb 2012 04:52:09 -0000
Received: from athena.apache.org (HELO athena.apache.org) (140.211.11.136)
by apache.org (qpsmtpd/0.29) with ESMTP; Mon, 27 Feb 2012 04:52:09 +0000
X-ASF-Spam-Status: No, hits=-2000.0 required=5.0
tests=ALL_TRUSTED,T_RP_MATCHES_RCVD
X-Spam-Check-By: apache.org
Received: from [140.211.11.116] (HELO hel.zones.apache.org) (140.211.11.116)
by apache.org (qpsmtpd/0.29) with ESMTP; Mon, 27 Feb 2012 04:52:08 +0000
Received: from hel.zones.apache.org (hel.zones.apache.org [140.211.11.116])
by hel.zones.apache.org (Postfix) with ESMTP id C432833C1FE
for <common-dev@hadoop.apache.org>; Mon, 27 Feb 2012 04:51:48 +0000 (UTC)
Date: Mon, 27 Feb 2012 04:51:48 +0000 (UTC)
From: "Martin A. Juell (Created) (JIRA)" <jira@apache.org>
To: common-dev@hadoop.apache.org
Message-ID: <34396313.22134.1330318308805.JavaMail.tomcat@hel.zones.apache.org>
Subject: [jira] [Created] (HADOOP-8114) Init scripts in 1.0.0/1.0.1 .deb
distribution appear to rely on $USER in an unhealthy way - breaks status
functionality, inconsistency between manual and automatic service startups
MIME-Version: 1.0
Content-Type: text/plain; charset=utf-8
Content-Transfer-Encoding: 7bit
X-JIRA-FingerPrint: 30527f35849b9dde25b450d4833f0394
Init scripts in 1.0.0/1.0.1 .deb distribution appear to rely on $USER in an unhealthy way - breaks status functionality, inconsistency between manual and automatic service startups
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
Key: HADOOP-8114
URL: https://issues.apache.org/jira/browse/HADOOP-8114
Project: Hadoop Common
Issue Type: Bug
Affects Versions: 1.0.0, 1.0.1
Environment: Debian/Ubuntu
Reporter: Martin A. Juell
When I run hadoop using
{{$ sudo /etc/init.d/hadoop-namenode start}} (or whatever service),
it creates pid file {{/var/run/hadoop/hadoop-root-namenode.pid}}.
When the namenode is automatically started at boot, the file is called
{{/var/run/hadoop/hadoop--namenode.pid}} , i.e. the user part is missing.
Either way, doing /etc/init.d/hadoop-namenode status always returns an error exit code.
I've snooped around a bit, and the cause seems to be that the name of the pid file to look for is hardcoded:
{{if start-stop-daemon --stop --quiet --oknodo --pidfile ${HADOOP_PID_DIR}/hadoop-hdfs-namenode.pid; then}}
(Line 77 of /etc/init.d/hadoop-jobtracker from hadoop-1.0.1 , .deb version)
{{start-stop-daemon -c}} doesn't change the {{$USER}} variable, but it appears that it should be set. I tried prepending {{USER=hdfs}} to the above line, starting the namenode, and now the pid file was named {{/var/run/hadoop/hadoop-hdfs-namenode.pid}}
Assuming I've understood thsi correctly, my proposed solution is to make the init scripts use a method of changing user where the {{$USER}} variable is also changed.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
From common-dev-return-77861-apmail-hadoop-common-dev-archive=hadoop.apache.org@hadoop.apache.org Mon Feb 27 05:10:48 2012
Return-Path: <common-dev-return-77861-apmail-hadoop-common-dev-archive=hadoop.apache.org@hadoop.apache.org>
X-Original-To: apmail-hadoop-common-dev-archive@www.apache.org
Delivered-To: apmail-hadoop-common-dev-archive@www.apache.org
Received: from mail.apache.org (hermes.apache.org [140.211.11.3])
by minotaur.apache.org (Postfix) with SMTP id D14A79718
for <apmail-hadoop-common-dev-archive@www.apache.org>; Mon, 27 Feb 2012 05:10:48 +0000 (UTC)
Received: (qmail 82127 invoked by uid 500); 27 Feb 2012 05:10:47 -0000
Delivered-To: apmail-hadoop-common-dev-archive@hadoop.apache.org
Received: (qmail 81124 invoked by uid 500); 27 Feb 2012 05:10:45 -0000
Mailing-List: contact common-dev-help@hadoop.apache.org; run by ezmlm
Precedence: bulk
List-Help: <mailto:common-dev-help@hadoop.apache.org>
List-Unsubscribe: <mailto:common-dev-unsubscribe@hadoop.apache.org>
List-Post: <mailto:common-dev@hadoop.apache.org>
List-Id: <common-dev.hadoop.apache.org>
Reply-To: common-dev@hadoop.apache.org
Delivered-To: mailing list common-dev@hadoop.apache.org
Received: (qmail 81051 invoked by uid 99); 27 Feb 2012 05:10:44 -0000
Received: from nike.apache.org (HELO nike.apache.org) (192.87.106.230)
by apache.org (qpsmtpd/0.29) with ESMTP; Mon, 27 Feb 2012 05:10:44 +0000
X-ASF-Spam-Status: No, hits=0.5 required=5.0
tests=RCVD_IN_DNSWL_NONE,REPTO_QUOTE_YAHOO,SPF_PASS
X-Spam-Check-By: apache.org
Received-SPF: pass (nike.apache.org: local policy)
Received: from [98.139.52.66] (HELO nm2-vm0.bullet.mail.ac4.yahoo.com) (98.139.52.66)
by apache.org (qpsmtpd/0.29) with SMTP; Mon, 27 Feb 2012 05:10:33 +0000
Received: from [98.139.52.193] by nm2.bullet.mail.ac4.yahoo.com with NNFMP; 27 Feb 2012 05:10:12 -0000
Received: from [98.139.52.157] by tm6.bullet.mail.ac4.yahoo.com with NNFMP; 27 Feb 2012 05:10:12 -0000
Received: from [127.0.0.1] by omp1040.mail.ac4.yahoo.com with NNFMP; 27 Feb 2012 05:10:12 -0000
X-Yahoo-Newman-Property: ymail-3
X-Yahoo-Newman-Id: 668517.31248.bm@omp1040.mail.ac4.yahoo.com
Received: (qmail 23494 invoked by uid 60001); 27 Feb 2012 05:09:42 -0000
DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=yahoo.com; s=s1024; t=1330319382; bh=Z+NxL6CTZ2mZVCxjCavuL5E988KzglBkuqXPMH3CVYg=; h=X-YMail-OSG:Received:X-Mailer:References:Message-ID:Date:From:Reply-To:Subject:To:In-Reply-To:MIME-Version:Content-Type:Content-Transfer-Encoding; b=6CFPidnT2ZdPPwFDRY5QRjgpeg1Pyb6HinH9LJpm7xTX7xHcvYwZZJglGtdaEJ2Urv4EQRM7E3IpXwG/sG+GSVD9xnDAZnAf+lIQaL7WZZF+TiqpLdCcmq1CyUX4SEtl4ZAkDaz+1tMWQmeOhHZl3Q/NDpjvlzY9HQ7J1XjuYd0=
DomainKey-Signature:a=rsa-sha1; q=dns; c=nofws;
s=s1024; d=yahoo.com;
h=X-YMail-OSG:Received:X-Mailer:References:Message-ID:Date:From:Reply-To:Subject:To:In-Reply-To:MIME-Version:Content-Type:Content-Transfer-Encoding;
b=AqBgQEdG3kyGzs8o4hacw9pmXlFTlTBAtgl8FgGFxU25hIBEgWAl7Hgn1YCmnY6GoVonXfmIfovgs0gnQwFKdVBX+MBo/82ngWb6n5ZstqfaM6/XoZyHGyZ3pME69oWInUctIFO8tRUV6g4OXrNSDmBisxa0ri17sHprGEus+jk=;
X-YMail-OSG: siQkOKAVM1nYNpNctQpuyLzU3k6BnOVdhXq543jlcsj1gY9
iSye7P9eTP7Ajh3YVrd.DV5OveDH.OcUzEOvGq.JxK9y52LUQgPAZ93NCdfG
2wd7H22HbYnCUidfguEknB2gnAyro0Y5pcjx9FWqLE1JQlLQe9ZllbG6FwHf
ElCG5iMlwaOUVXZ6hGe40am6nmSx4AdDTfVhJidykCy1uZqd.OwfnAE0SSd9
Y5etZGGrV1XGlUM3nblSL0PqdQjFApkaKoymyNZw0BcqOsAPzPseMrCQudnX
Qh39GCd43T6vIh5JnaUw5n6W3RQ2TvhH6OOeeKG.G3HRUn0fzDmzUaPxlCqE
Fm3ykLLGBWFvOrOIMlqM84f3wbAM8Ww6s06c22QnSIRpzfKNsjU03ySMbTus
2VGWPZxBNzJw1vnSJPgChULF1IZ25FiCopLaTtWfXAQaFWvc253siN0i6VUG
I8bBKvC3lv90Hl2BSCsPM8nkZkjpTUtnG66z7proxh1R8o2haGzn9XReJACi
IofNPivf1Ihz1HH4xAwCMrFS307QtyEvp4.GcI3W1THg0
Received: from [71.139.26.60] by web65906.mail.ac4.yahoo.com via HTTP; Sun, 26 Feb 2012 21:09:42 PST
X-Mailer: YahooMailWebService/0.8.116.338427
References: <1329941845.89602.YahooMailNeo@web65901.mail.ac4.yahoo.com> <1329942015.73853.YahooMailNeo@web65903.mail.ac4.yahoo.com> <CALF7aMQuKkSNLUz=2yv6DKriKE5W87WUhO0g0kXKZakrDFWRxA@mail.gmail.com> <1329955071.13478.YahooMailNeo@web65904.mail.ac4.yahoo.com> <1329955330.2043.YahooMailNeo@web65906.mail.ac4.yahoo.com> <1330127722.24215.YahooMailNeo@web65902.mail.ac4.yahoo.com> <1330128067.11284.YahooMailNeo@web65901.mail.ac4.yahoo.com> <1330317477.92236.YahooMailNeo@web65904.mail.ac4.yahoo.com> <1330317566.15580.YahooMailNeo@web65904.mail.ac4.yahoo.com>
Message-ID: <1330319382.23292.YahooMailNeo@web65906.mail.ac4.yahoo.com>
Date: Sun, 26 Feb 2012 21:09:42 -0800 (PST)
From: "Tsz Wo \(Nicholas\), Sze" <s29752-hadoopdev@yahoo.com>
Reply-To: "Tsz Wo \(Nicholas\), Sze" <s29752-hadoopdev@yahoo.com>
Subject: Re: [RESULT][VOTE] Merging 0.23-PB to 0.23
To: "mapreduce-dev@hadoop.apache.org" <mapreduce-dev@hadoop.apache.org>,
common dev <common-dev@hadoop.apache.org>,
hdfs dev <hdfs-dev@hadoop.apache.org>
In-Reply-To: <1330317566.15580.YahooMailNeo@web65904.mail.ac4.yahoo.com>
MIME-Version: 1.0
Content-Type: text/plain; charset=iso-8859-1
Content-Transfer-Encoding: quoted-printable
X-Virus-Checked: Checked by ClamAV on apache.org
Hi dev,=0A=0AThe merging is done.=A0 You may resume your commit as usual.=
=A0 Thank you.=0A=0A=0ATsz-Wo Nicholas Sze=0AHortonworks Inc.=0Ahttp://hort=
onworks.com/=0A=0A=0A=0A=0A----- Original Message -----=0AFrom: "Tsz Wo (Ni=
cholas), Sze" <s29752-hadoopdev@yahoo.com>=0ATo: common dev <common-dev@had=
oop.apache.org>; hdfs dev <hdfs-dev@hadoop.apache.org>; mapreduce-dev hadoo=
p <mapreduce-dev@hadoop.apache.org>=0ACc: =0ASent: Sunday, February 26, 201=
2 8:39 PM=0ASubject: Fw: [RESULT][VOTE] Merging 0.23-PB to 0.23=0A=0AHi dev=
,=0A=0AI am merging 0.23-PB back to 0.23.=A0 Please hold on your commit to =
0.23 for a moment.=A0 Thanks.=0A=0ATsz-Wo Nicholas Sze=0AHortonworks Inc.=
=0Ahttp://hortonworks.com/=0A=0A=0A----- Forwarded Message -----=0AFrom: "T=
sz Wo (Nicholas), Sze" <s29752-hadoopgeneral@yahoo.com>=0ATo: general hadoo=
p <general@hadoop.apache.org> =0ASent: Friday, February 24, 2012 4:01 PM=0A=
Subject: [RESULT][VOTE] Merging 0.23-PB to 0.23=0A=0AThere are six +1s (Mah=
adev, Eli, Suresh, Arun, Jitendra and myself) and no -1s.=A0 The vote passe=
d.=0A=0AI will send out emails to the dev mailing lists right before the me=
rging.=0A=0AThanks everyone!=0A=0ATsz-Wo Nicholas Sze=0AHortonworks Inc.=0A=
http://hortonworks.com/
From common-dev-return-77862-apmail-hadoop-common-dev-archive=hadoop.apache.org@hadoop.apache.org Mon Feb 27 09:21:15 2012
Return-Path: <common-dev-return-77862-apmail-hadoop-common-dev-archive=hadoop.apache.org@hadoop.apache.org>
X-Original-To: apmail-hadoop-common-dev-archive@www.apache.org
Delivered-To: apmail-hadoop-common-dev-archive@www.apache.org
Received: from mail.apache.org (hermes.apache.org [140.211.11.3])
by minotaur.apache.org (Postfix) with SMTP id 513999E78
for <apmail-hadoop-common-dev-archive@www.apache.org>; Mon, 27 Feb 2012 09:21:15 +0000 (UTC)
Received: (qmail 52932 invoked by uid 500); 27 Feb 2012 09:21:13 -0000
Delivered-To: apmail-hadoop-common-dev-archive@hadoop.apache.org
Received: (qmail 52428 invoked by uid 500); 27 Feb 2012 09:20:59 -0000
Mailing-List: contact common-dev-help@hadoop.apache.org; run by ezmlm
Precedence: bulk
List-Help: <mailto:common-dev-help@hadoop.apache.org>
List-Unsubscribe: <mailto:common-dev-unsubscribe@hadoop.apache.org>
List-Post: <mailto:common-dev@hadoop.apache.org>
List-Id: <common-dev.hadoop.apache.org>
Reply-To: common-dev@hadoop.apache.org
Delivered-To: mailing list common-dev@hadoop.apache.org
Received: (qmail 52333 invoked by uid 99); 27 Feb 2012 09:20:55 -0000
Received: from athena.apache.org (HELO athena.apache.org) (140.211.11.136)
by apache.org (qpsmtpd/0.29) with ESMTP; Mon, 27 Feb 2012 09:20:55 +0000
X-ASF-Spam-Status: No, hits=-2000.0 required=5.0
tests=ALL_TRUSTED
X-Spam-Check-By: apache.org
Received: from [140.211.11.8] (HELO aegis.apache.org) (140.211.11.8)
by apache.org (qpsmtpd/0.29) with ESMTP; Mon, 27 Feb 2012 09:20:53 +0000
Received: from aegis (localhost [127.0.0.1])
by aegis.apache.org (Postfix) with ESMTP id 36E7FC00A0
for <common-dev@hadoop.apache.org>; Mon, 27 Feb 2012 09:20:33 +0000 (UTC)
Date: Mon, 27 Feb 2012 09:20:33 +0000 (UTC)
From: Apache Jenkins Server <jenkins@builds.apache.org>
To: common-dev@hadoop.apache.org
Message-ID: <1839391439.2071330334433216.JavaMail.hudson@aegis>
In-Reply-To: <841917880.761330248272040.JavaMail.hudson@aegis>
References: <841917880.761330248272040.JavaMail.hudson@aegis>
Subject: Build failed in Jenkins: Hadoop-Common-0.23-PB-Build #5
MIME-Version: 1.0
Content-Type: text/plain; charset=UTF-8
Content-Transfer-Encoding: 7bit
X-Jenkins-Job: Hadoop-Common-0.23-PB-Build
X-Jenkins-Result: FAILURE
See <https://builds.apache.org/job/Hadoop-Common-0.23-PB-Build/5/changes>
Changes:
[szetszwo] Merge r1293501 through r1293896 from 0.23.
------------------------------------------
[...truncated 12382 lines...]
[javadoc] Loading source files for package org.apache.hadoop.io...
[javadoc] Loading source files for package org.apache.hadoop.io.compress...
[javadoc] Loading source files for package org.apache.hadoop.io.compress.bzip2...
[javadoc] Loading source files for package org.apache.hadoop.io.compress.lz4...
[javadoc] Loading source files for package org.apache.hadoop.io.compress.snappy...
[javadoc] Loading source files for package org.apache.hadoop.io.compress.zlib...
[javadoc] Loading source files for package org.apache.hadoop.io.file.tfile...
[javadoc] Loading source files for package org.apache.hadoop.io.nativeio...
[javadoc] Loading source files for package org.apache.hadoop.io.retry...
[javadoc] Loading source files for package org.apache.hadoop.io.serializer...
[javadoc] Loading source files for package org.apache.hadoop.io.serializer.avro...
[javadoc] Loading source files for package org.apache.hadoop.ipc...
[javadoc] Loading source files for package org.apache.hadoop.ipc.metrics...
[javadoc] Loading source files for package org.apache.hadoop.jmx...
[javadoc] Loading source files for package org.apache.hadoop.log...
[javadoc] Loading source files for package org.apache.hadoop.log.metrics...
[javadoc] Loading source files for package org.apache.hadoop.metrics...
[javadoc] Loading source files for package org.apache.hadoop.metrics.file...
[javadoc] Loading source files for package org.apache.hadoop.metrics.ganglia...
[javadoc] Loading source files for package org.apache.hadoop.metrics.jvm...
[javadoc] Loading source files for package org.apache.hadoop.metrics.spi...
[javadoc] Loading source files for package org.apache.hadoop.metrics.util...
[javadoc] Loading source files for package org.apache.hadoop.metrics2...
[javadoc] Loading source files for package org.apache.hadoop.metrics2.annotation...
[javadoc] Loading source files for package org.apache.hadoop.metrics2.filter...
[javadoc] Loading source files for package org.apache.hadoop.metrics2.impl...
[javadoc] Loading source files for package org.apache.hadoop.metrics2.lib...
[javadoc] Loading source files for package org.apache.hadoop.metrics2.sink...
[javadoc] Loading source files for package org.apache.hadoop.metrics2.sink.ganglia...
[javadoc] Loading source files for package org.apache.hadoop.metrics2.source...
[javadoc] Loading source files for package org.apache.hadoop.metrics2.util...
[javadoc] Loading source files for package org.apache.hadoop.net...
[javadoc] Loading source files for package org.apache.hadoop.record...
[javadoc] Loading source files for package org.apache.hadoop.record.compiler...
[javadoc] Loading source files for package org.apache.hadoop.record.compiler.ant...
[javadoc] Loading source files for package org.apache.hadoop.record.compiler.generated...
[javadoc] Loading source files for package org.apache.hadoop.record.meta...
[javadoc] Loading source files for package org.apache.hadoop.security...
[javadoc] Loading source files for package org.apache.hadoop.security.authorize...
[javadoc] Loading source files for package org.apache.hadoop.security.token...
[javadoc] Loading source files for package org.apache.hadoop.security.token.delegation...
[javadoc] Loading source files for package org.apache.hadoop.tools...
[javadoc] Loading source files for package org.apache.hadoop.util...
[javadoc] Loading source files for package org.apache.hadoop.util.bloom...
[javadoc] Loading source files for package org.apache.hadoop.util.hash...
[javadoc] 2 errors
[xslt] Processing <https://builds.apache.org/job/Hadoop-Common-0.23-PB-Build/ws/trunk/hadoop-common-project/hadoop-common/target/findbugsXml.xml> to <https://builds.apache.org/job/Hadoop-Common-0.23-PB-Build/ws/trunk/hadoop-common-project/hadoop-common/target/site/findbugs.html>
[xslt] Loading stylesheet /home/jenkins/tools/findbugs/latest/src/xsl/default.xsl
[INFO] Executed tasks
[INFO]
[INFO] --- maven-antrun-plugin:1.6:run (pre-dist) @ hadoop-common ---
[INFO] Executing tasks
main:
[INFO] Executed tasks
[INFO]
[INFO] >>> maven-javadoc-plugin:2.8.1:javadoc (default) @ hadoop-common >>>
[INFO]
[INFO] --- maven-antrun-plugin:1.6:run (create-testdirs) @ hadoop-common ---
[INFO] Executing tasks
main:
[INFO] Executed tasks
[INFO]
[INFO] --- build-helper-maven-plugin:1.5:add-source (add-source) @ hadoop-common ---
[INFO] Source directory: <https://builds.apache.org/job/Hadoop-Common-0.23-PB-Build/ws/trunk/hadoop-common-project/hadoop-common/target/generated-sources/java> added.
[INFO]
[INFO] --- build-helper-maven-plugin:1.5:add-test-source (add-test-source) @ hadoop-common ---
[INFO] Test Source directory: <https://builds.apache.org/job/Hadoop-Common-0.23-PB-Build/ws/trunk/hadoop-common-project/hadoop-common/target/generated-test-sources/java> added.
[INFO]
[INFO] --- maven-antrun-plugin:1.6:run (compile-proto) @ hadoop-common ---
[INFO] Executing tasks
main:
[INFO] Executed tasks
[INFO]
[INFO] --- maven-antrun-plugin:1.6:run (save-version) @ hadoop-common ---
[INFO] Executing tasks
main:
[INFO] Executed tasks
[INFO]
[INFO] <<< maven-javadoc-plugin:2.8.1:javadoc (default) @ hadoop-common <<<
[INFO]
[INFO] --- maven-javadoc-plugin:2.8.1:javadoc (default) @ hadoop-common ---
[INFO]
ExcludePrivateAnnotationsStandardDoclet
9 warnings
[WARNING] Javadoc Warnings
[WARNING] <https://builds.apache.org/job/Hadoop-Common-0.23-PB-Build/ws/trunk/hadoop-common-project/hadoop-common/src/main/java/org/apache/hadoop/io/FastByteComparisons.java>:25: warning: sun.misc.Unsafe is Sun proprietary API and may be removed in a future release
[WARNING] import sun.misc.Unsafe;
[WARNING] ^
[WARNING] <https://builds.apache.org/job/Hadoop-Common-0.23-PB-Build/ws/trunk/hadoop-common-project/hadoop-common/src/main/java/org/apache/hadoop/io/FastByteComparisons.java>:117: warning: sun.misc.Unsafe is Sun proprietary API and may be removed in a future release
[WARNING] static final Unsafe theUnsafe;
[WARNING] ^
[WARNING] <https://builds.apache.org/job/Hadoop-Common-0.23-PB-Build/ws/trunk/hadoop-common-project/hadoop-common/src/main/java/org/apache/hadoop/security/SecurityUtil.java>:49: warning: sun.net.dns.ResolverConfiguration is Sun proprietary API and may be removed in a future release
[WARNING] import sun.net.dns.ResolverConfiguration;
[WARNING] ^
[WARNING] <https://builds.apache.org/job/Hadoop-Common-0.23-PB-Build/ws/trunk/hadoop-common-project/hadoop-common/src/main/java/org/apache/hadoop/security/SecurityUtil.java>:50: warning: sun.net.util.IPAddressUtil is Sun proprietary API and may be removed in a future release
[WARNING] import sun.net.util.IPAddressUtil;
[WARNING] ^
[WARNING] <https://builds.apache.org/job/Hadoop-Common-0.23-PB-Build/ws/trunk/hadoop-common-project/hadoop-common/src/main/java/org/apache/hadoop/security/SecurityUtil.java>:51: warning: sun.security.jgss.krb5.Krb5Util is Sun proprietary API and may be removed in a future release
[WARNING] import sun.security.jgss.krb5.Krb5Util;
[WARNING] ^
[WARNING] <https://builds.apache.org/job/Hadoop-Common-0.23-PB-Build/ws/trunk/hadoop-common-project/hadoop-common/src/main/java/org/apache/hadoop/security/SecurityUtil.java>:52: warning: sun.security.krb5.Credentials is Sun proprietary API and may be removed in a future release
[WARNING] import sun.security.krb5.Credentials;
[WARNING] ^
[WARNING] <https://builds.apache.org/job/Hadoop-Common-0.23-PB-Build/ws/trunk/hadoop-common-project/hadoop-common/src/main/java/org/apache/hadoop/security/SecurityUtil.java>:53: warning: sun.security.krb5.PrincipalName is Sun proprietary API and may be removed in a future release
[WARNING] import sun.security.krb5.PrincipalName;
[WARNING] ^
[WARNING] <https://builds.apache.org/job/Hadoop-Common-0.23-PB-Build/ws/trunk/hadoop-common-project/hadoop-common/src/main/java/org/apache/hadoop/security/HadoopKerberosName.java>:28: warning: sun.security.krb5.Config is Sun proprietary API and may be removed in a future release
[WARNING] import sun.security.krb5.Config;
[WARNING] ^
[WARNING] <https://builds.apache.org/job/Hadoop-Common-0.23-PB-Build/ws/trunk/hadoop-common-project/hadoop-common/src/main/java/org/apache/hadoop/security/HadoopKerberosName.java>:29: warning: sun.security.krb5.KrbException is Sun proprietary API and may be removed in a future release
[WARNING] import sun.security.krb5.KrbException;
[WARNING] ^
[INFO]
[INFO] --- maven-assembly-plugin:2.2.1:single (dist) @ hadoop-common ---
[WARNING] The following patterns were never triggered in this artifact exclusion filter:
o 'org.apache.ant:*:jar'
o 'jdiff:jdiff:jar'
[INFO] share/hadoop/common/jdiff/ already added, skipping
[INFO] Copying files to <https://builds.apache.org/job/Hadoop-Common-0.23-PB-Build/ws/trunk/hadoop-common-project/hadoop-common/target/hadoop-common-0.23.3-SNAPSHOT>
[INFO] share/hadoop/common/jdiff/ already added, skipping
[INFO]
[INFO] --- maven-jar-plugin:2.3.1:jar (default-jar) @ hadoop-common ---
[INFO]
[INFO] --- maven-source-plugin:2.1.2:jar-no-fork (hadoop-java-sources) @ hadoop-common ---
[INFO] org already added, skipping
[INFO] org/apache already added, skipping
[INFO] org/apache/hadoop already added, skipping
[INFO] org/apache/hadoop/ipc already added, skipping
[INFO] org/apache/hadoop/ipc/protobuf already added, skipping
[INFO] Building jar: <https://builds.apache.org/job/Hadoop-Common-0.23-PB-Build/ws/trunk/hadoop-common-project/hadoop-common/target/hadoop-common-0.23.3-SNAPSHOT-sources.jar>
[INFO] org already added, skipping
[INFO] org/apache already added, skipping
[INFO] org/apache/hadoop already added, skipping
[INFO] org/apache/hadoop/ipc already added, skipping
[INFO] org/apache/hadoop/ipc/protobuf already added, skipping
[WARNING] Artifact org.apache.hadoop:hadoop-common:java-source:sources:0.23.3-SNAPSHOT already attached to project, ignoring duplicate
[INFO]
[INFO] --- maven-site-plugin:3.0:attach-descriptor (attach-descriptor) @ hadoop-common ---
[INFO]
[INFO] --- maven-antrun-plugin:1.6:run (tar) @ hadoop-common ---
[INFO] Executing tasks
main:
[INFO] Executed tasks
[INFO]
[INFO] --- maven-javadoc-plugin:2.8.1:jar (module-javadocs) @ hadoop-common ---
[INFO]
ExcludePrivateAnnotationsStandardDoclet
9 warnings
[WARNING] Javadoc Warnings
[WARNING] <https://builds.apache.org/job/Hadoop-Common-0.23-PB-Build/ws/trunk/hadoop-common-project/hadoop-common/src/main/java/org/apache/hadoop/io/FastByteComparisons.java>:25: warning: sun.misc.Unsafe is Sun proprietary API and may be removed in a future release
[WARNING] import sun.misc.Unsafe;
[WARNING] ^
[WARNING] <https://builds.apache.org/job/Hadoop-Common-0.23-PB-Build/ws/trunk/hadoop-common-project/hadoop-common/src/main/java/org/apache/hadoop/io/FastByteComparisons.java>:117: warning: sun.misc.Unsafe is Sun proprietary API and may be removed in a future release
[WARNING] static final Unsafe theUnsafe;
[WARNING] ^
[WARNING] <https://builds.apache.org/job/Hadoop-Common-0.23-PB-Build/ws/trunk/hadoop-common-project/hadoop-common/src/main/java/org/apache/hadoop/security/SecurityUtil.java>:49: warning: sun.net.dns.ResolverConfiguration is Sun proprietary API and may be removed in a future release
[WARNING] import sun.net.dns.ResolverConfiguration;
[WARNING] ^
[WARNING] <https://builds.apache.org/job/Hadoop-Common-0.23-PB-Build/ws/trunk/hadoop-common-project/hadoop-common/src/main/java/org/apache/hadoop/security/SecurityUtil.java>:50: warning: sun.net.util.IPAddressUtil is Sun proprietary API and may be removed in a future release
[WARNING] import sun.net.util.IPAddressUtil;
[WARNING] ^
[WARNING] <https://builds.apache.org/job/Hadoop-Common-0.23-PB-Build/ws/trunk/hadoop-common-project/hadoop-common/src/main/java/org/apache/hadoop/security/SecurityUtil.java>:51: warning: sun.security.jgss.krb5.Krb5Util is Sun proprietary API and may be removed in a future release
[WARNING] import sun.security.jgss.krb5.Krb5Util;
[WARNING] ^
[WARNING] <https://builds.apache.org/job/Hadoop-Common-0.23-PB-Build/ws/trunk/hadoop-common-project/hadoop-common/src/main/java/org/apache/hadoop/security/SecurityUtil.java>:52: warning: sun.security.krb5.Credentials is Sun proprietary API and may be removed in a future release
[WARNING] import sun.security.krb5.Credentials;
[WARNING] ^
[WARNING] <https://builds.apache.org/job/Hadoop-Common-0.23-PB-Build/ws/trunk/hadoop-common-project/hadoop-common/src/main/java/org/apache/hadoop/security/SecurityUtil.java>:53: warning: sun.security.krb5.PrincipalName is Sun proprietary API and may be removed in a future release
[WARNING] import sun.security.krb5.PrincipalName;
[WARNING] ^
[WARNING] <https://builds.apache.org/job/Hadoop-Common-0.23-PB-Build/ws/trunk/hadoop-common-project/hadoop-common/src/main/java/org/apache/hadoop/security/HadoopKerberosName.java>:28: warning: sun.security.krb5.Config is Sun proprietary API and may be removed in a future release
[WARNING] import sun.security.krb5.Config;
[WARNING] ^
[WARNING] <https://builds.apache.org/job/Hadoop-Common-0.23-PB-Build/ws/trunk/hadoop-common-project/hadoop-common/src/main/java/org/apache/hadoop/security/HadoopKerberosName.java>:29: warning: sun.security.krb5.KrbException is Sun proprietary API and may be removed in a future release
[WARNING] import sun.security.krb5.KrbException;
[WARNING] ^
[INFO] Building jar: <https://builds.apache.org/job/Hadoop-Common-0.23-PB-Build/ws/trunk/hadoop-common-project/hadoop-common/target/hadoop-common-0.23.3-SNAPSHOT-javadoc.jar>
[INFO]
[INFO] --- maven-checkstyle-plugin:2.6:checkstyle (default-cli) @ hadoop-common ---
[INFO]
[INFO] There are 8670 checkstyle errors.
[WARNING] Unable to locate Source XRef to link to - DISABLED
[INFO]
[INFO] --- findbugs-maven-plugin:2.3.2:findbugs (default-cli) @ hadoop-common ---
[INFO] ****** FindBugsMojo execute *******
[INFO] canGenerate is true
[INFO] ****** FindBugsMojo executeFindbugs *******
[INFO] Temp File is <https://builds.apache.org/job/Hadoop-Common-0.23-PB-Build/ws/trunk/hadoop-common-project/hadoop-common/target/findbugsTemp.xml>
[INFO] Fork Value is true
[java] The following classes needed for analysis were missing:
[java] org.codehaus.jackson.FormatSchema
[java] org.codehaus.jackson.format.InputAccessor
[java] Missing classes: 1
[INFO] xmlOutput is false
[INFO]
[INFO] ------------------------------------------------------------------------
[INFO] Building Apache Hadoop Common Project 0.23.3-SNAPSHOT
[INFO] ------------------------------------------------------------------------
[INFO]
[INFO] --- maven-clean-plugin:2.4.1:clean (default-clean) @ hadoop-common-project ---
[INFO] Deleting <https://builds.apache.org/job/Hadoop-Common-0.23-PB-Build/ws/trunk/hadoop-common-project/target>
[INFO]
[INFO] --- maven-antrun-plugin:1.6:run (create-testdirs) @ hadoop-common-project ---
[INFO] Executing tasks
main:
[mkdir] Created dir: <https://builds.apache.org/job/Hadoop-Common-0.23-PB-Build/ws/trunk/hadoop-common-project/target/test-dir>
[INFO] Executed tasks
[INFO]
[INFO] --- maven-source-plugin:2.1.2:jar-no-fork (hadoop-java-sources) @ hadoop-common-project ---
[INFO]
[INFO] --- maven-site-plugin:3.0:attach-descriptor (attach-descriptor) @ hadoop-common-project ---
[INFO]
[INFO] --- maven-javadoc-plugin:2.8.1:jar (module-javadocs) @ hadoop-common-project ---
[INFO] Not executing Javadoc as the project is not a Java classpath-capable package
[INFO]
[INFO] --- maven-checkstyle-plugin:2.6:checkstyle (default-cli) @ hadoop-common-project ---
[INFO]
[INFO] --- findbugs-maven-plugin:2.3.2:findbugs (default-cli) @ hadoop-common-project ---
[INFO] ****** FindBugsMojo execute *******
[INFO] canGenerate is false
[INFO] ------------------------------------------------------------------------
[INFO] Reactor Summary:
[INFO]
[INFO] Apache Hadoop Annotations ......................... SUCCESS [12.466s]
[INFO] Apache Hadoop Auth ................................ SUCCESS [19.148s]
[INFO] Apache Hadoop Auth Examples ....................... SUCCESS [8.170s]
[INFO] Apache Hadoop Common .............................. SUCCESS [4:20.267s]
[INFO] Apache Hadoop Common Project ...................... SUCCESS [0.032s]
[INFO] ------------------------------------------------------------------------
[INFO] BUILD SUCCESS
[INFO] ------------------------------------------------------------------------
[INFO] Total time: 5:01.047s
[INFO] Finished at: Mon Feb 27 09:10:32 UTC 2012
[INFO] Final Memory: 80M/806M
[INFO] ------------------------------------------------------------------------
+ /home/jenkins/tools/maven/latest/bin/mvn test -Pclover -DcloverLicenseLocation=/home/jenkins/tools/clover/latest/lib/clover.license
Build step 'Execute shell' marked build as failure
[WARNINGS] Skipping publisher since build result is FAILURE
Archiving artifacts
Recording test results
Publishing Javadoc
Recording fingerprints
From common-dev-return-77863-apmail-hadoop-common-dev-archive=hadoop.apache.org@hadoop.apache.org Mon Feb 27 09:26:01 2012
Return-Path: <common-dev-return-77863-apmail-hadoop-common-dev-archive=hadoop.apache.org@hadoop.apache.org>
X-Original-To: apmail-hadoop-common-dev-archive@www.apache.org
Delivered-To: apmail-hadoop-common-dev-archive@www.apache.org
Received: from mail.apache.org (hermes.apache.org [140.211.11.3])
by minotaur.apache.org (Postfix) with SMTP id 9D24D9AC1
for <apmail-hadoop-common-dev-archive@www.apache.org>; Mon, 27 Feb 2012 09:26:01 +0000 (UTC)
Received: (qmail 66079 invoked by uid 500); 27 Feb 2012 09:26:00 -0000
Delivered-To: apmail-hadoop-common-dev-archive@hadoop.apache.org
Received: (qmail 66020 invoked by uid 500); 27 Feb 2012 09:26:00 -0000
Mailing-List: contact common-dev-help@hadoop.apache.org; run by ezmlm
Precedence: bulk
List-Help: <mailto:common-dev-help@hadoop.apache.org>
List-Unsubscribe: <mailto:common-dev-unsubscribe@hadoop.apache.org>
List-Post: <mailto:common-dev@hadoop.apache.org>
List-Id: <common-dev.hadoop.apache.org>
Reply-To: common-dev@hadoop.apache.org
Delivered-To: mailing list common-dev@hadoop.apache.org
Received: (qmail 66012 invoked by uid 99); 27 Feb 2012 09:26:00 -0000
Received: from nike.apache.org (HELO nike.apache.org) (192.87.106.230)
by apache.org (qpsmtpd/0.29) with ESMTP; Mon, 27 Feb 2012 09:26:00 +0000
X-ASF-Spam-Status: No, hits=-2000.0 required=5.0
tests=ALL_TRUSTED
X-Spam-Check-By: apache.org
Received: from [140.211.11.8] (HELO aegis.apache.org) (140.211.11.8)
by apache.org (qpsmtpd/0.29) with ESMTP; Mon, 27 Feb 2012 09:25:58 +0000
Received: from aegis (localhost [127.0.0.1])
by aegis.apache.org (Postfix) with ESMTP id DFB57C00A0
for <common-dev@hadoop.apache.org>; Mon, 27 Feb 2012 09:25:36 +0000 (UTC)
Date: Mon, 27 Feb 2012 09:25:36 +0000 (UTC)
From: Apache Jenkins Server <jenkins@builds.apache.org>
To: common-dev@hadoop.apache.org
Message-ID: <559159438.2101330334736901.JavaMail.hudson@aegis>
In-Reply-To: <355028509.711330247985059.JavaMail.hudson@aegis>
References: <355028509.711330247985059.JavaMail.hudson@aegis>
Subject: Jenkins build is back to normal : Hadoop-Common-trunk #330
MIME-Version: 1.0
Content-Type: text/plain; charset=UTF-8
Content-Transfer-Encoding: 7bit
X-Jenkins-Job: Hadoop-Common-trunk
X-Jenkins-Result: SUCCESS
X-Virus-Checked: Checked by ClamAV on apache.org
See <https://builds.apache.org/job/Hadoop-Common-trunk/330/>
From common-dev-return-77864-apmail-hadoop-common-dev-archive=hadoop.apache.org@hadoop.apache.org Mon Feb 27 15:39:13 2012
Return-Path: <common-dev-return-77864-apmail-hadoop-common-dev-archive=hadoop.apache.org@hadoop.apache.org>
X-Original-To: apmail-hadoop-common-dev-archive@www.apache.org
Delivered-To: apmail-hadoop-common-dev-archive@www.apache.org
Received: from mail.apache.org (hermes.apache.org [140.211.11.3])
by minotaur.apache.org (Postfix) with SMTP id E926796EA
for <apmail-hadoop-common-dev-archive@www.apache.org>; Mon, 27 Feb 2012 15:39:12 +0000 (UTC)
Received: (qmail 37098 invoked by uid 500); 27 Feb 2012 15:39:10 -0000
Delivered-To: apmail-hadoop-common-dev-archive@hadoop.apache.org
Received: (qmail 37030 invoked by uid 500); 27 Feb 2012 15:39:10 -0000
Mailing-List: contact common-dev-help@hadoop.apache.org; run by ezmlm
Precedence: bulk
List-Help: <mailto:common-dev-help@hadoop.apache.org>
List-Unsubscribe: <mailto:common-dev-unsubscribe@hadoop.apache.org>
List-Post: <mailto:common-dev@hadoop.apache.org>
List-Id: <common-dev.hadoop.apache.org>
Reply-To: common-dev@hadoop.apache.org
Delivered-To: mailing list common-dev@hadoop.apache.org
Received: (qmail 37018 invoked by uid 99); 27 Feb 2012 15:39:10 -0000
Received: from athena.apache.org (HELO athena.apache.org) (140.211.11.136)
by apache.org (qpsmtpd/0.29) with ESMTP; Mon, 27 Feb 2012 15:39:10 +0000
X-ASF-Spam-Status: No, hits=-2000.0 required=5.0
tests=ALL_TRUSTED,T_RP_MATCHES_RCVD
X-Spam-Check-By: apache.org
Received: from [140.211.11.116] (HELO hel.zones.apache.org) (140.211.11.116)
by apache.org (qpsmtpd/0.29) with ESMTP; Mon, 27 Feb 2012 15:39:09 +0000
Received: from hel.zones.apache.org (hel.zones.apache.org [140.211.11.116])
by hel.zones.apache.org (Postfix) with ESMTP id F232033D1F1
for <common-dev@hadoop.apache.org>; Mon, 27 Feb 2012 15:38:48 +0000 (UTC)
Date: Mon, 27 Feb 2012 15:38:48 +0000 (UTC)
From: "Marc Harris (Created) (JIRA)" <jira@apache.org>
To: common-dev@hadoop.apache.org
Message-ID: <2097895001.23109.1330357128993.JavaMail.tomcat@hel.zones.apache.org>
Subject: [jira] [Created] (HADOOP-8115) configuration entry in core-site.xml
gets silently ignored
MIME-Version: 1.0
Content-Type: text/plain; charset=utf-8
Content-Transfer-Encoding: 7bit
X-JIRA-FingerPrint: 30527f35849b9dde25b450d4833f0394
configuration entry in core-site.xml gets silently ignored
----------------------------------------------------------
Key: HADOOP-8115
URL: https://issues.apache.org/jira/browse/HADOOP-8115
Project: Hadoop Common
Issue Type: Bug
Environment: v 0.20.203.0
Standard tar release (i.e. not Cloudera or anything)
Ubuntu
Reporter: Marc Harris
The order of loading configuration files (and thus the order of priority from least to most) seems to be as follows:
core-default.xml, core-site.xml, hdfs-default.xml, hdfs-site.xml.
This means that a configuration parameter that is set in hdfs-default.xml will override that value set in core-site.xml.
Either
(1) Parameters should be able to go in any site.xml file, and override any default.xml, even if they don't "match", or
(2) Putting a parameter in the "wrong" site.xml file should be considered an error, and result in at the very least a warning.
What in fact happens is that the parameter is silently ignored, which is the worst combination.
I my opinion, it is counter-intuitive that a value in a site.xml file should be overridden by a value in a default.xml file, so I would choose option (1).
The particular example here was dfs.http.address, by the way.
I marked this as major rather than minor since it was not at all obvious what the problem (and therefore the workaround was) and eventually required attaching to a running production service with a debugger to find out why the parameter I was setting was being ignored.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
From common-dev-return-77865-apmail-hadoop-common-dev-archive=hadoop.apache.org@hadoop.apache.org Mon Feb 27 22:20:46 2012
Return-Path: <common-dev-return-77865-apmail-hadoop-common-dev-archive=hadoop.apache.org@hadoop.apache.org>
X-Original-To: apmail-hadoop-common-dev-archive@www.apache.org
Delivered-To: apmail-hadoop-common-dev-archive@www.apache.org
Received: from mail.apache.org (hermes.apache.org [140.211.11.3])
by minotaur.apache.org (Postfix) with SMTP id 3DCAB97A2
for <apmail-hadoop-common-dev-archive@www.apache.org>; Mon, 27 Feb 2012 22:20:46 +0000 (UTC)
Received: (qmail 40767 invoked by uid 500); 27 Feb 2012 22:20:43 -0000
Delivered-To: apmail-hadoop-common-dev-archive@hadoop.apache.org
Received: (qmail 40647 invoked by uid 500); 27 Feb 2012 22:20:43 -0000
Mailing-List: contact common-dev-help@hadoop.apache.org; run by ezmlm
Precedence: bulk
List-Help: <mailto:common-dev-help@hadoop.apache.org>
List-Unsubscribe: <mailto:common-dev-unsubscribe@hadoop.apache.org>
List-Post: <mailto:common-dev@hadoop.apache.org>
List-Id: <common-dev.hadoop.apache.org>
Reply-To: common-dev@hadoop.apache.org
Delivered-To: mailing list common-dev@hadoop.apache.org
Received: (qmail 40611 invoked by uid 99); 27 Feb 2012 22:20:43 -0000
Received: from nike.apache.org (HELO nike.apache.org) (192.87.106.230)
by apache.org (qpsmtpd/0.29) with ESMTP; Mon, 27 Feb 2012 22:20:43 +0000
X-ASF-Spam-Status: No, hits=-2000.0 required=5.0
tests=ALL_TRUSTED,T_RP_MATCHES_RCVD
X-Spam-Check-By: apache.org
Received: from [140.211.11.116] (HELO hel.zones.apache.org) (140.211.11.116)
by apache.org (qpsmtpd/0.29) with ESMTP; Mon, 27 Feb 2012 22:20:41 +0000
Received: from hel.zones.apache.org (hel.zones.apache.org [140.211.11.116])
by hel.zones.apache.org (Postfix) with ESMTP id 4AE8B33D941
for <common-dev@hadoop.apache.org>; Mon, 27 Feb 2012 22:19:50 +0000 (UTC)
Date: Mon, 27 Feb 2012 22:19:50 +0000 (UTC)
From: "Aaron T. Myers (Created) (JIRA)" <jira@apache.org>
To: common-dev@hadoop.apache.org
Message-ID: <280635416.25133.1330381190309.JavaMail.tomcat@hel.zones.apache.org>
Subject: [jira] [Created] (HADOOP-8116) HA: RetriableCommand is using
RetryPolicy incorrectly after HADOOP-7896
MIME-Version: 1.0
Content-Type: text/plain; charset=utf-8
Content-Transfer-Encoding: 7bit
X-JIRA-FingerPrint: 30527f35849b9dde25b450d4833f0394
X-Virus-Checked: Checked by ClamAV on apache.org
HA: RetriableCommand is using RetryPolicy incorrectly after HADOOP-7896
-----------------------------------------------------------------------
Key: HADOOP-8116
URL: https://issues.apache.org/jira/browse/HADOOP-8116
Project: Hadoop Common
Issue Type: Sub-task
Components: util
Affects Versions: HA Branch (HDFS-1623)
Reporter: Aaron T. Myers
Assignee: Aaron T. Myers
HADOOP-7896 (on the HA branch) refactored RetryAction from an enum to a class, and also moved the act of sleeping to delay retries from the RetryPolicy implementations into RetryInvocationHandler. RetriableCommand, in the rewritten distcp tool, uses RetryPolicy and associated classes from o.a.h.io.retry. When MAPREDUCE-2765 was merged into the HA branch, RetriableCommand wasn't adjusted accordingly to make use of the new structure of the o.a.h.io.retry classes.
It's probably generally not kosher for RetriableCommand to be using the RetryPolicy classes at all, since they're not really intended to be used except by RetryInvocationHandler. But, regardless, this JIRA aims to make distcp's use of the o.a.h.io.retry classes functional again.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
From common-dev-return-77866-apmail-hadoop-common-dev-archive=hadoop.apache.org@hadoop.apache.org Tue Feb 28 00:28:11 2012
Return-Path: <common-dev-return-77866-apmail-hadoop-common-dev-archive=hadoop.apache.org@hadoop.apache.org>
X-Original-To: apmail-hadoop-common-dev-archive@www.apache.org
Delivered-To: apmail-hadoop-common-dev-archive@www.apache.org
Received: from mail.apache.org (hermes.apache.org [140.211.11.3])
by minotaur.apache.org (Postfix) with SMTP id 1B4D29329
for <apmail-hadoop-common-dev-archive@www.apache.org>; Tue, 28 Feb 2012 00:28:11 +0000 (UTC)
Received: (qmail 90800 invoked by uid 500); 28 Feb 2012 00:28:09 -0000
Delivered-To: apmail-hadoop-common-dev-archive@hadoop.apache.org
Received: (qmail 90577 invoked by uid 500); 28 Feb 2012 00:28:09 -0000
Mailing-List: contact common-dev-help@hadoop.apache.org; run by ezmlm
Precedence: bulk
List-Help: <mailto:common-dev-help@hadoop.apache.org>
List-Unsubscribe: <mailto:common-dev-unsubscribe@hadoop.apache.org>
List-Post: <mailto:common-dev@hadoop.apache.org>
List-Id: <common-dev.hadoop.apache.org>
Reply-To: common-dev@hadoop.apache.org
Delivered-To: mailing list common-dev@hadoop.apache.org
Received: (qmail 90569 invoked by uid 99); 28 Feb 2012 00:28:09 -0000
Received: from athena.apache.org (HELO athena.apache.org) (140.211.11.136)
by apache.org (qpsmtpd/0.29) with ESMTP; Tue, 28 Feb 2012 00:28:09 +0000
X-ASF-Spam-Status: No, hits=-2000.0 required=5.0
tests=ALL_TRUSTED,T_RP_MATCHES_RCVD
X-Spam-Check-By: apache.org
Received: from [140.211.11.116] (HELO hel.zones.apache.org) (140.211.11.116)
by apache.org (qpsmtpd/0.29) with ESMTP; Tue, 28 Feb 2012 00:28:08 +0000
Received: from hel.zones.apache.org (hel.zones.apache.org [140.211.11.116])
by hel.zones.apache.org (Postfix) with ESMTP id B882833C115
for <common-dev@hadoop.apache.org>; Tue, 28 Feb 2012 00:27:48 +0000 (UTC)
Date: Tue, 28 Feb 2012 00:27:48 +0000 (UTC)
From: "Todd Lipcon (Created) (JIRA)" <jira@apache.org>
To: common-dev@hadoop.apache.org
Message-ID: <1845893580.25646.1330388868757.JavaMail.tomcat@hel.zones.apache.org>
Subject: [jira] [Created] (HADOOP-8117) Upgrade test build to Surefire 2.12
MIME-Version: 1.0
Content-Type: text/plain; charset=utf-8
Content-Transfer-Encoding: 7bit
X-JIRA-FingerPrint: 30527f35849b9dde25b450d4833f0394
Upgrade test build to Surefire 2.12
-----------------------------------
Key: HADOOP-8117
URL: https://issues.apache.org/jira/browse/HADOOP-8117
Project: Hadoop Common
Issue Type: Improvement
Components: build, test
Affects Versions: 0.24.0, 0.23.3
Reporter: Todd Lipcon
Assignee: Todd Lipcon
Priority: Trivial
Surefire 2.9, which we're using currently, has a few annoying bugs. In particular, if a test exits with a non-zero exit code, it doesn't report the test as failed.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
From common-dev-return-77867-apmail-hadoop-common-dev-archive=hadoop.apache.org@hadoop.apache.org Tue Feb 28 09:20:35 2012
Return-Path: <common-dev-return-77867-apmail-hadoop-common-dev-archive=hadoop.apache.org@hadoop.apache.org>
X-Original-To: apmail-hadoop-common-dev-archive@www.apache.org
Delivered-To: apmail-hadoop-common-dev-archive@www.apache.org
Received: from mail.apache.org (hermes.apache.org [140.211.11.3])
by minotaur.apache.org (Postfix) with SMTP id 704C890A0
for <apmail-hadoop-common-dev-archive@www.apache.org>; Tue, 28 Feb 2012 09:20:35 +0000 (UTC)
Received: (qmail 66535 invoked by uid 500); 28 Feb 2012 09:20:33 -0000
Delivered-To: apmail-hadoop-common-dev-archive@hadoop.apache.org
Received: (qmail 66455 invoked by uid 500); 28 Feb 2012 09:20:33 -0000
Mailing-List: contact common-dev-help@hadoop.apache.org; run by ezmlm
Precedence: bulk
List-Help: <mailto:common-dev-help@hadoop.apache.org>
List-Unsubscribe: <mailto:common-dev-unsubscribe@hadoop.apache.org>
List-Post: <mailto:common-dev@hadoop.apache.org>
List-Id: <common-dev.hadoop.apache.org>
Reply-To: common-dev@hadoop.apache.org
Delivered-To: mailing list common-dev@hadoop.apache.org
Received: (qmail 66439 invoked by uid 99); 28 Feb 2012 09:20:32 -0000
Received: from nike.apache.org (HELO nike.apache.org) (192.87.106.230)
by apache.org (qpsmtpd/0.29) with ESMTP; Tue, 28 Feb 2012 09:20:32 +0000
X-ASF-Spam-Status: No, hits=-2000.0 required=5.0
tests=ALL_TRUSTED
X-Spam-Check-By: apache.org
Received: from [140.211.11.8] (HELO aegis.apache.org) (140.211.11.8)
by apache.org (qpsmtpd/0.29) with ESMTP; Tue, 28 Feb 2012 09:20:28 +0000
Received: from aegis (localhost [127.0.0.1])
by aegis.apache.org (Postfix) with ESMTP id AF008C0005
for <common-dev@hadoop.apache.org>; Tue, 28 Feb 2012 09:20:06 +0000 (UTC)
Date: Tue, 28 Feb 2012 09:20:06 +0000 (UTC)
From: Apache Jenkins Server <jenkins@builds.apache.org>
To: common-dev@hadoop.apache.org
Message-ID: <985796427.51330420806708.JavaMail.hudson@aegis>
Subject: Build failed in Jenkins: Hadoop-Common-0.23-Build #177
MIME-Version: 1.0
Content-Type: text/plain; charset=UTF-8
Content-Transfer-Encoding: 7bit
X-Jenkins-Job: Hadoop-Common-0.23-Build
X-Jenkins-Result: FAILURE
X-Virus-Checked: Checked by ClamAV on apache.org
See <https://builds.apache.org/job/Hadoop-Common-0.23-Build/177/changes>
Changes:
[vinodkv] MAPREDUCE-3922. Fixed build to not compile 32bit container-executor binary by default on all platforms. Contributed by Hitesh Shah.
svn merge --ignore-ancestry -c 1294446 ../../trunk
[vinodkv] MAPREDUCE-2855. Passing a cached class-loader to ResourceBundle creator to minimize counter names lookup time. Contributed by Siddarth Seth.
svn merge --ignore-ancestry -c 1294436 ../../trunk
[szetszwo] Fix 0.23.3 entries in CHANGES.txt.
[vinodkv] MAPREDUCE-3901. Modified JobHistory records in YARN to lazily load job and task reports so as to improve UI response times. Contributed by Siddarth Seth.
svn merge --ignore-ancestry -c 1294417 ../../trunk
[szetszwo] Fix 0.23.3 entries in CHANGES.txt.
[szetszwo] Move MAPREDUCE-3740 to BUG FIXES in CHANGES.txt.
[stevel] MAPREDUCE-3909
[tgraves] merge -r 1294206:1294207 from trunk to branch-0.23. FIXES: MAPREDUCE-3913
------------------------------------------
[...truncated 12386 lines...]
[javadoc] Loading source files for package org.apache.hadoop.io...
[javadoc] Loading source files for package org.apache.hadoop.io.compress...
[javadoc] Loading source files for package org.apache.hadoop.io.compress.bzip2...
[javadoc] Loading source files for package org.apache.hadoop.io.compress.lz4...
[javadoc] Loading source files for package org.apache.hadoop.io.compress.snappy...
[javadoc] Loading source files for package org.apache.hadoop.io.compress.zlib...
[javadoc] Loading source files for package org.apache.hadoop.io.file.tfile...
[javadoc] Loading source files for package org.apache.hadoop.io.nativeio...
[javadoc] Loading source files for package org.apache.hadoop.io.retry...
[javadoc] Loading source files for package org.apache.hadoop.io.serializer...
[javadoc] Loading source files for package org.apache.hadoop.io.serializer.avro...
[javadoc] Loading source files for package org.apache.hadoop.ipc...
[javadoc] Loading source files for package org.apache.hadoop.ipc.metrics...
[javadoc] Loading source files for package org.apache.hadoop.jmx...
[javadoc] Loading source files for package org.apache.hadoop.log...
[javadoc] Loading source files for package org.apache.hadoop.log.metrics...
[javadoc] Loading source files for package org.apache.hadoop.metrics...
[javadoc] Loading source files for package org.apache.hadoop.metrics.file...
[javadoc] Loading source files for package org.apache.hadoop.metrics.ganglia...
[javadoc] Loading source files for package org.apache.hadoop.metrics.jvm...
[javadoc] Loading source files for package org.apache.hadoop.metrics.spi...
[javadoc] Loading source files for package org.apache.hadoop.metrics.util...
[javadoc] Loading source files for package org.apache.hadoop.metrics2...
[javadoc] Loading source files for package org.apache.hadoop.metrics2.annotation...
[javadoc] Loading source files for package org.apache.hadoop.metrics2.filter...
[javadoc] Loading source files for package org.apache.hadoop.metrics2.impl...
[javadoc] Loading source files for package org.apache.hadoop.metrics2.lib...
[javadoc] Loading source files for package org.apache.hadoop.metrics2.sink...
[javadoc] Loading source files for package org.apache.hadoop.metrics2.sink.ganglia...
[javadoc] Loading source files for package org.apache.hadoop.metrics2.source...
[javadoc] Loading source files for package org.apache.hadoop.metrics2.util...
[javadoc] Loading source files for package org.apache.hadoop.net...
[javadoc] Loading source files for package org.apache.hadoop.record...
[javadoc] Loading source files for package org.apache.hadoop.record.compiler...
[javadoc] Loading source files for package org.apache.hadoop.record.compiler.ant...
[javadoc] Loading source files for package org.apache.hadoop.record.compiler.generated...
[javadoc] Loading source files for package org.apache.hadoop.record.meta...
[javadoc] Loading source files for package org.apache.hadoop.security...
[javadoc] Loading source files for package org.apache.hadoop.security.authorize...
[javadoc] Loading source files for package org.apache.hadoop.security.token...
[javadoc] Loading source files for package org.apache.hadoop.security.token.delegation...
[javadoc] Loading source files for package org.apache.hadoop.tools...
[javadoc] Loading source files for package org.apache.hadoop.util...
[javadoc] Loading source files for package org.apache.hadoop.util.bloom...
[javadoc] Loading source files for package org.apache.hadoop.util.hash...
[javadoc] 2 errors
[xslt] Processing <https://builds.apache.org/job/Hadoop-Common-0.23-Build/ws/trunk/hadoop-common-project/hadoop-common/target/findbugsXml.xml> to <https://builds.apache.org/job/Hadoop-Common-0.23-Build/ws/trunk/hadoop-common-project/hadoop-common/target/site/findbugs.html>
[xslt] Loading stylesheet /home/jenkins/tools/findbugs/latest/src/xsl/default.xsl
[INFO] Executed tasks
[INFO]
[INFO] --- maven-antrun-plugin:1.6:run (pre-dist) @ hadoop-common ---
[INFO] Executing tasks
main:
[INFO] Executed tasks
[INFO]
[INFO] >>> maven-javadoc-plugin:2.8.1:javadoc (default) @ hadoop-common >>>
[INFO]
[INFO] --- maven-antrun-plugin:1.6:run (create-testdirs) @ hadoop-common ---
[INFO] Executing tasks
main:
[INFO] Executed tasks
[INFO]
[INFO] --- build-helper-maven-plugin:1.5:add-source (add-source) @ hadoop-common ---
[INFO] Source directory: <https://builds.apache.org/job/Hadoop-Common-0.23-Build/ws/trunk/hadoop-common-project/hadoop-common/target/generated-sources/java> added.
[INFO]
[INFO] --- build-helper-maven-plugin:1.5:add-test-source (add-test-source) @ hadoop-common ---
[INFO] Test Source directory: <https://builds.apache.org/job/Hadoop-Common-0.23-Build/ws/trunk/hadoop-common-project/hadoop-common/target/generated-test-sources/java> added.
[INFO]
[INFO] --- maven-antrun-plugin:1.6:run (compile-proto) @ hadoop-common ---
[INFO] Executing tasks
main:
[INFO] Executed tasks
[INFO]
[INFO] --- maven-antrun-plugin:1.6:run (save-version) @ hadoop-common ---
[INFO] Executing tasks
main:
[INFO] Executed tasks
[INFO]
[INFO] <<< maven-javadoc-plugin:2.8.1:javadoc (default) @ hadoop-common <<<
[INFO]
[INFO] --- maven-javadoc-plugin:2.8.1:javadoc (default) @ hadoop-common ---
[INFO]
ExcludePrivateAnnotationsStandardDoclet
9 warnings
[WARNING] Javadoc Warnings
[WARNING] <https://builds.apache.org/job/Hadoop-Common-0.23-Build/ws/trunk/hadoop-common-project/hadoop-common/src/main/java/org/apache/hadoop/security/SecurityUtil.java>:49: warning: sun.net.dns.ResolverConfiguration is Sun proprietary API and may be removed in a future release
[WARNING] import sun.net.dns.ResolverConfiguration;
[WARNING] ^
[WARNING] <https://builds.apache.org/job/Hadoop-Common-0.23-Build/ws/trunk/hadoop-common-project/hadoop-common/src/main/java/org/apache/hadoop/security/SecurityUtil.java>:50: warning: sun.net.util.IPAddressUtil is Sun proprietary API and may be removed in a future release
[WARNING] import sun.net.util.IPAddressUtil;
[WARNING] ^
[WARNING] <https://builds.apache.org/job/Hadoop-Common-0.23-Build/ws/trunk/hadoop-common-project/hadoop-common/src/main/java/org/apache/hadoop/security/SecurityUtil.java>:51: warning: sun.security.jgss.krb5.Krb5Util is Sun proprietary API and may be removed in a future release
[WARNING] import sun.security.jgss.krb5.Krb5Util;
[WARNING] ^
[WARNING] <https://builds.apache.org/job/Hadoop-Common-0.23-Build/ws/trunk/hadoop-common-project/hadoop-common/src/main/java/org/apache/hadoop/security/SecurityUtil.java>:52: warning: sun.security.krb5.Credentials is Sun proprietary API and may be removed in a future release
[WARNING] import sun.security.krb5.Credentials;
[WARNING] ^
[WARNING] <https://builds.apache.org/job/Hadoop-Common-0.23-Build/ws/trunk/hadoop-common-project/hadoop-common/src/main/java/org/apache/hadoop/security/SecurityUtil.java>:53: warning: sun.security.krb5.PrincipalName is Sun proprietary API and may be removed in a future release
[WARNING] import sun.security.krb5.PrincipalName;
[WARNING] ^
[WARNING] <https://builds.apache.org/job/Hadoop-Common-0.23-Build/ws/trunk/hadoop-common-project/hadoop-common/src/main/java/org/apache/hadoop/security/HadoopKerberosName.java>:28: warning: sun.security.krb5.Config is Sun proprietary API and may be removed in a future release
[WARNING] import sun.security.krb5.Config;
[WARNING] ^
[WARNING] <https://builds.apache.org/job/Hadoop-Common-0.23-Build/ws/trunk/hadoop-common-project/hadoop-common/src/main/java/org/apache/hadoop/security/HadoopKerberosName.java>:29: warning: sun.security.krb5.KrbException is Sun proprietary API and may be removed in a future release
[WARNING] import sun.security.krb5.KrbException;
[WARNING] ^
[WARNING] <https://builds.apache.org/job/Hadoop-Common-0.23-Build/ws/trunk/hadoop-common-project/hadoop-common/src/main/java/org/apache/hadoop/io/FastByteComparisons.java>:25: warning: sun.misc.Unsafe is Sun proprietary API and may be removed in a future release
[WARNING] import sun.misc.Unsafe;
[WARNING] ^
[WARNING] <https://builds.apache.org/job/Hadoop-Common-0.23-Build/ws/trunk/hadoop-common-project/hadoop-common/src/main/java/org/apache/hadoop/io/FastByteComparisons.java>:117: warning: sun.misc.Unsafe is Sun proprietary API and may be removed in a future release
[WARNING] static final Unsafe theUnsafe;
[WARNING] ^
[INFO]
[INFO] --- maven-assembly-plugin:2.2.1:single (dist) @ hadoop-common ---
[WARNING] The following patterns were never triggered in this artifact exclusion filter:
o 'org.apache.ant:*:jar'
o 'jdiff:jdiff:jar'
[INFO] share/hadoop/common/jdiff/ already added, skipping
[INFO] Copying files to <https://builds.apache.org/job/Hadoop-Common-0.23-Build/ws/trunk/hadoop-common-project/hadoop-common/target/hadoop-common-0.23.3-SNAPSHOT>
[INFO] share/hadoop/common/jdiff/ already added, skipping
[INFO]
[INFO] --- maven-jar-plugin:2.3.1:jar (default-jar) @ hadoop-common ---
[INFO]
[INFO] --- maven-source-plugin:2.1.2:jar-no-fork (hadoop-java-sources) @ hadoop-common ---
[INFO] org already added, skipping
[INFO] org/apache already added, skipping
[INFO] org/apache/hadoop already added, skipping
[INFO] org/apache/hadoop/ipc already added, skipping
[INFO] org/apache/hadoop/ipc/protobuf already added, skipping
[INFO] Building jar: <https://builds.apache.org/job/Hadoop-Common-0.23-Build/ws/trunk/hadoop-common-project/hadoop-common/target/hadoop-common-0.23.3-SNAPSHOT-sources.jar>
[INFO] org already added, skipping
[INFO] org/apache already added, skipping
[INFO] org/apache/hadoop already added, skipping
[INFO] org/apache/hadoop/ipc already added, skipping
[INFO] org/apache/hadoop/ipc/protobuf already added, skipping
[WARNING] Artifact org.apache.hadoop:hadoop-common:java-source:sources:0.23.3-SNAPSHOT already attached to project, ignoring duplicate
[INFO]
[INFO] --- maven-site-plugin:3.0:attach-descriptor (attach-descriptor) @ hadoop-common ---
[INFO]
[INFO] --- maven-antrun-plugin:1.6:run (tar) @ hadoop-common ---
[INFO] Executing tasks
main:
[INFO] Executed tasks
[INFO]
[INFO] --- maven-javadoc-plugin:2.8.1:jar (module-javadocs) @ hadoop-common ---
[INFO]
ExcludePrivateAnnotationsStandardDoclet
9 warnings
[WARNING] Javadoc Warnings
[WARNING] <https://builds.apache.org/job/Hadoop-Common-0.23-Build/ws/trunk/hadoop-common-project/hadoop-common/src/main/java/org/apache/hadoop/security/SecurityUtil.java>:49: warning: sun.net.dns.ResolverConfiguration is Sun proprietary API and may be removed in a future release
[WARNING] import sun.net.dns.ResolverConfiguration;
[WARNING] ^
[WARNING] <https://builds.apache.org/job/Hadoop-Common-0.23-Build/ws/trunk/hadoop-common-project/hadoop-common/src/main/java/org/apache/hadoop/security/SecurityUtil.java>:50: warning: sun.net.util.IPAddressUtil is Sun proprietary API and may be removed in a future release
[WARNING] import sun.net.util.IPAddressUtil;
[WARNING] ^
[WARNING] <https://builds.apache.org/job/Hadoop-Common-0.23-Build/ws/trunk/hadoop-common-project/hadoop-common/src/main/java/org/apache/hadoop/security/SecurityUtil.java>:51: warning: sun.security.jgss.krb5.Krb5Util is Sun proprietary API and may be removed in a future release
[WARNING] import sun.security.jgss.krb5.Krb5Util;
[WARNING] ^
[WARNING] <https://builds.apache.org/job/Hadoop-Common-0.23-Build/ws/trunk/hadoop-common-project/hadoop-common/src/main/java/org/apache/hadoop/security/SecurityUtil.java>:52: warning: sun.security.krb5.Credentials is Sun proprietary API and may be removed in a future release
[WARNING] import sun.security.krb5.Credentials;
[WARNING] ^
[WARNING] <https://builds.apache.org/job/Hadoop-Common-0.23-Build/ws/trunk/hadoop-common-project/hadoop-common/src/main/java/org/apache/hadoop/security/SecurityUtil.java>:53: warning: sun.security.krb5.PrincipalName is Sun proprietary API and may be removed in a future release
[WARNING] import sun.security.krb5.PrincipalName;
[WARNING] ^
[WARNING] <https://builds.apache.org/job/Hadoop-Common-0.23-Build/ws/trunk/hadoop-common-project/hadoop-common/src/main/java/org/apache/hadoop/security/HadoopKerberosName.java>:28: warning: sun.security.krb5.Config is Sun proprietary API and may be removed in a future release
[WARNING] import sun.security.krb5.Config;
[WARNING] ^
[WARNING] <https://builds.apache.org/job/Hadoop-Common-0.23-Build/ws/trunk/hadoop-common-project/hadoop-common/src/main/java/org/apache/hadoop/security/HadoopKerberosName.java>:29: warning: sun.security.krb5.KrbException is Sun proprietary API and may be removed in a future release
[WARNING] import sun.security.krb5.KrbException;
[WARNING] ^
[WARNING] <https://builds.apache.org/job/Hadoop-Common-0.23-Build/ws/trunk/hadoop-common-project/hadoop-common/src/main/java/org/apache/hadoop/io/FastByteComparisons.java>:25: warning: sun.misc.Unsafe is Sun proprietary API and may be removed in a future release
[WARNING] import sun.misc.Unsafe;
[WARNING] ^
[WARNING] <https://builds.apache.org/job/Hadoop-Common-0.23-Build/ws/trunk/hadoop-common-project/hadoop-common/src/main/java/org/apache/hadoop/io/FastByteComparisons.java>:117: warning: sun.misc.Unsafe is Sun proprietary API and may be removed in a future release
[WARNING] static final Unsafe theUnsafe;
[WARNING] ^
[INFO] Building jar: <https://builds.apache.org/job/Hadoop-Common-0.23-Build/ws/trunk/hadoop-common-project/hadoop-common/target/hadoop-common-0.23.3-SNAPSHOT-javadoc.jar>
[INFO]
[INFO] --- maven-checkstyle-plugin:2.6:checkstyle (default-cli) @ hadoop-common ---
[INFO]
[INFO] There are 8670 checkstyle errors.
[WARNING] Unable to locate Source XRef to link to - DISABLED
[INFO]
[INFO] --- findbugs-maven-plugin:2.3.2:findbugs (default-cli) @ hadoop-common ---
[INFO] ****** FindBugsMojo execute *******
[INFO] canGenerate is true
[INFO] ****** FindBugsMojo executeFindbugs *******
[INFO] Temp File is <https://builds.apache.org/job/Hadoop-Common-0.23-Build/ws/trunk/hadoop-common-project/hadoop-common/target/findbugsTemp.xml>
[INFO] Fork Value is true
[java] The following classes needed for analysis were missing:
[java] org.codehaus.jackson.FormatSchema
[java] org.codehaus.jackson.format.InputAccessor
[java] Missing classes: 1
[INFO] xmlOutput is false
[INFO]
[INFO] ------------------------------------------------------------------------
[INFO] Building Apache Hadoop Common Project 0.23.3-SNAPSHOT
[INFO] ------------------------------------------------------------------------
[INFO]
[INFO] --- maven-clean-plugin:2.4.1:clean (default-clean) @ hadoop-common-project ---
[INFO] Deleting <https://builds.apache.org/job/Hadoop-Common-0.23-Build/ws/trunk/hadoop-common-project/target>
[INFO]
[INFO] --- maven-antrun-plugin:1.6:run (create-testdirs) @ hadoop-common-project ---
[INFO] Executing tasks
main:
[mkdir] Created dir: <https://builds.apache.org/job/Hadoop-Common-0.23-Build/ws/trunk/hadoop-common-project/target/test-dir>
[INFO] Executed tasks
[INFO]
[INFO] --- maven-source-plugin:2.1.2:jar-no-fork (hadoop-java-sources) @ hadoop-common-project ---
[INFO]
[INFO] --- maven-site-plugin:3.0:attach-descriptor (attach-descriptor) @ hadoop-common-project ---
[INFO]
[INFO] --- maven-javadoc-plugin:2.8.1:jar (module-javadocs) @ hadoop-common-project ---
[INFO] Not executing Javadoc as the project is not a Java classpath-capable package
[INFO]
[INFO] --- maven-checkstyle-plugin:2.6:checkstyle (default-cli) @ hadoop-common-project ---
[INFO]
[INFO] --- findbugs-maven-plugin:2.3.2:findbugs (default-cli) @ hadoop-common-project ---
[INFO] ****** FindBugsMojo execute *******
[INFO] canGenerate is false
[INFO] ------------------------------------------------------------------------
[INFO] Reactor Summary:
[INFO]
[INFO] Apache Hadoop Annotations ......................... SUCCESS [12.849s]
[INFO] Apache Hadoop Auth ................................ SUCCESS [19.295s]
[INFO] Apache Hadoop Auth Examples ....................... SUCCESS [7.649s]
[INFO] Apache Hadoop Common .............................. SUCCESS [4:17.599s]
[INFO] Apache Hadoop Common Project ...................... SUCCESS [0.035s]
[INFO] ------------------------------------------------------------------------
[INFO] BUILD SUCCESS
[INFO] ------------------------------------------------------------------------
[INFO] Total time: 4:58.400s
[INFO] Finished at: Tue Feb 28 09:10:00 UTC 2012
[INFO] Final Memory: 82M/821M
[INFO] ------------------------------------------------------------------------
+ /home/jenkins/tools/maven/latest/bin/mvn test -Pclover -DcloverLicenseLocation=/home/jenkins/tools/clover/latest/lib/clover.license
Build step 'Execute shell' marked build as failure
[WARNINGS] Skipping publisher since build result is FAILURE
Archiving artifacts
Recording fingerprints
Publishing Javadoc
Recording test results
From common-dev-return-77868-apmail-hadoop-common-dev-archive=hadoop.apache.org@hadoop.apache.org Tue Feb 28 09:20:38 2012
Return-Path: <common-dev-return-77868-apmail-hadoop-common-dev-archive=hadoop.apache.org@hadoop.apache.org>
X-Original-To: apmail-hadoop-common-dev-archive@www.apache.org
Delivered-To: apmail-hadoop-common-dev-archive@www.apache.org
Received: from mail.apache.org (hermes.apache.org [140.211.11.3])
by minotaur.apache.org (Postfix) with SMTP id E43F190C7
for <apmail-hadoop-common-dev-archive@www.apache.org>; Tue, 28 Feb 2012 09:20:38 +0000 (UTC)
Received: (qmail 68230 invoked by uid 500); 28 Feb 2012 09:20:37 -0000
Delivered-To: apmail-hadoop-common-dev-archive@hadoop.apache.org
Received: (qmail 68158 invoked by uid 500); 28 Feb 2012 09:20:37 -0000
Mailing-List: contact common-dev-help@hadoop.apache.org; run by ezmlm
Precedence: bulk
List-Help: <mailto:common-dev-help@hadoop.apache.org>
List-Unsubscribe: <mailto:common-dev-unsubscribe@hadoop.apache.org>
List-Post: <mailto:common-dev@hadoop.apache.org>
List-Id: <common-dev.hadoop.apache.org>
Reply-To: common-dev@hadoop.apache.org
Delivered-To: mailing list common-dev@hadoop.apache.org
Received: (qmail 68150 invoked by uid 99); 28 Feb 2012 09:20:37 -0000
Received: from athena.apache.org (HELO athena.apache.org) (140.211.11.136)
by apache.org (qpsmtpd/0.29) with ESMTP; Tue, 28 Feb 2012 09:20:37 +0000
X-ASF-Spam-Status: No, hits=-2000.0 required=5.0
tests=ALL_TRUSTED
X-Spam-Check-By: apache.org
Received: from [140.211.11.8] (HELO aegis.apache.org) (140.211.11.8)
by apache.org (qpsmtpd/0.29) with ESMTP; Tue, 28 Feb 2012 09:20:35 +0000
Received: from aegis (localhost [127.0.0.1])
by aegis.apache.org (Postfix) with ESMTP id 272BFC00A0
for <common-dev@hadoop.apache.org>; Tue, 28 Feb 2012 09:20:15 +0000 (UTC)
Date: Tue, 28 Feb 2012 09:20:15 +0000 (UTC)
From: Apache Jenkins Server <jenkins@builds.apache.org>
To: common-dev@hadoop.apache.org
Message-ID: <1153881635.61330420815158.JavaMail.hudson@aegis>
In-Reply-To: <1839391439.2071330334433216.JavaMail.hudson@aegis>
References: <1839391439.2071330334433216.JavaMail.hudson@aegis>
Subject: Build failed in Jenkins: Hadoop-Common-0.23-PB-Build #6
MIME-Version: 1.0
Content-Type: text/plain; charset=UTF-8
Content-Transfer-Encoding: 7bit
X-Jenkins-Job: Hadoop-Common-0.23-PB-Build
X-Jenkins-Result: FAILURE
X-Virus-Checked: Checked by ClamAV on apache.org
See <https://builds.apache.org/job/Hadoop-Common-0.23-PB-Build/6/>
------------------------------------------
[...truncated 12383 lines...]
[javadoc] Loading source files for package org.apache.hadoop.io...
[javadoc] Loading source files for package org.apache.hadoop.io.compress...
[javadoc] Loading source files for package org.apache.hadoop.io.compress.bzip2...
[javadoc] Loading source files for package org.apache.hadoop.io.compress.lz4...
[javadoc] Loading source files for package org.apache.hadoop.io.compress.snappy...
[javadoc] Loading source files for package org.apache.hadoop.io.compress.zlib...
[javadoc] Loading source files for package org.apache.hadoop.io.file.tfile...
[javadoc] Loading source files for package org.apache.hadoop.io.nativeio...
[javadoc] Loading source files for package org.apache.hadoop.io.retry...
[javadoc] Loading source files for package org.apache.hadoop.io.serializer...
[javadoc] Loading source files for package org.apache.hadoop.io.serializer.avro...
[javadoc] Loading source files for package org.apache.hadoop.ipc...
[javadoc] Loading source files for package org.apache.hadoop.ipc.metrics...
[javadoc] Loading source files for package org.apache.hadoop.jmx...
[javadoc] Loading source files for package org.apache.hadoop.log...
[javadoc] Loading source files for package org.apache.hadoop.log.metrics...
[javadoc] Loading source files for package org.apache.hadoop.metrics...
[javadoc] Loading source files for package org.apache.hadoop.metrics.file...
[javadoc] Loading source files for package org.apache.hadoop.metrics.ganglia...
[javadoc] Loading source files for package org.apache.hadoop.metrics.jvm...
[javadoc] Loading source files for package org.apache.hadoop.metrics.spi...
[javadoc] Loading source files for package org.apache.hadoop.metrics.util...
[javadoc] Loading source files for package org.apache.hadoop.metrics2...
[javadoc] Loading source files for package org.apache.hadoop.metrics2.annotation...
[javadoc] Loading source files for package org.apache.hadoop.metrics2.filter...
[javadoc] Loading source files for package org.apache.hadoop.metrics2.impl...
[javadoc] Loading source files for package org.apache.hadoop.metrics2.lib...
[javadoc] Loading source files for package org.apache.hadoop.metrics2.sink...
[javadoc] Loading source files for package org.apache.hadoop.metrics2.sink.ganglia...
[javadoc] Loading source files for package org.apache.hadoop.metrics2.source...
[javadoc] Loading source files for package org.apache.hadoop.metrics2.util...
[javadoc] Loading source files for package org.apache.hadoop.net...
[javadoc] Loading source files for package org.apache.hadoop.record...
[javadoc] Loading source files for package org.apache.hadoop.record.compiler...
[javadoc] Loading source files for package org.apache.hadoop.record.compiler.ant...
[javadoc] Loading source files for package org.apache.hadoop.record.compiler.generated...
[javadoc] Loading source files for package org.apache.hadoop.record.meta...
[javadoc] Loading source files for package org.apache.hadoop.security...
[javadoc] Loading source files for package org.apache.hadoop.security.authorize...
[javadoc] Loading source files for package org.apache.hadoop.security.token...
[javadoc] Loading source files for package org.apache.hadoop.security.token.delegation...
[javadoc] Loading source files for package org.apache.hadoop.tools...
[javadoc] Loading source files for package org.apache.hadoop.util...
[javadoc] Loading source files for package org.apache.hadoop.util.bloom...
[javadoc] Loading source files for package org.apache.hadoop.util.hash...
[javadoc] 2 errors
[xslt] Processing <https://builds.apache.org/job/Hadoop-Common-0.23-PB-Build/ws/trunk/hadoop-common-project/hadoop-common/target/findbugsXml.xml> to <https://builds.apache.org/job/Hadoop-Common-0.23-PB-Build/ws/trunk/hadoop-common-project/hadoop-common/target/site/findbugs.html>
[xslt] Loading stylesheet /home/jenkins/tools/findbugs/latest/src/xsl/default.xsl
[INFO] Executed tasks
[INFO]
[INFO] --- maven-antrun-plugin:1.6:run (pre-dist) @ hadoop-common ---
[INFO] Executing tasks
main:
[INFO] Executed tasks
[INFO]
[INFO] >>> maven-javadoc-plugin:2.8.1:javadoc (default) @ hadoop-common >>>
[INFO]
[INFO] --- maven-antrun-plugin:1.6:run (create-testdirs) @ hadoop-common ---
[INFO] Executing tasks
main:
[INFO] Executed tasks
[INFO]
[INFO] --- build-helper-maven-plugin:1.5:add-source (add-source) @ hadoop-common ---
[INFO] Source directory: <https://builds.apache.org/job/Hadoop-Common-0.23-PB-Build/ws/trunk/hadoop-common-project/hadoop-common/target/generated-sources/java> added.
[INFO]
[INFO] --- build-helper-maven-plugin:1.5:add-test-source (add-test-source) @ hadoop-common ---
[INFO] Test Source directory: <https://builds.apache.org/job/Hadoop-Common-0.23-PB-Build/ws/trunk/hadoop-common-project/hadoop-common/target/generated-test-sources/java> added.
[INFO]
[INFO] --- maven-antrun-plugin:1.6:run (compile-proto) @ hadoop-common ---
[INFO] Executing tasks
main:
[INFO] Executed tasks
[INFO]
[INFO] --- maven-antrun-plugin:1.6:run (save-version) @ hadoop-common ---
[INFO] Executing tasks
main:
[INFO] Executed tasks
[INFO]
[INFO] <<< maven-javadoc-plugin:2.8.1:javadoc (default) @ hadoop-common <<<
[INFO]
[INFO] --- maven-javadoc-plugin:2.8.1:javadoc (default) @ hadoop-common ---
[INFO]
ExcludePrivateAnnotationsStandardDoclet
9 warnings
[WARNING] Javadoc Warnings
[WARNING] <https://builds.apache.org/job/Hadoop-Common-0.23-PB-Build/ws/trunk/hadoop-common-project/hadoop-common/src/main/java/org/apache/hadoop/io/FastByteComparisons.java>:25: warning: sun.misc.Unsafe is Sun proprietary API and may be removed in a future release
[WARNING] import sun.misc.Unsafe;
[WARNING] ^
[WARNING] <https://builds.apache.org/job/Hadoop-Common-0.23-PB-Build/ws/trunk/hadoop-common-project/hadoop-common/src/main/java/org/apache/hadoop/io/FastByteComparisons.java>:117: warning: sun.misc.Unsafe is Sun proprietary API and may be removed in a future release
[WARNING] static final Unsafe theUnsafe;
[WARNING] ^
[WARNING] <https://builds.apache.org/job/Hadoop-Common-0.23-PB-Build/ws/trunk/hadoop-common-project/hadoop-common/src/main/java/org/apache/hadoop/security/SecurityUtil.java>:49: warning: sun.net.dns.ResolverConfiguration is Sun proprietary API and may be removed in a future release
[WARNING] import sun.net.dns.ResolverConfiguration;
[WARNING] ^
[WARNING] <https://builds.apache.org/job/Hadoop-Common-0.23-PB-Build/ws/trunk/hadoop-common-project/hadoop-common/src/main/java/org/apache/hadoop/security/SecurityUtil.java>:50: warning: sun.net.util.IPAddressUtil is Sun proprietary API and may be removed in a future release
[WARNING] import sun.net.util.IPAddressUtil;
[WARNING] ^
[WARNING] <https://builds.apache.org/job/Hadoop-Common-0.23-PB-Build/ws/trunk/hadoop-common-project/hadoop-common/src/main/java/org/apache/hadoop/security/SecurityUtil.java>:51: warning: sun.security.jgss.krb5.Krb5Util is Sun proprietary API and may be removed in a future release
[WARNING] import sun.security.jgss.krb5.Krb5Util;
[WARNING] ^
[WARNING] <https://builds.apache.org/job/Hadoop-Common-0.23-PB-Build/ws/trunk/hadoop-common-project/hadoop-common/src/main/java/org/apache/hadoop/security/SecurityUtil.java>:52: warning: sun.security.krb5.Credentials is Sun proprietary API and may be removed in a future release
[WARNING] import sun.security.krb5.Credentials;
[WARNING] ^
[WARNING] <https://builds.apache.org/job/Hadoop-Common-0.23-PB-Build/ws/trunk/hadoop-common-project/hadoop-common/src/main/java/org/apache/hadoop/security/SecurityUtil.java>:53: warning: sun.security.krb5.PrincipalName is Sun proprietary API and may be removed in a future release
[WARNING] import sun.security.krb5.PrincipalName;
[WARNING] ^
[WARNING] <https://builds.apache.org/job/Hadoop-Common-0.23-PB-Build/ws/trunk/hadoop-common-project/hadoop-common/src/main/java/org/apache/hadoop/security/HadoopKerberosName.java>:28: warning: sun.security.krb5.Config is Sun proprietary API and may be removed in a future release
[WARNING] import sun.security.krb5.Config;
[WARNING] ^
[WARNING] <https://builds.apache.org/job/Hadoop-Common-0.23-PB-Build/ws/trunk/hadoop-common-project/hadoop-common/src/main/java/org/apache/hadoop/security/HadoopKerberosName.java>:29: warning: sun.security.krb5.KrbException is Sun proprietary API and may be removed in a future release
[WARNING] import sun.security.krb5.KrbException;
[WARNING] ^
[INFO]
[INFO] --- maven-assembly-plugin:2.2.1:single (dist) @ hadoop-common ---
[WARNING] The following patterns were never triggered in this artifact exclusion filter:
o 'org.apache.ant:*:jar'
o 'jdiff:jdiff:jar'
[INFO] share/hadoop/common/jdiff/ already added, skipping
[INFO] Copying files to <https://builds.apache.org/job/Hadoop-Common-0.23-PB-Build/ws/trunk/hadoop-common-project/hadoop-common/target/hadoop-common-0.23.3-SNAPSHOT>
[INFO] share/hadoop/common/jdiff/ already added, skipping
[INFO]
[INFO] --- maven-jar-plugin:2.3.1:jar (default-jar) @ hadoop-common ---
[INFO]
[INFO] --- maven-source-plugin:2.1.2:jar-no-fork (hadoop-java-sources) @ hadoop-common ---
[INFO] org already added, skipping
[INFO] org/apache already added, skipping
[INFO] org/apache/hadoop already added, skipping
[INFO] org/apache/hadoop/ipc already added, skipping
[INFO] org/apache/hadoop/ipc/protobuf already added, skipping
[INFO] Building jar: <https://builds.apache.org/job/Hadoop-Common-0.23-PB-Build/ws/trunk/hadoop-common-project/hadoop-common/target/hadoop-common-0.23.3-SNAPSHOT-sources.jar>
[INFO] org already added, skipping
[INFO] org/apache already added, skipping
[INFO] org/apache/hadoop already added, skipping
[INFO] org/apache/hadoop/ipc already added, skipping
[INFO] org/apache/hadoop/ipc/protobuf already added, skipping
[WARNING] Artifact org.apache.hadoop:hadoop-common:java-source:sources:0.23.3-SNAPSHOT already attached to project, ignoring duplicate
[INFO]
[INFO] --- maven-site-plugin:3.0:attach-descriptor (attach-descriptor) @ hadoop-common ---
[INFO]
[INFO] --- maven-antrun-plugin:1.6:run (tar) @ hadoop-common ---
[INFO] Executing tasks
main:
[INFO] Executed tasks
[INFO]
[INFO] --- maven-javadoc-plugin:2.8.1:jar (module-javadocs) @ hadoop-common ---
[INFO]
ExcludePrivateAnnotationsStandardDoclet
9 warnings
[WARNING] Javadoc Warnings
[WARNING] <https://builds.apache.org/job/Hadoop-Common-0.23-PB-Build/ws/trunk/hadoop-common-project/hadoop-common/src/main/java/org/apache/hadoop/io/FastByteComparisons.java>:25: warning: sun.misc.Unsafe is Sun proprietary API and may be removed in a future release
[WARNING] import sun.misc.Unsafe;
[WARNING] ^
[WARNING] <https://builds.apache.org/job/Hadoop-Common-0.23-PB-Build/ws/trunk/hadoop-common-project/hadoop-common/src/main/java/org/apache/hadoop/io/FastByteComparisons.java>:117: warning: sun.misc.Unsafe is Sun proprietary API and may be removed in a future release
[WARNING] static final Unsafe theUnsafe;
[WARNING] ^
[WARNING] <https://builds.apache.org/job/Hadoop-Common-0.23-PB-Build/ws/trunk/hadoop-common-project/hadoop-common/src/main/java/org/apache/hadoop/security/SecurityUtil.java>:49: warning: sun.net.dns.ResolverConfiguration is Sun proprietary API and may be removed in a future release
[WARNING] import sun.net.dns.ResolverConfiguration;
[WARNING] ^
[WARNING] <https://builds.apache.org/job/Hadoop-Common-0.23-PB-Build/ws/trunk/hadoop-common-project/hadoop-common/src/main/java/org/apache/hadoop/security/SecurityUtil.java>:50: warning: sun.net.util.IPAddressUtil is Sun proprietary API and may be removed in a future release
[WARNING] import sun.net.util.IPAddressUtil;
[WARNING] ^
[WARNING] <https://builds.apache.org/job/Hadoop-Common-0.23-PB-Build/ws/trunk/hadoop-common-project/hadoop-common/src/main/java/org/apache/hadoop/security/SecurityUtil.java>:51: warning: sun.security.jgss.krb5.Krb5Util is Sun proprietary API and may be removed in a future release
[WARNING] import sun.security.jgss.krb5.Krb5Util;
[WARNING] ^
[WARNING] <https://builds.apache.org/job/Hadoop-Common-0.23-PB-Build/ws/trunk/hadoop-common-project/hadoop-common/src/main/java/org/apache/hadoop/security/SecurityUtil.java>:52: warning: sun.security.krb5.Credentials is Sun proprietary API and may be removed in a future release
[WARNING] import sun.security.krb5.Credentials;
[WARNING] ^
[WARNING] <https://builds.apache.org/job/Hadoop-Common-0.23-PB-Build/ws/trunk/hadoop-common-project/hadoop-common/src/main/java/org/apache/hadoop/security/SecurityUtil.java>:53: warning: sun.security.krb5.PrincipalName is Sun proprietary API and may be removed in a future release
[WARNING] import sun.security.krb5.PrincipalName;
[WARNING] ^
[WARNING] <https://builds.apache.org/job/Hadoop-Common-0.23-PB-Build/ws/trunk/hadoop-common-project/hadoop-common/src/main/java/org/apache/hadoop/security/HadoopKerberosName.java>:28: warning: sun.security.krb5.Config is Sun proprietary API and may be removed in a future release
[WARNING] import sun.security.krb5.Config;
[WARNING] ^
[WARNING] <https://builds.apache.org/job/Hadoop-Common-0.23-PB-Build/ws/trunk/hadoop-common-project/hadoop-common/src/main/java/org/apache/hadoop/security/HadoopKerberosName.java>:29: warning: sun.security.krb5.KrbException is Sun proprietary API and may be removed in a future release
[WARNING] import sun.security.krb5.KrbException;
[WARNING] ^
[INFO] Building jar: <https://builds.apache.org/job/Hadoop-Common-0.23-PB-Build/ws/trunk/hadoop-common-project/hadoop-common/target/hadoop-common-0.23.3-SNAPSHOT-javadoc.jar>
[INFO]
[INFO] --- maven-checkstyle-plugin:2.6:checkstyle (default-cli) @ hadoop-common ---
[INFO]
[INFO] There are 8670 checkstyle errors.
[WARNING] Unable to locate Source XRef to link to - DISABLED
[INFO]
[INFO] --- findbugs-maven-plugin:2.3.2:findbugs (default-cli) @ hadoop-common ---
[INFO] ****** FindBugsMojo execute *******
[INFO] canGenerate is true
[INFO] ****** FindBugsMojo executeFindbugs *******
[INFO] Temp File is <https://builds.apache.org/job/Hadoop-Common-0.23-PB-Build/ws/trunk/hadoop-common-project/hadoop-common/target/findbugsTemp.xml>
[INFO] Fork Value is true
[java] The following classes needed for analysis were missing:
[java] org.codehaus.jackson.FormatSchema
[java] org.codehaus.jackson.format.InputAccessor
[java] Missing classes: 1
[INFO] xmlOutput is false
[INFO]
[INFO] ------------------------------------------------------------------------
[INFO] Building Apache Hadoop Common Project 0.23.3-SNAPSHOT
[INFO] ------------------------------------------------------------------------
[INFO]
[INFO] --- maven-clean-plugin:2.4.1:clean (default-clean) @ hadoop-common-project ---
[INFO] Deleting <https://builds.apache.org/job/Hadoop-Common-0.23-PB-Build/ws/trunk/hadoop-common-project/target>
[INFO]
[INFO] --- maven-antrun-plugin:1.6:run (create-testdirs) @ hadoop-common-project ---
[INFO] Executing tasks
main:
[mkdir] Created dir: <https://builds.apache.org/job/Hadoop-Common-0.23-PB-Build/ws/trunk/hadoop-common-project/target/test-dir>
[INFO] Executed tasks
[INFO]
[INFO] --- maven-source-plugin:2.1.2:jar-no-fork (hadoop-java-sources) @ hadoop-common-project ---
[INFO]
[INFO] --- maven-site-plugin:3.0:attach-descriptor (attach-descriptor) @ hadoop-common-project ---
[INFO]
[INFO] --- maven-javadoc-plugin:2.8.1:jar (module-javadocs) @ hadoop-common-project ---
[INFO] Not executing Javadoc as the project is not a Java classpath-capable package
[INFO]
[INFO] --- maven-checkstyle-plugin:2.6:checkstyle (default-cli) @ hadoop-common-project ---
[INFO]
[INFO] --- findbugs-maven-plugin:2.3.2:findbugs (default-cli) @ hadoop-common-project ---
[INFO] ****** FindBugsMojo execute *******
[INFO] canGenerate is false
[INFO] ------------------------------------------------------------------------
[INFO] Reactor Summary:
[INFO]
[INFO] Apache Hadoop Annotations ......................... SUCCESS [12.808s]
[INFO] Apache Hadoop Auth ................................ SUCCESS [20.457s]
[INFO] Apache Hadoop Auth Examples ....................... SUCCESS [7.749s]
[INFO] Apache Hadoop Common .............................. SUCCESS [4:19.727s]
[INFO] Apache Hadoop Common Project ...................... SUCCESS [0.035s]
[INFO] ------------------------------------------------------------------------
[INFO] BUILD SUCCESS
[INFO] ------------------------------------------------------------------------
[INFO] Total time: 5:01.834s
[INFO] Finished at: Tue Feb 28 09:10:05 UTC 2012
[INFO] Final Memory: 82M/813M
[INFO] ------------------------------------------------------------------------
+ /home/jenkins/tools/maven/latest/bin/mvn test -Pclover -DcloverLicenseLocation=/home/jenkins/tools/clover/latest/lib/clover.license
Build step 'Execute shell' marked build as failure
[WARNINGS] Skipping publisher since build result is FAILURE
Archiving artifacts
Recording test results
Publishing Javadoc
Recording fingerprints
From common-dev-return-77869-apmail-hadoop-common-dev-archive=hadoop.apache.org@hadoop.apache.org Tue Feb 28 16:56:13 2012
Return-Path: <common-dev-return-77869-apmail-hadoop-common-dev-archive=hadoop.apache.org@hadoop.apache.org>
X-Original-To: apmail-hadoop-common-dev-archive@www.apache.org
Delivered-To: apmail-hadoop-common-dev-archive@www.apache.org
Received: from mail.apache.org (hermes.apache.org [140.211.11.3])
by minotaur.apache.org (Postfix) with SMTP id DB999993D
for <apmail-hadoop-common-dev-archive@www.apache.org>; Tue, 28 Feb 2012 16:56:12 +0000 (UTC)
Received: (qmail 84407 invoked by uid 500); 28 Feb 2012 16:56:10 -0000
Delivered-To: apmail-hadoop-common-dev-archive@hadoop.apache.org
Received: (qmail 84096 invoked by uid 500); 28 Feb 2012 16:56:09 -0000
Mailing-List: contact common-dev-help@hadoop.apache.org; run by ezmlm
Precedence: bulk
List-Help: <mailto:common-dev-help@hadoop.apache.org>
List-Unsubscribe: <mailto:common-dev-unsubscribe@hadoop.apache.org>
List-Post: <mailto:common-dev@hadoop.apache.org>
List-Id: <common-dev.hadoop.apache.org>
Reply-To: common-dev@hadoop.apache.org
Delivered-To: mailing list common-dev@hadoop.apache.org
Received: (qmail 84063 invoked by uid 99); 28 Feb 2012 16:56:09 -0000
Received: from nike.apache.org (HELO nike.apache.org) (192.87.106.230)
by apache.org (qpsmtpd/0.29) with ESMTP; Tue, 28 Feb 2012 16:56:09 +0000
X-ASF-Spam-Status: No, hits=-2000.0 required=5.0
tests=ALL_TRUSTED,T_RP_MATCHES_RCVD
X-Spam-Check-By: apache.org
Received: from [140.211.11.116] (HELO hel.zones.apache.org) (140.211.11.116)
by apache.org (qpsmtpd/0.29) with ESMTP; Tue, 28 Feb 2012 16:56:07 +0000
Received: from hel.zones.apache.org (hel.zones.apache.org [140.211.11.116])
by hel.zones.apache.org (Postfix) with ESMTP id 8CC8833EBF4
for <common-dev@hadoop.apache.org>; Tue, 28 Feb 2012 16:55:46 +0000 (UTC)
Date: Tue, 28 Feb 2012 16:55:46 +0000 (UTC)
From: "Aaron T. Myers (Resolved) (JIRA)" <jira@apache.org>
To: common-dev@hadoop.apache.org
Message-ID: <637377279.28695.1330448146577.JavaMail.tomcat@hel.zones.apache.org>
In-Reply-To: <280635416.25133.1330381190309.JavaMail.tomcat@hel.zones.apache.org>
Subject: [jira] [Resolved] (HADOOP-8116) HA: RetriableCommand is using
RetryPolicy incorrectly after HADOOP-7896
MIME-Version: 1.0
Content-Type: text/plain; charset=utf-8
Content-Transfer-Encoding: 7bit
X-JIRA-FingerPrint: 30527f35849b9dde25b450d4833f0394
X-Virus-Checked: Checked by ClamAV on apache.org
[ https://issues.apache.org/jira/browse/HADOOP-8116?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Aaron T. Myers resolved HADOOP-8116.
------------------------------------
Resolution: Fixed
Hadoop Flags: Reviewed
I've committed this to the HA branch and filed the following JIRA: MAPREDUCE-3934
Thanks a lot for the review, Eli.
> HA: RetriableCommand is using RetryPolicy incorrectly after HADOOP-7896
> -----------------------------------------------------------------------
>
> Key: HADOOP-8116
> URL: https://issues.apache.org/jira/browse/HADOOP-8116
> Project: Hadoop Common
> Issue Type: Sub-task
> Components: util
> Affects Versions: HA Branch (HDFS-1623)
> Reporter: Aaron T. Myers
> Assignee: Aaron T. Myers
> Attachments: HADOOP-8116-HDFS-1623.patch, HADOOP-8116-HDFS-1623.patch
>
>
> HADOOP-7896 (on the HA branch) refactored RetryAction from an enum to a class, and also moved the act of sleeping to delay retries from the RetryPolicy implementations into RetryInvocationHandler. RetriableCommand, in the rewritten distcp tool, uses RetryPolicy and associated classes from o.a.h.io.retry. When MAPREDUCE-2765 was merged into the HA branch, RetriableCommand wasn't adjusted accordingly to make use of the new structure of the o.a.h.io.retry classes.
> It's probably generally not kosher for RetriableCommand to be using the RetryPolicy classes at all, since they're not really intended to be used except by RetryInvocationHandler. But, regardless, this JIRA aims to make distcp's use of the o.a.h.io.retry classes functional again.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
From common-dev-return-77870-apmail-hadoop-common-dev-archive=hadoop.apache.org@hadoop.apache.org Wed Feb 29 02:46:25 2012
Return-Path: <common-dev-return-77870-apmail-hadoop-common-dev-archive=hadoop.apache.org@hadoop.apache.org>
X-Original-To: apmail-hadoop-common-dev-archive@www.apache.org
Delivered-To: apmail-hadoop-common-dev-archive@www.apache.org
Received: from mail.apache.org (hermes.apache.org [140.211.11.3])
by minotaur.apache.org (Postfix) with SMTP id 93A529F75
for <apmail-hadoop-common-dev-archive@www.apache.org>; Wed, 29 Feb 2012 02:46:25 +0000 (UTC)
Received: (qmail 41166 invoked by uid 500); 29 Feb 2012 02:46:23 -0000
Delivered-To: apmail-hadoop-common-dev-archive@hadoop.apache.org
Received: (qmail 40919 invoked by uid 500); 29 Feb 2012 02:46:23 -0000
Mailing-List: contact common-dev-help@hadoop.apache.org; run by ezmlm
Precedence: bulk
List-Help: <mailto:common-dev-help@hadoop.apache.org>
List-Unsubscribe: <mailto:common-dev-unsubscribe@hadoop.apache.org>
List-Post: <mailto:common-dev@hadoop.apache.org>
List-Id: <common-dev.hadoop.apache.org>
Reply-To: common-dev@hadoop.apache.org
Delivered-To: mailing list common-dev@hadoop.apache.org
Received: (qmail 40864 invoked by uid 99); 29 Feb 2012 02:46:22 -0000
Received: from nike.apache.org (HELO nike.apache.org) (192.87.106.230)
by apache.org (qpsmtpd/0.29) with ESMTP; Wed, 29 Feb 2012 02:46:22 +0000
X-ASF-Spam-Status: No, hits=-2000.0 required=5.0
tests=ALL_TRUSTED,T_RP_MATCHES_RCVD
X-Spam-Check-By: apache.org
Received: from [140.211.11.116] (HELO hel.zones.apache.org) (140.211.11.116)
by apache.org (qpsmtpd/0.29) with ESMTP; Wed, 29 Feb 2012 02:46:19 +0000
Received: from hel.zones.apache.org (hel.zones.apache.org [140.211.11.116])
by hel.zones.apache.org (Postfix) with ESMTP id B8F7E54BB3
for <common-dev@hadoop.apache.org>; Wed, 29 Feb 2012 02:45:58 +0000 (UTC)
Date: Wed, 29 Feb 2012 02:45:58 +0000 (UTC)
From: "Tsz Wo (Nicholas), SZE (Created) (JIRA)" <jira@apache.org>
To: common-dev@hadoop.apache.org
Message-ID: <76620471.1168.1330483558758.JavaMail.tomcat@hel.zones.apache.org>
Subject: [jira] [Created] (HADOOP-8118) Print the stack trace of
InstanceAlreadyExistsException in trace level
MIME-Version: 1.0
Content-Type: text/plain; charset=utf-8
Content-Transfer-Encoding: 7bit
X-JIRA-FingerPrint: 30527f35849b9dde25b450d4833f0394
X-Virus-Checked: Checked by ClamAV on apache.org
Print the stack trace of InstanceAlreadyExistsException in trace level
----------------------------------------------------------------------
Key: HADOOP-8118
URL: https://issues.apache.org/jira/browse/HADOOP-8118
Project: Hadoop Common
Issue Type: Improvement
Components: metrics
Reporter: Tsz Wo (Nicholas), SZE
Assignee: Tsz Wo (Nicholas), SZE
Priority: Minor
There are many InstanceAlreadyExistsException stack traces in the unit tests output like below.
{noformat}
javax.management.InstanceAlreadyExistsException: Hadoop:service=NameNode,name=NameNodeInfo
at com.sun.jmx.mbeanserver.Repository.addMBean(Repository.java:453)
at com.sun.jmx.interceptor.DefaultMBeanServerInterceptor.internal_addObject(DefaultMBeanServerInterceptor.java:1484)
at com.sun.jmx.interceptor.DefaultMBeanServerInterceptor.registerDynamicMBean(DefaultMBeanServerInterceptor.java:963)
...
{noformat}
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
From common-dev-return-77871-apmail-hadoop-common-dev-archive=hadoop.apache.org@hadoop.apache.org Wed Feb 29 03:06:53 2012
Return-Path: <common-dev-return-77871-apmail-hadoop-common-dev-archive=hadoop.apache.org@hadoop.apache.org>
X-Original-To: apmail-hadoop-common-dev-archive@www.apache.org
Delivered-To: apmail-hadoop-common-dev-archive@www.apache.org
Received: from mail.apache.org (hermes.apache.org [140.211.11.3])
by minotaur.apache.org (Postfix) with SMTP id 533309947
for <apmail-hadoop-common-dev-archive@www.apache.org>; Wed, 29 Feb 2012 03:06:53 +0000 (UTC)
Received: (qmail 87061 invoked by uid 500); 29 Feb 2012 03:06:51 -0000
Delivered-To: apmail-hadoop-common-dev-archive@hadoop.apache.org
Received: (qmail 86963 invoked by uid 500); 29 Feb 2012 03:06:51 -0000
Mailing-List: contact common-dev-help@hadoop.apache.org; run by ezmlm
Precedence: bulk
List-Help: <mailto:common-dev-help@hadoop.apache.org>
List-Unsubscribe: <mailto:common-dev-unsubscribe@hadoop.apache.org>
List-Post: <mailto:common-dev@hadoop.apache.org>
List-Id: <common-dev.hadoop.apache.org>
Reply-To: common-dev@hadoop.apache.org
Delivered-To: mailing list common-dev@hadoop.apache.org
Received: (qmail 86911 invoked by uid 99); 29 Feb 2012 03:06:49 -0000
Received: from nike.apache.org (HELO nike.apache.org) (192.87.106.230)
by apache.org (qpsmtpd/0.29) with ESMTP; Wed, 29 Feb 2012 03:06:49 +0000
X-ASF-Spam-Status: No, hits=-2000.0 required=5.0
tests=ALL_TRUSTED,T_RP_MATCHES_RCVD
X-Spam-Check-By: apache.org
Received: from [140.211.11.116] (HELO hel.zones.apache.org) (140.211.11.116)
by apache.org (qpsmtpd/0.29) with ESMTP; Wed, 29 Feb 2012 03:06:47 +0000
Received: from hel.zones.apache.org (hel.zones.apache.org [140.211.11.116])
by hel.zones.apache.org (Postfix) with ESMTP id A76195435A
for <common-dev@hadoop.apache.org>; Wed, 29 Feb 2012 03:06:25 +0000 (UTC)
Date: Wed, 29 Feb 2012 03:06:25 +0000 (UTC)
From: "Tsz Wo (Nicholas), SZE (Created) (JIRA)" <jira@apache.org>
To: common-dev@hadoop.apache.org
Message-ID: <685887196.1205.1330484785891.JavaMail.tomcat@hel.zones.apache.org>
Subject: [jira] [Created] (HADOOP-8119) Fix javac warnings in
TestAuthenticationFilter
MIME-Version: 1.0
Content-Type: text/plain; charset=utf-8
Content-Transfer-Encoding: 7bit
X-JIRA-FingerPrint: 30527f35849b9dde25b450d4833f0394
X-Virus-Checked: Checked by ClamAV on apache.org
Fix javac warnings in TestAuthenticationFilter
----------------------------------------------
Key: HADOOP-8119
URL: https://issues.apache.org/jira/browse/HADOOP-8119
Project: Hadoop Common
Issue Type: Bug
Components: test
Reporter: Tsz Wo (Nicholas), SZE
Assignee: Tsz Wo (Nicholas), SZE
Priority: Minor
There are 43 javac warnings in TestAuthenticationFilter.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
From common-dev-return-77872-apmail-hadoop-common-dev-archive=hadoop.apache.org@hadoop.apache.org Wed Feb 29 04:10:46 2012
Return-Path: <common-dev-return-77872-apmail-hadoop-common-dev-archive=hadoop.apache.org@hadoop.apache.org>
X-Original-To: apmail-hadoop-common-dev-archive@www.apache.org
Delivered-To: apmail-hadoop-common-dev-archive@www.apache.org
Received: from mail.apache.org (hermes.apache.org [140.211.11.3])
by minotaur.apache.org (Postfix) with SMTP id DEB8A910D
for <apmail-hadoop-common-dev-archive@www.apache.org>; Wed, 29 Feb 2012 04:10:46 +0000 (UTC)
Received: (qmail 23535 invoked by uid 500); 29 Feb 2012 04:10:45 -0000
Delivered-To: apmail-hadoop-common-dev-archive@hadoop.apache.org
Received: (qmail 22080 invoked by uid 500); 29 Feb 2012 04:10:40 -0000
Mailing-List: contact common-dev-help@hadoop.apache.org; run by ezmlm
Precedence: bulk
List-Help: <mailto:common-dev-help@hadoop.apache.org>
List-Unsubscribe: <mailto:common-dev-unsubscribe@hadoop.apache.org>
List-Post: <mailto:common-dev@hadoop.apache.org>
List-Id: <common-dev.hadoop.apache.org>
Reply-To: common-dev@hadoop.apache.org
Delivered-To: mailing list common-dev@hadoop.apache.org
Received: (qmail 21757 invoked by uid 99); 29 Feb 2012 04:10:37 -0000
Received: from athena.apache.org (HELO athena.apache.org) (140.211.11.136)
by apache.org (qpsmtpd/0.29) with ESMTP; Wed, 29 Feb 2012 04:10:37 +0000
X-ASF-Spam-Status: No, hits=-2000.0 required=5.0
tests=ALL_TRUSTED,T_RP_MATCHES_RCVD
X-Spam-Check-By: apache.org
Received: from [140.211.11.116] (HELO hel.zones.apache.org) (140.211.11.116)
by apache.org (qpsmtpd/0.29) with ESMTP; Wed, 29 Feb 2012 04:10:32 +0000
Received: from hel.zones.apache.org (hel.zones.apache.org [140.211.11.116])
by hel.zones.apache.org (Postfix) with ESMTP id 8A66F54AD0
for <common-dev@hadoop.apache.org>; Wed, 29 Feb 2012 04:10:12 +0000 (UTC)
Date: Wed, 29 Feb 2012 04:10:12 +0000 (UTC)
From: "Sanjay Radia (Created) (JIRA)" <jira@apache.org>
To: common-dev@hadoop.apache.org
Message-ID: <2094180980.1356.1330488612582.JavaMail.tomcat@hel.zones.apache.org>
Subject: [jira] [Created] (HADOOP-8120) Refactor IPC client and server so
shared parts in separate class
MIME-Version: 1.0
Content-Type: text/plain; charset=utf-8
Content-Transfer-Encoding: 7bit
X-JIRA-FingerPrint: 30527f35849b9dde25b450d4833f0394
X-Virus-Checked: Checked by ClamAV on apache.org
Refactor IPC client and server so shared parts in separate class
----------------------------------------------------------------
Key: HADOOP-8120
URL: https://issues.apache.org/jira/browse/HADOOP-8120
Project: Hadoop Common
Issue Type: Improvement
Reporter: Sanjay Radia
Assignee: Sanjay Radia
Priority: Minor
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
From common-dev-return-77873-apmail-hadoop-common-dev-archive=hadoop.apache.org@hadoop.apache.org Wed Feb 29 09:22:16 2012
Return-Path: <common-dev-return-77873-apmail-hadoop-common-dev-archive=hadoop.apache.org@hadoop.apache.org>
X-Original-To: apmail-hadoop-common-dev-archive@www.apache.org
Delivered-To: apmail-hadoop-common-dev-archive@www.apache.org
Received: from mail.apache.org (hermes.apache.org [140.211.11.3])
by minotaur.apache.org (Postfix) with SMTP id 24E7B9B5B
for <apmail-hadoop-common-dev-archive@www.apache.org>; Wed, 29 Feb 2012 09:22:16 +0000 (UTC)
Received: (qmail 58980 invoked by uid 500); 29 Feb 2012 09:22:14 -0000
Delivered-To: apmail-hadoop-common-dev-archive@hadoop.apache.org
Received: (qmail 58871 invoked by uid 500); 29 Feb 2012 09:22:13 -0000
Mailing-List: contact common-dev-help@hadoop.apache.org; run by ezmlm
Precedence: bulk
List-Help: <mailto:common-dev-help@hadoop.apache.org>
List-Unsubscribe: <mailto:common-dev-unsubscribe@hadoop.apache.org>
List-Post: <mailto:common-dev@hadoop.apache.org>
List-Id: <common-dev.hadoop.apache.org>
Reply-To: common-dev@hadoop.apache.org
Delivered-To: mailing list common-dev@hadoop.apache.org
Received: (qmail 58857 invoked by uid 99); 29 Feb 2012 09:22:13 -0000
Received: from nike.apache.org (HELO nike.apache.org) (192.87.106.230)
by apache.org (qpsmtpd/0.29) with ESMTP; Wed, 29 Feb 2012 09:22:13 +0000
X-ASF-Spam-Status: No, hits=-2000.0 required=5.0
tests=ALL_TRUSTED
X-Spam-Check-By: apache.org
Received: from [140.211.11.8] (HELO aegis.apache.org) (140.211.11.8)
by apache.org (qpsmtpd/0.29) with ESMTP; Wed, 29 Feb 2012 09:22:11 +0000
Received: from aegis (localhost [127.0.0.1])
by aegis.apache.org (Postfix) with ESMTP id 44313C0005
for <common-dev@hadoop.apache.org>; Wed, 29 Feb 2012 09:21:50 +0000 (UTC)
Date: Wed, 29 Feb 2012 09:21:50 +0000 (UTC)
From: Apache Jenkins Server <jenkins@builds.apache.org>
To: common-dev@hadoop.apache.org
Message-ID: <291153530.1601330507310268.JavaMail.hudson@aegis>
In-Reply-To: <1153881635.61330420815158.JavaMail.hudson@aegis>
References: <1153881635.61330420815158.JavaMail.hudson@aegis>
Subject: Jenkins build is back to normal : Hadoop-Common-0.23-PB-Build #7
MIME-Version: 1.0
Content-Type: text/plain; charset=UTF-8
Content-Transfer-Encoding: 7bit
X-Jenkins-Job: Hadoop-Common-0.23-PB-Build
X-Jenkins-Result: SUCCESS
X-Virus-Checked: Checked by ClamAV on apache.org
See <https://builds.apache.org/job/Hadoop-Common-0.23-PB-Build/7/>
From common-dev-return-77874-apmail-hadoop-common-dev-archive=hadoop.apache.org@hadoop.apache.org Wed Feb 29 09:29:34 2012
Return-Path: <common-dev-return-77874-apmail-hadoop-common-dev-archive=hadoop.apache.org@hadoop.apache.org>
X-Original-To: apmail-hadoop-common-dev-archive@www.apache.org
Delivered-To: apmail-hadoop-common-dev-archive@www.apache.org
Received: from mail.apache.org (hermes.apache.org [140.211.11.3])
by minotaur.apache.org (Postfix) with SMTP id 44C1A992B
for <apmail-hadoop-common-dev-archive@www.apache.org>; Wed, 29 Feb 2012 09:29:34 +0000 (UTC)
Received: (qmail 79919 invoked by uid 500); 29 Feb 2012 09:29:32 -0000
Delivered-To: apmail-hadoop-common-dev-archive@hadoop.apache.org
Received: (qmail 79857 invoked by uid 500); 29 Feb 2012 09:29:32 -0000
Mailing-List: contact common-dev-help@hadoop.apache.org; run by ezmlm
Precedence: bulk
List-Help: <mailto:common-dev-help@hadoop.apache.org>
List-Unsubscribe: <mailto:common-dev-unsubscribe@hadoop.apache.org>
List-Post: <mailto:common-dev@hadoop.apache.org>
List-Id: <common-dev.hadoop.apache.org>
Reply-To: common-dev@hadoop.apache.org
Delivered-To: mailing list common-dev@hadoop.apache.org
Received: (qmail 79849 invoked by uid 99); 29 Feb 2012 09:29:32 -0000
Received: from nike.apache.org (HELO nike.apache.org) (192.87.106.230)
by apache.org (qpsmtpd/0.29) with ESMTP; Wed, 29 Feb 2012 09:29:32 +0000
X-ASF-Spam-Status: No, hits=-2000.0 required=5.0
tests=ALL_TRUSTED
X-Spam-Check-By: apache.org
Received: from [140.211.11.8] (HELO aegis.apache.org) (140.211.11.8)
by apache.org (qpsmtpd/0.29) with ESMTP; Wed, 29 Feb 2012 09:29:27 +0000
Received: from aegis (localhost [127.0.0.1])
by aegis.apache.org (Postfix) with ESMTP id 159BCC0005
for <common-dev@hadoop.apache.org>; Wed, 29 Feb 2012 09:29:06 +0000 (UTC)
Date: Wed, 29 Feb 2012 09:29:05 +0000 (UTC)
From: Apache Jenkins Server <jenkins@builds.apache.org>
To: common-dev@hadoop.apache.org
Message-ID: <453114499.1611330507746072.JavaMail.hudson@aegis>
In-Reply-To: <985796427.51330420806708.JavaMail.hudson@aegis>
References: <985796427.51330420806708.JavaMail.hudson@aegis>
Subject: Build failed in Jenkins: Hadoop-Common-0.23-Build #178
MIME-Version: 1.0
Content-Type: text/plain; charset=UTF-8
Content-Transfer-Encoding: 7bit
X-Jenkins-Job: Hadoop-Common-0.23-Build
X-Jenkins-Result: FAILURE
X-Virus-Checked: Checked by ClamAV on apache.org
See <https://builds.apache.org/job/Hadoop-Common-0.23-Build/178/changes>
Changes:
[vinodkv] MAPREDUCE-3931. Changed PB implementation of LocalResource to take locks so that race conditions don't fail tasks by inadvertantly changing the timestamps. Contributed by Siddarth Seth.
svn merge --ignore-ancestry -c 1294970 ../../trunk
[sseth] merge MAPREDUCE-3930 from trunk
[bobby] svn merge -c 1294808 trunk to branch 0.23 FIXES MAPREDUCE-3816 capacity scheduler web ui bar graphs for used capacity wrong (tgraves via bobby)
[tucu] Merge -r 1294783:1294784 from trunk to branch. FIXES: HADOOP-8104
[tucu] Merge -r 1294756:1294757 from trunk to branch. FIXES: HADOOP-8098
[tucu] Merge -r 1173738:1173739 from trunk to branch. FIXES: HADOOP-7621
[todd] HDFS-3024. Improve performance of stringification in addStoredBlock. Contributed by Todd Lipcon.
[bobby] svn merge -c 1294750 trunk to branch-0.23 FIXES MAPREDUCE-3790 Broken pipe on streaming job can lead to truncated output for a successful job (Jason Lowe via bobby)
[bobby] svn merge -c 1294743 trunk to branch-0.23 FIXES MAPREDUCE-3790 Broken pipe on streaming job can lead to truncated output for a successful job (Jason Lowe via bobby)
------------------------------------------
[...truncated 12381 lines...]
[javadoc] Loading source files for package org.apache.hadoop.fs.shell...
[javadoc] Loading source files for package org.apache.hadoop.fs.viewfs...
[javadoc] Loading source files for package org.apache.hadoop.http...
[javadoc] Loading source files for package org.apache.hadoop.http.lib...
[javadoc] Loading source files for package org.apache.hadoop.io...
[javadoc] Loading source files for package org.apache.hadoop.io.compress...
[javadoc] Loading source files for package org.apache.hadoop.io.compress.bzip2...
[javadoc] Loading source files for package org.apache.hadoop.io.compress.lz4...
[javadoc] Loading source files for package org.apache.hadoop.io.compress.snappy...
[javadoc] Loading source files for package org.apache.hadoop.io.compress.zlib...
[javadoc] Loading source files for package org.apache.hadoop.io.file.tfile...
[javadoc] Loading source files for package org.apache.hadoop.io.nativeio...
[javadoc] Loading source files for package org.apache.hadoop.io.retry...
[javadoc] Loading source files for package org.apache.hadoop.io.serializer...
[javadoc] Loading source files for package org.apache.hadoop.io.serializer.avro...
[javadoc] Loading source files for package org.apache.hadoop.ipc...
[javadoc] Loading source files for package org.apache.hadoop.ipc.metrics...
[javadoc] Loading source files for package org.apache.hadoop.jmx...
[javadoc] Loading source files for package org.apache.hadoop.log...
[javadoc] Loading source files for package org.apache.hadoop.log.metrics...
[javadoc] Loading source files for package org.apache.hadoop.metrics...
[javadoc] Loading source files for package org.apache.hadoop.metrics.file...
[javadoc] Loading source files for package org.apache.hadoop.metrics.ganglia...
[javadoc] Loading source files for package org.apache.hadoop.metrics.jvm...
[javadoc] Loading source files for package org.apache.hadoop.metrics.spi...
[javadoc] Loading source files for package org.apache.hadoop.metrics.util...
[javadoc] Loading source files for package org.apache.hadoop.metrics2...
[javadoc] Loading source files for package org.apache.hadoop.metrics2.annotation...
[javadoc] Loading source files for package org.apache.hadoop.metrics2.filter...
[javadoc] Loading source files for package org.apache.hadoop.metrics2.impl...
[javadoc] Loading source files for package org.apache.hadoop.metrics2.lib...
[javadoc] Loading source files for package org.apache.hadoop.metrics2.sink...
[javadoc] Loading source files for package org.apache.hadoop.metrics2.sink.ganglia...
[javadoc] Loading source files for package org.apache.hadoop.metrics2.source...
[javadoc] Loading source files for package org.apache.hadoop.metrics2.util...
[javadoc] Loading source files for package org.apache.hadoop.net...
[javadoc] Loading source files for package org.apache.hadoop.record...
[javadoc] Loading source files for package org.apache.hadoop.record.compiler...
[javadoc] Loading source files for package org.apache.hadoop.record.compiler.ant...
[javadoc] Loading source files for package org.apache.hadoop.record.compiler.generated...
[javadoc] Loading source files for package org.apache.hadoop.record.meta...
[javadoc] Loading source files for package org.apache.hadoop.security...
[javadoc] Loading source files for package org.apache.hadoop.security.authorize...
[javadoc] Loading source files for package org.apache.hadoop.security.token...
[javadoc] Loading source files for package org.apache.hadoop.security.token.delegation...
[javadoc] Loading source files for package org.apache.hadoop.tools...
[javadoc] Loading source files for package org.apache.hadoop.util...
[javadoc] Loading source files for package org.apache.hadoop.util.bloom...
[javadoc] Loading source files for package org.apache.hadoop.util.hash...
[javadoc] 2 errors
[xslt] Processing <https://builds.apache.org/job/Hadoop-Common-0.23-Build/ws/trunk/hadoop-common-project/hadoop-common/target/findbugsXml.xml> to <https://builds.apache.org/job/Hadoop-Common-0.23-Build/ws/trunk/hadoop-common-project/hadoop-common/target/site/findbugs.html>
[xslt] Loading stylesheet /home/jenkins/tools/findbugs/latest/src/xsl/default.xsl
[INFO] Executed tasks
[INFO]
[INFO] --- maven-antrun-plugin:1.6:run (pre-dist) @ hadoop-common ---
[INFO] Executing tasks
main:
[INFO] Executed tasks
[INFO]
[INFO] >>> maven-javadoc-plugin:2.8.1:javadoc (default) @ hadoop-common >>>
[INFO]
[INFO] --- maven-antrun-plugin:1.6:run (create-testdirs) @ hadoop-common ---
[INFO] Executing tasks
main:
[INFO] Executed tasks
[INFO]
[INFO] --- build-helper-maven-plugin:1.5:add-source (add-source) @ hadoop-common ---
[INFO] Source directory: <https://builds.apache.org/job/Hadoop-Common-0.23-Build/ws/trunk/hadoop-common-project/hadoop-common/target/generated-sources/java> added.
[INFO]
[INFO] --- build-helper-maven-plugin:1.5:add-test-source (add-test-source) @ hadoop-common ---
[INFO] Test Source directory: <https://builds.apache.org/job/Hadoop-Common-0.23-Build/ws/trunk/hadoop-common-project/hadoop-common/target/generated-test-sources/java> added.
[INFO]
[INFO] --- maven-antrun-plugin:1.6:run (compile-proto) @ hadoop-common ---
[INFO] Executing tasks
main:
[INFO] Executed tasks
[INFO]
[INFO] --- maven-antrun-plugin:1.6:run (save-version) @ hadoop-common ---
[INFO] Executing tasks
main:
[INFO] Executed tasks
[INFO]
[INFO] <<< maven-javadoc-plugin:2.8.1:javadoc (default) @ hadoop-common <<<
[INFO]
[INFO] --- maven-javadoc-plugin:2.8.1:javadoc (default) @ hadoop-common ---
[INFO]
ExcludePrivateAnnotationsStandardDoclet
9 warnings
[WARNING] Javadoc Warnings
[WARNING] <https://builds.apache.org/job/Hadoop-Common-0.23-Build/ws/trunk/hadoop-common-project/hadoop-common/src/main/java/org/apache/hadoop/security/SecurityUtil.java>:49: warning: sun.net.dns.ResolverConfiguration is Sun proprietary API and may be removed in a future release
[WARNING] import sun.net.dns.ResolverConfiguration;
[WARNING] ^
[WARNING] <https://builds.apache.org/job/Hadoop-Common-0.23-Build/ws/trunk/hadoop-common-project/hadoop-common/src/main/java/org/apache/hadoop/security/SecurityUtil.java>:50: warning: sun.net.util.IPAddressUtil is Sun proprietary API and may be removed in a future release
[WARNING] import sun.net.util.IPAddressUtil;
[WARNING] ^
[WARNING] <https://builds.apache.org/job/Hadoop-Common-0.23-Build/ws/trunk/hadoop-common-project/hadoop-common/src/main/java/org/apache/hadoop/security/SecurityUtil.java>:51: warning: sun.security.jgss.krb5.Krb5Util is Sun proprietary API and may be removed in a future release
[WARNING] import sun.security.jgss.krb5.Krb5Util;
[WARNING] ^
[WARNING] <https://builds.apache.org/job/Hadoop-Common-0.23-Build/ws/trunk/hadoop-common-project/hadoop-common/src/main/java/org/apache/hadoop/security/SecurityUtil.java>:52: warning: sun.security.krb5.Credentials is Sun proprietary API and may be removed in a future release
[WARNING] import sun.security.krb5.Credentials;
[WARNING] ^
[WARNING] <https://builds.apache.org/job/Hadoop-Common-0.23-Build/ws/trunk/hadoop-common-project/hadoop-common/src/main/java/org/apache/hadoop/security/SecurityUtil.java>:53: warning: sun.security.krb5.PrincipalName is Sun proprietary API and may be removed in a future release
[WARNING] import sun.security.krb5.PrincipalName;
[WARNING] ^
[WARNING] <https://builds.apache.org/job/Hadoop-Common-0.23-Build/ws/trunk/hadoop-common-project/hadoop-common/src/main/java/org/apache/hadoop/security/HadoopKerberosName.java>:28: warning: sun.security.krb5.Config is Sun proprietary API and may be removed in a future release
[WARNING] import sun.security.krb5.Config;
[WARNING] ^
[WARNING] <https://builds.apache.org/job/Hadoop-Common-0.23-Build/ws/trunk/hadoop-common-project/hadoop-common/src/main/java/org/apache/hadoop/security/HadoopKerberosName.java>:29: warning: sun.security.krb5.KrbException is Sun proprietary API and may be removed in a future release
[WARNING] import sun.security.krb5.KrbException;
[WARNING] ^
[WARNING] <https://builds.apache.org/job/Hadoop-Common-0.23-Build/ws/trunk/hadoop-common-project/hadoop-common/src/main/java/org/apache/hadoop/io/FastByteComparisons.java>:25: warning: sun.misc.Unsafe is Sun proprietary API and may be removed in a future release
[WARNING] import sun.misc.Unsafe;
[WARNING] ^
[WARNING] <https://builds.apache.org/job/Hadoop-Common-0.23-Build/ws/trunk/hadoop-common-project/hadoop-common/src/main/java/org/apache/hadoop/io/FastByteComparisons.java>:117: warning: sun.misc.Unsafe is Sun proprietary API and may be removed in a future release
[WARNING] static final Unsafe theUnsafe;
[WARNING] ^
[INFO]
[INFO] --- maven-assembly-plugin:2.2.1:single (dist) @ hadoop-common ---
[WARNING] The following patterns were never triggered in this artifact exclusion filter:
o 'org.apache.ant:*:jar'
o 'jdiff:jdiff:jar'
[INFO] share/hadoop/common/jdiff/ already added, skipping
[INFO] Copying files to <https://builds.apache.org/job/Hadoop-Common-0.23-Build/ws/trunk/hadoop-common-project/hadoop-common/target/hadoop-common-0.23.3-SNAPSHOT>
[INFO] share/hadoop/common/jdiff/ already added, skipping
[INFO]
[INFO] --- maven-jar-plugin:2.3.1:jar (default-jar) @ hadoop-common ---
[INFO]
[INFO] --- maven-source-plugin:2.1.2:jar-no-fork (hadoop-java-sources) @ hadoop-common ---
[INFO] org already added, skipping
[INFO] org/apache already added, skipping
[INFO] org/apache/hadoop already added, skipping
[INFO] org/apache/hadoop/ipc already added, skipping
[INFO] org/apache/hadoop/ipc/protobuf already added, skipping
[INFO] Building jar: <https://builds.apache.org/job/Hadoop-Common-0.23-Build/ws/trunk/hadoop-common-project/hadoop-common/target/hadoop-common-0.23.3-SNAPSHOT-sources.jar>
[INFO] org already added, skipping
[INFO] org/apache already added, skipping
[INFO] org/apache/hadoop already added, skipping
[INFO] org/apache/hadoop/ipc already added, skipping
[INFO] org/apache/hadoop/ipc/protobuf already added, skipping
[WARNING] Artifact org.apache.hadoop:hadoop-common:java-source:sources:0.23.3-SNAPSHOT already attached to project, ignoring duplicate
[INFO]
[INFO] --- maven-site-plugin:3.0:attach-descriptor (attach-descriptor) @ hadoop-common ---
[INFO]
[INFO] --- maven-antrun-plugin:1.6:run (tar) @ hadoop-common ---
[INFO] Executing tasks
main:
[INFO] Executed tasks
[INFO]
[INFO] --- maven-javadoc-plugin:2.8.1:jar (module-javadocs) @ hadoop-common ---
[INFO]
ExcludePrivateAnnotationsStandardDoclet
9 warnings
[WARNING] Javadoc Warnings
[WARNING] <https://builds.apache.org/job/Hadoop-Common-0.23-Build/ws/trunk/hadoop-common-project/hadoop-common/src/main/java/org/apache/hadoop/security/SecurityUtil.java>:49: warning: sun.net.dns.ResolverConfiguration is Sun proprietary API and may be removed in a future release
[WARNING] import sun.net.dns.ResolverConfiguration;
[WARNING] ^
[WARNING] <https://builds.apache.org/job/Hadoop-Common-0.23-Build/ws/trunk/hadoop-common-project/hadoop-common/src/main/java/org/apache/hadoop/security/SecurityUtil.java>:50: warning: sun.net.util.IPAddressUtil is Sun proprietary API and may be removed in a future release
[WARNING] import sun.net.util.IPAddressUtil;
[WARNING] ^
[WARNING] <https://builds.apache.org/job/Hadoop-Common-0.23-Build/ws/trunk/hadoop-common-project/hadoop-common/src/main/java/org/apache/hadoop/security/SecurityUtil.java>:51: warning: sun.security.jgss.krb5.Krb5Util is Sun proprietary API and may be removed in a future release
[WARNING] import sun.security.jgss.krb5.Krb5Util;
[WARNING] ^
[WARNING] <https://builds.apache.org/job/Hadoop-Common-0.23-Build/ws/trunk/hadoop-common-project/hadoop-common/src/main/java/org/apache/hadoop/security/SecurityUtil.java>:52: warning: sun.security.krb5.Credentials is Sun proprietary API and may be removed in a future release
[WARNING] import sun.security.krb5.Credentials;
[WARNING] ^
[WARNING] <https://builds.apache.org/job/Hadoop-Common-0.23-Build/ws/trunk/hadoop-common-project/hadoop-common/src/main/java/org/apache/hadoop/security/SecurityUtil.java>:53: warning: sun.security.krb5.PrincipalName is Sun proprietary API and may be removed in a future release
[WARNING] import sun.security.krb5.PrincipalName;
[WARNING] ^
[WARNING] <https://builds.apache.org/job/Hadoop-Common-0.23-Build/ws/trunk/hadoop-common-project/hadoop-common/src/main/java/org/apache/hadoop/security/HadoopKerberosName.java>:28: warning: sun.security.krb5.Config is Sun proprietary API and may be removed in a future release
[WARNING] import sun.security.krb5.Config;
[WARNING] ^
[WARNING] <https://builds.apache.org/job/Hadoop-Common-0.23-Build/ws/trunk/hadoop-common-project/hadoop-common/src/main/java/org/apache/hadoop/security/HadoopKerberosName.java>:29: warning: sun.security.krb5.KrbException is Sun proprietary API and may be removed in a future release
[WARNING] import sun.security.krb5.KrbException;
[WARNING] ^
[WARNING] <https://builds.apache.org/job/Hadoop-Common-0.23-Build/ws/trunk/hadoop-common-project/hadoop-common/src/main/java/org/apache/hadoop/io/FastByteComparisons.java>:25: warning: sun.misc.Unsafe is Sun proprietary API and may be removed in a future release
[WARNING] import sun.misc.Unsafe;
[WARNING] ^
[WARNING] <https://builds.apache.org/job/Hadoop-Common-0.23-Build/ws/trunk/hadoop-common-project/hadoop-common/src/main/java/org/apache/hadoop/io/FastByteComparisons.java>:117: warning: sun.misc.Unsafe is Sun proprietary API and may be removed in a future release
[WARNING] static final Unsafe theUnsafe;
[WARNING] ^
[INFO] Building jar: <https://builds.apache.org/job/Hadoop-Common-0.23-Build/ws/trunk/hadoop-common-project/hadoop-common/target/hadoop-common-0.23.3-SNAPSHOT-javadoc.jar>
[INFO]
[INFO] --- maven-checkstyle-plugin:2.6:checkstyle (default-cli) @ hadoop-common ---
[INFO]
[INFO] There are 8678 checkstyle errors.
[WARNING] Unable to locate Source XRef to link to - DISABLED
[INFO]
[INFO] --- findbugs-maven-plugin:2.3.2:findbugs (default-cli) @ hadoop-common ---
[INFO] ****** FindBugsMojo execute *******
[INFO] canGenerate is true
[INFO] ****** FindBugsMojo executeFindbugs *******
[INFO] Temp File is <https://builds.apache.org/job/Hadoop-Common-0.23-Build/ws/trunk/hadoop-common-project/hadoop-common/target/findbugsTemp.xml>
[INFO] Fork Value is true
[INFO] xmlOutput is false
[INFO]
[INFO] ------------------------------------------------------------------------
[INFO] Building Apache Hadoop Common Project 0.23.3-SNAPSHOT
[INFO] ------------------------------------------------------------------------
[INFO]
[INFO] --- maven-clean-plugin:2.4.1:clean (default-clean) @ hadoop-common-project ---
[INFO] Deleting <https://builds.apache.org/job/Hadoop-Common-0.23-Build/ws/trunk/hadoop-common-project/target>
[INFO]
[INFO] --- maven-antrun-plugin:1.6:run (create-testdirs) @ hadoop-common-project ---
[INFO] Executing tasks
main:
[mkdir] Created dir: <https://builds.apache.org/job/Hadoop-Common-0.23-Build/ws/trunk/hadoop-common-project/target/test-dir>
[INFO] Executed tasks
[INFO]
[INFO] --- maven-source-plugin:2.1.2:jar-no-fork (hadoop-java-sources) @ hadoop-common-project ---
[INFO]
[INFO] --- maven-site-plugin:3.0:attach-descriptor (attach-descriptor) @ hadoop-common-project ---
[INFO]
[INFO] --- maven-javadoc-plugin:2.8.1:jar (module-javadocs) @ hadoop-common-project ---
[INFO] Not executing Javadoc as the project is not a Java classpath-capable package
[INFO]
[INFO] --- maven-checkstyle-plugin:2.6:checkstyle (default-cli) @ hadoop-common-project ---
[INFO]
[INFO] --- findbugs-maven-plugin:2.3.2:findbugs (default-cli) @ hadoop-common-project ---
[INFO] ****** FindBugsMojo execute *******
[INFO] canGenerate is false
[INFO] ------------------------------------------------------------------------
[INFO] Reactor Summary:
[INFO]
[INFO] Apache Hadoop Annotations ......................... SUCCESS [13.809s]
[INFO] Apache Hadoop Auth ................................ SUCCESS [19.317s]
[INFO] Apache Hadoop Auth Examples ....................... SUCCESS [7.460s]
[INFO] Apache Hadoop Common .............................. SUCCESS [4:22.888s]
[INFO] Apache Hadoop Common Project ...................... SUCCESS [0.032s]
[INFO] ------------------------------------------------------------------------
[INFO] BUILD SUCCESS
[INFO] ------------------------------------------------------------------------
[INFO] Total time: 5:04.533s
[INFO] Finished at: Wed Feb 29 09:10:55 UTC 2012
[INFO] Final Memory: 79M/821M
[INFO] ------------------------------------------------------------------------
+ /home/jenkins/tools/maven/latest/bin/mvn test -Pclover -DcloverLicenseLocation=/home/jenkins/tools/clover/latest/lib/clover.license
Build step 'Execute shell' marked build as failure
[WARNINGS] Skipping publisher since build result is FAILURE
Archiving artifacts
Recording fingerprints
Publishing Javadoc
Recording test results
From common-dev-return-77875-apmail-hadoop-common-dev-archive=hadoop.apache.org@hadoop.apache.org Wed Feb 29 10:30:12 2012
Return-Path: <common-dev-return-77875-apmail-hadoop-common-dev-archive=hadoop.apache.org@hadoop.apache.org>
X-Original-To: apmail-hadoop-common-dev-archive@www.apache.org
Delivered-To: apmail-hadoop-common-dev-archive@www.apache.org
Received: from mail.apache.org (hermes.apache.org [140.211.11.3])
by minotaur.apache.org (Postfix) with SMTP id 1E96E9AD5
for <apmail-hadoop-common-dev-archive@www.apache.org>; Wed, 29 Feb 2012 10:30:12 +0000 (UTC)
Received: (qmail 54733 invoked by uid 500); 29 Feb 2012 10:30:10 -0000
Delivered-To: apmail-hadoop-common-dev-archive@hadoop.apache.org
Received: (qmail 54678 invoked by uid 500); 29 Feb 2012 10:30:10 -0000
Mailing-List: contact common-dev-help@hadoop.apache.org; run by ezmlm
Precedence: bulk
List-Help: <mailto:common-dev-help@hadoop.apache.org>
List-Unsubscribe: <mailto:common-dev-unsubscribe@hadoop.apache.org>
List-Post: <mailto:common-dev@hadoop.apache.org>
List-Id: <common-dev.hadoop.apache.org>
Reply-To: common-dev@hadoop.apache.org
Delivered-To: mailing list common-dev@hadoop.apache.org
Received: (qmail 54668 invoked by uid 99); 29 Feb 2012 10:30:10 -0000
Received: from nike.apache.org (HELO nike.apache.org) (192.87.106.230)
by apache.org (qpsmtpd/0.29) with ESMTP; Wed, 29 Feb 2012 10:30:10 +0000
X-ASF-Spam-Status: No, hits=-0.1 required=5.0
tests=HTML_MESSAGE,RCVD_IN_DNSWL_MED,SPF_PASS
X-Spam-Check-By: apache.org
Received-SPF: pass (nike.apache.org: domain of vinayakumar.b@huawei.com designates 119.145.14.64 as permitted sender)
Received: from [119.145.14.64] (HELO szxga01-in.huawei.com) (119.145.14.64)
by apache.org (qpsmtpd/0.29) with ESMTP; Wed, 29 Feb 2012 10:30:02 +0000
Received: from huawei.com (szxga05-in [172.24.2.49])
by szxga05-in.huawei.com (iPlanet Messaging Server 5.2 HotFix 2.14 (built Aug
8 2006)) with ESMTP id <0M0500J75H51A5@szxga05-in.huawei.com>; Wed,
29 Feb 2012 18:29:26 +0800 (CST)
Received: from szxrg02-dlp.huawei.com ([172.24.2.119])
by szxga05-in.huawei.com (iPlanet Messaging Server 5.2 HotFix 2.14 (built Aug
8 2006)) with ESMTP id <0M0500KZ9H51O8@szxga05-in.huawei.com>; Wed,
29 Feb 2012 18:29:25 +0800 (CST)
Received: from szxeml210-edg.china.huawei.com ([172.24.2.119])
by szxrg02-dlp.huawei.com (MOS 4.1.9-GA) with ESMTP id AHM61697; Wed,
29 Feb 2012 18:29:19 +0800
Received: from SZXEML426-HUB.china.huawei.com (10.72.61.34)
by szxeml210-edg.china.huawei.com (172.24.2.183) with Microsoft SMTP Server
(TLS) id 14.1.323.3; Wed, 29 Feb 2012 18:28:56 +0800
Received: from SZXEML510-MBX.china.huawei.com ([169.254.7.220])
by szxeml426-hub.china.huawei.com ([10.72.61.34]) with mapi id 14.01.0323.003;
Wed, 29 Feb 2012 18:29:14 +0800
Date: Wed, 29 Feb 2012 10:29:12 +0000
From: Vinayakumar B <vinayakumar.b@huawei.com>
Subject: [Important] Checksum Error while appending to the file.
X-Originating-IP: [10.85.157.83]
To: "hdfs-dev@hadoop.apache.org" <hdfs-dev@hadoop.apache.org>,
"," <common-dev@hadoop.apache.org>
Message-id:
<5DF48A23D7B14649BBA72C2F64C6663B44358BDE@SZXEML510-MBX.china.huawei.com>
MIME-version: 1.0
Content-type: multipart/alternative;
boundary="Boundary_(ID_N975nSkKjWWPzuTBA4+ibQ)"
Content-language: en-US
Accept-Language: en-US, zh-CN
Thread-topic: [Important] Checksum Error while appending to the file.
Thread-index: Acz2zFPl779WXVgpThO47bats9gJ3w==
X-MS-Has-Attach:
X-MS-TNEF-Correlator:
X-CFilter-Loop: Reflected
X-Virus-Checked: Checked by ClamAV on apache.org
--Boundary_(ID_N975nSkKjWWPzuTBA4+ibQ)
Content-type: text/plain; charset=iso-8859-1
Content-transfer-encoding: 7BIT
Hi All,
In one of our hadoop cluster we faced CheckSum file Corruption, due to which appending to the file failed.
If any one of you faced this problem earlier, please share your experiences.
We are using hadoop 0.20.1 with append feature.
Scenario:
===============
1. Created the file, written 305 bytes, closed the Stream.
2. Called append to same file and written 307 bytes and closed the stream.
3. Repeated the Step 2 with different bytes (311, 313, 307, 305, 313, 311, 307, 311, 313, 307, 307, 307, 305, 307, 305, 290, 288, 305, 307, 307, 307, 290);
4. Now again Step 2 is repeated with 294 bytes. Now pipeline was {xxx.xxx.xxx.106:50010, xxx.xxx.xxx.xxx:10010}
Now file length becomes 7629. And stream is closed.
Here checksum will be verified by the Last DataNode in the pipeline for every packet received.
If verification fails then Exception will be thrown.
Since There is no exception in any of the DataNode Logs, Checksum verification should be successful. And meta file size should be 67 bytes.
Meta File should contain 15 checksum bytes and 7 header bytes. 7629/512=14 checksums for full chunks and 1 checksum for partial chunk.
5. Now Again append to the same file is called, Now append fails because of the recovery failure at DataNodes due to below Exception.
java.io.IOException: Block blk_1329468764084_188363 is of size 7629 but has 17 checksums and each checksum size is 4 bytes.
at org.apache.hadoop.hdfs.server.datanode.FSDataset.validateBlockMetadata(FSDataset.java:1922)
at org.apache.hadoop.hdfs.server.datanode.FSDataset.startBlockRecovery(FSDataset.java:2142)
at org.apache.hadoop.hdfs.server.datanode.DataNode.startBlockRecovery(DataNode.java:2078)
at sun.reflect.GeneratedMethodAccessor29.invoke(Unknown Source)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
at java.lang.reflect.Method.invoke(Method.java:597)
at org.apache.hadoop.ipc.RPC$Server.call(RPC.java:547)
at org.apache.hadoop.ipc.Server$Handler$1.run(Server.java:1139)
at org.apache.hadoop.ipc.Server$Handler$1.run(Server.java:1135)
at java.security.AccessController.doPrivileged(Native Method)
at javax.security.auth.Subject.doAs(Subject.java:396)
at org.apache.hadoop.ipc.Server$Handler.run(Server.java:1133)
Here metafile length is 17*4+7=75 bytes. But it should be 67 bytes according to step 5.
Data block size in Step 4 and Step 5 are matching, but metafile sizes are not matching.
Thanks and Regards,
Vinayakumar B
--Boundary_(ID_N975nSkKjWWPzuTBA4+ibQ)--
From common-dev-return-77876-apmail-hadoop-common-dev-archive=hadoop.apache.org@hadoop.apache.org Wed Feb 29 16:14:19 2012
Return-Path: <common-dev-return-77876-apmail-hadoop-common-dev-archive=hadoop.apache.org@hadoop.apache.org>
X-Original-To: apmail-hadoop-common-dev-archive@www.apache.org
Delivered-To: apmail-hadoop-common-dev-archive@www.apache.org
Received: from mail.apache.org (hermes.apache.org [140.211.11.3])
by minotaur.apache.org (Postfix) with SMTP id 9CE4C9B1A
for <apmail-hadoop-common-dev-archive@www.apache.org>; Wed, 29 Feb 2012 16:14:19 +0000 (UTC)
Received: (qmail 1547 invoked by uid 500); 29 Feb 2012 16:14:18 -0000
Delivered-To: apmail-hadoop-common-dev-archive@hadoop.apache.org
Received: (qmail 1471 invoked by uid 500); 29 Feb 2012 16:14:18 -0000
Mailing-List: contact common-dev-help@hadoop.apache.org; run by ezmlm
Precedence: bulk
List-Help: <mailto:common-dev-help@hadoop.apache.org>
List-Unsubscribe: <mailto:common-dev-unsubscribe@hadoop.apache.org>
List-Post: <mailto:common-dev@hadoop.apache.org>
List-Id: <common-dev.hadoop.apache.org>
Reply-To: common-dev@hadoop.apache.org
Delivered-To: mailing list common-dev@hadoop.apache.org
Received: (qmail 1463 invoked by uid 99); 29 Feb 2012 16:14:17 -0000
Received: from athena.apache.org (HELO athena.apache.org) (140.211.11.136)
by apache.org (qpsmtpd/0.29) with ESMTP; Wed, 29 Feb 2012 16:14:17 +0000
X-ASF-Spam-Status: No, hits=-2000.0 required=5.0
tests=ALL_TRUSTED,T_RP_MATCHES_RCVD
X-Spam-Check-By: apache.org
Received: from [140.211.11.116] (HELO hel.zones.apache.org) (140.211.11.116)
by apache.org (qpsmtpd/0.29) with ESMTP; Wed, 29 Feb 2012 16:14:17 +0000
Received: from hel.zones.apache.org (hel.zones.apache.org [140.211.11.116])
by hel.zones.apache.org (Postfix) with ESMTP id 10B22C7612
for <common-dev@hadoop.apache.org>; Wed, 29 Feb 2012 16:13:57 +0000 (UTC)
Date: Wed, 29 Feb 2012 16:13:57 +0000 (UTC)
From: "Jonathan Natkins (Created) (JIRA)" <jira@apache.org>
To: common-dev@hadoop.apache.org
Message-ID: <520655657.3447.1330532037069.JavaMail.tomcat@hel.zones.apache.org>
Subject: [jira] [Created] (HADOOP-8121) Active Directory Group Mapping
Service
MIME-Version: 1.0
Content-Type: text/plain; charset=utf-8
Content-Transfer-Encoding: 7bit
X-JIRA-FingerPrint: 30527f35849b9dde25b450d4833f0394
X-Virus-Checked: Checked by ClamAV on apache.org
Active Directory Group Mapping Service
--------------------------------------
Key: HADOOP-8121
URL: https://issues.apache.org/jira/browse/HADOOP-8121
Project: Hadoop Common
Issue Type: New Feature
Components: security
Reporter: Jonathan Natkins
Assignee: Jonathan Natkins
Planning on building a group mapping service that will go and talk directly to an Active Directory setup to get group memberships
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
From common-dev-return-77877-apmail-hadoop-common-dev-archive=hadoop.apache.org@hadoop.apache.org Wed Feb 29 18:26:23 2012
Return-Path: <common-dev-return-77877-apmail-hadoop-common-dev-archive=hadoop.apache.org@hadoop.apache.org>
X-Original-To: apmail-hadoop-common-dev-archive@www.apache.org
Delivered-To: apmail-hadoop-common-dev-archive@www.apache.org
Received: from mail.apache.org (hermes.apache.org [140.211.11.3])
by minotaur.apache.org (Postfix) with SMTP id 5F366915E
for <apmail-hadoop-common-dev-archive@www.apache.org>; Wed, 29 Feb 2012 18:26:23 +0000 (UTC)
Received: (qmail 35935 invoked by uid 500); 29 Feb 2012 18:26:21 -0000
Delivered-To: apmail-hadoop-common-dev-archive@hadoop.apache.org
Received: (qmail 35830 invoked by uid 500); 29 Feb 2012 18:26:21 -0000
Mailing-List: contact common-dev-help@hadoop.apache.org; run by ezmlm
Precedence: bulk
List-Help: <mailto:common-dev-help@hadoop.apache.org>
List-Unsubscribe: <mailto:common-dev-unsubscribe@hadoop.apache.org>
List-Post: <mailto:common-dev@hadoop.apache.org>
List-Id: <common-dev.hadoop.apache.org>
Reply-To: common-dev@hadoop.apache.org
Delivered-To: mailing list common-dev@hadoop.apache.org
Received: (qmail 35725 invoked by uid 99); 29 Feb 2012 18:26:21 -0000
Received: from nike.apache.org (HELO nike.apache.org) (192.87.106.230)
by apache.org (qpsmtpd/0.29) with ESMTP; Wed, 29 Feb 2012 18:26:21 +0000
X-ASF-Spam-Status: No, hits=-2000.0 required=5.0
tests=ALL_TRUSTED,T_RP_MATCHES_RCVD
X-Spam-Check-By: apache.org
Received: from [140.211.11.116] (HELO hel.zones.apache.org) (140.211.11.116)
by apache.org (qpsmtpd/0.29) with ESMTP; Wed, 29 Feb 2012 18:26:18 +0000
Received: from hel.zones.apache.org (hel.zones.apache.org [140.211.11.116])
by hel.zones.apache.org (Postfix) with ESMTP id E3904C7F4F
for <common-dev@hadoop.apache.org>; Wed, 29 Feb 2012 18:25:57 +0000 (UTC)
Date: Wed, 29 Feb 2012 18:25:57 +0000 (UTC)
From: "Suresh Srinivas (Created) (JIRA)" <jira@apache.org>
To: common-dev@hadoop.apache.org
Message-ID: <2064859770.3879.1330539957933.JavaMail.tomcat@hel.zones.apache.org>
Subject: [jira] [Created] (HADOOP-8122) Build should fail when compilation
.proto files fail
MIME-Version: 1.0
Content-Type: text/plain; charset=utf-8
Content-Transfer-Encoding: 7bit
X-JIRA-FingerPrint: 30527f35849b9dde25b450d4833f0394
X-Virus-Checked: Checked by ClamAV on apache.org
Build should fail when compilation .proto files fail
----------------------------------------------------
Key: HADOOP-8122
URL: https://issues.apache.org/jira/browse/HADOOP-8122
Project: Hadoop Common
Issue Type: Bug
Components: build
Affects Versions: 0.24.0
Reporter: Suresh Srinivas
Build continues even if the .proto file compilation fails. The build should stop and flag an error when generating java files from .proto files fail.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
From common-dev-return-77878-apmail-hadoop-common-dev-archive=hadoop.apache.org@hadoop.apache.org Wed Feb 29 22:28:21 2012
Return-Path: <common-dev-return-77878-apmail-hadoop-common-dev-archive=hadoop.apache.org@hadoop.apache.org>
X-Original-To: apmail-hadoop-common-dev-archive@www.apache.org
Delivered-To: apmail-hadoop-common-dev-archive@www.apache.org
Received: from mail.apache.org (hermes.apache.org [140.211.11.3])
by minotaur.apache.org (Postfix) with SMTP id DFCF69D94
for <apmail-hadoop-common-dev-archive@www.apache.org>; Wed, 29 Feb 2012 22:28:20 +0000 (UTC)
Received: (qmail 7457 invoked by uid 500); 29 Feb 2012 22:28:19 -0000
Delivered-To: apmail-hadoop-common-dev-archive@hadoop.apache.org
Received: (qmail 7398 invoked by uid 500); 29 Feb 2012 22:28:19 -0000
Mailing-List: contact common-dev-help@hadoop.apache.org; run by ezmlm
Precedence: bulk
List-Help: <mailto:common-dev-help@hadoop.apache.org>
List-Unsubscribe: <mailto:common-dev-unsubscribe@hadoop.apache.org>
List-Post: <mailto:common-dev@hadoop.apache.org>
List-Id: <common-dev.hadoop.apache.org>
Reply-To: common-dev@hadoop.apache.org
Delivered-To: mailing list common-dev@hadoop.apache.org
Received: (qmail 7390 invoked by uid 99); 29 Feb 2012 22:28:19 -0000
Received: from athena.apache.org (HELO athena.apache.org) (140.211.11.136)
by apache.org (qpsmtpd/0.29) with ESMTP; Wed, 29 Feb 2012 22:28:19 +0000
X-ASF-Spam-Status: No, hits=-2000.0 required=5.0
tests=ALL_TRUSTED,T_RP_MATCHES_RCVD
X-Spam-Check-By: apache.org
Received: from [140.211.11.116] (HELO hel.zones.apache.org) (140.211.11.116)
by apache.org (qpsmtpd/0.29) with ESMTP; Wed, 29 Feb 2012 22:28:18 +0000
Received: from hel.zones.apache.org (hel.zones.apache.org [140.211.11.116])
by hel.zones.apache.org (Postfix) with ESMTP id EF299C8205
for <common-dev@hadoop.apache.org>; Wed, 29 Feb 2012 22:27:57 +0000 (UTC)
Date: Wed, 29 Feb 2012 22:27:57 +0000 (UTC)
From: "Jonathan Eagles (Created) (JIRA)" <jira@apache.org>
To: common-dev@hadoop.apache.org
Message-ID: <938216301.5125.1330554477980.JavaMail.tomcat@hel.zones.apache.org>
Subject: [jira] [Created] (HADOOP-8123) hadoop-project invalid pom warnings
prevent transitive dependency resolution
MIME-Version: 1.0
Content-Type: text/plain; charset=utf-8
Content-Transfer-Encoding: 7bit
X-JIRA-FingerPrint: 30527f35849b9dde25b450d4833f0394
X-Virus-Checked: Checked by ClamAV on apache.org
hadoop-project invalid pom warnings prevent transitive dependency resolution
----------------------------------------------------------------------------
Key: HADOOP-8123
URL: https://issues.apache.org/jira/browse/HADOOP-8123
Project: Hadoop Common
Issue Type: Bug
Components: build
Affects Versions: 0.23.1
Reporter: Jonathan Eagles
Assignee: Jonathan Eagles
Priority: Critical
[DEBUG] Artifact resolved
[WARNING] POM for 'org.apache.hadoop:hadoop-common:pom:0.23.1:compile' is invalid.
Its dependencies (if any) will NOT be available to the current build.
[DEBUG] Reason: Failed to validate POM for project org.apache.hadoop:hadoop-common at Artifact [org.apache.hadoop:hadoop-common:pom:0.23.1:compile]
[DEBUG]
Validation Errors:
[DEBUG] For dependency Dependency {groupId=jdk.tools, artifactId=jdk.tools, version=1.6, type=jar}: system-scoped dependency must specify an absolute path systemPath.
[DEBUG]
[DEBUG] org.apache.hadoop:hadoop-common:jar:0.23.1:compile (selected for compile)
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira