-DartifactId=ApprovalsJava -Dversion=013 -Dpackaging=jar
mvn clean package
We utilize 8 servers for this process and trunk builds complete in 1 hour. Each slave has 8 physical cores with hyperthreading enabled and 48GB of ram. Each slave is allowed 8 test “threads”. I had used more than 8 threads but Zookeeper timed out randomly.
On all slaves add the following to /etc/ssh/sshd_config:
MaxAuthTries 100 MaxSessions 100 MaxStartups 100
Recent version of git, svn, make, patch, java, ant and maven should be installed. Additionally environment variables such as MAVEN_OPTS and ANT_OPTS should be configured with large leap sizes:
$ for item in java maven ant; do echo $item; cat /etc/profile.d/${item}.sh;done java export JAVA_HOME=$(readlink -f /usr/java/default) export PATH=$JAVA_HOME/bin:$PATH maven export M2_HOME=$(readlink -f /usr/local/apache-maven) export PATH=$M2_HOME/bin:$PATH export MAVEN_OPTS="-Xmx2g -XX:MaxPermSize=256M" ant export ANT_HOME=$(readlink -f /usr/local/apache-ant) export PATH=$ANT_HOME/bin:$PATH export ANT_OPTS="-Xmx1g -XX:MaxPermSize=256m"
$ cat /etc/profile.d/umask.sh umask 0022
root soft nproc 32768 root hard nproc 65536
root soft nofile 32768 root hard nofile 32768
Ensure the user running the tests has strict host/key checking disabled:
$ cat ~/.ssh/config StrictHostKeyChecking no ConnectTimeout 20 ServerAliveInterval 1
See conf/example-apache-trunk.properties
mvn dependency:copy-dependencies java -Xms4g -Xmx4g -cp "target/hive-ptest-1.0-classes.jar:target/dependency/*" org.apache.hive.ptest.execution.PTest --properties apache-trunk.properties