commit | 9f72df0f1e711746dfa90845abdeebf82df501db | [log] [tgz] |
---|---|---|
author | Lee moon soo <moon@apache.org> | Tue Nov 10 22:50:57 2015 +0900 |
committer | Lee moon soo <moon@apache.org> | Wed Nov 11 20:10:29 2015 +0900 |
tree | b2493d251eb67e0e2b99ae8a7a159b5a3ce9d66a | |
parent | 197e339d204f77a72a67f8f6033f103d95db338f [diff] |
ZEPPELIN-406 Handle license issue found in 0.5.5-incubating rc2 This issue addresses license problem found in 0.5.5-incubating rc2 https://issues.apache.org/jira/browse/ZEPPELIN-406 * Removes unnecessary files docs/assets/bootstrap-3.0.2-dist.zip docs/assets/themes/twitter/ * Add Apache license header if applicable * Add license info to LICENSE GLYPHICONS Halflings jekyll-bootstrap jekyll * Adjust rat plugin exclude rule Author: Lee moon soo <moon@apache.org> Closes #407 from Leemoonsoo/ZEPPELIN-406 and squashes the following commits: a216886 [Lee moon soo] Exclude license dir from rat check 5ec2aca [Lee moon soo] Add binary license b7a749c [Lee moon soo] Change format of LICENSE and attach LICENSE file of individual dependency 35e6554 [Lee moon soo] Update license according to dependency version 84a75dc [Lee moon soo] put the json example on the doc page instead of separate files 788a841 [Lee moon soo] Remove 3rd party dependences from LICENSE that are not included in source package 0c0b68c [Lee moon soo] Add version info ab4ba01 [Lee moon soo] Add bootstrap and remove GLYPHICONS Halflings (distributed as a part of bootstrap with the same license) from LICENSE 61dc5b7 [Lee moon soo] Exclude Gemfile.lock from rat plugin a48fbed [Lee moon soo] Add license header and update LICENSE, rat plugin c7a5f25 [Lee moon soo] Remove unused files 3e031df [Lee moon soo] Enable rat plugin for docs directory
#Zeppelin
Documentation: User Guide
Mailing List: User and Dev mailing list
Continuous Integration:
Contributing: Contribution Guide
License: Apache 2.0
Zeppelin, a web-based notebook that enables interactive data analytics. You can make beautiful data-driven, interactive and collaborative documents with SQL, Scala and more.
Core feature:
To know more about Zeppelin, visit our web site http://zeppelin.incubator.apache.org
If you don't have requirements prepared, install it. (The installation method may vary according to your environment, example is for Ubuntu.)
sudo apt-get update sudo apt-get install git sudo apt-get install openjdk-7-jdk sudo apt-get install npm sudo apt-get install libfontconfig # install maven wget http://www.eu.apache.org/dist/maven/maven-3/3.3.3/binaries/apache-maven-3.3.3-bin.tar.gz sudo tar -zxf apache-maven-3.3.3-bin.tar.gz -C /usr/local/ sudo ln -s /usr/local/apache-maven-3.3.3/bin/mvn /usr/local/bin/mvn
Notes:
node --version
mvn -version
If you want to build Zeppelin from the source, please first clone this repository, then:
mvn clean package -DskipTests
To build with a specific Spark version, Hadoop version or specific features, define one or more of the spark
, pyspark
, hadoop
and yarn
profiles, such as:
-Pspark-1.5 [Version to run in local spark mode] -Ppyspark [optional: enable PYTHON support in spark via the %pyspark interpreter] -Pyarn [optional: enable YARN support] -Dhadoop.version=2.2.0 [hadoop distribution] -Phadoop-2.2 [hadoop version]
Currently, final/full distributions run with:
mvn clean package -Pspark-1.5 -Phadoop-2.4 -Pyarn -Ppyspark
Spark 1.5.x
mvn clean package -Pspark-1.5 -Dhadoop.version=2.2.0 -Phadoop-2.2 -DskipTests
Spark 1.4.x
mvn clean package -Pspark-1.4 -Dhadoop.version=2.2.0 -Phadoop-2.2 -DskipTests
Spark 1.3.x
mvn clean package -Pspark-1.3 -Dhadoop.version=2.2.0 -Phadoop-2.2 -DskipTests
Spark 1.2.x
mvn clean package -Pspark-1.2 -Dhadoop.version=2.2.0 -Phadoop-2.2 -DskipTests
Spark 1.1.x
mvn clean package -Pspark-1.1 -Dhadoop.version=2.2.0 -Phadoop-2.2 -DskipTests
CDH 5.X
mvn clean package -Pspark-1.2 -Dhadoop.version=2.5.0-cdh5.3.0 -Phadoop-2.4 -DskipTests
Yarn (Hadoop 2.7.x)
mvn clean package -Pspark-1.4 -Dspark.version=1.4.1 -Dhadoop.version=2.7.0 -Phadoop-2.6 -Pyarn -DskipTests
Yarn (Hadoop 2.6.x)
mvn clean package -Pspark-1.1 -Dhadoop.version=2.6.0 -Phadoop-2.6 -Pyarn -DskipTests
Yarn (Hadoop 2.4.x)
mvn clean package -Pspark-1.1 -Dhadoop.version=2.4.0 -Phadoop-2.4 -Pyarn -DskipTests
Yarn (Hadoop 2.3.x)
mvn clean package -Pspark-1.1 -Dhadoop.version=2.3.0 -Phadoop-2.3 -Pyarn -DskipTests
Yarn (Hadoop 2.2.x)
mvn clean package -Pspark-1.1 -Dhadoop.version=2.2.0 -Phadoop-2.2 -Pyarn -DskipTests
Ignite (1.1.0-incubating and later)
mvn clean package -Dignite.version=1.1.0-incubating -DskipTests
If you wish to configure Zeppelin option (like port number), configure the following files:
./conf/zeppelin-env.sh ./conf/zeppelin-site.xml
(You can copy ./conf/zeppelin-env.sh.template
into ./conf/zeppelin-env.sh
. Same for zeppelin-site.xml
.)
Without SPARK_HOME and HADOOP_HOME, Zeppelin uses embedded Spark and Hadoop binaries that you have specified with mvn build option. If you want to use system provided Spark and Hadoop, export SPARK_HOME and HADOOP_HOME in zeppelin-env.sh You can use any supported version of spark without rebuilding Zeppelin.
# ./conf/zeppelin-env.sh export SPARK_HOME=... export HADOOP_HOME=...
Mesos
# ./conf/zeppelin-env.sh export MASTER=mesos://... export ZEPPELIN_JAVA_OPTS="-Dspark.executor.uri=/path/to/spark-*.tgz" or SPARK_HOME="/path/to/spark_home" export MESOS_NATIVE_LIBRARY=/path/to/libmesos.so
If you set SPARK_HOME
, you should deploy spark binary on the same location to all worker nodes. And if you set spark.executor.uri
, every worker can read that file on its node.
Yarn
# ./conf/zeppelin-env.sh export SPARK_HOME=/path/to/spark_dir
./bin/zeppelin-daemon.sh start browse localhost:8080 in your browser.
For configuration details check ./conf subdirectory.
To package the final distribution including the compressed archive, run:
mvn clean package -Pbuild-distr
To build a distribution with specific profiles, run:
mvn clean package -Pbuild-distr -Pspark-1.5 -Phadoop-2.4 -Pyarn -Ppyspark
The profiles -Pspark-1.5 -Phadoop-2.4 -Pyarn -Ppyspark
can be adjusted if you wish to build to a specific spark versions, or omit support such as yarn
.
The archive is generated under zeppelin-distribution/target directory
###Run end-to-end tests Zeppelin comes with a set of end-to-end acceptance tests driving headless selenium browser
#assumes zeppelin-server running on localhost:8080 (use -Durl=.. to override) mvn verify #or take care of starting\stoping zeppelin-server from packaged _zeppelin-distribuion/target_ mvn verify -P using-packaged-distr