Google Git
Sign in
apache / zeppelin / refs/tags/v0.5.0
tag1f3b954b7b9c05a3865acfea34d73aa631c672f2
taggerLee moon soo <moon@Lees-MacBook.local>Sat Jul 11 07:51:26 2015 -0700
object5f5958a045147e0cf965d8840a55415d298a4e9f 
[maven-release-plugin] copy for tag v0.5.0
commit5f5958a045147e0cf965d8840a55415d298a4e9f[log] [tgz]
authorLee moon soo <moon@Lees-MacBook.local>Sat Jul 11 07:51:11 2015 -0700
committerLee moon soo <moon@Lees-MacBook.local>Sat Jul 11 07:51:11 2015 -0700
treebfb3953a542f158c6c3a4137332c1d89a045143b
parent850c31dde35b169233c07947436c1e7472ebec11 [diff]
[maven-release-plugin] prepare release v0.5.0
13 files changed
tree: bfb3953a542f158c6c3a4137332c1d89a045143b
  1. _tools/
  2. angular/
  3. bin/
  4. conf/
  5. dev/
  6. flink/
  7. hive/
  8. markdown/
  9. notebook/
  10. shell/
  11. spark/
  12. tajo/
  13. testing/
  14. zeppelin-distribution/
  15. zeppelin-interpreter/
  16. zeppelin-server/
  17. zeppelin-web/
  18. zeppelin-zengine/
  19. .gitignore
  20. .travis.yml
  21. CONTRIBUTING.md
  22. DEPLOY.md
  23. DISCLAIMER
  24. LICENSE
  25. NOTICE
  26. pom.xml
  27. README.md
  28. Roadmap.md
  29. STYLE.md
README.md

#Zeppelin

Documentation: User Guide
Mailing List: User and Dev mailing list
Continuous Integration: Build Status
Contributing: Contribution Guide
License: Apache 2.0

Zeppelin, a web-based notebook that enables interactive data analytics. You can make beautiful data-driven, interactive and collaborative documents with SQL, Scala and more.

Core feature:

  • Web based notebook style editor.
  • Built-in Apache Spark support

To know more about Zeppelin, visit our web site http://zeppelin.incubator.apache.org

Requirements

  • Java 1.7
  • Tested on Mac OSX, Ubuntu 14.X, CentOS 6.X
  • Maven (if you want to build from the source code)
  • Node.js Package Manager

Getting Started

Before Build

If you don't have requirements prepared, install it. (The installation method may vary according to your environment, example is for Ubuntu.)

sudo apt-get update
sudo apt-get install openjdk-7-jdk
sudo apt-get install git
sudo apt-get install maven
sudo apt-get install npm

Build

If you want to build Zeppelin from the source, please first clone this repository. And then:

mvn clean package

Build with specific version

Spark 1.1.x

mvn clean package -Pspark-1.1 -Dhadoop.version=2.2.0 -Phadoop-2.2 -DskipTests

Spark 1.2.x

mvn clean package -Pspark-1.2 -Dhadoop.version=2.2.0 -Phadoop-2.2 -DskipTests

Spark 1.3.x

mvn clean package -Pspark-1.3 -Dhadoop.version=2.2.0 -Phadoop-2.2 -DskipTests

Spark 1.4.x

mvn clean package -Pspark-1.4 -Dhadoop.version=2.2.0 -Phadoop-2.2 -DskipTests

CDH 5.X

mvn clean package -Pspark-1.2 -Dhadoop.version=2.5.0-cdh5.3.0 -Phadoop-2.4 -DskipTests

Yarn (Hadoop 2.2.x and later)

mvn clean package -Pspark-1.1 -Dhadoop.version=2.2.0 -Phadoop-2.2 -Pyarn -DskipTests

Configure

If you wish to configure Zeppelin option (like port number), configure the following files:

./conf/zeppelin-env.sh
./conf/zeppelin-site.xml

(You can copy ./conf/zeppelin-env.sh.template into ./conf/zeppelin-env.sh. Same for zeppein-site.xml.)

External cluster configuration

Mesos

# ./conf/zeppelin-env.sh
export MASTER=mesos://...
export ZEPPELIN_JAVA_OPTS="-Dspark.executor.uri=/path/to/spark-*.tgz" or SPARK_HOME="/path/to/spark_home"
export MESOS_NATIVE_LIBRARY=/path/to/libmesos.so

If you set SPARK_HOME, you should deploy spark binary on the same location to all worker nodes. And if you set spark.executor.uri, every worker can read that file on its node.

Yarn

# ./conf/zeppelin-env.sh
export HADOOP_CONF_DIR=/path/to/hadoop_conf_dir

HADOOP_CONF_DIR should contains yarn-site.xml and core-site.xml.

Run

./bin/zeppelin-daemon.sh start

browse localhost:8080 in your browser. 8081 port should be accessible for websocket connection.

For configuration details check ./conf subdirectory.

Package

To package final distribution do:

  mvn clean package -P build-distr

The archive is generated under zeppelin-distribution/target directory

###Run end-to-end tests Zeppelin comes with a set of end-to-end acceptance tests driving headless selenium browser

  #assumes zeppelin-server running on localhost:8080 (use -Durl=.. to override)
  mvn verify

  #or take care of starting\stoping zeppelin-server from packaged _zeppelin-distribuion/target_
  mvn verify -P using-packaged-distr

Analytics