Google Git
Sign in
apache / zeppelin / e6df657714ada918fe345048d87acd04b80af28a
commite6df657714ada918fe345048d87acd04b80af28a[log] [tgz]
authorLee moon soo <moon@apache.org>Thu Jul 02 12:05:23 2015 -0700
committerLee moon soo <moon@apache.org>Sun Jul 05 10:45:11 2015 -0700
tree65508eca7ae5cbf05cb89e7d46d12b083ffbea8c
parent6ed67913d8afe4ec2d664ca5e0438647ac7a8c2d [diff]
ZEPPELIN-79 Zeppelin does not kill some interpreters when server is stopped

https://issues.apache.org/jira/browse/ZEPPELIN-79

Zeppelin sometimes left interpreter process after it is stopped.
This pr solve the problem by increase timeout for graceful shutdown

Author: Lee moon soo <moon@apache.org>

Closes #135 from Leemoonsoo/ZEPPELIN-79 and squashes the following commits:

d2b1fa6 [Lee moon soo] Close and destroy interpreters in parallel
4558417 [Lee moon soo] Increase graceful shutdown timeout

(cherry picked from commit 12e5abf2803e4c5015998672b10642fc72aac0da)
Signed-off-by: Lee moon soo <moon@apache.org>
4 files changed
tree: 65508eca7ae5cbf05cb89e7d46d12b083ffbea8c
  1. _tools/
  2. angular/
  3. bin/
  4. conf/
  5. dev/
  6. flink/
  7. hive/
  8. markdown/
  9. notebook/
  10. shell/
  11. spark/
  12. tajo/
  13. testing/
  14. zeppelin-distribution/
  15. zeppelin-interpreter/
  16. zeppelin-server/
  17. zeppelin-web/
  18. zeppelin-zengine/
  19. .gitignore
  20. .travis.yml
  21. CONTRIBUTING.md
  22. DEPLOY.md
  23. DISCLAIMER
  24. LICENSE
  25. NOTICE
  26. pom.xml
  27. README.md
  28. Roadmap.md
  29. STYLE.md
README.md

#Zeppelin

Documentation: User Guide
Mailing List: User and Dev mailing list
Continuous Integration: Build Status
Contributing: Contribution Guide
License: Apache 2.0

Zeppelin, a web-based notebook that enables interactive data analytics. You can make beautiful data-driven, interactive and collaborative documents with SQL, Scala and more.

Core feature:

  • Web based notebook style editor.
  • Built-in Apache Spark support

To know more about Zeppelin, visit our web site http://zeppelin.incubator.apache.org

Requirements

  • Java 1.7
  • Tested on Mac OSX, Ubuntu 14.X, CentOS 6.X
  • Maven (if you want to build from the source code)
  • Node.js Package Manager

Getting Started

Before Build

If you don't have requirements prepared, install it. (The installation method may vary according to your environment, example is for Ubuntu.)

sudo apt-get update
sudo apt-get install openjdk-7-jdk
sudo apt-get install git
sudo apt-get install maven
sudo apt-get install npm

Build

If you want to build Zeppelin from the source, please first clone this repository. And then:

mvn clean package

Build with specific version

Spark 1.1.x

mvn clean package -Pspark-1.1 -Dhadoop.version=2.2.0 -Phadoop-2.2 -DskipTests

Spark 1.2.x

mvn clean package -Pspark-1.2 -Dhadoop.version=2.2.0 -Phadoop-2.2 -DskipTests

Spark 1.3.x

mvn clean package -Pspark-1.3 -Dhadoop.version=2.2.0 -Phadoop-2.2 -DskipTests

Spark 1.4.x

mvn clean package -Pspark-1.4 -Dhadoop.version=2.2.0 -Phadoop-2.2 -DskipTests

CDH 5.X

mvn clean package -Pspark-1.2 -Dhadoop.version=2.5.0-cdh5.3.0 -Phadoop-2.4 -DskipTests

Yarn (Hadoop 2.2.x and later)

mvn clean package -Pspark-1.1 -Dhadoop.version=2.2.0 -Phadoop-2.2 -Pyarn -DskipTests

Configure

If you wish to configure Zeppelin option (like port number), configure the following files:

./conf/zeppelin-env.sh
./conf/zeppelin-site.xml

(You can copy ./conf/zeppelin-env.sh.template into ./conf/zeppelin-env.sh. Same for zeppein-site.xml.)

External cluster configuration

Mesos

# ./conf/zeppelin-env.sh
export MASTER=mesos://...
export ZEPPELIN_JAVA_OPTS="-Dspark.executor.uri=/path/to/spark-*.tgz" or SPARK_HOME="/path/to/spark_home"
export MESOS_NATIVE_LIBRARY=/path/to/libmesos.so

If you set SPARK_HOME, you should deploy spark binary on the same location to all worker nodes. And if you set spark.executor.uri, every worker can read that file on its node.

Yarn

# ./conf/zeppelin-env.sh
export HADOOP_CONF_DIR=/path/to/hadoop_conf_dir

HADOOP_CONF_DIR should contains yarn-site.xml and core-site.xml.

Run

./bin/zeppelin-daemon.sh start

browse localhost:8080 in your browser. 8081 port should be accessible for websocket connection.

For configuration details check ./conf subdirectory.

Package

To package final distribution do:

  mvn clean package -P build-distr

The archive is generated under zeppelin-distribution/target directory

###Run end-to-end tests Zeppelin comes with a set of end-to-end acceptance tests driving headless selenium browser

  #assumes zeppelin-server running on localhost:8080 (use -Durl=.. to override)
  mvn verify

  #or take care of starting\stoping zeppelin-server from packaged _zeppelin-distribuion/target_
  mvn verify -P using-packaged-distr

Analytics