Apache Zeppelin is a web-based notebook that enables data-driven, interactive data analytics and collaborative documents with SQL, Scala and more. This project provides a means to run the Stellar REPL directly within a Zeppelin Notebook.
Apache Zeppelin 0.7.3
This is tested with version 0.7.3. Other versions may work, but are not supported.
Currently, you need to manually install the Stellar Interpreter in Zeppelin. In the future this step could be automated by the Metron Mpack.
To install the Stellar Interpreter in your Apache Zeppelin installation, follow these instructions. This is paraphrased from the Zeppelin docs.
Build and install Metron. Metron and its dependencies will be retrieved from your local Maven repository.
cd $METRON_HOME mvn clean install -DskipTests
If you do not already have Zeppelin installed, download and unpack Apache Zeppelin. Then change directories to the root of your Zeppelin download.
cd $ZEPPELIN_HOME
Use Zeppelin's installation utility to install the Stellar Interpreter.
If Zeppelin was already installed, make sure that it is stopped before running this command. Update the version, ‘0.6.0’ in the example below, to whatever is appropriate for your environment.
bin/install-interpreter.sh --name stellar --artifact org.apache.metron:stellar-zeppelin:0.6.0
Start Zeppelin.
bin/zeppelin-daemon.sh start
Navigate to Zeppelin running at http://localhost:8080/. The Stellar Interpreter should be ready for use with a basic set of functions.
Create a new notebook.
Click on “Notebook” > “Create new note”.
Set the default Interpreter to stellar.
When creating the notebook, if you define stellar as the default interpreter, then there is no need to enter %stellar at the top of each code block.
If stellar is not the default interpreter, then you must enter %stellar at the top of a code block containing Stellar code.
In the first block, add the following Stellar, then click Run.
2 in [2,3,4]
In the next block, check which functions are available to you.
When executing Stellar‘s magic functions, you must explicitly define which interpreter should be used in the code block. If you define ‘stellar’ as the default interpreter when creating a notebook, then this is only required when using Stellar’s magic functions.
%stellar %functions
You will only ‘see’ the functions defined within stellar-common since that is the only library that we added to the interpreter.
Add additional Stellar functions to your session.
Go back to the Stellar interpreter configuration and add another dependency as follows.
org.apache.metron:metron-statistics:0.6.0
Go back to your notebook and run %functions again. You will now see the additional functions defined within the metron-statistics project.
Auto-completion is also available for Stellar expressions.
In another block, type ‘TO_’ then press the CTRL + PERIOD keys. This will trigger the auto-complete mechanism in Stellar and display a list of matching functions or variables.