update getting started and team
diff --git a/_docs/getting_started.md b/_docs/getting_started.md
index 40e81e8..34d83e9 100644
--- a/_docs/getting_started.md
+++ b/_docs/getting_started.md
@@ -3,46 +3,82 @@
permalink: /docs/getting_started/
---
+# Nemo
+
+[](https://travis-ci.org/apache/incubator-nemo)
+[](https://sonarcloud.io/dashboard?id=org.apache.nemo%3Anemo-project)
+
+A Data Processing System for Flexible Employment With Different Deployment Characteristics.
+
+## Online Documentation
+
+Details about Nemo and its development can be found in:
+* Our website: https://nemo.apache.org/
+* Our project wiki: https://cwiki.apache.org/confluence/display/NEMO/
+* Our Dev mailing list for contributing: dev@nemo.apache.org [(subscribe)](mailto:dev-subscribe@nemo.apache.org)
+
+Please refer to the [Contribution guideline](.github/CONTRIBUTING.md) to contribute to our project.
+
+## Nemo prerequisites and setup
+
### Prerequisites
-* Java 8
+* Java 8 or later (tested on Java 8 and Java 11)
* Maven
-* Latest REEF snapshot
* YARN settings
- * Download Hadoop 2.7.4 at http://apache.tt.co.kr/hadoop/common/hadoop-2.7.4/
+ * Download Hadoop 2.7.2 at https://archive.apache.org/dist/hadoop/common/hadoop-2.7.2/
* Set the shell profile as following:
```bash
- export HADOOP_HOME=/path/to/hadoop-2.7.4
+ export HADOOP_HOME=/path/to/hadoop-2.7.2
export YARN_HOME=$HADOOP_HOME
export PATH=$PATH:$HADOOP_HOME/bin
```
* Protobuf 2.5.0
- * Downloadable at https://github.com/google/protobuf/releases/tag/v2.5.0
- * On Ubuntu:
- 1. Run `sudo apt-get install autoconf automake libtool curl make g++ unzip`
- 2. Extract the downloaded tarball and run
- * `sudo ./configure`
- * `sudo make`
- * `sudo make check`
- * `sudo make install`
- 3. To check for a successful installation of version 2.5.0, run `protoc --version`
+ * On Ubuntu 14.04 LTS and its point releases:
-### Installing Nemo
-* Run all tests and install: `mvn clean install -T 2C`
-* Run only unit tests and install: `mvn clean install -DskipITs -T 2C`
+ ```bash
+ $ sudo apt-get install protobuf-compiler
+ ```
+
+ * On Ubuntu 16.04 LTS and its point releases:
+
+ ```bash
+ $ sudo add-apt-repository ppa:snuspl/protobuf-250
+ $ sudo apt update
+ $ sudo apt install protobuf-compiler=2.5.0-9xenial1
+ ```
+
+ * On macOS:
+
+ ```bash
+ $ wget https://github.com/google/protobuf/releases/download/v2.5.0/protobuf-2.5.0.tar.bz2
+ $ tar xvf protobuf-2.5.0.tar.bz2
+ $ pushd protobuf-2.5.0
+ $ ./configure CC=clang CXX=clang++ CXXFLAGS='-std=c++11 -stdlib=libc++ -O3 -g' LDFLAGS='-stdlib=libc++' LIBS="-lc++ -lc++abi"
+ $ make -j 4
+ $ sudo make install
+ $ popd
+ ```
+
+ * Or build from source:
+
+ * Downloadable at https://github.com/google/protobuf/releases/tag/v2.5.0
+ * Extract the downloaded tarball
+ * `$ ./configure`
+ * `$ make`
+ * `$ make check`
+ * `$ sudo make install`
+
+ * To check for a successful installation of version 2.5.0, run `$ protoc --version`
+
+### Installing Nemo
+* Run all tests and install: `$ mvn clean install -T 2C`
+* Run only unit tests and install: `$ mvn clean install -DskipITs -T 2C`
## Running Beam applications
-### Running an external Beam application
-* Use run_external_app.sh instead of run.sh
-* Set the first argument the path to the external Beam application jar
-```bash
-./bin/run_external_app.sh \
-`pwd`/nemo_app/target/bd17f-1.0-SNAPSHOT.jar \
--job_id mapreduce \
--executor_json `pwd`/nemo_runtime/config/default.json \
--user_main MapReduce \
--user_args "`pwd`/mr_input_data `pwd`/nemo_output/output_data"
-```
+Apache Nemo is an official runner of Apache Beam, and it can be executed from Beam, using NemoRunner, as well as directly from the Nemo project.
+The details of using NemoRunner from Beam is shown on the [NemoRunner page of the Apache Beam website](https://beam.apache.org/documentation/runners/nemo/).
+Below describes how Beam applications can be run directly on Nemo.
### Configurable options
* `-job_id`: ID of the Beam job
@@ -53,33 +89,53 @@
### Examples
```bash
-## MapReduce example
-./bin/run.sh \
- -job_id mr_default \
- -user_main edu.snu.nemo.examples.beam.MapReduce \
- -optimization_policy edu.snu.nemo.compiler.optimizer.policy.DefaultPolicy \
- -user_args "`pwd`/src/main/resources/sample_input_mr `pwd`/src/main/resources/sample_output"
+## WordCount example from the Beam website (Count words from a document)
+$ ./bin/run_beam.sh \
+ -job_id beam_wordcount \
+ -optimization_policy org.apache.nemo.compiler.optimizer.policy.DefaultPolicy \
+ -user_main org.apache.nemo.examples.beam.BeamWordCount \
+ -user_args "--runner=NemoRunner --inputFile=`pwd`/examples/resources/inputs/test_input_wordcount --output=`pwd`/outputs/wordcount"
+$ less `pwd`/outputs/wordcount*
+
+## MapReduce WordCount example (Count words from the Wikipedia dataset)
+$ ./bin/run_beam.sh \
+ -job_id mr_default \
+ -executor_json `pwd`/examples/resources/executors/beam_test_executor_resources.json \
+ -optimization_policy org.apache.nemo.compiler.optimizer.policy.DefaultPolicy \
+ -user_main org.apache.nemo.examples.beam.WordCount \
+ -user_args "`pwd`/examples/resources/inputs/test_input_wordcount `pwd`/outputs/wordcount"
+$ less `pwd`/outputs/wordcount*
## YARN cluster example
-./bin/run.sh \
- -deploy_mode yarn \
- -job_id mr_pado \
- -user_main edu.snu.nemo.examples.beam.MapReduce \
- -optimization_policy edu.snu.nemo.compiler.optimizer.policy.PadoPolicy \
- -user_args "hdfs://v-m:9000/sample_input_mr hdfs://v-m:9000/sample_output_mr"
-```
+$ ./bin/run_beam.sh \
+ -deploy_mode yarn \
+ -job_id mr_transient \
+ -executor_json `pwd`/examples/resources/executors/beam_test_executor_resources.json \
+ -user_main org.apache.nemo.examples.beam.WordCount \
+ -optimization_policy org.apache.nemo.compiler.optimizer.policy.TransientResourcePolicy \
+ -user_args "hdfs://v-m:9000/test_input_wordcount hdfs://v-m:9000/test_output_wordcount"
+## NEXMark streaming Q0 (query0) example
+$ ./bin/run_nexmark.sh \
+ -job_id nexmark-Q0 \
+ -executor_json `pwd`/examples/resources/executors/beam_test_executor_resources.json \
+ -user_main org.apache.beam.sdk.nexmark.Main \
+ -optimization_policy org.apache.nemo.compiler.optimizer.policy.StreamingPolicy \
+ -scheduler_impl_class_name org.apache.nemo.runtime.master.scheduler.StreamingScheduler \
+ -user_args "--runner=NemoRunner --streaming=true --query=0 --numEventGenerators=1"
+
+```
## Resource Configuration
`-executor_json` command line option can be used to provide a path to the JSON file that describes resource configuration for executors. Its default value is `config/default.json`, which initializes one of each `Transient`, `Reserved`, and `Compute` executor, each of which has one core and 1024MB memory.
### Configurable options
* `num` (optional): Number of containers. Default value is 1
* `type`: Three container types are supported:
- * `Transient` : Containers that store eviction-prone resources. When batch jobs use idle resources in `Transient` containers, they can be arbitrarily evicted when latency-critical jobs attempt to use the resources.
- * `Reserved` : Containers that store eviction-free resources. `Reserved` containers are used to reliably store intermediate data which have high eviction cost.
- * `Compute` : Containers that are mainly used for computation.
+ * `Transient` : Containers that store eviction-prone resources. When batch jobs use idle resources in `Transient` containers, they can be arbitrarily evicted when latency-critical jobs attempt to use the resources.
+ * `Reserved` : Containers that store eviction-free resources. `Reserved` containers are used to reliably store intermediate data which have high eviction cost.
+ * `Compute` : Containers that are mainly used for computation.
* `memory_mb`: Memory size in MB
-* `capacity`: Number of `TaskGroup`s that can be run in an executor. Set this value to be the same as the number of CPU cores of the container.
+* `capacity`: Number of `Task`s that can be run in an executor. Set this value to be the same as the number of CPU cores of the container.
### Examples
```json
@@ -102,17 +158,53 @@
* 12 transient containers with 4 cores and 1024MB memory each
* 1 reserved container with 2 cores and 1024MB memory
-## Monitoring your job using web UI
-Nemo Compiler and Runtime can store JSON representation of intermediate DAGs.
-* `-dag_dir` command line option is used to specify the directory where the JSON files are stored. The default directory is `./dag`.
-Using our [online visualizer](https://service.jangho.io/Nemo-dag/), you can easily visualize a DAG. Just drop the JSON file of the DAG as an input to it.
+## Monitoring your job using Web UI
+Please refer to the instructions at `web-ui/README.md` to run the frontend.
+
+### Visualizing metric on run-time
+
+While Nemo driver is alive, it can post runtime metrics through websocket. At your frontend, add websocket endpoint
+
+```
+ws://<DRIVER>:10101/api/websocket
+```
+
+where `<DRIVER>` is the hostname that Nemo driver runs.
+
+OR, you can directly run the WebUI on the driver using `bin/run_webserver.sh`,
+where it looks for the websocket on its local machine,
+which, by default, provides the address at
+
+```
+http://<DRIVER>:3333
+```
+
+### Post-job analysis
+
+On job completion, the Nemo driver creates `metric.json` at the directory specified by `-dag_dir` option. At your frontend, add the JSON file to do post-job analysis.
+
+Other JSON files are for legacy Web UI, hosted [here](https:/nemo.snuspl.snu.ac.kr:50443/nemo-dag/). It uses [Graphviz](https://www.graphviz.org/) to visualize IR DAGs and execution plans.
### Examples
```bash
-./bin/run.sh \
- -job_id als \
- -user_main edu.snu.nemo.examples.beam.AlternatingLeastSquare \
- -optimization_policy edu.snu.nemo.compiler.optimizer.policy.PadoPolicy \
- -dag_dir "./dag/als" \
- -user_args "`pwd`/src/main/resources/sample_input_als 10 3"
+$ ./bin/run_beam.sh \
+ -job_id als \
+ -executor_json `pwd`/examples/resources/executors/beam_test_executor_resources.json \
+ -user_main org.apache.nemo.examples.beam.AlternatingLeastSquare \
+ -optimization_policy org.apache.nemo.compiler.optimizer.policy.TransientResourcePolicy \
+ -dag_dir "./dag/als" \
+ -user_args "`pwd`/examples/resources/inputs/test_input_als 10 3"
```
+
+## Options for writing metric results to databases.
+
+* `-db_enabled`: Whether or not to turn on the DB (`true` or `false`).
+* `-db_address`: Address of the DB. (ex. PostgreSQL DB starts with `jdbc:postgresql://...`)
+* `-db_id` : ID of the DB from the given address.
+* `-db_password`: Credentials for the DB from the given address.
+
+## Speeding up builds
+* To exclude Spark related packages: mvn clean install -T 2C -DskipTests -pl \\!compiler/frontend/spark,\\!examples/spark
+* To exclude Beam related packages: mvn clean install -T 2C -DskipTests -pl \\!compiler/frontend/beam,\\!examples/beam
+* To exclude NEXMark related packages: mvn clean install -T 2C -DskipTests -pl \\!examples/nexmark
+
diff --git a/_pages/team.md b/_pages/team.md
index 4bc53bf..be68fdb 100644
--- a/_pages/team.md
+++ b/_pages/team.md
@@ -15,16 +15,17 @@
| Apache ID | Full Name | Affiliation(s) |
| --- | :------: | -------------: |
| bgchun | Byung-Gon Chun | Seoul National University |
-| jeongyoon | Jeongyoon Eo | Seoul National University |
| gwkim | Geon-Woo Kim | Viva Republica, Seoul National University |
-| jooykim | Joo Yeon Kim | Samsung |
| gwlee | Gyewon Lee | Seoul National University |
-| jglee | Jung-Gil Lee | LG |
-| sanha | Sanha Lee | Seoul National University |
-| wylee | Wooyeon Lee | Seoul National University |
-| yunseong | Yunseong Lee | Seoul National University |
+| haeyoon | Haeyoon Cho | Seoul National University |
| jangho | JangHo Seo | Seoul National University |
-| wonook | Won Wook SONG | Seoul National University |
-| taegeonum | Taegeon Um | Seoul National University |
+| jeongyoon | Jeongyoon Eo | Seoul National University |
+| jglee | Jung-Gil Lee | LG |
| johnyangk | Youngseok Yang | Seoul National University |
+| jooykim | Joo Yeon Kim | Samsung |
+| sanha | Sanha Lee | Seoul National University |
+| taegeonum | Taegeon Um | Seoul National University |
+| wonook | Won Wook SONG | Seoul National University |
+| wylee | Wooyeon Lee | Samsung |
+| yunseong | Yunseong Lee | Qualcomm AI Research |
diff --git a/content/docs/bootstrap/index.html b/content/docs/bootstrap/index.html
index fdb4b54..abaeefb 100644
--- a/content/docs/bootstrap/index.html
+++ b/content/docs/bootstrap/index.html
@@ -21,9 +21,9 @@
<meta property="og:url" content="http://nemo.apache.org//docs/bootstrap/" />
<meta property="og:site_name" content="Nemo" />
<meta property="og:type" content="article" />
-<meta property="article:published_time" content="2020-03-07T16:14:00+09:00" />
+<meta property="article:published_time" content="2020-03-07T16:26:06+09:00" />
<script type="application/ld+json">
-{"datePublished":"2020-03-07T16:14:00+09:00","url":"http://nemo.apache.org//docs/bootstrap/","description":"Buttons Default Primary Success Info Warning Danger Link Default Primary Success Info Warning Danger Link Default Action Another action Something else here Separated link","headline":"Bootstrap Features","dateModified":"2020-03-07T16:14:00+09:00","@type":"WebPage","@context":"https://schema.org"}</script>
+{"datePublished":"2020-03-07T16:26:06+09:00","url":"http://nemo.apache.org//docs/bootstrap/","description":"Buttons Default Primary Success Info Warning Danger Link Default Primary Success Info Warning Danger Link Default Action Another action Something else here Separated link","headline":"Bootstrap Features","dateModified":"2020-03-07T16:26:06+09:00","@type":"WebPage","@context":"https://schema.org"}</script>
<!-- End Jekyll SEO tag -->
diff --git a/content/docs/cheatsheet/index.html b/content/docs/cheatsheet/index.html
index c318678..b9c1713 100644
--- a/content/docs/cheatsheet/index.html
+++ b/content/docs/cheatsheet/index.html
@@ -21,9 +21,9 @@
<meta property="og:url" content="http://nemo.apache.org//docs/cheatsheet/" />
<meta property="og:site_name" content="Nemo" />
<meta property="og:type" content="article" />
-<meta property="article:published_time" content="2020-03-07T16:14:00+09:00" />
+<meta property="article:published_time" content="2020-03-07T16:26:06+09:00" />
<script type="application/ld+json">
-{"datePublished":"2020-03-07T16:14:00+09:00","url":"http://nemo.apache.org//docs/cheatsheet/","description":"From adam-p/markdown-here","headline":"Markdown Cheatsheet","dateModified":"2020-03-07T16:14:00+09:00","@type":"WebPage","@context":"https://schema.org"}</script>
+{"datePublished":"2020-03-07T16:26:06+09:00","url":"http://nemo.apache.org//docs/cheatsheet/","description":"From adam-p/markdown-here","headline":"Markdown Cheatsheet","dateModified":"2020-03-07T16:26:06+09:00","@type":"WebPage","@context":"https://schema.org"}</script>
<!-- End Jekyll SEO tag -->
diff --git a/content/docs/compiler_design/index.html b/content/docs/compiler_design/index.html
index bace175..0bdbcba 100644
--- a/content/docs/compiler_design/index.html
+++ b/content/docs/compiler_design/index.html
@@ -21,9 +21,9 @@
<meta property="og:url" content="http://nemo.apache.org//docs/compiler_design/" />
<meta property="og:site_name" content="Nemo" />
<meta property="og:type" content="article" />
-<meta property="article:published_time" content="2020-03-07T16:14:00+09:00" />
+<meta property="article:published_time" content="2020-03-07T16:26:06+09:00" />
<script type="application/ld+json">
-{"datePublished":"2020-03-07T16:14:00+09:00","url":"http://nemo.apache.org//docs/compiler_design/","description":"Overview","headline":"Compiler Design","dateModified":"2020-03-07T16:14:00+09:00","@type":"WebPage","@context":"https://schema.org"}</script>
+{"datePublished":"2020-03-07T16:26:06+09:00","url":"http://nemo.apache.org//docs/compiler_design/","description":"Overview","headline":"Compiler Design","dateModified":"2020-03-07T16:26:06+09:00","@type":"WebPage","@context":"https://schema.org"}</script>
<!-- End Jekyll SEO tag -->
diff --git a/content/docs/contribute/index.html b/content/docs/contribute/index.html
index 9df23de..40eca06 100644
--- a/content/docs/contribute/index.html
+++ b/content/docs/contribute/index.html
@@ -21,9 +21,9 @@
<meta property="og:url" content="http://nemo.apache.org//docs/contribute/" />
<meta property="og:site_name" content="Nemo" />
<meta property="og:type" content="article" />
-<meta property="article:published_time" content="2020-03-07T16:14:00+09:00" />
+<meta property="article:published_time" content="2020-03-07T16:26:06+09:00" />
<script type="application/ld+json">
-{"datePublished":"2020-03-07T16:14:00+09:00","url":"http://nemo.apache.org//docs/contribute/","description":"Contribute","headline":"Contribute","dateModified":"2020-03-07T16:14:00+09:00","@type":"WebPage","@context":"https://schema.org"}</script>
+{"datePublished":"2020-03-07T16:26:06+09:00","url":"http://nemo.apache.org//docs/contribute/","description":"Contribute","headline":"Contribute","dateModified":"2020-03-07T16:26:06+09:00","@type":"WebPage","@context":"https://schema.org"}</script>
<!-- End Jekyll SEO tag -->
diff --git a/content/docs/extending_nemo/index.html b/content/docs/extending_nemo/index.html
index aaec13e..03785e4 100644
--- a/content/docs/extending_nemo/index.html
+++ b/content/docs/extending_nemo/index.html
@@ -21,9 +21,9 @@
<meta property="og:url" content="http://nemo.apache.org//docs/extending_nemo/" />
<meta property="og:site_name" content="Nemo" />
<meta property="og:type" content="article" />
-<meta property="article:published_time" content="2020-03-07T16:14:00+09:00" />
+<meta property="article:published_time" content="2020-03-07T16:26:06+09:00" />
<script type="application/ld+json">
-{"datePublished":"2020-03-07T16:14:00+09:00","url":"http://nemo.apache.org//docs/extending_nemo/","description":"Overview","headline":"Extending Nemo","dateModified":"2020-03-07T16:14:00+09:00","@type":"WebPage","@context":"https://schema.org"}</script>
+{"datePublished":"2020-03-07T16:26:06+09:00","url":"http://nemo.apache.org//docs/extending_nemo/","description":"Overview","headline":"Extending Nemo","dateModified":"2020-03-07T16:26:06+09:00","@type":"WebPage","@context":"https://schema.org"}</script>
<!-- End Jekyll SEO tag -->
diff --git a/content/docs/font-awesome/index.html b/content/docs/font-awesome/index.html
index 60a309b..74af435 100644
--- a/content/docs/font-awesome/index.html
+++ b/content/docs/font-awesome/index.html
@@ -21,9 +21,9 @@
<meta property="og:url" content="http://nemo.apache.org//docs/font-awesome/" />
<meta property="og:site_name" content="Nemo" />
<meta property="og:type" content="article" />
-<meta property="article:published_time" content="2020-03-07T16:14:00+09:00" />
+<meta property="article:published_time" content="2020-03-07T16:26:06+09:00" />
<script type="application/ld+json">
-{"datePublished":"2020-03-07T16:14:00+09:00","url":"http://nemo.apache.org//docs/font-awesome/","description":"500px address-book address-book-o address-card address-card-o adjust adn align-center align-justify align-left align-right amazon ambulance american-sign-language-interpreting anchor android angellist angle-double-down angle-double-left angle-double-right angle-double-up angle-down angle-left angle-right angle-up apple archive area-chart arrow-circle-down arrow-circle-left arrow-circle-o-down arrow-circle-o-left arrow-circle-o-right arrow-circle-o-up arrow-circle-right arrow-circle-up arrow-down arrow-left arrow-right arrow-up arrows arrows-alt arrows-h arrows-v assistive-listening-systems asterisk at audio-description backward balance-scale ban bandcamp bar-chart barcode bars bath battery-empty battery-full battery-half battery-quarter battery-three-quarters bed beer behance behance-square bell bell-o bell-slash bell-slash-o bicycle binoculars birthday-cake bitbucket bitbucket-square black-tie blind bluetooth bluetooth-b bold bolt bomb book bookmark bookmark-o braille briefcase btc bug building building-o bullhorn bullseye bus buysellads calculator calendar calendar-check-o calendar-minus-o calendar-o calendar-plus-o calendar-times-o camera camera-retro car caret-down caret-left caret-right caret-square-o-down caret-square-o-left caret-square-o-right caret-square-o-up caret-up cart-arrow-down cart-plus cc cc-amex cc-diners-club cc-discover cc-jcb cc-mastercard cc-paypal cc-stripe cc-visa certificate chain-broken check check-circle check-circle-o check-square check-square-o chevron-circle-down chevron-circle-left chevron-circle-right chevron-circle-up chevron-down chevron-left chevron-right chevron-up child chrome circle circle-o circle-o-notch circle-thin clipboard clock-o clone cloud cloud-download cloud-upload code code-fork codepen codiepie coffee cog cogs columns comment comment-o commenting commenting-o comments comments-o compass compress connectdevelop contao copyright creative-commons credit-card credit-card-alt crop crosshairs css3 cube cubes cutlery dashcube database deaf delicious desktop deviantart diamond digg dot-circle-o download dribbble dropbox drupal edge eercast eject ellipsis-h ellipsis-v empire envelope envelope-o envelope-open envelope-open-o envelope-square envira eraser etsy eur exchange exclamation exclamation-circle exclamation-triangle expand expeditedssl external-link external-link-square eye eye-slash eyedropper facebook facebook-official facebook-square fast-backward fast-forward fax female fighter-jet file file-archive-o file-audio-o file-code-o file-excel-o file-image-o file-o file-pdf-o file-powerpoint-o file-text file-text-o file-video-o file-word-o files-o film filter fire fire-extinguisher firefox first-order flag flag-checkered flag-o flask flickr floppy-o folder folder-o folder-open folder-open-o font font-awesome fonticons fort-awesome forumbee forward foursquare free-code-camp frown-o futbol-o gamepad gavel gbp genderless get-pocket gg gg-circle gift git git-square github github-alt github-square gitlab glass glide glide-g globe google google-plus google-plus-official google-plus-square google-wallet graduation-cap gratipay grav h-square hacker-news hand-lizard-o hand-o-down hand-o-left hand-o-right hand-o-up hand-paper-o hand-peace-o hand-pointer-o hand-rock-o hand-scissors-o hand-spock-o handshake-o hashtag hdd-o header headphones heart heart-o heartbeat history home hospital-o hourglass hourglass-end hourglass-half hourglass-o hourglass-start houzz html5 i-cursor id-badge id-card id-card-o ils imdb inbox indent industry info info-circle inr instagram internet-explorer ioxhost italic joomla jpy jsfiddle key keyboard-o krw language laptop lastfm lastfm-square leaf leanpub lemon-o level-down level-up life-ring lightbulb-o line-chart link linkedin linkedin-square linode linux list list-alt list-ol list-ul location-arrow lock long-arrow-down long-arrow-left long-arrow-right long-arrow-up low-vision magic magnet male map map-marker map-o map-pin map-signs mars mars-double mars-stroke mars-stroke-h mars-stroke-v maxcdn meanpath medium medkit meetup meh-o mercury microchip microphone microphone-slash minus minus-circle minus-square minus-square-o mixcloud mobile modx money moon-o motorcycle mouse-pointer music neuter newspaper-o object-group object-ungroup odnoklassniki odnoklassniki-square opencart openid opera optin-monster outdent pagelines paint-brush paper-plane paper-plane-o paperclip paragraph pause pause-circle pause-circle-o paw paypal pencil pencil-square pencil-square-o percent phone phone-square picture-o pie-chart pied-piper pied-piper-alt pied-piper-pp pinterest pinterest-p pinterest-square plane play play-circle play-circle-o plug plus plus-circle plus-square plus-square-o podcast power-off print product-hunt puzzle-piece qq qrcode question question-circle question-circle-o quora quote-left quote-right random ravelry rebel recycle reddit reddit-alien reddit-square refresh registered renren repeat reply reply-all retweet road rocket rss rss-square rub safari scissors scribd search search-minus search-plus sellsy server share share-alt share-alt-square share-square share-square-o shield ship shirtsinbulk shopping-bag shopping-basket shopping-cart shower sign-in sign-language sign-out signal simplybuilt sitemap skyatlas skype slack sliders slideshare smile-o snapchat snapchat-ghost snapchat-square snowflake-o sort sort-alpha-asc sort-alpha-desc sort-amount-asc sort-amount-desc sort-asc sort-desc sort-numeric-asc sort-numeric-desc soundcloud space-shuttle spinner spoon spotify square square-o stack-exchange stack-overflow star star-half star-half-o star-o steam steam-square step-backward step-forward stethoscope sticky-note sticky-note-o stop stop-circle stop-circle-o street-view strikethrough stumbleupon stumbleupon-circle subscript subway suitcase sun-o superpowers superscript table tablet tachometer tag tags tasks taxi telegram television tencent-weibo terminal text-height text-width th th-large th-list themeisle thermometer-empty thermometer-full thermometer-half thermometer-quarter thermometer-three-quarters thumb-tack thumbs-down thumbs-o-down thumbs-o-up thumbs-up ticket times times-circle times-circle-o tint toggle-off toggle-on trademark train transgender transgender-alt trash trash-o tree trello tripadvisor trophy truck try tty tumblr tumblr-square twitch twitter twitter-square umbrella underline undo universal-access university unlock unlock-alt upload usb usd user user-circle user-circle-o user-md user-o user-plus user-secret user-times users venus venus-double venus-mars viacoin viadeo viadeo-square video-camera vimeo vimeo-square vine vk volume-control-phone volume-down volume-off volume-up weibo weixin whatsapp wheelchair wheelchair-alt wifi wikipedia-w window-close window-close-o window-maximize window-minimize window-restore windows wordpress wpbeginner wpexplorer wpforms wrench xing xing-square y-combinator yahoo yelp yoast youtube youtube-play youtube-square","headline":"Font Awesome Icon List","dateModified":"2020-03-07T16:14:00+09:00","@type":"WebPage","@context":"https://schema.org"}</script>
+{"datePublished":"2020-03-07T16:26:06+09:00","url":"http://nemo.apache.org//docs/font-awesome/","description":"500px address-book address-book-o address-card address-card-o adjust adn align-center align-justify align-left align-right amazon ambulance american-sign-language-interpreting anchor android angellist angle-double-down angle-double-left angle-double-right angle-double-up angle-down angle-left angle-right angle-up apple archive area-chart arrow-circle-down arrow-circle-left arrow-circle-o-down arrow-circle-o-left arrow-circle-o-right arrow-circle-o-up arrow-circle-right arrow-circle-up arrow-down arrow-left arrow-right arrow-up arrows arrows-alt arrows-h arrows-v assistive-listening-systems asterisk at audio-description backward balance-scale ban bandcamp bar-chart barcode bars bath battery-empty battery-full battery-half battery-quarter battery-three-quarters bed beer behance behance-square bell bell-o bell-slash bell-slash-o bicycle binoculars birthday-cake bitbucket bitbucket-square black-tie blind bluetooth bluetooth-b bold bolt bomb book bookmark bookmark-o braille briefcase btc bug building building-o bullhorn bullseye bus buysellads calculator calendar calendar-check-o calendar-minus-o calendar-o calendar-plus-o calendar-times-o camera camera-retro car caret-down caret-left caret-right caret-square-o-down caret-square-o-left caret-square-o-right caret-square-o-up caret-up cart-arrow-down cart-plus cc cc-amex cc-diners-club cc-discover cc-jcb cc-mastercard cc-paypal cc-stripe cc-visa certificate chain-broken check check-circle check-circle-o check-square check-square-o chevron-circle-down chevron-circle-left chevron-circle-right chevron-circle-up chevron-down chevron-left chevron-right chevron-up child chrome circle circle-o circle-o-notch circle-thin clipboard clock-o clone cloud cloud-download cloud-upload code code-fork codepen codiepie coffee cog cogs columns comment comment-o commenting commenting-o comments comments-o compass compress connectdevelop contao copyright creative-commons credit-card credit-card-alt crop crosshairs css3 cube cubes cutlery dashcube database deaf delicious desktop deviantart diamond digg dot-circle-o download dribbble dropbox drupal edge eercast eject ellipsis-h ellipsis-v empire envelope envelope-o envelope-open envelope-open-o envelope-square envira eraser etsy eur exchange exclamation exclamation-circle exclamation-triangle expand expeditedssl external-link external-link-square eye eye-slash eyedropper facebook facebook-official facebook-square fast-backward fast-forward fax female fighter-jet file file-archive-o file-audio-o file-code-o file-excel-o file-image-o file-o file-pdf-o file-powerpoint-o file-text file-text-o file-video-o file-word-o files-o film filter fire fire-extinguisher firefox first-order flag flag-checkered flag-o flask flickr floppy-o folder folder-o folder-open folder-open-o font font-awesome fonticons fort-awesome forumbee forward foursquare free-code-camp frown-o futbol-o gamepad gavel gbp genderless get-pocket gg gg-circle gift git git-square github github-alt github-square gitlab glass glide glide-g globe google google-plus google-plus-official google-plus-square google-wallet graduation-cap gratipay grav h-square hacker-news hand-lizard-o hand-o-down hand-o-left hand-o-right hand-o-up hand-paper-o hand-peace-o hand-pointer-o hand-rock-o hand-scissors-o hand-spock-o handshake-o hashtag hdd-o header headphones heart heart-o heartbeat history home hospital-o hourglass hourglass-end hourglass-half hourglass-o hourglass-start houzz html5 i-cursor id-badge id-card id-card-o ils imdb inbox indent industry info info-circle inr instagram internet-explorer ioxhost italic joomla jpy jsfiddle key keyboard-o krw language laptop lastfm lastfm-square leaf leanpub lemon-o level-down level-up life-ring lightbulb-o line-chart link linkedin linkedin-square linode linux list list-alt list-ol list-ul location-arrow lock long-arrow-down long-arrow-left long-arrow-right long-arrow-up low-vision magic magnet male map map-marker map-o map-pin map-signs mars mars-double mars-stroke mars-stroke-h mars-stroke-v maxcdn meanpath medium medkit meetup meh-o mercury microchip microphone microphone-slash minus minus-circle minus-square minus-square-o mixcloud mobile modx money moon-o motorcycle mouse-pointer music neuter newspaper-o object-group object-ungroup odnoklassniki odnoklassniki-square opencart openid opera optin-monster outdent pagelines paint-brush paper-plane paper-plane-o paperclip paragraph pause pause-circle pause-circle-o paw paypal pencil pencil-square pencil-square-o percent phone phone-square picture-o pie-chart pied-piper pied-piper-alt pied-piper-pp pinterest pinterest-p pinterest-square plane play play-circle play-circle-o plug plus plus-circle plus-square plus-square-o podcast power-off print product-hunt puzzle-piece qq qrcode question question-circle question-circle-o quora quote-left quote-right random ravelry rebel recycle reddit reddit-alien reddit-square refresh registered renren repeat reply reply-all retweet road rocket rss rss-square rub safari scissors scribd search search-minus search-plus sellsy server share share-alt share-alt-square share-square share-square-o shield ship shirtsinbulk shopping-bag shopping-basket shopping-cart shower sign-in sign-language sign-out signal simplybuilt sitemap skyatlas skype slack sliders slideshare smile-o snapchat snapchat-ghost snapchat-square snowflake-o sort sort-alpha-asc sort-alpha-desc sort-amount-asc sort-amount-desc sort-asc sort-desc sort-numeric-asc sort-numeric-desc soundcloud space-shuttle spinner spoon spotify square square-o stack-exchange stack-overflow star star-half star-half-o star-o steam steam-square step-backward step-forward stethoscope sticky-note sticky-note-o stop stop-circle stop-circle-o street-view strikethrough stumbleupon stumbleupon-circle subscript subway suitcase sun-o superpowers superscript table tablet tachometer tag tags tasks taxi telegram television tencent-weibo terminal text-height text-width th th-large th-list themeisle thermometer-empty thermometer-full thermometer-half thermometer-quarter thermometer-three-quarters thumb-tack thumbs-down thumbs-o-down thumbs-o-up thumbs-up ticket times times-circle times-circle-o tint toggle-off toggle-on trademark train transgender transgender-alt trash trash-o tree trello tripadvisor trophy truck try tty tumblr tumblr-square twitch twitter twitter-square umbrella underline undo universal-access university unlock unlock-alt upload usb usd user user-circle user-circle-o user-md user-o user-plus user-secret user-times users venus venus-double venus-mars viacoin viadeo viadeo-square video-camera vimeo vimeo-square vine vk volume-control-phone volume-down volume-off volume-up weibo weixin whatsapp wheelchair wheelchair-alt wifi wikipedia-w window-close window-close-o window-maximize window-minimize window-restore windows wordpress wpbeginner wpexplorer wpforms wrench xing xing-square y-combinator yahoo yelp yoast youtube youtube-play youtube-square","headline":"Font Awesome Icon List","dateModified":"2020-03-07T16:26:06+09:00","@type":"WebPage","@context":"https://schema.org"}</script>
<!-- End Jekyll SEO tag -->
diff --git a/content/docs/getting_started/index.html b/content/docs/getting_started/index.html
index 46fd49a..ab601c5 100644
--- a/content/docs/getting_started/index.html
+++ b/content/docs/getting_started/index.html
@@ -15,15 +15,15 @@
<meta name="generator" content="Jekyll v3.4.3" />
<meta property="og:title" content="Getting Started" />
<meta property="og:locale" content="en_US" />
-<meta name="description" content="Prerequisites Java 8 Maven Latest REEF snapshot YARN settings Download Hadoop 2.7.4 at http://apache.tt.co.kr/hadoop/common/hadoop-2.7.4/ Set the shell profile as following: export HADOOP_HOME=/path/to/hadoop-2.7.4 export YARN_HOME=$HADOOP_HOME export PATH=$PATH:$HADOOP_HOME/bin Protobuf 2.5.0 Downloadable at https://github.com/google/protobuf/releases/tag/v2.5.0 On Ubuntu: Run sudo apt-get install autoconf automake libtool curl make g++ unzip Extract the downloaded tarball and run sudo ./configure sudo make sudo make check sudo make install 3. To check for a successful installation of version 2.5.0, run protoc --version" />
-<meta property="og:description" content="Prerequisites Java 8 Maven Latest REEF snapshot YARN settings Download Hadoop 2.7.4 at http://apache.tt.co.kr/hadoop/common/hadoop-2.7.4/ Set the shell profile as following: export HADOOP_HOME=/path/to/hadoop-2.7.4 export YARN_HOME=$HADOOP_HOME export PATH=$PATH:$HADOOP_HOME/bin Protobuf 2.5.0 Downloadable at https://github.com/google/protobuf/releases/tag/v2.5.0 On Ubuntu: Run sudo apt-get install autoconf automake libtool curl make g++ unzip Extract the downloaded tarball and run sudo ./configure sudo make sudo make check sudo make install 3. To check for a successful installation of version 2.5.0, run protoc --version" />
+<meta name="description" content="Nemo" />
+<meta property="og:description" content="Nemo" />
<link rel="canonical" href="http://nemo.apache.org//docs/getting_started/" />
<meta property="og:url" content="http://nemo.apache.org//docs/getting_started/" />
<meta property="og:site_name" content="Nemo" />
<meta property="og:type" content="article" />
-<meta property="article:published_time" content="2020-03-07T16:14:00+09:00" />
+<meta property="article:published_time" content="2020-03-07T16:26:06+09:00" />
<script type="application/ld+json">
-{"datePublished":"2020-03-07T16:14:00+09:00","url":"http://nemo.apache.org//docs/getting_started/","description":"Prerequisites Java 8 Maven Latest REEF snapshot YARN settings Download Hadoop 2.7.4 at http://apache.tt.co.kr/hadoop/common/hadoop-2.7.4/ Set the shell profile as following: export HADOOP_HOME=/path/to/hadoop-2.7.4 export YARN_HOME=$HADOOP_HOME export PATH=$PATH:$HADOOP_HOME/bin Protobuf 2.5.0 Downloadable at https://github.com/google/protobuf/releases/tag/v2.5.0 On Ubuntu: Run sudo apt-get install autoconf automake libtool curl make g++ unzip Extract the downloaded tarball and run sudo ./configure sudo make sudo make check sudo make install 3. To check for a successful installation of version 2.5.0, run protoc --version","headline":"Getting Started","dateModified":"2020-03-07T16:14:00+09:00","@type":"WebPage","@context":"https://schema.org"}</script>
+{"datePublished":"2020-03-07T16:26:06+09:00","url":"http://nemo.apache.org//docs/getting_started/","description":"Nemo","headline":"Getting Started","dateModified":"2020-03-07T16:26:06+09:00","@type":"WebPage","@context":"https://schema.org"}</script>
<!-- End Jekyll SEO tag -->
@@ -174,16 +174,35 @@
<div class="col-md-8">
<h1>Getting Started</h1>
- <div id="markdown-content-container"><h3 id="prerequisites">Prerequisites</h3>
+ <div id="markdown-content-container"><h1 id="nemo">Nemo</h1>
+
+<p><a href="https://travis-ci.org/apache/incubator-nemo"><img src="https://travis-ci.org/apache/incubator-nemo.svg?branch=master" alt="Build Status" /></a>
+<a href="https://sonarcloud.io/dashboard?id=org.apache.nemo%3Anemo-project"><img src="https://sonarcloud.io/api/project_badges/measure?project=org.apache.nemo%3Anemo-project&metric=alert_status" alt="Quality Gate Status" /></a></p>
+
+<p>A Data Processing System for Flexible Employment With Different Deployment Characteristics.</p>
+
+<h2 id="online-documentation">Online Documentation</h2>
+
+<p>Details about Nemo and its development can be found in:</p>
<ul>
- <li>Java 8</li>
+ <li>Our website: https://nemo.apache.org/</li>
+ <li>Our project wiki: https://cwiki.apache.org/confluence/display/NEMO/</li>
+ <li>Our Dev mailing list for contributing: dev@nemo.apache.org <a href="mailto:dev-subscribe@nemo.apache.org">(subscribe)</a></li>
+</ul>
+
+<p>Please refer to the <a href=".github/CONTRIBUTING.md">Contribution guideline</a> to contribute to our project.</p>
+
+<h2 id="nemo-prerequisites-and-setup">Nemo prerequisites and setup</h2>
+
+<h3 id="prerequisites">Prerequisites</h3>
+<ul>
+ <li>Java 8 or later (tested on Java 8 and Java 11)</li>
<li>Maven</li>
- <li>Latest REEF snapshot</li>
<li>YARN settings
<ul>
- <li>Download Hadoop 2.7.4 at http://apache.tt.co.kr/hadoop/common/hadoop-2.7.4/</li>
+ <li>Download Hadoop 2.7.2 at https://archive.apache.org/dist/hadoop/common/hadoop-2.7.2/</li>
<li>Set the shell profile as following:
- <div class="language-bash highlighter-rouge"><pre class="highlight"><code> <span class="nb">export </span><span class="nv">HADOOP_HOME</span><span class="o">=</span>/path/to/hadoop-2.7.4
+ <div class="language-bash highlighter-rouge"><pre class="highlight"><code> <span class="nb">export </span><span class="nv">HADOOP_HOME</span><span class="o">=</span>/path/to/hadoop-2.7.2
<span class="nb">export </span><span class="nv">YARN_HOME</span><span class="o">=</span><span class="nv">$HADOOP_HOME</span>
<span class="nb">export </span><span class="nv">PATH</span><span class="o">=</span><span class="nv">$PATH</span>:<span class="nv">$HADOOP_HOME</span>/bin
</code></pre>
@@ -193,45 +212,65 @@
</li>
<li>Protobuf 2.5.0
<ul>
- <li>Downloadable at https://github.com/google/protobuf/releases/tag/v2.5.0</li>
- <li>On Ubuntu:
- <ol>
- <li>Run <code class="highlighter-rouge">sudo apt-get install autoconf automake libtool curl make g++ unzip</code></li>
- <li>Extract the downloaded tarball and run</li>
- </ol>
+ <li>
+ <p>On Ubuntu 14.04 LTS and its point releases:</p>
+
+ <div class="language-bash highlighter-rouge"><pre class="highlight"><code><span class="gp">$ </span>sudo apt-get install protobuf-compiler
+</code></pre>
+ </div>
+ </li>
+ <li>
+ <p>On Ubuntu 16.04 LTS and its point releases:</p>
+
+ <div class="language-bash highlighter-rouge"><pre class="highlight"><code><span class="gp">$ </span>sudo add-apt-repository ppa:snuspl/protobuf-250
+<span class="gp">$ </span>sudo apt update
+<span class="gp">$ </span>sudo apt install protobuf-compiler<span class="o">=</span>2.5.0-9xenial1
+</code></pre>
+ </div>
+ </li>
+ <li>
+ <p>On macOS:</p>
+
+ <div class="language-bash highlighter-rouge"><pre class="highlight"><code><span class="gp">$ </span>wget https://github.com/google/protobuf/releases/download/v2.5.0/protobuf-2.5.0.tar.bz2
+<span class="gp">$ </span>tar xvf protobuf-2.5.0.tar.bz2
+<span class="gp">$ </span><span class="nb">pushd </span>protobuf-2.5.0
+<span class="gp">$ </span>./configure <span class="nv">CC</span><span class="o">=</span>clang <span class="nv">CXX</span><span class="o">=</span>clang++ <span class="nv">CXXFLAGS</span><span class="o">=</span><span class="s1">'-std=c++11 -stdlib=libc++ -O3 -g'</span> <span class="nv">LDFLAGS</span><span class="o">=</span><span class="s1">'-stdlib=libc++'</span> <span class="nv">LIBS</span><span class="o">=</span><span class="s2">"-lc++ -lc++abi"</span>
+<span class="gp">$ </span>make -j 4
+<span class="gp">$ </span>sudo make install
+<span class="gp">$ </span><span class="nb">popd</span>
+</code></pre>
+ </div>
+ </li>
+ <li>
+ <p>Or build from source:</p>
+
<ul>
- <li><code class="highlighter-rouge">sudo ./configure</code></li>
- <li><code class="highlighter-rouge">sudo make</code></li>
- <li><code class="highlighter-rouge">sudo make check</code></li>
- <li><code class="highlighter-rouge">sudo make install</code>
- 3. To check for a successful installation of version 2.5.0, run <code class="highlighter-rouge">protoc --version</code></li>
+ <li>Downloadable at https://github.com/google/protobuf/releases/tag/v2.5.0</li>
+ <li>Extract the downloaded tarball</li>
+ <li><code class="highlighter-rouge">$ ./configure</code></li>
+ <li><code class="highlighter-rouge">$ make</code></li>
+ <li><code class="highlighter-rouge">$ make check</code></li>
+ <li><code class="highlighter-rouge">$ sudo make install</code></li>
</ul>
</li>
+ <li>
+ <p>To check for a successful installation of version 2.5.0, run <code class="highlighter-rouge">$ protoc --version</code></p>
+ </li>
</ul>
</li>
</ul>
<h3 id="installing-nemo">Installing Nemo</h3>
<ul>
- <li>Run all tests and install: <code class="highlighter-rouge">mvn clean install -T 2C</code></li>
- <li>Run only unit tests and install: <code class="highlighter-rouge">mvn clean install -DskipITs -T 2C</code></li>
+ <li>Run all tests and install: <code class="highlighter-rouge">$ mvn clean install -T 2C</code></li>
+ <li>Run only unit tests and install: <code class="highlighter-rouge">$ mvn clean install -DskipITs -T 2C</code></li>
</ul>
<h2 id="running-beam-applications">Running Beam applications</h2>
-<h3 id="running-an-external-beam-application">Running an external Beam application</h3>
-<ul>
- <li>Use run_external_app.sh instead of run.sh</li>
- <li>Set the first argument the path to the external Beam application jar</li>
-</ul>
-<div class="language-bash highlighter-rouge"><pre class="highlight"><code>./bin/run_external_app.sh <span class="se">\</span>
-<span class="sb">`</span><span class="nb">pwd</span><span class="sb">`</span>/nemo_app/target/bd17f-1.0-SNAPSHOT.jar <span class="se">\</span>
--job_id mapreduce <span class="se">\</span>
--executor_json <span class="sb">`</span><span class="nb">pwd</span><span class="sb">`</span>/nemo_runtime/config/default.json <span class="se">\</span>
--user_main MapReduce <span class="se">\</span>
--user_args <span class="s2">"</span><span class="sb">`</span><span class="nb">pwd</span><span class="sb">`</span><span class="s2">/mr_input_data </span><span class="sb">`</span><span class="nb">pwd</span><span class="sb">`</span><span class="s2">/nemo_output/output_data"</span>
-</code></pre>
-</div>
+<p>Apache Nemo is an official runner of Apache Beam, and it can be executed from Beam, using NemoRunner, as well as directly from the Nemo project.
+The details of using NemoRunner from Beam is shown on the <a href="https://beam.apache.org/documentation/runners/nemo/">NemoRunner page of the Apache Beam website</a>.
+Below describes how Beam applications can be run directly on Nemo.</p>
<h3 id="configurable-options">Configurable options</h3>
<ul>
@@ -243,23 +282,43 @@
</ul>
<h3 id="examples">Examples</h3>
-<div class="language-bash highlighter-rouge"><pre class="highlight"><code><span class="c">## MapReduce example</span>
-./bin/run.sh <span class="se">\</span>
- -job_id mr_default <span class="se">\</span>
- -user_main edu.snu.nemo.examples.beam.MapReduce <span class="se">\</span>
- -optimization_policy edu.snu.nemo.compiler.optimizer.policy.DefaultPolicy <span class="se">\</span>
- -user_args <span class="s2">"</span><span class="sb">`</span><span class="nb">pwd</span><span class="sb">`</span><span class="s2">/src/main/resources/sample_input_mr </span><span class="sb">`</span><span class="nb">pwd</span><span class="sb">`</span><span class="s2">/src/main/resources/sample_output"</span>
+<div class="language-bash highlighter-rouge"><pre class="highlight"><code><span class="c">## WordCount example from the Beam website (Count words from a document)</span>
+<span class="gp">$ </span>./bin/run_beam.sh <span class="se">\</span>
+ -job_id beam_wordcount <span class="se">\</span>
+ -optimization_policy org.apache.nemo.compiler.optimizer.policy.DefaultPolicy <span class="se">\</span>
+ -user_main org.apache.nemo.examples.beam.BeamWordCount <span class="se">\</span>
+ -user_args <span class="s2">"--runner=NemoRunner --inputFile=</span><span class="sb">`</span><span class="nb">pwd</span><span class="sb">`</span><span class="s2">/examples/resources/inputs/test_input_wordcount --output=</span><span class="sb">`</span><span class="nb">pwd</span><span class="sb">`</span><span class="s2">/outputs/wordcount"</span>
+<span class="gp">$ </span>less <span class="sb">`</span><span class="nb">pwd</span><span class="sb">`</span>/outputs/wordcount<span class="k">*</span>
+
+<span class="c">## MapReduce WordCount example (Count words from the Wikipedia dataset)</span>
+<span class="gp">$ </span>./bin/run_beam.sh <span class="se">\</span>
+ -job_id mr_default <span class="se">\</span>
+ -executor_json <span class="sb">`</span><span class="nb">pwd</span><span class="sb">`</span>/examples/resources/executors/beam_test_executor_resources.json <span class="se">\</span>
+ -optimization_policy org.apache.nemo.compiler.optimizer.policy.DefaultPolicy <span class="se">\</span>
+ -user_main org.apache.nemo.examples.beam.WordCount <span class="se">\</span>
+ -user_args <span class="s2">"</span><span class="sb">`</span><span class="nb">pwd</span><span class="sb">`</span><span class="s2">/examples/resources/inputs/test_input_wordcount </span><span class="sb">`</span><span class="nb">pwd</span><span class="sb">`</span><span class="s2">/outputs/wordcount"</span>
+<span class="gp">$ </span>less <span class="sb">`</span><span class="nb">pwd</span><span class="sb">`</span>/outputs/wordcount<span class="k">*</span>
<span class="c">## YARN cluster example</span>
-./bin/run.sh <span class="se">\</span>
- -deploy_mode yarn <span class="se">\</span>
- -job_id mr_pado <span class="se">\</span>
- -user_main edu.snu.nemo.examples.beam.MapReduce <span class="se">\</span>
- -optimization_policy edu.snu.nemo.compiler.optimizer.policy.PadoPolicy <span class="se">\</span>
- -user_args <span class="s2">"hdfs://v-m:9000/sample_input_mr hdfs://v-m:9000/sample_output_mr"</span>
+<span class="gp">$ </span>./bin/run_beam.sh <span class="se">\</span>
+ -deploy_mode yarn <span class="se">\</span>
+ -job_id mr_transient <span class="se">\</span>
+ -executor_json <span class="sb">`</span><span class="nb">pwd</span><span class="sb">`</span>/examples/resources/executors/beam_test_executor_resources.json <span class="se">\</span>
+ -user_main org.apache.nemo.examples.beam.WordCount <span class="se">\</span>
+ -optimization_policy org.apache.nemo.compiler.optimizer.policy.TransientResourcePolicy <span class="se">\</span>
+ -user_args <span class="s2">"hdfs://v-m:9000/test_input_wordcount hdfs://v-m:9000/test_output_wordcount"</span>
+
+<span class="c">## NEXMark streaming Q0 (query0) example</span>
+<span class="gp">$ </span>./bin/run_nexmark.sh <span class="se">\</span>
+ -job_id nexmark-Q0 <span class="se">\</span>
+ -executor_json <span class="sb">`</span><span class="nb">pwd</span><span class="sb">`</span>/examples/resources/executors/beam_test_executor_resources.json <span class="se">\</span>
+ -user_main org.apache.beam.sdk.nexmark.Main <span class="se">\</span>
+ -optimization_policy org.apache.nemo.compiler.optimizer.policy.StreamingPolicy <span class="se">\</span>
+ -scheduler_impl_class_name org.apache.nemo.runtime.master.scheduler.StreamingScheduler <span class="se">\</span>
+ -user_args <span class="s2">"--runner=NemoRunner --streaming=true --query=0 --numEventGenerators=1"</span>
+
</code></pre>
</div>
-
<h2 id="resource-configuration">Resource Configuration</h2>
<p><code class="highlighter-rouge">-executor_json</code> command line option can be used to provide a path to the JSON file that describes resource configuration for executors. Its default value is <code class="highlighter-rouge">config/default.json</code>, which initializes one of each <code class="highlighter-rouge">Transient</code>, <code class="highlighter-rouge">Reserved</code>, and <code class="highlighter-rouge">Compute</code> executor, each of which has one core and 1024MB memory.</p>
@@ -274,7 +333,7 @@
</ul>
</li>
<li><code class="highlighter-rouge">memory_mb</code>: Memory size in MB</li>
- <li><code class="highlighter-rouge">capacity</code>: Number of <code class="highlighter-rouge">TaskGroup</code>s that can be run in an executor. Set this value to be the same as the number of CPU cores of the container.</li>
+ <li><code class="highlighter-rouge">capacity</code>: Number of <code class="highlighter-rouge">Task</code>s that can be run in an executor. Set this value to be the same as the number of CPU cores of the container.</li>
</ul>
<h3 id="examples-1">Examples</h3>
@@ -300,22 +359,60 @@
<li>1 reserved container with 2 cores and 1024MB memory</li>
</ul>
-<h2 id="monitoring-your-job-using-web-ui">Monitoring your job using web UI</h2>
-<p>Nemo Compiler and Runtime can store JSON representation of intermediate DAGs.</p>
-<ul>
- <li><code class="highlighter-rouge">-dag_dir</code> command line option is used to specify the directory where the JSON files are stored. The default directory is <code class="highlighter-rouge">./dag</code>.
-Using our <a href="https://service.jangho.io/Nemo-dag/">online visualizer</a>, you can easily visualize a DAG. Just drop the JSON file of the DAG as an input to it.</li>
-</ul>
+<h2 id="monitoring-your-job-using-web-ui">Monitoring your job using Web UI</h2>
+<p>Please refer to the instructions at <code class="highlighter-rouge">web-ui/README.md</code> to run the frontend.</p>
-<h3 id="examples-2">Examples</h3>
-<div class="language-bash highlighter-rouge"><pre class="highlight"><code>./bin/run.sh <span class="se">\</span>
- -job_id als <span class="se">\</span>
- -user_main edu.snu.nemo.examples.beam.AlternatingLeastSquare <span class="se">\</span>
- -optimization_policy edu.snu.nemo.compiler.optimizer.policy.PadoPolicy <span class="se">\</span>
- -dag_dir <span class="s2">"./dag/als"</span> <span class="se">\</span>
- -user_args <span class="s2">"</span><span class="sb">`</span><span class="nb">pwd</span><span class="sb">`</span><span class="s2">/src/main/resources/sample_input_als 10 3"</span>
+<h3 id="visualizing-metric-on-run-time">Visualizing metric on run-time</h3>
+
+<p>While Nemo driver is alive, it can post runtime metrics through websocket. At your frontend, add websocket endpoint</p>
+
+<div class="highlighter-rouge"><pre class="highlight"><code>ws://<DRIVER>:10101/api/websocket
</code></pre>
</div>
+
+<p>where <code class="highlighter-rouge"><DRIVER></code> is the hostname that Nemo driver runs.</p>
+
+<p>OR, you can directly run the WebUI on the driver using <code class="highlighter-rouge">bin/run_webserver.sh</code>,
+where it looks for the websocket on its local machine,
+which, by default, provides the address at</p>
+
+<div class="highlighter-rouge"><pre class="highlight"><code>http://<DRIVER>:3333
+</code></pre>
+</div>
+
+<h3 id="post-job-analysis">Post-job analysis</h3>
+
+<p>On job completion, the Nemo driver creates <code class="highlighter-rouge">metric.json</code> at the directory specified by <code class="highlighter-rouge">-dag_dir</code> option. At your frontend, add the JSON file to do post-job analysis.</p>
+
+<p>Other JSON files are for legacy Web UI, hosted <a href="https:/nemo.snuspl.snu.ac.kr:50443/nemo-dag/">here</a>. It uses <a href="https://www.graphviz.org/">Graphviz</a> to visualize IR DAGs and execution plans.</p>
+
+<h3 id="examples-2">Examples</h3>
+<div class="language-bash highlighter-rouge"><pre class="highlight"><code><span class="gp">$ </span>./bin/run_beam.sh <span class="se">\</span>
+ -job_id als <span class="se">\</span>
+ -executor_json <span class="sb">`</span><span class="nb">pwd</span><span class="sb">`</span>/examples/resources/executors/beam_test_executor_resources.json <span class="se">\</span>
+ -user_main org.apache.nemo.examples.beam.AlternatingLeastSquare <span class="se">\</span>
+ -optimization_policy org.apache.nemo.compiler.optimizer.policy.TransientResourcePolicy <span class="se">\</span>
+ -dag_dir <span class="s2">"./dag/als"</span> <span class="se">\</span>
+ -user_args <span class="s2">"</span><span class="sb">`</span><span class="nb">pwd</span><span class="sb">`</span><span class="s2">/examples/resources/inputs/test_input_als 10 3"</span>
+</code></pre>
+</div>
+
+<h2 id="options-for-writing-metric-results-to-databases">Options for writing metric results to databases.</h2>
+
+<ul>
+ <li><code class="highlighter-rouge">-db_enabled</code>: Whether or not to turn on the DB (<code class="highlighter-rouge">true</code> or <code class="highlighter-rouge">false</code>).</li>
+ <li><code class="highlighter-rouge">-db_address</code>: Address of the DB. (ex. PostgreSQL DB starts with <code class="highlighter-rouge">jdbc:postgresql://...</code>)</li>
+ <li><code class="highlighter-rouge">-db_id</code> : ID of the DB from the given address.</li>
+ <li><code class="highlighter-rouge">-db_password</code>: Credentials for the DB from the given address.</li>
+</ul>
+
+<h2 id="speeding-up-builds">Speeding up builds</h2>
+<ul>
+ <li>To exclude Spark related packages: mvn clean install -T 2C -DskipTests -pl \!compiler/frontend/spark,\!examples/spark</li>
+ <li>To exclude Beam related packages: mvn clean install -T 2C -DskipTests -pl \!compiler/frontend/beam,\!examples/beam</li>
+ <li>To exclude NEXMark related packages: mvn clean install -T 2C -DskipTests -pl \!examples/nexmark</li>
+</ul>
+
</div>
<p class="text-center">
<br />
diff --git a/content/docs/home/index.html b/content/docs/home/index.html
index 9e02070..238a950 100644
--- a/content/docs/home/index.html
+++ b/content/docs/home/index.html
@@ -21,9 +21,9 @@
<meta property="og:url" content="http://nemo.apache.org//docs/home/" />
<meta property="og:site_name" content="Nemo" />
<meta property="og:type" content="article" />
-<meta property="article:published_time" content="2020-03-07T16:14:00+09:00" />
+<meta property="article:published_time" content="2020-03-07T16:26:06+09:00" />
<script type="application/ld+json">
-{"datePublished":"2020-03-07T16:14:00+09:00","url":"http://nemo.apache.org//docs/home/","description":"Nemo aims to optimize data processing for better performance and datacenter efficiency, not only in general and common conditions, but also with various deployment characteristics. Such characteristics include processing data on specific resource environments, like transient resources, and running jobs with specific attributes, like skewed data.","headline":"Overview","dateModified":"2020-03-07T16:14:00+09:00","@type":"WebPage","@context":"https://schema.org"}</script>
+{"datePublished":"2020-03-07T16:26:06+09:00","url":"http://nemo.apache.org//docs/home/","description":"Nemo aims to optimize data processing for better performance and datacenter efficiency, not only in general and common conditions, but also with various deployment characteristics. Such characteristics include processing data on specific resource environments, like transient resources, and running jobs with specific attributes, like skewed data.","headline":"Overview","dateModified":"2020-03-07T16:26:06+09:00","@type":"WebPage","@context":"https://schema.org"}</script>
<!-- End Jekyll SEO tag -->
diff --git a/content/docs/ir/index.html b/content/docs/ir/index.html
index ea5c5ad..1e0064f 100644
--- a/content/docs/ir/index.html
+++ b/content/docs/ir/index.html
@@ -21,9 +21,9 @@
<meta property="og:url" content="http://nemo.apache.org//docs/ir/" />
<meta property="og:site_name" content="Nemo" />
<meta property="og:type" content="article" />
-<meta property="article:published_time" content="2020-03-07T16:14:00+09:00" />
+<meta property="article:published_time" content="2020-03-07T16:26:06+09:00" />
<script type="application/ld+json">
-{"datePublished":"2020-03-07T16:14:00+09:00","url":"http://nemo.apache.org//docs/ir/","description":"Overview","headline":"Nemo Intermediate Representation (IR)","dateModified":"2020-03-07T16:14:00+09:00","@type":"WebPage","@context":"https://schema.org"}</script>
+{"datePublished":"2020-03-07T16:26:06+09:00","url":"http://nemo.apache.org//docs/ir/","description":"Overview","headline":"Nemo Intermediate Representation (IR)","dateModified":"2020-03-07T16:26:06+09:00","@type":"WebPage","@context":"https://schema.org"}</script>
<!-- End Jekyll SEO tag -->
diff --git a/content/docs/jekyll/index.html b/content/docs/jekyll/index.html
index f5c285d..c329dbd 100644
--- a/content/docs/jekyll/index.html
+++ b/content/docs/jekyll/index.html
@@ -21,9 +21,9 @@
<meta property="og:url" content="http://nemo.apache.org//docs/jekyll/" />
<meta property="og:site_name" content="Nemo" />
<meta property="og:type" content="article" />
-<meta property="article:published_time" content="2020-03-07T16:14:00+09:00" />
+<meta property="article:published_time" content="2020-03-07T16:26:06+09:00" />
<script type="application/ld+json">
-{"datePublished":"2020-03-07T16:14:00+09:00","url":"http://nemo.apache.org//docs/jekyll/","description":"Getting started","headline":"Jekyll intro","dateModified":"2020-03-07T16:14:00+09:00","@type":"WebPage","@context":"https://schema.org"}</script>
+{"datePublished":"2020-03-07T16:26:06+09:00","url":"http://nemo.apache.org//docs/jekyll/","description":"Getting started","headline":"Jekyll intro","dateModified":"2020-03-07T16:26:06+09:00","@type":"WebPage","@context":"https://schema.org"}</script>
<!-- End Jekyll SEO tag -->
diff --git a/content/docs/passes_and_policies/index.html b/content/docs/passes_and_policies/index.html
index 87a136e..4e665fe 100644
--- a/content/docs/passes_and_policies/index.html
+++ b/content/docs/passes_and_policies/index.html
@@ -21,9 +21,9 @@
<meta property="og:url" content="http://nemo.apache.org//docs/passes_and_policies/" />
<meta property="og:site_name" content="Nemo" />
<meta property="og:type" content="article" />
-<meta property="article:published_time" content="2020-03-07T16:14:00+09:00" />
+<meta property="article:published_time" content="2020-03-07T16:26:06+09:00" />
<script type="application/ld+json">
-{"datePublished":"2020-03-07T16:14:00+09:00","url":"http://nemo.apache.org//docs/passes_and_policies/","description":"Optimization Passes","headline":"Passes and Policies","dateModified":"2020-03-07T16:14:00+09:00","@type":"WebPage","@context":"https://schema.org"}</script>
+{"datePublished":"2020-03-07T16:26:06+09:00","url":"http://nemo.apache.org//docs/passes_and_policies/","description":"Optimization Passes","headline":"Passes and Policies","dateModified":"2020-03-07T16:26:06+09:00","@type":"WebPage","@context":"https://schema.org"}</script>
<!-- End Jekyll SEO tag -->
diff --git a/content/docs/runtime_design/index.html b/content/docs/runtime_design/index.html
index 7bf3236..0e792a3 100644
--- a/content/docs/runtime_design/index.html
+++ b/content/docs/runtime_design/index.html
@@ -21,9 +21,9 @@
<meta property="og:url" content="http://nemo.apache.org//docs/runtime_design/" />
<meta property="og:site_name" content="Nemo" />
<meta property="og:type" content="article" />
-<meta property="article:published_time" content="2020-03-07T16:14:00+09:00" />
+<meta property="article:published_time" content="2020-03-07T16:26:06+09:00" />
<script type="application/ld+json">
-{"datePublished":"2020-03-07T16:14:00+09:00","url":"http://nemo.apache.org//docs/runtime_design/","description":"Receiving a Job from the Nemo Compiler","headline":"Runtime Design","dateModified":"2020-03-07T16:14:00+09:00","@type":"WebPage","@context":"https://schema.org"}</script>
+{"datePublished":"2020-03-07T16:26:06+09:00","url":"http://nemo.apache.org//docs/runtime_design/","description":"Receiving a Job from the Nemo Compiler","headline":"Runtime Design","dateModified":"2020-03-07T16:26:06+09:00","@type":"WebPage","@context":"https://schema.org"}</script>
<!-- End Jekyll SEO tag -->
diff --git a/content/docs/themes/index.html b/content/docs/themes/index.html
index 9185d0e..d060f58 100644
--- a/content/docs/themes/index.html
+++ b/content/docs/themes/index.html
@@ -21,9 +21,9 @@
<meta property="og:url" content="http://nemo.apache.org//docs/themes/" />
<meta property="og:site_name" content="Nemo" />
<meta property="og:type" content="article" />
-<meta property="article:published_time" content="2020-03-07T16:14:00+09:00" />
+<meta property="article:published_time" content="2020-03-07T16:26:06+09:00" />
<script type="application/ld+json">
-{"datePublished":"2020-03-07T16:14:00+09:00","url":"http://nemo.apache.org//docs/themes/","description":"By default, this website uses paper theme, but you can change it to another bootwatch theme by setting bootwatch variable in _config.yml file. (Don’t forget to restart Jekyll if you are running locally because the configuration is not re-read upon change.)","headline":"Themes","dateModified":"2020-03-07T16:14:00+09:00","@type":"WebPage","@context":"https://schema.org"}</script>
+{"datePublished":"2020-03-07T16:26:06+09:00","url":"http://nemo.apache.org//docs/themes/","description":"By default, this website uses paper theme, but you can change it to another bootwatch theme by setting bootwatch variable in _config.yml file. (Don’t forget to restart Jekyll if you are running locally because the configuration is not re-read upon change.)","headline":"Themes","dateModified":"2020-03-07T16:26:06+09:00","@type":"WebPage","@context":"https://schema.org"}</script>
<!-- End Jekyll SEO tag -->
diff --git a/content/docs/welcome_to_jekyll/index.html b/content/docs/welcome_to_jekyll/index.html
index c9450e0..862f480 100644
--- a/content/docs/welcome_to_jekyll/index.html
+++ b/content/docs/welcome_to_jekyll/index.html
@@ -21,9 +21,9 @@
<meta property="og:url" content="http://nemo.apache.org//docs/welcome_to_jekyll/" />
<meta property="og:site_name" content="Nemo" />
<meta property="og:type" content="article" />
-<meta property="article:published_time" content="2020-03-07T16:14:00+09:00" />
+<meta property="article:published_time" content="2020-03-07T16:26:06+09:00" />
<script type="application/ld+json">
-{"datePublished":"2020-03-07T16:14:00+09:00","url":"http://nemo.apache.org//docs/welcome_to_jekyll/","description":"You’ll find this post in your _posts directory. Go ahead and edit it and re-build the site to see your changes. You can rebuild the site in many different ways, but the most common way is to run jekyll serve, which launches a web server and auto-regenerates your site when a file is updated.","headline":"Welcome to Jekyll!","dateModified":"2020-03-07T16:14:00+09:00","@type":"WebPage","@context":"https://schema.org"}</script>
+{"datePublished":"2020-03-07T16:26:06+09:00","url":"http://nemo.apache.org//docs/welcome_to_jekyll/","description":"You’ll find this post in your _posts directory. Go ahead and edit it and re-build the site to see your changes. You can rebuild the site in many different ways, but the most common way is to run jekyll serve, which launches a web server and auto-regenerates your site when a file is updated.","headline":"Welcome to Jekyll!","dateModified":"2020-03-07T16:26:06+09:00","@type":"WebPage","@context":"https://schema.org"}</script>
<!-- End Jekyll SEO tag -->
diff --git a/content/feed.xml b/content/feed.xml
index 0dd0d07..2682014 100644
--- a/content/feed.xml
+++ b/content/feed.xml
@@ -1,4 +1,4 @@
-<?xml version="1.0" encoding="utf-8"?><feed xmlns="http://www.w3.org/2005/Atom" ><generator uri="https://jekyllrb.com/" version="3.4.3">Jekyll</generator><link href="http://nemo.apache.org//feed.xml" rel="self" type="application/atom+xml" /><link href="http://nemo.apache.org//" rel="alternate" type="text/html" /><updated>2020-03-07T16:14:00+09:00</updated><id>http://nemo.apache.org//feed.xml</id><title type="html">Nemo</title><subtitle>A Data Processing System for Flexible Employment With Different Deployment Characteristics.
+<?xml version="1.0" encoding="utf-8"?><feed xmlns="http://www.w3.org/2005/Atom" ><generator uri="https://jekyllrb.com/" version="3.4.3">Jekyll</generator><link href="http://nemo.apache.org//feed.xml" rel="self" type="application/atom+xml" /><link href="http://nemo.apache.org//" rel="alternate" type="text/html" /><updated>2020-03-07T16:26:06+09:00</updated><id>http://nemo.apache.org//feed.xml</id><title type="html">Nemo</title><subtitle>A Data Processing System for Flexible Employment With Different Deployment Characteristics.
</subtitle><entry><title type="html">Nemo Release 0.1</title><link href="http://nemo.apache.org//blog/2019/03/02/release-note-0.1/" rel="alternate" type="text/html" title="Nemo Release 0.1" /><published>2019-03-02T00:00:00+09:00</published><updated>2019-03-02T00:00:00+09:00</updated><id>http://nemo.apache.org//blog/2019/03/02/release-note-0.1</id><content type="html" xml:base="http://nemo.apache.org//blog/2019/03/02/release-note-0.1/"><p>Nemo 0.1 is an initial release that brings several features and performance enhancements. The most visible features are the frontend support for Beam and Spark; IR DAG with execution properties, optimization passes and policies; support for loops; dynamic optimization; multiple-job submission; and various features of the execution runtime.</p>
<p>You can view the JIRA-generated release note here: <a href="https://issues.apache.org/jira/secure/ReleaseNote.jspa?projectId=12321823&amp;version=12344546">link</a>.</p>
diff --git a/content/pages/downloads/index.html b/content/pages/downloads/index.html
index 5b3093d..8f2d635 100644
--- a/content/pages/downloads/index.html
+++ b/content/pages/downloads/index.html
@@ -21,9 +21,9 @@
<meta property="og:url" content="http://nemo.apache.org//pages/downloads/" />
<meta property="og:site_name" content="Nemo" />
<meta property="og:type" content="article" />
-<meta property="article:published_time" content="2020-03-07T16:14:00+09:00" />
+<meta property="article:published_time" content="2020-03-07T16:26:06+09:00" />
<script type="application/ld+json">
-{"datePublished":"2020-03-07T16:14:00+09:00","url":"http://nemo.apache.org//pages/downloads/","description":"Releases","headline":"Downloads","dateModified":"2020-03-07T16:14:00+09:00","@type":"WebPage","@context":"https://schema.org"}</script>
+{"datePublished":"2020-03-07T16:26:06+09:00","url":"http://nemo.apache.org//pages/downloads/","description":"Releases","headline":"Downloads","dateModified":"2020-03-07T16:26:06+09:00","@type":"WebPage","@context":"https://schema.org"}</script>
<!-- End Jekyll SEO tag -->
diff --git a/content/pages/license/index.html b/content/pages/license/index.html
index 95f30ed..f2f5033 100644
--- a/content/pages/license/index.html
+++ b/content/pages/license/index.html
@@ -21,9 +21,9 @@
<meta property="og:url" content="http://nemo.apache.org//pages/license/" />
<meta property="og:site_name" content="Nemo" />
<meta property="og:type" content="article" />
-<meta property="article:published_time" content="2020-03-07T16:14:00+09:00" />
+<meta property="article:published_time" content="2020-03-07T16:26:06+09:00" />
<script type="application/ld+json">
-{"datePublished":"2020-03-07T16:14:00+09:00","url":"http://nemo.apache.org//pages/license/","description":"``` Apache License Version 2.0, January 2004 http://www.apache.org/licenses/","headline":"License","dateModified":"2020-03-07T16:14:00+09:00","@type":"WebPage","@context":"https://schema.org"}</script>
+{"datePublished":"2020-03-07T16:26:06+09:00","url":"http://nemo.apache.org//pages/license/","description":"``` Apache License Version 2.0, January 2004 http://www.apache.org/licenses/","headline":"License","dateModified":"2020-03-07T16:26:06+09:00","@type":"WebPage","@context":"https://schema.org"}</script>
<!-- End Jekyll SEO tag -->
diff --git a/content/pages/talks/index.html b/content/pages/talks/index.html
index 81cdadf..6e9e47d 100644
--- a/content/pages/talks/index.html
+++ b/content/pages/talks/index.html
@@ -21,9 +21,9 @@
<meta property="og:url" content="http://nemo.apache.org//pages/talks/" />
<meta property="og:site_name" content="Nemo" />
<meta property="og:type" content="article" />
-<meta property="article:published_time" content="2020-03-07T16:14:00+09:00" />
+<meta property="article:published_time" content="2020-03-07T16:26:06+09:00" />
<script type="application/ld+json">
-{"datePublished":"2020-03-07T16:14:00+09:00","url":"http://nemo.apache.org//pages/talks/","description":"Apache Nemo: A Framework for Building Distributed Dataflow Optimization Policies (ATC 2019 Conference)(link)","headline":"Talks","dateModified":"2020-03-07T16:14:00+09:00","@type":"WebPage","@context":"https://schema.org"}</script>
+{"datePublished":"2020-03-07T16:26:06+09:00","url":"http://nemo.apache.org//pages/talks/","description":"Apache Nemo: A Framework for Building Distributed Dataflow Optimization Policies (ATC 2019 Conference)(link)","headline":"Talks","dateModified":"2020-03-07T16:26:06+09:00","@type":"WebPage","@context":"https://schema.org"}</script>
<!-- End Jekyll SEO tag -->
diff --git a/content/pages/team/index.html b/content/pages/team/index.html
index 7cfdb94..fd2b4e3 100644
--- a/content/pages/team/index.html
+++ b/content/pages/team/index.html
@@ -21,9 +21,9 @@
<meta property="og:url" content="http://nemo.apache.org//pages/team/" />
<meta property="og:site_name" content="Nemo" />
<meta property="og:type" content="article" />
-<meta property="article:published_time" content="2020-03-07T16:14:00+09:00" />
+<meta property="article:published_time" content="2020-03-07T16:26:06+09:00" />
<script type="application/ld+json">
-{"datePublished":"2020-03-07T16:14:00+09:00","url":"http://nemo.apache.org//pages/team/","description":"Contributing to Nemo Your contributation is always welcome :) If you would like to contribute to Nemo, please subscribe to our mailing list: dev@nemo.apache.org [subscribe]. We have a Slack channel for active discussions. Join us on Slack by requesting for an invitation by sending an e-mail to dev@ after subscription.","headline":"Team","dateModified":"2020-03-07T16:14:00+09:00","@type":"WebPage","@context":"https://schema.org"}</script>
+{"datePublished":"2020-03-07T16:26:06+09:00","url":"http://nemo.apache.org//pages/team/","description":"Contributing to Nemo Your contributation is always welcome :) If you would like to contribute to Nemo, please subscribe to our mailing list: dev@nemo.apache.org [subscribe]. We have a Slack channel for active discussions. Join us on Slack by requesting for an invitation by sending an e-mail to dev@ after subscription.","headline":"Team","dateModified":"2020-03-07T16:26:06+09:00","@type":"WebPage","@context":"https://schema.org"}</script>
<!-- End Jekyll SEO tag -->
@@ -104,43 +104,18 @@
<td style="text-align: right">Seoul National University</td>
</tr>
<tr>
- <td>jeongyoon</td>
- <td style="text-align: center">Jeongyoon Eo</td>
- <td style="text-align: right">Seoul National University</td>
- </tr>
- <tr>
<td>gwkim</td>
<td style="text-align: center">Geon-Woo Kim</td>
<td style="text-align: right">Viva Republica, Seoul National University</td>
</tr>
<tr>
- <td>jooykim</td>
- <td style="text-align: center">Joo Yeon Kim</td>
- <td style="text-align: right">Samsung</td>
- </tr>
- <tr>
<td>gwlee</td>
<td style="text-align: center">Gyewon Lee</td>
<td style="text-align: right">Seoul National University</td>
</tr>
<tr>
- <td>jglee</td>
- <td style="text-align: center">Jung-Gil Lee</td>
- <td style="text-align: right">LG</td>
- </tr>
- <tr>
- <td>sanha</td>
- <td style="text-align: center">Sanha Lee</td>
- <td style="text-align: right">Seoul National University</td>
- </tr>
- <tr>
- <td>wylee</td>
- <td style="text-align: center">Wooyeon Lee</td>
- <td style="text-align: right">Seoul National University</td>
- </tr>
- <tr>
- <td>yunseong</td>
- <td style="text-align: center">Yunseong Lee</td>
+ <td>haeyoon</td>
+ <td style="text-align: center">Haeyoon Cho</td>
<td style="text-align: right">Seoul National University</td>
</tr>
<tr>
@@ -149,8 +124,28 @@
<td style="text-align: right">Seoul National University</td>
</tr>
<tr>
- <td>wonook</td>
- <td style="text-align: center">Won Wook SONG</td>
+ <td>jeongyoon</td>
+ <td style="text-align: center">Jeongyoon Eo</td>
+ <td style="text-align: right">Seoul National University</td>
+ </tr>
+ <tr>
+ <td>jglee</td>
+ <td style="text-align: center">Jung-Gil Lee</td>
+ <td style="text-align: right">LG</td>
+ </tr>
+ <tr>
+ <td>johnyangk</td>
+ <td style="text-align: center">Youngseok Yang</td>
+ <td style="text-align: right">Seoul National University</td>
+ </tr>
+ <tr>
+ <td>jooykim</td>
+ <td style="text-align: center">Joo Yeon Kim</td>
+ <td style="text-align: right">Samsung</td>
+ </tr>
+ <tr>
+ <td>sanha</td>
+ <td style="text-align: center">Sanha Lee</td>
<td style="text-align: right">Seoul National University</td>
</tr>
<tr>
@@ -159,10 +154,20 @@
<td style="text-align: right">Seoul National University</td>
</tr>
<tr>
- <td>johnyangk</td>
- <td style="text-align: center">Youngseok Yang</td>
+ <td>wonook</td>
+ <td style="text-align: center">Won Wook SONG</td>
<td style="text-align: right">Seoul National University</td>
</tr>
+ <tr>
+ <td>wylee</td>
+ <td style="text-align: center">Wooyeon Lee</td>
+ <td style="text-align: right">Samsung</td>
+ </tr>
+ <tr>
+ <td>yunseong</td>
+ <td style="text-align: center">Yunseong Lee</td>
+ <td style="text-align: right">Qualcomm AI Research</td>
+ </tr>
</tbody>
</table>
diff --git a/content/sitemap.xml b/content/sitemap.xml
index cf24d45..2345ac7 100644
--- a/content/sitemap.xml
+++ b/content/sitemap.xml
@@ -2,75 +2,75 @@
<urlset xmlns:xsi="http://www.w3.org/2001/XMLSchema-instance" xsi:schemaLocation="http://www.sitemaps.org/schemas/sitemap/0.9 http://www.sitemaps.org/schemas/sitemap/0.9/sitemap.xsd" xmlns="http://www.sitemaps.org/schemas/sitemap/0.9">
<url>
<loc>http://nemo.apache.org//docs/contribute/</loc>
-<lastmod>2020-03-07T16:14:00+09:00</lastmod>
+<lastmod>2020-03-07T16:26:06+09:00</lastmod>
</url>
<url>
<loc>http://nemo.apache.org//docs/compiler_design/</loc>
-<lastmod>2020-03-07T16:14:00+09:00</lastmod>
+<lastmod>2020-03-07T16:26:06+09:00</lastmod>
</url>
<url>
<loc>http://nemo.apache.org//docs/runtime_design/</loc>
-<lastmod>2020-03-07T16:14:00+09:00</lastmod>
+<lastmod>2020-03-07T16:26:06+09:00</lastmod>
</url>
<url>
<loc>http://nemo.apache.org//docs/getting_started/</loc>
-<lastmod>2020-03-07T16:14:00+09:00</lastmod>
+<lastmod>2020-03-07T16:26:06+09:00</lastmod>
</url>
<url>
<loc>http://nemo.apache.org//docs/home/</loc>
-<lastmod>2020-03-07T16:14:00+09:00</lastmod>
+<lastmod>2020-03-07T16:26:06+09:00</lastmod>
</url>
<url>
<loc>http://nemo.apache.org//docs/bootstrap/</loc>
-<lastmod>2020-03-07T16:14:00+09:00</lastmod>
+<lastmod>2020-03-07T16:26:06+09:00</lastmod>
</url>
<url>
<loc>http://nemo.apache.org//docs/cheatsheet/</loc>
-<lastmod>2020-03-07T16:14:00+09:00</lastmod>
+<lastmod>2020-03-07T16:26:06+09:00</lastmod>
</url>
<url>
<loc>http://nemo.apache.org//docs/jekyll/</loc>
-<lastmod>2020-03-07T16:14:00+09:00</lastmod>
+<lastmod>2020-03-07T16:26:06+09:00</lastmod>
</url>
<url>
<loc>http://nemo.apache.org//docs/font-awesome/</loc>
-<lastmod>2020-03-07T16:14:00+09:00</lastmod>
+<lastmod>2020-03-07T16:26:06+09:00</lastmod>
</url>
<url>
<loc>http://nemo.apache.org//docs/themes/</loc>
-<lastmod>2020-03-07T16:14:00+09:00</lastmod>
+<lastmod>2020-03-07T16:26:06+09:00</lastmod>
</url>
<url>
<loc>http://nemo.apache.org//docs/welcome_to_jekyll/</loc>
-<lastmod>2020-03-07T16:14:00+09:00</lastmod>
+<lastmod>2020-03-07T16:26:06+09:00</lastmod>
</url>
<url>
<loc>http://nemo.apache.org//docs/extending_nemo/</loc>
-<lastmod>2020-03-07T16:14:00+09:00</lastmod>
+<lastmod>2020-03-07T16:26:06+09:00</lastmod>
</url>
<url>
<loc>http://nemo.apache.org//docs/ir/</loc>
-<lastmod>2020-03-07T16:14:00+09:00</lastmod>
+<lastmod>2020-03-07T16:26:06+09:00</lastmod>
</url>
<url>
<loc>http://nemo.apache.org//docs/passes_and_policies/</loc>
-<lastmod>2020-03-07T16:14:00+09:00</lastmod>
+<lastmod>2020-03-07T16:26:06+09:00</lastmod>
</url>
<url>
<loc>http://nemo.apache.org//pages/downloads/</loc>
-<lastmod>2020-03-07T16:14:00+09:00</lastmod>
+<lastmod>2020-03-07T16:26:06+09:00</lastmod>
</url>
<url>
<loc>http://nemo.apache.org//pages/license/</loc>
-<lastmod>2020-03-07T16:14:00+09:00</lastmod>
+<lastmod>2020-03-07T16:26:06+09:00</lastmod>
</url>
<url>
<loc>http://nemo.apache.org//pages/talks/</loc>
-<lastmod>2020-03-07T16:14:00+09:00</lastmod>
+<lastmod>2020-03-07T16:26:06+09:00</lastmod>
</url>
<url>
<loc>http://nemo.apache.org//pages/team/</loc>
-<lastmod>2020-03-07T16:14:00+09:00</lastmod>
+<lastmod>2020-03-07T16:26:06+09:00</lastmod>
</url>
<url>
<loc>http://nemo.apache.org//blog/2018/03/20/nemo-blog-published/</loc>
