commit | f830cead4578de2a0e54d39e0ec56d00f7b03549 | [log] [tgz] |
---|---|---|
author | Javier Luraschi <javierluraschi@hotmail.com> | Fri Jan 25 07:11:20 2019 -0600 |
committer | Wes McKinney <wesm+git@apache.org> | Fri Jan 25 07:15:53 2019 -0600 |
tree | 8bc7fd2f8c665a006acc19f1232aeed1f85f1311 | |
parent | b05ea90d232c82a2925c631c096df41680d58440 [diff] |
ARROW-4262: [Website] Preview to Spark with Arrow and R improvements Here is a draft for a blogpost to preview the improvements and work happening in Spark and R. Author: Javier Luraschi <javierluraschi@hotmail.com> Author: Wes McKinney <wesm+git@apache.org> Closes #3001 from javierluraschi/post/spark-r-arrow-preview and squashes the following commits: 36e1bcba8 <Javier Luraschi> proper capitalization for sparkr project 966ecf62e <Javier Luraschi> add reference to ongoing sparkr work f3c3e99b4 <Javier Luraschi> use more accurate multipliers describing improements fae7e0146 <Javier Luraschi> add github references to arrow 0.12 release aa6aec7ff <Javier Luraschi> update blog post with arrow 0.12 and 10m rows 23dc2281e <Wes McKinney> Fix some typos 9b5a3d0d9 <Javier Luraschi> add reference to specific sparklyr branch 7f298ff2d <Javier Luraschi> increment benchmark iterations to 100 259cbb519 <Javier Luraschi> explain sparklyr implementation, plots and stats c2058a890 <Javier Luraschi> Preview to Spark with Arrow and R improvements
If you are planning to publish the website, you must first clone the arrow-site git repository:
git clone --branch=asf-site https://github.com/apache/arrow-site.git asf-site
Now, with Ruby >= 2.1 installed, run:
gem install jekyll bundler bundle install # This imports the format Markdown documents so they will be rendered scripts/sync_format_docs.sh bundle exec jekyll serve
After following the above instructions the base site/
directory, run:
JEKYLL_ENV=production bundle exec jekyll build rsync -r build/ asf-site/ cd asf-site git status
Now git add
any new files, then commit everything, and push:
git push
To update the documentation, run the script ./dev/gen_apidocs.sh
. This script will run the code documentation tools in a fixed environment.
First, build Apache Arrow C++ and Apache Arrow GLib.
mkdir -p ../cpp/build cd ../cpp/build cmake .. -DCMAKE_BUILD_TYPE=debug make cd ../../c_glib ./autogen.sh ./configure \ --with-arrow-cpp-build-dir=$PWD/../cpp/build \ --with-arrow-cpp-build-type=debug \ --enable-gtk-doc LD_LIBRARY_PATH=$PWD/../cpp/build/debug make GTK_DOC_V_XREF=": " rsync -r doc/reference/html/ ../site/asf-site/docs/c_glib/
cd ../js npm run doc rsync -r doc/ ../site/asf-site/docs/js
Then add/commit/push from the site/asf-site git checkout.