commit | eecc263a18e4410a25c704c41951fbe7777ee6c1 | [log] [tgz] |
---|---|---|
author | Wes McKinney <wesm+git@apache.org> | Tue Feb 05 08:41:30 2019 -0600 |
committer | Uwe L. Korn <uwelk@xhochy.com> | Fri Feb 08 21:59:17 2019 +0100 |
tree | b9ae6c138c541a6260da3229e662abded3635a38 | |
parent | c4b2f5d794e3f57fe7cef12c5b89f49794efd7fe [diff] |
ARROW-4472: [Website][Python] Blog post about string memory use work in Arrow 0.12 This blog shows how we were able to significant improve performance and memory use in common cases when converting from the Arrow string memory layout to pandas's native memory model based on NumPy arrays of Python objects. Author: Wes McKinney <wesm+git@apache.org> Closes #3553 from wesm/python-string-memory-0.12 and squashes the following commits: f0d684d7f <Wes McKinney> Update publication date 2bbb92d42 <Wes McKinney> Fix some base urls c624e5545 <Wes McKinney> Draft blog post about string memory use work in Arrow 0.12
Site content is maintained in the main Arrow repository, mostly in markdown format. Jekyll is used to generate HTML files that can then be committed to the arrow-site repository.
With Ruby >= 2.1 installed, run the following commands to install Jekyll.
gem install jekyll bundler
bundle install
If you are planning to publish the website, you must clone the arrow-site git repository. Run this command from the site
directory so that asf-site
is a subdirectory of site
.
git clone --branch=asf-site https://github.com/apache/arrow-site.git asf-site
Also, from the site
directory, run the following command to import the format markdown documents so that they will rendered.
scripts/sync_format_docs.sh
From the site
directory, run the following to generate HTML files and run the web site locally.
bundle exec jekyll serve
After following the above instructions, run the following commands from the site
directory:
JEKYLL_ENV=production bundle exec jekyll build rsync -r build/ asf-site/ cd asf-site git status
Now git add
any new files, then commit everything, and push:
git push
To update the documentation, run the script ./dev/gen_apidocs.sh
. This script will run the code documentation tools in a fixed environment.
First, build Apache Arrow C++ and Apache Arrow GLib.
mkdir -p ../cpp/build cd ../cpp/build cmake .. -DCMAKE_BUILD_TYPE=debug make cd ../../c_glib ./autogen.sh ./configure \ --with-arrow-cpp-build-dir=$PWD/../cpp/build \ --with-arrow-cpp-build-type=debug \ --enable-gtk-doc LD_LIBRARY_PATH=$PWD/../cpp/build/debug make GTK_DOC_V_XREF=": " rsync -r doc/reference/html/ ../site/asf-site/docs/c_glib/
cd ../js npm run doc rsync -r doc/ ../site/asf-site/docs/js
Then add/commit/push from the site/asf-site git checkout.