ARROW-3070: [Packaging] Use Bintray
dev/release/03-binary.sh uploads binaries (.deb, .rpm, .whl and conda
.tar.bz2) to https://bintray.com/apache/arrow/ . It uses debian-rc,
ubuntu-rc, centos-rc and python-rc packages on Bintray.
dev/release/03-binary.sh signs and generates checksums binaries. This
ignores signs and checksums generated by crossbow. Because we need
some special signing. For example, .dsc and .changes should use inline
sign instead of separated sign file. debsign command does this. .rpm
should be signed by "rpm --addsign".
dev/release/03-binary.sh also generates metadata to install .deb and
.rpm files by apt and yum. See the changes for site/install.md how to
use https://bintray.com/apache/arrow/ as APT and Yum repository.
This means that this change includes work for
https://issues.apache.org/jira/browse/ARROW-1349 .
We can install not only RC binaries but also released binaries by apt
and yum. It will help us to verify binaries.
dev/release/post-02-binary.sh downloads verified binaries at
debian-rc, ubuntu-rc, centos-rc and python-rc packages on Bintray and
uploads them to debian, ubuntu, centos and python packages on Bintray.
APT and Yum repositories for RC and release are separated. So RC
doesn't affect users.
Release manager needs write access to https://bintray.com/apache/arrow .
Author: Kouhei Sutou <kou@clear-code.com>
Closes #2879 from kou/packaging-use-bintray and squashes the following commits:
575a2d20 <Kouhei Sutou> Fix license position
456ec8c7 <Kouhei Sutou> Add missing license header
8214abdc <Kouhei Sutou> Clean
395c873b <Kouhei Sutou> Ensure right permission
d8fc63be <Kouhei Sutou> Export only the target GPG key
4bfc6e08 <Kouhei Sutou> Use gpg-agent via SSH
3dc2d44e <Kouhei Sutou> Add support for changing Bintray repository
0cb8ccc9 <Kouhei Sutou> Fix typos
66ca3d11 <Kouhei Sutou> Fix upload path for Python binaries
5e094ed5 <Kouhei Sutou> Ensure updating APT repository
41b355c1 <Kouhei Sutou> Fix path
9965a063 <Kouhei Sutou> Uncomment
e49ca7cc <Kouhei Sutou> Stop to upload binaries to dist.apache.org
e71a7742 <Kouhei Sutou> Reduce API request
12e2239e <Kouhei Sutou> Fix function name
a9cb7b83 <Kouhei Sutou> Unify how to install
1fb9083b <Kouhei Sutou> Force to resign
d0b2b059 <Kouhei Sutou> Remove needless quotations
a7fd26ba <Kouhei Sutou> Fix a typo
d2d6c3b2 <Kouhei Sutou> Fix a typo
42d3836e <Kouhei Sutou> Sign
b3c11872 <Kouhei Sutou> Replace existing files
238ee605 <Kouhei Sutou> Update install document
65554a32 <Kouhei Sutou> Sign .dec and .changes
3c0bafc9 <Kouhei Sutou> Fix a typo
9e39341c <Kouhei Sutou> Support Python
c22ebbac <Kouhei Sutou> Support APT
18d7e112 <Kouhei Sutou> Use Bintray for binary artifacts
diff --git a/install.md b/install.md
index 39e69d4..d72323d 100644
--- a/install.md
+++ b/install.md
@@ -69,7 +69,7 @@
These include the Apache Arrow and Apache Parquet C++ binary libraries bundled
with the wheel.
-### C++ and GLib (C) Packages for Debian GNU/Linux, Ubuntu and CentOS (Unofficial)
+### C++ and GLib (C) Packages for Debian GNU/Linux, Ubuntu and CentOS
We have provided APT and Yum repositories for Apache Arrow C++ and
Apache Arrow GLib (C). Here are supported platforms:
@@ -81,50 +81,19 @@
* CentOS 6
* CentOS 7
-Debian GNU/Linux:
-
-```shell
-sudo apt install -y -V apt-transport-https
-sudo apt install -y -V lsb-release
-sudo wget -O /usr/share/keyrings/red-data-tools-keyring.gpg https://packages.red-data-tools.org/$(lsb_release --id --short | tr 'A-Z' 'a-z')/red-data-tools-keyring.gpg
-sudo tee /etc/apt/sources.list.d/red-data-tools.list <<APT_LINE
-deb [signed-by=/usr/share/keyrings/red-data-tools-keyring.gpg] https://packages.red-data-tools.org/$(lsb_release --id --short | tr 'A-Z' 'a-z')/ $(lsb_release --codename --short) main
-deb-src [signed-by=/usr/share/keyrings/red-data-tools-keyring.gpg] https://packages.red-data-tools.org/$(lsb_release --id --short | tr 'A-Z' 'a-z')/ $(lsb_release --codename --short) main
-APT_LINE
-sudo apt update
-sudo apt install -y -V libarrow-dev # For C++
-sudo apt install -y -V libarrow-glib-dev # For GLib (C)
-```
-
-Ubuntu:
-
-```shell
-sudo apt install -y -V apt-transport-https
-sudo apt install -y -V lsb-release
-sudo wget -O /usr/share/keyrings/red-data-tools-keyring.gpg https://packages.red-data-tools.org/$(lsb_release --id --short | tr 'A-Z' 'a-z')/red-data-tools-keyring.gpg
-sudo tee /etc/apt/sources.list.d/red-data-tools.list <<APT_LINE
-deb [signed-by=/usr/share/keyrings/red-data-tools-keyring.gpg] https://packages.red-data-tools.org/$(lsb_release --id --short | tr 'A-Z' 'a-z')/ $(lsb_release --codename --short) universe
-deb-src [signed-by=/usr/share/keyrings/red-data-tools-keyring.gpg] https://packages.red-data-tools.org/$(lsb_release --id --short | tr 'A-Z' 'a-z')/ $(lsb_release --codename --short) universe
-APT_LINE
-sudo apt update
-sudo apt install -y -V libarrow-dev # For C++
-sudo apt install -y -V libarrow-glib-dev # For GLib (C)
-```
-
-CentOS:
-
-```shell
-sudo yum install -y https://packages.red-data-tools.org/centos/red-data-tools-release-latest.noarch.rpm
-sudo yum install -y --enablerepo=epel arrow-devel # For C++
-sudo yum install -y --enablerepo=epel arrow-glib-devel # For GLib (C)
-```
-
-These repositories also provide Apache Parquet C++ and
-Apache Parquet GLib. You can install them by the followings:
-
Debian GNU/Linux and Ubuntu:
```shell
+sudo apt update
+sudo apt install -y -V apt-transport-https lsb-release
+sudo wget -O /usr/share/keyrings/apache-arrow-keyring.gpg https://dl.bintray.com/apache/arrow/$(lsb_release --id --short | tr 'A-Z' 'a-z')/apache-arrow-keyring.gpg
+sudo tee /etc/apt/sources.list.d/apache-arrow.list <<APT_LINE
+deb [arch=amd64 signed-by=/usr/share/keyrings/apache-arrow-keyring.gpg] https://dl.bintray.com/apache/arrow/$(lsb_release --id --short | tr 'A-Z' 'a-z')/ $(lsb_release --codename --short) main
+deb-src [signed-by=/usr/share/keyrings/apache-arrow-keyring.gpg] https://dl.bintray.com/apache/arrow/$(lsb_release --id --short | tr 'A-Z' 'a-z')/ $(lsb_release --codename --short) main
+APT_LINE
+sudo apt update
+sudo apt install -y -V libarrow-dev # For C++
+sudo apt install -y -V libarrow-glib-dev # For GLib (C)
sudo apt install -y -V libparquet-dev # For Apache Parquet C++
sudo apt install -y -V libparquet-glib-dev # For Parquet GLib (C)
```
@@ -132,21 +101,26 @@
CentOS:
```shell
+sudo tee /etc/yum.repos.d/Apache-Arrow.repo <<REPO
+[apache-arrow]
+name=Apache Arrow
+baseurl=https://dl.bintray.com/apache/arrow/centos/\$releasever/\$basearch/
+gpgcheck=1
+enabled=1
+gpgkey=https://dl.bintray.com/apache/arrow/centos/RPM-GPG-KEY-apache-arrow
+REPO
+sudo yum install -y epel-release
+sudo yum install -y --enablerepo=epel arrow-devel # For C++
+sudo yum install -y --enablerepo=epel arrow-glib-devel # For GLib (C)
sudo yum install -y --enablerepo=epel parquet-devel # For Apache Parquet C++
sudo yum install -y --enablerepo=epel parquet-glib-devel # For Parquet GLib (C)
```
-These repositories are managed at
-[red-data-tools/packages.red-data-tools.org][9]. If you have any
-feedback, please send it to the project instead of Apache Arrow
-project.
-
[1]: {{site.data.versions['current'].mirrors}}
[2]: {{site.data.versions['current'].github-tag-link}}
[4]: {{site.data.versions['current'].java-artifacts}}
[5]: http://conda-forge.github.io
[6]: {{site.data.versions['current'].mirrors-tar}}
-[9]: https://github.com/red-data-tools/packages.red-data-tools.org
[10]: {{site.data.versions['current'].release-notes}}
[11]: http://www.apache.org/dist/arrow/KEYS
[12]: https://www.apache.org/dyn/closer.cgi#verify
