This page describes how to use Riak-CS for deep storage instead of S3. We are still setting up some of the peripheral stuff (file downloads, etc.).
This guide provided by Pablo Nebrera, thanks!
A VMWare image based on Druid 0.3.27.2 and built according to the instructions below has also been provided by Pablo Nebrera.
The provided vmware machine has access with the following credentials:
username: root password: riakdruid
We started with a minimal CentOS installation but you can use any other compatible installation. At the end of this setup you will one node that is running:
This just walks through getting the relevant software installed and running. You will then need to configure the Realtime node to take in your data.
Install CentOS-6.4-x86_64-minimal.iso (“RedHat v6.4” is the name of the AWS AMI) or your favorite Linux OS (if you use a different OS, some of the installation instructions for peripheral services might differ, please adjust them according to the system you are using). The rest of these instructions assume that you have a running instance and are running as the root user.
Configure the network. We used dhcp executing:
dhclient eth0
Disable firewall for now
service iptables stop chkconfig iptables off
Change the limits on the number of open files a process can have:
cat >> /etc/security/limits.conf <<- _RBEOF_ # ulimit settings for Riak CS root soft nofile 65536 root hard nofile 65536 riak soft nofile 65536 riak hard nofile 65536 _RBEOF_ ulimit -n 65536
Install necessary software with yum
yum install -y java-1.7.0-openjdk-devel git wget mysql-server
Install maven
wget http://apache.rediris.es/maven/maven-3/3.0.5/binaries/apache-maven-3.0.5-bin.tar.gz
tar xzf apache-maven-3.0.5-bin.tar.gz -C /usr/local
pushd /usr/local
sudo ln -s apache-maven-3.0.5 maven
popd
echo 'export M2_HOME=/usr/local/maven' >> /etc/profile.d/maven.sh
echo 'export PATH=${M2_HOME}/bin:${PATH}' >> /etc/profile.d/maven.sh
source /etc/profile.d/maven.sh
Install erlang
wget http://binaries.erlang-solutions.com/rpm/centos/6/x86_64/esl-erlang-R15B01-1.x86_64.rpm yum localinstall -y esl-erlang-R15B01-1.x86_64.rpm
Install kafka and zookeeper:
wget http://apache.rediris.es/incubator/kafka/kafka-0.7.2-incubating/kafka-0.7.2-incubating-src.tgz tar zxvf kafka-0.7.2-incubating-src.tgz pushd kafka-0.7.2-incubating-src/ ./sbt update ./sbt package mkdir -p /var/lib/kafka rsync -a * /var/lib/kafka/ popd
Install s3cmd to manage riak s3
wget http://downloads.sourceforge.net/project/s3tools/s3cmd/1.5.0-alpha3/s3cmd-1.5.0-alpha3.tar.gz tar xzvf s3cmd-1.5.0-alpha3.tar.gz cd s3cmd-1.5.0-alpha3 cp -r s3cmd S3 /usr/local/bin/
Install riak, riak-cs and stanchion. Note: riak-cs-control is optional
wget http://s3.amazonaws.com/downloads.basho.com/riak/1.3/1.3.1/rhel/6/riak-1.3.1-1.el6.x86_64.rpm wget http://s3.amazonaws.com/downloads.basho.com/riak-cs/1.3/1.3.1/rhel/6/riak-cs-1.3.1-1.el6.x86_64.rpm wget http://s3.amazonaws.com/downloads.basho.com/stanchion/1.3/1.3.1/rhel/6/stanchion-1.3.1-1.el6.x86_64.rpm wget http://s3.amazonaws.com/downloads.basho.com/riak-cs-control/1.0/1.0.0/rhel/6/riak-cs-control-1.0.0-1.el6.x86_64.rpm yum localinstall -y riak-*.rpm stanchion-*.rpm
Clone the git repository for druid, checkout a “stable” tag and build
git clone https://github.com/metamx/druid.git druid pushd druid git checkout druid-0.4.12 export LANGUAGE=C export LC_MESSAGE=C export LC_ALL=C export LANG=en_US ./build.sh mkdir -p /var/lib/druid/app cp ./services/target/druid-services-*-selfcontained.jar /var/lib/druid/app ln -s /var/lib/druid/app/druid-services-*-selfcontained.jar /var/lib/druid/app/druid-services.jar popd
Add this line to /etc/hosts
echo "127.0.0.1 s3.amazonaws.com bucket.s3.amazonaws.com `hostname`" >> /etc/hosts
NOTE: the bucket name in this case is “bucket”, but you might need to update it to your bucket name if you want to use a different bucket name.
Download and extract run scripts and configuration files:
wget http://static.druid.io/artifacts/scripts/druid_scripts_nebrera.tar / pushd / tar xvf ~/druid_scripts_nebrera.tar popd
Start Riak in order to create a user:
/etc/init.d/riak start /etc/init.d/riak-cs start /etc/init.d/stanchion start
You can check riak status using:
riak-admin member-status
You should expect results like
Attempting to restart script through sudo -H -u riak ================================= Membership ================================== Status Ring Pending Node ------------------------------------------------------------------------------- valid 100.0% -- 'riak@127.0.0.1' ------------------------------------------------------------------------------- Valid:1 / Leaving:0 / Exiting:0 / Joining:0 / Down:0
Create riak-cs user and yoink out credentials.
curl -H 'Content-Type: application/json' -X POST http://127.0.0.1:8088/riak-cs/user --data '{"email":"example@domain.com", "name":"admin"}' >> /tmp/riak_user.json
export RIAK_KEY_ID=`sed 's/^.*"key_id":"//' /tmp/riak_user.json | cut -d '"' -f 1`
export RIAK_KEY_SECRET=`sed 's/^.*"key_secret":"//' /tmp/riak_user.json | cut -d '"' -f 1`
sed -i "s/<%=[ ]*@key_id[ ]*%>/${RIAK_KEY_ID}/" /etc/riak-cs/app.config /etc/riak-cs-control/app.config /etc/stanchion/app.config /etc/druid/config.sh /etc/druid/base.properties /root/.s3cfg
sed -i "s/<%=[ ]*@key_secret[ ]*%>/${RIAK_KEY_SECRET}/" /etc/riak-cs/app.config /etc/riak-cs-control/app.config /etc/stanchion/app.config /etc/druid/config.sh /etc/druid/base.properties /root/.s3cfg
This will store the result of creating the user into /tmp/riak_user.json. You can look at it if you are interested. It will look something like this
{"email":"example@domain.com",
"display_name":"example",
"name":"admin",
"key_id":"DOXKZYR_QM2S-7HSKAEU",
"key_secret":"GtvVJow068RM-_viHIYR9DWMAXsFcL1SmjuNfA==",
"id":"4c5b5468c180f3efafd531b6cd8e2bb24371d99640aad5ced5fbbc0604fc473d",
"status":"enabled"}
Stop riak-cs:
/etc/init.d/riak-cs stop /etc/init.d/stanchion stop /etc/init.d/riak stop
Disable anonymous user creation
sed 's/{[ ]*anonymous_user_creation[ ]*,[ ]*true[ ]*}/{anonymous_user_creation, false}/' /etc/riak-cs/app.config |grep anonymous_user_creation
Restart riak-cs services:
/etc/init.d/riak start /etc/init.d/riak-cs start /etc/init.d/stanchion start
Create your bucket. The example name and in config files is “bucket”
s3cmd mb s3://bucket
You can verify that the bucket is created with:
s3cmd ls
Start MySQL server
service mysqld start chkconfig mysqld on /usr/bin/mysqladmin -u root password 'riakdruid'
NOTE: If you don't like “riakdruid” as your password, feel free to change it around. NOTE: If you have used root user to connect to database. It should be changed by other user but I have used this one to simplify it
Start zookeeper and kafka
/etc/init.d/zookeeper start /etc/init.d/kafka start
Start druid
/etc/init.d/druid_master start /etc/init.d/druid_realtime start /etc/init.d/druid_broker start /etc/init.d/druid_compute start