Licensed to the Apache Software Foundation (ASF) under one or more contributor license agreements. See the NOTICE file distributed with this work for additional information regarding copyright ownership. The ASF licenses this file to You under the Apache License, Version 2.0 (the “License”); you may not use this file except in compliance with the License. You may obtain a copy of the License at
http://www.apache.org/licenses/LICENSE-2.0
Unless required by applicable law or agreed to in writing, software distributed under the License is distributed on an “AS IS” BASIS, WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied. See the License for the specific language governing permissions and limitations under the License.
A tool to build and run big data pseudo cluster using Docker.
Make sure you have Docker installed. We've tested this using Docker for Mac
Currently supported OS list:
docker run -d -p 50070:50070 bigtop/sandbox:centos-6_hdfs
docker run -d -p 50070:50070 -p 8088:8088 -p 8080:8080 bigtop/sandbox:debian-8_hdfs_yarn_spark
docker run -d -p 50070:50070 -p 60010:60010 bigtop/sandbox:ubuntu-16.04_hdfs_hbase
./build.sh -a bigtop -o centos-6 -c hdfs
./build.sh -a bigtop -o debian-8 -c "hdfs, yarn, spark"
./build.sh -a bigtop -o ubuntu-16.04 -c "hdfs, hbase"
./build.sh -a bigtop -o ubuntu-16.04 -c "hdfs, hbase" --dryrun
export REPO=http://ci.bigtop.apache.org:8080/job/Bigtop-trunk-repos/BUILD_ENVIRONMENTS=centos-6%2Clabel=docker-slave-06//ws/output ./build.sh -a bigtop -o centos-6 -c "hdfs, yarn, spark, ignite"
cp site.yaml.template.centos-6_hadoop site.yaml.template.centos-6_hadoop_ignite vim site.yaml.template.centos-6_hadoop_ignite
... hadoop_cluster_node::cluster_components: [hdfs, yarn, ignite] ...
./build.sh -a bigtop -o centos-6 -f site.yaml.template.centos-6_hadoop_ignite -t my_ignite_stack
Since systemd requires CAP_SYS_ADMIN, currently any OS using systemd can not successfully started up daemons during image build time.
Daemons can be brought up only if --privileged specified using docker run command.