Licensed to the Apache Software Foundation (ASF) under one or more contributor license agreements. See the NOTICE file distributed with this work for additional information regarding copyright ownership. The ASF licenses this file to You under the Apache License, Version 2.0 (the "License"); you may not use this file except in compliance with the License. You may obtain a copy of the License at http://www.apache.org/licenses/LICENSE-2.0 Unless required by applicable law or agreed to in writing, software distributed under the License is distributed on an "AS IS" BASIS, WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied. See the License for the specific language governing permissions and limitations under the License.
The Vagrantfile definition creates a bigtop virtual hadoop cluster for you, by pulling from existing publishing bigtop repositories. This cluster can be used:
Eventually, we may also add ability to build AND provision bigtop in a vagrant recipe, which would essentially give full validation of the BigTop stack.
Install Vagrant(DO NOT install 1.8.5 because of a critical bug)
Install vagrant-hostmanager plugin to manage /etc/hosts
vagrant plugin install vagrant-hostmanager
vagrant plugin install vagrant-cachier
vagrant up
num_instances
in vagrantconfig.yamlnum_instances: 5
first, build up local yum repo
cd bigtop; ./gradlew alluxio-yum
and then enable local yum in vagrantconfig.yaml
enable_local_repo: true
finally, spin up the cluster
vagrant up
You can override vagrant configurations from environment variables:
$ export REPO=http://repo.example.com/path/to $ vagrant up
or
$ MEMORY_SIZE=8000 vagrant up
components: "hadoop, hbase, yarn,..."
By default, Apache Hadoop and YARN will be installed. See bigtop-deploy/puppet/hieradata/site.yaml
for more details.
Vagrant is a useful tool for times when you would like to capture the state of the VM and publish it as a sandbox for others to use. We provide a wrapper script for this that works with VirtualBox. Here's how to run it:
./create-sandboxes.sh [temp work dir] [version]
If you don't specify the temp work dir the current directory is going to be used, the version by default is 1.0.
Once the script is done running you will have vagrant-bigtop-v.box and vagrant-bigtop-v.ova VM images available to you under the temp work dir.