Quick Intro slide

Here's a slide to quickly go through the idea of the BigTop VM and Docker provisioner.

Getting Started

Clone the BigTop source code

$ git clone https://github.com/apache/bigtop.git

To create a VM based BigTop Hadoop cluster:

$ cd bigtop/bigtop-deploy/vm/vagrant-puppet-vm

$ vim vagrantconfig.yaml  

# Update the repo to be:

Note: Bigtop S3 repos is currently out of available, we're working on the fix. Please use the packages on our CI server instead.

CentOS 6: "http://ci.bigtop.apache.org:8080/view/Releases/job/Bigtop-1.0.0-rpm/BUILD_ENVIRONMENTS=centos-6%2clabel=docker-slave-06/lastSuccessfulBuild/artifact/output/"

Debian 8: "http://ci.bigtop.apache.org:8080/view/Releases/job/Bigtop-1.0.0-deb/BUILD_ENVIRONMENTS=debian-8%2clabel=docker-slave-07/lastSuccessfulBuild/artifact/output/apt/"

And update the component you'd like to deploy, for example: 

components: [hadoop, yarn, ignite-hadoop] (effective values)

$ vagrant up

DONE!

To create a Docker based  BigTop Hadoop cluster:

$ cd bigtop/bigtop-deploy/vm/vagrant-puppet-docker

$ vim vagrantconfig.yaml  

# Update the repo to be:

Note: Bigtop S3 repos is currently out of available, we're working on the fix. Please use the packages on our CI server instead.

CentOS 6: "http://ci.bigtop.apache.org:8080/view/Releases/job/Bigtop-1.0.0-rpm/BUILD_ENVIRONMENTS=centos-6%2clabel=docker-slave-06/lastSuccessfulBuild/artifact/output/"

Debian 8: "http://ci.bigtop.apache.org:8080/view/Releases/job/Bigtop-1.0.0-deb/BUILD_ENVIRONMENTS=debian-8%2clabel=docker-slave-07/lastSuccessfulBuild/artifact/output/apt/"

And update the component you'd like to deploy, for example: 

components: [hadoop, yarn, ignite-hadoop] (effective values)

$ ./docker-hadoop.sh --build-image --create 3

DONE!

Destroy clusters:

destroy VM cluster:

$ vagrant destroy -f

destroy Docker cluster:

$ ./docker-hadoop.sh --destroy