Versions Compared

Key

  • This line was added.
  • This line was removed.
  • Formatting was changed.
Comment: Migrated to Confluence 5.3

...

WARNING 3: BigTop involves installing several Hadoop-related services on your machine that are enabled by default (i.e., started upon system reboot). If you would rather have the services start only when you specifically activate them, check your OS-specific documentation for disabling specific services at startup, for example see here, here and here for Ubuntusome options.

NOTE 1: We support Fedora 16 and tested Bigtop 0.5.0 on it; however, we haven't released any binary artifacts for it.

...

  1. Make sure to grab the repo file:
    No Format
    wget -O /etc/yum.repos.d/bigtop.repo http://archive.apache.org/dist/bigtop/bigtop-0.5.0/repos/[centos5|centos6|fedora17]/bigtop.repo
    
  2. Browse through the artifacts
    No Format
    yum search mahout
    
  3. Install the full Hadoop stack (or parts of it)
    No Format
    sudo yum install hadoop\* flume\* mahout\* oozie\* whirr\* hbase\* hive\*
    

SLES 11, OpenSUSE

  1. Make sure to grab the repo file:
    No Format
    wget http://archive.apache.org/dist/bigtop/bigtop-0.5.0/repos/[sles11|opensuse12]/bigtop.repo
    sudo mv#mv bigtop.repo  /etc/zypp/repos.d/bigtop.repo
    
  2. Refresh zypper to start looking at the newly added repo
    No Format
    sudo zypper#zypper refresh
    
  3. Browse through the artifacts
    No Format
    zypper search mahout
    
  4. Install the full Hadoop stack (or parts of it)
    No Format
    sudo zypper install hadoop\* flume\* mahout\* oozie\* whirr\* hive\*
    

Ubuntu (64 bit, lucid, precise, quantal)

  1. Install the Apache Bigtop GPG key
    No Format
    wget -O- http://archive.apache.org/dist/bigtop/bigtop-0.5.0/repos/GPG-KEY-bigtop | sudo apt-key add -
    
  2. Make sure to grab the repo file:
    No Format
    sudo wget -O /etc/apt/sources.list.d/bigtop-0.5.0.list http://archive.apache.org/dist/bigtop/bigtop-0.5.0/repos/`lsb_release --codename --short`/bigtop.list
    
  3. Update the apt cache
    No Format
    sudo apt-get update
    
  4. Browse through the artifacts
    No Format
    apt-cache search mahout
    
  5. Install bigtop-utils
    No Format
    sudo apt-get install bigtop-utils
    
  6. Make sure that you have the latest JDK installed on your system as well. You can either get it from the official Oracle website (http://www.oracle.com/technetwork/java/javase/downloads/jdk-6u29-download-513648.html) or follow the advice given by your Linux distribution. If your JDK is installed in a non-standard location, make sure to add the line below to the /etc/default/bigtop-utils file
    No Format
    export JAVA_HOME=XXXX
    
  7. Install the full Hadoop stack (or parts of it)
    No Format
    sudo apt-get install hadoop\* flume-* mahout\* oozie\* whirr-* hive\*
    

Running Hadoop

After installing Hadoop packages onto your Linux box, make sure that:

...

One of the advantages of Bigtop is the ease of installation of the different Hadoop Components without having to hunt for a specific Hadoop Component distribution and matching it with a specific Hadoop version.
Please visit the link above to run some easy examples from the Bigtop distribution !
Provided at the link above are examples to run Hadoop 1.0.1 and nine other components from the Hadoop ecosystem (hive/hbase/zookeeper/pig/sqoop/oozie/mahout/whirr and flume).
See the

HTML
<a href="https://github.com/apache/bigtop/blob/master/bigtop.mk" target="_blank">Bigtop Make File</a>

...