This Confluence has been LDAP enabled, if you are an ASF Committer, please use your LDAP Credentials to login. Any problems file an INFRA jira ticket please.

Page tree

Versions Compared

Key

  • This line was added.
  • This line was removed.
  • Formatting was changed.
Comment: Migrated to Confluence 5.3

...

  1. Make sure to grab the repo file:
    No Format
    wget -O /etc/yum.repos.d/bigtop.repo http://archive.apache.org/dist/bigtop/bigtop-0.5.0/repos/[centos5|centos6|fedora17]/bigtop.repo
    
  2. Browse through the artifacts
    No Format
    yum search mahout
    
  3. Install the full Hadoop stack (or parts of it)
    No Format
    sudo yum install hadoop\* flume\* mahout\* oozie\* whirr\* hbase\* hive\*
    

SLES 11, OpenSUSE

  1. Make sure to grab the repo file:
    No Format
    wget http://archive.apache.org/dist/bigtop/bigtop-0.5.0/repos/[sles11|opensuse12]/bigtop.repo
    #mv bigtop.repo  /etc/zypp/repos.d/bigtop.repo
    
  2. Refresh zypper to start looking at the newly added repo
    No Format
    #zypper refresh
    
  3. Browse through the artifacts
    No Format
    zypper search mahout
    
  4. Install the full Hadoop stack (or parts of it)
    No Format
    zypper install hadoop\* flume\* mahout\* oozie\* whirr\* hive\*
    

Ubuntu (64 bit, lucid, precise, quantal)

  1. Install the Apache Bigtop GPG key
    No Format
    wget -O- http://archive.apache.org/dist/bigtop/bigtop-0.5.0/repos/GPG-KEY-bigtop | sudo apt-key add -
    
  2. Make sure to grab the repo file:
    No Format
    sudo wget -O /etc/apt/sources.list.d/bigtop-0.5.0.list http://archive.apache.org/dist/bigtop/bigtop-0.5.0/repos/`lsb_release --codename --short`/bigtop.list
    
  3. Update the apt cache
    No Format
    sudo apt-get update
    
  4. Browse through the artifacts
    No Format
    apt-cache search mahout
    
  5. Install bigtop-utils
    No Format
    sudo apt-get install bigtop-utils
    
  6. Make sure that you have the latest JDK installed on your system as well. You can either get it from the official Oracle website (http://www.oracle.com/technetwork/java/javase/downloads/jdk-6u29-download-513648.html) or follow the advice given by your Linux distribution. If your JDK is installed in a non-standard location, make sure to add the line below to the /etc/default/bigtop-utils file
    No Format
    export JAVA_HOME=XXXX
    
  7. Install the full Hadoop stack (or parts of it)
    No Format
    sudo apt-get install hadoop\* flume-* mahout\* oozie\* whirr-* hive\*
    

Running Hadoop

After installing Hadoop packages onto your Linux box, make sure that:

...

One of the advantages of Bigtop is the ease of installation of the different Hadoop Components without having to hunt for a specific Hadoop Component distribution and matching it with a specific Hadoop version.
Please visit the link above to run some easy examples from the Bigtop distribution !
Provided at the link above are examples to run Hadoop 1.0.1 and nine other components from the Hadoop ecosystem (hive/hbase/zookeeper/pig/sqoop/oozie/mahout/whirr and flume).
See the

HTML
<a href="https://github.com/apache/bigtop/blob/master/bigtop.mk" target="_blank">Bigtop Make File</a>

...