Skip to content

A simple image that ships hadoop 2.x w/ dependencies supervisor for other hadoop related docker images

Notifications You must be signed in to change notification settings

andlaz/hadoop-base

Folders and files

NameName
Last commit message
Last commit date

Latest commit

 

History

17 Commits
 
 
 
 
 
 
 
 

Repository files navigation

Basic Hadoop image

Overview

Installs Hadoop and it's dependencies. Can run a number of hadoop client commands outlined below. Serves as a baseline to all the other hadoop/cassandra related images under the andlaz repo -- hadoop-cassandra, hadoop-hdfs-namenode, hadoop-yarn-resourcemanager

Usage

There is nothing in this image to help you configure or start any of the Hadoop deamons. Those you will find in

  • andlaz/hadoop-cassandra ( data node, node manager )
  • andlaz/hadoop-hdfs-namenode ( name node )
  • andlaz/hadoop-yarn-resourcemanager ( resource manager )

Nevertheless, you can ( and should ) use this image to run hdfs/yarn/mapred client commands.

Install Locations
  • /opt/hadoop-2.7.0
  • /usr/lib/jvm/java-1.8.0-openjdk-1.8.0.45-30.b13.el7_1.x86_64/

JAVA_HOME is set and the hadoop bin folder added to PATH

Client command example

n.b. in the example below resourcemanager is the host of the resource manager

docker run \
	-e "YARN_CLIENT_OPTS=-Dyarn.resourcemanager.hostname=resourcemanager" \
    -ti --rm \
    andlaz/hadoop-base \
    yarn node -list

About

A simple image that ships hadoop 2.x w/ dependencies supervisor for other hadoop related docker images

Resources

Stars

Watchers

Forks

Releases

No releases published

Packages

No packages published

Languages