Versions Compared

Old Version 11

changes.mady.by.user Ilya Kasnacheev

Saved on

compared with

New Version Current

changes.mady.by.user Ilya Kasnacheev

Saved on

Key

  • This line was added.
  • This line was removed.
  • Formatting was changed.
Comment: Remove redundant and obsolete docs in favor of readme.io link.

...

For

...

Ignite YARN Application

...

Apache Ignite

...

  • Client downloads ignte distributive, puts necessary resources to HDFS, creates the necessary context for launching the task, launches the ApplicationMaster process.
  • Application master.  Once registration is successful the component will begin requesting of resource from Resource Manager to utilize resources for Apache Ignite nodes. The Application Master will maintain the Ignite cluster at desired total resources level (CPU, memory, etc).
  • Container - the entity that runs Ignite Node on slaves.

Running Ignite YARN application

For running Ignite Application requires YARN and Hadoop cluster are configured and running. For information on how to set up a the cluster please refer to http://hadoop.apache.org/docs/current/hadoop-project-dist/hadoop-common/ClusterSetup.html

...

hadoop java jar ignite-yarn.jar ./ignite-yarn.jar

or

hadoop java jar ignite-yarn.jar ./ignite-yarn.jar properties.prop

where properties.prop is a property file. Example property file:

Code Block
languagetext
# The number of nodes in the cluster.
IGNITE_NODE_COUNT=2

# The number of CPU Cores for each Apache Ignite node.
IGNITE_RUN_CPU_PER_NODE=1

# The number of Megabytes of RAM for each Apache Ignite node.
IGNITE_MEMORY_PER_NODE=2048

# The version ignite which will be run on nodes.
IGNITE_VERSION=1.0.6

...

Configuration

All configuration is handled through environment variables or property file. Following configuration parameters can be optionally configured.

NameDescriptionDefaultExample

IGNITE_RUN_CPU_PER_NODE

The number of CPU Cores for each Apache Ignite node.

2

4

IGNITE_MEMORY_PER_NODE

The number of Megabytes of RAM for each Apache Ignite node.

2048

1024

IGNITE_NODE_COUNT

The number of nodes in the cluster.

3

10

IGNITE_VERSION

The version ignite which will be run on nodes.

latest

1.0.5

IGNITE_WORKING_DIR

The directory which will be used for saving Apache Ignite distributives.

./ignite-release

/opt/ignite/

IGNITE_RELEASES_DIRThe hdfs directory which will be used for saving Apache Ignite distributives./ignite/releases//ignite-rel/ 

IGNITE_XML_CONFIG

The hdfs path to Apache Ignite config file.

N/A

/opt/ignite/ignite-config.xml

IGNITE_USERS_LIBS

The hdfs path to libs which will be added to classpath.

N/A

/opt/libs/

IGNITE_HOSTNAME_CONSTRAINTThe constraint on slave hosts.N/A192.168.0.[1-100]

YARN documentation please refer to Readme.io Apache Ignite docs.