Versions Compared

Key

  • This line was added.
  • This line was removed.
  • Formatting was changed.
Comment: Add info about logging on Hadoop cluster / distributed mode

...

Info
titleLegacy logging

Prior to Nutch version 1.19, Nutch logging was configured via conf/log4j.properties this . This changed in Nutch 1.19, see below.


Info
titleLogging on Hadoop

When running Nutch on a Hadoop cluster (aka. distributed mode), the logging configuration of the Hadoop cluster is used. The configuration is usually found in /etc/hadoop/conf/. . see belowSee Hadoop Cluster Setup, Logging.

As of version 1.19 Nutch uses conf/log4j2.xml for logging configuration. By default, Nutch will log to log to $NUTCH_HOME/logs/hadoop.log

...