Page History

...

Pig on Tez

Cascading on Tez

TBD 

Enable logging for specific tasks in Tez

• "tez.task-specific.launch.cmd-opts.list" and "tez.task-specific.log.level" can be used to control log levels for specific tasks in the vertex of a DAG. Examples are given below
  
  • tez.task-specific.launch.cmd-opts.list="Map 1[0]" tez.task-specific.log.level="INFO;org.apache=DEBUG;"
    • Enable DEBUG log for "org.apache" for task-0 in Map 1.  Rest of the logs would be at INFO level

Profiling in Tez

It is possible profile specific tasks in specific vertices in Tez. "tez.task-specific.launch.cmd-opts.list" and "tez.task-specific.launch.cmd-opts" options can be used for this. Examples are given below.

...