Versions Compared

Key

  • This line was added.
  • This line was removed.
  • Formatting was changed.
Comment: Migration of unmigrated content due to installation of a new plugin

...

  1. Download Yourkit tar on each node of your cluster (since you don't know where AM will be launched) and extract files. 
  2. Add following property in tez-site.xml:
Code Block
xml
xml
Wiki Markup
{code:xml}
<property>
	<name>tez.am.launch.cmd-opts</name>
	<value>-agentpath:<absolute path of libyjpagent.so>=<yourkit options></value>
</property>
{code}

libyjpagent.so can be found in <Yourkit-dir>/bin/<architecture>/libyjpagent.so. 

Yourkit options can be found by running

Code Block
bash
bash
java -agentpath:<path of libyjpagent.so>=help <some-java-class>

 

If you are capturing snapshot of DAGAppMaster, snapshot files can be found under your home dir in 'Snapshot' dir. If you submit YARN job as user yarn, you need go to /home/yarn/Snapshots.

 

Profiling task containers is similar to profiling DAGAppMaster, the only difference is you should use property 'tez.task.launch.cmd-opts' (for all tasks) or 'tez.task-specific.launch.cmd-opts' (for specific task) in tez-site.xml.