This Confluence has been LDAP enabled, if you are an ASF Committer, please use your LDAP Credentials to login. Any problems file an INFRA jira ticket please.

Versions Compared


  • This line was added.
  • This line was removed.
  • Formatting was changed.
Comment: Migrated to Confluence 5.3

This section contains documentation on Spark's internals:

Children Display

Spark's Cluster Mode Overview documentation has good descriptions of the various components involved in task scheduling and execution.

The Intro to Spark Internals Meetup talk (Video, PPT slides) is also a good introduction to the internals (the talk is from December 2012, so a few details might have changed since then, but the basics should be the same).