Versions Compared

Old Version 15

changes.mady.by.user Josh Rosen

Saved on

compared with

New Version Current

changes.mady.by.user Sean Owen

Saved on

Key

  • This line was added.
  • This line was removed.
  • Formatting was changed.

NOTE: This Wiki is obsolete as of November 2016 and is retained for reference only.


Overview

PySpark is built on top of Spark's Java API. Data is processed in Python and cached / shuffled in the JVM:

...