Page History

...

• Spark Resilient Distributed Datasets (RDD) is a fundamental data structure of Spark. It is an immutable distributed collection of objects. Each dataset in RDD is divided into logical partitions, which may be computed on different nodes of the cluster.
• The features of RDDs (decomposing the name):

              Resilient, i.e. fault-tolerant with the help of RDD lineage graph and so able to recompute missing or damaged partitions due to node failures. 

              Distributed with data residing on multiple nodes in a cluster.

                - Dataset is a collection of partitioned data with primitive values or values of values, e.g. tuples or other objects (that represent records of the data you work with).

Image Modified

  Figure 4: Sequence Diagram  (Spark 1.6.2)

...