class IndexPartitioner[K] extends Partitioner

Uses KeyIndex to partition an RDD in memory, giving its records some spatial locality. When persisting an RDD partitioned by this partitioner we can safely assume that all records contributing to the same SFC index will reside in one partition.

Linear Supertypes
Partitioner, Serializable, Serializable, AnyRef, Any
Ordering
  1. Alphabetic
  2. By Inheritance
Inherited
  1. IndexPartitioner
  2. Partitioner
  3. Serializable
  4. Serializable
  5. AnyRef
  6. Any
  1. Hide All
  2. Show All
Visibility
  1. Public
  2. All

Instance Constructors

  1. new IndexPartitioner(index: KeyIndex[K], count: Int)

Value Members

  1. val breaks: Array[BigInt]
  2. def getPartition(key: Any): Int

    Because breaks define divisions rather than breaks, all indexable keys will have a bucket.

    Because breaks define divisions rather than breaks, all indexable keys will have a bucket. Keys that are far out of bounds will be assigned to either first or last partition.

    Definition Classes
    IndexPartitioner → Partitioner
  3. def numPartitions: Int
    Definition Classes
    IndexPartitioner → Partitioner