o

geotrellis.spark.store.hadoop

HadoopRDDWriter

object HadoopRDDWriter

Linear Supertypes
AnyRef, Any
Ordering
  1. Alphabetic
  2. By Inheritance
Inherited
  1. HadoopRDDWriter
  2. AnyRef
  3. Any
  1. Hide All
  2. Show All
Visibility
  1. Public
  2. All

Type Members

  1. class MultiMapWriter extends AnyRef

    When record being written would exceed the block size of the current MapFile opens a new file to continue writing.

    When record being written would exceed the block size of the current MapFile opens a new file to continue writing. This allows to split partition into block-sized chunks without foreknowledge of how big it is.

Value Members

  1. final val DefaultIndexInterval: Int(4)

    Index innterval at which map files should store an offset into sequence file.

    Index innterval at which map files should store an offset into sequence file. This value is picked as a compromize between in-memory footprint and IO cost of retreiving a single record.

  2. def write[K, V](rdd: RDD[(K, V)], path: Path, keyIndex: KeyIndex[K], indexInterval: Int = DefaultIndexInterval, existenceCheck: Boolean = true)(implicit arg0: AvroRecordCodec[K], arg1: ClassTag[K], arg2: AvroRecordCodec[V], arg3: ClassTag[V]): Unit