class HadoopLayerReader extends FilteringLayerReader[LayerId]

Handles reading raster RDDs and their metadata from S3.

Linear Supertypes
FilteringLayerReader[LayerId], LayerReader[LayerId], AnyRef, Any
Ordering
  1. Alphabetic
  2. By Inheritance
Inherited
  1. HadoopLayerReader
  2. FilteringLayerReader
  3. LayerReader
  4. AnyRef
  5. Any
  1. Hide All
  2. Show All
Visibility
  1. Public
  2. All

Instance Constructors

  1. new HadoopLayerReader(attributeStore: AttributeStore)(implicit sc: SparkContext)

    attributeStore

    AttributeStore that contains metadata for corresponding LayerId

Value Members

  1. val attributeStore: AttributeStore
    Definition Classes
    HadoopLayerReader → LayerReader
  2. val defaultNumPartitions: Int
    Definition Classes
    HadoopLayerReader → LayerReader
  3. def query[K, V, M](layerId: LayerId, numPartitions: Int)(implicit arg0: AvroRecordCodec[K], arg1: Boundable[K], arg2: Decoder[K], arg3: ClassTag[K], arg4: AvroRecordCodec[V], arg5: ClassTag[V], arg6: Decoder[M], arg7: Component[M, Bounds[K]]): BoundLayerQuery[K, M, RDD[(K, V)] with Metadata[M]]
    Definition Classes
    FilteringLayerReader
  4. def query[K, V, M](layerId: LayerId)(implicit arg0: AvroRecordCodec[K], arg1: Boundable[K], arg2: Decoder[K], arg3: ClassTag[K], arg4: AvroRecordCodec[V], arg5: ClassTag[V], arg6: Decoder[M], arg7: Component[M, Bounds[K]]): BoundLayerQuery[K, M, RDD[(K, V)] with Metadata[M]]
    Definition Classes
    FilteringLayerReader
  5. def read[K, V, M](id: LayerId, tileQuery: LayerQuery[K, M], numPartitions: Int, indexFilterOnly: Boolean)(implicit arg0: AvroRecordCodec[K], arg1: Boundable[K], arg2: Decoder[K], arg3: ClassTag[K], arg4: AvroRecordCodec[V], arg5: ClassTag[V], arg6: Decoder[M], arg7: Component[M, Bounds[K]]): RDD[(K, V)] with Metadata[M]

    read

    read

    This function will read an RDD layer based on a query.

    K

    Type of RDD Key (ex: SpatialKey)

    V

    Type of RDD Value (ex: Tile or MultibandTile )

    M

    Type of Metadata associated with the RDD[(K,V)]

    id

    The ID of the layer to be read

    numPartitions

    The desired number of partitions in the resulting RDD.

    indexFilterOnly

    If true, the reader should only filter out elements who's KeyIndex entries do not match the indexes of the query key bounds. This can include keys that are not inside the query key bounds.

    Definition Classes
    HadoopLayerReader → FilteringLayerReader
  6. def read[K, V, M](id: LayerId, numPartitions: Int)(implicit arg0: AvroRecordCodec[K], arg1: Boundable[K], arg2: Decoder[K], arg3: ClassTag[K], arg4: AvroRecordCodec[V], arg5: ClassTag[V], arg6: Decoder[M], arg7: Component[M, Bounds[K]]): RDD[(K, V)] with Metadata[M]
    Definition Classes
    FilteringLayerReader → LayerReader
  7. def read[K, V, M](id: LayerId, rasterQuery: LayerQuery[K, M])(implicit arg0: AvroRecordCodec[K], arg1: Boundable[K], arg2: Decoder[K], arg3: ClassTag[K], arg4: AvroRecordCodec[V], arg5: ClassTag[V], arg6: Decoder[M], arg7: Component[M, Bounds[K]]): RDD[(K, V)] with Metadata[M]
    Definition Classes
    FilteringLayerReader
  8. def read[K, V, M](id: LayerId, rasterQuery: LayerQuery[K, M], numPartitions: Int)(implicit arg0: AvroRecordCodec[K], arg1: Boundable[K], arg2: Decoder[K], arg3: ClassTag[K], arg4: AvroRecordCodec[V], arg5: ClassTag[V], arg6: Decoder[M], arg7: Component[M, Bounds[K]]): RDD[(K, V)] with Metadata[M]
    Definition Classes
    FilteringLayerReader
  9. def read[K, V, M](id: LayerId)(implicit arg0: AvroRecordCodec[K], arg1: Boundable[K], arg2: Decoder[K], arg3: ClassTag[K], arg4: AvroRecordCodec[V], arg5: ClassTag[V], arg6: Decoder[M], arg7: Component[M, Bounds[K]]): RDD[(K, V)] with Metadata[M]
    Definition Classes
    LayerReader
  10. def reader[K, V, M](implicit arg0: AvroRecordCodec[K], arg1: Boundable[K], arg2: Decoder[K], arg3: ClassTag[K], arg4: AvroRecordCodec[V], arg5: ClassTag[V], arg6: Decoder[M], arg7: Component[M, Bounds[K]]): Reader[LayerId, RDD[(K, V)] with Metadata[M]]
    Definition Classes
    LayerReader