class S3LayerReader extends FilteringLayerReader[LayerId]

Handles reading raster RDDs and their metadata from S3.

Linear Supertypes
FilteringLayerReader[LayerId], LayerReader[LayerId], AnyRef, Any
Ordering
  1. Alphabetic
  2. By Inheritance
Inherited
  1. S3LayerReader
  2. FilteringLayerReader
  3. LayerReader
  4. AnyRef
  5. Any
  1. Hide All
  2. Show All
Visibility
  1. Public
  2. All

Instance Constructors

  1. new S3LayerReader(attributeStore: AttributeStore, s3Client: ⇒ S3Client = S3ClientProducer.get(), runtime: ⇒ IORuntime = IORuntimeTransient.IORuntime)(implicit sc: SparkContext)

    attributeStore

    AttributeStore that contains metadata for corresponding LayerId

Value Members

  1. val attributeStore: AttributeStore
    Definition Classes
    S3LayerReader → LayerReader
  2. val defaultNumPartitions: Int
    Definition Classes
    S3LayerReader → LayerReader
  3. def query[K, V, M](layerId: LayerId, numPartitions: Int)(implicit arg0: AvroRecordCodec[K], arg1: Boundable[K], arg2: Decoder[K], arg3: ClassTag[K], arg4: AvroRecordCodec[V], arg5: ClassTag[V], arg6: Decoder[M], arg7: Component[M, Bounds[K]]): BoundLayerQuery[K, M, RDD[(K, V)] with Metadata[M]]
    Definition Classes
    FilteringLayerReader
  4. def query[K, V, M](layerId: LayerId)(implicit arg0: AvroRecordCodec[K], arg1: Boundable[K], arg2: Decoder[K], arg3: ClassTag[K], arg4: AvroRecordCodec[V], arg5: ClassTag[V], arg6: Decoder[M], arg7: Component[M, Bounds[K]]): BoundLayerQuery[K, M, RDD[(K, V)] with Metadata[M]]
    Definition Classes
    FilteringLayerReader
  5. def rddReader: S3RDDReader
  6. def read[K, V, M](id: LayerId, tileQuery: LayerQuery[K, M], numPartitions: Int, filterIndexOnly: Boolean)(implicit arg0: AvroRecordCodec[K], arg1: Boundable[K], arg2: Decoder[K], arg3: ClassTag[K], arg4: AvroRecordCodec[V], arg5: ClassTag[V], arg6: Decoder[M], arg7: Component[M, Bounds[K]]): ContextRDD[K, V, M]

    read

    read

    This function will read an RDD layer based on a query.

    K

    Type of RDD Key (ex: SpatialKey)

    V

    Type of RDD Value (ex: Tile or MultibandTile )

    M

    Type of Metadata associated with the RDD[(K,V)]

    id

    The ID of the layer to be read

    numPartitions

    The desired number of partitions in the resulting RDD.

    Definition Classes
    S3LayerReader → FilteringLayerReader
  7. def read[K, V, M](id: LayerId, numPartitions: Int)(implicit arg0: AvroRecordCodec[K], arg1: Boundable[K], arg2: Decoder[K], arg3: ClassTag[K], arg4: AvroRecordCodec[V], arg5: ClassTag[V], arg6: Decoder[M], arg7: Component[M, Bounds[K]]): RDD[(K, V)] with Metadata[M]
    Definition Classes
    FilteringLayerReader → LayerReader
  8. def read[K, V, M](id: LayerId, rasterQuery: LayerQuery[K, M])(implicit arg0: AvroRecordCodec[K], arg1: Boundable[K], arg2: Decoder[K], arg3: ClassTag[K], arg4: AvroRecordCodec[V], arg5: ClassTag[V], arg6: Decoder[M], arg7: Component[M, Bounds[K]]): RDD[(K, V)] with Metadata[M]
    Definition Classes
    FilteringLayerReader
  9. def read[K, V, M](id: LayerId, rasterQuery: LayerQuery[K, M], numPartitions: Int)(implicit arg0: AvroRecordCodec[K], arg1: Boundable[K], arg2: Decoder[K], arg3: ClassTag[K], arg4: AvroRecordCodec[V], arg5: ClassTag[V], arg6: Decoder[M], arg7: Component[M, Bounds[K]]): RDD[(K, V)] with Metadata[M]
    Definition Classes
    FilteringLayerReader
  10. def read[K, V, M](id: LayerId)(implicit arg0: AvroRecordCodec[K], arg1: Boundable[K], arg2: Decoder[K], arg3: ClassTag[K], arg4: AvroRecordCodec[V], arg5: ClassTag[V], arg6: Decoder[M], arg7: Component[M, Bounds[K]]): RDD[(K, V)] with Metadata[M]
    Definition Classes
    LayerReader
  11. def reader[K, V, M](implicit arg0: AvroRecordCodec[K], arg1: Boundable[K], arg2: Decoder[K], arg3: ClassTag[K], arg4: AvroRecordCodec[V], arg5: ClassTag[V], arg6: Decoder[M], arg7: Component[M, Bounds[K]]): Reader[LayerId, RDD[(K, V)] with Metadata[M]]
    Definition Classes
    LayerReader