class S3COGLayerReader extends COGLayerReader[LayerId]
Handles reading raster RDDs and their metadata from S3.
Linear Supertypes
Ordering
- Alphabetic
- By Inheritance
Inherited
- S3COGLayerReader
- COGLayerReader
- Serializable
- Serializable
- AnyRef
- Any
- Hide All
- Show All
Visibility
- Public
- All
Instance Constructors
-
new
S3COGLayerReader(attributeStore: AttributeStore, s3Client: ⇒ S3Client = S3ClientProducer.get(), runtime: ⇒ IORuntime = IORuntimeTransient.IORuntime)(implicit sc: SparkContext)
- attributeStore
AttributeStore that contains metadata for corresponding LayerId
Value Members
-
val
attributeStore: AttributeStore
- Definition Classes
- S3COGLayerReader → COGLayerReader
-
def
baseReadAllBands[K, V <: CellGrid[Int]](id: LayerId, tileQuery: LayerQuery[K, TileLayerMetadata[K]], numPartitions: Int)(implicit arg0: SpatialComponent[K], arg1: Boundable[K], arg2: Decoder[K], arg3: ClassTag[K], arg4: GeoTiffReader[V], arg5: ClassTag[V], sc: SparkContext, idToLayerId: (LayerId) ⇒ LayerId): RDD[(K, V)] with Metadata[TileLayerMetadata[K]]
- Definition Classes
- COGLayerReader
-
def
baseReadSubsetBands[K](id: LayerId, targetBands: Seq[Int], tileQuery: LayerQuery[K, TileLayerMetadata[K]], numPartitions: Int)(implicit arg0: SpatialComponent[K], arg1: Boundable[K], arg2: Decoder[K], arg3: ClassTag[K], sc: SparkContext, idToLayerId: (LayerId) ⇒ LayerId): RDD[(K, Array[Option[Tile]])] with Metadata[TileLayerMetadata[K]]
- Definition Classes
- COGLayerReader
-
val
defaultNumPartitions: Int
- Definition Classes
- S3COGLayerReader → COGLayerReader
-
def
fullPath(path: String): URI
- Definition Classes
- S3COGLayerReader → COGLayerReader
-
def
getHeader(id: LayerId): S3LayerHeader
- Definition Classes
- S3COGLayerReader → COGLayerReader
-
implicit
lazy val
ioRuntime: IORuntime
- Definition Classes
- S3COGLayerReader → COGLayerReader
- Annotations
- @transient()
-
def
pathExists(path: String): Boolean
- Definition Classes
- S3COGLayerReader → COGLayerReader
-
def
produceGetKeyPath(id: LayerId): (ZoomRange, Int) ⇒ (BigInt) ⇒ String
- Definition Classes
- S3COGLayerReader → COGLayerReader
-
def
query[K, V <: CellGrid[Int]](layerId: LayerId, numPartitions: Int)(implicit arg0: SpatialComponent[K], arg1: Boundable[K], arg2: Decoder[K], arg3: ClassTag[K], arg4: GeoTiffReader[V], arg5: ClassTag[V]): BoundLayerQuery[K, TileLayerMetadata[K], RDD[(K, V)] with Metadata[TileLayerMetadata[K]]]
- Definition Classes
- COGLayerReader
-
def
query[K, V <: CellGrid[Int]](layerId: LayerId)(implicit arg0: SpatialComponent[K], arg1: Boundable[K], arg2: Decoder[K], arg3: ClassTag[K], arg4: GeoTiffReader[V], arg5: ClassTag[V]): BoundLayerQuery[K, TileLayerMetadata[K], RDD[(K, V)] with Metadata[TileLayerMetadata[K]]]
- Definition Classes
- COGLayerReader
-
def
querySubsetBands[K](layerId: LayerId, targetBands: Seq[Int], numPartitions: Int)(implicit arg0: SpatialComponent[K], arg1: Boundable[K], arg2: Decoder[K], arg3: ClassTag[K]): BoundLayerQuery[K, TileLayerMetadata[K], RDD[(K, Array[Option[Tile]])] with Metadata[TileLayerMetadata[K]]]
- Definition Classes
- COGLayerReader
-
def
querySubsetBands[K](layerId: LayerId, targetBands: Seq[Int])(implicit arg0: SpatialComponent[K], arg1: Boundable[K], arg2: Decoder[K], arg3: ClassTag[K]): BoundLayerQuery[K, TileLayerMetadata[K], RDD[(K, Array[Option[Tile]])] with Metadata[TileLayerMetadata[K]]]
- Definition Classes
- COGLayerReader
-
def
read[K, V <: CellGrid[Int]](id: LayerId, tileQuery: LayerQuery[K, TileLayerMetadata[K]], numPartitions: Int)(implicit arg0: SpatialComponent[K], arg1: Boundable[K], arg2: Decoder[K], arg3: ClassTag[K], arg4: GeoTiffReader[V], arg5: ClassTag[V]): RDD[(K, V)] with Metadata[TileLayerMetadata[K]]
read
read
This function will read an RDD layer based on a query.
- K
Type of RDD Key (ex: SpatialKey)
- V
Type of RDD Value (ex: Tile or MultibandTile )
- id
The ID of the layer to be read
- numPartitions
The desired number of partitions in the resulting RDD.
- Definition Classes
- S3COGLayerReader → COGLayerReader
-
def
read[K, V <: CellGrid[Int]](id: LayerId)(implicit arg0: SpatialComponent[K], arg1: Boundable[K], arg2: Decoder[K], arg3: ClassTag[K], arg4: GeoTiffReader[V], arg5: ClassTag[V]): RDD[(K, V)] with Metadata[TileLayerMetadata[K]]
- Definition Classes
- COGLayerReader
-
def
read[K, V <: CellGrid[Int]](id: LayerId, numPartitions: Int)(implicit arg0: SpatialComponent[K], arg1: Boundable[K], arg2: Decoder[K], arg3: ClassTag[K], arg4: GeoTiffReader[V], arg5: ClassTag[V]): RDD[(K, V)] with Metadata[TileLayerMetadata[K]]
- Definition Classes
- COGLayerReader
-
def
read[K, V <: CellGrid[Int]](id: LayerId, rasterQuery: LayerQuery[K, TileLayerMetadata[K]])(implicit arg0: SpatialComponent[K], arg1: Boundable[K], arg2: Decoder[K], arg3: ClassTag[K], arg4: GeoTiffReader[V], arg5: ClassTag[V]): RDD[(K, V)] with Metadata[TileLayerMetadata[K]]
- Definition Classes
- COGLayerReader
-
def
readSubsetBands[K](id: LayerId, targetBands: Seq[Int], rasterQuery: LayerQuery[K, TileLayerMetadata[K]], numPartitions: Int)(implicit arg0: SpatialComponent[K], arg1: Boundable[K], arg2: Decoder[K], arg3: ClassTag[K]): RDD[(K, Array[Option[Tile]])] with Metadata[TileLayerMetadata[K]]
This method will read in an RDD layer whose value will only contain the desired bands in their given order.
This method will read in an RDD layer whose value will only contain the desired bands in their given order. This value is represented as an: Array[Option[Tile]]. Where Some(tile) represents a single band and None represents a band that could not be accessed.
- K
Type of RDD Key (ex: SpatialKey)
- id
The ID of the layer to be read
- targetBands
The desired set of bands the output layer should have.
- rasterQuery
The query that will specify the filter for this read.
- numPartitions
The desired number of partitions in the resulting RDD.
- Definition Classes
- S3COGLayerReader → COGLayerReader
-
def
readSubsetBands[K](id: LayerId, targetBands: Seq[Int])(implicit arg0: SpatialComponent[K], arg1: Boundable[K], arg2: Decoder[K], arg3: ClassTag[K]): RDD[(K, Array[Option[Tile]])] with Metadata[TileLayerMetadata[K]]
- Definition Classes
- COGLayerReader
-
def
readSubsetBands[K](id: LayerId, targetBands: Seq[Int], numPartitions: Int)(implicit arg0: SpatialComponent[K], arg1: Boundable[K], arg2: Decoder[K], arg3: ClassTag[K]): RDD[(K, Array[Option[Tile]])] with Metadata[TileLayerMetadata[K]]
- Definition Classes
- COGLayerReader
-
def
readSubsetBands[K](id: LayerId, targetBands: Seq[Int], rasterQuery: LayerQuery[K, TileLayerMetadata[K]])(implicit arg0: SpatialComponent[K], arg1: Boundable[K], arg2: Decoder[K], arg3: ClassTag[K]): RDD[(K, Array[Option[Tile]])] with Metadata[TileLayerMetadata[K]]
- Definition Classes
- COGLayerReader
-
def
reader[K, V <: CellGrid[Int]](implicit arg0: SpatialComponent[K], arg1: Boundable[K], arg2: Decoder[K], arg3: ClassTag[K], arg4: GeoTiffReader[V], arg5: ClassTag[V]): Reader[LayerId, RDD[(K, V)] with Metadata[TileLayerMetadata[K]]]
- Definition Classes
- COGLayerReader
- implicit val sc: SparkContext