Package

geotrellis.spark.io

s3

Permalink

package s3

Linear Supertypes
AnyRef, Any
Ordering
  1. Alphabetic
  2. By Inheritance
Inherited
  1. s3
  2. AnyRef
  3. Any
  1. Hide All
  2. Show All
Visibility
  1. Public
  2. All

Type Members

  1. class AmazonS3Client extends S3Client

    Permalink
  2. class GeoTiffS3InputFormat extends S3InputFormat[ProjectedExtent, Tile]

    Permalink

    Read single band GeoTiff from S3

  3. class GeoTiffS3RecordReader extends S3RecordReader[ProjectedExtent, Tile]

    Permalink
  4. class MultibandGeoTiffS3InputFormat extends S3InputFormat[ProjectedExtent, MultibandTile]

    Permalink

    Read multi band GeoTiff from S3

  5. class S3AttributeStore extends AttributeStore with BlobLayerAttributeStore

    Permalink

    Stores and retrieves layer attributes in an S3 bucket in JSON format

  6. trait S3Client extends LazyLogging

    Permalink
  7. abstract class S3InputFormat[K, V] extends InputFormat[K, V] with LazyLogging

    Permalink

    Reads keys from s3n URL using AWS Java SDK.

    Reads keys from s3n URL using AWS Java SDK. The number of keys per InputSplits are controlled by S3 pagination. If AWS credentials are not part of the URL they will be discovered using [DefaultAWSCredentialsProviderChain]:

    • EnvironmentVariableCredentialsProvider
    • SystemPropertiesCredentialsProvider
    • ProfileCredentialsProvider
    • InstanceProfileCredentialsProvider
  8. class S3InputSplit extends InputSplit with Writable with LazyLogging

    Permalink

    Represents are batch of keys to be read from an S3 bucket.

    Represents are batch of keys to be read from an S3 bucket. AWS credentials have already been discovered and provided by the S3InputFormat.

  9. class S3LayerCopier extends LayerCopier[LayerId]

    Permalink
  10. class S3LayerDeleter extends LayerDeleter[LayerId]

    Permalink
  11. case class S3LayerHeader(keyClass: String, valueClass: String, bucket: String, key: String) extends LayerHeader with Product with Serializable

    Permalink
  12. class S3LayerManager extends LayerManager[LayerId]

    Permalink
  13. class S3LayerReader extends FilteringLayerReader[LayerId] with LazyLogging

    Permalink

    Handles reading raster RDDs and their metadata from S3.

  14. class S3LayerUpdater extends LayerUpdater[LayerId] with LazyLogging

    Permalink
  15. class S3LayerWriter extends LayerWriter[LayerId] with LazyLogging

    Permalink

    Handles writing Raster RDDs and their metadata to S3.

  16. trait S3RDDReader extends AnyRef

    Permalink
  17. trait S3RDDWriter extends AnyRef

    Permalink
  18. abstract class S3RecordReader[K, V] extends RecordReader[K, V] with LazyLogging

    Permalink

    This reader will fetch bytes of each key one at a time using [AmazonS3Client.getObject].

    This reader will fetch bytes of each key one at a time using [AmazonS3Client.getObject]. Subclass must extend [read] method to map from S3 object bytes to (K,V)

  19. class S3TileReader[K, V] extends Reader[LayerId, Reader[K, V]]

    Permalink
  20. class SaveToS3Methods[K] extends MethodExtensions[RDD[(K, Array[Byte])]]

    Permalink
  21. class TemporalGeoTiffS3InputFormat extends S3InputFormat[TemporalProjectedExtent, Tile]

    Permalink

    Read single band GeoTiff from S3

    Read single band GeoTiff from S3

    This can be configured with the hadoop configuration by providing: TemporalGeoTiffS3InputFormat.GEOTIFF_TIME_TAG; default of "TIFFTAG_DATETIME" TemporalGeoTiffS3InputFormat.GEOTIFF_TIME_FORMAT; default is ""YYYY:MM:DD HH:MM:SS""

  22. class TemporalGeoTiffS3RecordReader extends S3RecordReader[TemporalProjectedExtent, Tile]

    Permalink
  23. class TemporalMultibandGeoTiffS3InputFormat extends S3InputFormat[TemporalProjectedExtent, MultibandTile]

    Permalink

    Read single band GeoTiff from S3

    Read single band GeoTiff from S3

    This can be configured with the hadoop configuration by providing: TemporalMultibandGeoTiffS3InputFormat.GEOTIFF_TIME_TAG; default of "TIFFTAG_DATETIME" TemporalMultibandGeoTiffS3InputFormat.GEOTIFF_TIME_FORMAT; default is ""YYYY:MM:DD HH:MM:SS""

  24. implicit class withSaveToS3Methods[K] extends SaveToS3Methods[K]

    Permalink

Inherited from AnyRef

Inherited from Any

Ungrouped