package s3

Linear Supertypes
Implicits, Serializable, Serializable, AnyRef, Any
Ordering
  1. Alphabetic
  2. By Inheritance
Inherited
  1. s3
  2. Implicits
  3. Serializable
  4. Serializable
  5. AnyRef
  6. Any
  1. Hide All
  2. Show All
Visibility
  1. Public
  2. All

Type Members

  1. abstract class BaseS3RecordReader[K, V] extends RecordReader[K, V]

    This is the base class for readers that will create key value pairs for object requests.

    This is the base class for readers that will create key value pairs for object requests. Subclass must extend [readObjectRequest] method to map from S3 object requests to (K,V)

  2. class BytesS3InputFormat extends S3InputFormat[String, Array[Byte]]
  3. trait Implicits extends Serializable
  4. implicit class withSaveToS3Methods[K, V] extends SaveToS3Methods[K, V]
    Definition Classes
    Implicits
  5. class S3GeoTiffInfoReader extends GeoTiffInfoReader
  6. abstract class S3InputFormat[K, V] extends InputFormat[K, V]

    Reads keys from s3n URL using AWS Java SDK.

    Reads keys from s3n URL using AWS Java SDK. The number of keys per InputSplits are controlled by S3 pagination. If AWS credentials are not part of the URL they will be discovered using [DefaultAWSCredentialsProviderChain]:

    • EnvironmentVariableCredentialsProvider
    • SystemPropertiesCredentialsProvider
    • ProfileCredentialsProvider
    • InstanceProfileCredentialsProvider
  7. class S3InputSplit extends InputSplit with Writable

    Represents are batch of keys to be read from an S3 bucket.

    Represents are batch of keys to be read from an S3 bucket. AWS credentials have already been discovered and provided by the S3InputFormat.

  8. class S3LayerManager extends LayerManager[LayerId]
  9. class S3LayerReader extends FilteringLayerReader[LayerId]

    Handles reading raster RDDs and their metadata from S3.

  10. class S3LayerWriter extends LayerWriter[LayerId]

    Handles writing Raster RDDs and their metadata to S3.

  11. class S3RDDReader extends Serializable
  12. class S3RDDWriter extends Serializable
  13. abstract class S3RecordReader[K, V] extends BaseS3RecordReader[K, V]

    This reader will fetch bytes of each key one at a time using [AmazonS3Client.getObject].

    This reader will fetch bytes of each key one at a time using [AmazonS3Client.getObject]. Subclass must extend [read] method to map from S3 object bytes to (K,V)

  14. class S3SparkLayerProvider extends S3CollectionLayerProvider with LayerReaderProvider with LayerWriterProvider

    Provides S3LayerReader instance for URI with s3 scheme.

    Provides S3LayerReader instance for URI with s3 scheme. The uri represents S3 bucket an prefix of catalog root. ex: s3://<bucket>/<prefix-to-catalog>

  15. class SaveToS3Methods[K, V] extends MethodExtensions[RDD[(K, V)]]
  16. abstract class StreamingS3RecordReader[K, V] extends BaseS3RecordReader[K, V]

    This reader will stream bytes of each key one at a time using [AmazonS3Client.getObject].

    This reader will stream bytes of each key one at a time using [AmazonS3Client.getObject]. Subclass must extend [read] method to map from S3RangeReader to (K,V)

  17. class TiffTagsS3InputFormat extends S3InputFormat[GetObjectRequest, TiffTags]

    Reads the tiff tags of GeoTiffs on S3, avoiding full file read.

  18. class GeoTiffS3InputFormat extends S3InputFormat[ProjectedExtent, Tile]

    Read single band GeoTiff from S3

    Read single band GeoTiff from S3

    Annotations
    @deprecated
    Deprecated

    (Since version 1.0.0) GeoTiffS3InputFormat is deprecated, use S3GeoTiffRDD instead

  19. class GeoTiffS3RecordReader extends S3RecordReader[ProjectedExtent, Tile]
    Annotations
    @deprecated
    Deprecated

    (Since version 1.0.0) GeoTiffS3RecordReader is deprecated, use S3GeoTiffRDD instead

  20. class MultibandGeoTiffS3InputFormat extends S3InputFormat[ProjectedExtent, MultibandTile]

    Read multi band GeoTiff from S3

    Read multi band GeoTiff from S3

    Annotations
    @deprecated
    Deprecated

    (Since version 1.0.0) MultibandGeoTiffS3InputFormat is deprecated, use S3GeoTiffRDD instead

  21. class TemporalGeoTiffS3InputFormat extends S3InputFormat[TemporalProjectedExtent, Tile]

    Read single band GeoTiff from S3

    Read single band GeoTiff from S3

    This can be configured with the hadoop configuration by providing: TemporalGeoTiffS3InputFormat.GEOTIFF_TIME_TAG; default of "TIFFTAG_DATETIME" TemporalGeoTiffS3InputFormat.GEOTIFF_TIME_FORMAT; default is ""yyyy:MM:dd HH:mm:ss""

    Annotations
    @deprecated
    Deprecated

    (Since version 1.0.0) TemporalGeoTiffS3InputFormat is deprecated, use S3GeoTiffRDD instead

  22. class TemporalGeoTiffS3RecordReader extends S3RecordReader[TemporalProjectedExtent, Tile]
    Annotations
    @deprecated
    Deprecated

    (Since version 1.0.0) TemporalGeoTiffS3RecordReader is deprecated, use S3GeoTiffRDD instead

  23. class TemporalMultibandGeoTiffS3InputFormat extends S3InputFormat[TemporalProjectedExtent, MultibandTile]

    Read single band GeoTiff from S3

    Read single band GeoTiff from S3

    This can be configured with the hadoop configuration by providing: TemporalMultibandGeoTiffS3InputFormat.GEOTIFF_TIME_TAG; default of "TIFFTAG_DATETIME" TemporalMultibandGeoTiffS3InputFormat.GEOTIFF_TIME_FORMAT; default is ""yyyy:MM:DD HH:MM:SS""

    Annotations
    @deprecated
    Deprecated

    (Since version 1.0.0) TemporalMultibandGeoTiffS3InputFormat is deprecated, use S3GeoTiffRDD instead

Abstract Value Members

  1. abstract def getClass(): Class[_]
    Definition Classes
    Any

Concrete Value Members

  1. final def !=(arg0: Any): Boolean
    Definition Classes
    Any
  2. final def ##(): Int
    Definition Classes
    Any
  3. final def ==(arg0: Any): Boolean
    Definition Classes
    Any
  4. final def asInstanceOf[T0]: T0
    Definition Classes
    Any
  5. def equals(arg0: Any): Boolean
    Definition Classes
    Any
  6. def hashCode(): Int
    Definition Classes
    Any
  7. final def isInstanceOf[T0]: Boolean
    Definition Classes
    Any
  8. def toString(): String
    Definition Classes
    Any
  9. object Implicits extends Implicits
  10. object S3GeoTiffInfoReader extends Serializable
  11. object S3GeoTiffRDD

    The S3GeoTiffRDD object allows for the creation of whole or windowed RDD[(K, V)]s from files on S3.

  12. object S3InputFormat
  13. object S3LayerReader
  14. object S3LayerReindexer
  15. object S3LayerWriter
  16. object SaveToS3

Deprecated Value Members

  1. object GeoTiffS3InputFormat
    Annotations
    @deprecated
    Deprecated

    (Since version 1.0.0) GeoTiffS3InputFormat is deprecated, use S3GeoTiffRDD instead

  2. object TemporalGeoTiffS3InputFormat
    Annotations
    @deprecated
    Deprecated

    (Since version 1.0.0) TemporalGeoTiffS3InputFormat is deprecated, use S3GeoTiffRDD instead

Inherited from Implicits

Inherited from Serializable

Inherited from Serializable

Inherited from AnyRef

Inherited from Any

Ungrouped