c

geotrellis.spark.store.s3

StreamingS3RecordReader

abstract class StreamingS3RecordReader[K, V] extends BaseS3RecordReader[K, V]

This reader will stream bytes of each key one at a time using [AmazonS3Client.getObject]. Subclass must extend [read] method to map from S3RangeReader to (K,V)

Linear Supertypes
BaseS3RecordReader[K, V], RecordReader[K, V], Closeable, AutoCloseable, AnyRef, Any
Ordering
  1. Alphabetic
  2. By Inheritance
Inherited
  1. StreamingS3RecordReader
  2. BaseS3RecordReader
  3. RecordReader
  4. Closeable
  5. AutoCloseable
  6. AnyRef
  7. Any
  1. Hide All
  2. Show All
Visibility
  1. Public
  2. All

Instance Constructors

  1. new StreamingS3RecordReader(s3Client: S3Client)

Abstract Value Members

  1. abstract def read(key: String, byteReader: ByteReader): (K, V)

Concrete Value Members

  1. def close(): Unit
    Definition Classes
    BaseS3RecordReader → RecordReader → Closeable → AutoCloseable
  2. def getCurrentKey(): K
    Definition Classes
    BaseS3RecordReader → RecordReader
  3. def getCurrentValue(): V
    Definition Classes
    BaseS3RecordReader → RecordReader
  4. def getProgress(): Float
    Definition Classes
    BaseS3RecordReader → RecordReader
  5. def initialize(split: InputSplit, context: TaskAttemptContext): Unit
    Definition Classes
    BaseS3RecordReader → RecordReader
  6. def nextKeyValue(): Boolean
    Definition Classes
    BaseS3RecordReader → RecordReader
  7. def readObjectRequest(objectRequest: GetObjectRequest): (K, V)
    Definition Classes
    StreamingS3RecordReader → BaseS3RecordReader