c

geotrellis.spark.store.s3

StreamingS3RecordReader

abstract class StreamingS3RecordReader[K, V] extends BaseS3RecordReader[K, V]

This reader will stream bytes of each key one at a time using [AmazonS3Client.getObject]. Subclass must extend [read] method to map from S3RangeReader to (K,V)

Linear Supertypes
BaseS3RecordReader[K, V], RecordReader[K, V], Closeable, AutoCloseable, AnyRef, Any
Ordering
  1. Alphabetic
  2. By Inheritance
Inherited
  1. StreamingS3RecordReader
  2. BaseS3RecordReader
  3. RecordReader
  4. Closeable
  5. AutoCloseable
  6. AnyRef
  7. Any
  1. Hide All
  2. Show All
Visibility
  1. Public
  2. All

Instance Constructors

  1. new StreamingS3RecordReader(s3Client: S3Client)

Abstract Value Members

  1. abstract def read(key: String, byteReader: ByteReader): (K, V)

Concrete Value Members

  1. final def !=(arg0: Any): Boolean
    Definition Classes
    AnyRef → Any
  2. final def ##(): Int
    Definition Classes
    AnyRef → Any
  3. final def ==(arg0: Any): Boolean
    Definition Classes
    AnyRef → Any
  4. final def asInstanceOf[T0]: T0
    Definition Classes
    Any
  5. var bucket: String
    Attributes
    protected
    Definition Classes
    BaseS3RecordReader
  6. def clone(): AnyRef
    Attributes
    protected[lang]
    Definition Classes
    AnyRef
    Annotations
    @throws( ... ) @native()
  7. def close(): Unit
    Definition Classes
    BaseS3RecordReader → RecordReader → Closeable → AutoCloseable
  8. var curCount: Int
    Attributes
    protected
    Definition Classes
    BaseS3RecordReader
  9. var curKey: K
    Attributes
    protected
    Definition Classes
    BaseS3RecordReader
  10. var curValue: V
    Attributes
    protected
    Definition Classes
    BaseS3RecordReader
  11. final def eq(arg0: AnyRef): Boolean
    Definition Classes
    AnyRef
  12. def equals(arg0: Any): Boolean
    Definition Classes
    AnyRef → Any
  13. def finalize(): Unit
    Attributes
    protected[lang]
    Definition Classes
    AnyRef
    Annotations
    @throws( classOf[java.lang.Throwable] )
  14. final def getClass(): Class[_]
    Definition Classes
    AnyRef → Any
    Annotations
    @native()
  15. def getCurrentKey(): K
    Definition Classes
    BaseS3RecordReader → RecordReader
  16. def getCurrentValue(): V
    Definition Classes
    BaseS3RecordReader → RecordReader
  17. def getProgress(): Float
    Definition Classes
    BaseS3RecordReader → RecordReader
  18. def hashCode(): Int
    Definition Classes
    AnyRef → Any
    Annotations
    @native()
  19. def initialize(split: InputSplit, context: TaskAttemptContext): Unit
    Definition Classes
    BaseS3RecordReader → RecordReader
  20. final def isInstanceOf[T0]: Boolean
    Definition Classes
    Any
  21. var keyCount: Int
    Attributes
    protected
    Definition Classes
    BaseS3RecordReader
  22. var keys: Iterator[String]
    Attributes
    protected
    Definition Classes
    BaseS3RecordReader
  23. final def ne(arg0: AnyRef): Boolean
    Definition Classes
    AnyRef
  24. def nextKeyValue(): Boolean
    Definition Classes
    BaseS3RecordReader → RecordReader
  25. final def notify(): Unit
    Definition Classes
    AnyRef
    Annotations
    @native()
  26. final def notifyAll(): Unit
    Definition Classes
    AnyRef
    Annotations
    @native()
  27. def readObjectRequest(objectRequest: GetObjectRequest): (K, V)
    Definition Classes
    StreamingS3RecordReader → BaseS3RecordReader
  28. final def synchronized[T0](arg0: ⇒ T0): T0
    Definition Classes
    AnyRef
  29. def toString(): String
    Definition Classes
    AnyRef → Any
  30. final def wait(): Unit
    Definition Classes
    AnyRef
    Annotations
    @throws( ... )
  31. final def wait(arg0: Long, arg1: Int): Unit
    Definition Classes
    AnyRef
    Annotations
    @throws( ... )
  32. final def wait(arg0: Long): Unit
    Definition Classes
    AnyRef
    Annotations
    @throws( ... ) @native()

Inherited from BaseS3RecordReader[K, V]

Inherited from RecordReader[K, V]

Inherited from Closeable

Inherited from AutoCloseable

Inherited from AnyRef

Inherited from Any

Ungrouped