Class

geotrellis.spark.io.s3

StreamingS3RecordReader

Related Doc: package s3

Permalink

abstract class StreamingS3RecordReader[K, V] extends BaseS3RecordReader[K, V]

This reader will stream bytes of each key one at a time using [AmazonS3Client.getObject]. Subclass must extend [read] method to map from S3RangeReader to (K,V)

Linear Supertypes
BaseS3RecordReader[K, V], LazyLogging, RecordReader[K, V], Closeable, AutoCloseable, AnyRef, Any
Ordering
  1. Alphabetic
  2. By Inheritance
Inherited
  1. StreamingS3RecordReader
  2. BaseS3RecordReader
  3. LazyLogging
  4. RecordReader
  5. Closeable
  6. AutoCloseable
  7. AnyRef
  8. Any
  1. Hide All
  2. Show All
Visibility
  1. Public
  2. All

Instance Constructors

  1. new StreamingS3RecordReader(s3Client: S3Client)

    Permalink

Abstract Value Members

  1. abstract def read(key: String, byteReader: ByteReader): (K, V)

    Permalink

Concrete Value Members

  1. final def !=(arg0: Any): Boolean

    Permalink
    Definition Classes
    AnyRef → Any
  2. final def ##(): Int

    Permalink
    Definition Classes
    AnyRef → Any
  3. final def ==(arg0: Any): Boolean

    Permalink
    Definition Classes
    AnyRef → Any
  4. final def asInstanceOf[T0]: T0

    Permalink
    Definition Classes
    Any
  5. var bucket: String

    Permalink
    Attributes
    protected
    Definition Classes
    BaseS3RecordReader
  6. def clone(): AnyRef

    Permalink
    Attributes
    protected[java.lang]
    Definition Classes
    AnyRef
    Annotations
    @throws( ... )
  7. def close(): Unit

    Permalink
    Definition Classes
    BaseS3RecordReader → RecordReader → Closeable → AutoCloseable
  8. var curCount: Int

    Permalink
    Attributes
    protected
    Definition Classes
    BaseS3RecordReader
  9. var curKey: K

    Permalink
    Attributes
    protected
    Definition Classes
    BaseS3RecordReader
  10. var curValue: V

    Permalink
    Attributes
    protected
    Definition Classes
    BaseS3RecordReader
  11. final def eq(arg0: AnyRef): Boolean

    Permalink
    Definition Classes
    AnyRef
  12. def equals(arg0: Any): Boolean

    Permalink
    Definition Classes
    AnyRef → Any
  13. def finalize(): Unit

    Permalink
    Attributes
    protected[java.lang]
    Definition Classes
    AnyRef
    Annotations
    @throws( classOf[java.lang.Throwable] )
  14. final def getClass(): Class[_]

    Permalink
    Definition Classes
    AnyRef → Any
  15. def getCurrentKey(): K

    Permalink
    Definition Classes
    BaseS3RecordReader → RecordReader
  16. def getCurrentValue(): V

    Permalink
    Definition Classes
    BaseS3RecordReader → RecordReader
  17. def getProgress(): Float

    Permalink
    Definition Classes
    BaseS3RecordReader → RecordReader
  18. def hashCode(): Int

    Permalink
    Definition Classes
    AnyRef → Any
  19. def initialize(split: InputSplit, context: TaskAttemptContext): Unit

    Permalink
    Definition Classes
    BaseS3RecordReader → RecordReader
  20. final def isInstanceOf[T0]: Boolean

    Permalink
    Definition Classes
    Any
  21. var keyCount: Int

    Permalink
    Attributes
    protected
    Definition Classes
    BaseS3RecordReader
  22. var keys: Iterator[String]

    Permalink
    Attributes
    protected
    Definition Classes
    BaseS3RecordReader
  23. lazy val logger: Logger

    Permalink
    Attributes
    protected
    Definition Classes
    LazyLogging
  24. final def ne(arg0: AnyRef): Boolean

    Permalink
    Definition Classes
    AnyRef
  25. def nextKeyValue(): Boolean

    Permalink
    Definition Classes
    BaseS3RecordReader → RecordReader
  26. final def notify(): Unit

    Permalink
    Definition Classes
    AnyRef
  27. final def notifyAll(): Unit

    Permalink
    Definition Classes
    AnyRef
  28. def readObjectRequest(objectRequest: GetObjectRequest): (K, V)

    Permalink
  29. final def synchronized[T0](arg0: ⇒ T0): T0

    Permalink
    Definition Classes
    AnyRef
  30. def toString(): String

    Permalink
    Definition Classes
    AnyRef → Any
  31. final def wait(): Unit

    Permalink
    Definition Classes
    AnyRef
    Annotations
    @throws( ... )
  32. final def wait(arg0: Long, arg1: Int): Unit

    Permalink
    Definition Classes
    AnyRef
    Annotations
    @throws( ... )
  33. final def wait(arg0: Long): Unit

    Permalink
    Definition Classes
    AnyRef
    Annotations
    @throws( ... )

Inherited from BaseS3RecordReader[K, V]

Inherited from LazyLogging

Inherited from RecordReader[K, V]

Inherited from Closeable

Inherited from AutoCloseable

Inherited from AnyRef

Inherited from Any

Ungrouped