Package

geotrellis.spark.io

hadoop

Permalink

package hadoop

Linear Supertypes
Implicits, AnyRef, Any
Ordering
  1. Alphabetic
  2. By Inheritance
Inherited
  1. hadoop
  2. Implicits
  3. AnyRef
  4. Any
  1. Hide All
  2. Show All
Visibility
  1. Public
  2. All

Type Members

  1. class HadoopAttributeStore extends BlobLayerAttributeStore

    Permalink
  2. case class HadoopCatalogConfig(compressionFactor: Double, metadataFileName: String, layerDataDir: (LayerId) ⇒ String) extends Product with Serializable

    Permalink
  3. class HadoopCollectionLayerReader extends CollectionLayerReader[LayerId] with LazyLogging

    Permalink

    Handles reading raster RDDs and their metadata from S3.

  4. class HadoopCollectionReader extends AnyRef

    Permalink
  5. class HadoopLayerCopier extends LayerCopier[LayerId]

    Permalink
  6. class HadoopLayerDeleter extends LazyLogging with LayerDeleter[LayerId]

    Permalink
  7. case class HadoopLayerHeader(keyClass: String, valueClass: String, path: Path) extends LayerHeader with Product with Serializable

    Permalink
  8. class HadoopLayerManager extends LayerManager[LayerId]

    Permalink
  9. class HadoopLayerMover extends LayerMover[LayerId]

    Permalink
  10. class HadoopLayerProvider extends AttributeStoreProvider with LayerReaderProvider with LayerWriterProvider

    Permalink

    Provides HadoopAttributeStore instance for URI with hdfs, hdfs+file, s3n, and s3a schemes.

    Provides HadoopAttributeStore instance for URI with hdfs, hdfs+file, s3n, and s3a schemes. The uri represents Hadoop Path of catalog root. This Provider intentinally does not handle the s3 scheme because the Hadoop implemintation is poor. That support is provided by S3Attributestore

  11. class HadoopLayerReader extends FilteringLayerReader[LayerId] with LazyLogging

    Permalink

    Handles reading raster RDDs and their metadata from S3.

  12. class HadoopLayerUpdater extends LayerUpdater[LayerId] with LazyLogging

    Permalink
  13. class HadoopLayerWriter extends LayerWriter[LayerId]

    Permalink
  14. trait HadoopRasterMethods[T] extends MethodExtensions[T]

    Permalink
  15. trait HadoopSparkContextMethods extends AnyRef

    Permalink
  16. implicit class HadoopSparkContextMethodsWrapper extends HadoopSparkContextMethods

    Permalink
    Definition Classes
    Implicits
  17. class HadoopValueReader extends ValueReader[LayerId]

    Permalink
  18. class HdfsRangeReader extends RangeReader

    Permalink

    This class extends RangeReader by reading chunks out of a GeoTiff on HDFS.

    This class extends RangeReader by reading chunks out of a GeoTiff on HDFS.

    returns

    A new instance of S3RangeReader.

  19. trait Implicits extends AnyRef

    Permalink
  20. class KeyPartitioner[K] extends Partitioner

    Permalink
  21. abstract class LineScanner extends Iterator[String] with Closeable

    Permalink
  22. class SaveBytesToHadoopMethods[K] extends AnyRef

    Permalink
  23. class SaveToHadoopMethods[K, V] extends AnyRef

    Permalink
  24. class SerializableConfiguration extends Serializable

    Permalink

    From Spark codebase, marked private there.

    From Spark codebase, marked private there. Allows us to use the Hadoop Configuration in serializable tasks

  25. implicit class withGeoTiffHadoopWriteMethods[T <: CellGrid] extends HadoopRasterMethods[GeoTiff[T]]

    Permalink
    Definition Classes
    Implicits
  26. implicit class withHadoopConfigurationMethods extends MethodExtensions[Configuration]

    Permalink
  27. implicit class withJpgHadoopWriteMethods extends HadoopRasterMethods[Jpg]

    Permalink
    Definition Classes
    Implicits
  28. implicit class withPngHadoopWriteMethods extends HadoopRasterMethods[Png]

    Permalink
    Definition Classes
    Implicits
  29. implicit class withSaveBytesToHadoopMethods[K] extends SaveBytesToHadoopMethods[K]

    Permalink
    Definition Classes
    Implicits
  30. implicit class withSaveToHadoopMethods[K, V] extends SaveToHadoopMethods[K, V]

    Permalink
    Definition Classes
    Implicits

Value Members

  1. object HadoopAttributeStore

    Permalink
  2. object HadoopCatalogConfig extends Serializable

    Permalink
  3. object HadoopCollectionLayerReader

    Permalink
  4. object HadoopCollectionReader

    Permalink
  5. object HadoopGeoTiffRDD

    Permalink

    Allows for reading of whole or windowed GeoTiff as RDD[(K, V)]s through Hadoop FileSystem API.

  6. object HadoopGeoTiffReader

    Permalink
  7. object HadoopJpgReader

    Permalink
  8. object HadoopLayerCopier

    Permalink
  9. object HadoopLayerDeleter

    Permalink
  10. object HadoopLayerHeader extends Serializable

    Permalink
  11. object HadoopLayerMover

    Permalink
  12. object HadoopLayerReader

    Permalink
  13. object HadoopLayerReindexer

    Permalink
  14. object HadoopLayerUpdater

    Permalink
  15. object HadoopLayerWriter

    Permalink
  16. object HadoopPngReader

    Permalink
  17. object HadoopRDDReader extends LazyLogging

    Permalink
  18. object HadoopRDDWriter extends LazyLogging

    Permalink
  19. object HadoopValueReader

    Permalink
  20. object HdfsRangeReader

    Permalink
  21. object HdfsUtils extends LazyLogging

    Permalink
  22. object Implicits extends Implicits

    Permalink
  23. object KeyPartitioner extends Serializable

    Permalink
  24. object SaveToHadoop

    Permalink
  25. package formats

    Permalink
  26. implicit def stringToPath(path: String): Path

    Permalink

Inherited from Implicits

Inherited from AnyRef

Inherited from Any

Ungrouped