Package

geotrellis.spark.io

hadoop

Permalink

package hadoop

Linear Supertypes
Implicits, AnyRef, Any
Ordering
  1. Alphabetic
  2. By Inheritance
Inherited
  1. hadoop
  2. Implicits
  3. AnyRef
  4. Any
  1. Hide All
  2. Show All
Visibility
  1. Public
  2. All

Type Members

  1. class HadoopAttributeStore extends BlobLayerAttributeStore

    Permalink
  2. case class HadoopCatalogConfig(compressionFactor: Double, metadataFileName: String, layerDataDir: (LayerId) ⇒ String) extends Product with Serializable

    Permalink
  3. class HadoopCollectionLayerReader extends CollectionLayerReader[LayerId] with LazyLogging

    Permalink

    Handles reading raster RDDs and their metadata from S3.

  4. class HadoopCollectionReader extends AnyRef

    Permalink
  5. case class HadoopGeoTiffInfoReader(path: String, config: SerializableConfiguration, tiffExtensions: Seq[String] = ..., streaming: Boolean = true) extends GeoTiffInfoReader with Product with Serializable

    Permalink
  6. class HadoopLayerCopier extends LayerCopier[LayerId]

    Permalink
  7. class HadoopLayerDeleter extends LazyLogging with LayerDeleter[LayerId]

    Permalink
  8. case class HadoopLayerHeader(keyClass: String, valueClass: String, path: URI, layerType: LayerType = AvroLayerType) extends LayerHeader with Product with Serializable

    Permalink
  9. class HadoopLayerManager extends LayerManager[LayerId]

    Permalink
  10. class HadoopLayerMover extends LayerMover[LayerId]

    Permalink
  11. class HadoopLayerProvider extends AttributeStoreProvider with LayerReaderProvider with LayerWriterProvider with ValueReaderProvider with CollectionLayerReaderProvider

    Permalink

    Provides HadoopAttributeStore instance for URI with hdfs, hdfs+file, s3n, s3a, wasb and wasbs schemes.

    Provides HadoopAttributeStore instance for URI with hdfs, hdfs+file, s3n, s3a, wasb and wasbs schemes. The uri represents Hadoop Path of catalog root. wasb and wasbs provide support for the Hadoop Azure connector. Additional configuration is required for this. This Provider intentinally does not handle the s3 scheme because the Hadoop implemintation is poor. That support is provided by HadoopAttributeStore

  12. class HadoopLayerReader extends FilteringLayerReader[LayerId] with LazyLogging

    Permalink

    Handles reading raster RDDs and their metadata from S3.

  13. class HadoopLayerWriter extends LayerWriter[LayerId] with LazyLogging

    Permalink
  14. trait HadoopRasterMethods[T] extends MethodExtensions[T]

    Permalink
  15. trait HadoopSparkContextMethods extends AnyRef

    Permalink
  16. implicit class HadoopSparkContextMethodsWrapper extends HadoopSparkContextMethods

    Permalink
    Definition Classes
    Implicits
  17. class HadoopValueReader extends OverzoomingValueReader

    Permalink
  18. class HdfsRangeReader extends RangeReader

    Permalink

    This class extends RangeReader by reading chunks out of a GeoTiff on HDFS.

    This class extends RangeReader by reading chunks out of a GeoTiff on HDFS.

    returns

    A new instance of S3RangeReader.

  19. trait Implicits extends AnyRef

    Permalink
  20. class KeyPartitioner[K] extends Partitioner

    Permalink
  21. abstract class LineScanner extends Iterator[String] with Closeable

    Permalink
  22. class SaveBytesToHadoopMethods[K] extends AnyRef

    Permalink
  23. class SaveToHadoopMethods[K, V] extends AnyRef

    Permalink
  24. case class SerializableConfiguration(value: Configuration) extends Serializable with Product

    Permalink

    From Spark codebase.

    From Spark codebase. Allows us to use the Hadoop Configuration in serializable tasks

  25. implicit class withGeoTiffHadoopWriteMethods[T <: CellGrid] extends HadoopRasterMethods[GeoTiff[T]]

    Permalink
    Definition Classes
    Implicits
  26. implicit class withHadoopConfigurationMethods extends MethodExtensions[Configuration]

    Permalink
  27. implicit class withJpgHadoopWriteMethods extends HadoopRasterMethods[Jpg]

    Permalink
    Definition Classes
    Implicits
  28. implicit class withPngHadoopWriteMethods extends HadoopRasterMethods[Png]

    Permalink
    Definition Classes
    Implicits
  29. implicit class withSaveBytesToHadoopMethods[K] extends SaveBytesToHadoopMethods[K]

    Permalink
    Definition Classes
    Implicits
  30. implicit class withSaveToHadoopMethods[K, V] extends SaveToHadoopMethods[K, V]

    Permalink
    Definition Classes
    Implicits

Value Members

  1. object HadoopAttributeStore extends Serializable

    Permalink
  2. object HadoopCatalogConfig extends Serializable

    Permalink
  3. object HadoopCollectionLayerReader

    Permalink
  4. object HadoopCollectionReader

    Permalink
  5. object HadoopGeoTiffRDD extends LazyLogging

    Permalink

    Allows for reading of whole or windowed GeoTiff as RDD[(K, V)]s through Hadoop FileSystem API.

  6. object HadoopGeoTiffReader

    Permalink
  7. object HadoopJpgReader

    Permalink
  8. object HadoopLayerCopier

    Permalink
  9. object HadoopLayerDeleter

    Permalink
  10. object HadoopLayerHeader extends Serializable

    Permalink
  11. object HadoopLayerMover

    Permalink
  12. object HadoopLayerReader

    Permalink
  13. object HadoopLayerReindexer

    Permalink
  14. object HadoopLayerWriter

    Permalink
  15. object HadoopPngReader

    Permalink
  16. object HadoopRDDReader extends LazyLogging

    Permalink
  17. object HadoopRDDWriter extends LazyLogging

    Permalink
  18. object HadoopValueReader

    Permalink
  19. object HdfsRangeReader

    Permalink
  20. object HdfsUtils extends LazyLogging

    Permalink
  21. object Implicits extends Implicits

    Permalink
  22. object KeyPartitioner extends Serializable

    Permalink
  23. object SaveToHadoop

    Permalink
  24. package cog

    Permalink
  25. package conf

    Permalink
  26. package formats

    Permalink
  27. package geotiff

    Permalink
  28. implicit def stringToPath(path: String): Path

    Permalink

Inherited from Implicits

Inherited from AnyRef

Inherited from Any

Ungrouped