HadoopGeoTiffRDD

Type Members

case class Options(tiffExtensions: Seq[String] = ..., crs: Option[CRS] = None, timeTag: String = GEOTIFF_TIME_TAG_DEFAULT, timeFormat: String = GEOTIFF_TIME_FORMAT_DEFAULT, maxTileSize: Option[Int] = None, numPartitions: Option[Int] = None, chunkSize: Option[Int] = None) extends RasterReader.Options with Product with Serializable

This case class contains the various parameters one can set when reading RDDs from Hadoop using Spark.
This case class contains the various parameters one can set when reading RDDs from Hadoop using Spark.
tiffExtensions
Read all file with an extension contained in the given list.
crs
Override CRS of the input files. If None, the reader will use the file's original CRS.
timeTag
Name of tiff tag containing the timestamp for the tile.
timeFormat
Pattern for java.time.format.DateTimeFormatter to parse timeTag.
maxTileSize
Maximum allowed size of each tiles in output RDD. May result in a one input GeoTiff being split amongst multiple records if it exceeds this size. If no maximum tile size is specific, then each file file is read fully.
numPartitions
How many partitions Spark should create when it repartitions the data.
chunkSize
How many bytes should be read in at a time.

Value Members

final def !=(arg0: Any): Boolean

Definition Classes
AnyRef → Any
final def ##(): Int

Definition Classes
AnyRef → Any
final def ==(arg0: Any): Boolean

Definition Classes
AnyRef → Any
final val GEOTIFF_TIME_FORMAT_DEFAULT: String("yyyy:MM:dd HH:mm:ss")
final val GEOTIFF_TIME_TAG_DEFAULT: String("TIFFTAG_DATETIME")
object Options extends Serializable
def apply[K, V](pathsToDimensions: RDD[(Path, (Int, Int))], options: Options)(implicit rr: RasterReader[Options, (K, V)]): RDD[(K, V)]

Creates a RDD[(K, V)] whose K and V depends on the type of the GeoTiff that is going to be read in.
Creates a RDD[(K, V)] whose K and V depends on the type of the GeoTiff that is going to be read in.
pathsToDimensions
RDD keyed by GeoTiff path with (cols, rows) tuple as value.
options
An instance of Options that contains any user defined or default settings.
def apply[K, V](path: Path, options: Options = Options.DEFAULT)(implicit sc: SparkContext, rr: RasterReader[Options, (K, V)]): RDD[(K, V)]

Creates a RDD[(K, V)] whose K and V depends on the type of the GeoTiff that is going to be read in.
Creates a RDD[(K, V)] whose K and V depends on the type of the GeoTiff that is going to be read in.
path
Hdfs GeoTiff path.
options
An instance of Options that contains any user defined or default settings.
final def asInstanceOf[T0]: T0

Definition Classes
Any
def clone(): AnyRef

Attributes
protected[java.lang]
Definition Classes
AnyRef
Annotations
@throws( ... )
final def eq(arg0: AnyRef): Boolean

Definition Classes
AnyRef
def equals(arg0: Any): Boolean

Definition Classes
AnyRef → Any
def finalize(): Unit

Attributes
protected[java.lang]
Definition Classes
AnyRef
Annotations
@throws( classOf[java.lang.Throwable] )
final def getClass(): Class[_]

Definition Classes
AnyRef → Any
def hashCode(): Int

Definition Classes
AnyRef → Any
final def isInstanceOf[T0]: Boolean

Definition Classes
Any
final def ne(arg0: AnyRef): Boolean

Definition Classes
AnyRef
final def notify(): Unit

Definition Classes
AnyRef
final def notifyAll(): Unit

Definition Classes
AnyRef
def spatial(path: Path, options: Options)(implicit sc: SparkContext): RDD[(ProjectedExtent, Tile)]

Creates RDDs with the [(K, V)] values being ProjectedExtent and Tile, respectively.
Creates RDDs with the [(K, V)] values being ProjectedExtent and Tile, respectively. It assumes that the provided files are SinglebandGeoTiffs.
path
Hadoop path to recursively search for GeoTiffs.
options
An instance of Options that contains any user defined or default settings.
def spatial(path: Path)(implicit sc: SparkContext): RDD[(ProjectedExtent, Tile)]

Creates RDDs with the [(K, V)] values being ProjectedExtent and Tile, respectively.
Creates RDDs with the [(K, V)] values being ProjectedExtent and Tile, respectively. It assumes that the provided files are SinglebandGeoTiffs.
path
Hadoop path to recursively search for GeoTiffs.
def spatialMultiband(path: Path, options: Options)(implicit sc: SparkContext): RDD[(ProjectedExtent, MultibandTile)]

Creates RDDs with the [(K, V)] values being ProjectedExtent and MultibandTile, respectively.
Creates RDDs with the [(K, V)] values being ProjectedExtent and MultibandTile, respectively. It assumes that the provided files are MultibandGeoTiffs.
path
Hadoop path to recursively search for GeoTiffs.
options
An instance of Options that contains any user defined or default settings.
def spatialMultiband(path: Path)(implicit sc: SparkContext): RDD[(ProjectedExtent, MultibandTile)]

Creates RDDs with the [(K, V)] values being ProjectedExtent and MultibandTile, respectively.
Creates RDDs with the [(K, V)] values being ProjectedExtent and MultibandTile, respectively. It assumes that the provided files are MultibandGeoTiffs.
path
Hadoop path to recursively search for GeoTiffs.
final def synchronized[T0](arg0: ⇒ T0): T0

Definition Classes
AnyRef
def temporal(path: Path, options: Options)(implicit sc: SparkContext): RDD[(TemporalProjectedExtent, Tile)]

Creates RDDs with the [(K, V)] values being TemporalProjectedExtent and Tile, respectively.
Creates RDDs with the [(K, V)] values being TemporalProjectedExtent and Tile, respectively. It assumes that the provided files are SinglebandGeoTiffs.
path
Hadoop path to recursively search for GeoTiffs.
options
An instance of Options that contains any user defined or default settings.
def temporal(path: Path)(implicit sc: SparkContext): RDD[(TemporalProjectedExtent, Tile)]

Creates RDDs with the [(K, V)] values being TemporalProjectedExtent and Tile, respectively.
Creates RDDs with the [(K, V)] values being TemporalProjectedExtent and Tile, respectively. It assumes that the provided files are SinglebandGeoTiffs.
path
Hadoop path to recursively search for GeoTiffs.
def temporalMultiband(path: Path, options: Options)(implicit sc: SparkContext): RDD[(TemporalProjectedExtent, MultibandTile)]

Creates RDDs with the [(K, V)] values being TemporalProjectedExtent and MultibandTile, respectively.
Creates RDDs with the [(K, V)] values being TemporalProjectedExtent and MultibandTile, respectively. It assumes that the provided files are MultibandGeoTiffs.
path
Hadoop path to recursively search for GeoTiffs.
options
An instance of Options that contains any user defined or default settings.
def temporalMultiband(path: Path)(implicit sc: SparkContext): RDD[(TemporalProjectedExtent, MultibandTile)]

Creates RDDs with the [(K, V)] values being TemporalProjectedExtent and MultibandTile, respectively.
Creates RDDs with the [(K, V)] values being TemporalProjectedExtent and MultibandTile, respectively. It assumes that the provided files are MultibandGeoTiffs.
path
Hadoop path to recursively search for GeoTiffs.
def toString(): String

Definition Classes
AnyRef → Any
final def wait(): Unit

Definition Classes
AnyRef
Annotations
@throws( ... )
final def wait(arg0: Long, arg1: Int): Unit

Definition Classes
AnyRef
Annotations
@throws( ... )
final def wait(arg0: Long): Unit

Definition Classes
AnyRef
Annotations
@throws( ... )

Related Doc: package hadoop

object HadoopGeoTiffRDD

Type Members

Value Members

final def !=(arg0: Any): Boolean

final def ##(): Int

final def ==(arg0: Any): Boolean

final val GEOTIFF_TIME_FORMAT_DEFAULT: String("yyyy:MM:dd HH:mm:ss")

final val GEOTIFF_TIME_TAG_DEFAULT: String("TIFFTAG_DATETIME")

object Options extends Serializable

def apply[K, V](pathsToDimensions: RDD[(Path, (Int, Int))], options: Options)(implicit rr: RasterReader[Options, (K, V)]): RDD[(K, V)]

def apply[K, V](path: Path, options: Options = Options.DEFAULT)(implicit sc: SparkContext, rr: RasterReader[Options, (K, V)]): RDD[(K, V)]

final def asInstanceOf[T0]: T0

def clone(): AnyRef

final def eq(arg0: AnyRef): Boolean

def equals(arg0: Any): Boolean

def finalize(): Unit

final def getClass(): Class[_]

def hashCode(): Int

final def isInstanceOf[T0]: Boolean

final def ne(arg0: AnyRef): Boolean

final def notify(): Unit

final def notifyAll(): Unit

def spatial(path: Path, options: Options)(implicit sc: SparkContext): RDD[(ProjectedExtent, Tile)]

def spatial(path: Path)(implicit sc: SparkContext): RDD[(ProjectedExtent, Tile)]

def spatialMultiband(path: Path, options: Options)(implicit sc: SparkContext): RDD[(ProjectedExtent, MultibandTile)]

def spatialMultiband(path: Path)(implicit sc: SparkContext): RDD[(ProjectedExtent, MultibandTile)]

final def synchronized[T0](arg0: ⇒ T0): T0

def temporal(path: Path, options: Options)(implicit sc: SparkContext): RDD[(TemporalProjectedExtent, Tile)]

def temporal(path: Path)(implicit sc: SparkContext): RDD[(TemporalProjectedExtent, Tile)]

def temporalMultiband(path: Path, options: Options)(implicit sc: SparkContext): RDD[(TemporalProjectedExtent, MultibandTile)]

def temporalMultiband(path: Path)(implicit sc: SparkContext): RDD[(TemporalProjectedExtent, MultibandTile)]

def toString(): String

final def wait(): Unit

final def wait(arg0: Long, arg1: Int): Unit

final def wait(arg0: Long): Unit

Inherited from AnyRef

Inherited from Any

Ungrouped