Class/Object

geotrellis.spark.io.file

FileLayerWriter

Related Docs: object FileLayerWriter | package file

Permalink

class FileLayerWriter extends LayerWriter[LayerId] with LazyLogging

Handles writing Raster RDDs and their metadata to a filesystem.

Linear Supertypes
Ordering
  1. Alphabetic
  2. By Inheritance
Inherited
  1. FileLayerWriter
  2. LazyLogging
  3. LayerWriter
  4. AnyRef
  5. Any
  1. Hide All
  2. Show All
Visibility
  1. Public
  2. All

Instance Constructors

  1. new FileLayerWriter(attributeStore: AttributeStore, catalogPath: String)

    Permalink

    attributeStore

    AttributeStore to be used for storing raster metadata

    catalogPath

    The root directory of this catalog.

Value Members

  1. final def !=(arg0: Any): Boolean

    Permalink
    Definition Classes
    AnyRef → Any
  2. final def ##(): Int

    Permalink
    Definition Classes
    AnyRef → Any
  3. final def ==(arg0: Any): Boolean

    Permalink
    Definition Classes
    AnyRef → Any
  4. def _write[K, V, M](layerId: LayerId, rdd: RDD[(K, V)] with Metadata[M], keyIndex: KeyIndex[K])(implicit arg0: AvroRecordCodec[K], arg1: JsonFormat[K], arg2: ClassTag[K], arg3: AvroRecordCodec[V], arg4: ClassTag[V], arg5: JsonFormat[M], arg6: GetComponent[M, Bounds[K]]): Unit

    Permalink
    Attributes
    protected
    Definition Classes
    FileLayerWriterLayerWriter
  5. final def asInstanceOf[T0]: T0

    Permalink
    Definition Classes
    Any
  6. val attributeStore: AttributeStore

    Permalink

    AttributeStore to be used for storing raster metadata

    AttributeStore to be used for storing raster metadata

    Definition Classes
    FileLayerWriterLayerWriter
  7. def clone(): AnyRef

    Permalink
    Attributes
    protected[java.lang]
    Definition Classes
    AnyRef
    Annotations
    @throws( ... )
  8. final def eq(arg0: AnyRef): Boolean

    Permalink
    Definition Classes
    AnyRef
  9. def equals(arg0: Any): Boolean

    Permalink
    Definition Classes
    AnyRef → Any
  10. def finalize(): Unit

    Permalink
    Attributes
    protected[java.lang]
    Definition Classes
    AnyRef
    Annotations
    @throws( classOf[java.lang.Throwable] )
  11. final def getClass(): Class[_]

    Permalink
    Definition Classes
    AnyRef → Any
  12. def hashCode(): Int

    Permalink
    Definition Classes
    AnyRef → Any
  13. final def isInstanceOf[T0]: Boolean

    Permalink
    Definition Classes
    Any
  14. lazy val logger: Logger

    Permalink
    Attributes
    protected
    Definition Classes
    LazyLogging
  15. final def ne(arg0: AnyRef): Boolean

    Permalink
    Definition Classes
    AnyRef
  16. final def notify(): Unit

    Permalink
    Definition Classes
    AnyRef
  17. final def notifyAll(): Unit

    Permalink
    Definition Classes
    AnyRef
  18. def overwrite[K, V, M](id: LayerId, rdd: RDD[(K, V)] with Metadata[M])(implicit arg0: AvroRecordCodec[K], arg1: Boundable[K], arg2: JsonFormat[K], arg3: ClassTag[K], arg4: AvroRecordCodec[V], arg5: ClassTag[V], arg6: JsonFormat[M], arg7: GetComponent[M, Bounds[K]], arg8: Mergable[M]): Unit

    Permalink

    Update persisted layer without checking for possible.

    Update persisted layer without checking for possible.

    Warning: using this method may result in data loss. Unlike the LayerWriter.update this method will not check for existing records before writing the update. Use this as optimiation when you are certain that update will not overlap with existing records.

    Additional care is needed in cases where KeyIndex may map multiple, distinct, values of K to single index. This is likely with spatio-temproral layers. In these cases overwrite will replace the whole record, possibly overwriting (K,V) pairs with K is not contained in update RDD.

    The method will throw if:

    • Specified layer does not exist
    • Change the Avro schema of records is detected
    • Update RDD Bounds are outside of layer index Bounds

    Updates with empty Bounds will be ignored.

    Definition Classes
    FileLayerWriterLayerWriter
  19. final def synchronized[T0](arg0: ⇒ T0): T0

    Permalink
    Definition Classes
    AnyRef
  20. def toString(): String

    Permalink
    Definition Classes
    AnyRef → Any
  21. def update[K, V, M](id: LayerId, rdd: RDD[(K, V)] with Metadata[M], mergeFunc: (V, V) ⇒ V)(implicit arg0: AvroRecordCodec[K], arg1: Boundable[K], arg2: JsonFormat[K], arg3: ClassTag[K], arg4: AvroRecordCodec[V], arg5: ClassTag[V], arg6: JsonFormat[M], arg7: GetComponent[M, Bounds[K]], arg8: Mergable[M]): Unit

    Permalink

    Update persisted layer, merging existing value with updated value.

    Update persisted layer, merging existing value with updated value.

    The layer metadata may change as result of the update to reflect added values.

    The method will throw if:

    • Specified layer does not exist
    • Change the Avro schema of records is detected
    • Update RDD Bounds are outside of layer index Bounds

    Updates with empty Bounds will be ignored.

    Definition Classes
    FileLayerWriterLayerWriter
  22. def validateUpdate[H, K, V, M](id: LayerId, updateMetadata: M)(implicit arg0: JsonFormat[H], arg1: AvroRecordCodec[K], arg2: Boundable[K], arg3: JsonFormat[K], arg4: ClassTag[K], arg5: AvroRecordCodec[V], arg6: GetComponent[M, Bounds[K]], arg7: Mergable[M], arg8: JsonFormat[M]): Option[LayerAttributes[H, M, K]]

    Permalink

    Validate update metadata before delegating to update function with updated LayerAttributes.

    Validate update metadata before delegating to update function with updated LayerAttributes. The update function is expected to handle the saving of updated attributes and values.

    Attributes
    protected[geotrellis]
    Definition Classes
    LayerWriter
  23. final def wait(): Unit

    Permalink
    Definition Classes
    AnyRef
    Annotations
    @throws( ... )
  24. final def wait(arg0: Long, arg1: Int): Unit

    Permalink
    Definition Classes
    AnyRef
    Annotations
    @throws( ... )
  25. final def wait(arg0: Long): Unit

    Permalink
    Definition Classes
    AnyRef
    Annotations
    @throws( ... )
  26. def write[K, V, M](id: LayerId, layer: RDD[(K, V)] with Metadata[M], keyIndexMethod: KeyIndexMethod[K])(implicit arg0: AvroRecordCodec[K], arg1: JsonFormat[K], arg2: ClassTag[K], arg3: AvroRecordCodec[V], arg4: ClassTag[V], arg5: JsonFormat[M], arg6: GetComponent[M, Bounds[K]]): Unit

    Permalink
    Definition Classes
    LayerWriter
  27. def write[K, V, M](id: LayerId, layer: RDD[(K, V)] with Metadata[M], keyIndex: KeyIndex[K])(implicit arg0: AvroRecordCodec[K], arg1: JsonFormat[K], arg2: ClassTag[K], arg3: AvroRecordCodec[V], arg4: ClassTag[V], arg5: JsonFormat[M], arg6: GetComponent[M, Bounds[K]]): Unit

    Permalink
    Definition Classes
    LayerWriter
  28. def writer[K, V, M](keyIndex: KeyIndex[K])(implicit arg0: AvroRecordCodec[K], arg1: JsonFormat[K], arg2: ClassTag[K], arg3: AvroRecordCodec[V], arg4: ClassTag[V], arg5: JsonFormat[M], arg6: GetComponent[M, Bounds[K]]): Writer[LayerId, RDD[(K, V)] with Metadata[M]]

    Permalink
    Definition Classes
    LayerWriter
  29. def writer[K, V, M](keyIndexMethod: KeyIndexMethod[K])(implicit arg0: AvroRecordCodec[K], arg1: JsonFormat[K], arg2: ClassTag[K], arg3: AvroRecordCodec[V], arg4: ClassTag[V], arg5: JsonFormat[M], arg6: GetComponent[M, Bounds[K]]): Writer[LayerId, RDD[(K, V)] with Metadata[M]]

    Permalink
    Definition Classes
    LayerWriter

Inherited from LazyLogging

Inherited from LayerWriter[LayerId]

Inherited from AnyRef

Inherited from Any

Ungrouped