Packages

trait LayerWriter[ID] extends AnyRef

Ordering
  1. Alphabetic
  2. By Inheritance
Inherited
  1. LayerWriter
  2. AnyRef
  3. Any
  1. Hide All
  2. Show All
Visibility
  1. Public
  2. All

Abstract Value Members

  1. abstract val attributeStore: AttributeStore
  2. abstract def overwrite[K, V, M](id: ID, rdd: RDD[(K, V)] with Metadata[M])(implicit arg0: AvroRecordCodec[K], arg1: Boundable[K], arg2: Encoder[K], arg3: Decoder[K], arg4: ClassTag[K], arg5: AvroRecordCodec[V], arg6: ClassTag[V], arg7: Encoder[M], arg8: Decoder[M], arg9: Component[M, Bounds[K]], arg10: Semigroup[M]): Unit

    Update persisted layer without checking for possible.

    Update persisted layer without checking for possible.

    Warning: using this method may result in data loss. Unlike the LayerWriter.update this method will not check for existing records before writing the update. Use this as optimiation when you are certain that update will not overlap with existing records.

    Additional care is needed in cases where KeyIndex may map multiple, distinct, values of K to single index. This is likely with spatio-temproral layers. In these cases overwrite will replace the whole record, possibly overwriting (K,V) pairs with K is not contained in update RDD.

    The method will throw if:

    • Specified layer does not exist
    • Change the Avro schema of records is detected
    • Update RDD Bounds are outside of layer index Bounds

    Updates with empty Bounds will be ignored.

  3. abstract def update[K, V, M](id: ID, rdd: RDD[(K, V)] with Metadata[M], mergeFunc: (V, V) ⇒ V = ...)(implicit arg0: AvroRecordCodec[K], arg1: Boundable[K], arg2: Encoder[K], arg3: Decoder[K], arg4: ClassTag[K], arg5: AvroRecordCodec[V], arg6: ClassTag[V], arg7: Encoder[M], arg8: Decoder[M], arg9: Component[M, Bounds[K]], arg10: Semigroup[M]): Unit

    Update persisted layer, merging existing value with updated value.

    Update persisted layer, merging existing value with updated value.

    The layer metadata may change as result of the update to reflect added values.

    The method will throw if:

    • Specified layer does not exist
    • Change the Avro schema of records is detected
    • Update RDD Bounds are outside of layer index Bounds

    Updates with empty Bounds will be ignored.

Concrete Value Members

  1. def write[K, V, M](id: ID, layer: RDD[(K, V)] with Metadata[M], keyIndexMethod: KeyIndexMethod[K])(implicit arg0: AvroRecordCodec[K], arg1: Encoder[K], arg2: ClassTag[K], arg3: AvroRecordCodec[V], arg4: ClassTag[V], arg5: Encoder[M], arg6: Component[M, Bounds[K]]): Unit
  2. def write[K, V, M](id: ID, layer: RDD[(K, V)] with Metadata[M], keyIndex: KeyIndex[K])(implicit arg0: AvroRecordCodec[K], arg1: Encoder[K], arg2: ClassTag[K], arg3: AvroRecordCodec[V], arg4: ClassTag[V], arg5: Encoder[M], arg6: Component[M, Bounds[K]]): Unit
  3. def writer[K, V, M](keyIndex: KeyIndex[K])(implicit arg0: AvroRecordCodec[K], arg1: Encoder[K], arg2: ClassTag[K], arg3: AvroRecordCodec[V], arg4: ClassTag[V], arg5: Encoder[M], arg6: Component[M, Bounds[K]]): Writer[ID, RDD[(K, V)] with Metadata[M]]
  4. def writer[K, V, M](keyIndexMethod: KeyIndexMethod[K])(implicit arg0: AvroRecordCodec[K], arg1: Encoder[K], arg2: ClassTag[K], arg3: AvroRecordCodec[V], arg4: ClassTag[V], arg5: Encoder[M], arg6: Component[M, Bounds[K]]): Writer[ID, RDD[(K, V)] with Metadata[M]]