class SaveToHadoopMethods[K, V] extends AnyRef
Linear Supertypes
Known Subclasses
Ordering
- Alphabetic
- By Inheritance
Inherited
- SaveToHadoopMethods
- AnyRef
- Any
- Hide All
- Show All
Visibility
- Public
- All
Instance Constructors
- new SaveToHadoopMethods(rdd: RDD[(K, V)])
Value Members
-
def
saveToHadoop(keyToUri: (K) ⇒ String)(getBytes: (K, V) ⇒ Array[Byte]): Long
Saves to Hadoop, but returns a count of records saved.
Saves to Hadoop, but returns a count of records saved.
- keyToUri
maps each key to full hadoop supported path
- getBytes
K and V both provided in case K contains required information, like extent.
-
def
setupSaveToHadoop(keyToUri: (K) ⇒ String)(getBytes: (K, V) ⇒ Array[Byte]): RDD[(K, V)]
Sets up saving to Hadoop, but returns an RDD so that writes can be chained.
Sets up saving to Hadoop, but returns an RDD so that writes can be chained.
- keyToUri
maps each key to full hadoop supported path
- getBytes
K and V both provided in case K contains required information, like extent.