object HadoopRDDWriter
Linear Supertypes
Ordering
- Alphabetic
- By Inheritance
Inherited
- HadoopRDDWriter
- AnyRef
- Any
- Hide All
- Show All
Visibility
- Public
- All
Type Members
-
class
MultiMapWriter extends AnyRef
When record being written would exceed the block size of the current MapFile opens a new file to continue writing.
When record being written would exceed the block size of the current MapFile opens a new file to continue writing. This allows to split partition into block-sized chunks without foreknowledge of how big it is.
Value Members
-
final
def
!=(arg0: Any): Boolean
- Definition Classes
- AnyRef → Any
-
final
def
##(): Int
- Definition Classes
- AnyRef → Any
-
final
def
==(arg0: Any): Boolean
- Definition Classes
- AnyRef → Any
-
final
val
DefaultIndexInterval: Int(4)
Index innterval at which map files should store an offset into sequence file.
Index innterval at which map files should store an offset into sequence file. This value is picked as a compromize between in-memory footprint and IO cost of retreiving a single record.
-
final
def
asInstanceOf[T0]: T0
- Definition Classes
- Any
-
def
clone(): AnyRef
- Attributes
- protected[lang]
- Definition Classes
- AnyRef
- Annotations
- @throws( ... ) @native()
-
final
def
eq(arg0: AnyRef): Boolean
- Definition Classes
- AnyRef
-
def
equals(arg0: Any): Boolean
- Definition Classes
- AnyRef → Any
-
def
finalize(): Unit
- Attributes
- protected[lang]
- Definition Classes
- AnyRef
- Annotations
- @throws( classOf[java.lang.Throwable] )
-
final
def
getClass(): Class[_]
- Definition Classes
- AnyRef → Any
- Annotations
- @native()
-
def
hashCode(): Int
- Definition Classes
- AnyRef → Any
- Annotations
- @native()
-
final
def
isInstanceOf[T0]: Boolean
- Definition Classes
- Any
-
final
def
ne(arg0: AnyRef): Boolean
- Definition Classes
- AnyRef
-
final
def
notify(): Unit
- Definition Classes
- AnyRef
- Annotations
- @native()
-
final
def
notifyAll(): Unit
- Definition Classes
- AnyRef
- Annotations
- @native()
-
final
def
synchronized[T0](arg0: ⇒ T0): T0
- Definition Classes
- AnyRef
-
def
toString(): String
- Definition Classes
- AnyRef → Any
-
final
def
wait(): Unit
- Definition Classes
- AnyRef
- Annotations
- @throws( ... )
-
final
def
wait(arg0: Long, arg1: Int): Unit
- Definition Classes
- AnyRef
- Annotations
- @throws( ... )
-
final
def
wait(arg0: Long): Unit
- Definition Classes
- AnyRef
- Annotations
- @throws( ... ) @native()
- def write[K, V](rdd: RDD[(K, V)], path: Path, keyIndex: KeyIndex[K], indexInterval: Int = DefaultIndexInterval, existenceCheck: Boolean = true)(implicit arg0: AvroRecordCodec[K], arg1: ClassTag[K], arg2: AvroRecordCodec[V], arg3: ClassTag[V]): Unit