Packages

object JdbcRDD extends Serializable

Source
JdbcRDD.scala
Linear Supertypes
Serializable, AnyRef, Any

Ordering
  1. Alphabetic
  2. By Inheritance
Inherited
  1. JdbcRDD
  2. Serializable
  3. AnyRef
  4. Any
  1. Hide All
  2. Show All
Visibility
  1. Public
  2. Protected

Type Members

  1.  trait ConnectionFactory extends Serializable

Value Members

  1.  final def !=(arg0: Any): Boolean
    Definition Classes
    AnyRef → Any
  2.  final def ##: Int
    Definition Classes
    AnyRef → Any
  3.  final def ==(arg0: Any): Boolean
    Definition Classes
    AnyRef → Any
  4.  final def asInstanceOf[T0]: T0
    Definition Classes
    Any
  5.  def clone(): AnyRef
    Attributes
    protected[lang]
    Definition Classes
    AnyRef
    Annotations
    @throws(classOf[java.lang.CloneNotSupportedException]) @IntrinsicCandidate() @native()
  6.  def create(sc: JavaSparkContext, connectionFactory: ConnectionFactory, sql: String, lowerBound: Long, upperBound: Long, numPartitions: Int): JavaRDD[Array[AnyRef]]

    Create an RDD that executes a SQL query on a JDBC connection and reads results.

    Create an RDD that executes a SQL query on a JDBC connection and reads results. Each row is converted into a Object array. For usage example, see test case JavaAPISuite.testJavaJdbcRDD.

    connectionFactory

    a factory that returns an open Connection. The RDD takes care of closing the connection.

    sql

    the text of the query. The query must contain two ? placeholders for parameters used to partition the results. For example,

    select title, author from books where ? <= id and id <= ?
    lowerBound

    the minimum value of the first placeholder

    upperBound

    the maximum value of the second placeholder The lower and upper bounds are inclusive.

    numPartitions

    the number of partitions. Given a lowerBound of 1, an upperBound of 20, and a numPartitions of 2, the query would be executed twice, once with (1, 10) and once with (11, 20)

  7.  def create[T](sc: JavaSparkContext, connectionFactory: ConnectionFactory, sql: String, lowerBound: Long, upperBound: Long, numPartitions: Int, mapRow: Function[ResultSet, T]): JavaRDD[T]

    Create an RDD that executes a SQL query on a JDBC connection and reads results.

    Create an RDD that executes a SQL query on a JDBC connection and reads results. For usage example, see test case JavaAPISuite.testJavaJdbcRDD.

    connectionFactory

    a factory that returns an open Connection. The RDD takes care of closing the connection.

    sql

    the text of the query. The query must contain two ? placeholders for parameters used to partition the results. For example,

    select title, author from books where ? <= id and id <= ?
    lowerBound

    the minimum value of the first placeholder

    upperBound

    the maximum value of the second placeholder The lower and upper bounds are inclusive.

    numPartitions

    the number of partitions. Given a lowerBound of 1, an upperBound of 20, and a numPartitions of 2, the query would be executed twice, once with (1, 10) and once with (11, 20)

    mapRow

    a function from a ResultSet to a single row of the desired result type(s). This should only call getInt, getString, etc; the RDD takes care of calling next. The default maps a ResultSet to an array of Object.

  8.  final def eq(arg0: AnyRef): Boolean
    Definition Classes
    AnyRef
  9.  def equals(arg0: AnyRef): Boolean
    Definition Classes
    AnyRef → Any
  10.  final def getClass(): Class[_ <: AnyRef]
    Definition Classes
    AnyRef → Any
    Annotations
    @IntrinsicCandidate() @native()
  11.  def hashCode(): Int
    Definition Classes
    AnyRef → Any
    Annotations
    @IntrinsicCandidate() @native()
  12.  final def isInstanceOf[T0]: Boolean
    Definition Classes
    Any
  13.  final def ne(arg0: AnyRef): Boolean
    Definition Classes
    AnyRef
  14.  final def notify(): Unit
    Definition Classes
    AnyRef
    Annotations
    @IntrinsicCandidate() @native()
  15.  final def notifyAll(): Unit
    Definition Classes
    AnyRef
    Annotations
    @IntrinsicCandidate() @native()
  16.  def resultSetToObjectArray(rs: ResultSet): Array[AnyRef]
  17.  final def synchronized[T0](arg0: => T0): T0
    Definition Classes
    AnyRef
  18.  def toString(): String
    Definition Classes
    AnyRef → Any
  19.  final def wait(arg0: Long, arg1: Int): Unit
    Definition Classes
    AnyRef
    Annotations
    @throws(classOf[java.lang.InterruptedException])
  20.  final def wait(arg0: Long): Unit
    Definition Classes
    AnyRef
    Annotations
    @throws(classOf[java.lang.InterruptedException]) @native()
  21.  final def wait(): Unit
    Definition Classes
    AnyRef
    Annotations
    @throws(classOf[java.lang.InterruptedException])

Deprecated Value Members

  1.  def finalize(): Unit
    Attributes
    protected[lang]
    Definition Classes
    AnyRef
    Annotations
    @throws(classOf[java.lang.Throwable]) @Deprecated
    Deprecated

    (Since version 9)

Inherited from Serializable

Inherited from AnyRef

Inherited from Any

Ungrouped