Packages

t

org.apache.spark

ReadOnlySparkConf

trait ReadOnlySparkConf extends AnyRef

Source
SparkConf.scala
Linear Supertypes
AnyRef, Any
Known Subclasses
SparkConf

Ordering
  1. Alphabetic
  2. By Inheritance
Inherited
  1. ReadOnlySparkConf
  2. AnyRef
  3. Any
  1. Hide All
  2. Show All
Visibility
  1. Public
  2. Protected

Abstract Value Members

  1.  abstract def contains(key: String): Boolean

    Does the configuration contain a given parameter?

  2.  abstract def getAll: Array[(String, String)]

    Get all parameters as a list of pairs

  3.  abstract def getOption(key: String): Option[String]

    Get a parameter as an Option

Concrete Value Members

  1.  final def !=(arg0: Any): Boolean
    Definition Classes
    AnyRef → Any
  2.  final def ##: Int
    Definition Classes
    AnyRef → Any
  3.  final def ==(arg0: Any): Boolean
    Definition Classes
    AnyRef → Any
  4.  final def asInstanceOf[T0]: T0
    Definition Classes
    Any
  5.  def catchIllegalValue[T](key: String)(getValue: => T): T

    Wrapper method for get() methods which require some specific value format.

    Wrapper method for get() methods which require some specific value format. This catches any NumberFormatException or IllegalArgumentException and re-raises it with the incorrectly configured key in the exception message.

    Attributes
    protected
  6.  def clone(): AnyRef
    Attributes
    protected[lang]
    Definition Classes
    AnyRef
    Annotations
    @throws(classOf[java.lang.CloneNotSupportedException]) @IntrinsicCandidate() @native()
  7.  def contains(entry: ConfigEntry[_]): Boolean

    Does the configuration have the typed config entry?

  8.  final def eq(arg0: AnyRef): Boolean
    Definition Classes
    AnyRef
  9.  def equals(arg0: AnyRef): Boolean
    Definition Classes
    AnyRef → Any
  10.  def get(key: String, defaultValue: String): String

    Get a parameter, falling back to a default if not set

  11.  def get(key: String): String

    Get a parameter; throws a NoSuchElementException if it's not set

  12.  def getBoolean(key: String, defaultValue: Boolean): Boolean

    Get a parameter as a boolean, falling back to a default if not set

    Get a parameter as a boolean, falling back to a default if not set

    Exceptions thrown

    IllegalArgumentException If the value cannot be interpreted as a boolean

  13.  final def getClass(): Class[_ <: AnyRef]
    Definition Classes
    AnyRef → Any
    Annotations
    @IntrinsicCandidate() @native()
  14.  def getDouble(key: String, defaultValue: Double): Double

    Get a parameter as a double, falling back to a default if not ste

    Get a parameter as a double, falling back to a default if not ste

    Exceptions thrown

    NumberFormatException If the value cannot be interpreted as a double

  15.  def getInt(key: String, defaultValue: Int): Int

    Get a parameter as an integer, falling back to a default if not set

    Get a parameter as an integer, falling back to a default if not set

    Exceptions thrown

    NumberFormatException If the value cannot be interpreted as an integer

  16.  def getLong(key: String, defaultValue: Long): Long

    Get a parameter as a long, falling back to a default if not set

    Get a parameter as a long, falling back to a default if not set

    Exceptions thrown

    NumberFormatException If the value cannot be interpreted as a long

  17.  def getSizeAsBytes(key: String, defaultValue: Long): Long

    Get a size parameter as bytes, falling back to a default if not set.

    Get a size parameter as bytes, falling back to a default if not set.

    Exceptions thrown

    NumberFormatException If the value cannot be interpreted as bytes

  18.  def getSizeAsBytes(key: String, defaultValue: String): Long

    Get a size parameter as bytes, falling back to a default if not set.

    Get a size parameter as bytes, falling back to a default if not set. If no suffix is provided then bytes are assumed.

    Exceptions thrown

    NumberFormatException If the value cannot be interpreted as bytes

  19.  def getSizeAsBytes(key: String): Long

    Get a size parameter as bytes; throws a NoSuchElementException if it's not set.

    Get a size parameter as bytes; throws a NoSuchElementException if it's not set. If no suffix is provided then bytes are assumed.

    Exceptions thrown

    NumberFormatException If the value cannot be interpreted as bytes

    java.util.NoSuchElementException If the size parameter is not set

  20.  def getSizeAsGb(key: String, defaultValue: String): Long

    Get a size parameter as Gibibytes, falling back to a default if not set.

    Get a size parameter as Gibibytes, falling back to a default if not set. If no suffix is provided then Gibibytes are assumed.

    Exceptions thrown

    NumberFormatException If the value cannot be interpreted as Gibibytes

  21.  def getSizeAsGb(key: String): Long

    Get a size parameter as Gibibytes; throws a NoSuchElementException if it's not set.

    Get a size parameter as Gibibytes; throws a NoSuchElementException if it's not set. If no suffix is provided then Gibibytes are assumed.

    Exceptions thrown

    NumberFormatException If the value cannot be interpreted as Gibibytes

    java.util.NoSuchElementException If the size parameter is not set

  22.  def getSizeAsKb(key: String, defaultValue: String): Long

    Get a size parameter as Kibibytes, falling back to a default if not set.

    Get a size parameter as Kibibytes, falling back to a default if not set. If no suffix is provided then Kibibytes are assumed.

    Exceptions thrown

    NumberFormatException If the value cannot be interpreted as Kibibytes

  23.  def getSizeAsKb(key: String): Long

    Get a size parameter as Kibibytes; throws a NoSuchElementException if it's not set.

    Get a size parameter as Kibibytes; throws a NoSuchElementException if it's not set. If no suffix is provided then Kibibytes are assumed.

    Exceptions thrown

    NumberFormatException If the value cannot be interpreted as Kibibytes

    java.util.NoSuchElementException If the size parameter is not set

  24.  def getSizeAsMb(key: String, defaultValue: String): Long

    Get a size parameter as Mebibytes, falling back to a default if not set.

    Get a size parameter as Mebibytes, falling back to a default if not set. If no suffix is provided then Mebibytes are assumed.

    Exceptions thrown

    NumberFormatException If the value cannot be interpreted as Mebibytes

  25.  def getSizeAsMb(key: String): Long

    Get a size parameter as Mebibytes; throws a NoSuchElementException if it's not set.

    Get a size parameter as Mebibytes; throws a NoSuchElementException if it's not set. If no suffix is provided then Mebibytes are assumed.

    Exceptions thrown

    NumberFormatException If the value cannot be interpreted as Mebibytes

    java.util.NoSuchElementException If the size parameter is not set

  26.  def getTimeAsMs(key: String, defaultValue: String): Long

    Get a time parameter as milliseconds, falling back to a default if not set.

    Get a time parameter as milliseconds, falling back to a default if not set. If no suffix is provided then milliseconds are assumed.

    Exceptions thrown

    NumberFormatException If the value cannot be interpreted as milliseconds

  27.  def getTimeAsMs(key: String): Long

    Get a time parameter as milliseconds; throws a NoSuchElementException if it's not set.

    Get a time parameter as milliseconds; throws a NoSuchElementException if it's not set. If no suffix is provided then milliseconds are assumed.

    Exceptions thrown

    NumberFormatException If the value cannot be interpreted as milliseconds

    java.util.NoSuchElementException If the time parameter is not set

  28.  def getTimeAsSeconds(key: String, defaultValue: String): Long

    Get a time parameter as seconds, falling back to a default if not set.

    Get a time parameter as seconds, falling back to a default if not set. If no suffix is provided then seconds are assumed.

    Exceptions thrown

    NumberFormatException If the value cannot be interpreted as seconds

  29.  def getTimeAsSeconds(key: String): Long

    Get a time parameter as seconds; throws a NoSuchElementException if it's not set.

    Get a time parameter as seconds; throws a NoSuchElementException if it's not set. If no suffix is provided then seconds are assumed.

    Exceptions thrown

    NumberFormatException If the value cannot be interpreted as seconds

    java.util.NoSuchElementException If the time parameter is not set

  30.  def hashCode(): Int
    Definition Classes
    AnyRef → Any
    Annotations
    @IntrinsicCandidate() @native()
  31.  final def isInstanceOf[T0]: Boolean
    Definition Classes
    Any
  32.  final def ne(arg0: AnyRef): Boolean
    Definition Classes
    AnyRef
  33.  final def notify(): Unit
    Definition Classes
    AnyRef
    Annotations
    @IntrinsicCandidate() @native()
  34.  final def notifyAll(): Unit
    Definition Classes
    AnyRef
    Annotations
    @IntrinsicCandidate() @native()
  35.  final def synchronized[T0](arg0: => T0): T0
    Definition Classes
    AnyRef
  36.  def toString(): String
    Definition Classes
    AnyRef → Any
  37.  final def wait(arg0: Long, arg1: Int): Unit
    Definition Classes
    AnyRef
    Annotations
    @throws(classOf[java.lang.InterruptedException])
  38.  final def wait(arg0: Long): Unit
    Definition Classes
    AnyRef
    Annotations
    @throws(classOf[java.lang.InterruptedException]) @native()
  39.  final def wait(): Unit
    Definition Classes
    AnyRef
    Annotations
    @throws(classOf[java.lang.InterruptedException])

Deprecated Value Members

  1.  def finalize(): Unit
    Attributes
    protected[lang]
    Definition Classes
    AnyRef
    Annotations
    @throws(classOf[java.lang.Throwable]) @Deprecated
    Deprecated

    (Since version 9)

Inherited from AnyRef

Inherited from Any

Ungrouped