Packages

case class PivotalConnection(config: GreenplumConnectionConfig) extends DQConnection with Product with Serializable

Connection to Greenplum database

config

Connection configuration

Linear Supertypes
Serializable, Serializable, Product, Equals, DQConnection, AnyRef, Any
Ordering
  1. Alphabetic
  2. By Inheritance
Inherited
  1. PivotalConnection
  2. Serializable
  3. Serializable
  4. Product
  5. Equals
  6. DQConnection
  7. AnyRef
  8. Any
  1. Hide All
  2. Show All
Visibility
  1. Public
  2. All

Instance Constructors

  1. new PivotalConnection(config: GreenplumConnectionConfig)

    config

    Connection configuration

Type Members

  1. type SourceType = GreenplumSourceConfig
    Definition Classes
    PivotalConnectionDQConnection

Value Members

  1. final def !=(arg0: Any): Boolean
    Definition Classes
    AnyRef → Any
  2. final def ##(): Int
    Definition Classes
    AnyRef → Any
  3. final def ==(arg0: Any): Boolean
    Definition Classes
    AnyRef → Any
  4. final def asInstanceOf[T0]: T0
    Definition Classes
    Any
  5. def checkConnection: Result[Unit]

    Checks connection.

    Checks connection.

    returns

    Nothing or error message in case if connection is not ready.

    Definition Classes
    PivotalConnectionDQConnection
  6. def clone(): AnyRef
    Attributes
    protected[lang]
    Definition Classes
    AnyRef
    Annotations
    @throws( ... ) @native()
  7. val config: GreenplumConnectionConfig
  8. val connectionUrl: String
    Attributes
    protected
  9. val currentSchema: Option[String]
    Attributes
    protected
  10. final def eq(arg0: AnyRef): Boolean
    Definition Classes
    AnyRef
  11. def finalize(): Unit
    Attributes
    protected[lang]
    Definition Classes
    AnyRef
    Annotations
    @throws( classOf[java.lang.Throwable] )
  12. final def getClass(): Class[_]
    Definition Classes
    AnyRef → Any
    Annotations
    @native()
  13. def getProperties: Properties

    Gets basic Greenplum connection properties

    Gets basic Greenplum connection properties

    returns

    Connection properties

  14. val id: String
    Definition Classes
    PivotalConnectionDQConnection
  15. final def isInstanceOf[T0]: Boolean
    Definition Classes
    Any
  16. val jdbcDriver: String
    Attributes
    protected
  17. def loadDataFrame(sourceConfig: SourceType)(implicit settings: AppSettings, spark: SparkSession, schemas: Map[String, SourceSchema]): DataFrame

    Loads external data into dataframe given a source configuration

    Loads external data into dataframe given a source configuration

    sourceConfig

    Source configuration

    settings

    Implicit application settings object

    spark

    Implicit spark session object

    schemas

    Implicit Map of all explicitly defined schemas (schemaId -> SourceSchema)

    returns

    Spark DataFrame

    Definition Classes
    PivotalConnectionDQConnection
  18. final def ne(arg0: AnyRef): Boolean
    Definition Classes
    AnyRef
  19. final def notify(): Unit
    Definition Classes
    AnyRef
    Annotations
    @native()
  20. final def notifyAll(): Unit
    Definition Classes
    AnyRef
    Annotations
    @native()
  21. val sparkParams: Seq[String]
    Attributes
    protected
    Definition Classes
    PivotalConnectionDQConnection
  22. final def synchronized[T0](arg0: ⇒ T0): T0
    Definition Classes
    AnyRef
  23. final def wait(): Unit
    Definition Classes
    AnyRef
    Annotations
    @throws( ... )
  24. final def wait(arg0: Long, arg1: Int): Unit
    Definition Classes
    AnyRef
    Annotations
    @throws( ... )
  25. final def wait(arg0: Long): Unit
    Definition Classes
    AnyRef
    Annotations
    @throws( ... ) @native()

Inherited from Serializable

Inherited from Serializable

Inherited from Product

Inherited from Equals

Inherited from DQConnection

Inherited from AnyRef

Inherited from Any

Ungrouped