Packages

package core

Ordering
  1. Alphabetic
Visibility
  1. Public
  2. All

Type Members

  1. sealed trait CalculatorStatus extends EnumEntry

    Calculator Status enumeration.

    Calculator Status enumeration. Following statuses are possible:

    • Success: calculator run without errors and returned success.
    • Failure: calculator run without errors and returned failure.
    • Error: calculator thrown some errors.
  2. case class Source(id: String, df: DataFrame, keyFields: Seq[String] = Seq.empty, parents: Seq[String] = Seq.empty, checkpoint: Option[Checkpoint] = None) extends Product with Serializable

    Data Quality Source definition

    Data Quality Source definition

    id

    Source ID

    df

    Spark dataframe with source data

    keyFields

    Key fields (columns) of this source: uniquely define data row

    parents

    Sequence of parent sources IDs from which this source is build (applies to virtual sources)

    checkpoint

    Initial source checkpoint. Applicable only for streaming sources.

    Note

    Source can hold both static and streaming dataframes and, therefore, both batch source readers and stream source readers return same source definition.

Value Members

  1. object CalculatorStatus extends Enum[CalculatorStatus]
  2. object Results
  3. object Source extends Serializable