package load
Type Members
-
final
case class
ColumnsExistsLoadCheckCalculator(checkId: String, requiredColumns: Seq[String]) extends LoadCheckCalculator with Product with Serializable
Columns exists
load check calculator: verifies if source contains required columnsColumns exists
load check calculator: verifies if source contains required columns- checkId
Load check ID
- requiredColumns
Sequence of required columns
-
final
case class
ExactColNumLoadCheckCalculator(checkId: String, requiredColNum: Int) extends LoadCheckCalculator with Product with Serializable
Exact column number
load check calculator: verifies if number of columns in the source is equal to required one.Exact column number
load check calculator: verifies if number of columns in the source is equal to required one.- checkId
Load check ID
- requiredColNum
Required number of columns.
- Note
Counts top level columns only.
-
final
case class
MinColNumLoadCheckCalculator(checkId: String, requiredColNum: Int) extends LoadCheckCalculator with Product with Serializable
Min column number
load check calculator: verifies if number of columns in the source greater than or equal to required one.Min column number
load check calculator: verifies if number of columns in the source greater than or equal to required one.- checkId
Load check ID
- requiredColNum
Minimum required number of columns.
-
final
case class
SchemaMatchLoadCheckCalculator(checkId: String, schemaId: String, ignoreOrder: Boolean) extends LoadCheckCalculator with Product with Serializable
Schema match
load check calculator: verifies if source schema matches required schema (defined in schemas section of job configuration and referenced by its ID)Schema match
load check calculator: verifies if source schema matches required schema (defined in schemas section of job configuration and referenced by its ID)- checkId
Load check ID
- schemaId
Sequence of required columns