Type Members

1.  case class AvgStringDFMetricCalculator(metricId: String, columns: Seq[String]) extends DFMetricCalculator with Product with Serializable

   Calculates average string length of processed elements

   Calculates average string length of processed elements

   metricId

   Id of the metric.

   columns

   Sequence of columns which are used for metric calculation

   Note

   Null values are omitted: For values: "foo", "bar-buz", null Metric result would be: (3 + 7) / 2 = 5

2.  case class CompletenessDFMetricCalculator(metricId: String, columns: Seq[String], includeEmptyStrings: Boolean, reversed: Boolean) extends DFMetricCalculator with ReversibleDFCalculator with Product with Serializable

   Calculates completeness of values in the specified columns

   Calculates completeness of values in the specified columns

   metricId

   Id of the metric.

   columns

   Sequence of columns which are used for metric calculation

   includeEmptyStrings

   Flag which sets whether empty strings are considered in addition to null values.

   reversed

   Boolean flag indicating whether error collection logic should be reversed for this metric

3.  case class EmptinessDFMetricCalculator(metricId: String, columns: Seq[String], includeEmptyStrings: Boolean, reversed: Boolean) extends ConditionalDFCalculator with Product with Serializable

   Calculates emptiness of values in the specified columns, i.e.

   Calculates emptiness of values in the specified columns, i.e. percentage of null values or empty values (if configured to account for empty values).

   metricId

   Id of the metric.

   columns

   Sequence of columns which are used for metric calculation

   includeEmptyStrings

   Flag which sets whether empty strings are considered in addition to null values.

   reversed

   Boolean flag indicating whether error collection logic should be reversed for this metric

4.  case class EmptyValuesDFMetricCalculator(metricId: String, columns: Seq[String], reversed: Boolean) extends ConditionalDFCalculator with Product with Serializable

   Calculates amount of empty strings in processed elements.

   Calculates amount of empty strings in processed elements.

   metricId

   Id of the metric.

   columns

   Sequence of columns which are used for metric calculation.

   reversed

   Boolean flag indicating whether error collection logic should be reversed for this metric

5.  case class FormattedDateDFMetricCalculator(metricId: String, columns: Seq[String], dateFormat: String, reversed: Boolean) extends ConditionalDFCalculator with Product with Serializable

   Calculates amount of strings in provided date format.

   Calculates amount of strings in provided date format.

   metricId

   Id of the metric.

   columns

   Sequence of columns which are used for metric calculation

   dateFormat

   Requested date format

   reversed

   Boolean flag indicating whether error collection logic should be reversed for this metric

6.  case class MaxStringDFMetricCalculator(metricId: String, columns: Seq[String]) extends DFMetricCalculator with Product with Serializable

   Calculates maximum string length of processed elements

   Calculates maximum string length of processed elements

   metricId

   Id of the metric.

   columns

   Sequence of columns which are used for metric calculation

7.  case class MinStringDFMetricCalculator(metricId: String, columns: Seq[String]) extends DFMetricCalculator with Product with Serializable

   Calculates minimal string length of processed elements

   Calculates minimal string length of processed elements

   metricId

   Id of the metric.

   columns

   Sequence of columns which are used for metric calculation

8.  case class NullValuesDFMetricCalculator(metricId: String, columns: Seq[String], reversed: Boolean) extends ConditionalDFCalculator with Product with Serializable

   Calculates amount of null values in processed elements

   Calculates amount of null values in processed elements

   metricId

   Id of the metric.

   columns

   Sequence of columns which are used for metric calculation

   reversed

   Boolean flag indicating whether error collection logic should be reversed for this metric

9.  case class RegexMatchDFMetricCalculator(metricId: String, columns: Seq[String], regex: String, reversed: Boolean) extends ConditionalDFCalculator with Product with Serializable

   Calculates amount of values that match the provided regular expression

   Calculates amount of values that match the provided regular expression

   metricId

   Id of the metric.

   columns

   Sequence of columns which are used for metric calculation

   regex

   Regex pattern

   reversed

   Boolean flag indicating whether error collection logic should be reversed for this metric

10.  case class RegexMismatchDFMetricCalculator(metricId: String, columns: Seq[String], regex: String, reversed: Boolean) extends ConditionalDFCalculator with Product with Serializable

    Calculates amount of values that do not match the provided regular expression

    Calculates amount of values that do not match the provided regular expression

    metricId

    Id of the metric.

    columns

    Sequence of columns which are used for metric calculation

    regex

    Regex pattern

    reversed

    Boolean flag indicating whether error collection logic should be reversed for this metric

11.  case class StringInDomainDFMetricCalculator(metricId: String, columns: Seq[String], domain: Set[String], reversed: Boolean) extends ConditionalDFCalculator with Product with Serializable

    Calculates amount of strings that are within provided domain

    Calculates amount of strings that are within provided domain

    metricId

    Id of the metric.

    columns

    Sequence of columns which are used for metric calculation

    domain

    Set of strings that represents the requested domain

    reversed

    Boolean flag indicating whether error collection logic should be reversed for this metric

12.  case class StringLengthDFMetricCalculator(metricId: String, columns: Seq[String], compareLength: Int, compareRule: String, reversed: Boolean) extends ConditionalDFCalculator with Product with Serializable

    Calculates amount of strings with specific requested length.

    Calculates amount of strings with specific requested length.

    metricId

    Id of the metric.

    columns

    Sequence of columns which are used for metric calculation

    compareLength

    Requested length

    compareRule

    Comparison rule. Could be:

    • "eq" - equals to,
    • "lt" - less than,
    • "lte" - less than or equals to,
    • "gt" - greater than,
    • "gte" - greater than or equals to.

    reversed

    Boolean flag indicating whether error collection logic should be reversed for this metric

13.  case class StringOutDomainDFMetricCalculator(metricId: String, columns: Seq[String], domain: Set[String], reversed: Boolean) extends ConditionalDFCalculator with Product with Serializable

    Calculates amount of strings that are out of provided domain.

    Calculates amount of strings that are out of provided domain.

    metricId

    Id of the metric.

    columns

    Sequence of columns which are used for metric calculation

    domain

    Set of strings that represents the requested domain

    reversed

    Boolean flag indicating whether error collection logic should be reversed for this metric

14.  case class StringValuesDFMetricCalculator(metricId: String, columns: Seq[String], compareValue: String, reversed: Boolean) extends ConditionalDFCalculator with Product with Serializable

    Counts number of appearances of requested string in processed elements

    Counts number of appearances of requested string in processed elements

    metricId

    Id of the metric.

    columns

    Sequence of columns which are used for metric calculation

    compareValue

    Requested string to find

    reversed

    Boolean flag indicating whether error collection logic should be reversed for this metric