abstract class CheckCalculator extends AnyRef
Base Check Calculator
- Alphabetic
- By Inheritance
- CheckCalculator
- AnyRef
- Any
- Hide All
- Show All
- Public
- All
Instance Constructors
- new CheckCalculator()
Abstract Value Members
- abstract val baseMetric: String
- abstract val checkId: String
- abstract val checkName: CheckName
- abstract val compareMetric: Option[String]
-
abstract
def
getDetailsMsg(compareMetricResult: Option[MetricCalculatorResult]): Option[String]
Gets check details message to insert into final check message.
Gets check details message to insert into final check message.
- compareMetricResult
Compare metric result
- returns
Check details message
- Attributes
- protected
-
abstract
def
resultOnError(err: Throwable, baseMetricResults: Seq[MetricCalculatorResult], compareMetricResults: Option[Seq[MetricCalculatorResult]]): CheckCalculatorResult
Callback method that process possible runtime error that can be thrown during check evaluation.
Callback method that process possible runtime error that can be thrown during check evaluation.
- err
Error thrown during check evaluation
- baseMetricResults
Sequence of base metric result for metric ID referenced by this check
- compareMetricResults
Sequence of compare metric result for compareMetric ID referenced by this check
- returns
Check result with Error status and captured error message
- Attributes
- protected
- Note
TopN metric yields multiple results
-
abstract
def
resultOnMetricNotFound: CheckCalculatorResult
Callback method that is used when metric results are not found for metric ID referenced in this check
Callback method that is used when metric results are not found for metric ID referenced in this check
- returns
Check result with Error status and 'not found' error message
- Attributes
- protected
-
abstract
def
tryToRun(baseMetricResults: Seq[MetricCalculatorResult], compareMetricResults: Option[Seq[MetricCalculatorResult]])(implicit jobId: String, manager: Option[DqStorageManager], settings: AppSettings, spark: SparkSession, fs: FileSystem): CheckCalculatorResult
Runs the check for the given metric results.
Runs the check for the given metric results.
- baseMetricResults
Sequence of base metric result for metric ID referenced by this check
- compareMetricResults
Sequence of compare metric result for compareMetric ID referenced by this check
- jobId
Current Job ID
- manager
Implicit storage manager used to load historical results
- settings
Implicit application settings
- spark
Implicit spark session object
- fs
Implicit hadoop filesystem object
- returns
Check evaluation result with either Success or Failure status
- Attributes
- protected
- Note
TopN metric yields multiple results
-
abstract
def
windowString: Option[String]
- Attributes
- protected
Concrete Value Members
-
final
def
!=(arg0: Any): Boolean
- Definition Classes
- AnyRef → Any
-
final
def
##(): Int
- Definition Classes
- AnyRef → Any
-
final
def
==(arg0: Any): Boolean
- Definition Classes
- AnyRef → Any
-
final
def
asInstanceOf[T0]: T0
- Definition Classes
- Any
-
def
clone(): AnyRef
- Attributes
- protected[lang]
- Definition Classes
- AnyRef
- Annotations
- @throws( ... ) @native()
-
final
def
eq(arg0: AnyRef): Boolean
- Definition Classes
- AnyRef
-
def
equals(arg0: Any): Boolean
- Definition Classes
- AnyRef → Any
-
def
errorMsg(e: Throwable): String
Generates error message provided with caught error.
Generates error message provided with caught error.
- e
Error that has been caught
- returns
Error message
- Attributes
- protected
-
def
finalize(): Unit
- Attributes
- protected[lang]
- Definition Classes
- AnyRef
- Annotations
- @throws( classOf[java.lang.Throwable] )
-
final
def
getClass(): Class[_]
- Definition Classes
- AnyRef → Any
- Annotations
- @native()
-
def
getMessage(baseMetricResult: MetricCalculatorResult, compareMetricResult: Option[MetricCalculatorResult], status: CalculatorStatus, statusString: String): String
Generates comprehensive check message
Generates comprehensive check message
- baseMetricResult
Base metric result
- compareMetricResult
Compare metric result
- status
Check evaluation status
- statusString
Check evaluation status string
- returns
Check message
- Attributes
- protected
-
def
getOptionHead(resSeq: Option[Seq[MetricCalculatorResult]]): Option[MetricCalculatorResult]
Safely gets head out of optional sequence of metric calculator results.
Safely gets head out of optional sequence of metric calculator results.
- resSeq
Optional sequence of metric calculator results
- returns
Optional metric calculator result
- Attributes
- protected
-
def
hashCode(): Int
- Definition Classes
- AnyRef → Any
- Annotations
- @native()
-
final
def
isInstanceOf[T0]: Boolean
- Definition Classes
- Any
-
final
def
ne(arg0: AnyRef): Boolean
- Definition Classes
- AnyRef
-
val
notFoundErrMsg: String
- Attributes
- protected
-
final
def
notify(): Unit
- Definition Classes
- AnyRef
- Annotations
- @native()
-
final
def
notifyAll(): Unit
- Definition Classes
- AnyRef
- Annotations
- @native()
-
def
run(metricResults: MetricResults)(implicit jobId: String, manager: Option[DqStorageManager], settings: AppSettings, spark: SparkSession, fs: FileSystem): CheckCalculatorResult
Safely runs check provided with all the metric calculators results.
Safely runs check provided with all the metric calculators results. There are three scenarios covered:
- Check evaluates normally and returns either Success or Failure status (depending on whether check condition was met)
- Check evaluation throws runtime error: check result with Error status and corresponding error message is returned.
- Metric results are not found for metric ID defined in the check: check cannot be run at all and check result with Error status and corresponding message is returned.
- metricResults
All computed metrics
- jobId
Current Job ID
- manager
Implicit storage manager used to load historical results
- settings
Implicit application settings
- spark
Implicit spark session object
- fs
Implicit hadoop filesystem object
- returns
Check result
-
final
def
synchronized[T0](arg0: ⇒ T0): T0
- Definition Classes
- AnyRef
-
def
toString(): String
- Definition Classes
- AnyRef → Any
-
final
def
wait(): Unit
- Definition Classes
- AnyRef
- Annotations
- @throws( ... )
-
final
def
wait(arg0: Long, arg1: Int): Unit
- Definition Classes
- AnyRef
- Annotations
- @throws( ... )
-
final
def
wait(arg0: Long): Unit
- Definition Classes
- AnyRef
- Annotations
- @throws( ... ) @native()