org.checkita.dqf.core.metrics.rdd.regular.BasicNumericRDDMetrics
SequenceCompletenessRDDMetricCalculator
case class SequenceCompletenessRDDMetricCalculator(uniqueValues: Set[Long], increment: Long, minVal: Long, maxVal: Long, failCount: Long = 0, status: CalculatorStatus = CalculatorStatus.Success, failMsg: String = "OK") extends RDDMetricCalculator with Product with Serializable
Calculates completeness of incremental integer (long) sequence, i.e. checks if sequence does not have missing elements. Works for single column only!
- uniqueValues
Set of unique values in a sequence
- increment
Sequence increment
- minVal
Minimum observed value in a sequence
- maxVal
Maximum observed value in a sequence
- returns
result map with keys: "SEQUENCE_COMPLETENESS"
- Alphabetic
- By Inheritance
- SequenceCompletenessRDDMetricCalculator
- Serializable
- Serializable
- Product
- Equals
- RDDMetricCalculator
- AnyRef
- Any
- Hide All
- Show All
- Public
- All
Instance Constructors
- new SequenceCompletenessRDDMetricCalculator(increment: Long)
-
new
SequenceCompletenessRDDMetricCalculator(uniqueValues: Set[Long], increment: Long, minVal: Long, maxVal: Long, failCount: Long = 0, status: CalculatorStatus = CalculatorStatus.Success, failMsg: String = "OK")
- uniqueValues
Set of unique values in a sequence
- increment
Sequence increment
- minVal
Minimum observed value in a sequence
- maxVal
Maximum observed value in a sequence
Value Members
-
final
def
!=(arg0: Any): Boolean
- Definition Classes
- AnyRef → Any
-
final
def
##(): Int
- Definition Classes
- AnyRef → Any
-
final
def
==(arg0: Any): Boolean
- Definition Classes
- AnyRef → Any
-
final
def
asInstanceOf[T0]: T0
- Definition Classes
- Any
-
def
clone(): AnyRef
- Attributes
- protected[lang]
- Definition Classes
- AnyRef
- Annotations
- @throws( ... ) @native()
-
def
copyWithError(status: CalculatorStatus, msg: String, failInc: Long = 1): RDDMetricCalculator
Copy calculator with error status and corresponding message.
Copy calculator with error status and corresponding message.
- status
Calculator status to copy with
- msg
Failure message
- failInc
Failure increment
- returns
Copy of this calculator with error status
- Attributes
- protected
- Definition Classes
- SequenceCompletenessRDDMetricCalculator → RDDMetricCalculator
-
final
def
eq(arg0: AnyRef): Boolean
- Definition Classes
- AnyRef
-
val
failCount: Long
- Attributes
- protected
- Definition Classes
- SequenceCompletenessRDDMetricCalculator → RDDMetricCalculator
-
val
failMsg: String
- Attributes
- protected
- Definition Classes
- SequenceCompletenessRDDMetricCalculator → RDDMetricCalculator
-
def
finalize(): Unit
- Attributes
- protected[lang]
- Definition Classes
- AnyRef
- Annotations
- @throws( classOf[java.lang.Throwable] )
-
final
def
getClass(): Class[_]
- Definition Classes
- AnyRef → Any
- Annotations
- @native()
-
def
getFailCounter: Long
Gets current metric failure counts
-
def
getFailMessage: String
Gets current failure or error message
-
def
getStatus: CalculatorStatus
Gets current metric calculator status
-
def
increment(values: Seq[Any]): RDDMetricCalculator
Safely updates metric calculator
Safely updates metric calculator
- values
values to process
- returns
updated calculator
- Definition Classes
- RDDMetricCalculator
- val increment: Long
-
final
def
isInstanceOf[T0]: Boolean
- Definition Classes
- Any
- val maxVal: Long
-
def
merge(m2: RDDMetricCalculator): RDDMetricCalculator
Merges two metric calculators together
Merges two metric calculators together
- m2
second metric calculator
- returns
merged metric calculator
- Definition Classes
- SequenceCompletenessRDDMetricCalculator → RDDMetricCalculator
- val minVal: Long
-
final
def
ne(arg0: AnyRef): Boolean
- Definition Classes
- AnyRef
-
final
def
notify(): Unit
- Definition Classes
- AnyRef
- Annotations
- @native()
-
final
def
notifyAll(): Unit
- Definition Classes
- AnyRef
- Annotations
- @native()
-
def
result(): Map[String, (Double, Option[String])]
Gets results of calculator in the current state
Gets results of calculator in the current state
- returns
Map of (result_name -> (result, additionalResults))
- Definition Classes
- SequenceCompletenessRDDMetricCalculator → RDDMetricCalculator
-
val
status: CalculatorStatus
- Attributes
- protected
- Definition Classes
- SequenceCompletenessRDDMetricCalculator → RDDMetricCalculator
-
final
def
synchronized[T0](arg0: ⇒ T0): T0
- Definition Classes
- AnyRef
-
def
tryToIncrement(values: Seq[Any]): RDDMetricCalculator
Increment metric calculator.
Increment metric calculator. May throw an exception.
- values
values to process
- returns
updated calculator or throws an exception
- Attributes
- protected
- Definition Classes
- SequenceCompletenessRDDMetricCalculator → RDDMetricCalculator
- val uniqueValues: Set[Long]
-
final
def
wait(): Unit
- Definition Classes
- AnyRef
- Annotations
- @throws( ... )
-
final
def
wait(arg0: Long, arg1: Int): Unit
- Definition Classes
- AnyRef
- Annotations
- @throws( ... )
-
final
def
wait(arg0: Long): Unit
- Definition Classes
- AnyRef
- Annotations
- @throws( ... ) @native()