case class TDigestRDDMetricCalculator(tdigest: TDigest, accuracyError: Double, targetSideNumber: Double, failCount: Long = 0, status: CalculatorStatus = CalculatorStatus.Success, failMsg: String = "OK") extends RDDMetricCalculator with Product with Serializable
Calculates percentiles, quantiles for provided elements with use of TDigest library https://github.com/isarn/isarn-sketches
Works for single column only!
- tdigest
Initial TDigest object
- accuracyError
Required level of calculation accuracy
- targetSideNumber
Required parameter. For quantiles should be in [0,1]
- returns
result map with keys:
- "GET_QUANTILE"
- "GET_PERCENTILE"
- "FIRST_QUANTILE"
- "THIRD_QUANTILE"
- "MEDIAN_VALUE"
- Alphabetic
- By Inheritance
- TDigestRDDMetricCalculator
- Serializable
- Serializable
- Product
- Equals
- RDDMetricCalculator
- AnyRef
- Any
- Hide All
- Show All
- Public
- All
Instance Constructors
- new TDigestRDDMetricCalculator(accuracyError: Double, targetSideNumber: Double)
-
new
TDigestRDDMetricCalculator(tdigest: TDigest, accuracyError: Double, targetSideNumber: Double, failCount: Long = 0, status: CalculatorStatus = CalculatorStatus.Success, failMsg: String = "OK")
- tdigest
Initial TDigest object
- accuracyError
Required level of calculation accuracy
- targetSideNumber
Required parameter. For quantiles should be in [0,1]
Value Members
-
final
def
!=(arg0: Any): Boolean
- Definition Classes
- AnyRef → Any
-
final
def
##(): Int
- Definition Classes
- AnyRef → Any
-
final
def
==(arg0: Any): Boolean
- Definition Classes
- AnyRef → Any
- val accuracyError: Double
-
final
def
asInstanceOf[T0]: T0
- Definition Classes
- Any
-
def
clone(): AnyRef
- Attributes
- protected[lang]
- Definition Classes
- AnyRef
- Annotations
- @throws( ... ) @native()
-
def
copyWithError(status: CalculatorStatus, msg: String, failInc: Long = 1): RDDMetricCalculator
Copy calculator with error status and corresponding message.
Copy calculator with error status and corresponding message.
- status
Calculator status to copy with
- msg
Failure message
- failInc
Failure increment
- returns
Copy of this calculator with error status
- Attributes
- protected
- Definition Classes
- TDigestRDDMetricCalculator → RDDMetricCalculator
-
final
def
eq(arg0: AnyRef): Boolean
- Definition Classes
- AnyRef
-
val
failCount: Long
- Attributes
- protected
- Definition Classes
- TDigestRDDMetricCalculator → RDDMetricCalculator
-
val
failMsg: String
- Attributes
- protected
- Definition Classes
- TDigestRDDMetricCalculator → RDDMetricCalculator
-
def
finalize(): Unit
- Attributes
- protected[lang]
- Definition Classes
- AnyRef
- Annotations
- @throws( classOf[java.lang.Throwable] )
-
final
def
getClass(): Class[_]
- Definition Classes
- AnyRef → Any
- Annotations
- @native()
-
def
getFailCounter: Long
Gets current metric failure counts
-
def
getFailMessage: String
Gets current failure or error message
-
def
getStatus: CalculatorStatus
Gets current metric calculator status
-
def
increment(values: Seq[Any]): RDDMetricCalculator
Safely updates metric calculator
Safely updates metric calculator
- values
values to process
- returns
updated calculator
- Definition Classes
- RDDMetricCalculator
-
final
def
isInstanceOf[T0]: Boolean
- Definition Classes
- Any
-
def
merge(m2: RDDMetricCalculator): RDDMetricCalculator
Merges two metric calculators together
Merges two metric calculators together
- m2
second metric calculator
- returns
merged metric calculator
- Definition Classes
- TDigestRDDMetricCalculator → RDDMetricCalculator
-
final
def
ne(arg0: AnyRef): Boolean
- Definition Classes
- AnyRef
-
final
def
notify(): Unit
- Definition Classes
- AnyRef
- Annotations
- @native()
-
final
def
notifyAll(): Unit
- Definition Classes
- AnyRef
- Annotations
- @native()
-
def
result(): Map[String, (Double, Option[String])]
Gets results of calculator in the current state
Gets results of calculator in the current state
- returns
Map of (result_name -> (result, additionalResults))
- Definition Classes
- TDigestRDDMetricCalculator → RDDMetricCalculator
-
val
status: CalculatorStatus
- Attributes
- protected
- Definition Classes
- TDigestRDDMetricCalculator → RDDMetricCalculator
-
final
def
synchronized[T0](arg0: ⇒ T0): T0
- Definition Classes
- AnyRef
- val targetSideNumber: Double
- val tdigest: TDigest
-
def
tryToIncrement(values: Seq[Any]): RDDMetricCalculator
Increment metric calculator.
Increment metric calculator. May throw an exception.
- values
values to process
- returns
updated calculator or throws an exception
- Attributes
- protected
- Definition Classes
- TDigestRDDMetricCalculator → RDDMetricCalculator
-
final
def
wait(): Unit
- Definition Classes
- AnyRef
- Annotations
- @throws( ... )
-
final
def
wait(arg0: Long, arg1: Int): Unit
- Definition Classes
- AnyRef
- Annotations
- @throws( ... )
-
final
def
wait(arg0: Long): Unit
- Definition Classes
- AnyRef
- Annotations
- @throws( ... ) @native()