How to Detect a Drop to Zero in Segment Size
Suppose you have data coming from a number of sources, and you'd like to know if one of them shuts down, you can create a SegmentSizeDrift verse which will check if the segment size from a specific source dropped to zero.
{
"YOUR-USER-ID": {
"TEXT": {
"fields": {...},
"stanzas": {
"name_of_stanza": {
"metrics": [],
"segment_by": [
"source_of_text"
],
"verses": [
{
"type": "SegmentSizeDrift",
"min_anomaly_level": 1,
"use_relative_sizes": true,
"trend_directions": [
"desc"
],
"min_segment_size":0,
"traget_min_segment_size": 0
}
]
}
}
}
}
}
In this example we are looking for drifts in the size of segments, segmented according to the "source_of_text". Since we are not tracking a specific metric, but the size of the segments, the metrics param is left empty. By using the "use_relative_sizes" param set as true we use the segment's relative sizes in the relevant baseline segment. The trend_direction will filter only drops in the size of segment. Since we are trying to track if a segment drops to 0 in size, we need to set both the min_segment_size and traget_min_segment_size to 0 in order to catch this anomaly. Lastly the min_anomaly_level will only alert us on drops of 100 percent of the segment size.
Updated about 2 years ago