Accuracy
The operator measured: 7 replayed days, Wed to Tue. Measured against 391 injected incidents (incidents_truth) between the operator's first and last tick, Wed 06:00 to Tue 18:00 UTC, 7 replayed days. Incidents from before it was switched on are not counted. A detection matches a planted incident of the same kind, on the same shipment or container, within 20 minutes.Precision0.914421 detections
Recall0.967of 391 injected
Resolved automatically89.5%auto rate, 7-day mean
Reverted by people0actions a person undid
Cost per resolved incidentUSD 0.00417 resolved · USD 0.00 model spend
Weakest detectorreefer excursionprecision 0.789: 15 of 19 right · the red line
Time to resolve1 h 47 minmean, from the problem's start to the action that resolved it · 1 h 24 min when a person decides
Precision per detector, per day
the busiest detectors and the weakest one (red); the rest are in the table belowReverted actions
who undid the operator, and why| When (UTC) | Shipment | Kind and call | By | Why | |
|---|---|---|---|---|---|
| No reverts in this window. | |||||
Drift alarms
precision down 15 pts week on week| Tue | green | all detectors | Week-on-week alarms need 14 replayed days; the ledger has 7. waiting for data |
| Tue | green | model | No drift: answers usable, confidence steady, few reverts. recal.drift |
Per detector, 7 days
precision: of what it flagged, how much was a planted incident| Detector | Detections | Precision | Reports |
|---|---|---|---|
| bl_held_unpaid | 25 | 1.000 | bl_held_unpaid |
| container_number_mismatch | 20 | 1.000 | container_number_mismatch |
| customs_hold | 51 | 1.000 | customs_hold |
| duplicate_booking | 15 | 0.800 | duplicate_booking |
| eta_slipped | 113 | 0.885 | eta_slipped |
| free_time_expiring | 53 | 1.000 | free_time_expiring |
| hs_code_mismatch | 79 | 0.797 | hs_code_mismatch |
| missed_delivery_appointment | 23 | 1.000 | missed_delivery_appointment |
| reefer_excursion | 19 | 0.789 | reefer_excursion |
| vessel_rolled | 23 | 1.000 | vessel_rolled |
Planted incidents, by kind
recall: of what was planted, how much it found; the counts add up to 391| Planted kind | Planted | Found | Recall | Reported by |
|---|---|---|---|---|
| eta_slipped | 100 | 100 | 1.000 | eta_slipped |
| hs_code_mismatch | 71 | 63 | 0.887 | hs_code_mismatch |
| free_time_expiring | 53 | 53 | 1.000 | free_time_expiring |
| customs_hold | 51 | 51 | 1.000 | customs_hold |
| vessel_rolled | 24 | 23 | 0.958 | vessel_rolled |
| missed_delivery_appointment | 23 | 23 | 1.000 | missed_delivery_appointment |
| container_number_mismatch | 20 | 20 | 1.000 | container_number_mismatch |
| bl_held_unpaid | 18 | 18 | 1.000 | bl_held_unpaid |
| reefer_excursion | 18 | 15 | 0.833 | reefer_excursion |
| duplicate_booking | 13 | 12 | 0.923 | duplicate_booking |
| total | 391 | 378 | 0.967 |