Machine Learning - Monitoring

Key areas

  • System: latency, throughput, error rates, saturation.
  • Model: score distributions, confidence, data/label drift.
  • Business: acceptance rate, conversions, risk thresholds.

Logging predictions

# Pseudocode for a logging middleware
# log = {"request_id": rid, "features": x_hash, "prediction": y, "score": p, "ts": now()}
# emit(log)