System health

Live component status, recent incidents, and the exact build serving this workspace.

degraded
Components
9 subsystems checked continuously

  • REST API

    operational

  • gRPC server

    operational

  • PostgreSQL

    operational

  • Object storage (R2)

    operational

  • Job scheduler

    operational

  • Worker pool (14/14)

    operational

  • Model registry

    Elevated read latency after metadata migration; writes unaffected.

    degraded

  • Metrics service

    operational

  • Cleanup service

    Paused for retention policy rollout until 16:00 UTC.

    maintenance
Incidents
Most recent first

  • Elevated model registry latency

    monitoring

    Jul 30, 2026 05:00:00 · impact: Model metadata reads up to 400 ms; inference path unaffected.

    1. 2 months ago

      Investigating elevated p95 on registry reads.

    2. 2 months ago

      Identified: metadata migration lock contention. Mitigation deployed.

    3. 2 months ago

      Latency recovering; monitoring before resolving.

  • Staging classifier health check failures

    identified

    Jul 30, 2026 11:35:00 · impact: classifier-v1 unavailable in staging; production unaffected.

    1. 2 months ago

      Readiness probe failing on classifier-staging (3/3).

    2. 2 months ago

      Root cause identified: corrupted session cache after unload. Clearing and reloading.

Build information
Binary currently serving requests
Version
1.4.2
Commit
a4f9c2e
Built
2026-07-24
ONNX Runtime
1.19.2
OpenCV
4.10.0
Compiler
Clang 18.1.8 (-O3, LTO)