Production AI

Synthetic worker latency fixture: worker A has 100 requests at one second, worker B has 900 at ten seconds; the combined nearest-rank p95 is ten seconds.

Averaging your agents' p95 latencies gives you the wrong percentile

Worker percentiles discard the distribution you need for a service percentile. A reproducible fixture shows the error and a histogram query shows what to aggregate instead.

Two synthetic agent policies: broad coverage answers 900 of 1000 requests; cautious coverage answers 400, leaving 600 for another route.

Your agent got more accurate by answering fewer questions

An agent can raise its answer accuracy by refusing more work. Report the accepted answers, the rejected requests and the review queue together before changing its threshold.