Online monitoring

Online evaluation samples live runs, scores them with the same scorers used offline, and watches the trend so a regression shows up before a customer reports it.

Under construction

This page is planned and not yet written, because the capability it describes is not yet generally available. The structure is here so you can see where it fits; the notice comes off when it ships.

What this page will cover

• Sampling policy and cost controls.
• Monitors and thresholds.
• Where alerts land.

Meanwhile

• Audit and evidence explains the execution trace these scores are computed from.