Which decisions should a person review?
A model labels 100 products. A reviewer can check 30 today. Raise the confidence cutoff and watch what happens to the queue and the errors that get through.
| Confidence | Labels | Errors | Decision |
|---|---|---|---|
| 60% | 10 | 4 | Review |
| 75% | 20 | 5 | Publish |
| 85% | 20 | 3 | Publish |
| 95% | 30 | 2 | Publish |
| 99% | 20 | 0 | Publish |
10Sent to review
0Waiting tomorrow
10Errors auto-published
The reviewer has 20 open slots. Try a higher cutoff and see how many more errors you can keep out of the published batch.
Labels at the cutoff publish automatically. A reviewer corrects every error they inspect in this exercise. Queued labels stay on hold until checked.