# Data annotation vendor comparison worksheet

Use the same six fields for every vendor response before labels enter production files.

| Field | Vendor A | Vendor B | Risk note |
|---|---|---|---|
| Sample design |  |  |  |
| Label rules |  |  |  |
| Language fit |  |  |  |
| Review sample |  |  |  |
| Output test |  |  |  |
| Rework rule |  |  |  |

## What good answers include

- Sample design names count, format, and representative edge cases.
- Label rules include examples, rejected labels, and unclear-item handling.
- Language fit separates script, dialect, region, and subject review.
- Review sample names percentage or item count before the first full batch.
- Output test confirms one delivery file opens in the client's platform.
- Rework rule states what counts as a defect and how corrected labels return.