What you'll do
- Sampling and gold‑set strategy
- Consensus rules; dispute resolution
- CI test sets and drift monitoring
What we're looking for
- Experience with retrieval systems
- QA/labeling ops background
- Metric discipline
Where this role fits
This role sits in the LLM Infra & MLOps TalentZone and commonly supports packs like Cost & Quality Sprint and Guardrail & Reg Audit. Work is routed under QA; this is a managed bench, not a marketplace.