- Employee
Job Description
📋 Description
- Build and own AI evaluation infrastructure, CI/CD pipelines, scorers, and datasets.
- Diagnose quality failures across the agent pipeline and identify fixes.
- Grow evaluation datasets with annotation workflows and simulated conversations.
- Run structured experiments on prompts, models, and the agent harness.
- Lead and grow the AI Quality engineering team, setting technical…
pythonmachine learningllmruby on railsobservabilityci/cdevaluation frameworks
Match
Sign in and add your skills to see how well you match this role.
Tailor your CV to this jobPro
Pro rewrites your CV bullets for this job and checks every line against your CV, dropping anything it can't back up.
See ProBack to all jobs