Staff Technical Product Manager – AI Quality and Evaluation
ServiceNowRemotely
llmquality engineeringaievaluationplatform strategyci/cdai observability
Job Description
📋 Description
- Establish and scale AI Evaluation as a core engineering capability
- Lead Eval-driven development across AI lifecycle
- Define platform eval strategy and adoption with AI teams
- Identify gaps and define custom Evals, metrics, rubrics
- Create reusable Evals for domain-specific outcomes
- Embed Evals into development, regression, and release workflows
🎯 Requirements
- 10+ years in Product Management with AI focus
- Technically strong PM with AI/LLM, Evaluation Science, Quality Engineering, Platform Strategy
- Experience with LLM-as-a-Judge, rubrics, evaluation datasets, agent evaluation, AI observability
- Experience with developer platforms; ServiceNow AI Platform a plus
Back to all jobs
