Staff Technical Product Manager – AI Evaluation
ServiceNowRemotely
llmobservabilityaievaluationplatform strategyci/cdai platform
Job Description
📋 Description
- Lead and scale AI Evaluation as a core engineering capability across the DT organization.
- Partner with ServiceNow AI platform and product teams to drive adoption of out-of-the-box Evals and
- Define custom Evals, metrics, rubrics, datasets, and evaluation strategies for enterprise AI apps
- Embed Evals into the full AI lifecycle: Define → Measure → Build → Evaluate → Improve → Release →
- Establish Eval-based quality gates and enable continuous evaluation in production.
🎯 Requirements
- Experience in leveraging AI in work processes and solving real problems with AI-powered tools.
- 10+ years in Product Management with a focus on AI.
- Technically strong PM combining AI/LLM expertise, evaluation science, quality engineering, product
- Experience with LLM-as-a-Judge, rubrics, evaluation datasets, agent evaluation, AI observability
- ServiceNow AI Platform experience is a plus.
🎁 Benefits
- Note: Benefits information is typically provided in the official job posting or Careers page; refer
Back to all jobs