Staff Technical Product Manager – AI/LLM expertise + AI Evaluation Science

📋 Description

• Lead AI Evaluation as a core engineering capability across the DT organization; drive adoption of
• Partner with ServiceNow AI platform and product teams to implement and validate out-of-the-box
• Identify gaps in platform evaluation capabilities; define and develop custom Evals, metrics
• Establish Eval-Driven Development as standard engineering practice; shift AI quality to continuous
• Embed Evals into the full AI lifecycle: Define → Measure → Build → Evaluate → Improve → Release →
• Enable continuous evaluation in production and establish coverage/quality thresholds for AI

🎯 Requirements

• Experience integrating AI into work processes, decision-making, or problem-solving with AI-powered
• 10+ years in Product Management with a focus on AI.
• Technically strong PM who blends AI/LLM expertise with Evaluation Science, Quality Engineering
• Experience with LLM-as-a-Judge, rubrics, evaluation datasets, agent evaluation, AI observability
• ServiceNow AI Platform experience is a huge plus.

🎁 Benefits

• Flexible work persona options; distributed/work-from-anywhere arrangements where eligible.
• Inclusive, equal opportunity employer with accommodations available for applicants requiring them.