North AmericaFull TimeEngineering
Remotely
product managementai evaluationaihuman in the loopdata driventelemetrycross functionalfeedback taxonomy
Job Description
📋 Description
- Own the evaluation and feedback backbone for AI-powered support products.
- Design end-to-end AI product evaluation ecosystem (auto evals, human-in-loop).
- Coordinate across Product, AI/ML Eng, Data & Telemetry, AI Ops.
- Drive structured feedback taxonomy for continuous product improvement.
- Develop a closed-loop process to translate feedback into product improvements.
🎯 Requirements
- 15+ years in product management with AI/ML/Agent experience.
- Experience designing structured feedback systems (golden datasets, sampling, HIL).
- Strong data-driven decision skills; metrics and telemetry literacy.
- Cross-functional leadership without direct authority.
- Experience in customer support or service delivery is a plus.
- Excellent stakeholder management and communication to align execs and teams.
🎁 Benefits
- Base pay: $221,200 - $387,100 plus equity, variable compensation and benefits.
- Health plans, 401(k) with match, ESPP, donations matching, flexible time away, family leave.
