San FranciscoFull TimeManagement
Remotely
productevaluationroadmapapexmlswebenchmarkleaderboardds
Job Description
📋 Description
- Own roadmap and portfolio strategy for APEX benchmarks
- Manage intake for new benchmarks across researchers and customers
- Ensure evaluation integrity and transparent methodology
- Build end-to-end eval pipelines from runs to results
- Collaborate with labs, customers, and GTM for adoption
- Track ROI and drive business impact
🎯 Requirements
- 5+ years in product mgmt, technical PM, or customer-facing tech role
- Experience with rubric design, inter-rater reliability, contamination, overfitting
- Ability to publish neutral, precise numbers
- Strong instincts on which capabilities to measure
- Entrepreneurial mindset with high ownership
- Ability to self-direct in ambiguous contexts and align stakeholders
🎁 Benefits
- Bi-annual performance bonus
- Generous equity grant over 4 years
- Relocation bonus up to $15k
- $10k housing bonus near office
- $1.5k monthly meals stipend
- Medical, dental, vision insurance
Back to all jobs