Senior Software Engineer, Agent Eval Platform

📋 Description

• Build the judgement layer of our agent evaluation platform, including rubrics, validators, and
• Develop an orchestration runtime to execute multi-turn agent scenarios at scale with environment
• Advance agent observability with OpenTelemetry-native tracing and a queryable trajectory data model.
• Create stateful simulations of enterprise systems with hermetic per-run isolation and reproducible

🎯 Requirements

• 5+ years building production backend or infrastructure systems
• Strong in Python or Go (ideally both)
• Experience designing and operating systems that handle real traffic at scale
• Comfort turning fuzzy agent behavior into measurable signals
• Comfort with ambiguity; solving novel problems without textbook solutions

🎁 Benefits

• Health plans, 401(k) with company match, ESPP
• Equity where applicable, flexible time away, family leave programs