🌎North AmericaFull TimeSoftware Development
- Employee
Listed on 2 job boards, which is a stronger signal than one board alone.
Job Description
📋 Description
- Design and lead an end-to-end evaluation framework for planner-executor agents, covering scenario
- Define scenario schemas, grading specifications, and validation processes in collaboration with
- Develop an LLM-powered user simulator capable of realistic multi-turn conversations, using hidden
- Build isolated, parallel experiment execution systems with configurable runs and…
pythonllmstatisticsdatainference optimizationai agentsevaluationlangsmithlangfuse
Match
Sign in and add your skills to see how well you match this role.
Tailor your CV to this jobPro
Pro rewrites your CV bullets for this job and checks every line against your CV, dropping anything it can't back up.
See ProAlso available on
Back to all jobs