Senior Software Engineer in Test (AI Agentic Systems)

📋 Description

• Own quality for an LLM-based multi-agent pipeline that adjudicates health insurance claims for
• Build a Three-Tier Evaluation Framework to ensure Gemini-powered agents reason, call tools, and
• Work at the intersection of Vertex AI, healthcare compliance, and high-scale data engineering to

🎯 Requirements

• 5+ years of experience in software testing and development.
• Python SDET expertise: Python and pytest; experience building custom mocking frameworks for
• AI/LLM observability: Vertex AI Experiments, Auto-SxS, and Cloud Logging for trace analysis.
• Data literacy: SQL (BigQuery) and Pandas; ability to diff large datasets and find adjudication
• Prompt engineering for QA and architectural testing for multi-layer systems (RAG, LangGraph

🎁 Benefits

• Hybrid position based out of Lehi, UT or Plano, TX offices; in-office at least two weekdays per
• Pay ranges vary by location; Lehi: $99,200 – $124,000 USD; Plano: $109,120 – $136,400 USD.
• Stock options and benefits including health insurance, 401k, and PTO; more details at