North AmericaFull TimeEngineering
Remotely
awsllmproductionhealthcareagentic systemsragsagemakerbedrock
Job Description
📋 Description
- Design, implement, and continuously improve agent behavior across live, long-horizon, multi-turn
- Architect retrieval and context strategies that deliver the right source data to models in the
- Design memory and state-management approaches for multi-turn and multi-agent experiences
- Develop prompt and context templates using few-shot examples, structured formats, reasoning
- Improve agent performance through experimentation with prompting, tool-use strategies, retrieval
- Build production-representative evaluation suites and regression checks to measure accuracy
🎯 Requirements
- 8+ years of production software engineering experience, including at least 3 years of hands-on
- Professional experience working with AI systems in healthcare, finance, or another regulated
- Demonstrated ability to diagnose agent failures and determine whether improvements should come from
- Strong understanding of how to evaluate AI failures based on severity, risk, and cost rather than
- Hands-on experience designing and implementing RAG architectures and production-grounded evaluation
- Experience developing fallback mechanisms, human-in-the-loop workflows, escalation logic, or
🎁 Benefits
- Competitive compensation: $175,000–$200,000 per year.
- Meaningful technical ownership: Define how AI agent performance, safety, reliability, and
- High-impact scope: Influence prompts, retrieval, context, memory, evaluations, escalation patterns
- Mission-driven work: Contribute to technology designed to improve healthcare delivery and patient
- Remote-friendly culture: Flexible working environment designed to support distributed collaboration.
- Professional development: Employee-driven programs and initiatives supporting personal and career