North AmericaFull TimeEngineering
Remotely
pythonawsllmobservabilityapisembeddingsretrieval
Job Description
📋 Description
- Design and deliver production AI and agentic systems
- Architect LLM-based systems: retrieval, tool use, orchestration, memory
- Own evals and observability for production AI
- Manage cost and latency at production scale
- Collaborate with product and data engineering on pipelines and data quality
- Mentor engineers and evaluate vendors/models
🎯 Requirements
- 6+ years software engineering; 2+ years shipping LLM/ML systems
- Experience building/deploying agentic systems with tool use and workflows
- Strong Python; production-grade coding, testing, deployment
- Hands-on with LLM APIs (Anthropic, OpenAI, AWS Bedrock, etc.)
- Production evals/observability for LLMs; measure accuracy and monitor drift
- Experience with retrieval systems (RAG), vector DBs, embeddings
🎁 Benefits
- Remote-first team; flexible work arrangements
- Competitive salary and growth opportunities
- Opportunity to influence AI product direction and architecture
Back to all jobs