Staff + Senior Software Engineer, Inference

📋 Description

• Design, build, and maintain the distributed systems that serve Claude to millions of users worldwide
• Develop resilient, flexible systems that adapt in real time to real world events
• Develop intelligent request routing, load balancing, and traffic management systems across
• Maximize compute efficiency across the fleet by autoscaling and orchestrating production, research
• Build and operate production-grade deployment pipelines for releasing new models to users
• Provide high-performance inference infrastructure that enables researchers to develop

🎯 Requirements

• Significant software engineering experience, particularly with distributed systems
• Results-oriented, with a bias towards flexibility and impact
• Willingness to pick up slack, even if it goes outside your job description
• Desire to learn more about machine learning systems and infrastructure
• Thrive in environments where technical excellence directly drives both business results and
• Care about the societal impacts of your work

🎁 Benefits

• Competitive compensation and benefits