Senior Software Engineer, AI Infrastructure
MirantisNorth AmericaFull TimeEngineering
Remotely
reactgotypescriptkubernetesllmci/cdhelmgpu
Job Description
📋 Description
- Design and build LLM serving infrastructure on Kubernetes: deployment, GPU scheduling, scaling, and
- Package the platform for enterprise environments: Helm-based installs, upgrades, and
- Integrate the serving layer with the platform's API gateway, identity, and metering services.
- Build the observability for operating GPU inference in production (serving metrics, GPU telemetry).
- Contribute across a multi-service codebase and help set engineering direction through design docs
🎯 Requirements
- 5+ years of software engineering experience in infrastructure, platform, or distributed systems.
- Deep hands-on Kubernetes experience: building and operating production workloads and Helm charts
- Experience with GPU workloads or LLM inference, or strong adjacent systems experience and a track
- Strong Go programming skills; solid CI/CD and infrastructure-as-code skills.
- Fluency with AI-assisted development tools (Claude Code, OpenAI Codex) as part of your daily
- Comfortable with high autonomy on a small, remote-first, written-culture team.
🎁 Benefits
- Work with an established Silicon Valley leader in the cloud infrastructure industry
- Collaborative, passionate colleagues supporting Fortune 500 and Global 2000 customers
- Cutting-edge, open-source innovation
- High-energy environment with openness and growth opportunities
- Professional development, conferences, hackathons, tech talks
- Competitive compensation package with strong benefits
Back to all jobs