Staff Software Engineer, Inference / Compute Infrastructure Engineering

📋 Description

• Build the provisioning state machine to model full lifecycle of a physical host to run inference
• Design self-service APIs and a control plane to stand up, scale, or tear down clusters via API
• Automate self-healing: detect degraded nodes, repair or replace, and rebalance capacity.
• Own reliability of the provisioning pipeline with idempotency, retries, and drift detection.
• Partner with inference/ML platform teams to encode cluster shapes as abstractions.
• Engineer infrastructure code with strong typing, tests, versioning, and CI/CD.

🎯 Requirements

• Strong software engineering background in Go, Python, Rust, or similar.
• Experience with durable workflow orchestration tools (Temporal, Cadence, or equivalent).
• Experience building software control planes or orchestration systems (Kubernetes
• Experience with event-driven systems (Kafka, NATS, SQS) rather than polling scripts.

🎁 Benefits