Staff Software Engineer, Inference / Compute Infrastructure Engineering
Together AIRemotely
Listed on 2 job boards, which is a stronger signal than one board alone.
gopythonrustkuberneteskafkacadencetemporalnats
Also available on
Job Description
📋 Description
- Build the provisioning state machine for lifecycle management of physical hosts and GPUs.
- Create a self-service API and control plane to stand up, scale, and tear down inference clusters
- Automate self-healing: detect degraded nodes, drain, repair/replace, and reintroduce capacity
- Own reliability of the pipeline with idempotency, retries, rollback, and drift detection.
- Partner with the inference/ML platform team to encode cluster shapes as first-class platform
- Engineer like software: strong typing, automated tests, code reviews, versioning, and CI/CD for
🎯 Requirements
- Strong software engineering background in Go, Python, Rust, or similar.
- Experience with durable workflow orchestration tools (Temporal, Cadence, or equivalent).
- Experience building software control planes or orchestration systems that model state over time
- Experience with event-driven systems (message queues, event streams, pub/sub like Kafka, NATS, SQS).
- A product mindset; built internal platforms or APIs used by other engineering teams.
- Nice to have: exposure to bare-metal provisioning (PXE/iPXE, Redfish/IPMI, BMC) and
Back to all jobs
