Sr Engineer (Backend)

We are looking for a mid to senior level API Platform Engineer.

In this role, youll architect and scale the foundation that powers delightful developer experiences and production-grade AI systems. You'll work at the intersection of high-performance APIs, scalable infrastructure, and cutting-edge machine learningdelivering tools that enable developers and partners to build on top of Menlos intelligent platform.

Responsibilities

•
Design and build the Menlo API Platform, focusing on high reliability, performance, and a world-class developer experience

•
Develop intuitive APIs and SDKs that make it easy for developers to access and integrate multimodal AI capabilities

•
Deploy and optimize AI/ML models into scalable, production environments, working closely with research and applied ML teams

•
Manage and evolve a modern, cloud-native infrastructure stack, using Kubernetes, Docker, and infrastructure-as-code (IaC) tools

•
Ensure platform reliability, including designing and implementing telemetry, monitoring, alerting, autoscaling, failover, and disaster recovery mechanisms

•
Contribute to developer and operations workflows, including CI/CD pipelines, release management, and on-call rotations

•
Collaborate across teams to implement secure APIs with fine-grained access control, usage metering, and billing integration

•
Continuously improve platform performance, cost-efficiency, and observability as we scale to serve millions of users worldwide

Requirements

•
3+ years of experience building and operating large-scale, production systems with real-world usage and uptime expectations

• Strong experience with containerization and orchestration: Kubernetes, Docker, Helm, and service mesh technologies (e.g., Istio or Linkerd)

• Proficiency with cloud platforms: AWS, GCP, or Azure including experience with IAM, networking, and serverless tooling

• Hands-on coding skills in Python and JavaScript/TypeScript, with familiarity in backend frameworks (e.g., FastAPI, Express)

• Deep knowledge of API architecture and design patterns: WebRTC/Websockets, REST, gRPC, OpenAPI/Swagger, authentication (OAuth2, API keys), and versioning

• Experience with databases: PostgreSQL, Redis, and modern vector databases (e.g., Pinecone, Weaviate, FAISS)

• Familiarity with CI/CD pipelines, GitOps practices, and tools like GitHub Actions, Argo CD, or Jenkins

• Comfortable with monitoring and observability tools such as Prometheus, Grafana, Datadog, or OpenTelemetry

Bonus Experience

• Experience with MLOps tools and AI workflows: model versioning, inference pipelines, model registries, etc.

• Understanding of access control systems: ACLs, RBAC, multi-tenant security and isolation

• Knowledge of billing systems, rate limiting, chargeback models, quota enforcement, and usage metering

• Prior experience working on developer platforms or API products with a strong focus on UX and documentation

Originally posted on Himalayas