Senior or Staff ML Systems Engineer, LLMs
TRM LabsJob Description
📋 Description Build reusable CI/CD workflows for model training, evaluation, and deployment. Automate model versioning, approvals, and compliance across environments. Create modular AI infra: vector stores, feature stores, registries, observability. Partner with eng and data science to embed AI models and agents in real-time apps. Evaluate and integrate state-of-the-art AI tools (LangChain, LlamaIndex, vLLM, MLflow, BentoML). Drive AI reliability and governance, ensuring compliance, security, and uptime. 🎯 Requirements Python-focused; strong software engineering ability Scalable infra: Docker, Kubernetes IaC/deployment: Terraform, CI/CD pipelines Monitoring/logging: Datadog, Prometheus, OpenTelemetry ML Ops: model versioning/rollback, eval, drift detection Production infra for LLM/agent workflows (vLLM, Triton, BentoML) 🎁 Benefits Remote-friendly, distributed-first company with global hubs High-ownership culture and fast-moving, impact-driven environment Clear career paths with defined engineering levels and mentorship Opportunity to work on AI infrastructure at scale in safety-focused org