AI Platform and Harness Engineer
LTSJob Description
📋 Description Design, build, and maintain enterprise AI platform capabilities for LLMs, AI agents, RAG. Develop reusable AI harnesses to automate testing, prompt evaluation, model benchmarking. Build AI evaluation frameworks for accuracy, retrieval quality, latency, and cost. Implement observability and monitoring for AI apps: telemetry, tracing, logging, dashboards. Build and maintain LLMOps pipelines: deployment, versioning, evaluation, experimentation. Design automated workflows for prompt testing, retrieval evaluation, and validation. 🎯 Requirements Bachelor's degree in Computer Science, Software Engineering, AI, Data Science, or related. 5+ years in software/platform/backend/DevOps/cloud/infra engineering. 2+ years building or supporting Generative AI, LLMs, or ML apps. Strong programming experience in Python. Experience developing APIs, backend services, and distributed systems. Experience with cloud platforms AWS, Azure, or Google Cloud Platform. Experience deploying apps using Docker and Kubernetes. Experience with Git, CI/CD, IaC, and infrastructure automation. 🎁 Benefits The Opportunity to support high-visibility federal missions A culture that values innovation, growth, and collaboration Access to cutting-edge tools and technologies Comprehensive benefits for you and your family A career path that rewards ambition and performance