Job Description
📋 Description Developing and maintaining our central GenAI Gateway (LLM Gateway) on Azure, integrating both Managing the complete lifecycle of LLM deployed models. Implementing CI/CD pipelines using Azure DevOps for automated deployments and testing. Defining priorities and influencing the GenAI Lab roadmap. Operationalizing and integrating AI capabilities into business processes, IT systems, and data Collaborating continuously with team members, domain experts, and business stakeholders to refine 🎯 Requirements At least 5 years of experience as AI/ML Engineer, Cloud Engineer, or similar. Master’s degree in a quantitative field (CS, Software Eng, Data Science, etc.). Strong proficiency in Python for GenAI apps and automation. Solid experience with Azure cloud services. Expertise in Infrastructure-as-Code (Terraform, Bicep, or ARM templates). Experience building production-grade GenAI applications. 🎁 Benefits Hands-on experience deploying and managing multiple LLM providers (OpenAI, Anthropic Claude, Azure Experience with LLM Gateway patterns and API management at scale. Familiarity with API design patterns (REST, streaming, WebSockets) and asynchronous processing Understanding of AI governance, monitoring, and observability tools (Azure Monitor, Application Working knowledge of LangChain and other GenAI orchestration frameworks. Knowledge of semantic caching and optimization for LLM apps.
