Job Description
📋 Description LLM-based evaluation to assess relevance and align with user behavior Real-time quality in production: reranking, filtering, latency Automated quality monitoring with agentic insights and actionable recommendations 🎯 Requirements 4+ years shipping production ML systems Experience with search, information retrieval, or recommendation systems Fine-tuning, evaluation frameworks, and scaling LLM deployments Python and PyTorch; SQL and data orchestration tools (Spark, Airflow) Designing and running A/B tests to validate model impact Excellent English communication; cross-functional collaboration 🎁 Benefits Work with smart and empathetic people who will help you grow Regular team offsite events to connect and collaborate Fully remote team - choose where you live Unlimited vacation time - we strongly encourage all employees take at least 3 weeks per year Work from home stipend to set up your home office Apple laptops provided for new employees
