Senior AI Scientist
JobgetherRemotely
pythonsqlllmproductionragembeddings
Job Description
📋 Description
- Analyze AI conversations, interaction data, and user feedback to identify opportunities to improve
- Design, implement, test, and optimize prompt engineering strategies and conversational behaviors.
- Optimize RAG pipelines, retrieval mechanisms, vector-based search, and overall retrieval quality.
- Evaluate different LLMs and recommend the most effective models for specific product use cases
- Define, track, and continuously improve AI quality metrics such as accuracy, relevance, latency
- Design and execute structured experiments to assess AI improvements and determine their impact.
🎯 Requirements
- 5+ years of professional experience in AI, machine learning, NLP, or a related technical field.
- Strong practical understanding of LLMs, generative AI, and conversational AI systems.
- Hands-on experience with prompt engineering, prompt evaluation, and LLM optimization.
- Proven experience evaluating conversational AI using both qualitative and quantitative
- Strong Python and SQL skills, with the ability to analyze data and build practical evaluation or
- Knowledge of RAG architectures, vector databases, embedding models, and retrieval optimization.
🎁 Benefits
- Remote-first working environment with flexibility across your local time zone.
- Core working hours from 10:00 AM to 3:00 PM local time, with flexibility outside those hours.
- 28 days of paid annual leave.
- Referral bonuses and additional flash bonus opportunities.
- High-quality, top-of-the-line work equipment.
- Annual company retreats designed to strengthen collaboration and internal networking.
Back to all jobs