Senior AI Scientist
Sporty GroupRemotely
pythonsqlllmnlprag
Job Description
📋 Description
- Analyse AI conversations and identify opportunities to improve response quality and user experience.
- Design, implement and evaluate prompt engineering strategies.
- Optimise RAG pipelines and retrieval quality.
- Evaluate different LLMs and recommend the most effective models for specific use cases. Potentially
- Define and monitor AI quality metrics, including accuracy, relevance, latency and user satisfaction.
- Design and execute experiments to validate AI improvements.
🎯 Requirements
- 5+ years of experience in AI, ML, NLP or a related field.
- Strong understanding of LLMs and conversational AI.
- Experience with prompt engineering, prompt evaluation and LLM optimisation.
- Experience evaluating conversational AI systems using qualitative and quantitative methods.
- Strong Python and SQL skills.
- Strong analytical and problem-solving skills.
🎁 Benefits
- Sporty is a remote first company in pursuit of sustainability
- A competitive salary + individual performance based bonuses every quarter
- 28 days paid annual leave
- Our core working hours are 10am-3pm in your local time zone with flexibility outside of this
- Referral bonuses & flash bonuses
- Top of the line equipment