Domain Advisor Consultant (Subject Matter Expert)
JobgetherRemotely
machine learninggenerative aitechnical writingai evaluationbenchmarkingsubject matter expertiseall other
Job Description
📋 Description
- Review and advise on AI output evaluation criteria and scoring rubrics
- Create and validate high-quality benchmark tasks, prompts, and responses for AI training
- Analyze model failures and explain causes and improvements
- Assess complexity and difficulty of evaluation scenarios
- Document expert reasoning for technical teams
- Deliver agreed outcomes under project Statements of Work
🎯 Requirements
- Elite-level expertise in specialized domain with advanced degree (PhD, MD, JD, or equivalent)
- Recognized professional standing (senior/principal, publications, awards, or contributions)
- Current independent consultant, freelancer, or autonomous professional
- Strong ability to distinguish high-quality from flawed reasoning
- Apply expertise to ambiguous problems to define accurate responses
- Excellent written communication skills
🎁 Benefits
- Project-based flexibility to complement existing work
- Non-exclusive engagements with other clients allowed
- Flexible delivery of agreed deliverables
- Defined compensation for each assignment
- Remote work from own location
- Intellectual challenge in highly analytical AI reasoning work
Back to all jobs