Domain Advisor Consultant (Subject Matter Expert)
JobgetherRemotely
machine learningprompt engineeringgenerative aiai trainingai evaluationdatabenchmarkingsubject matter expertise
Job Description
📋 Description
- Review and advise on evaluation criteria and scoring rubrics to determine whether AI-generated
- Create, edit, and validate high-quality benchmark tasks, prompts, and responses that can serve as
- Analyze model failures, including hallucinations, flawed reasoning, and logical inconsistencies
- Assess the complexity, nuance, and difficulty of evaluation scenarios to ensure AI systems are
- Clearly document expert reasoning and recommendations so that technical teams can translate domain
- Work under project-specific Statements of Work, delivering agreed outcomes within defined timelines
🎯 Requirements
- Demonstrated elite-level expertise in a specialized professional or academic domain, supported by
- Recognized professional standing, such as senior/principal-level leadership, significant
- Current experience as an independent consultant, freelancer, business owner, academic leader, or
- Strong ability to distinguish high-quality from flawed reasoning and to explain complex concepts
- Ability to apply deep subject matter expertise to unfamiliar or ambiguous problems and establish
- Excellent written communication skills, with the ability to articulate nuanced technical or
🎁 Benefits
- Project-based flexibility: Choose assignments that complement your existing consulting, freelance
- Non-exclusive engagements: Continue working with other clients while participating in projects.
- Flexible delivery: Manage how you complete agreed deliverables in alignment with project
- Defined compensation: Scope, timelines, and compensation are established in advance for each
- Remote work: Work independently from your own location using your own workspace and equipment.
- Intellectual challenge: Apply and deconstruct your expertise in rare, highly analytical work
Back to all jobs