Research Scientist, Human Data & Evaluation

📋 Description

• Turn ambiguous questions into clear research questions and study designs.
• Develop research proposals and methodologies from scratch.
• Identify new research directions for the team.
• Define metrics and measures for Contra Labs.
• Own research engagements from scoping to delivery.
• Collaborate with leads, engineers, and teams.

🎯 Requirements

• Design human-data collection strategies and evaluation protocols.
• Develop prompt strategies for evaluating model behavior.
• Determine sampling, evaluator selection, calibration, QC.
• Design cross-domain methods for design, image, video, agentic workflows.

🎁 Benefits

• Medical, Dental, Vision benefits
• 401k Matching
• Company laptop provided