Job Description
📋 Description Own study design, annotation protocols, and evaluation designs. Manage delivery: scope, staffing, timelines, client relations. Ensure data quality and inter-rater reliability; real-time corrections. Analyze findings and translate into actionable recommendations. Build scalable processes; partner with engineering on tooling. Create case studies and benchmark publications for market clarity. 🎯 Requirements 3+ years designing studies, evaluating data, and presenting findings. Experience with data labeling, annotation, or AI/ML evaluation workflows. Track record managing several concurrent projects, including annotation or QA. Strong point of view on creative quality and what 'good' looks like. Based in NYC; in-office 5 days a week (Williamsburg). 🎁 Benefits Medical, dental, vision coverage. 401(k) matching. Company laptop provided. Equity opportunities.