Job Description
What We're Researching
We are hiring senior full-stack engineers to help build and refine next-generation coding environments that evaluate AI agents. This work directly supports the development of robust grading systems that accurately measure how effectively an AI agent solves complex coding tasks. The goal is to create secure evaluation suites that cannot be bypassed or easily cheated by the models.
How It Works
Throughout this long-term engagement, you will work remotely with real website clones to identify bugs and write technical specifications. You will build comprehensive automated test suites designed to grade AI-generated code. This involves analyzing how an agent interacts with a given task and ensuring the grading logic is watertight. The process requires deep technical scrutiny and creative problem-solving to account for unpredictable AI behavior.
Who This Is For
We welcome senior full-stack software engineers with extensive hands-on experience in React. You should be highly comfortable writing technical specs and building automated testing frameworks for complex web environments. Candidates with a strong background in web security, QA automation, or AI evaluation are highly encouraged to apply.
What You'll Do
- Interact with real website clones to identify bugs and workflow gaps
- Write detailed technical specifications for complex AI coding tasks
- Build robust automated test suites to securely grade AI agent performance
- Ensure grading logic is watertight and resistant to AI bypassing or shortcuts
Who Should Apply
- Senior-level experience in full-stack software engineering
- Deep professional expertise building web applications with React
- Strong background in automated testing and technical specification writing
- Available for an ongoing, high-commitment technical engagement
Compensation
$75 per hour
Ready to participate?
Start your paid interview now
About Terac
Terac is building the world's largest pool of vetted human experts for AI. Researchers, AI labs, and product teams use Terac to recruit, screen, and pay study participants across industries, languages, and skill sets.
Learn more at or on YouTube at @jointerac.
Originally posted on Himalayas
