North AmericaContractEngineering
Remotely
pythontypescriptjavascriptaicursorclaude codeopenai codexengineering judgment
Job Description
📋 Description
- Evaluate AI coding interactions end-to-end
- Assess usefulness, correctness, and engineering judgment
- Judge quality of explanations and reasoning
- Distinguish levels of response quality
- Provide clear, opinionated feedback
- Help define what great looks like when interacting with AI tools
🎯 Requirements
- Staff / Principal-level engineer or equivalent
- Strong background in TypeScript/JavaScript or Python
- Hands-on experience with OpenAI Codex, Claude Code, Cursor
- Deep familiarity with AI-assisted dev workflows
- Ability to evaluate code without full execution
- Comfortable giving direct, opinionated feedback
🎁 Benefits
- Contract engagement through early May with potential extension
- Hourly rate: $100–$200/hour
- Hours: ~10–20 hours/week
- Start ASAP
- Take-home evaluation plus behavioral interview