Study Domain Expert — Judge Calibration — Sales - review AI outputs in your specialty

Role Overview

Mercor is sourcing Sales experts for a structured judge-calibration study. You will apply professional judgment to realistic Sales work and evaluate model-generated outputs.

What You'll Do

• Sign an NDA before receiving study materials.

• Complete one realistic Sales task using supplied source files.

• Review model outputs, rank and score them, and write evidence-based rationales.

• Provide structured feedback on the task and study design.

Time Commitment

13 hours during September 12-15, 2026.

Quality Criteria

• More than 5 years of experience in Sales or a closely relevant field, ideally at a high-caliber firm.

• Ideally held a manager, director, or principal-level Sales role; entry-level experience alone is insufficient.

• Fluent or native English.

• Prior work as an expert is a plus.

• No geographic restrictions.

Study Conditions and Eligibility

• No use of LLMs or other AI assistants during the study.

• People who have worked on Project Alchemy in any capacity or accessed its source-world data are not eligible.