mercor

AI Red Team Specialist - LLM

Remote (United States)Posted 24 days agocontract
Apply on mercor's career page

CV for this role

Rewrite your CV for what mercor asks for

This job is free to read. A CV tailored to it comes with Weekly and Monthly.

Tailor my CV

Pay comparison

Pay posted by mercor

Source: Text of the mercor job posting.

Job description preview

From mercor’s original posting

About the job Mercor connects elite creative and technical talent with leading AI research labs. Headquartered in San Francisco, our investors include Benchmark, General Catalyst, Peter Thiel, Adam D'Angelo, Larry Summers, and Jack Dorsey. Position: LLM Red Team Specialist — Failure Modes & Edge Cases Type:Contract Compensation:$60–$90/hour Location:Remote Commitment:35 hours/week Role Responsibilities • Probe models to explore how frontier AI models handle coding, ML, and analysis tasks. Identify spots where models quietly fail. • Design challenges by turning identified weaknesses into well-crafted tasks that are challenging for models but fair to grade. • Document findings clearly with reproducible evidence and steps. • Strengthen tasks by collaborating with task authors to close loopholes, shortcuts, and grading gaps. • Work as a team by sharing insights with researchers and fellow experts to continually improve the benchmark. Qualifications Must-Have • MSc or PhD in a STEM field or equivalent practical experience. • 1+ years of experience in research, research-engineering, security, or AI-evaluation roles. • Ability to identify vulnerabilities, edge cases, or failure modes in…

Open full posting on mercor’s site

Similar roles on Seoulstart

Browse all Global jobs