Job Description

About the Role

Mercor is partnering with a leading AI lab to train frontier models on high-quality legal reasoning data. This is an evergreen talent pool for experienced US In-House Counsel , by applying, you join a standing bench and are considered for ongoing and upcoming legal-AI projects as they launch. We review applications on a rolling basis and reach out when work that fits your background comes up.

Typical work includes recurring side-by-side evaluations and legal dataset generation: you'll compare AI-generated legal work, judge which response is stronger and why, and create realistic in-house legal tasks and reference answers.

What You'll Do

• Compare pairs of responses to in-house legal tasks (contract review, policy and compliance questions, risk assessments and business-facing legal advice) and decide which is stronger, with clear reasoning
• Write concise justifications grounded in the source documents and applicable US law
• Create realistic legal prompts, fact patterns and model answers drawn from your in-house experience
• Flag errors, gaps and risky advice in AI-generated legal content
• Attend onboarding and calibration sessions

You're a Good Fit If You

• Are admitted to practice in at least one US state (active bar membership)
• Have 3+ years of legal practice, including in-house experience advising a business on contracts, compliance, employment, risk or disputes
• Hold a J.D. from an ABA-accredited law school
• Write clearly and pay close attention to detail

Bonus Qualifications

• 2+ years of experience at an AmLaw 100 firm (strongly preferred)
• Prior work on legal AI projects with Mercor
• Prior data annotation, AI evaluation or legal-benchmark experience

Role Highlights

• Evergreen talent pool, apply once and be considered for ongoing projects as they launch
• Fully remote, flexible hours; recurring tasks as new work comes up
• Applications reviewed on a rolling basis

Job Tags

Similar Jobs