Loading opportunity…
All opportunities
SME Careers
micro1
Outlier
AfterQuery
Braintrust
Handshake AI
Sovrano AIMercor 
Vetto AI
Rust Labs
AI Training · hourly
Legal Rubric & Ground Truth Auditor (Licensed Attorney)
Mercor is seeking experienced licensed attorneys to audit rubrics and ground truth answers for a legal research dataset used to evaluate advanced AI systems. You will review existing legal research questions, verify the accuracy of model answers, and refine grading rubrics so the dataset reflects current law and sound…
PLATFORMMercor
LOCATIONRemote (United States)
PAY$120–$140/hr
SCHEDULEProject based
LAST CHECKED11 Nov 2026
THE OPPORTUNITY
Put your skills to work.
Mercor is seeking experienced licensed attorneys to audit rubrics and ground truth answers for a legal research dataset used to evaluate advanced AI systems. You will review existing legal research questions, verify the accuracy of model answers, and refine grading rubrics so the dataset reflects current law and sound…
- Commitment
- hourly
- Field
- Law
- Open slots
- 3
- Eligible countries
- USA
Mercor is seeking experienced licensed attorneys to audit rubrics and ground-truth answers for a legal research dataset used to evaluate advanced AI systems. You will review existing legal research questions, verify the accuracy of model answers, and refine grading rubrics so the dataset reflects current law and sound legal reasoning. This is a short-term, fully remote engagement.
- * *
Responsibilities
- Audit grading rubrics for accuracy, completeness, consistency, and clarity.
- Verify ground-truth answers against controlling statutes, regulations, and case law.
- Identify legal errors, outdated authority, missing issues, and ambiguous grading criteria.
- Rewrite or correct ground-truth answers and rubric items where needed.
- Provide concise, structured written feedback on each item reviewed.
- * *
Practice Areas
The dataset spans eight practice areas. Experience in one or more is required, and breadth across several is a plus:
- Administrative / Regulatory
- Business & Commercial
- Civil Litigation
- Constitutional / Civil Rights
- Criminal
- Family
- Health
- Immigration
- * *
Required Qualifications
- Juris Doctor (JD) and active U.S. bar admission in good standing.
- 5+ years of legal practice.
- Substantive experience in at least one of the practice areas above.
- Strong legal research, analysis, and writing skills.
- High attention to detail and the ability to apply consistent judgment.
- * *
Preferred Qualifications
- Experience across multiple listed practice areas.
- Judicial clerkship, appellate, government, or law firm research experience.
- Prior experience reviewing or grading legal work product, or with AI / legal-tech evaluation projects.
- * *
Why Join?
- Apply your legal expertise to shape how AI systems are evaluated for legal research.
- Collaborate with a leading AI research organisation.
Role details are copied from the Mercor listing and can change. Check the platform before you apply.
Relevant skills
LawLegal RubricGround Truth Auditor
A few things to check
- Location and experience requirements.
- Schedule, compensation, and assessment process.
- Current availability on Mercor.
KEEP EXPLORING
Similar opportunities.
Related roles across other platforms, selected by field, title and skills.
SME CareersLegal & Compliance Specialist – Rubric Design
In this hourly, remote contractor role, you will work as a Legal & Compliance Subject Matter Expert (SME) to create challenging professional questions, evaluate AI generated legal and regulatory content, and design high quality rubrics defining what a complete, well reasoned, and professionally appropriate response…
Legal ReasoningFinancial RegulationRegulatory Compliance
United States
Up to $120/hr
micro1Tax Attorney
Skills include tax law, legal research and analysis, legal document review. 50 openings shown by micro1.
tax lawlegal research and analysislegal document review
Remote · eligibility varies
$100–$170/hr
OutlierOdysseus: personal finance and legal experts (US)
Outlier is looking for US-based personal finance experts (CFPs, financial advisors, tax preparers) or lawyers with experience helping individuals with everyday financial, estate, retirement and legal planning.
Personal financeFinancial planningTax preparation
United States
Not disclosed
AfterQueryTax Attorney Expert
<p>Tax attorneys to build the tax law reasoning scenarios frontier AI labs use to test model judgment.</p> <p>AfterQuery builds the expert evaluation data that frontier AI labs use to measure and improve their models. We're hiring tax attorneys as contractors to author and grade the tax law scenarios those evaluations
Remote · eligibility varies
$160/hr
BraintrustSenior U.S. Attorney & Legal Expert - AI Training
Outlier lists this freelance opportunity through Braintrust. Skills include Legal Writing.
Legal Writing
United States only
$105/hr
ESG Analyst
Handshake is looking for sustainability and ESG professionals to support AI research through flexible, hourly contract work. This is not a traditional job. You'll draw on your hands-on experience with carbon accounting, GHG reporting, and environmental compliance to evaluate AI-generated content and provide feedback…
ESG AnalystRemote collaboration
Remote · eligibility varies
Up to $80/hr
Sovrano AILegal Expert
Join Sovrano AI's legal expert network. This is a waitlist for future AI training projects, paid up to €150 an hour, and your application is not tied to a specific project. Apply once, complete a short AI interview about your field, and we contact you directly when a project matches your background.
Legal researchLegal writingContract drafting
Remote (US, CA, EU, TR)
EUR 150/hr
Lawyers & Legal Experts — Global Talent Pool (UK, Germany, France, Spain, Australia, Japan)
Mercor is partnering with leading AI companies to evaluate and improve how well AI systems handle real questions of law across multiple jurisdictions. We keep an ongoing talent pool of qualified, practising lawyers who serve as expert reviewers on these projects.…
LawLawyersLegal Experts — Global Talent Pool
Remote — UK, Germany, France, Spain, Australia, Japan
$100–$140/hr
Vetto AILegal Expert — Talent Pool
Join Vetto's legal talent pool. We're mapping lawyers, compliance and regulatory professionals so that when the right project opens, we can reach you first.
Talent poolLegal
Remote · eligibility varies
$10–$70/hr
Rust LabsGovernance & compliance (legal)
Judge AI-made governance and compliance material for legal accuracy: corporate governance, regulatory compliance and the policies behind them.
LegalCompliance
Remote · remote
$75–$200/hr