Loading opportunity…
All opportunities
Mercormicro1 
Turing
Terac
Braintrust
Rust Labs
Alignerr
Claru AI
Handshake AI
Anyone AI
Remote Jobs · Flexible project
Domain Contributor - Evaluation Specialist
Skills include Domain depth, Source verification, Reasoning clarity. 20 openings shown by micro1.
PLATFORMmicro1
LOCATIONRemote · eligibility varies
PAY$30–$60/hr
SCHEDULEProject based
LAST CHECKED4 Nov 2026
THE OPPORTUNITY
Put your skills to work.
Skills include Domain depth, Source verification, Reasoning clarity. 20 openings shown by micro1.
- Role type
- generalist
- Openings
- 20
- Skills
- Domain depth, Source verification, Reasoning clarity
Role Title: Domain Contributor - Evaluation Specialist
Role Type: Contractor (~15 hrs/week)
Location: Remote
micro1 is engaging Domain Contributor - Evaluation Specialists to support an internal project evaluating and improving advanced AI models. In this role, you'll apply your expertise to help train next-generation AI systems. Your work will shape how models learn, reason, and perform through high-quality, real-world input. Flexible, pay-per-task work across history, law, finance, journalism, and tech, for experts with prior AI training experience.
Scope of Work
Preferred Qualifications
Compensation Structure
Compensation is output-based; experts are paid per task that meets the project specifications. The time required to complete work may vary depending on the expert’s experience and workflow. Minimum submission requirements apply. Experts must submit a minimum of tasks per week.
- Design nuanced, domain-specific tasks that probe AI model limits and surface reasoning flaws.
- Author questions and scenarios demanding deep subject knowledge, beyond general understanding.
- Assess AI-generated outputs, validating accuracy against authoritative, primary sources in your area of expertise.
- Document clear rationales for model shortcomings, specifying missed reasoning, source errors, or nuances.
- Apply detailed task guidelines and evaluation rubrics consistently to each submission.
- Submit completed deliverables independently on a rolling basis, meeting project requirements for written and verbal clarity.
- Proven hands-on experience with AI model training, annotation, RLHF, or evaluation.
- Deep expertise in a core domain: history, archival or library science, law (paralegal, legal academic, compliance), finance (equity research, PE/VC, forensic accounting), journalism, or technology/industry history.
- Advanced research skills with a track record of verifying complex claims against authoritative sources.
- Exceptional written and verbal communication skills to articulate findings and feedback.
- Demonstrated ability to precisely follow detailed instructions and evaluation frameworks.
- Background in adversarial or “stomp the model” task design is advantageous.
- Graduate-level research, experience at a Fortune 100 company, or professional fluency in a non-English language a plus.
Role details are copied from the micro1 listing and can change. Check the platform before you apply.
Relevant skills
Domain depthSource verificationReasoning clarity
A few things to check
- Location and experience requirements.
- Schedule, compensation, and assessment process.
- Current availability on micro1.
KEEP EXPLORING
Similar opportunities.
Related roles across other platforms, selected by field, title and skills.
Finance Domain Expert — AI Training & Evaluation
Join a leading AI lab's cutting edge GenAI team to be at the core of the AI revolution, where your expertise fuels the development of the most advanced AI models. 1\. Overview We are hiring a senior finance domain expert to work directly with a leading AI lab's research and program management teams, improving how…
FinanceFinance Domain Expert — AI TrainingEvaluation
Bay Area, CA
$60–$100/hr
micro1Evaluation Specialist/Recent Grad
Skills include Research & source triangulation, Attention to detail, Written precision. 5 openings shown by micro1.
Research & source triangulationAttention to detailWritten precision
Remote · eligibility varies
$20–$60/hr
Senior Software Engineer - AI Evaluation / Coding Agents ($100-150/hr)
Evaluate and improve AI coding models by reviewing generated code.
PythonTypescriptJavaScript
Remote · eligibility varies
$100-$150/hour, please provide a specific hourly rate expectation
Hardware Engineers: RTL Implementation and Evaluation Workflows
We are conducting a paid study on hardware description workflows and automated evaluation. We need experienced hardware engineers to review RTL implementation strategies and provide feedback on design processes.
Hardware EngineersRTL Implementation and Evaluation WorkflowsRemote collaboration
Remote · eligibility varies
$147 /hr
BraintrustClinical Pharmacist - AI Evaluation
Turing lists this freelance opportunity through Braintrust. Skills include Critical Thinking.
Critical Thinking
United States only
$38/hr
Rust LabsClinicians: medical imaging AI evaluation (US)
US radiologists, physicians and pharmacists review de-identified medical images and cases for AI evaluation, remotely. Pay by role: radiologists $180/hr, physicians $115/hr, radiology residents $85/hr (R4-R5) or $70/hr (R3), pharmacists $70/hr.
MedicineImagingAI evaluation
United States, remote · remote
$70–$180/hr by role
Senior Software Engineer — AI Evaluation & Benchmarks
Build the benchmarks that test the world's most advanced AI models. $80–$100/hr, fully remote, Python experts wanted....
Remote
$80-100/hr
Claru AIGame Simulation Data Contributor
Your job is to generate high-quality human demonstration data by playing games and simulations under controlled conditions. You will follow session protocols that specify the game, the scenario, the objectives, and the annotation requirements. After each session, you fill out a structured form documenting your strategi
Gaming
Remote · eligibility varies
$25–35/hr
Bangla AI Evaluation Specialist
**Opportunity Overview** Handshake is looking for Bangla speakers as it’s spoken in Singapore to help make AI responses more personalized. This is not a traditional job — you'll use your language skills to help evaluate and rank AI responses so future models can better tailor their answers to individual users.…
Bangla AI Evaluation SpecialistRemote collaboration
Remote · eligibility varies
Up to $30/hr
Anyone AISenior Software Engineer – Open Source & SWE-Bench Evaluation
Anyone AI is recruiting experienced Software Engineers for a specialized project focused on reviewing and evaluating real-world software engineering tasks derived from open-source repositories.The work involves assessing whether coding tasks based on real GitHub issues and pull requests are technically sound, reproduci
Software Engineering
Argentina · remote
$65/hr