Loading opportunity…
All opportunities
Anyone AI 
SME Careers
Outlier
Vetto AI
AfterQuery
Braintrust
micro1
Claru AI
Meridial
Terac
Expert Work · Full-time
Quality Evaluator – Fluent English
Quality Evaluator – EnglishHelp shape the future of AI by evaluating and comparing responses from advanced AI models.Location: RemoteType: Independent contractor / Part-timeCommitment: up to 3 monthsCompensation: $7-$12/hourAbout the roleAt Anyone AI, we create high-quality training and evaluation data for frontier AI
PLATFORMAnyone AI
LOCATIONEstonia · remote
PAY$7–$12/hr
SCHEDULESee role requirements
LAST CHECKED4 Nov 2026
THE OPPORTUNITY
Put your skills to work.
Quality Evaluator – EnglishHelp shape the future of AI by evaluating and comparing responses from advanced AI models.Location: RemoteType: Independent contractor / Part-timeCommitment: up to 3 monthsCompensation: $7-$12/hourAbout the roleAt Anyone AI, we create high-quality training and evaluation data for frontier AI
- Pay
- $7–$12/hr
- Location
- Estonia
- Employment type
- Full-time
- Department
- AI Training
- Work setting
- Remote
Quality Evaluator – English
Help shape the future of AI by evaluating and comparing responses from advanced AI models.
- Location: Remote
- Type: Independent contractor / Part-time
- Commitment: up to 3 months
- Compensation: $7-$12/hour
About the role
At Anyone AI, we create high-quality training and evaluation data for frontier AI models.
We’re looking for English-fluent experts with strong writing skills, critical thinking, and extensive hands-on experience using large language models (LLMs).
In this role, you’ll interact directly with AI models and compare their responses side by side to determine which best meets the user’s needs. Your evaluations and written explanations will help improve the accuracy, helpfulness, and reliability of AI systems.
What you’ll do
- Interact with different AI models and tools across a wide range of prompts and topics.
- Compare two or more AI-generated responses side by side.
- Assess accuracy, helpfulness, instruction-following, clarity, and overall response quality.
- Follow detailed rating guidelines and multi-step evaluation workflows.
- Write clear, well-reasoned explanations supporting your evaluation decisions.
- Apply evaluation criteria consistently across tasks.
What we’re looking for
- Fluency in English, with strong reading comprehension and writing skills.
- Extensive hands-on experience using LLMs and critically assessing their outputs.
- Strong analytical judgment and the ability to weigh multiple dimensions of response quality.
- Excellent attention to detail and the ability to follow complex instructions carefully.
- Ability to explain evaluation decisions clearly and convincingly.
- Comfort switching between AI models, tools, and multi-step workflows.
Nice to have
- Previous experience in AI response evaluation, data annotation, or quality assurance.
- Experience in editing, research, fact-checking, or analytical writing.
- Familiarity with evaluation rubrics and side-by-side comparison tasks.
Role details are copied from the Anyone AI listing and can change. Check the platform before you apply.
Relevant skills
AI Training
A few things to check
- Location and experience requirements.
- Schedule, compensation, and assessment process.
- Current availability on Anyone AI.
KEEP EXPLORING
Similar opportunities.
Related roles across other platforms, selected by field, title and skills.
Anyone AIQuality Evaluator – Fluent English
Quality Evaluator – EnglishHelp shape the future of AI by evaluating and comparing responses from advanced AI models.Location: RemoteType: Independent contractor / Part-timeCommitment: up to 3 monthsCompensation: $7-$12/hourAbout the roleAt Anyone AI, we create high-quality training and evaluation data for frontier AI
AI Training
Ecuador · remote
$7–$12/hr
SME CareersEnglish Quality Assurance Lead (QAL)
In this hourly, remote contractor role, you will work as an English Quality Assurance Lead (QAL) to oversee quality, consistency, and trainer performance across AI training projects.…
LLM EvaluationTrainingEnglish Quality Assurance
United States
Up to $35/hr
OutlierEnglish-Speaking AI Image and Video Evaluator
Outlier helps the world’s most innovative companies improve their AI models by providing human feedback. Are you a strong communicator with fluency in English who would like to lend your expertise to train AI models?About the opportunity:Outlier is looking for talented, detail-oriented English speakers to help train ge
Generalist
Remote - Bangladesh, India
Up to $7/hr
Vetto AIAI Bot Evaluator for Finance - Brazil
EN-US: Chat with your bank's AI assistant and help evaluate Brazilian banks. / PT-BR: Converse com o assistente de IA do seu banco e ajude a avaliar bancos brasileiros.
Finance
Remote · eligibility varies
BRL 5 per package
AfterQueryContent Writer and Evaluator - Global
We are seeking candidates to develop evaluation scenarios that test cutting-edge autonomous AI systems across multiple domains. You'll create complex research tasks that challenge AI capabilities in sports analytics, financial analysis, patent research, academic planning, and business intelligence while ensuring accura
Remote · eligibility varies
$15/hr
BraintrustQuality & Patient Safety Nurse - AI Evaluation
Turing lists this freelance opportunity through Braintrust. Skills include Critical Thinking.
Critical Thinking
United States only
$65/hr
micro1Food Delivery AI Response Evaluator
Skills include food delivery domain knowledge, customer service, written communication. 10 openings shown by micro1.
food delivery domain knowledgecustomer servicewritten communication
Remote · eligibility varies
$10–$30/hr
Claru AIAI Prompt Quality Rater
You'll evaluate prompt-response pairs generated by large language models, scoring them across dimensions like factual accuracy, instruction-following, coherence, and appropriate refusal behavior. Each session involves reviewing batches of 20–50 pairs using a structured rubric inside a web-based annotation platform, fla
RLHF
Remote · eligibility varies
$35–55/hr
Side by Side Factuality Evaluator
Review AI-generated responses side by side for factual accuracy and write clear rationales. English-fluent experts, independent contractor.
Eligibility varies
$6/hr · varies by task
Photography Evaluators: Paid Task on Image Quality and Brand Guidelines
We are conducting a paid study to evaluate photography pairs and image quality against specific brand guidelines. We are looking for individuals with a strong eye for visual design to complete a calibration task and participate in a subsequent onboarding process.
Photography EvaluatorsPaid Task on Image Quality and Brand GuidelinesRemote collaboration
Remote · eligibility varies
$60 /hr