Loading opportunity…
All opportunities
Turing
Anyone AIRust Labs 
Alignerr
micro1
Braintrust
Terac
Verita AI
AfterQuery
REX / RemoExperts
Expert Work · Project
Senior software engineering: AI evaluation
Review and score AI coding work the way a strong senior engineer would: rubrics, side-by-side comparisons and code-quality judgments.
PLATFORMRust Labs
LOCATIONUS or Canada · remote
PAY$75–85/hr
SCHEDULEFrom 20 hours a week
LAST CHECKED4 Nov 2026
THE OPPORTUNITY
Put your skills to work.
Review and score AI coding work the way a strong senior engineer would: rubrics, side-by-side comparisons and code-quality judgments.
- Pay
- $75–85/hr
- Field
- Software engineering
- Selection
- Five-minute form
- Staffing
- Staffing now
- Work
- Remote, paid per accepted task
About the role
Review and score AI coding work the way a strong senior engineer would: rubrics, side-by-side comparisons and code-quality judgments.
Requirements
- Five or more years in Python, TypeScript, JavaScript or Go
- Living in the US or Canada
- Not currently employed at Microsoft
Role details are copied from the Rust Labs listing and can change. Check the platform before you apply.
Relevant skills
Software engineeringPythonTypeScriptJavaScriptGo
A few things to check
- Location and experience requirements.
- Schedule, compensation, and assessment process.
- Current availability on Rust Labs.
KEEP EXPLORING
Similar opportunities.
Related roles across other platforms, selected by field, title and skills.
Senior Software Engineer - AI Evaluation / Coding Agents ($100-150/hr)
Evaluate and improve AI coding models by reviewing generated code.
PythonTypescriptJavaScript
Remote · eligibility varies
$100-$150/hour, please provide a specific hourly rate expectation
Anyone AISenior Software Engineer – Open Source & SWE-Bench Evaluation
Anyone AI is recruiting experienced Software Engineers for a specialized project focused on reviewing and evaluating real-world software engineering tasks derived from open-source repositories.The work involves assessing whether coding tasks based on real GitHub issues and pull requests are technically sound, reproduci
Software Engineering
Argentina · remote
$65/hr
Rust LabsProgram leads: software engineering data for AI
Leads run software engineering data programs for AI models: managing engineers and reviewers and owning quality and delivery, remotely. A one-minute form tells rustLabs about you.
Software engineeringProgram managementAI evaluation
Remote · remote
Not disclosed
Senior Software Engineer — AI Evaluation & Benchmarks
Build the benchmarks that test the world's most advanced AI models. $80–$100/hr, fully remote, Python experts wanted....
Remote
$80-100/hr
micro1Senior Forward Deployed Engineer, U.S. Government
Skills include Agentic AI & LLM Systems Engineering, Python & Production Software Engineering, ML Infrastructure & Model Evaluation. 1 opening shown by micro1.
Agentic AI & LLM Systems EngineeringPython & Production Software EngineeringML Infrastructure & Model Evaluation
hybrid
$40–$60/hr
BraintrustPrincipal Coding Annotator / LLM Evaluation Engineer
Leading AI Lab lists this freelance opportunity through Braintrust. Skills include Data Annotation, Software Engineering, Python.
Data AnnotationSoftware EngineeringPython
Belgium · Denmark · France +9 more
$75–$90/hr
Software Engineers & Data Scientists: AI Slide Deck Evaluation
We are running a paid project to determine what constitutes an excellent technical presentation. We are looking for technical professionals to review and rank slide decks from their field.
Software EngineersData ScientistsRemote collaboration
Remote · eligibility varies
$110 /hr
Verita AITask & Evaluation Specialist
What this role does Design realistic, difficult shopping-related tasks (e.g. meal planning, restocking, gifting, travel prep) that stress-test AI models, then build the rubrics used to grade how well a model performs them. Who we're looking for Subject-matter expertise in retail, e-commerce, consumer shopping behavior,
Software Engineering
Remote · eligibility varies
$60/hr
AfterQueryFull-Stack Software Engineer - Testing & Evaluation
<p>We are hiring skilled software engineers with strong full-stack experience. The ideal candidate is comfortable architecting and working across multi-file codebases, structuring realistic development environments, and building reproducible setups supported by clear documentation and testing. Experience with Docker an
Remote · eligibility varies
$75/hr
Software Engineer – LLM Evaluation & Repository Validation
We are looking for software engineers to validate real-world repositories used to evaluate large language models. You will triage issues, set up reproducible environments, assess test quality, and check how well models fix real bugs. **Key Responsibilities** - Review and triage issues in open-source GitHub projects. -
ALL
USD $50–100 per hour, adjusted by country of residence.