Loading opportunity…
All opportunities
Mercor 
Terac
Braintrust
micro1
Anyone AI
Meridial
Verita AI
SME Careers
Sovrano AI
Turing
AI Training · hourly
AWS Serverless & Infrastructure-as-Code Task Auditor
Evaluate the quality, correctness, and cloud architecture soundness of AWS serverless and infrastructure as code tasks used to train and evaluate a frontier AI lab's models. You'll assess multi service serverless designs, IaC fidelity, and cross service integration correctness — and provide clear, rubric based written…
PLATFORMMercor
LOCATIONRemote — United States
PAY$70–$90/hr
SCHEDULE40 hrs/week
LAST CHECKED11 Nov 2026
THE OPPORTUNITY
Put your skills to work.
Evaluate the quality, correctness, and cloud architecture soundness of AWS serverless and infrastructure as code tasks used to train and evaluate a frontier AI lab's models. You'll assess multi service serverless designs, IaC fidelity, and cross service integration correctness — and provide clear, rubric based written…
- Commitment
- hourly
- Hours per week
- 40
- Field
- Software Engineering
- Open slots
- 3
- Eligible countries
- USA
Evaluate the quality, correctness, and cloud-architecture soundness of AWS serverless and infrastructure-as-code tasks used to train and evaluate a frontier AI lab's models. You'll assess multi-service serverless designs, IaC fidelity, and cross-service integration correctness — and provide clear, rubric-based written feedback.
Basic Qualifications
Preferred Qualifications
- 3+ years hands-on experience building multi-service AWS serverless applications (Lambda, API Gateway, DynamoDB/Streams, S3, EventBridge, SNS/SQS, Step Functions)
- Strong experience with infrastructure-as-code (AWS CDK, CloudFormation, or SAM)
- Demonstrated ability to assess event-driven architecture correctness, IAM/permission boundaries, and failure/retry semantics
- Familiarity with local emulation/testing fidelity (e.g., LocalStack) versus real AWS behavior
- AWS certifications (Solutions Architect / Developer)
- Experience with observability and cost-optimization for serverless workloads
- Prior code-review or task-grading experience
Role details are copied from the Mercor listing and can change. Check the platform before you apply.
Relevant skills
Software EngineeringAWS ServerlessInfrastructure
A few things to check
- Location and experience requirements.
- Schedule, compensation, and assessment process.
- Current availability on Mercor.
KEEP EXPLORING
Similar opportunities.
Related roles across other platforms, selected by field, title and skills.
AI Developer Trace Task Auditor
Evaluate the quality and correctness of AI assisted software development traces used to train and evaluate a frontier AI lab's models. You'll assess end to end coding sessions produced with AI assisted developer tools — judging correctness, workflow soundness, and reasoning — and provide clear, rubric based written…
Software EngineeringAI Developer Trace Task AuditorRemote collaboration
Remote — United States
$70–$90/hr
Finance and Accounting Professionals: Business Operations and Software Workflows
We are running a paid interview study on the software tools used for everyday finance and accounting workflows. We need business operations professionals to walk us through their daily processes and evaluate their current tech stack.
Finance and Accounting ProfessionalsBusiness Operations and Software WorkflowsRemote collaboration
United States · remote
$71 one-time
BraintrustLead Security Engineer (US-Remote)
Handl Health lists this direct_hire opportunity through Braintrust. Skills include Security Engineering, Cloud Security, Security Auditing.
Security EngineeringCloud SecuritySecurity Auditing
United States only
$185,000–$215,000/yr
micro1Member of Technical Staff, Infrastructure
Skills include Cloud Infrastructure & DevOps Engineering, SRE & Observability, AI Agents & Agent-Ready Data Systems. 1 opening shown by micro1.
Cloud Infrastructure & DevOps EngineeringSRE & ObservabilityAI Agents & Agent-Ready Data Systems
Remote · eligibility varies
$7–$8/hr
Anyone AIFP&A Analyst
About the opportunityAnyone AI is seeking FP&A Analysts to develop realistic tasks that test AI agents’ ability to analyze business performance and support financial planning. You will create original tasks and reference models, then evaluate agents working with spreadsheets, planning software, and financial datasets.C
AI Training
Fully Remote · remote
$80–$150/hr
Technical Task Auditor
Audit technical tasks for accuracy, realism, reproducibility and tests. Specialties include GPU kernels, security, machine learning, AWS, Kubernetes and SWE-Bench.
Eligibility varies
$60/hr · varies by task
Verita AITask & Evaluation Specialist
What this role does Design realistic, difficult shopping-related tasks (e.g. meal planning, restocking, gifting, travel prep) that stress-test AI models, then build the rubrics used to grade how well a model performs them. Who we're looking for Subject-matter expertise in retail, e-commerce, consumer shopping behavior,
Software Engineering
Remote · eligibility varies
$60/hr
SME CareersCivil Engineer
If you are a civil engineer who thrives on technical precision, applied problem solving, and infrastructure focused reasoning, this is a unique opportunity to contribute directly to how the next generation of AI systems understand and communicate complex engineering concepts.…
Civil EngineeringInfrastructure DesignStructural Analysis
Bangladesh · Bhutan · Brazil +14 more
Up to $100/hr
Sovrano AISoftware Engineering Expert, AI Trainer
Fully remote, project-based work checking how well AI coding agents handle real software engineering. You write tasks based on your own experience and grade where the agent gets it wrong. $40 to $125 USD an hour, at least 10 hours a week, as an independent contractor. For working software engineers in the US, UK, Irela
Software engineeringCode reviewDebugging
Remote (US, CA, UK, AU, IE)
$40–125/hr
C/C++ Developer – AI Training & Code Evaluation
Curate and evaluate C/C++ code for AI training and performance.
PythonJavaScriptJava
Remote · eligibility varies
Not disclosed