Knowledge Expert — Human Communication & Context Elicitation

In this role, you'll review conversations between participants and AI models, evaluate whether sufficient context was gathered before recommendations were made, identify missed opportunities for clarification, and provide structured feedback that helps improve the quality, reasoning, and conversational abilities of next-generation AI systems.

COMPENSATION

WHAT WE'RE LOOKING FOR

We're seeking subject matter experts with one of the following qualifications:

Successful candidates will also demonstrate:

PREFERRED QUALIFICATIONS

While not required, experience in any of the following is a plus:

KEY RESPONSIBILITIES

• Up to $28 per completed task (average task time: ~87.5 minutes)
• Pay-per-task compensation model
• Up to 40 hours per week
• At least 4 hours of overlap with Pacific Time (PST)
• Fully remote
• 4-week contractor engagement
• Immediate start available
• MSW with LCSW (or equivalent social work licensure)
• MA/MS with LMFT, LPC, LCPC, or equivalent counseling licensure
• PhD or PsyD in Clinical, Counseling, Social, or Industrial-Organizational Psychology
• MA or PhD in Human-Computer Interaction (HCI), Communication, Anthropology, Sociology, Conflict Resolution, Qualitative Research, or a closely related field
• A relevant professional credential combined with 5+ years of direct advisory, coaching, consulting, mediation, or client-facing experience
• Strong analytical thinking and qualitative evaluation skills
• Excellent attention to detail and the ability to consistently apply detailed evaluation guidelines
• Comfort working with spreadsheets, annotation platforms, or data labeling tools
• Strong written communication and documentation skills
• The ability to evaluate nuanced human conversations objectively and consistently
• Experience making evidence-based judgments across ambiguous or complex scenarios
• Conversation analysis or discourse analysis
• AI evaluation, RLHF, or human preference labeling