Psychologist – EQ & Theory of Mind Annotator

Psychologist – EQ & Theory of Mind Annotator

The team is looking for licensed psychologists, clinical psychologists, or researchers with expertise in social cognition to join Project TOM

Details

• Remote, flexible schedule | ~1-1.25 hrs per task | Paid hourly
• Pilot phase: 30 entries before full production
• Triple-blind annotation: each task reviewed by 3 independent annotators
• Target accuracy: 80%+ label consistency with Gold Standard

Day-to-day

• Evaluate AI model responses across 7 Theory of Mind (ToM) dimensions: Intentions (T1), Emotions (T2), Desires (T3), Percepts (T4), Knowledge (T5), Beliefs (T6), and Non-literal Communication / Subtext (T7)
• Compare two AI model outputs (Model A vs. Model B) and select the preferred response with a written rationale (~50 words per dimension)
• Assess whether AI models correctly diagnose mental states (Stage
• 1), form coherent behavioral strategies (Stage
• 2), and produce psychologically authentic final responses (Stage
• 3)
• Identify false beliefs, emotional misattributions, hallucinated knowledge states, and failures of Theory of Mind reasoning

You bring

• Licensed psychologist, clinical psychologist, counselor, or researcher with expertise in social cognition, ToM, or interpersonal psychology
• Strong ability to perceive subtext, emotional undercurrents, and causal chains in human behavior
• Experience with sentiment
• Analysis:, behavioral assessment, or text-based psychological evaluation
• Familiarity with Eastern and Western cultural norms in interpersonal conflict resolution
• Details
• Remote, flexible schedule | ~1-1.25 hrs per task | Paid hourly