Key Skills

Job Description

Psychology researchers to build the behavioral science scenarios frontier AI labs use to test model judgment. AfterQuery builds the expert evaluation data that frontier AI labs use to measure and improve their models. We're hiring psychology researchers as contractors to author and grade the behavioral science scenarios those evaluations run on. This is our social science listing, and every psychology specialty is welcome. What you'll actually do Author realistic behavioral science scenarios from study design through interpretation, the kind a working researcher actually reasons through. Write reference answers with the methodological reasoning behind each conclusion, constructs, confounds, and effect sizes weighed. Grade model output for construct validity, inference quality, and replication awareness. Flag claims that read plausible but overstate what the evidence supports, the misses only a trained researcher would catch. Who this is for Psychology researchers with an advanced degree in psychology or a closely related behavioral science. Academics, UX researchers, and applied behavioral scientists with at least two years of human subjects or behavioral data research. Researchers who reason from methods and evidence, and know what the replication crisis taught the field. People with strong written English who can turn methodological judgment into clear, teachable reasoning. Contract and pay $60 to $120/hr, paid weekly via Stripe. Your rate is set from your experience, not negotiated down after you start. Fully remote, fully async. No fixed hours. Minimum 10 hours per week, no maximum. Scale up or down week to week. No screen recording, no keystroke monitoring, no idle timers. Independent contractor. Ongoing project work rather than single task batches. How our hiring process works Apply at /apply/psychology-research-expert. About five minutes. Resume plus a few structured questions. Resume review. Every application gets read against a published rubric and gets a decision. Written assessment. You may be asked to take a written assessment for further placement. Onboarding. Sign the contractor agreement, connect Stripe, and get platform access. Project match. You're matched to live work in your specialty, usually within a week of onboarding. About AfterQuery AfterQuery is an expert data lab. We build the evaluation and training data that frontier AI labs use to measure what their models can and can't do in real professional work. Our contributors are practicing professionals, not annotators, and the work is credited, reviewed, and paid at professional rates. Responsibilities Author realistic behavioral science scenarios from study design through interpretation Write reference answers with the methodological reasoning behind each conclusion Grade model output for construct validity, inference quality, and replication awareness Flag claims that read plausible but overstate what the evidence supports Required Qualifications Advanced degree in psychology or a closely related behavioral science 2+ years of research experience with human subjects or behavioral data Working command of study design, measurement, and statistical inference Clear written English for documenting behavioral reasoning Able to commit at least 10 hours per week Preferred Qualifications PhD and peer reviewed publications Cognitive, social, clinical, or industrial organizational specialty depth UX research or applied behavioral science industry experience Why apply Work stays in your specialty, judged on methodological judgment rather than output volume Set your own hours and scale up or down week to week Weekly pay via Stripe at a rate set from your experience Your judgment shapes how the next generation of AI handles human behavior

Core Responsibilities

Author realistic behavioral science scenarios and reference answers that explain the methodological reasoning behind conclusions. Evaluate model responses for construct validity, inference quality, and awareness of replication, and flag claims that exceed the evidence.

Requirements

Applicants need an advanced degree in psychology or a closely related behavioral science, at least two years of human-subjects or behavioral-data research experience, and a working command of study design, measurement, and statistical inference. Strong written English and a commitment of at least 10 hours per week are required.

Benefits

• Weekly Pay
• Flexible Schedule
• Fully Remote Work
• No Screen Recording
• No Keystroke Monitoring
• No Idle Timers
• Ongoing Project Work