Quality Assurance

Video Evaluation Generalist

Mercor

Verified listing

Remote

WorldwidePosted Sep 3$15-$20 per hour

Overview

Mercor partners with leading AI labs to train frontier models using human expertise. This role involves evaluating short video clips side by side against a provided rubric, scoring them across dimensions like prompt adherence, motion quality, and visual artifacts.

What You’ll Do

Watch and compare two short video clips presented side by side
Evaluate videos against a provided rubric across dimensions such as prompt adherence, motion quality, visual artifacts, and physical plausibility
Assign rubric scores to each clip and select an overall preference between the two
Document brief written justifications supporting scoring decisions
Apply consistent standards across high task volumes while maintaining calibration to the rubric

Requirements

Bachelor's degree (BS or BA) from a reputable institution completed or in progress
Strong writing and critical thinking skills
Ability to work independently and meet deadlines
Minimum 20 hours per week commitment for approximately 1.5 weeks

Who Should Apply

This role suits academics, researchers, or professionals with strong writing and analytical skills who can make consistent judgments under clear rubrics. You'll thrive if you're detail-oriented, can work independently on repetitive tasks, and enjoy distilling complex visual phenomena into clear written explanations. It will frustrate you if you prefer varied work, need significant interaction with managers, or struggle with maintaining calibration across large task volumes.

Salary Insight

$15–$20/hour is standard for high-skill remote contract annotation work, though on the lower end for roles requiring a bachelor's degree and research experience. The hourly rate means at 20 hours/week for 1.5 weeks, you'd earn $600–$800 total. The posting doesn't specify whether you'll hit the full 20 hours every week or how the work scales; clarify this and whether hours can flex if you need to plan income around it.

About Mercor

A marketplace placing specialists into paid remote contract work with AI companies. One profile and one AI interview, reused across every role you apply to.

Remote policy: Fully remote, worldwide, on hourly contractor agreements rather than employment. But payment eligibility is the thing to check before you invest any time, because it is decided by country and there is no way around it. Mercor pays through Stripe Connect in…

How hiring works at Mercor →

Required Skills

video evaluationrubric scoringcritical analysiswritten justificationAI training data

Compensation

$15-$20 per hour

Location: Worldwide
Engagement: Remote
Posted: Sep 3

Opens Mercor’s listing on MyRemoteJobs Team — we don’t collect applications ourselves.

About Mercor

A marketplace placing specialists into paid remote contract work with AI companies. One profile and one AI interview, reused across every role you apply to.

How hiring works at Mercor →

Will your CV get past the filter?

Most applications are rejected by software before a person ever reads them. Scan your CV using our ATS Checker tool, see exactly what's blocking it, then fix it in the CV Builder and apply knowing it'll get through.

Scan my CV

Get roles like this by email

Tell us what you do and we'll email you when a similar remote job is posted. No account needed.

See our jobs more often in your search

Add MyRemoteJobs as a Preferred Source on Google. Free, takes seconds, and you stay on this page.

Application Tip

The rubric and scoring consistency are the heart of this work—this isn't about watching videos, it's about reliably applying a standard at scale. In your application, lead with a concrete example of a time you've had to apply evaluation criteria consistently across many items (grading papers, peer review, quality audits, or even game testing), showing how you caught your own calibration drift and corrected it. The 15-minute AI interview will test your ability to articulate judgment calls clearly; practice explaining why you'd score something a certain way in 2–3 sentences before you apply.

Sourced from MyRemoteJobs Team · verified against the original posting