myRemoteJobs
Quality Assurance

Software Engineering Evaluator

Mercor

Verified listing
Contract
WorldwidePosted Oct 4$100–$150/hr

Overview

Mercor partners with leading AI labs and enterprises to train frontier models using human expertise. In this role, you will review and assess AI-generated work products (slides, spreadsheets, documents) for real-world quality, applying deep software engineering expertise to grade outputs and provide feedback.

What You’ll Do

  • Evaluate AI-generated artifacts for usability in software engineering context
  • Identify factual, aesthetic, and presentation errors
  • Provide clear, structured written feedback

Requirements

  • 5+ years of relevant professional experience in Software Engineering at a top firm in the United States, United Kingdom, Canada, Australia, or New Zealand
  • Native or professional fluency in English
  • Highly proficient in Microsoft Office and Google Workspace (PowerPoint, Excel, Word)

Who Should Apply

This suits experienced software engineers looking for flexible, remote contract work who enjoy detailed critical analysis and writing. You should thrive on evaluating technical quality across different output formats. This will frustrate anyone who wants clear escalation paths, ongoing mentorship, or deep engagement with a single team—it's project-based, asynchronous work with a clear rubric, not a relationship-building role.

Salary Insight

The $100–$150/hr range is typical for expert contract evaluation work, and puts this at the premium end of freelance rates; it reflects the requirement for 5+ years at top-tier firms. The wide band likely accommodates geographic variation and project complexity. Weekly payment via Stripe or Wise reduces payment friction for contractors.

Required Skills

AI evaluationSoftware EngineeringMicrosoft OfficeGoogle Workspace

Compensation

$100–$150/hr

Location
Worldwide
Engagement
Contract
Posted
Oct 4

Opens Mercor’s listing on MyRemoteJobs — we don’t collect applications ourselves.

About Mercor

A marketplace placing specialists into paid remote contract work with AI companies. One profile and one AI interview, reused across every role you apply to.

Remote policy: Fully remote, worldwide, on hourly contractor agreements rather than employment. But payment eligibility is the thing to check before you invest any time, because it is decided by country and there is no way around it. Mercor pays through Stripe Connect in…

How hiring works at Mercor →

Will your CV get past the filter?

Most applications are rejected by software before a person ever reads them. Scan your CV using our ATS Checker tool, see exactly what's blocking it, then fix it in the CV Builder and apply knowing it'll get through.

Scan my CV

Get roles like this by email

Tell us what you do and we'll email you when a similar remote job is posted. No account needed.

Free. We email you as soon as a role matches — applying early matters. Only genuine matches, and unsubscribe in one click.

See our jobs more often in your search

Add MyRemoteJobs as a Preferred Source on Google. Free, takes seconds, and you stay on this page.

Application Tip

Lead with a specific example of a time you reviewed or debugged work you didn't write—ideally something that required you to assess both technical correctness and presentation quality across multiple formats. This role hinges on your ability to be a precise, fair grader under a rubric; mention any experience writing detailed feedback, code review, or quality assurance in a high-bar environment. The best applications show you understand the difference between "this is wrong" and "here's why this fails and how to fix it."

Sourced from MyRemoteJobs · verified against the original posting