myRemoteJobs
Quality Assurance

AI Agent Tester - Real-World Tasks

micro1

Verified listing
Contract
U.S. basedPosted Oct 21$25 - $45/hr

Overview

micro1 is testing how well AI agents handle real-life errands and tasks. This role involves testing two AI agents side by side on everyday scenarios like bill payments, bookings, shopping, and travel—using your own phone and accounts—to evaluate their performance and provide feedback on what works and what doesn't.

What You’ll Do

  • Run real-life scenarios (bills, returns, email follow-ups, bookings, shopping, groceries, travel, family logistics, outings, forms)
  • Approve or stop AI agents at key decision points
  • Screen record every test attempt
  • Score each run on completion, quality, control issues, satisfaction, and time
  • Provide clear written feedback on agent experience

Requirements

  • US-based
  • Bachelor's degree
  • 2-3 years of experience in engineering, business management, or office/operations
  • Active personal AI assistant account (Plus tier)
  • Active Muse and Dots access
  • Smartphone capable of screen recording
  • Payment card for test purchases (reimbursed)
  • Detail-oriented with strong ability to follow instructions
  • Clear written communication skills

Who Should Apply

Apply if you already use AI daily, notice how products fail in real ways, and enjoy documenting what you observe clearly. This suits someone methodical and patient, but will frustrate anyone who needs deep technical challenge, fixed schedules, or a sense of working toward a singular product roadmap—you're running ad-hoc tasks, not building anything.

Salary Insight

The range $25–$45/hr reflects time zone and experience spread, with tasks lasting roughly 1.5 hours each at around $37.50–$67.50 per completed run. No salary stated but pay is explicit: clarify with the hiring team whether you can cherry-pick tasks or are expected to take all assignments, and whether there's a minimum task volume per week or month.

Required Skills

AI agentsChatGPTMuseScreen recordingReal-world testing

Compensation

$25 - $45/hr

Location
U.S. based
Engagement
Contract
Posted
Oct 21

Opens micro1’s listing on MyRemoteJobs — we don’t collect applications ourselves.

About Micro1

Platform connecting domain experts with AI training and evaluation projects, paid on a flexible contract basis.

Remote policy: Remote worldwide, excluding Afghanistan, Belarus, China, Cuba, Democratic Republic of the Congo, Hong Kong, Iran, Iraq, Libya, Macao, Myanmar, North Korea, Russia, Somalia, South Sudan, Sudan, Syria, Venezuela, Ukraine and Yemen. Individual projects may have…

How hiring works at Micro1 →

Will your CV get past the filter?

Most applications are rejected by software before a person ever reads them. Scan your CV using our ATS Checker tool, see exactly what's blocking it, then fix it in the CV Builder and apply knowing it'll get through.

Scan my CV

Get roles like this by email

Tell us what you do and we'll email you when a similar remote job is posted. No account needed.

Free. We email you as soon as a role matches — applying early matters. Only genuine matches, and unsubscribe in one click.

See our jobs more often in your search

Add MyRemoteJobs as a Preferred Source on Google. Free, takes seconds, and you stay on this page.

Application Tip

Lead with a specific example of an AI tool failing or surprising you in real life—not a generic "I use ChatGPT"—and walk through exactly what you observed and why it mattered. This role succeeds or fails on your ability to notice small UX problems and articulate them clearly; hiring managers will be looking for signs that you think like a user, not a feature list. Mention any prior QA, user testing, or feedback documentation experience if you have it.

Sourced from MyRemoteJobs · verified against the original posting