AI Benchmark & Red-Teaming Specialist
Turing
Verified listingOverview
Turing is a research accelerator for frontier AI labs and enterprises deploying advanced AI systems. This role involves building evidence-based benchmark tasks that expose weaknesses in state-of-the-art AI models through investigative research, red-teaming, and rigorous failure diagnosis.
What You’ll Do
- Discover obscure facts and niche research targets that resist simple search queries
- Rigorously verify facts against primary sources and document source URLs
- Author clear, unambiguous benchmark tasks designed to expose model weaknesses
- Execute tasks against SOTA models to confirm they trigger intended failures
- Trace model logs and search trajectories to diagnose exact failure mechanisms
- Apply validated patterns across new domains and review peer-authored tasks
Requirements
- 1+ years in investigative research, fact-checking, AI benchmark authoring, red-teaming, or technical QA
- Proven experience with benchmarks like GAIA, BrowseComp, SimpleQA, SWE-bench, or Humanity's Last Exam
- Intermediate-to-advanced OSINT and web search skills
- Strong analytical capability to inspect model reasoning chains and diagnose failures
- Precision writing ability for clear benchmark prompts and bulletproof answer keys
- Bachelor degree or higher from relevant engineering domain
Who Should Apply
Apply if you combine deep investigative research skills with genuine curiosity about how AI models fail — you'll thrive finding obscure facts, building airtight prompts, and debugging model reasoning at scale. This frustrates people who prefer well-defined tasks, expect high job security, or lack comfort navigating ambiguous data sources; the work is deliberately adversarial and the role is a short-term contract (4 weeks max).
Salary Insight
No salary figure is stated in this posting. This is common for Turing contractor roles and often varies by location and experience level. Research Turing's typical contractor rates on Glassdoor or ask directly during initial screening; bring a day rate or weekly rate in mind based on your experience level with benchmarking and OSINT work. For a specialized role combining research + technical QA, expect to anchor above standard QA rates but below senior researcher rates.
About Turing
Remote work platform connecting skilled professionals with AI labs and companies for software engineering, AI training, data, and specialist contract work.
Remote policy: Remote worldwide, but location eligibility varies by individual project. Many AI roles require minimum hours per week and U.S. Pacific Time overlap. Contractors and freelancers only, not employees.
How hiring works at Turing →Required Skills
Compensation
Not disclosed
- Location
- Remote
- Engagement
- Contract
- Posted
- Oct 20
Opens Turing’s listing on MyRemoteJobs — we don’t collect applications ourselves.
About Turing
Remote work platform connecting skilled professionals with AI labs and companies for software engineering, AI training, data, and specialist contract work.
Remote policy: Remote worldwide, but location eligibility varies by individual project. Many AI roles require minimum hours per week and U.S. Pacific Time overlap. Contractors and freelancers only, not employees.
How hiring works at Turing →Will your CV get past the filter?
Most applications are rejected by software before a person ever reads them. Scan your CV using our ATS Checker tool, see exactly what's blocking it, then fix it in the CV Builder and apply knowing it'll get through.
Scan my CVGet roles like this by email
Tell us what you do and we'll email you when a similar remote job is posted. No account needed.
See our jobs more often in your search
Add MyRemoteJobs as a Preferred Source on Google. Free, takes seconds, and you stay on this page.
Application Tip
Lead with a specific benchmark task you've authored or reviewed — describe the obscure fact, how you verified it, and what model failure it surfaced. Hiring managers here care far more about evidence of OSINT capability and failure diagnosis than credentials; a link to published investigative work or a brief case study of a model you red-teamed will outweigh a generic resume. If you lack formal benchmark experience, emphasize your strongest investigative win: a fact few people could have uncovered, or a source-verification challenge you solved rigorously.
Sourced from MyRemoteJobs · verified against the original posting
Similar open positions
Audio Video Annotator
Turing
Verified
Thai Bilingual Expert
micro1
VerifiedVoice Recorder (French + English)
micro1
Verified