Remote AI Benchmark Researcher & Red-Teaming Specialist

Benture; San Francisco (CA); Remote; USD 55.000 - 110.000; Teilzeit

Zusammenfassung

Turing, based in San Francisco, is hiring an analytical researcher and red-teaming specialist to build evidence-based benchmark tasks for exposing weaknesses in state-of-the-art AI models. You will verify facts, draft precise prompts, and test tasks against leading models, documenting sources and results with primary evidence.

Remote contractor role with PST overlap. Ideal candidates have 1+ years in AI research, OSINT, and benchmark authoring, plus a Bachelor's degree in a relevant engineering

Qualifikationen

• Bachelor's degree in a relevant engineering field is required.
• 1+ years of investigative research, AI benchmark task authoring, red-teaming, or technical QA review.
• Strong OSINT and web-sourcing abilities.
• Ability to inspect model reasoning chains, logs and source selection to diagnose failures.
• Clear, unambiguous benchmark prompts with primary-sourced answer keys.

Aufgaben

• Research niche topics to uncover factual ground truths not easily surfaced by straightforward queries.
• Verify facts against primary or highly credible sources and document exact URLs.
• Draft clear benchmark tasks to expose weaknesses in model research strategies.
• Run tasks against SOTA models to confirm failure modes and document results.
• Trace model run logs and search trajectories to pinpoint failure points, vs. ambiguous prompts.
• Review tasks authored by peers and apply validated research patterns across domains.

Kenntnisse

Investigative research

Fact-checking

AI benchmark task authoring

Red-teaming

Technical QA review

OSINT

Ausbildung

Bachelor's degree (engineering)

Tools

GAIA

BrowseComp

SimpleQA

SWE-bench

Terminal-Bench

Humanity's Last Exam (HLE)

Jobbeschreibung

Turing, based in San Francisco, is hiring an analytical researcher and red-teaming specialist to build evidence-based benchmark tasks for exposing weaknesses in state-of-the-art AI models. You will verify facts, draft precise prompts, and test tasks against leading models, documenting sources and results with primary evidence.

Remote contractor role with PST overlap. Ideal candidates have 1+ years in AI research, OSINT, and benchmark authoring, plus a Bachelor's degree in a relevant engineering