AI Benchmark Architect & OSINT Research Writer

Crossing Hurdles; Colombia; On-site; COP 95,484,000 - 190,967,000; Full time

Job summary

Crossing Hurdles is seeking a detail-oriented researcher to verify information and design AI benchmark tasks in Colombia. The role focuses on testing model outputs, identifying failures, and crafting clear, primary-source-backed prompts and keys.

Candidates should have strong OSINT skills, experience in red-teaming, and excellent technical QA writing abilities to create rigorous benchmark materials.

Qualifications

• Experience in investigative research and fact-checking.
• Ability to design challenging AI benchmark tasks.
• Proficiency in web research and OSINT techniques.
• Experience red-teaming AI models and QA.
• Strong writing skills to craft benchmark prompts.

Responsibilities

• Investigate hard-to-find facts and verify information through credible sources.
• Design challenging research tasks to test AI models.
• Test AI model outputs and identify failures in search and reasoning.
• Analyze model search trajectories, source selection, and reasoning failures.
• Write clear benchmark prompts and accurate, primary-source-backed answer keys.

Skills

Investigative research

Fact-checking

Red-teaming

Technical QA

AI benchmark authoring

Tools

GAIA

BrowseComp

SimpleQA

SWE-bench

Terminal-Bench

Humanity’s Last Exam

Job description

Crossing Hurdles is seeking a detail-oriented researcher to verify information and design AI benchmark tasks in Colombia. The role focuses on testing model outputs, identifying failures, and crafting clear, primary-source-backed prompts and keys.

Candidates should have strong OSINT skills, experience in red-teaming, and excellent technical QA writing abilities to create rigorous benchmark materials.