Technical Research Analyst | $10/hr Remote

Crossing Hurdles

Brasil

Vor Ort

BRL 90.000 - 150.000

Vollzeit

14 Tage+

Eine vollständige Bewerbung in einer Minute

Maßgeschneiderter Lebenslauf und Anschreiben – versandbereit.

Schaffe es an den ATS-Filtern vorbei

Zusammenfassung

Crossing Hurdles seeks professionals with deep investigative research and fact-checking experience to design and validate AI benchmarks. You will craft difficult research tasks, test model outputs, and analyze search trajectories with strong OSINT skills and precise writing abilities.

The role emphasizes rigorous primary-source-backed benchmarks and red-teaming perspectives to ensure high-quality QA and evaluation of AI models.

Qualifikationen

  • Possess strong relevant experience in investigative research, fact-checking, AI benchmark authoring, red-teaming, or technical QA.
  • Experience using AI benchmarks such as GAIA, BrowseComp, SimpleQA, SWE-bench, Terminal-Bench, or Humanity's Last Exam.
  • Demonstrate strong web research and OSINT skills, including navigating archives, records, and databases.
  • Capable of analyzing model search trajectories and failures.
  • Strong writing skills to craft clear benchmark tasks.

Aufgaben

  • Investigate hard-to-find facts and verify information through credible sources.
  • Design challenging research tasks to test AI models.
  • Test AI model outputs and identify failures in search and reasoning.
  • Analyze model search trajectories, source selection, and reasoning failures.
  • Write clear benchmark prompts and accurate, primary-source-backed answer keys.

Kenntnisse

Investigative research
Fact-checking
AI benchmark authoring
Red-teaming
Technical QA
OSINT skills
Web research
Strong writing

Tools

GAIA
BrowseComp
SimpleQA
SWE-bench
Terminal-Bench
Humanity's Last Exam

Jobbeschreibung

  • Investigate hard-to-find facts and verify information through credible sources.
  • Design challenging research tasks to test AI models.
  • Test AI model outputs and identify failures in search and reasoning.
  • Analyze model search trajectories, source selection, and reasoning failures.
  • Write clear benchmark prompts and accurate, primary-source-backed answer keys.
Requirements
  • Possess strong relevant experience in investigative research, fact-checking, AI benchmark authoring, red-teaming, or technical QA.
  • Have experience using AI benchmarks such as GAIA, BrowseComp, SimpleQA, SWE-bench, Terminal-Bench, or Humanity s Last Exam.
  • Demonstrate strong web research and OSINT skills, including navigating academic archives, local records, and specialized databases.
  • Capable of strong analysis of model search trajectories and failures.
  • Strong writing skills to craft clear and accurate benchmark tasks.
Hol dir deinen kostenlosen, vertraulichen Lebenslauf-Check.

oder ziehe deine Datei hierhin.

Similar jobs

Ähnliche Jobs, die dir auch gefallen könnten

Internet Research Analyst | $10/hr Remote
Internet Research Analyst | $10/hr Remote

Crossing Hurdles • Brasilien

Vor Ort
BRL 120.000 - 180.000
Market Research Expert
Market Research Expert

SME Careers • Brasilien

Remote
BRL 96.000 - 165.000
Security Engineer(AI Trainer) | $20/hr | Remote
Security Engineer(AI Trainer) | $20/hr | Remote

Codefeast • Brasilien

Remote
BRL 130.000 - 185.000
Copy of Senior Python Developer (AI Evaluation & Benchmarking)
Copy of Senior Python Developer (AI Evaluation & Benchmarking)

Liftedanupworkcompany • Brasilien

Remote
BRL 637.000 - 796.000
C++ Engineer
C++ Engineer

SME Careers • Brasilien

Remote
BRL 276.000 - 588.000
AI Agent Evaluation Analyst (Freelance)
AI Agent Evaluation Analyst (Freelance)

Mindrift • Rio de Janeiro

Remote
BRL 111.037 - 125.842
Competitive pay up to $17/hour
Flexible working hours
Advanced AI project experience
Remote Business Analyst - 57510
Remote Business Analyst - 57510

Turing • Brasilien

Remote
BRL 287.000 - 573.000
Competitive compensation
Flexible working hours
Fully remote environment
+2
Java Engineer
Java Engineer

SME Careers • Brasilien

Remote
BRL 83.000 - 165.000
Senior C Engineer
Senior C Engineer

SME Careers • Brasilien

Remote
BRL 120.000 - 150.000
AI Data Quality Analyst
AI Data Quality Analyst

Alignerr Corp. • Brasilien

Remote
BRL 78.000 - 311.000