GenAI Benchmark Research Scientist (Remote, 35h/wk)

Obsidian; San Francisco (CA); On-site; USD 100,000 - 160,000; Full time

Job summary

Cincinnatus LLC is recruiting experienced data scientists and quantitative analysts to design ground-truth tasks for frontier AI models. This full-time W-2 role is fully remote in the United States, approx. 35 hours per week, with tasks ranging from data cleaning to reporting in notebooks.

You will work closely with researchers to ensure rigorous analyses and clear recommendations for decision-makers. The role requires 1+ year in research-heavy analytics, strong Python (pandas/NumPy), Jupyter or

Qualifications

• MSc or PhD in statistics, data science, or another quantitative STEM field, or equivalent practical experience in a research-heavy analytical domain.
• 1+ years of experience in a research, research-engineering, or heavy data-analysis role.
• Hands-on data-analysis skills: data cleaning, statistical correlation, hypothesis testing, and interpretation.
• Proficiency with Jupyter Notebooks or Google Colab for analysis and reporting.
• Working proficiency in Python (pandas, NumPy) and Git.
• Strong ability to communicate analytical findings in writing for decision-makers.
• Past experience in AI training, model evaluation, or benchmark/task authoring is preferred.
• Perfectionist mindset with high attention to detail and independent work in open-ended problems.
• Ability to engage reliably for approximately 35 hours per week.

Responsibilities

• Design tasks: Create realistic data-analysis challenges — cleaning messy data, comparing methods, interpreting results.
• Author notebooks: Work through tasks in Jupyter or Colab, producing clear, reproducible analyses.
• Compare methods: Build tasks for fair comparisons between analytical approaches with spot checks.
• Evaluate models: Review how models handle tasks, ensuring statistics hold up.
• Work as a team: Compare notes with researchers to keep evaluations consistent and accurate.

Skills

Python

Pandas/NumPy

Data cleaning

Statistical analysis

Git

Notebook reporting

Education

MSc/PhD in statistics or data science

1+ years research/data-analysis experience

Tools

Jupyter

Colab

Job description

Cincinnatus LLC is recruiting experienced data scientists and quantitative analysts to design ground-truth tasks for frontier AI models. This full-time W-2 role is fully remote in the United States, approx. 35 hours per week, with tasks ranging from data cleaning to reporting in notebooks.

You will work closely with researchers to ensure rigorous analyses and clear recommendations for decision-makers. The role requires 1+ year in research-heavy analytics, strong Python (pandas/NumPy), Jupyter or