Lead Evaluation Researcher

Aaru; New York (NY); On-site; USD 180,000 - 260,000; Full time

Benefits offered by this job

Equity participation

Comprehensive medical, vision, dental

Visa sponsorship & relocation support

Job summary

Aaru in New York City seeks an Evaluation Research Manager to lead a focused team of researchers and engineers. You will translate the company's evaluation charter into a coherent portfolio of studies, datasets, and shared infrastructure, and be accountable for quality, pace, and impact.

You will design studies, write analysis code, inspect failures, review statistical choices, and contribute to the hardest evaluations while collaborating across population research, prediction research, and

Qualifications

• Led evaluation, measurement, or empirical research in ML, behavioral science, econometrics, or measurement theory.
• Defined study constructs, datasets, and evidence collection methods.
• Designed studies, inspected failures, and reviewed statistical choices.
• Wrote code, analyzed large datasets, and maintained reproducible pipelines.
• Led a small, high-talent research team with direct feedback.
• Communicated scientific results clearly to mixed audiences.

Responsibilities

• Build, lead, and develop a high-performing team of Evaluation Researchers and engineers.
• Translate evaluation questions into measurable constructs and decisive experiments.
• Set an evaluation agenda across population construction, predictive systems, and simulations.
• Decide which evaluations become reusable rails and which require bespoke studies.
• Establish standards for baselines, holdouts, power, and reproducibility.
• Create diagnostic tests that reveal why systems fail and how to fix them.
• Partner with Simulation Engineering to integrate evaluations into release workflows.

Skills

Evaluation leadership

Experimental design

Data analysis

Code writing

Team leadership

Communication

Job description

Aaru in New York City seeks an Evaluation Research Manager to lead a focused team of researchers and engineers. You will translate the company's evaluation charter into a coherent portfolio of studies, datasets, and shared infrastructure, and be accountable for quality, pace, and impact.

You will design studies, write analysis code, inspect failures, review statistical choices, and contribute to the hardest evaluations while collaborating across population research, prediction research, and