Research Scientist, AI Benchmarks & Data Quality

deCircle; New York (NY); Sur place; USD 250 000 - 350 000; Plein temps

Résumé du poste

Longitude Labs is seeking a leading AI research hire to design benchmarks, evals and dataset taxonomies that define high-quality AI data. You will perform independent research and publish to establish thought leadership in AI benchmarks.

In-office in NYC or SF (5 days, flex 4) with visa sponsorship available; base salary 250k–350k plus competitive equity. PhD in ML/CS/CV or quantitative science strongly preferred and top-venue publications valued.

Qualifications

• PhD in ML/CS/CV or quantitative science (strongly preferred)
• Top-venue publications (ICML, NeurIPS), ideally top author with cited work
• Deep LLM, benchmark design, eval methodology and data quality expertise
• NYC or SF, in-office 5 days (flex 4)

Responsabilités

• Design and own benchmarks, evals and dataset taxonomies setting the standard for AI data quality
• Independent research and publishing to establish thought leadership in AI benchmarks
• Identify where frontier models fail and build datasets to close gaps
• Partner with domain experts and deployment leads on what high-quality data looks like
• Drive the research agenda with autonomy

Connaissances

Deep LLM

Benchmark design

Evaluation methodologies

Data quality

Python

PyTorch

LLMs

Data Pipelines

Formation

PhD in ML/CS/CV or quantitative science

Outils

Python

PyTorch

LLMs

Evaluation Frameworks

Data Pipelines

Description du poste

Longitude Labs is seeking a leading AI research hire to design benchmarks, evals and dataset taxonomies that define high-quality AI data. You will perform independent research and publish to establish thought leadership in AI benchmarks.

In-office in NYC or SF (5 days, flex 4) with visa sponsorship available; base salary 250k–350k plus competitive equity. PhD in ML/CS/CV or quantitative science strongly preferred and top-venue publications valued.