Data-Centric AI Research Scientist - Alignment & Evaluation

Surge AI

United States

Remote

USD 130,000 - 210,000

Full time

14 days+
Application generator

Get a reply from this employer — a resume and cover letter tailored to exactly what they’re hiring for.

Get past ATS filters

Job summary

Surge AI in the United States is seeking a Research Scientist focused on data to push the frontiers of LLM development. You’ll design datasets that guide frontier models, partner directly with AI research teams to test data collection strategies, evaluate dataset quality, and uncover insights that improve alignment, safety, and performance.

This is a research-driven, impactful role where you’ll experiment quickly in production, shape data-centric methodologies, and help define how high-quality

Qualifications

  • Deep curiosity about data and its influence on LLM performance.
  • Bias toward insight and iteration; design lightweight experiments.
  • Desire to shape AI development and data infrastructure.

Responsibilities

  • Research data collection strategies and design high-impact data slices that uncover model failure modes.
  • Model annotator behavior and design experiments to improve instruction clarity and reward signal reliability.
  • Develop metrics and frameworks for evaluating dataset quality and impact on downstream model alignment.

Skills

Data curiosity
Iterative mindset
AI development

Job description

Surge AI in the United States is seeking a Research Scientist focused on data to push the frontiers of LLM development. You’ll design datasets that guide frontier models, partner directly with AI research teams to test data collection strategies, evaluate dataset quality, and uncover insights that improve alignment, safety, and performance.

This is a research-driven, impactful role where you’ll experiment quickly in production, shape data-centric methodologies, and help define how high-quality

Get your free, confidential resume review.

or drag and drop your file here.

Similar jobs

Similar jobs worth comparing

Research Scientist
Research Scientist

Surge AI • United States

Remote
USD 130,000 - 210,000
Remote AI Evaluation & Alignment Research Engineer
Remote AI Evaluation & Alignment Research Engineer

United States Digital Space LLC • United States

Remote
USD 120,000 - 160,000
External Handbook
Website
Youtube
Lead AI Alignment & Evaluation Researcher
Lead AI Alignment & Evaluation Researcher

Wipro • San Francisco (CA)

On-site
USD 240,000 - 375,000
Medical benefits
Dental benefits
Paid time off
+1
Human Data Architect — Design Scalable AI Data Pipelines
Human Data Architect — Design Scalable AI Data Pipelines

Surge AI • United States

Remote
USD 120,000 - 210,000
AI Systems & DataOps Engineer
AI Systems & DataOps Engineer

Surge AI • United States

Remote
USD 110,000 - 180,000
Data Partnerships & Initiatives Lead for Open AI Research
Data Partnerships & Initiatives Lead for Open AI Research

Reflection AI • New York (NY)

On-site
USD 140,000 - 190,000
Top-tier compensation
Stock options
Health & wellness
+1
Software Engineer - Coding Data & Evaluation for Frontier AI
Software Engineer - Coding Data & Evaluation for Frontier AI

Surge AI • United States

Remote
USD 110,000 - 180,000
Frontier Coding Data Engineer — Evaluation & Training
Frontier Coding Data Engineer — Evaluation & Training

Surge AI • United States

Remote
USD 140,000 - 210,000
Strategic Projects Lead
Strategic Projects Lead

Surge AI • United States

Remote
USD 140,000 - 200,000
Analytics Team Lead
Analytics Team Lead

People In AI • New York (NY)

On-site
USD 100,000 - 130,000