Engineering Manager, Research Data Platform & Datasets

Anthropic Limited; San Francisco (CA); On-site; USD 405,000 - 850,000; Full time

Benefits offered by this job

Equity donation matching

Generous vacation and parental leave

Flexible working hours

Job summary

Anthropic Limited in San Francisco is seeking a technical lead for the Research Data Platform. You will work directly with researchers and engineers to understand workflows, define the data platform direction, and own core datasets end to end, beginning with RL data models.

You will ship improvements close to code, mentor teammates, and grow into formal people leadership. Strong candidates bring data-intensive systems experience, platform design, and a passion for trustworthy AI.

Qualifications

• Experience building and operating data-intensive systems at scale.
• Experience leading a team or owning data platform architecture.
• Ability to work with researchers and internal users as customers.

Responsibilities

• Work directly with researchers and the engineers supporting them to understand their workflows, identify the highest-leverage opportunities, and shape what the team builds next
• Set the technical direction for the team across our platform and our datasets
• Design and build platform components that other teams plug into - libraries, services, and interfaces such as the metrics library used by training frameworks
• Own core datasets end to end: the pipelines that produce them, the schemas that define them, and the documentation and guarantees that make researchers trust them
• Drive convergence toward canonical datasets - including the core data model for RL transcripts - that research teams standardize on
• Lead complex, multi-quarter projects that span several systems and teams, staying hands-on in the code
• Raise the team's technical bar through design reviews, mentorship, and the quality of your own work

Skills

Data modeling

System design

Leadership

Research collaboration

Experimentation

ML knowledge

ETL pipelines

Big data storage

Education

Bachelor's degree

Tools

Spark

BigQuery

ClickHouse

DuckDB

Parquet

Job description

Anthropic Limited in San Francisco is seeking a technical lead for the Research Data Platform. You will work directly with researchers and engineers to understand workflows, define the data platform direction, and own core datasets end to end, beginning with RL data models.

You will ship improvements close to code, mentor teammates, and grow into formal people leadership. Strong candidates bring data-intensive systems experience, platform design, and a passion for trustworthy AI.