Staff Data Infrastructure Engineer for Scalable ML Pipelines

Neura Market; San Francisco, Northern (CA, KY); Hybrid; USD 500,000 - 850,000; Full time

Benefits offered by this job

Competitive compensation

Equity donation matching

Generous vacation

Parental leave

Flexible working hours

Office space

Job summary

Anthropic in San Francisco is seeking a Staff level Engineer to join the Pre-training team, responsible for developing the next generation of large language models. You will work at the intersection of cutting-edge research and practical engineering, contributing to safe, steerable, and trustworthy AI systems.

You will design data processing infrastructure for LLM training, build high-throughput distributed systems, and collaborate with researchers to create scalable data pipelines.

Qualifications

• 5+ years of experience outside internships.
• Strong software engineering skills for high-throughput fault-tolerant distributed systems.
• Hands-on experience with distributed computing frameworks, particularly Apache Spark.
• Excellent problem-solving and attention to detail.
• Strong communication and collaborative abilities.
• Advanced degree in Computer Science or related field.
• Experience with language model training infrastructure.
• Background in Data Infrastructure, MLOPs, or ML infrastructure.

Responsibilities

• Design and implement data processing infrastructure for large language model training (highly performant, reproducible, traceable).
• Develop and maintain core processing primitives (e.g., tokenization, deduplication, chunking) with a focus on scalability.
• Build robust systems for data quality assurance and validation at scale.
• Collaborate with research teams to implement novel data processing architectures.
• Build and operate end-to-end data pipelines that turn raw web-scale corpora into training-ready datasets.

Skills

Distributed systems

Python

Rust

Apache Spark

MLOps / Data infra

Problem solving

Communication

Team collaboration

Education

Advanced degree in Computer Science or related field

Tools

Spark

Job description

Anthropic in San Francisco is seeking a Staff level Engineer to join the Pre-training team, responsible for developing the next generation of large language models. You will work at the intersection of cutting-edge research and practical engineering, contributing to safe, steerable, and trustworthy AI systems.

You will design data processing infrastructure for LLM training, build high-throughput distributed systems, and collaborate with researchers to create scalable data pipelines.