Research Engineer: Scalable Pretraining

Anthropic; San Francisco (CA); On-site; USD 350,000 - 850,000; Full time

Job summary

Anthropic is seeking a Research Engineer in San Francisco to enhance the efficiency and reliability of large-scale production pretraining models. The role is positioned at the intersection of research and engineering, demanding a 50/50 blend of skills in both areas. Successful candidates will have hands-on experience with ML frameworks like JAX and TPU, and must thrive in high-pressure situations. This unique position offers extensive operational challenges along with substantial learning opportunities in pioneering AI systems.

Qualifications

• Experience with training large language models is essential.
• Background in research and engineering is desired.
• Desire to work in a fast-paced, operationally intense environment.

Responsibilities

• Own critical aspects of the production pretraining pipeline.
• Design and run experiments to improve training efficiency.
• Respond to on-call incidents during model launches.

Skills

Hands-on experience training large language models

Expertise with JAX

Expertise with TPU

Expertise with PyTorch

Experience with large-scale distributed systems

Excellent debugging skills

Strong communication skills

Education

Bachelor's degree or equivalent

Tools

JAX

TPU

PyTorch

Job description

Anthropic is seeking a Research Engineer in San Francisco to enhance the efficiency and reliability of large-scale production pretraining models. The role is positioned at the intersection of research and engineering, demanding a 50/50 blend of skills in both areas. Successful candidates will have hands-on experience with ML frameworks like JAX and TPU, and must thrive in high-pressure situations. This unique position offers extensive operational challenges along with substantial learning opportunities in pioneering AI systems.