Performance Engineer — AI Inference Systems

Anthropic; San Francisco (CA); Hybrid; USD 350,000 - 850,000; Full time

Benefits offered by this job

Visa sponsorship

Flexible hybrid work policy

Job summary

Anthropic is looking for a Performance Engineer to work on its Inference System Dynamics team. You will focus on optimizing throughput, latency, and correctness across systems serving millions of users. You will also improve the evaluation pipeline for model outputs and build observability tools for performance metrics.

The ideal candidate has hands-on experience in performance engineering, strong data analysis skills, and proficiency in Python. This role offers a hybrid work environment and is integral to maintaining the high standards of AI systems.

Qualifications

• 1+ years of hands-on performance engineering experience in complex production systems.
• Ability to read and contribute to large production Python codebases.
• Solid experience with data analysis tools like SQL or pandas.

Responsibilities

• Run performance investigations across throughput, latency, and reliability.
• Improve correctness evaluation pipeline for model output quality.
• Build observability and dashboards for performance metrics.

Skills

Performance engineering experience

Proficiency in Python

Data analysis skills

Communication of quantitative results

Interest in correctness

Education

Bachelor’s degree or equivalent

Job description

Anthropic is looking for a Performance Engineer to work on its Inference System Dynamics team. You will focus on optimizing throughput, latency, and correctness across systems serving millions of users. You will also improve the evaluation pipeline for model outputs and build observability tools for performance metrics.

The ideal candidate has hands-on experience in performance engineering, strong data analysis skills, and proficiency in Python. This role offers a hybrid work environment and is integral to maintaining the high standards of AI systems.