Senior AI Performance Engineer

Graphcore; Austin (TX); Hybrid; USD 190,000 - 260,000; Full time

Benefits offered by this job

Medical, dental, and vision coverage

Mental health resources

Retirement savings benefits

Paid vacation and holidays

Life insurance and disability coverage

Flexible working hours and hybrid work

Job summary

Graphcore in Austin, Texas seeks a Senior AI Performance Engineer to analyze and optimize AI training and inference workloads across large-scale distributed systems. You will own performance investigations from problem definition through validation, turning profiling, benchmarking and modeling results into concrete improvements.

You will design benchmarks and investigate bottlenecks, optimizing distributed communication software across technologies such as MPI, NCCL, UCX and RDMA.

Qualifications

• Strong experience profiling and optimizing AI, machine learning or high-performance computing workloads.
• Experience with distributed systems and communication libraries such as MPI, NCCL, UCX or libfabric.
• Strong C++ and Python skills, including reliable tools or performance-sensitive software.
• Deep understanding of compute, memory and communication behavior in large-scale systems.
• Ability to own complex technical work and coordinate improvements across teams.
• Familiarity with MLPerf, accelerated architectures, ML frameworks or high-performance interconnects.

Responsibilities

• Analyze and optimize AI training and inference workloads across large-scale distributed systems.
• Own complex performance investigations from problem definition through validation.
• Turn profiling, benchmarking and modeling results into actionable improvements for engineers.
• Design benchmarks, investigate system bottlenecks and optimize distributed communication software (MPI/NCCL/UCX).
• Contribute to cross-team collaboration and technical decision-making with data-driven evidence.
• Engage with hardware, software, networking and system architecture considerations to improve AI compute performance.

Skills

AI profiling

Distributed systems

MPI/NCCL/UCX

C++

Python

Performance optimization

Systems architecture

Cross-team collaboration

Job description

About The Job

Turn complex AI workload signals into faster, more efficient systems at data center scale.

Turn complex AI workload signals into faster, more efficient systems at data center scale. As a Senior AI Performance Engineer, you will analyze and optimize AI training and inference workloads across large-scale distributed systems. Your work will connect compute, memory, communication and software behavior. You will own complex performance investigations from problem definition through validation. You will turn profiling, benchmarking and modeling results into improvements engineers can build from. You will design benchmarks, investigate system bottlenecks and optimize distributed communication software across technologies such as MPI, NCCL, UCX and RDMA. Your work will help Graphcore deliver efficient, reliable AI systems for large-scale deployment. This role gives you rare scope across hardware, software, networking and system architecture. It is based in Austin, Texas.

The team and culture

The System Engineering Performance team architects, evaluates and optimizes high-performance infrastructure for large-scale data center deployments. The team works across the computing stack to understand real system behavior. Work moves through evidence, ownership and clear technical judgement. You will define investigations, coordinate across teams and validate impact with reliable performance data. Decisions are shaped through benchmarks, models, simulations and practical engineering tradeoffs. The team values engineers who think big, act fast, take responsibility, speak up and lead beyond their own area.

What We’re Looking For

• Strong experience profiling and optimizing AI, machine learning or high-performance computing workloads.
• Experience with distributed systems and communication libraries such as MPI, NCCL, UCX or libfabric.
• Strong C++ and Python skills, including reliable tools or performance-sensitive software.
• Deep understanding of compute, memory and communication behavior in large-scale systems.
• Ability to own complex technical work and coordinate improvements across teams.
• Familiarity with MLPerf, accelerated architectures, ML frameworks or high-performance interconnects.

While we have outlined a set of requirements, we value transferable skills and diverse experiences. We also welcome engineers returning to the profession after a career break, including through returnship routes.

Benefits

Graphcore offers competitive compensation and benefits designed to support employees' health, financial well-being, work-life needs, and professional growth. Benefits and programs for eligible U.S. employees may include:

• Medical, dental, and vision coverage, with options that may extend to eligible dependents.
• Mental health, wellness, and employee assistance resources.
• Retirement savings benefits and company contributions where applicable.
• Paid vacation, sick time, company holidays, and parental or family leave in accordance with applicable plans and policies.
• Life insurance and short-term or long-term disability coverage.
• Flexible working hours and hybrid working arrangements where compatible with the role and team requirements.
• Professional-development resources, learning programs, office amenities, and team-led activities.

Benefits vary by work location, employment status, scheduled hours, and plan eligibility and are subject to the terms of the applicable plans and company policies. This overview is not a contract or guarantee of benefits.

Graphcore is an equal opportunity employer. We consider qualified applicants without regard to race, color, religion, creed, sex, pregnancy, sexual orientation, gender identity or expression, national origin, ancestry, age, disability, genetic information, veteran status, or any other status protected by applicable law.

Graphcore is committed to an inclusive and accessible hiring process. If you need a reasonable accommodation to participate in the application or interview process, please let the recruiting team know.

Personal information submitted during the recruiting process will be handled in accordance with Graphcore's applicable candidate privacy notices.

Join the Team at Graphcore

Graphcore is one of the world’s leading innovators in Artificial Intelligence compute. It is developing hardware, software and systems infrastructure that will unlock the next generation of AI breakthroughs and power the widespread adoption of AI solutions across every industry.

As part of the SoftBank Group, Graphcore is a member of an elite family of companies responsible for some of the world’s most transformative technologies. Together, they share a bold vision: to enable Artificial Super Intelligence and ensure its benefits are accessible to everyone.

Graphcore’s teams are drawn from diverse backgrounds and bring a broad range of skills and perspectives. A melting pot of AI research specialists, silicon designers, software engineers and systems architects, Graphcore brings together deep expertise to solve complex problems and deliver meaningful progress in AI compute.

Ready to improve AI performance across compute, memory, communication and software?