Principal AI Performance Engineer

Graphcore; Austin, Northern (TX, KY); Hybrid; USD 180,000 - 240,000; Full time

Benefits offered by this job

Health coverage

Mental health resources

Retirement plan

Paid time off

Life insurance

Flexible hours

Professional development

Job summary

Graphcore in Austin, TX seeks a Principal AI Performance Engineer to direct optimization of AI training and inference workloads at data center scale. You will shape hardware, software, networking, and system architecture decisions and lead the toughest profiling efforts across multi-node deployments.

You will define benchmarks, steer measurement practices, and guide cross-team collaboration, influencing strategy and priorities with evidence-driven engineering.

Qualifications

• Deep experience profiling and optimizing AI/ML or HPC workloads at scale.
• Proven technical leadership across complex performance engineering initiatives.
• Expert C++ and Python skills with performance-sensitive code.

Responsibilities

• Lead performance investigations from model behavior to multi-node scaling.
• Turn profiling and modeling into technical roadmaps and priorities.
• Set measurement standards and guide distributed communication strategy.
• Review and improve core C++/Python tools for performance.

Skills

AI performance profiling

Leadership

C++

Python

Distributed systems understanding

Tools

MPI

NCCL

UCX

libfabric

MLPerf

Job description

Set the performance direction behind large-scale AI systems built for real deployment.

As a Principal AI Performance Engineer, you will define how Graphcore analyzes and optimizes AI training and inference workloads. Your work will shape decisions across hardware, software, networking and system architecture.

You will lead the hardest performance investigations, from model behavior to multi-node scaling. You will turn profiling, benchmarking and modeling evidence into technical roadmaps and engineering priorities.

You will set measurement standards, guide distributed communication strategy and review critical C++ and Python tools. Your judgment will help teams make better decisions when data is incomplete.

This role gives you rare influence across AI infrastructure at data center scale. It is based in Austin, Texas.

The team and culture

The System Engineering Performance team architects, evaluates and optimizes high-performance infrastructure for large-scale data center deployments. The team works across the computing stack to understand real system behavior.

Work happens through evidence, technical ownership and direct cross-team influence. You will guide strategy, resolve complex tradeoffs and raise performance-engineering standards across the organization.

Decisions are shaped by benchmarks, simulations, models and clear technical debate. The team values engineers who think big, act fast, take responsibility, speak up and lead beyond their own area.

What we’re looking for

• Deep experience profiling and optimizing AI, machine learning or high-performance computing workloads at scale.
• Proven technical leadership across complex performance-engineering or system-architecture initiatives.
• Expert C++ and Python skills, including reliable tools or performance-sensitive software.
• Expert understanding of compute, memory, communication and scaling behavior in distributed systems.
• Ability to define benchmarks, measurement practices or optimization standards across teams.
• Experience with MPI, NCCL, UCX, libfabric, MLPerf, accelerated architectures or high-performance interconnects.

While we have outlined a set of requirements, we value transferable skills and diverse experiences. We also welcome engineers returning to the profession after a career break, including through returnship routes.

Graphcore offers competitive compensation and benefits designed to support employees' health, financial well-being, work-life needs, and professional growth. Benefits and programs for eligible U.S. employees may include:

• Medical, dental, and vision coverage, with options that may extend to eligible dependents.
• Mental health, wellness, and employee assistance resources.
• Retirement savings benefits and company contributions where applicable.
• Paid vacation, sick time, company holidays, and parental or family leave in accordance with applicable plans and policies.
• Life insurance and short-term or long-term disability coverage.
• Flexible working hours and hybrid working arrangements where compatible with the role and team requirements.
• Professional-development resources, learning programs, office amenities, and team-led activities.

Benefits vary by work location, employment status, scheduled hours, and plan eligibility and are subject to the terms of the applicable plans and company policies. This overview is not a contract or guarantee of benefits.

Graphcore is an equal opportunity employer. We consider qualified applicants without regard to race, color, religion, creed, sex, pregnancy, sexual orientation, gender identity or expression, national origin, ancestry, age, disability, genetic information, veteran status, or any other status protected by applicable law.

Graphcore is committed to an inclusive and accessible hiring process. If you need a reasonable accommodation to participate in the application or interview process, please let the recruiting team know.

Personal information submitted during the recruiting process will be handled in accordance with Graphcore's applicable candidate privacy notices.

Join the Team at Graphcore

Graphcore is one of the world’s leading innovators in Artificial Intelligence compute. It is developing hardware, software and systems infrastructure that will unlock the next generation of AI breakthroughs and power the widespread adoption of AI solutions across every industry.

As part of the SoftBank Group, Graphcore is a member of an elite family of companies responsible for some of the world’s most transformative technologies. Together, they share a bold vision: to enable Artificial Super Intelligence and ensure its benefits are accessible to everyone.

Graphcore’s teams are drawn from diverse backgrounds and bring a broad range of skills and perspectives. A melting pot of AI research specialists, silicon designers, software engineers and systems architects, Graphcore brings together deep expertise to solve complex problems and deliver meaningful progress in AI compute.