Sr. AI Software Engineer (GPU/C++)

KLA

Milpitas (CA)

On-site

USD 166,700 - 283,400

Full time

14 days+

Get more replies from employers

Send a job-specific resume in minutes.

Benefits offered by this job

Medical, dental, vision, life benefits
401(k) with company matching
Employee stock purchase program (ESPP)
Tuition reimbursement program
Paid time off and company holidays

Job summary

KLA is seeking a Sr. AI Infrastructure Software Engineer focused on C++. You’ll design and implement core AI infrastructure components that leverage GPUs, collaborate with top engineers, and contribute to shaping the future of computing.

The role requires a strong background in C++, GPU programming (CUDA), and knowledge of build tools like Makefile and CMake. The minimum qualifications include a bachelor's degree with relevant experience. Attractive total rewards package offered.

Qualifications

  • Strong C++ programming skills and solid software engineering fundamentals.
  • Experience with GPU programming in a Linux environment.
  • Familiarity with build tools and compilers.

Responsibilities

  • Design and implement core infrastructure components for AI/ML workloads.
  • Write high-performance C++ code for system-level software.
  • Collaborate to integrate AI frameworks into a unified development environment.

Skills

C++ programming
GPU programming (CUDA)
Linux development
Communication skills
Attention to detail

Education

Bachelor's Degree in Computer Science or related field
Master's Degree with 6 years experience
Doctorate with 3 years experience

Tools

Makefile
CMake
Clang
GCC

Job description

Sr. AI Infrastructure Software Engineer – C++ Focus

Love C++? Fascinated by GPUs? Curious about how AI frameworks with CUDA, TensorFlow, JAX and PyTorch really work under the hood? We’re building the next‑gen software stack that powers the future of AI and we’re looking for sharp, curious engineers who want to get close to the product, and grow to the architect level. If you’re passionate about low system‑level development, this is your chance to make a real impact in AI infrastructure.

You’ll work alongside a world‑class team, top‑notch architects, solving tough problems at the intersection of software and hardware, and growing your skills in a space that’s shaping the future of computing.

What You’ll Do
  • Design and implement core infrastructure components that support AI/ML workloads across multiple frameworks and hardware platforms.
  • Write high‑performance, maintainable C++ code for system‑level software that interfaces directly with GPUs and low‑level hardware.
  • Collaborate with cross‑functional teams to integrate AI frameworks into a unified development environment.
  • Contribute to build systems and toolchains using Makefiles, CMake, Clang, and GCC.
  • Learn from experienced engineers and grow into broader architectural and leadership responsibilities over time.
What We’re Looking For
  • Degree in Computer Science, Electrical Engineering, or a related field.
  • Strong C++ programming skills and solid software engineering fundamentals.
  • Solid experience and hands‑on knowledge with GPU programming (e.g., CUDA) and Linux development environments.
  • Familiarity with build tools (Makefile, CMake) and compilers (Clang, GCC).
  • Bonus: Exposure to AI/ML frameworks like TensorFlow, PyTorch, or JAX.
  • Bonus: Experience with embedded systems or companies building physical products.
  • Excellent attention to detail, planning, and execution skills—especially for multi‑month projects.
  • Strong communication skills and a collaborative, customer‑focused mindset.
  • A plus if you’ve transitioned from software development into technical project coordination or aspire to do so.
Minimum Qualifications
  • Doctorate (Academic) Degree and related work experience of 3 years; Master's Level Degree and related work experience of 6 years; Bachelor's Level Degree and related work experience of 8 years
Base Pay Range

$166,700.00 - $283,400.00 Annually

Primary Location

USA-CA-Milpitas-KLA

Benefits

KLA’s total rewards package for employees may also include participation in performance incentive programs and eligibility for additional benefits including but not limited to: medical, dental, vision, life, and other voluntary benefits, 401(k) including company matching, employee stock purchase program (ESPP), student debt assistance, tuition reimbursement program, development and career growth opportunities and programs, financial planning benefits, wellness benefits including an employee assistance program (EAP), paid time off and paid company holidays, and family care and bonding leave. Interns are eligible for some of the benefits listed. Our pay ranges are determined by role, level, and location. The range displayed reflects the pay for this position in the primary location identified in this posting. Actual pay depends on several factors, including state minimum pay wage rates, location, job‑related skills, experience, and relevant education level or training. We are committed to complying with all applicable federal and state minimum wage requirements where applicable. If applicable, your recruiter can share more about the specific pay range for your preferred location during the hiring process.

Equal Opportunity Employer and Accommodation

KLA is proud to be an Equal Opportunity Employer. We will ensure that qualified individuals with disabilities are provided reasonable accommodation to participate in the job application or interview process, to perform essential job functions, and to receive other benefits and privileges of employment. Please contact us at talent.acquisition@kla.com or at +1-408-352-2808 to request accommodation.

Get your free, confidential resume review.
or drag and drop your file here.
Similar jobs

Similar jobs worth comparing

Sr. AI Software Engineer (GPU/C++)
Sr. AI Software Engineer (GPU/C++)

KLA-Belgium • Milpitas (CA)

On-site
USD 166,000 - 284,000
Medical, dental, vision benefits
401(K) with company matching
Tuition reimbursement program
+1
HPC / AI Software Infrastructure Lead (E)
HPC / AI Software Infrastructure Lead (E)

KLA • Ann Arbor Charter Township (MI)

On-site
USD 151,000 - 257,000
Medical benefits
401(K) with company matching
Tuition reimbursement program
+1
AI Software Engineer|Manufacturing
AI Software Engineer|Manufacturing

KLA • Ann Arbor Charter Township (MI)

On-site
USD 111,000 - 189,000
Paid time off
Tuition reimbursement
401(k)
Sr. Software Engineer - AI/ML
Sr. Software Engineer - AI/ML

KLA • Ann Arbor Charter Township (MI)

Hybrid
USD 129,000 - 221,000
Medical, dental, and vision benefits
401(K) with company matching
Paid time off and holidays
Senior AI Infra Engineer — C++ & GPU Systems
Senior AI Infra Engineer — C++ & GPU Systems

KLA • Milpitas (CA)

On-site
USD 166,000 - 284,000
Software Engineer (AI/ML)
Software Engineer (AI/ML)

KLA • Austin (TX)

On-site
USD 98,000 - 166,000
Full Stack AI Engineer
Full Stack AI Engineer

KLA • Ann Arbor Charter Township (MI)

On-site
USD 111,000 - 191,000
Medical, dental, vision, life, and other benefits
401(k) with company matching
Employee stock purchase program
+3
Full Stack AI Engineer
Full Stack AI Engineer

KLA • Chandler (AZ)

On-site
USD 111,000 - 191,000
Medical, dental, vision benefits
401(k) with company matching
Employee stock purchase program
+2
Software Engineering Manager – Remote Services
Software Engineering Manager – Remote Services

KLA • Ann Arbor (MI)

On-site
USD 153,000 - 261,000
401K matching
Tuition reimbursement
Wellness benefits
Applied AI Engineer
Applied AI Engineer

NVIDIA AI • Santa Clara (CA)

On-site
USD 152,000 - 288,000
Equity
Benefits package