Lead AI Infrastructure & Accelerator Architect

EPAM Systems Inc; Austin (TX); Remote; USD 180,000 - 220,000; Full time

Benefits offered by this job

Medical, Dental and Vision Insurance (

Health Savings Account

Flexible Spending Accounts

Disability Insurance

Life and AD&D Insurance

Employee Assistance Program

LinkedIn Learning

401(k) Matching

Paid Time Off

Paid Holidays

Legal Plan

Identity Theft Protection

Accident Insurance

Employee Discounts

Pet Insurance

Employee Stock Purchase Program

Discretionary Bonus

Discretionary LTI Program

Job summary

EPAM Systems Inc. is seeking a visionary Principal Architect to define the architectural vision for AI training and serving infrastructure, and to lead our CoE in performance optimization and hardware/software co-design.

You will influence TPU/GPU ecosystems, compiler toolchains, and ML research collaborations in a remote, global role. The position requires 15+ years in software, 8+ years in AI infrastructure, and hands-on expertise in C++/Python, with a track record of delivering large-scale

Qualifications

• 15+ years of software engineering experience with HPC/AI infrastructure.
• 8+ years in distributed systems or AI infrastructure.
• 7+ years designing complex software in C++ or Python.
• 5+ years leading architecture and delivery of large-scale software.
• Kernel-level performance and hardware/software co-design experience.

Responsibilities

• Define multi-year roadmap for high-performance AI kernels and co-design.
• Scale and mentor the architectural practice across orgs.
• Partner with ML researchers and compiler teams to remove bottlenecks.
• Architect infrastructure including benchmarking and autotuning frameworks.
• Track hardware and model topology shifts to enable efficiency gains.

Skills

Distributed systems

AI infrastructure

High-performance computing

Kernel-level optimization

C++

Python

Leadership

Architectural governance

JAX

PyTorch

XLA

MLIR

CUDA

Open-source software

Compiler/toolchain design

Education

Bachelor's degree in CS/EE or equivalent

Master's or Ph.D. preferred

Tools

JAX

PyTorch

XLA

MLIR

CUDA

LLVM

Job description

EPAM Systems Inc. is seeking a visionary Principal Architect to define the architectural vision for AI training and serving infrastructure, and to lead our CoE in performance optimization and hardware/software co-design.

You will influence TPU/GPU ecosystems, compiler toolchains, and ML research collaborations in a remote, global role. The position requires 15+ years in software, 8+ years in AI infrastructure, and hands-on expertise in C++/Python, with a track record of delivering large-scale