Lead AI Infrastructure & Accelerator Architect

EPAM Systems Inc; San Jose (CA); Remote; USD 180,000 - 220,000; Full time

Benefits offered by this job

Medical, Dental and Vision Insurance (

Health Savings Account

Flexible Spending Accounts (Healthcare

Short-Term and Long-Term Disability

Life and AD&D Insurance

Employee Assistance Program

LinkedIn Learning access

401(k) Matching

Job summary

EPAM Systems Inc. is seeking a Principal Architect to steer the architectural vision across AI performance, optimization, and hardware‑software co‑design for TPU and GPU architectures.

You will define the multi‑year strategy and lead the Center of Excellence, shaping roadmaps for AI training and serving infrastructure. You will collaborate with ML researchers, framework architects, and compiler teams to eliminate bottlenecks and scale the practice globally, driving production readiness and

Qualifications

• Bachelor's degree in Computer Science or Electrical Engineering or equivalent practical experience (Master's or Ph.D. preferred).
• 15+ years of software engineering experience, with 8+ years in distributed systems, AI infrastructure, or HPC architecture.
• 7+ years designing and developing complex software systems in C++ or Python.
• 5+ years leading architecture, design, and delivery of large‑scale software products/frameworks.
• Proven track record architecting performance‑critical systems bridging hardware accelerators and software frameworks.

Responsibilities

• Define and drive multi-year technical roadmap for high-performance AI kernels and hardware–software co-design.
• Scale and mentor a world-class technical practice with governance and engineering standards.
• Liaise with ML researchers, core framework architects (JAX, PyTorch), and compiler teams (XLA, MLIR) to remove bottlenecks.
• Architect foundational infrastructure including benchmarking suites, autotuning frameworks, and regression pipelines.
• Track industry shifts in hardware, model topologies, and compilers to boost training and inference efficiency.

Skills

Distributed systems

AI infrastructure

High-performance computing

Leadership

Mentoring

Strategic planning

Education

Bachelor's degree in Computer Science or Electrical Engineering

Master's or Ph.D. preferred

Tools

C++

Python

JAX

PyTorch

XLA

MLIR

Job description

EPAM Systems Inc. is seeking a Principal Architect to steer the architectural vision across AI performance, optimization, and hardware‑software co‑design for TPU and GPU architectures.

You will define the multi‑year strategy and lead the Center of Excellence, shaping roadmaps for AI training and serving infrastructure. You will collaborate with ML researchers, framework architects, and compiler teams to eliminate bottlenecks and scale the practice globally, driving production readiness and