AI Infrastructure & Hardware-Accelerator Architect

EPAM Systems, Inc.; United States; Remote; USD 180,000 - 220,000; Full time

Benefits offered by this job

Health Insurance

401(k) Retirement Plan

Paid Time Off

Job summary

EPAM Systems, Inc. seeks a Principal Architect to lead the architectural vision for AI training and serving infrastructure, driving performance at scale across TPU/GPU architectures and compiler toolchains.

You will spearhead the Center of Excellence, mentor teams, and collaborate with ML researchers and framework engineers to set standards and accelerate production deployment. The role entails shaping enterprise-grade benchmarking, autotuning, and tooling while tracking industry advances in

Qualifications

• 15+ years of software engineering experience, incl. distributed systems, AI infrastructure, or HPC architecture.
• 7+ years designing and developing complex software systems in C++ or Python.
• 5+ years leading architecture, design, and delivery of large-scale software products or developer ecosystems.
• 8+ years focused on AI infrastructure or HPC architecture.

Responsibilities

• Define and drive the multi-year technical roadmap for high-performance AI kernels and hardware-software co-design.
• Scale and mentor a world-class technical practice, establish governance and engineering standards.
• Liaise with ML researchers, core framework architects (JAX, PyTorch), and compiler teams (XLA, MLIR) to remove bottlenecks.
• Architect foundational infrastructure including benchmarking suites, autotuning, and regression analysis pipelines.

Skills

Distributed systems

AI infrastructure

C++

Python

Kernel-level programming

Performance optimization

Hardware-software co-design

Education

Bachelor's degree in CS/EE or equivalent

Master's or Ph.D. preferred

Tools

MLIR

OpenXLA

LLVM

Job description

EPAM Systems, Inc. seeks a Principal Architect to lead the architectural vision for AI training and serving infrastructure, driving performance at scale across TPU/GPU architectures and compiler toolchains.

You will spearhead the Center of Excellence, mentor teams, and collaborate with ML researchers and framework engineers to set standards and accelerate production deployment. The role entails shaping enterprise-grade benchmarking, autotuning, and tooling while tracking industry advances in