Remote AI Infrastructure & Accelerator Architect

EPAM Systems; McLean (VA); Remote; USD 180,000 - 220,000; Full time

Benefits offered by this job

Medical, Dental and Vision Insurance (

Health Savings Account

401(k) Retirement Savings Plan

Paid Time Off

Life and AD&D Insurance

Employee Stock Purchase Program

Bonus program

Job summary

EPAM Systems is seeking a Principal Architect to lead the architectural strategy for high-performance AI training and serving infrastructure at scale. You will define the roadmap for AI kernels, hardware-software co-design, and cutting-edge compiler toolchains, driving impact across major enterprise customers and open-source ecosystems.

The role involves mentoring a technical practice, collaborating with ML researchers, and shaping future hardware requirements for efficient AI workloads.

Qualifications

• Bachelor's degree in Computer Science, Electrical Engineering, or equivalent practical experience (Master's or Ph.D. preferred).
• 15+ years of software engineering experience, with 8+ years focused on distributed systems, AI infrastructure, or HPC architecture.
• 7+ years of experience designing and developing complex software systems in C++ or Python.
• 5+ years of experience leading the architecture, design, and delivery of large-scale software products, frameworks, or developer ecosystems from inception to production.
• Proven track record of architecting performance-critical systems at the kernel level, bridging hardware accelerators and high-level software frameworks.

Responsibilities

• Define and drive the multi-year technical roadmap for high-performance AI kernels, custom operations, and hardware-software co-design targeting TPU and GPU architectures.
• Scale and mentor a world-class technical practice, establishing architectural governance, engineering standards, and best practices across the organization.
• Act as the principal technical liaison partnering with ML researchers, core framework architects (JAX, PyTorch), and compiler engineering teams (XLA, MLIR) to eliminate systemic bottlenecks and shape future hardware/software requirements.
• Architect foundational infrastructure—including enterprise-grade benchmarking suites, automated autotuning frameworks, regression analysis pipelines, and comprehensive documentation—empowering the global developer community.
• Anticipate industry shifts by tracking advancements in hardware architectures, emerging model topologies, and compiler innovations to unlock step-changes in AI training and inference efficiency.

Skills

C++

Python

Distributed systems

AI infrastructure

Kernel-level architecture

Education

Bachelor's degree in CS/EE

Master's or Ph.D. preferred

Tools

JAX

PyTorch

XLA

MLIR

Job description

EPAM Systems is seeking a Principal Architect to lead the architectural strategy for high-performance AI training and serving infrastructure at scale. You will define the roadmap for AI kernels, hardware-software co-design, and cutting-edge compiler toolchains, driving impact across major enterprise customers and open-source ecosystems.

The role involves mentoring a technical practice, collaborating with ML researchers, and shaping future hardware requirements for efficient AI workloads.