Principal AI Systems Performance Architect

Micron Technology, Inc.; Austin (TX); On-site; USD 190,000 - 240,000; Full time

Job summary

Micron Technology, Inc. is seeking a Principal AI Systems Performance Engineer to lead experiments on AI training, inference, and agentic workloads across server systems.

You will identify bottlenecks in bandwidth, memory, latency, and power, and translate findings into engineering requirements and customer guidance for future AI infrastructure. The role includes building performance models, benchmarking tools, and collaborating with product teams to drive scalable, efficient memory and

Qualifications

• Bachelor’s degree with at least 10 years of experience; master’s degree with 5+ years; or Ph.D. with related field experience.
• Hands-on experience profiling and benchmarking multi-GPU AI systems across single-node and multi-node environments.
• Understanding of transformer workloads, memory behavior, distributed systems, and agentic AI infrastructure.
• Experience with PyTorch, an AI serving platform, Python, and at least one of C, C++, CUDA, or Triton.
• Ability to lead controlled experiments and communicate results to technical and business audiences.

Responsibilities

• Develop and perform controlled, representative AI experiments on current and pre-production CPU-GPU systems, evaluating memory and storage performance, power, and thermal tradeoffs.
• Profile workloads from GPU memory through system memory, CXL-attached memory, storage, and interconnects; assess performance from node to cluster scale, including efficiency, latency, utilization, scalability, and tail behavior.
• Evaluate data placement, migration, prefetching, compression, and tiering approaches for KV cache, model state, and other AI data.
• Build and validate performance models, simulations, traces, and reusable benchmarking tools to forecast future system requirements.
• Lead cross-functional projects and transform outcomes into product requirements, develop recommendations, publications, demonstrations, and customer mentorship

Skills

AI systems performance

Multi-GPU profiling

Transformer workloads

Experimentation leadership

Technical communication

Education

Bachelor’s degree with 10+ years experience

Master’s degree with 5+ years

Ph.D. with relevant field experience

Tools

PyTorch

Python

CUDA

C/C++

Triton

Job description

Micron Technology, Inc. is seeking a Principal AI Systems Performance Engineer to lead experiments on AI training, inference, and agentic workloads across server systems.

You will identify bottlenecks in bandwidth, memory, latency, and power, and translate findings into engineering requirements and customer guidance for future AI infrastructure. The role includes building performance models, benchmarking tools, and collaborating with product teams to drive scalable, efficient memory and