Principal AI Systems Performance Engineer

Micron Technology, Inc.; Austin (TX); On-site; USD 190,000 - 240,000; Full time

Job summary

Micron Technology, Inc. is seeking a Principal AI Systems Performance Engineer to lead experiments on AI training, inference, and agentic workloads across server systems.

You will identify bottlenecks in bandwidth, memory, latency, and power, and translate findings into engineering requirements and customer guidance for future AI infrastructure. The role includes building performance models, benchmarking tools, and collaborating with product teams to drive scalable, efficient memory and

Qualifications

• Bachelor’s degree with at least 10 years of experience; master’s degree with 5+ years; or Ph.D. with related field experience.
• Hands-on experience profiling and benchmarking multi-GPU AI systems across single-node and multi-node environments.
• Understanding of transformer workloads, memory behavior, distributed systems, and agentic AI infrastructure.
• Experience with PyTorch, an AI serving platform, Python, and at least one of C, C++, CUDA, or Triton.
• Ability to lead controlled experiments and communicate results to technical and business audiences.

Responsibilities

• Develop and perform controlled, representative AI experiments on current and pre-production CPU-GPU systems, evaluating memory and storage performance, power, and thermal tradeoffs.
• Profile workloads from GPU memory through system memory, CXL-attached memory, storage, and interconnects; assess performance from node to cluster scale, including efficiency, latency, utilization, scalability, and tail behavior.
• Evaluate data placement, migration, prefetching, compression, and tiering approaches for KV cache, model state, and other AI data.
• Build and validate performance models, simulations, traces, and reusable benchmarking tools to forecast future system requirements.
• Lead cross-functional projects and transform outcomes into product requirements, develop recommendations, publications, demonstrations, and customer mentorship

Skills

AI systems performance

Multi-GPU profiling

Transformer workloads

Experimentation leadership

Technical communication

Education

Bachelor’s degree with 10+ years experience

Master’s degree with 5+ years

Ph.D. with relevant field experience

Tools

PyTorch

Python

CUDA

C/C++

Triton

Job description

Our vision is to transform how the world uses information to enrich life for all.

Micron Technology is a world leader in innovating memory and storage solutions that accelerate the transformation of information into intelligence, inspiring the world to learn, communicate and advance faster than ever.

Micron’s Data Center Workload Engineering team studies how real AI workloads use compute, memory, interconnects, and storage. We turn system-level measurements into insights that help build future Micron DRAM (DDR and LPDDR), HBM, CXL, and storage products.

Position Overview

As a Principal AI Systems Performance Engineer, you will direct experiments on AI training, inference, and agentic workloads across complete server systems. You will pinpoint where bandwidth, capacity, latency, power, and data movement restrict performance—then convert your discoveries into product requirements and guidance for engineering, product, and customer teams. Your efforts will link current measurements with the demands of future AI infrastructure.

Responsibilities:

• Develop and perform controlled, representative AI experiments on current and pre-production CPU-GPU systems, evaluating memory and storage performance, power, and thermal tradeoffs.
• Profile workloads from GPU memory through system memory, CXL-attached memory, storage, and interconnects; assess performance from node to cluster scale, including efficiency, latency, utilization, scalability, and tail behavior.
• Evaluate data placement, migration, prefetching, compression, and tiering approaches for KV cache, model state, and other AI data.
• Build and validate performance models, simulations, traces, and reusable benchmarking tools to forecast future system requirements.
• Lead cross-functional projects and transform outcomes into product requirements, develop recommendations, publications, demonstrations, and customer mentorship

Minimum Qualifications:

• Bachelor’s degree with at least 10 years of experience ; master’s degree with 5 or more years ; or Ph.D. with demonstrated experience in a related field.
• Hands-on experience profiling and benchmarking multi-GPU AI systems across single-node and multi-node environments.
• Understanding of transformer workloads, memory behavior, distributed systems, and agentic AI infrastructure.
• Experience with PyTorch, an AI serving platform, Python, and at least one of C, C++, CUDA, or Triton.
• Ability to lead controlled experiments and communicate results to technical and business audiences.

Preferred Qualifications:

• Experience with memory tiering, KV-cache management, or emerging AI workloads.
• Experience with disaggregated infrastructure or performance modeling and simulation.
• Relevant research, patents, open-source contributions, or other substantial technical work.

As a world leader in the semiconductor industry, Micron is dedicated to your personal wellbeing and professional growth. Micron benefits are designed to help you stay well, provide peace of mind and help you prepare for the future. We offer a choice of medical, dental and vision plans in all locations enabling team members to select the plans that best meet their family healthcare needs and budget. Micron also provides benefit programs that help protect your income if you are unable to work due to illness or injury, and paid family leave. Additionally, Micron benefits include a robust paid time-off program and paid holidays. For additional information regarding the Benefit programs available, please see the Benefits Guide posted on micron.com/careers/benefits .

Micron is proud to be an equal opportunity workplace and is an affirmative action employer. All qualified applicants will receive consideration for employment without regard to race, color, religion, sex, sexual orientation, age, national origin, citizenship status, disability, protected veteran status, gender identity or any other factor protected by applicable federal, state, or local laws.

To learn about your right to work click here. (http://www.justice.gov/crt/worker-information)

To learn more about Micron, please visit micron.com/careers

For US Sites Only: To request assistance with the application process and/or for reasonable accommodations, please contact Micron’s People Organization at [e-mail] or 1-800-336-8918 (select option #3)

Micron Prohibits the use of child labor and complies with all applicable laws, rules, regulations, and other international and industry labor standards.

Micron does not charge candidates any recruitment fees or unlawfully collect any other payment from candidates as consideration for their employment with Micron.

AI alert : Candidates are encouraged to use AI tools to enhance their resume and/or application materials. However, all information provided must be accurate and reflect the candidate's true skills and experiences. Misuse of AI to fabricate or misrepresent qualifications will result in immediate disqualification.

Fraud alert: Micron advises job seekers to be cautious of unsolicited job offers and to verify the authenticity of any communication claiming to be from Micron by checking the official Micron careers website in the About Micron Technology, Inc.