New College Grad - AI Infrastructure & HBM Architecture Engineer

1000 Micron Technology, Inc.; Richardson (TX); On-site; USD 120,000 - 160,000; Full time

Benefits offered by this job

Medical plans

Dental plans

Vision plans

Paid time off

Paid holidays

Job summary

Micron Technology, Inc. is seeking an AI Infrastructure & HBM Architecture Engineer to explore next-generation AI memory and system environments. You will analyze infrastructure trends, contribute to performance modeling, and support tool development informing HBM decisions.

The role involves working with senior engineers across DTPCO, Design, and Product/System teams, gaining hands-on exposure to AI workloads’ impact on memory system design.

Qualifications

• Pursuing a Master’s degree or PhD in Electrical Engineering, Computer Engineering, Computer Science, or related field.
• Strong foundational understanding of computer architecture, digital systems, and hardware/software interaction.
• Interest in memory subsystem design (HBM, DDR, caches) and AI/ML workloads.
• Deep understanding of LLM pipeline and critical bottlenecks.
• Programming experience in Python, C/C++, or similar languages.

Responsibilities

• Research emerging trends in compute, networking, and storage infrastructure for future AI workloads.
• Support HBM architecture analysis by collecting and synthesizing data on bandwidth, latency, and memory requirements.
• Help develop or refine simulation frameworks to model AI cluster performance and memory subsystem behavior.
• Assist in building first-order performance models for HBM bandwidth, latency, GPU/CPU interactions, and memory hierarchy trade-offs.
• Participate in building trend dashboards using CSP benchmarks and industry datasets.
• Collaborate with mentors to explore architectural intercept opportunities for next-gen AI systems.

Skills

Python

C/C++

Computer architecture

LLM bottlenecks

Education

Master's or PhD in EE/CE/CS

Job description

Our vision is to transform how the world uses information to enrich life for all. Micron Technology is a world leader in innovating memory and storage solutions that accelerate the transformation of information into intelligence, inspiring the world to learn, communicate and advance faster than ever. We are seeking a highly motivated AI Infrastructure & HBM Architecture Engineer to support the exploration of next-generation AI memory and system environments. You will help analyze emerging infrastructure trends, contribute to performance modeling efforts, and support tool development that informs HBM architecture decisions. You will work closely with senior engineers across DTPCO, Design, and Product/System teams, gaining hands‑on exposure to how AI workloads influence memory system design and architectural intercept strategies.

Key Responsibilities

• Researching emerging trends in compute, networking, and storage infrastructure to understand how future AI workloads will evolve.
• Supporting HBM architecture analysis by collecting and synthesizing data that informs bandwidth, latency, and system-level memory requirements.
• Helping develop or refine simulation frameworks used to model AI cluster performance and memory subsystem behavior.
• Assisting in building first-order performance models for HBM bandwidth, latency, GPU/CPU interactions, and memory hierarchy trade-offs.
• Participating in building trend dashboards using CSP benchmarks and industry datasets.
• Collaborating with DTPCO mentors to explore architectural intercept opportunities relevant to next-generation AI systems.

Required Qualifications

• Currently pursuing a Master's degree or PhD in Electrical Engineering, Computer Engineering, Computer Science, or related field.
• Strong foundational understanding of computer architecture, digital systems, and hardware/software interaction.
• Interest in memory subsystem design (HBM, DDR, caches) and how it impacts AI/ML workloads.
• Deep understanding of LLM pipeline and critical bottlenecks.
• Programming experience in Python, C/C++, or similar languages.

Preferred Skills

• Exposure to AI workload behavior, ML model training pipelines, or large-scale system bottlenecks.
• Ability to turn research findings into concise technical summaries or recommendations.
• Comfort learning new tools, simulation frameworks, and data-analysis workflows.

As a world leader in the semiconductor industry, Micron is dedicated to your personal wellbeing and professional growth. Micron benefits are designed to help you stay well, provide peace of mind and help you prepare for the future. We offer a choice of medical, dental and vision plans in all locations enabling team members to select the plans that best meet their family healthcare needs and budget. Micron also provides benefit programs that help protect your income if you are unable to work due to illness or injury, and paid family leave. Additionally, Micron benefits include a robust paid time-off program and paid holidays. For additional information regarding the Benefit programs available, please see the Benefits Guide posted on micron.com/careers/benefits.

Micron is proud to be an equal opportunity workplace and is an affirmative action employer. All qualified applicants will receive consideration for employment without regard to race, color, religion, sex, sexual orientation, age, national origin, citizenship status, disability, protected veteran status, gender identity or any other factor protected by applicable federal, state, or local laws.

Micron Prohibits the use of child labor and complies with all applicable laws, rules, regulations, and other international and industry labor standards.

Micron does not charge candidates any recruitment fees or unlawfully collect any other payment from candidates as consideration for their employment with Micron.