Memory System Architect: HBM for Generative AI

Micron Technology, Inc; Folsom (CA); On-site; USD 103,000 - 210,000; Full time

Job summary

Micron Technology is seeking a Memory System Architect to define future memory architectures for Generative AI workloads in the US. You will explore AI accelerator concepts and develop models to guide product strategy and roadmaps for next-generation memory solutions.

The role involves collaboration across teams to translate research findings into actionable architecture recommendations and long-term technology plans, with a focus on HBM, memory hierarchies, and scalable performance.

Qualifications

• 0-2 years of relevant experience in computer architecture, memory systems, AI hardware or HPC.
• Master's degree, PhD, or equivalent experience in Computer Architecture, Electrical Engineering, Computer Engineering, Computer Science, or related field.
• Strong understanding of GPU, TPU, AI accelerators, or large-scale computing architectures.
• Knowledge of memory hierarchy concepts including caches, HBM, DRAM, storage systems, and memory performance optimization.
• Experience with performance modeling, architectural simulation, system analysis or related methodologies.
• Programming in Python, C++, and AI frameworks such as CUDA, TensorFlow, or similar technologies.
• Familiarity with AI-enabled tools and LLMs such as Copilot, Claude, or similar.

Responsibilities

• Research and evaluate advanced memory architecture concepts for AI accelerators, including GPU, TPU, and emerging compute platforms.
• Develop and analyze system-level models to assess performance, power, scalability, and efficiency across memory and compute architectures.
• Investigate memory hierarchy optimizations involving HBM, DRAM, cache, storage, and interconnect technologies.
• Evaluate architectural trade-offs and emerging technologies, including compute-near-memory concepts, to support future product development.
• Collaborate with cross-functional teams to translate research findings into architecture recommendations and long-term technology roadmaps.

Skills

Memory systems

AI hardware

Computer architecture

High-performance computing

Python

C++

CUDA

TensorFlow

LLMs familiarity

Performance modeling

Education

Master's or PhD in Computer Architecture/EE/CE/CS

Tools

CUDA

TensorFlow

Job description

Micron Technology is seeking a Memory System Architect to define future memory architectures for Generative AI workloads in the US. You will explore AI accelerator concepts and develop models to guide product strategy and roadmaps for next-generation memory solutions.

The role involves collaboration across teams to translate research findings into actionable architecture recommendations and long-term technology plans, with a focus on HBM, memory hierarchies, and scalable performance.