Intern - AI Hardware and Memory Systems

1000 Micron Technology, Inc.; Folsom (CA); On-site; USD 80,000 - 98,000; Full time

Benefits offered by this job

Medical, dental and vision plans

Paid time off

Paid holidays

Job summary

Micron Technology, Inc. invites a PhD intern to join the HBM Architecture team to research memory hierarchies and interconnect choices for AI accelerators.

You will build performance models, analyze AI workloads, and push innovations across GPUs, TPUs, and custom accelerators in a collaborative environment. The role focuses on memory system optimization, power efficiency, and scalability for next‑gen AI infrastructure, offering opportunities to work with seasoned engineers and publish impactful

Qualifications

• Pursuing a PhD in a related technical field.
• 0-2 years of relevant research or internships in computer architecture or AI hardware.
• Experience with memory systems: HBM, DRAM, caches.
• Programming in Python or C++.

Responsibilities

• Research and evaluate advanced memory and system architecture concepts for AI accelerators.
• Develop and analyze performance models to assess bandwidth, latency, power, scalability.
• Analyze AI training, inference, and HPC workloads to identify memory bottlenecks.
• Investigate memory hierarchy, HBM, DRAM, interconnects to improve performance.
• Collaborate with cross-functional teams and explore AI/LLM tools to aid research workflows.

Skills

Python

C++

Performance modeling

AI hardware

Analytical thinking

Education

PhD candidate in Computer Architecture

Tools

SystemC

CUDA

GPU profiling tools

Job description

Our vision is to transform how the world uses information to enrich life for all. Micron Technology is a world leader in innovating memory and storage solutions that accelerate the transformation of information into intelligence, inspiring the world to learn, communicate and advance faster than ever. At Micron Technology, we transform how the world uses information to enrich life for all. The HBM Architecture team is at the forefront of developing next‑generation memory solutions that enable advances in artificial intelligence, high‑performance computing, and data‑intensive applications. The team researches and evaluates innovative memory and system architecture concepts, working across disciplines to optimize performance, power efficiency, and scalability for future computing platforms. Join a collaborative environment where innovative research is transformed into technologies that shape the future of AI infrastructure. As a PhD Intern on the HBM Architecture team, you will research and prototype advanced memory and system architecture concepts for next‑generation AI accelerators. You will develop performance models, analyze AI workloads, and evaluate how memory hierarchy and interconnect design choices impact system performance, power efficiency, and scalability. This role offers the opportunity to collaborate with experienced architects and engineers while contributing to the future of AI computing systems.

Responsibilities

• Research and evaluate advanced memory and system architecture concepts for AI accelerators, including GPUs, TPUs, and custom accelerator designs.
• Develop and analyze performance models to assess bandwidth, latency, power, scalability, and overall system efficiency.
• Analyze AI training, inference, and HPC workloads to identify memory and system performance bottlenecks.
• Investigate memory hierarchy, HBM, DRAM, cache, storage, and interconnect optimizations to improve system performance.
• Collaborate with cross‑functional engineering teams and explore the use of AI/LLM-based tools to enhance architecture research and development workflows.

Minimum Qualifications

• Currently pursuing a PhD in Computer Architecture, Electrical Engineering, Computer Engineering, Computer Science, or a related technical field.
• 0-2 years of relevant experience through research, internships, academic projects, or industry experience in computer architecture, memory systems, or AI hardware.
• Knowledge of memory system architecture, including caches, HBM, DRAM, memory hierarchy, and interconnect concepts.
• Experience with performance modeling, architectural simulation, system analysis, or related research methodologies.
• Programming experience in Python, C++, or similar programming languages.
• Strong analytical, problem‑solving, and technical communication skills.

Preferred Qualifications

• Research experience in AI accelerators, GPU architecture, memory systems, interconnects, or high‑performance computing.
• Experience with AI/ML frameworks such as PyTorch, TensorFlow, or CUDA‑based development environments.
• Familiarity with architectural simulators, SystemC, GPU profiling tools, emulation platforms, or performance analysis tools.
• Knowledge of rack‑scale systems, scale‑up/scale‑out architectures, and advanced interconnect technologies.
• Publications, conference papers, or demonstrated research contributions in computer architecture, AI hardware, memory systems, or related fields.

The US base salary range that Micron Technology estimates it could pay for this full‑time position is: $50.24 - $50.24 an hour. Additional compensation may include benefits, bonuses and equity. Our salary ranges are determined by role, level, and location. The range displayed on each job posting reflects the minimum and maximum target base pay for new hire salaries of the position across all US locations. Within the range, individual pay is determined by work location and additional job‑related factors, including knowledge, skills, experience, tenure and relevant education or training. The pay scale is subject to change depending on business needs. Your recruiter can share more about the specific salary range for your preferred location during the hiring process. Please note that the compensation details listed in US role postings reflect the base salary only, and do not include bonus, equity, or benefits.

Benefits

• We offer a choice of medical, dental and vision plans in all locations enabling team members to select the plans that best meet their family healthcare needs and budget.
• Micron also provides benefit programs that help protect your income if you are unable to work due to illness or injury, and paid family leave.
• Additionally, Micron benefits include a robust paid time‑off program and paid holidays.

Micron is proud to be an equal opportunity workplace and is an affirmative action employer. All qualified applicants will receive consideration for employment without regard to race, color, religion, sex, sexual orientation, age, national origin, citizenship status, disability, protected veteran status, gender identity or any other factor protected by applicable federal, state, or local laws.

To learn more about Micron, please visit micron.com/careers

US Sites Only

To request assistance with the application process and/or for reasonable accommodations, please contact Micron’s People Organization at [e-mail] or 1-800-336-8918 (select option #3)

Micron Prohibits the use of child labor and complies with all applicable laws, rules, regulations, and other international and industry labor standards.

Micron does not charge candidates any recruitment fees or unlawfully collect any other payment from candidates as consideration for their employment with Micron.

AI alert: Candidates are encouraged to use AI tools to enhance their resume and/or application materials. However, all information provided must be accurate and reflect the candidate's true skills and experiences. Misuse of AI to fabricate or disprove qualifications will result in immediate disqualification.

Fraud alert: Micron advises job seekers to be cautious of unsolicited job offers and to verify the authenticity of any communication claiming to be from Micron by checking the official Micron careers website in the About Micron Technology, Inc.