AI Workload Memory Performance Intern

New Grad; San Jose (CA); On-site; USD 69,000 - 77,000; Full time

Job summary

Micron Technology seeks an AI/ML Workload Analysis Intern to join its performance and system architecture teams. You will analyze AI workloads, collect memory traces, and help guide memory-centric design decisions for future accelerators.

You’ll collaborate with engineers to develop traces, models, and simulations, and present findings through reports and visualizations to influence architecture reviews. Coursework in CS/EE, strong Python/C++, and Linux profiling experience are valued.

Qualifications

• Pursuing an MS or PhD in Computer Engineering, Computer Science, Electrical Engineering, Data Science, or a related field.
• Coursework in Computer Architecture, ML/ DL, Parallel Computing, OS, Data Structures and Algorithms.

Responsibilities

• Analyze AI/ML workloads including LLMs, recommender models, computer vision, multimodal, and generative AI applications.
• Collect, process, and analyze memory traces from AI training and inference workloads.
• Characterize memory access patterns, locality, reuse behavior, bandwidth utilization, and latency sensitivity.
• Characterize compute, memory, storage, and interconnect behavior across AI training and inference workloads.
• Develop workload traces, performance models, and architecture simulation environments.
• Investigate system bottlenecks related to memory capacity, bandwidth, latency, cache utilization, and communication overheads.
• Evaluate architectural tradeoffs across CPUs, GPUs, NPUs, accelerators, and memory technologies.
• Create automation frameworks for workload execution, data collection, and results analysis.
• Validate simulation and analytical models using benchmark and hardware measurements.
• Present findings through technical reports, visualizations, and architecture reviews.

Skills

Python

C/C++

Analytical skills

Communication skills

Machine Learning

Education

MS or PhD in Computer Engineering/CS/EE/Data Science

Tools

Nsight

VTune

perf

rocprof

Job description

Micron Technology seeks an AI/ML Workload Analysis Intern to join its performance and system architecture teams. You will analyze AI workloads, collect memory traces, and help guide memory-centric design decisions for future accelerators.

You’ll collaborate with engineers to develop traces, models, and simulations, and present findings through reports and visualizations to influence architecture reviews. Coursework in CS/EE, strong Python/C++, and Linux profiling experience are valued.