Intern - Memory Performance and Power Modeling

Micron Technology; San Jose (CA); On-site; USD 69,000 - 77,000; Part time

Job summary

Micron Technology, Inc. seeks an AI/ML Workload Analysis Intern to collaborate with system architects and performance engineers. You will analyze AI workloads, collect memory traces, and study memory behavior to inform future memory technologies and AI platforms.

The role emphasizes trace-based analysis, simulation, and data-driven insights into bandwidth, cache efficiency, and data movement across CPUs, GPUs, NPUs, and accelerators.

Qualifications

• Pursuing MS or PhD in a relevant technical field.
• Strong background in computer architecture and ML.
• Experience with performance analysis and race conditions.

Responsibilities

• Analyze AI/ML workloads including LLMs and vision models.
• Collect and analyze memory traces from training/inference.
• Characterize memory access, bandwidth, and latency.
• Develop workload traces and architecture simulations.
• Identify bottlenecks in memory systems and interconnects.
• Present findings via reports and visualizations.

Skills

Python

C/C++

Machine Learning

Parallel Computing

Operating Systems

Data Structures & Algorithms

Performance Analysis

Education

MS or PhD in Computer Engineering, Computer Science, Electrical Engineering, Data Science, or related field

Tools

Nsight

VTune

Perf

rocprof

Gem5

Accel-Sim

Job description

Our vision is to transform how the world uses information to enrich life for all.

Micron Technology is a world leader in innovating memory and storage solutions that accelerate the transformation of information into intelligence, inspiring the world to learn, communicate and advance faster than ever.

As an AI/ML Workload Analysis Intern, you will work with system architects and performance engineers to analyze emerging AI workloads and evaluate next-generation computing and memory architecture. You will develop methodologies to characterize memory behavior, generate workload traces, and uncover performance bottlenecks across AI training and inference applications. You will develop insights into how large language models (LLMs), recommendation models, vision models, and multimodal AI applications interact with CPUs, GPUs, NPUs, memory subsystems, and interconnects.

You will leverage simulation, profiling, and data analysis tools to study performance bottlenecks, memory behavior, bandwidth requirements, and scalability characteristics of AI workloads. The focus of this role is on memory trace-based workload analysis, helping drive architectural decisions for future memory technologies and AI platforms. You will work with real-world AI workloads, trace collection tools, and analytics frameworks to understand memory access patterns, bandwidth demands, cache efficiency, data movement, and system bottlenecks.

Responsibilities

• Analyze AI/ML workloads including Large Language Models (LLMs), recommendation models, computer vision, multimodal, and generative AI applications.
• Collect, process, and analyze memory traces from AI training and inference workloads.
• Characterize memory access patterns, locality, reuse behavior, bandwidth utilization, and latency sensitivity.
• Characterize compute, memory, storage, and interconnect behavior across AI training and inference workloads.
• Develop workload traces, performance models, and architecture simulation environments.
• Investigate system bottlenecks related to memory capacity, bandwidth, latency, cache utilization, and communication overheads.
• Evaluate architectural tradeoffs across CPUs, GPUs, NPUs, accelerators, and memory technologies.
• Create automation frameworks for workload execution, data collection, and results analysis.
• Validate simulation and analytical models using benchmark and hardware measurements.
• Present findings through technical reports, visualizations, and architecture reviews.

Minimum Qualifications

• Pursuing an MS or PhD in Computer Engineering, Computer Science, Electrical Engineering, Data Science, or a related field.
• Coursework or research experience in:
  • Computer Architecture
  • Machine Learning / Deep Learning
  • Parallel Computing
  • Operating Systems
  • Data Structures and Algorithms
  • Performance Analysis
• Programming experience in:
  • Python
  • C/C++
• Strong analytical, problem-solving, and quantitative reasoning skills.
• Excellent written and verbal communication skills.

Preferred Qualifications

• Experience with AI frameworks such as PyTorch, TensorFlow, JAX, or ONNX.
• Familiarity with LLMs, transformers, diffusion models, recommender systems, or vision models.
• Experience with workload profiling, tracing, or performance analysis tools.
• Experience with simulation, modeling, or architecture research is a plus.
• Experience with AI code assistant is a plus
• Experience with performance profiling tools such as Nsight, VTune, perf, rocprof, or similar tools.
• Knowledge of GPU, NPU, TPU, or accelerator architectures.
• Understanding of memory systems, including cache hierarchies, DRAM.
• Experience with architecture simulators such as Gem5, Accel-Sim, or similar tools.
• Familiarity with Linux development environments and data analysis frameworks.

The US base salary range that Micron Technology estimates it could pay for this full-time position is:

$50.24 - $55.82 an hour

Additional Compensation May Include Benefits, Bonuses And Equity.

Our salary ranges are determined by role, level, and location. The range displayed on each job posting reflects the minimum and maximum target base pay for new hire salaries of the position across all US locations. Within the range, individual pay is determined by work location and additional job-related factors, including knowledge, skills, experience, tenure and relevant education or training. The pay scale is subject to change depending on business needs. Your recruiter can share more about the specific salary range for your preferred location during the hiring process.

Please note that the compensation details listed in US role postings reflect the base salary only, and do not include bonus, equity, or benefits.

As a world leader in the semiconductor industry, Micron is dedicated to your personal wellbeing and professional growth. Micron benefits are designed to help you stay well, provide peace of mind and help you prepare for the future. We offer a choice of medical, dental and vision plans in all locations enabling team members to select the plans that best meet their family healthcare needs and budget. Micron also provides benefit programs that help protect your income if you are unable to work due to illness or injury, and paid family leave. Additionally, Micron benefits include a robust paid time-off program and paid holidays. For additional information regarding the Benefit programs available, please see the Benefits Guide posted on micron.com/careers/benefits.

Micron is proud to be an equal opportunity workplace and is an affirmative action employer. All qualified applicants will receive consideration for employment without regard to race, color, religion, sex, sexual orientation, age, national origin, citizenship status, disability, protected veteran status, gender identity or any other factor protected by applicable federal, state, or local laws.

US Sites Only: To request assistance with the application process and/or for reasonable accommodations, please contact Micron’s People Organization at [e-mail] or 1-800-336-8918 (select option #3)

Micron Prohibits the use of child labor and complies with all applicable laws, rules, regulations, and other international and industry labor standards.

Micron does not charge candidates any recruitment fees or unlawfully collect any other payment from candidates as consideration for their employment with Micron.