LLM AI Systems & Infrastructure Intern

1000 Micron Technology, Inc.; Austin (TX); On-site; USD 41,000 - 55,000; Full time

Benefits offered by this job

Medical, dental, vision plans

Paid time off

Paid holidays

Job summary

Micron Technology, Inc. in Austin, Texas, invites graduate students to join the Advanced Systems Research and Engineering team as an AI Systems Software Engineering Intern.

You will work with senior engineers on systems software for LLMs and Agentic AI, focusing on profiling, optimization, and evaluation of AI training and inference across GPU platforms and memory systems. The role emphasizes collaboration across engineering and research teams, contributions to experiments and publications, and

Qualifications

• Currently pursuing a Master's or Ph.D. in Computer Science, Computer Engineering, Electrical Engineering, or a related technical field.
• Demonstrated experience with AI systems, machine learning systems, computer systems research, or systems software development through coursework, research, or projects.
• Understanding of Large Language Models (LLMs), including transformer execution, attention mechanisms, KV cache behavior, batching, token-level latency, throughput, and memory performance considerations.
• Proficiency in Python and C/C++, with hands-on experience developing, debugging, and optimizing software in Linux environments.
• Experience using GPU-based performance analysis tools and at least one modern AI framework or serving stack, such as PyTorch, vLLM, TensorRT-LLM, NVIDIA Dynamo, or related technologies.

Responsibilities

• Develop and enhance systems software, profiling tools, and experimentation frameworks for LLM training, LLM inference, and Agentic AI workloads.
• Design, implement, and evaluate memory- and state-management techniques for AI serving environments.
• Characterize and optimize AI workload execution across GPUs, CPUs, memory subsystems, storage, and distributed infrastructure.
• Build benchmarking, simulation, and automation capabilities to evaluate data placement, migration, scheduling, and performance across heterogeneous memory systems.
• Collaborate with engineering and research teams to develop representative AI workloads, analyze results, and contribute to publications and future platform designs.

Skills

Python

C/C++

LLM knowledge

Linux proficiency

GPU performance analysis

Cloud/ HPC concepts

English communication

Education

Master's or Ph.D. in Computer Science/Engineering or related field

Tools

PyTorch

TensorRT-LLM

NVIDIA CUDA

vLLM

NCCL

Job description

Micron Technology, Inc. in Austin, Texas, invites graduate students to join the Advanced Systems Research and Engineering team as an AI Systems Software Engineering Intern.

You will work with senior engineers on systems software for LLMs and Agentic AI, focusing on profiling, optimization, and evaluation of AI training and inference across GPU platforms and memory systems. The role emphasizes collaboration across engineering and research teams, contributions to experiments and publications, and