Principal AI Systems Software Engineer - Memory/Storage

Micron Technology; Richardson (TX); On-site; USD 150,000 - 230,000; Full time

Benefits offered by this job

Medical, dental and vision plans

Paid time off

Paid holidays

Job summary

Micron Technology is seeking a Principal Systems Software Engineer within the SMS group to architect and develop AI inference software for future memory and storage technologies. You’ll collaborate with AI/ML specialists, software and hardware engineers, and system architects.

The role involves leading architecture efforts, contributing across Linux apps, and mentoring interns. Strong C/C++, Python, and Linux expertise are required, with experience in GPUs/CUDA and heterogeneous computing.

Qualifications

• Bachelor’s or Master’s degree in Computer Science, Software Engineering, Computer Engineering, or a related field.
• 10+ years of experience, or PhD with 7+ years of experience for senior level.
• Hands-on development across AI inference software stack layers.

Responsibilities

• Design and modify AI inference software stacks to enable PoC hardware capabilities.
• Develop software to quantify and demonstrate value of proposed system features.
• Lead software architecture and development efforts, including technical leadership for small teams.
• Research emerging AI software topics to identify memory and storage system challenges and opportunities.

Skills

C/C++

Python

Linux

CUDA

SYCL/OpenCL

GDB

Multithreading

IPC

Hardware interfaces

LLM serving internals

Education

Bachelor's or Master’s degree in CS/EE

PhD (optional)

Tools

SGLang

vLLM

NVIDIA TensorRT-LLM

CUDA toolkit

Job description

Micron Technology is seeking a Principal Systems Software Engineer within the SMS group to architect and develop AI inference software for future memory and storage technologies. You’ll collaborate with AI/ML specialists, software and hardware engineers, and system architects.

The role involves leading architecture efforts, contributing across Linux apps, and mentoring interns. Strong C/C++, Python, and Linux expertise are required, with experience in GPUs/CUDA and heterogeneous computing.