Principal Systems AI Engineer – Memory & Storage

Micron Technology, Inc.; Richardson (TX); On-site; USD 180,000 - 240,000; Full time

Job summary

Micron Technology, Inc. in Richardson, TX seeks a Principal Systems Software Engineer to architect and develop AI inference software across memory and storage systems.

You will lead a small team, collaborate with AI/ML modeling and hardware engineers, and influence product direction with system-level insights. You will design software across Linux stacks using C/C++, Python, CUDA, and SYCL, and mentor interns while engaging with internal and external customers to demonstrate value and

Qualifications

• Bachelor’s or Master’s degree in Computer Science, Software Engineering, Computer Engineering, or a related field.

Responsibilities

• Design and modify AI inference software stacks to enable proof-of-concept hardware capabilities.
• Develop software to quantify and demonstrate the value of proposed system features.
• Lead software architecture and development efforts, both independently and as a technical lead for small teams.
• Research emerging AI software topics to identify memory and storage system challenges and opportunities.
• Develop and use emulators to predict system-level performance and functional impacts in advance of hardware availability.
• Debug system-level issues spanning applications, libraries, operating systems, kernels, networks, and hardware/software interfaces.
• Present technical findings, insights, and innovations to internal or external customers.

Skills

AI inference stack

C/C++/Python

Linux/multithreading

GPU programming

LLM serving internals

Technical leadership

Education

Bachelor's or Master’s in CS/SE/CE

PhD with 7+ years

Tools

CUDA

SYCL

OpenCL

TensorRT

vLLM

NVIDIA Dynamo

SGLang

Job description

Micron Technology, Inc. in Richardson, TX seeks a Principal Systems Software Engineer to architect and develop AI inference software across memory and storage systems.

You will lead a small team, collaborate with AI/ML modeling and hardware engineers, and influence product direction with system-level insights. You will design software across Linux stacks using C/C++, Python, CUDA, and SYCL, and mentor interns while engaging with internal and external customers to demonstrate value and