Systems Software Engineer

1000 Micron Technology, Inc.; Richardson (TX); On-site; USD 180,000 - 260,000; Full time

Benefits offered by this job

Medical plans

Dental plans

Paid time off

Paid holidays

Job summary

Micron Technology, Inc. in Richardson, TX seeks a Principal Systems Software Engineer to architect and develop software for future memory and storage technologies. You will contribute across AI applications to hardware interfaces and lead small teams.

You will collaborate with AI/ML specialists, software and hardware engineers, and system architects to accelerate product development and influence technical direction.

Qualifications

• Bachelor's or Master's degree in Computer Science, Software Engineering, Computer Engineering, or a related field.
• Hands-on development experience across multiple layers of AI inference software stacks.
• Proven ability to debug issues spanning apps, libraries, OS, kernels, and hardware interfaces.
• Experience in C++, Python, and Linux with multithreading and IPC.

Responsibilities

• Design and modify AI inference software stacks to enable proof-of-concept hardware capabilities.
• Lead software architecture and development efforts, including as a technical lead for small teams.
• Collaborate with AI/ML specialists, software/hardware engineers, and system architects.
• Present technical findings and innovations to internal or external customers.

Skills

C++

Python

CUDA

SYCL

Linux programming

LLM serving

Education

Bachelor's or Master's in CS/Engineering

PhD with 7+ years

Tools

GDB

CUDA Toolkit

TensorRT‑LM

vLLM

Job description

Our vision is to transform how the world uses information to enrich life for all. Micron Technology is a world leader in innovating memory and storage solutions that accelerate the transformation of information into intelligence, inspiring the world to learn, communicate and advance faster than ever.

As a Principal Systems Software Engineer in the Storage and Memory Systems (SMS) group within Micron’s ITP Pathfinding organization, you will architect, design, and develop software that enables and demonstrates the value of future memory and storage technologies.

You will work in a small, highly skilled engineering team, collaborating closely with AI/ML application and modeling specialists, software engineers, hardware engineers, and system architects. Your pathfinding work will accelerate the development of future products and influence technical direction.

This role requires broad technical expertise and a willingness to contribute across multiple layers of AI and systems software stacks, from AI applications to hardware/software interfaces.

Responsibilities

• Design and modify AI inference software stacks to enable proof‑of‑concept hardware capabilities.
• Develop software to quantify and demonstrate the value of proposed system features.
• Lead software architecture and development efforts, both independently and as a technical lead for small teams.
• Research emerging AI software topics to identify memory and storage system challenges and opportunities.
• Develop and modify Linux applications and libraries using C, C++, Python, Rust, CUDA, and/or SYCL for advanced heterogeneous computing systems.
• Develop and use emulators to predict system‑level performance and functional impacts in advance of hardware availability.
• Debug system‑level issues spanning applications, libraries, operating systems, kernels, system configuration, networks, and hardware/software interfaces.
• Use emerging AI tools to improve productivity.
• Collaborate across Micron organizations and with external partners.
• Mentor interns and earlier‑career engineers.
• Present technical findings, insights, and innovations to internal or external customers.

Minimum Qualifications

• Bachelor’s or Master’s degree with 10+ years of experience, or a PhD with 7+ years of experience, in Computer Science, Software Engineering, Computer Engineering, or a related field.
• Working knowledge of end‑to‑end AI inference software stack architectures, with hands‑on development experience in multiple layers, such as frameworks, inference engines, ML compilers, compiler infrastructure, hardware runtimes, or hardware abstraction layers.
• Experience debugging issues spanning applications, libraries, operating systems, kernels, networks, and hardware/software interfaces.
• Proficient development skills in C, C++ and Python, with Linux‑specific programming experience such as multithreading, IPC, ioctl, GDB, and the /proc and /sys filesystems.
• Experience programming GPUs or other accelerators using CUDA, SYCL, OpenCL, or a comparable programming model.
• Demonstrated ability to lead technical initiatives without supervisory authority.
• Familiarity with LLM serving internals, including KV‑cache management, prefill and decode phases, KV‑cache offloading, and disaggregated serving.
• Familiarity with inference engines and distributed serving frameworks such as SGLang, vLLM, NVIDIA Dynamo, or TensorRT‑LLM.
• Strong understanding of heterogeneous compute architecture concepts, including memory hierarchies, NUMA, caching, accelerator architectures, and interconnects such as PCIe, CXL, NVLink, or UALink.

Preferred Qualifications

• Technical leadership experience in a systems‑focused pathfinding or research organization.
• Technical knowledge of HBM, DRAM, and emerging memory technologies.
• Technical knowledge of NVMe SSDs, NAND, and next‑generation storage systems.

Benefits

• We offer a choice of medical, dental and vision plans in all locations enabling team members to select the plans that best meet their family healthcare needs and budget.
• Micron also provides benefit programs that help protect your income if you are unable to work due to illness or injury, and paid family leave.
• Additionally, Micron benefits include a robust paid time‑off program and paid holidays.
• For additional information regarding the Benefit programs available, please see the Benefits Guide posted on micron.com/careers/benefits.

Equal Opportunity

Micron is proud to be an equal opportunity workplace and is an affirmative action employer. All qualified applicants will receive consideration for employment without regard to race, color, religion, sex, sexual orientation, age, national origin, citizenship status, disability, protected veteran status, gender identity or any other factor protected by applicable federal, state, or local laws.

To learn about your right to work click here. To learn more about Micron, please visit micron.com/careers For US Sites Only: To request assistance with the application process and/or for reasonable accommodations, please contact Micron’s People Organization at [e-mail] or 1‑800‑336‑8918 (select option #3) Micron Prohibits the use of child labor and complies with all applicable laws, rules, regulations, and other international and industry labor standards. Micron does not charge candidates any recruitment fees or unlawfully collect any other payment from candidates as consideration for their employment with Micron.