Systems Software Engineer (AI inference stack, CUDA)

Micron Technology, Inc.; Richardson (TX); Presencial; USD 150.000 - 230.000; Jornada completa

Ventajas ofrecidas por este puesto de trabajo

Medical, Dental & Vision plans

Paid time off

Paid holidays

Descripción de la vacante

Micron Technology, Inc. seeks a senior AI software engineer to design and modify AI inference stacks for proof‑of‑concept hardware. You will lead software architecture with small teams and research memory/storage challenges in heterogeneous compute environments.

The role requires hands-on development in C/C++, Python, CUDA/SYCL, and experience debugging across applications, OS, and hardware interfaces. Mentoring interns and presenting findings to customers completes the scope.

Formación

• PhD with 7+ years or MS/BS with 10+ years in CS/SE/CE.
• Hands-on AI inference stack development across multiple layers.
• Proficient in C, C++, Python; Linux multithreading & IPC.
• Experience debugging across apps, OS, networks, and hardware interfaces.
• Familiarity with LLM internals and KV-cache management.
• Experience leading technical initiatives without supervision.

Responsabilidades

• Design and modify AI inference software stacks for proof-of-concept hardware.
• Lead software architecture and development efforts, independently and with small teams.
• Research AI topics to identify memory and storage challenges and opportunities.
• Develop Linux applications using C/C++, Python, CUDA/SYCL for heterogeneous compute.
• Mentor interns and present findings to customers and internal teams.

Conocimientos

C

C++

Python

Rust

Linux multithreading

GPU programming

CUDA

SYCL

OpenCL

Linux IPC

Educación

PhD with 7+ years or MS/BS with 10+ years in CS/SE/CE

Herramientas

CUDA

SYCL

OpenCL

TensorRT-LLM

NVIDIA Dynamo

vLLM

Descripción del empleo

Job Profile(s):

Relocation Level: TBD

Responsibilities

• Design and modify AI inference software stacks to enable proof-of-concept hardware capabilities.
• Develop software to quantify and demonstrate the value of proposed system features.
• Lead software architecture and development efforts, both independently and as a technical lead for small teams.
• Research emerging AI software topics to identify memory and storage system challenges and opportunities.
• Develop and modify Linux applications and libraries using C, C++, Python, Rust, CUDA, and/or SYCL for advanced heterogeneous computing systems.
• Develop and use emulators to predict system‑level performance and functional impacts in advance of hardware availability.
• Debug system‑level issues spanning applications, libraries, operating systems, kernels, system configuration, networks, and hardware/software interfaces.
• Use emerging AI tools to improve productivity.
• Collaborate across Micron organizations and with external partners.
• Mentor interns and earlier-career engineers.
• Present technical findings, insights, and innovations to internal or external customers.

Minimum Qualifications

• Bachelor’s or Master’s degree with 10+ years of experience, or a PhD with 7+ years of experience, in Computer Science, Software Engineering, Computer Engineering, or a related field.
• Working knowledge of end-to-end AI inference software stack architectures, with hands‑on development experience in multiple layers, such as frameworks, inference engines, ML compilers, compiler infrastructure, hardware runtimes, or hardware abstraction layers.
• Experience debugging issues spanning applications, libraries, operating systems, kernels, networks, and hardware/software interfaces.
• Proficient development skills in C, C++ and Python, with Linux‑specific programming experience such as multithreading, IPC, ioctl, GDB, and the /proc and /sys filesystems.
• Experience programming GPUs or other accelerators using CUDA, SYCL, OpenCL, or a comparable programming model.
• Demonstrated ability to lead technical initiatives without supervisory authority.
• Familiarity with LLM serving internals, including KV‑cache management, prefill and decode phases, KV‑cache offloading, and disaggregated serving.
• Familiarity with inference engines and distributed serving frameworks such as SGLang, vLLM, NVIDIA Dynamo, or TensorRT‑LLM.
• Strong understanding of heterogeneous compute architecture concepts, including memory hierarchies, NUMA, caching, accelerator architectures, and interconnects such as PCIe, CXL, NVLink, or UALink.

Preferred Qualifications

• Technical leadership experience in a systems-focused pathfinding or research organization.
• Technical knowledge of HBM, DRAM, and emerging memory technologies.
• Technical knowledge of NVMe SSDs, NAND, and next‑generation storage systems.

Before Getting Started

Please review Micron’s Internal Job Application Policy on your regional PeopleNow Career Opportunities page before searching and applying for jobs. Note in particular that:

• Hiring managers may view your performance appraisals, original resume, transcripts or other performance‑related documentation in your personal file. This information will be held in confidence.
• If you are selected to interview for a position, you must notify your direct supervisor before participating in the interview process.

Benefits

• Micron benefits are designed to help you stay well, provide peace of mind and help you prepare for the future.
• We offer a choice of medical, dental and vision plans in all locations enabling team members to select the plans that best meet their family healthcare needs and budget.
• Micron also provides benefit programs that help protect your income if you are unable to work due to illness or injury, and paid family leave.
• Additionally, Micron benefits include a robust paid time‑off program and paid holidays.

For additional information regarding the Benefit programs available, please see the Benefits Guide posted on Benefits | Micron Technology, Inc

Micron is proud to be an equal opportunity workplace and is an affirmative action employer. All qualified applicants will receive consideration for employment without regard to race, color, religion, sex, sexual orientation, age, national origin, citizenship status, disability, protected veteran status, gender identity or any other factor protected by applicable federal, state, or local laws.

For US Sites Only: To request assistance with the application process and/or for reasonable accommodations, please contact Micron’s People Organization at [e-mail] or 1-800-336-8918 (select option #3)