Lead AI Systems Software Engineer (C/C++, Linux)

Micron Technology, Inc.; Richardson (TX); On-site; USD 150,000 - 230,000; Full time

Benefits offered by this job

Medical, Dental & Vision plans

Paid time off

Paid holidays

Job summary

Micron Technology, Inc. seeks a senior AI software engineer to design and modify AI inference stacks for proof‑of‑concept hardware. You will lead software architecture with small teams and research memory/storage challenges in heterogeneous compute environments.

The role requires hands-on development in C/C++, Python, CUDA/SYCL, and experience debugging across applications, OS, and hardware interfaces. Mentoring interns and presenting findings to customers completes the scope.

Qualifications

• PhD with 7+ years or MS/BS with 10+ years in CS/SE/CE.
• Hands-on AI inference stack development across multiple layers.
• Proficient in C, C++, Python; Linux multithreading & IPC.
• Experience debugging across apps, OS, networks, and hardware interfaces.
• Familiarity with LLM internals and KV-cache management.
• Experience leading technical initiatives without supervision.

Responsibilities

• Design and modify AI inference software stacks for proof-of-concept hardware.
• Lead software architecture and development efforts, independently and with small teams.
• Research AI topics to identify memory and storage challenges and opportunities.
• Develop Linux applications using C/C++, Python, CUDA/SYCL for heterogeneous compute.
• Mentor interns and present findings to customers and internal teams.

Skills

C

C++

Python

Rust

Linux multithreading

GPU programming

CUDA

SYCL

OpenCL

Linux IPC

Education

PhD with 7+ years or MS/BS with 10+ years in CS/SE/CE

Tools

CUDA

SYCL

OpenCL

TensorRT-LLM

NVIDIA Dynamo

vLLM

Job description

Micron Technology, Inc. seeks a senior AI software engineer to design and modify AI inference stacks for proof‑of‑concept hardware. You will lead software architecture with small teams and research memory/storage challenges in heterogeneous compute environments.

The role requires hands-on development in C/C++, Python, CUDA/SYCL, and experience debugging across applications, OS, and hardware interfaces. Mentoring interns and presenting findings to customers completes the scope.