Member of Technical Staff, AI Engineering

Micron Technology; Boise (ID); On-site; USD 130,000 - 170,000; Full time

Benefits offered by this job

Medical, dental, and vision plans

Paid family leave

Robust paid time-off

Job summary

Micron Technology, Inc in Boise, Idaho is seeking a Member of Technical Staff in AI Engineering to work on innovative machine learning solutions that improve manufacturing processes. The role includes responsibilities such as architecting model training jobs, developing AI agents, and collaborating closely with hardware architects.

Applicants should have extensive experience in GPU architecture, performance optimization, and scalable ML systems. Micron offers an array of benefits including medical, dental, paid time-off, and is committed to equal opportunity employment.

Qualifications

• 10+ years of experience in GPU architecture and resource management.
• Strong hands-on experience building scalable ML systems.
• Deep proficiency in LLMs and fine-tuning methods.

Responsibilities

• Architect and complete large-scale custom model training jobs.
• Optimize training throughput and memory efficiency.
• Design autonomous AI Agents for automating complex workflows.

Skills

Deep expertise in GPU architecture

Performance optimization

Building scalable ML systems

Proficiency in LLMs

Programming in Python

Education

Bachelor’s or Master’s degree in Computer Science, Statistics, or related field

Tools

CUDA

PyTorch

Docker

Kubernetes

Job description

Member of Technical Staff, AI Engineering

Our vision is to transform how the world uses information to enrich life for all.

Micron Technology is a world leader in innovating memory and storage solutions that accelerate the transformation of information into intelligence, inspiring the world to learn, communicate and advance faster than ever.

The Smart Manufacturing and AI team builds advanced machine learning, GenAI, and Agentic AI solutions that directly power Micron’s manufacturing advantage. We work at the intersection of cutting‑edge AI and real‑world production systems, turning massive data and compute into measurable impact. If you enjoy solving hard problems at scale and seeing your work drive silicon to market, this is the team for you!

Responsibilities

• Architect and complete large-scale custom model training and fine-tuning jobs (SFT, RLHF) on multi-node, multi‑GPU clusters.
• Optimize training throughput and memory efficiency using distributed training strategies (FSDP, DeepSpeed, Megatron‑LM) and mixed‑precision techniques (FP16/BF16).
• Design and develop autonomous AI Agents capable of multi‑step reasoning, planning, and tool execution to automate complex manufacturing workflows.
• Analyze and profile complex workloads (e.g., LLM training, Rendering pipelines) to identify bottlenecks in compute, memory bandwidth, and latency.
• Write and optimize high‑performance kernels using CUDA, HIP, or custom assembly (PTX/SASS) to unlock hardware capabilities.
• Collaborate with Hardware Architects to define features for next‑generation GPUs based on workload characterization.
• Design and implement performance regression testing suites to catch degradations in drivers or compilers.
• Mentor engineers who are developing skills in parallel programming paradigms and optimization techniques.

Minimum Qualifications

• 10+ years of experience with deep expertise in GPU architecture (memory hierarchy, tensor cores, NVLink) and GPU resource management across cloud and on‑prem environments, along with 5+ years in performance optimization, parallel computing, and low‑level systems using C++ and GPGPU frameworks (CUDA preferred; HIP/OpenCL/Metal acceptable).
• Strong hands‑on experience building scalable ML systems, including distributed training (DDP, FSDP), model parallelism, and end‑to‑end automation of training, testing, and deployment workflows.
• Deep proficiency in LLMs, including prompt engineering, tool/function calling, chain‑of‑thought reasoning, fine‑tuning with PEFT methods (LoRA, QLoRA), and inference optimization using engines like vLLM and TensorRT‑LLM.
• Experience developing GenAI applications and AI agents using frameworks such as LangChain, LangGraph, LlamaIndex, and AutoGen, with strong knowledge of ML frameworks (PyTorch required; TensorFlow/scikit‑learn a plus).
• Strong programming in Python (preferred) or Java, with experience in CI/CD and cloud‑native tools (Git, Jenkins, Docker, Kubernetes); excellent communication skills, fast‑paced delivery mentality, and a Bachelor’s or Master’s degree in Computer Science, Statistics, or a related field.

Preferred Qualifications

• Ph.D. in Computer Science, Statistics, or related field (or equivalent experience), with strong foundations in mathematics, probability, statistics, and algorithms.
• Experience with HPC job schedulers (e.g., Slurm) and orchestrating large‑scale GPU workloads on Kubernetes using tools such as Ray and Kubeflow.
• Strong expertise in CUDA programming, Triton kernels, and developing custom C++ extensions for PyTorch to optimize and accelerate workloads.
• Experience designing and coordinating multi‑agent systems, including collaboration between specialized agents in complex architectures.
• Proven ability to productionize data science solutions, with experience in computer vision and/or signal processing for classification and feature extraction.

Benefits

Micron offers a range of benefits including medical, dental, and vision plans, income protection programs, paid family leave, robust paid time‑off, and paid holidays. Benefit details are available in the Micron Benefits Guide.

Micron is proud to be an equal opportunity workplace and is an affirmative action employer. All qualified applicants will receive consideration for employment without regard to race, color, religion, sex, sexual orientation, age, national origin, citizenship status, disability, protected veteran status, gender identity, or any other factor protected by applicable federal, state, or local laws.