SageMaker AI Inference Engineer - Kernel & Performance Optimizer

Amazon Development Center U.S., Inc.; Bellevue (WA); On-site; USD 150,000 - 190,000; Full time

Benefits offered by this job

Health insurance

401(k) matching

Paid time off

Parental leave

Job summary

Amazon Development Center U.S., Inc. in Bellevue, WA is seeking a Software Development Engineer to optimize inference performance, tune kernels, and improve LLM serving efficiency.

You will design, implement, and measure systems to reduce latency and increase throughput for production inference workloads across the full software lifecycle. This is a hands-on role requiring profiling, high‑performance coding, and collaboration with ML scientists and infrastructure teams.

Qualifications

• 3+ years of non‑internship professional software development experience.
• 2+ years of non‑internship design or architecture (design patterns, reliability and scaling) of new and existing systems experience.
• 1+ years of software development engineer or related occupational experience.
• 1+ years of designing and developing large‑scale, multi‑tiered, multi‑threaded, embedded or distributed software applications, tools, systems, and services using C#, C++, Java, or Perl.
• 1+ years of Object Oriented Design experience.
• Experience programming with at least one software programming language.

Responsibilities

• Design and implement kernel‑level optimizations and inference pipeline improvements that reduce latency and increase throughput for LLM serving workloads.
• Profile, benchmark, and tune model inference performance across hardware and software stacks, identifying bottlenecks and delivering measurable gains.
• Write well‑organized, maintainable code and participate actively in code reviews, providing constructive feedback to peers and mentoring newer engineers on the team.
• Collaborate with applied scientists, ML engineers, and infrastructure teams to translate model requirements into production‑ready inference solutions.
• Evaluate emerging tools, frameworks, and generative AI techniques for inference optimization, recommending adoption where they improve efficiency or quality.

Skills

OO Design

Profiling

Performance optimization

Latency reduction

Mentoring

Education

Bachelor's degree in Computer Science, Engineering, Mathematics, or related field

Tools

CUDA

C/C++

Java

Perl

Job description

Amazon Development Center U.S., Inc. in Bellevue, WA is seeking a Software Development Engineer to optimize inference performance, tune kernels, and improve LLM serving efficiency.

You will design, implement, and measure systems to reduce latency and increase throughput for production inference workloads across the full software lifecycle. This is a hands-on role requiring profiling, high‑performance coding, and collaboration with ML scientists and infrastructure teams.