SageMaker AI Inference Engineer II - Latency Optimizer

Amazon Inc.; Seattle (WA); In loco; USD 144.000 - 194.000; Tempo pieno

Descrizione del lavoro

Amazon's SageMaker AI Inference team in Bellevue, WA is seeking a Software Development Engineer II to optimize inference performance and build scalable, low-latency systems for large language model workloads.

You will design kernel-level improvements, profile across hardware, participate in code reviews, and collaborate with ML scientists and infra teams to push the boundaries of production AI services.

Competenze

• 3+ years of non-internship professional software development experience
• 2+ years of non-internship design or architecture experience
• 1+ years of software development engineer or related occupational experience
• 1+ years of designing and developing large-scale, multi-tiered, multi-threaded, embedded or distributed software applications, tools, systems, and services using: C#, C++, Java, or Perl experience
• 1+ years of Object Oriented Design experience
• Bachelor's degree or foreign equivalent in Computer Science, Engineering, Mathematics, or a related field
• Experience programming with at least one software programming language

Mansioni

• Design and implement kernel-level optimizations and inference pipeline improvements that reduce latency and increase throughput for LLM serving workloads
• Profile, benchmark, and tune model inference performance across hardware and software stacks, identifying bottlenecks and delivering measurable gains
• Write well-organized, maintainable code and participate actively in code reviews, providing constructive feedback to peers and mentoring newer engineers on the team
• Collaborate with applied scientists, ML engineers, and infrastructure teams to translate model requirements into production-ready inference solutions
• Evaluate emerging tools, frameworks, and generative AI techniques for inference optimization, recommending adoption where they improve efficiency or quality

Descrizione del lavoro

Amazon's SageMaker AI Inference team in Bellevue, WA is seeking a Software Development Engineer II to optimize inference performance and build scalable, low-latency systems for large language model workloads.

You will design kernel-level improvements, profile across hardware, participate in code reviews, and collaborate with ML scientists and infra teams to push the boundaries of production AI services.