Senior Principal SDE: Global AI Inference Platform

Amazon; Seattle (WA); On-site; USD 240,000 - 325,000; Full time

Job summary

Amazon seeks a Senior Principal Software Development Engineer to lead Mantle, AWS's high‑performance ML inference platform. You will shape the architecture for millisecond latency, zero-trust security, and global availability, while mentoring senior engineers and guiding cross‑team initiatives across Bedrock and AWS.

The role emphasizes long-term technical vision and executive-level collaboration. You will own end-to-end design decisions, drive system improvements, and partner with leadership to

Qualifications

• 15+ years of professional software development experience.
• Experience with object-oriented design, data structures, and algorithms.
• Experience owning tech strategy and end-to-end delivery with senior leadership.
• Strong track record mentoring engineers and leading large teams.

Responsibilities

• Design and evolve the architecture of Mantle's distributed inference engine, including capacity management, model onboarding pipelines, and quality-of-service controls.
• Drive cross-organizational initiatives spanning multiple AWS teams to deliver seamless, OpenAI-compatible API experiences with strong security guarantees.
• Lead technical strategy for scaling inference to support onboarding of new foundation models with global availability and performance SLAs.
• Author and champion technical vision documents, influence product roadmaps, and participate in executive-level architectural reviews.
• mentor and develop principal and senior engineers to foster a culture of engineering excellence and customer obsession.

Skills

Distributed systems

Mentoring

Technical strategy

Leadership

Job description

Amazon seeks a Senior Principal Software Development Engineer to lead Mantle, AWS's high‑performance ML inference platform. You will shape the architecture for millisecond latency, zero-trust security, and global availability, while mentoring senior engineers and guiding cross‑team initiatives across Bedrock and AWS.

The role emphasizes long-term technical vision and executive-level collaboration. You will own end-to-end design decisions, drive system improvements, and partner with leadership to