Senior AI Infrastructure Architect – Scalable ML Platform

JPMorgan Chase; Seattle (WA); On-site; USD 204,000 - 285,000; Full time

Job summary

JPMorgan Chase is seeking a Principal Engineer for the Core AI Infrastructure Platform in Seattle. You will design scalable AI/ML hosting, inference, and foundation services across hybrid-cloud environments, guiding teams through design, build, and operations.

You will own non-functional requirements, implement observability and security controls, and mentor engineers to raise the bar on reliability and performance for production AI systems.

Qualifications

• Formal training or certification on software engineering concepts and 10+ years applied experience.
• Strong hands-on coding experience in Python with production-grade services.
• Experience leading AI-assisted software development tools usage and validation, with setting team expectations for correctness, performance and security.
• Strong understanding of responsible AI use in engineering workflows, data sensitivity, secure handling and resiliency/ security adherence.
• Hands-on system design, automated testing, debugging, and operational stability for production software.
• Experience implementing observability, logging, metrics, alerts, SLOs and incident response in production services.
• Knowledge in cloud platforms, AI/ML, distributed systems, or infrastructure engineering.
• Ability to breakdown technical requirements into executable tasks and manage milestones with teams.
• Strong written and verbal communication skills.

Responsibilities

• Architect and design solutions to enhance reliability and scalability of AI/ML platforms.
• Build and enhance reusable platform services, APIs, SDKs, and libraries for model hosting and inference.
• Collaborate with AI infrastructure teams to enable AI Foundation Services across the delivery lifecycle.
• Own non-functional requirements and build tooling for observability, resilience, and security.
• Establish standards and reference architectures for reliability and automation across services.
• Partner with product and platform teams to meet service reliability targets and recoverability.
• Participate in on-call rotations and resolve complex production issues; drive remediation.
• Mentor engineers to improve engineering quality and operational rigor.

Skills

Python

Software design

AI/ML infrastructure

Observability

On-call rotations

Mentoring

Tools

Python tooling

Job description

JPMorgan Chase is seeking a Principal Engineer for the Core AI Infrastructure Platform in Seattle. You will design scalable AI/ML hosting, inference, and foundation services across hybrid-cloud environments, guiding teams through design, build, and operations.

You will own non-functional requirements, implement observability and security controls, and mentor engineers to raise the bar on reliability and performance for production AI systems.