Senior Principal AI/ML Platform Architect

JP Morgan Chase

Palo Alto (CA)

On-site

USD 210,000 - 320,000

Full time

14 days+

A complete application in a minute

Tailored resume and cover letter, ready to send.

Get past ATS filters

Job summary

JPMorganChase is seeking a Senior Principal Software Engineer to lead scalable ML/AI platforms on AWS, guiding model serving for LLMs and graph models. You will drive MLOps, governance, and scalable architectures across agile teams while ensuring security and reliability.

Strong communication with senior leaders is essential. The role emphasizes creating durable ML engineering frameworks, optimizing inference, and aligning technology with business outcomes in a fast-moving financial services

Qualifications

  • 10+ years of software/AI engineering experience.
  • Expertise in LLMs and GNNs.
  • Hands-on experience deploying LLM/GNN solutions on AWS.
  • Proficient in Python and major DL frameworks.
  • Strong knowledge of MLOps and governance.
  • Excellent cross-functional communication.

Responsibilities

  • Advises and leads strategy, architecture, and development of model serving solutions.
  • Defines and implements MLOps and LLMOps for end-to-end model lifecycle management.
  • Drives optimization of model inferencing for high throughput and low latency.
  • Sets strategy and standards for AI-enabled engineering across a portfolio.
  • Applies SDLC tools to improve automation and governance.
  • Creates reusable ML engineering frameworks for scale across teams.
  • Establishes best practices for CI/CD and infrastructure-as-code.
  • Partners with data science and SRE to productionize models on AWS.
  • Leads deployment and optimization using Triton and vLLM for high-scale serving.
  • Oversees AI ops including monitoring, security, and incident response.
  • Translates complex concepts to senior stakeholders to drive business impact.

Skills

Python
LLMs
GNNs
Cloud AWS
MLOps

Education

Formal software engineering training
10+ years AI/ML engineering experience

Tools

SageMaker
Bedrock
EKS
Kubeflow
MLflow
vLLM
Triton

Job description

JPMorganChase is seeking a Senior Principal Software Engineer to lead scalable ML/AI platforms on AWS, guiding model serving for LLMs and graph models. You will drive MLOps, governance, and scalable architectures across agile teams while ensuring security and reliability.

Strong communication with senior leaders is essential. The role emphasizes creating durable ML engineering frameworks, optimizing inference, and aligning technology with business outcomes in a fast-moving financial services

Get your free, confidential resume review.

or drag and drop your file here.

Similar jobs

Similar jobs worth comparing

Senior Principal LLM Engineer — AI Platform & Scale
Senior Principal LLM Engineer — AI Platform & Scale

JPMorgan Chase & Co. • Palo Alto (CA)

On-site
USD 233,000 - 325,000
Senior AI Platform Engineer — ML Systems Lead
Senior AI Platform Engineer — ML Systems Lead

JP Morgan Chase • Jersey City (NJ)

On-site
USD 180,000 - 230,000
Senior Principal AI/ML Engineer, LLM & GNN Scale
Senior Principal AI/ML Engineer, LLM & GNN Scale

JP Morgan Chase • Palo Alto (CA)

On-site
USD 180,000 - 240,000
Lead AI Platform Architect & Senior Software Engineer
Lead AI Platform Architect & Senior Software Engineer

JP Morgan Chase • Jersey City (NJ)

On-site
USD 110,000 - 150,000
Comprehensive health care coverage
Retirement savings plan
Tuition reimbursement
Senior AI Platform Engineer - LLM & Production ML
Senior AI Platform Engineer - LLM & Production ML

JP Morgan Chase • Jersey City (NJ)

On-site
USD 180,000 - 260,000
Senior AI Platform Engineer: ML/LLM Ops
Senior AI Platform Engineer: ML/LLM Ops

JPMorgan Chase & Co. • Jersey City (NJ)

On-site
USD 180,000 - 240,000
Principal AI Foundations Engineer - Platform & MLOps
Principal AI Foundations Engineer - Platform & MLOps

JP Morgan Chase • New York (NY)

On-site
USD 120,000 - 190,000
Lead AI Platform Architect for Enterprise LLM Systems
Lead AI Platform Architect for Enterprise LLM Systems

JP Morgan Chase • Jersey City (NJ)

On-site
USD 180,000 - 240,000
Senior Director, AI/ML Platform & Engineering
Senior Director, AI/ML Platform & Engineering

JP Morgan Chase • Palo Alto (CA)

On-site
USD 250,000 - 400,000
Senior AI/ML Platform Engineer — Cloud Infra & Pipelines
Senior AI/ML Platform Engineer — Cloud Infra & Pipelines

JP Morgan Chase • Jersey City (NJ)

On-site
USD 140,000 - 210,000