Senior Principal AI/ML Architect — LLM & GNN Platforms

Testing Site - JPMC; Palo Alto (CA); On-site; USD 250,000 - 330,000; Full time

Benefits offered by this job

Health insurance

Retirement plan

On-site facilities and amenities

Job summary

JPMorganChase's Commercial & Investment Bank team seeks a Senior Principal Software Engineer to lead ML engineering for large language models and graph neural networks, across cloud and on‑prem environments.

You will drive model serving, MLOps, and scalable AI platforms, collaborating with data science, SRE, and product leadership to deliver secure, high‑performance solutions.

The role emphasizes strategic influence, architecture experience, and translating complex AI concepts into business value.

Qualifications

• 10+ years of software engineering experience.
• 8+ years AI/ML engineering with LLMs and GNNs.
• Experience deploying LLM/GNN solutions on AWS/Azure/GCP at enterprise scale.
• Hands-on LLM inference with Triton and vLLM.
• Proficient in Python and DL frameworks (PyTorch, TensorFlow, HF).
• Expertise in MLOps (MLflow, SageMaker Pipelines, Kubeflow).
• Experience in security/compliance for AI deployments.

Responsibilities

• Advise on strategy, architecture, and development of LLM/GNN model serving across cloud and on‑premises.
• Define and implement MLOps strategies for end‑to‑end model lifecycle management.
• Drive optimization of model inference for high throughput and low latency.
• Create durable software and platform frameworks to scale ML engineering.
• Collaborate with SRE for observability, reliability, and cost efficiency.
• Lead deployment using Triton and vLLM at scale.

Skills

AI/ML engineering

LLMs

GNNs

Python

PyTorch

Education

Master’s or PhD in CS/Engineering

Tools

SageMaker

Bedrock

EKS

Azure ML

GCP Vertex AI

Triton Inference Server

Job description

JPMorganChase's Commercial & Investment Bank team seeks a Senior Principal Software Engineer to lead ML engineering for large language models and graph neural networks, across cloud and on‑prem environments.

You will drive model serving, MLOps, and scalable AI platforms, collaborating with data science, SRE, and product leadership to deliver secure, high‑performance solutions.

The role emphasizes strategic influence, architecture experience, and translating complex AI concepts into business value.