Principal Software Engineer - AI/ML & HPC Architect

JPMorganChase

Palo Alto (CA)

On-site

USD 210,000 - 270,000

Full time

11 hours ago
Be an early applicant
Application generator

Get a reply from this employer — a resume and cover letter tailored to exactly what they’re hiring for.

Get past ATS filters

Benefits offered by this job

Comprehensive health care
On-site health and wellness centers
Retirement savings plan
Tuition reimbursement
Mental health support
Financial coaching

Job summary

JPMorganChase is seeking a Principal Software Engineer in Palo Alto to lead the design of scalable software frameworks and secure AI-enabled workflows. The role collaborates with data scientists, engineers, and product partners, mentoring teams on high-performance computing practices and AI model deployment.

You will drive architectural decisions across low-latency systems, telemetry, and platform stability, enabling faster delivery with strong security and governance across the enterprise.

Qualifications

  • 10+ years of software engineering experience with system design and operations.
  • Advanced knowledge in HPC or large language models.
  • 8+ years in high-performance computing software.

Responsibilities

  • Design and implement scalable software frameworks.
  • Develop secure, high-quality production code and review others' work.
  • Lead technical design reviews and advise cross-functional partners.
  • Create reusable performance patterns for model training and inference.
  • Define telemetry and performance indicators to guide decisions.
  • Mentor HPC practices intersecting with AI/ML.
  • Govern AI-enabled engineering workflows with guardrails for security and reuse.
  • Utilize enterprise AI-assisted development tools to improve delivery at scale.

Skills

10+ years software experience
Python
C/C++
PyTorch
AI/ML frameworks
HPC expertise
Low-latency systems
Telemetry-driven DevOps
Security & resiliency
Agentic AI practices
CUDA
GPU profiling

Tools

CUDA
GPU profiling

Job description

JPMorganChase is seeking a Principal Software Engineer in Palo Alto to lead the design of scalable software frameworks and secure AI-enabled workflows. The role collaborates with data scientists, engineers, and product partners, mentoring teams on high-performance computing practices and AI model deployment.

You will drive architectural decisions across low-latency systems, telemetry, and platform stability, enabling faster delivery with strong security and governance across the enterprise.

Get your free, confidential resume review.
or drag and drop your file here.
Similar jobs

Similar jobs worth comparing

Principal AI & HPC Software Architect
Principal AI & HPC Software Architect

JPMorgan Chase & Co. • Palo Alto (CA)

On-site
USD 210,000 - 260,000
Senior Principal Software Engineer - AI/ML Platform Leader
Senior Principal Software Engineer - AI/ML Platform Leader

JPMorganChase • Seattle (WA)

On-site
USD 210,000 - 290,000
Senior AI Foundations Engineer
Senior AI Foundations Engineer

JPMorganChase • Jersey City (NJ)

On-site
USD 180,000 - 240,000
Lead AI/ML Engineer – GenAI, MLOps & Scalable Systems
Lead AI/ML Engineer – GenAI, MLOps & Scalable Systems

JPMorgan Chase & Co. • Palo Alto (CA)

On-site
USD 170,000 - 260,000
Principal Data Platform Engineer — AI-Driven & Cloud-Native
Principal Data Platform Engineer — AI-Driven & Cloud-Native

JPMorganChase • Jersey City (NJ)

On-site
USD 180,000 - 240,000
Health care coverage
On-site wellness centers
Retirement savings plan
+1
Senior AI/ML Platform Architect
Senior AI/ML Platform Architect

JPMorganChase • Jersey City (NJ)

On-site
USD 130,000 - 160,000
Lead AI Platform Engineer — Secure, Scalable AI
Lead AI Platform Engineer — Secure, Scalable AI

JPMorgan Chase & Co. • Wilmington (DE)

On-site
USD 135,000 - 190,000
Principal Data Platform Engineer - AI-Driven, Secure Cloud
Principal Data Platform Engineer - AI-Driven, Secure Cloud

JPMorgan Chase & Co. • Jersey City (NJ)

On-site
USD 140,000 - 200,000
Senior Principal AI/ML Engineer, LLM & GNN Scale
Senior Principal AI/ML Engineer, LLM & GNN Scale

JPMorganChase • Palo Alto (CA)

On-site
USD 180,000 - 240,000
Senior Principal AI/ML Engineer — LLM & GNN Architect
Senior Principal AI/ML Engineer — LLM & GNN Architect

Fairygodboss • Palo Alto (CA)

On-site
USD 180,000 - 240,000