Principal Software Engineer — AI/ML & HPC Architect

JPMorgan Chase; Palo Alto (CA); On-site; USD 204,000 - 285,000; Full time

Job summary

JPMorganChase seeks a Principal Software Engineer within the Core Foundational Platforms team in Palo Alto, to deliver trusted, scalable tech products. You will mentor engineers, lead design reviews, and shape AI-enabled workflows with secure governance across low-latency and high-throughput systems.

You will contribute to production-grade code, apply telemetry-driven decisions, and collaborate with data scientists, product partners, and cross-functional teams to accelerate delivery while

Qualifications

• Formal training or certification on software engineering concepts and 10+ years applied experience.
• Hands-on experience delivering system design, application development, testing, and operational stability.
• Advanced knowledge of software development with in-depth expertise in HPC or large language models.
• 8+ years of experience in high-performance computing software.
• 5+ years of experience with at least one accelerator.
• 3+ years of experience in deep learning, particularly LLMs.
• Strong programming skills in Python and C/C++, plus experience with AI/ML frameworks like PyTorch.
• Experience designing and leading agentic AI-enabled development practices with safe governance.

Responsibilities

• Design and implement complex, scalable software frameworks using architecture patterns.
• Develop secure, high-quality production code; review and improve others' code.
• Lead technical design reviews and advise cross-functional partners.
• Create reusable performance patterns to optimize model training and inference.
• Define telemetry and metrics to guide hardware and software decisions.
• Mentor developers in HPC practices intersecting with AI/ML.
• Architect and govern AI-enabled workflows to improve delivery at scale with guardrails.
• Apply SDLC tools and AI-assisted development to scale automation.

Skills

Python

C/C++

PyTorch

HPC

Low-latency

Telemetry

AI/ML

Mentoring

Education

PhD preferred (CS/CE/Math)

10+ years software engineering

Tools

CUDA

Enterprise SDLC tools

Git

GPU programming

Job description

JPMorganChase seeks a Principal Software Engineer within the Core Foundational Platforms team in Palo Alto, to deliver trusted, scalable tech products. You will mentor engineers, lead design reviews, and shape AI-enabled workflows with secure governance across low-latency and high-throughput systems.

You will contribute to production-grade code, apply telemetry-driven decisions, and collaborate with data scientists, product partners, and cross-functional teams to accelerate delivery while