Senior AI/ML Engineer: Deep Learning & GPU Inference

Testing Site - JPMC

Palo Alto (CA)

On-site

USD 180,000 - 240,000

Full time

14 days+

A complete application in a minute

Tailored resume and cover letter, ready to send.

Get past ATS filters

Job summary

JPMorgan Chase’s Software Engineer III role sits within the Commercial and Investment Banking technology team. You will design, develop, and deploy secure, scalable ML-powered software solutions, with emphasis on production-grade inference and fast, low-latency web services.

The role requires strong Python, ML framework experience, and hands-on cloud/Kubernetes expertise, including GPU workloads and modern microservices. Strong data analysis and collaborative skills are essential.

Qualifications

  • Formal training or certification on software engineering concepts and 3+ years applied experience.
  • Professional software development experience, with emphasis on ML systems.
  • Strong proficiency in Python and experience with ML frameworks (TensorFlow, PyTorch, or similar).
  • Experience deploying and managing GPU workloads in Kubernetes and cloud environments.

Responsibilities

  • Develop, test, and troubleshoot software solutions, applying creative approaches to solve technical challenges.
  • Write secure, high-quality production code and maintain algorithms integrated with firm systems.
  • Produce architecture and design artifacts for complex applications, ensuring alignment with design constraints.
  • Analyze and visualize large, diverse data sets to drive continuous improvement of applications and systems.
  • Identify and address hidden issues and patterns in data to enhance code quality and system architecture.
  • Collaborate with software engineering communities to explore and adopt new technologies.
  • Participate in system design and architecture discussions, focusing on reliability and scalability.
  • Optimize deep learning models for production inference, including quantization and batching.
  • Deploy and manage GPU workloads in Kubernetes environments.
  • Build scalable, low-latency systems using web services and APIs.
  • Partner with product and program management teams to deliver business-driven solutions.

Skills

Python
ML systems
Data analysis

Education

MS/PhD in CS/ML

Tools

Docker
Kubernetes
EKS
AWS
GCP
TorchServe
TF Serving
Triton Inference Server

Job description

JPMorgan Chase’s Software Engineer III role sits within the Commercial and Investment Banking technology team. You will design, develop, and deploy secure, scalable ML-powered software solutions, with emphasis on production-grade inference and fast, low-latency web services.

The role requires strong Python, ML framework experience, and hands-on cloud/Kubernetes expertise, including GPU workloads and modern microservices. Strong data analysis and collaborative skills are essential.

Get your free, confidential resume review.

or drag and drop your file here.

Similar jobs

Similar jobs worth comparing

Lead Software Engineer - AI/ML Deep Learning & GPU ML Serving
Lead Software Engineer - AI/ML Deep Learning & GPU ML Serving

Testing Site - JPMC • Palo Alto (CA)

On-site
USD 180,000 - 260,000
Senior Lead Engineer, AI Inference Platform
Senior Lead Engineer, AI Inference Platform

Aumni • Seattle (WA)

On-site
USD 180,000 - 260,000
Software Engineer III - AI/ML Deep Learning & GPU ML Serving
Software Engineer III - AI/ML Deep Learning & GPU ML Serving

Testing Site - JPMC • Palo Alto (CA)

On-site
USD 180,000 - 240,000
Software Engineer III- AI/ML Engineering, GPU ML Serving
Software Engineer III- AI/ML Engineering, GPU ML Serving

JPMorgan Chase & Co. • Palo Alto (CA)

On-site
USD 160,000 - 230,000
Lead AI/ML Software Engineer | Python & Java
Lead AI/ML Software Engineer | Python & Java

Testing Site - JPMC • Plano (TX)

On-site
USD 150,000 - 230,000
Senior AI/ML Engineer — Production Systems & Cloud
Senior AI/ML Engineer — Production Systems & Cloud

JPMorgan Chase & Co. • Jersey City (NJ)

On-site
USD 150,000 - 230,000
Cloud exposure
VP AI/ML Lead Engineer - Hands-on, Cloud FinTech
VP AI/ML Lead Engineer - Hands-on, Cloud FinTech

JPMorgan Chase & Co. • Whitewater (CO)

On-site
USD 180,000 - 250,000
Senior Python Engineer: GenAI & ML Platform Lead
Senior Python Engineer: GenAI & ML Platform Lead

Aumni • Plano (TX)

On-site
USD 170,000 - 210,000
Senior ML Platform Engineer: GPU Training & Cloud
Senior ML Platform Engineer: GPU Training & Cloud

JP Morgan Chase • Palo Alto (CA)

On-site
USD 160,000 - 210,000
Lead Software Engineer – AI/ML, Java & AWS Cloud
Lead Software Engineer – AI/ML, Java & AWS Cloud

Aumni • Plano (TX)

On-site
USD 150,000 - 210,000