Software Engineer III - AI/ML Deep Learning & GPU ML Serving

Testing Site - JPMC; Palo Alto (CA); On-site; USD 180,000 - 240,000; Full time

Job summary

JPMorgan Chase’s Software Engineer III role sits within the Commercial and Investment Banking technology team. You will design, develop, and deploy secure, scalable ML-powered software solutions, with emphasis on production-grade inference and fast, low-latency web services.

The role requires strong Python, ML framework experience, and hands-on cloud/Kubernetes expertise, including GPU workloads and modern microservices. Strong data analysis and collaborative skills are essential.

Qualifications

• Formal training or certification on software engineering concepts and 3+ years applied experience.
• Professional software development experience, with emphasis on ML systems.
• Strong proficiency in Python and experience with ML frameworks (TensorFlow, PyTorch, or similar).
• Experience deploying and managing GPU workloads in Kubernetes and cloud environments.

Responsibilities

• Develop, test, and troubleshoot software solutions, applying creative approaches to solve technical challenges.
• Write secure, high-quality production code and maintain algorithms integrated with firm systems.
• Produce architecture and design artifacts for complex applications, ensuring alignment with design constraints.
• Analyze and visualize large, diverse data sets to drive continuous improvement of applications and systems.
• Identify and address hidden issues and patterns in data to enhance code quality and system architecture.
• Collaborate with software engineering communities to explore and adopt new technologies.
• Participate in system design and architecture discussions, focusing on reliability and scalability.
• Optimize deep learning models for production inference, including quantization and batching.
• Deploy and manage GPU workloads in Kubernetes environments.
• Build scalable, low-latency systems using web services and APIs.
• Partner with product and program management teams to deliver business-driven solutions.

Skills

Python

ML systems

Data analysis

Education

MS/PhD in CS/ML

Tools

Docker

Kubernetes

EKS

AWS

GCP

TorchServe

TF Serving

Triton Inference Server

Job description

Be an integral part of an agile team that's constantly pushing the envelope to enhance, build, and deliver top-notch technology products.

As a Software Engineer III at JPMorgan Chase within the Commercial and Investment Banking team, you will be a key member of an agile team, designing and delivering secure, stable, and scalable technology products. You will implement critical technology solutions across multiple technical areas, supporting the firm’s business objectives.

Job Responsibilities

• Develop, test, and troubleshoot software solutions, applying creative approaches to solve technical challenges.
• Write secure, high-quality production code and maintain algorithms integrated with firm systems.
• Produce architecture and design artifacts for complex applications, ensuring alignment with design constraints.
• Analyze and visualize large, diverse data sets to drive continuous improvement of applications and systems.
• Identify and address hidden issues and patterns in data to enhance code quality and system architecture.
• Collaborate with software engineering communities to explore and adopt new technologies.
• Participate in system design and architecture discussions, focusing on reliability and scalability.
• Optimize deep learning models for production inference, including quantization and batching.
• Deploy and manage GPU workloads in Kubernetes environments.
• Build scalable, low-latency systems using web services and APIs.
• Partner with product and program management teams to deliver business-driven solutions.

Required qualifications, capabilities, and skills

• Formal training or certification on software engineering concepts and 3+ years applied experience
• Professional software development experience, with emphasis on ML systems.
• Strong proficiency in Python and experience with ML frameworks (TensorFlow, PyTorch, or similar).
• Experience with cloud technologies (Docker, Kubernetes, EKS) and public clouds (AWS, GCP).
• Hands-on experience with ML model serving frameworks (TorchServe, TensorFlow Serving, Triton Inference Server).
• Experience deploying and managing GPU workloads in Kubernetes.
• Familiarity with scalable, low-latency systems based on web services and APIs.
• Experience with NoSQL databases (Cassandra or equivalent) for high-throughput data access.
• Understanding of GPU resource management and cost optimization.
• Experience with modern microservices architecture.
• Ability to lead the design of large-scale systems and evaluate tradeoffs.

Preferred qualifications, capabilities, and skills

• MS/PhD in Computer Science, Machine Learning, or a related field.
• Proficiency in Java
• Experience with graph neural networks and graph processing frameworks (DGL, PyTorch Geometric, NetworkX).
• Knowledge of GPU programming (CUDA) and performance optimization.
• Experience with model monitoring, A/B testing, and ML observability tools.
• Familiarity with MLOps tools and practices (MLflow, Kubeflow, SageMaker).
• Experience serving large-scale models and optimizing for performance.

FEDERAL DEPOSIT INSURANCE ACT:

This position is subject to Section 19 of the Federal Deposit Insurance Act. As such, an employment offer for this position is contingent on JPMorgan Chase's review of criminal conviction history, including pretrial diversions or program entries.