Senior Lead Software Engineer - AI/ML Deep Learning & GPU ML Serving

JP Morgan Chase; Hyderabad; On-site; INR 4,500,000 - 7,600,000; Full time

Job summary

JP Morgan Chase is seeking a Senior Lead Software Engineer in Hyderabad to advance AI/ML deep learning, GPU serving, and secure production systems. You will guide teams, design scalable microservices, and apply responsible AI practices across the SDLC.

The role requires 5+ years in software engineering, with expertise in ML serving platforms, Python, and cloud-native techs. Expect collaboration with payments tech teams and a high-impact roadmap.

Qualifications

• 5+ years of professional software development experience.
• Experience with ML systems and architecture, including design patterns and scaling.
• Experience deploying GPU workloads in Kubernetes and cloud environments.
• Experience with ML model serving frameworks and low-latency inference.

Responsibilities

• Regularly provides technical guidance to the business and its technical teams, contractors, and vendors.
• Develops secure and high-quality production code, and reviews and debugs code written by others.
• Drives adoption and governance of AI-assisted engineering practices across teams to improve code quality, delivery speed, and operational outcomes.
• Applies knowledge of SDLC toolchain, including AI-assisted development and automation capabilities, to improve value of automation.
• Drives decisions that influence product design, application functionality, and technical operations.
• Serves as a function-wide subject matter expert in one or more areas of focus.
• Actively contributes to the engineering community as an advocate of firmwide frameworks, tools, and practices.

Skills

Python

TensorFlow

PyTorch

Kubernetes

Java

Scala

C++

GNNs

NoSQL

AWS

GCP

Docker

EKS

CI/CD

Tools

Docker

Kubernetes

TorchServe

TensorFlow Serving

Triton Inference Server

EKS

Job description

Senior Lead Software Engineer - AI/ML Deep Learning & GPU ML Serving

Job Information

• Job Identification 210807225
• Job Category Software Engineering
• Business Unit Commercial & Investment Bank
• Posting Date 11/09/2026, 07:08 AM
• Locations MAGMA,UNIT-1,PHASE-IV,SY NO.83/1,PLOT NO 2, GR Floor TO 2 Floor and 5 Floor TO 16 Floor,Basement 1,2, Hyderabad, IN-TG, 500081, IN
• Apply Before 11/10/2026, 05:00 AM
• Job Schedule Full time

Job Description

Be an integral part of an agile team that's constantly pushing the envelope to enhance, build, and deliver top-notch technology products.

As a Senior Lead Software Engineer at JPMorgan Chase within the Commercial & Investment Bank, Payments Technology, you are an integral part of an agile team that works to enhance, build, and deliver trusted market-leading technology products in a secure, stable, and scalable way. Drive significant business impact through your capabilities and contributions, and apply deep technical expertise and problem-solving methodologies to tackle a diverse array of challenges that span multiple technologies and applications.

Job responsibilities

• Regularly provides technical guidance and direction to support the business and its technical teams, contractors, and vendors
• Develops secure and high-quality production code, and reviews and debugs code written by others
• Drives adoption and governance of approved AI-assisted engineering practices across teams to improve code quality, delivery speed, and operational outcomes (e.g., AI-assisted code review/refactoring, test acceleration, release readiness, incident/root-cause analysis), while establishing measurable validation standards (secure coding, peer review, automated testing) and promoting reuse of proven patterns and automation within the SDLC/TLM toolchain.
• Applies knowledge of tools within the Software Development Life Cycle toolchain, including approved AI-assisted development and automation capabilities, to improve the value realized by automation at scale.
• Drives decisions that influence the product design, application functionality, and technical operations and processes
• Serves as a function-wide subject matter expert in one or more areas of focus
• Actively contributes to the engineering community as an advocate of firmwide frameworks, tools, and practices of the Software Development Life Cycle

Required qualifications, capabilities, and skills

• Formal training or certification on software engineering concepts and 5+ years applied experience.
• Relevant professional software development experience with focus on ML systems. Experience contributing to the system design or architecture (architecture, design patterns, reliability and scaling) of new and current systems, particularly ML serving platforms.
• Strong proficiency in Python with experience in ML frameworks (TensorFlow, PyTorch, or similar). Experience in Cloud Native Technologies (Docker, Kubernetes, specifically EKS)
• Experience deploying and managing GPU workloads in Kubernetes environment. Hands-on experience with ML model serving frameworks (TorchServe, TensorFlow Serving, Triton Inference Server, or similar).
• Experience optimizing deep learning models for production inference (model quantization, batching, caching strategies). Experience in partnering with product and program management teams. Strong proficiency with Java, Python, Scala, or C++
• Experience in building scalable, low-latency systems based on web services and APIs. Expertise in application, data, and infrastructure architecture disciplines. Experience with modern microservices architecture
• Experience with Cassandra or equivalent NoSQL databases for high-throughput data access. Understanding of GPU resource management, scheduling, and cost optimization. Ability to lead the design of large-scale systems and to reason about the challenges and tradeoffs
• Demonstrated experience leading effective use of enterprise-authorized AI-assisted software development tools within the work environment (e.g., for coding, code review, test acceleration, troubleshooting) with the ability to set team expectations for validating AI outputs for correctness, performance, and security
• Strong understanding of responsible AI use in engineering workflows, including data sensitivity considerations, secure handling of inputs/outputs, and adherence to resiliency and security expectations; experience coaching senior engineers/leads on compliant usage patterns and controls.
• Experience with graph neural networks (GNNs) and graph processing frameworks (DGL, PyTorch Geometric, NetworkX). Experience serving large-scale models (billions of parameters) with optimization techniques

Preferred qualifications, capabilities, and skills

Experience with one or more public clouds (AWS, GCP), with strong AWS knowledge preferred

• Financial services experience is a plus
• Understanding of payments systems, fraud detection, or financial modeling is highly desirable
• Experience handling PII data and building secure ML systems

About Us

JPMorganChase, one of the oldest financial institutions, offers innovative financial solutions to millions of consumers, small businesses and many of the world’s most prominent corporate, institutional and government clients under the J.P. Morgan and Chase brands. Our history spans over 200 years and today we are an leader in investment banking, consumer and small business banking, commercial banking, financial transaction processing and asset management.

We recognize that our people are our strength and the diverse talents they bring to our global workforce are directly linked to our success. We are an equal opportunity employer and place a high value on diversity and inclusion at our company. We do not discriminate on the basis of any protected attribute, including race, religion, color, national origin, gender, sexual orientation, gender identity, gender expression, age, marital or veteran status, pregnancy or disability, or any other basis protected under applicable law. We also make reasonable accommodations for applicants’ and employees’ religious practices and beliefs, as well as mental health or physical disability needs. Visit our FAQs for more information about requesting an accommodation.

About the Team

J.P. Morgan’s Commercial & Investment Bank is a global leader across banking, markets, securities services and payments. Corporations, governments and institutions throughout the world entrust us with their business in more than 100 countries. The Commercial & Investment Bank provides strategic advice, raises capital, manages risk and extends liquidity in markets around the world.