Senior Lead Software Engineer - Java, AWS & AI Platform Services

Aumni; Palo Alto (CA); On-site; USD 180,000 - 230,000; Full time

Job summary

JPMorganChase is seeking a Lead Software Engineer to design and deliver secure, scalable ML platforms. You will develop production-grade Python services, architect high-throughput distributed systems on AWS, and build cloud-native apps with EKS, ECS, Kafka, S3, and SQS.

You’ll drive API design, infrastructure-as-code, observability, and secure engineering practices while mentoring engineers. The role emphasizes collaboration with AI/ML teams, product managers, and SREs to achieve reliable,

Qualifications

• Formal training or certification on software engineering concepts and 5+ years applied experience.
• Advanced proficiency in Python programming, object-oriented design, and modular software architecture.
• Experience building and operating large-scale, high-performance cloud-native services within AWS environments.
• Hands-on experience with AWS technologies including EKS, ECS, MSK (Kafka), SQS, and S3.
• Strong experience implementing infrastructure-as-code solutions using Terraform and/or CloudFormation.
• Expertise in designing, deploying, and supporting distributed systems in production environments.
• Experience with observability, monitoring, logging, and alerting platforms such as Datadog, Dynatrace, and Splunk.
• Strong understanding of API design, microservices architecture, and scalable system design patterns.
• Experience implementing automated testing, CI/CD pipelines, deployment automation, and secure software engineering practices.
• Demonstrated experience utilizing approved AI-assisted software development tools for coding, code review, testing acceleration, troubleshooting, and operational support.
• Strong understanding of responsible AI usage, application security, resiliency requirements, compliance standards, and mentoring engineers on engineering best practices.

Responsibilities

• Design, develop, and maintain production-grade Python services and APIs that power high-impact machine learning platforms at enterprise scale
• Architect and implement high-throughput, low-latency distributed systems within AWS environments to support critical business workloads
• Build and manage scalable cloud-native applications leveraging AWS technologies including EKS, ECS, MSK, SQS, and S3
• Develop reusable service frameworks, shared libraries, and modular application components that accelerate engineering delivery across teams
• Design and implement infrastructure-as-code solutions using Terraform and CloudFormation to enable repeatable, auditable, and scalable deployments
• Create and maintain monitoring, alerting, and observability solutions utilizing platforms such as Datadog, Dynatrace, and Splunk to ensure operational excellence
• Deploy and support applications in production environments while ensuring adherence to service-level objectives and service-level agreements
• Implement secure-by-design engineering practices, automated testing, and deployment strategies including blue/green and canary releases
• Review code, provide architectural guidance, and mentor engineers on software engineering best practices to elevate team capability
• Collaborate with product managers, platform engineering teams, and site reliability engineers to deliver scalable, business-aligned solutions
• Drive adoption of enterprise-approved AI-assisted engineering practices to improve code quality, operational excellence, troubleshooting, and delivery efficiency

Skills

Python

AWS

Distributed systems

API design

CI/CD

Tools

Docker

Kubernetes

Terraform

CloudFormation

Datadog

S3

Job description

Join JPMorganChase's Machine Learning Center of Excellence — where cutting-edge engineering meets real-world impact at global scale.

As a Lead Software Engineer at JPMorganChase within the Corporate Sector – Artificial Intelligence and Machine Learning Data Platforms and Machine Learning Center of Excellence team, you serve as a seasoned member of an agile team to design and deliver trusted, market-leading technology products in a secure, stable, and scalable way. You are responsible for carrying out critical technology solutions across multiple technical areas within various business functions in support of the firm's business objectives. You will collaborate with a multi-disciplinary community of experts focused exclusively on machine learning, working with cutting-edge techniques in disciplines such as deep learning and reinforcement learning.

Job responsibilities

• Design, develop, and maintain production-grade Python services and APIs that power high-impact machine learning platforms at enterprise scale
• Architect and implement high-throughput, low-latency distributed systems within Amazon Web Services (AWS) environments to support critical business workloads
• Build and manage scalable cloud-native applications leveraging AWS technologies including Elastic Kubernetes Service (EKS), Elastic Container Service (ECS), Managed Streaming for Apache Kafka (MSK), Simple Queue Service (SQS), and S3
• Develop reusable service frameworks, shared libraries, and modular application components that accelerate engineering delivery across teams
• Design and implement infrastructure-as-code solutions using Terraform and CloudFormation to enable repeatable, auditable, and scalable deployments
• Create and maintain monitoring, alerting, and observability solutions utilizing platforms such as Datadog, Dynatrace, and Splunk to ensure operational excellence
• Deploy and support applications in production environments while ensuring adherence to service-level objectives and service-level agreements
• Implement secure-by-design engineering practices, automated testing, and deployment strategies including blue/green and canary releases
• Review code, provide architectural guidance, and mentor engineers on software engineering best practices to elevate team capability
• Collaborate with product managers, platform engineering teams, and site reliability engineers to deliver scalable, business-aligned solutions
• Drive adoption of enterprise-approved AI-assisted engineering practices to improve code quality, operational excellence, troubleshooting, and delivery efficiency

Required qualifications, capabilities, and skills

• Formal training or certification on software engineering concepts and 5+ years applied experience
• Advanced proficiency in Python programming, object-oriented design, and modular software architecture
• Experience building and operating large-scale, high-performance cloud-native services within AWS environments
• Hands-on experience with AWS technologies including EKS, ECS, MSK (Kafka), SQS, and S3
• Strong experience implementing infrastructure-as-code solutions using Terraform and/or CloudFormation
• Expertise in designing, deploying, and supporting distributed systems in production environments
• Experience with observability, monitoring, logging, and alerting platforms such as Datadog, Dynatrace, and Splunk
• Strong understanding of API design, microservices architecture, and scalable system design patterns
• Experience implementing automated testing, CI/CD pipelines, deployment automation, and secure software engineering practices
• Demonstrated experience utilizing approved AI-assisted software development tools for coding, code review, testing acceleration, troubleshooting, and operational support
• Strong understanding of responsible AI usage, application security, resiliency requirements, compliance standards, and mentoring engineers on engineering best practices

Preferred qualifications, capabilities, and skills

• Strong knowledge of distributed systems reliability patterns, including resiliency engineering, self-healing architectures, backpressure management, and idempotency
• Experience optimizing real-time and event-driven architectures at scale, particularly with Kafka-based messaging systems
• Experience implementing end-to-end observability, automated operational runbooks, and proactive monitoring frameworks
• Familiarity with CI/CD best practices, canary deployments, blue/green deployment strategies, and release automation within cloud environments
• Familiarity with Generative AI and Large Language Model technologies and experience building engineering solutions that leverage AI/LLM platforms

JPMorganChase, one of the oldest financial institutions, offers innovative financial solutions to millions of consumers, small businesses and many of the world’s most prominent corporate, institutional and government clients under the J.P. Morgan and Chase brands. Our history spans over 200 years and today we are a leader in investment banking, consumer and small business banking, commercial banking, financial transaction processing and asset management.

We offer a competitive total rewards package including base salary determined based on the role, experience, skill set and location. Those in eligible roles may receive commission-based pay and/or discretionary incentive compensation, paid in the form of cash and/or forfeitable equity, awarded in recognition of individual achievements and contributions. We also offer a range of benefits and programs to meet employee needs, based on eligibility. These benefits include comprehensive health care coverage, on-site health and wellness centers, a retirement savings plan, backup childcare, tuition reimbursement, mental health support, financial coaching and more. Additional details about total compensation and benefits will be provided during the hiring process.

We recognize that our people are our strength and the diverse talents they bring to our global workforce are directly linked to our success. We are an equal opportunity employer and place a high value on diversity and inclusion at our company. We do not discriminate on the basis of any protected attribute, including race, religion, color, national origin, gender, sexual orientation, gender identity, gender expression, age, marital or veteran status, pregnancy or disability, or any other basis protected under applicable law. We also make reasonable accommodations for applicants’ and employees’ religious practices and beliefs, as well as mental health or physical disability needs. Visit our FAQs for more information about requesting an accommodation.

JPMorgan Chase & Co. is an Equal Opportunity Employer, including Disability/Veterans

Our professionals in our Corporate Functions cover a diverse range of areas from finance and risk to human resources and marketing. Our corporate teams are an essential part of our company, ensuring that we’re setting our businesses, clients, customers and employees up for success. Drive AI/ML innovation by building scalable, cloud-native solutions that power the firm's most critical machine learning capabilities.