Sr Lead Software Engineer - AWS AI/ML Platform

JPMorgan Chase & Co.; Jersey City (NJ); On-site; USD 61,000 - 101,000; Full time

Benefits offered by this job

Health insurance

Retirement plan

Tuition reimbursement

Mental health support

On-site wellness centers

Financial coaching

Job summary

JPMorgan Chase & Co. in New Jersey seeks a Senior Lead Software Engineer to drive platform architecture, control plane integration, multi-region deployment, and API design for retraining, scheduling, endpoint deployment, and autoscaling.

The role requires formal training in software engineering, 5+ years of applied experience, deep AWS/cloud expertise, Kubernetes (EKS), Terraform, and Golang, plus a track record of building production services and secure AI-assisted workflows.

Qualifications

• Formal training or certification in software engineering concepts.
• 5+ years of applied software engineering experience.
• Strong experience architecting software solutions at scale.
• Excellent client-facing communication and collaboration across time zones.
• Deep knowledge of AWS and cloud infrastructure.
• Proven track record building production-ready platform services.
• Experience leading AI-assisted development tools usage.
• Understanding responsible AI usage in engineering workflows.
• Experience coaching senior engineers on compliant AI usage.
• Comfort with ambiguity and greenfield architecture.

Responsibilities

• Drive architectural vision for platform components and multi-region deployment.
• Design and implement APIs for retraining, scheduling, endpoints, and autoscaling.
• Build infrastructure enabling cross-account and client account integration.
• Collaborate with US-based clients on requirements and debugging.
• Make independent architectural decisions with minimal oversight.
• Provide technical guidance to business, technical teams, contractors, and vendors.
• Influence product design, functionality, and operations.
• Promote AI-assisted engineering governance and code quality standards.
• Establish security and testing standards across SDLC and tooling.

Skills

Architecting at scale

Self-directed

Client-facing communication

Distributed teamwork

AWS/cloud infrastructure

AI-assisted development tools

Responsible AI practices

Lead engineers coaching

Ability to design greenfield

Kubernetes / EKS experience

AWS SageMaker

Golang

Networking - VPCs, DNS

LLM deployment / integration

Terraform

Education

Formal training or certification in software engineering concepts

Tools

Kubernetes

EKS

AWS SageMaker

Golang

Terraform

LLM deployment tools

Job description

Salary: $61,000 - 101,000 per year

Requirements

• We are looking for someone with formal training or certification in software engineering concepts and at least 5 years of applied experience.
• We need strong experience architecting software solutions at scale that other teams rely on.
• We value a self-directed, autonomous approach with the ability to drive outcomes independently.
• We need excellent client-facing communication skills and the ability to collaborate effectively across time zones in a distributed team.
• We require deep knowledge of AWS and cloud-based infrastructure.
• We look for a proven track record of building resilient, production-ready platform services.
• We need demonstrated experience leading the use of enterprise-approved AI-assisted software development tools in the workplace, including coding, code review, test acceleration, and troubleshooting.
• We expect a strong understanding of responsible AI use in engineering workflows, including data sensitivity, secure handling of inputs and outputs, and resiliency and security considerations.
• We value experience coaching senior engineers and leads on compliant AI usage patterns and controls.
• Preferred: comfort working through ambiguity and designing greenfield architecture without an existing playbook.
• Preferred: production experience with Kubernetes or EKS at scale.
• Preferred: hands-on experience with AWS Sagemaker for model training and deployment.
• Preferred: strong Golang skills in infrastructure or platform services.
• Preferred: deep understanding of networking, including VPCs, DNS, and cross-account connectivity.
• Preferred: practical experience with LLM deployment, inference, or integration.
• Preferred: a track record of delivering Terraform across multi-account, multi-region environments.

Responsibilities

• We drive the architectural vision for platform components, including control plane integration, multi-region deployment, and disaster recovery.
• We design and implement APIs for retraining, scheduling, endpoint deployment, and autoscaling.
• We build infrastructure that enables smooth integration across the control plane and client accounts.
• We work directly with US-based clients on requirements, strategic solutioning, and debugging.
• We make independent architectural decisions and own technical tradeoffs with minimal oversight.
• We provide technical guidance and direction to business teams, technical teams, contractors, and vendors.
• We influence product design, application functionality, and technical operations and processes.
• We drive the adoption and governance of approved AI-assisted engineering practices across teams to improve code quality, delivery speed, and operational outcomes.
• We establish measurable validation standards such as secure coding, peer review, automated testing, and release readiness checks.
• We promote reuse of proven patterns and automation within the SDLC and TLM toolchain.
• We apply knowledge of software development lifecycle tools, including approved AI-assisted development and automation capabilities, to increase the value realized by automation at scale.

Technologies

• AI
• AWS
• Cloud
• Golang
• Support
• Kubernetes
• LLM
• Marketing
• Model Training
• Security
• Terraform
• Architect

More

We are a globally distributed team within JPMorganChase, spanning Glasgow, London, New Jersey, and India, and we are building the infrastructure that enables model deployment at scale. This Senior Lead Software Engineer role offers significant autonomy, direct collaboration with US-based clients, and the opportunity to shape production systems that other engineers build upon. We provide a competitive total rewards package, including base salary determined by role, experience, skill set, and location, with potential commission-based pay or discretionary incentive compensation for eligible roles. Our benefits may include comprehensive health care coverage, on-site health and wellness centers, a retirement savings plan, backup childcare, tuition reimbursement, mental health support, financial coaching, and more. We are committed to diversity, inclusion, and equal opportunity, and our Corporate Functions team supports the business across areas such as finance, risk, human resources, and marketing.

last updated 40 week of 2026