Lead Software Engineer-AI Foundation Services

JPMorgan Chase & Co.; Plano (TX); On-site; USD 140,000 - 220,000; Full time

Job summary

JPMorganChase is seeking a Lead Software Engineer within the AIML Data Platforms team to build AI foundation services for GenAI and ML at enterprise scale. You will lead hands-on delivery of secure, cloud-native platform capabilities (Kubernetes/CI/CD/IaC) and collaborate with application teams for reusable integrations and onboarding assets.

As a Lead Software Engineer, you will drive technical excellence across design, development, testing, and deployment, shaping scalable and secure

Qualifications

• 5+ years of hands-on software engineering experience building platform services.

Responsibilities

• Partner with Lines of Business teams to implement AI foundation services for GenAI/AI use cases.
• Build reusable platform services, APIs, SDKs, and libraries for model hosting and AI/ML services.
• Translate requirements into technical designs and delivery milestones with senior engineers' support.
• Develop secure, high-quality production code and participate in reviews, testing, and remediation of defects.

Skills

Python/Java/Go

Tools

Terraform

Kubernetes

CI/CD

Job description

Join JPMorganChase’s Chief Data & Analytics (AIML Data Platforms) team in Jersey City as a Lead Software Engineer building AI foundation services for GenAI and ML at enterprise scale. You’ll lead hands‑on delivery of secure, reliable, cloud‑native platform capabilities (Kubernetes/CI/CD/IaC) and partner with application teams to create reusable integrations, reference implementations, and onboarding assets.

As a Lead Software Engineer at JPMorganChase within the AIML Data Platforms – Chief Data and Analytics team, you are an integral part of an agile team that works to enhance, build, and deliver trusted market‑leading technology products in a secure, stable, and scalable way. In this role you will get to drive significant business impact through your capabilities and contributions and apply your deep technical expertise and problem‑solving methodologies to tackle a diverse array of challenges that span multiple technologies and applications.

Job responsibilities

• Partners with Lines of Business application teams to implement AI Foundation Services capabilities that unblock GenAI/AI use cases, supporting delivery from technical design through build, launch, and early operational support
• Builds and enhances reusable platform services, APIs, SDKs, and libraries that standardize how application teams consume model hosting, inference, and AI/ML managed services
• Translates functional and non‑functional application requirements into clear technical designs, engineering tasks, and delivery milestones with support from senior engineers and architects
• Develops secure, stable, and high‑quality production code, and participates in code reviews, debugging, testing, and remediation of defects across AI Foundation Services components
• Creates and maintains reusable engineering assets such as reference implementations, runbooks, test harnesses, baseline configurations, and onboarding guides to accelerate adoption across teams
• Drives team adoption of enterprise‑authorized AI‑assisted engineering practices within the work environment to improve code quality, delivery speed, and operational outcomes (e.g., AI-assisted code review/refactoring, test strategy acceleration, incident/root‑cause analysis support), while establishing consistent validation standards (secure coding, peer review, automated testing) and promoting reuse of effective patterns across the team.
• Applies knowledge of tools within the Software Development Life Cycle toolchain, including enterprise‑authorized AI‑assisted development and automation capabilities, to improve the value realized by automation.
• Designs and implements scalable software components using appropriate software design patterns, cloud‑native practices, and platform engineering standards
• Collaborates with cross‑functional teams across product, architecture, security, infrastructure, and application development to resolve technical dependencies and deliver production‑ready capabilities
• Contributes to technical methods, standards, documentation, and implementation patterns within AI Foundation Services, helping improve consistency, reliability, and reuse across delivery teams
• Communicates technical progress, risks, dependencies, and implementation options to engineering managers, product partners, and senior technical stakeholders

Required qualifications, capabilities, and skills

• Formal training or certification on software engineering concepts and 5+ years applied experience
• Strong hands‑on coding experience in one or more languages used for platform services, such as Python, Java, or Go, with experience delivering production‑grade services or APIs
• Experience building shared services, reusable components, or platform capabilities consumed by multiple application or engineering teams
• Experience with infrastructure‑as‑code and cloud‑native delivery practices, including tools such as Terraform, containers, Kubernetes, CI/CD pipelines, and automated deployment workflows
• Demonstrated experience leading effective use of approved AI‑assisted software development tools (e.g., for coding, code review, test acceleration, troubleshooting) with the ability to set team expectations for validating AI outputs for correctness, performance, and security
• Strong understanding of responsible AI use in engineering workflows, including data sensitivity considerations, secure handling of inputs/outputs, and adherence to resiliency and security expectations; experience coaching engineers on safe, compliant adoption within delivery practices
• Hands‑on practical experience with system design, application development, automated testing, debugging, and operational stability for production software
• Experience implementing observability, logging, metrics, alerts, Service Level Objectives, incident response practices, and root‑cause analysis for services in production
• Working knowledge of software application development and technical processes, with depth in one or more areas such as cloud platforms, artificial intelligence, machine learning platforms, distributed systems, or infrastructure engineering
• Ability to break down technical requirements into executable engineering tasks, manage dependencies, and deliver against milestones in partnership with product and application teams
• Strong written and verbal communication skills, with the ability to explain technical decisions, trade‑offs, issues, and risks to engineering teams and stakeholders

Preferred qualifications, capabilities, and skills

• Experience supporting AI/ML or GenAI platform capabilities, including model hosting, inference services, model gateways, managed AI services, or developer‑facing AI/ML infrastructure
• Experience with GPU‑enabled platforms or AI workload optimization, including inference latency, throughput, batching, capacity planning, or cost/performance tuning
• Experience building reusable “golden path” assets such as templates, reference implementations, SDKs, automated tests, onboarding guides, and deployment patterns
• Familiarity with model serving patterns, rollout strategies, safety controls, authorization, rate limiting, policy enforcement, and evaluation hooks