Lead Software Engineer (AI Platform) - Vice President

J.P. Morgan; New York (NY); On-site; USD 180,000 - 260,000; Full time

Benefits offered by this job

Healthcare coverage

Retirement plan

Tuition reimbursement

Mental health support

Job summary

JPMorgan Chase & Co. in New York seeks an AI Platform Engineer (Vice President) to own the architecture and operation of the AI research platform. You will design secure cloud and GPU infrastructure, build self-service environments, and collaborate with researchers to turn requirements into robust platform capabilities.

The role emphasizes automation, IaC, and scalable, reproducible experiment environments, with a focus on risk, control, and enterprise-grade delivery.

Qualifications

• Master's degree in a technical field with at least 4 years in cloud/platform/infrastructure
• Hands-on experience operating production-grade environments (EC2, networking, storage, monitoring)
• Strong knowledge of Linux, containers, networking, storage, and orchestration
• Experience with infrastructure-as-code and automation (Terraform, CloudFormation, CI/CD)

Responsibilities

• Own architecture and roadmap for AI research platform and daily engineering
• Design and operate secure, scalable cloud and CPU/GPU infrastructure
• Build self-service environments and platform automation with container images and IaC
• Translate research requirements into platform capabilities and interfaces
• Assess and onboard new AI infra tech, cloud services, accelerators, and tools
• Maintain reliable platforms with observability, runbooks, and risk controls

Skills

AI platform

Cloud infra

Python

Shell scripting

Terraform

CI/CD

Kubernetes

GPU compute

Education

Master's degree in CS/EE/CE or related field

Tools

Terraform

CloudFormation

Kubernetes

Slurm

Ray

Jupyter

Docker

CI/CD tooling

Job description

Are you looking for an exciting opportunity to join a dynamic and growing team in a fast-paced and challenging area? This is a unique opportunity for you to work with the Global Technology Applied Research (GTAR) center at JPMorgan Chase & Co. The goal of GTAR is to design and conduct research across multiple frontier technologies, in order to enable novel discoveries and inventions, and to inform and develop next-generation solutions for the firm's clients and businesses.

As an AI Platform Engineer - Vice President at JPMorgan Chase within the Global Technology Applied Research (GTAR) center, you will engineer, operate, and evolve the shared platforms that enable GTAR researchers to develop, evaluate, and mature AI solutions in secure, scalable, firm-approved environments. You will own the cloud and compute foundation for AI research workloads, build reusable platform services and automation, and partner with researchers and enterprise technology teams to make experimentation reproducible, reliable, well-controlled, and ready for downstream integration.

Job responsibilities

• Own the architecture, technical roadmap, and day-to-day engineering of the team’s AI research platform.
• Design and operate secure, scalable cloud and CPU/GPU infrastructure, including clusters, workload scheduling, storage, networking, capacity planning, performance, and cost.
• Build reproducible, self-service research environments and platform automation using standardized container images, GPU software stacks, dependency and artifact management, infrastructure-as-code, CI/CD, and orchestration.
• Partner with researchers to translate requirements from LLM, agentic AI, model evaluation, retrieval, inference, and accelerator benchmarking projects into dependable platform capabilities, and prepare research prototypes for downstream integration through packaging, service interfaces, and operational-readiness reviews.
• Assess and onboard new AI infrastructure technologies, cloud services, accelerators, and developer tooling through practical benchmarks, architecture reviews, and controlled pilots.
• Maintain reliable, well-controlled platforms through observability, incident response, patching and lifecycle management, access and data controls, risk and control evidence, operational documentation, and runbooks.

Required qualifications, capabilities, and skills

• Master's degree in computer science, software engineering, computer engineering, information systems, or a related technical field, plus at least 4 years of relevant industry experience building or operating cloud, platform, or infrastructure systems.
• Hands-on experience operating production-grade environments, including EC2, networking, storage, monitoring, and cost management.
• Strong knowledge of Linux systems, containers, networking, storage, and distributed systems, with experience in orchestration or workload-scheduling technologies.
• Experience with infrastructure-as-code and delivery automation using tools such as Terraform or CloudFormation, configuration management, and CI/CD pipelines.
• Proficiency in Python and shell scripting, with sound software engineering practices for building maintainable automation, services, and platform integrations.
• Working knowledge of AI/ML development workflows and demonstrated ability to translate research requirements into platform designs, communicate technical trade-offs, manage delivery dependencies, and drive risk and control items to closure.
• Experience in one or more of the following domains: cloud and accelerated compute platforms (e.g., AWS, CPU/GPU infrastructure, autoscaling, workload scheduling, resource quotas, capacity planning); research environments and developer platforms (e.g., containers, Jupyter, package and dependency management, artifact repositories, experiment tracking, self-service tooling); AI workload enablement (e.g., LLM inference and evaluation, agentic workflows, retrieval pipelines, model-serving infrastructure, distributed processing); reliability and operations (e.g., observability, service-level objectives, incident response, resilience, backup and recovery, operational readiness).

Preferred qualifications, capabilities, and skills

• Experience supporting AI/ML research or development teams and operating platforms for GPU-intensive, LLM, agentic, or other distributed AI workloads.
• Experience with Kubernetes or managed container platforms, GPU software stacks, cluster schedulers or distributed-compute frameworks such as Slurm or Ray, observability platforms, and cloud cost optimization.
• Experience delivering infrastructure in a regulated enterprise and working with cybersecurity, architecture, technology risk, and audit stakeholders.
• Familiarity with finance or financial use cases.

We offer a competitive total rewards package including base salary determined based on the role, experience, skill set and location. Those in eligible roles may receive commission-based pay and/or discretionary incentive compensation, paid in the form of cash and/or forfeitable equity, awarded in recognition of individual achievements and contributions. We also offer a range of benefits and programs to meet employee needs, based on eligibility. These benefits include comprehensive health care coverage, on-site health and wellness centers, a retirement savings plan, backup childcare, tuition reimbursement, mental health support, financial coaching and more. Additional details about total compensation and benefits will be provided during the hiring process.

We recognize that our people are our strength and the diverse talents they bring to our global workforce are directly linked to our success. We are an equal opportunity employer and place a high value on diversity and inclusion at our company. We do not discriminate on the basis of any protected attribute, including race, religion, color, national origin, gender, sexual orientation, gender identity, gender expression, age, marital or veteran status, pregnancy or disability, or any other basis protected under applicable law. We also make reasonable accommodations for applicants’ and employees’ religious practices and beliefs, as well as mental health or physical disability needs. Visit our FAQs for more information about requesting an accommodation.

JPMorgan Chase & Co. is an Equal Opportunity Employer, including Disability/Veterans

Our professionals in our Corporate Functions cover a diverse range of areas from finance and risk to human resources and marketing. Our corporate teams are an essential part of our company, ensuring that we’re setting our businesses, clients, customers and employees up for success. Build and run secure AI research platforms with scalable cloud and GPU compute to accelerate experimentation.