Lead Software Engineer, AI Platform - VP

JPMorgan Chase & Co.; New York (NY); On-site; USD 61,000 - 101,000; Full time

Benefits offered by this job

Health care coverage

On-site wellness centers

Retirement savings

Tuition reimbursement

Mental health support

Financial coaching

Job summary

JPMorgan Chase & Co. in New York seeks an AI Platform Engineer—Vice President to own the architecture and day-to-day engineering of our AI research platform.

You will design secure, scalable cloud infrastructure for CPU/GPU workloads and build reproducible research environments using container images, IaC, CI/CD, and orchestration. Collaborating with researchers, you will translate LLM and AI workflow requirements into dependable platform capabilities, manage risk and controls, and help advance

Qualifications

• Master's degree in computer science, software engineering, computer engineering, information systems, or related field; 4+ years in industry.
• Hands-on experience operating production environments (EC2, networking, storage, monitoring, cost management).
• Strong knowledge of Linux, containers, networking, storage, and distributed systems; experience with orchestration/workload scheduling.
• Experience with infrastructure-as-code and delivery automation (Terraform/CloudFormation).
• Proficiency in Python and shell scripting; solid automation practices.

Responsibilities

• Own architecture, technical roadmap, and day-to-day engineering of the AI research platform.
• Design and operate secure, scalable cloud/CPU/GPU infrastructure (clusters, scheduling, storage, networking, cost).
• Create reproducible, self‑service research environments and platform automation via container images, tooling, IaC, CI/CD, and orchestration.
• Collaborate with researchers to translate requirements into platform capabilities for LLM/agentic AI workloads.

Skills

Linux

Containers

Kubernetes

Python

Shell scripting

AI/ML workflows

Cloud platforms

ETL/CI‑CD

Education

Master's degree in CS/related field

Tools

Terraform

CloudFormation

EC2

CI/CD pipelines

Job description

Salary: $61,000 - 101,000 per year

Requirements:

• Masters degree in computer science, software engineering, computer engineering, information systems, or a related technical field, plus at least four years of relevant industry experience building or operating cloud, platform, or infrastructure systems.
• Hands‑on experience operating production‑grade environments, including EC2, networking, storage, monitoring, and cost management.
• Strong knowledge of Linux systems, containers, networking, storage, and distributed systems, with experience in orchestration or workload‑scheduling technologies.
• Experience with infrastructure-as-code and delivery automation, such as Terraform or CloudFormation, configuration management, and CI/CD pipelines.
• Proficiency in Python and shell scripting, along with sound software engineering practices for maintainable automation, services, and platform integrations.
• Working knowledge of AI/ML development workflows and the ability to translate research needs into platform designs, explain technical trade‑offs, manage delivery dependencies, and resolve risk and control items.
• Experience in at least one of these areas: cloud and accelerated compute platforms; research environments and developer platforms; AI workload enablement; or reliability and operations.
• Preferred: Experience supporting AI/ML research or development teams and operating platforms for GPU‑intensive, LLM, agentic, or other distributed AI workloads.
• Preferred: Experience with Kubernetes or managed container platforms, GPU software stacks, cluster schedulers or distributed‑compute frameworks such as Slurm or Ray, observability platforms, and cloud cost optimization.
• Preferred: Experience delivering infrastructure in a regulated enterprise and working with cybersecurity, architecture, technology risk, and audit stakeholders.
• Preferred: Familiarity with finance or financial use cases.

Responsibilities:

• Own the architecture, technical roadmap, and day‑to‑day engineering of our AI research platform.
• Design and operate secure, scalable cloud and CPU/GPU infrastructure, including clusters, workload scheduling, storage, networking, capacity planning, performance, and cost management.
• Create reproducible, self‑service research environments and platform automation using standardized container images, GPU software stacks, dependency and artifact management, infrastructure-as-code, CI/CD, and orchestration.
• Work with researchers to turn requirements from LLM, agentic AI, model evaluation, retrieval, inference, and accelerator benchmarking projects into dependable platform capabilities.
• Prepare research prototypes for downstream integration through packaging, service interfaces, and operational‑readiness reviews.
• Evaluate and onboard AI infrastructure technologies, cloud services, accelerators, and developer tools through practical benchmarks, architecture reviews, and controlled pilots.
• Maintain platform reliability and controls through observability, incident response, patching and lifecycle management, access and data controls, risk and control evidence, operational documentation, and runbooks.

Technologies:

• Agentic AI
• AI
• CI/CD
• Cloud
• EC2
• Support
• Kubernetes
• LLM
• Linux
• Marketing
• Python
• Terraform
• AWS
• Jupyter

More:

We are hiring an AI Platform Engineer – Vice President for our Global Technology Applied Research (GTAR) center at JPMorgan Chase. GTAR researches frontier technologies to enable new discoveries and inform next‑generation solutions for our clients and businesses. In this role, you will help provide secure, scalable, firm‑approved environments for AI research and support reproducible experimentation and downstream integration. We are one of the worlds longstanding financial institutions, serving consumers, small businesses, and corporate, institutional, and government clients across investment banking, consumer and commercial banking, financial transaction processing, and asset management. Our Corporate Functions teams span areas including finance, risk, human resources, and marketing, and help equip our businesses, clients, customers, and employees for success. We offer competitive total rewards, with compensation based on role, experience, skills, and location, and eligible employees may receive incentives. Benefits, subject to eligibility, include health care coverage, on‑site wellness centers, retirement savings, backup childcare, tuition reimbursement, mental health support, and financial coaching. We value diversity and inclusion and provide reasonable accommodations for applicants and employees.

last updated 40 week of 2026