Lead, Generative AI Platform Engineering

Testing Site - JPMC; New York (NY); On-site; USD 190,000 - 260,000; Full time

Job summary

Testing Site - JPMC seeks a Lead, Generative AI Engineering to drive production AI products and reusable APIs across the firm. You will guide design from experimentation to production hardening, ensuring reliability, scalability, performance, and responsible AI controls.

You will mentor engineers, set technical direction, and partner with cloud and SRE teams to deliver resilient, observable systems while aligning with governance and business goals.

Qualifications

• PhD or equivalent in CS, Math, or Stats.
• 7+ years in machine learning engineering or applied software delivering production systems.
• 3+ years of technical leadership leading cross-functional initiatives.
• Experience owning enterprise ML services, including reliability and incident management.
• Strong fundamentals in statistics, optimization and ML theory; NLP/vision experience.
• Hands-on with distributed, multi-threaded scalable systems (Ray, Horovod, DeepSpeed).
• Design and scale service-oriented architectures and APIs with high availability.
• Experience defining success metrics and OKRs aligned to business expectations.
• Ability to align technical decisions with governance, risk, and controls for responsible AI.
• Excellent communication and stakeholder management across senior audiences.

Responsibilities

• Lead the design and delivery of production generative AI products and APIs for firmwide adoption.
• Architect scalable systems combining large datasets with LLMs and multimodal models.
• Set direction for model-enabled services including quality, latency, and cost targets.
• Partner with cloud engineering and SRE teams for resilient architectures and observability.
• Translate research concepts into production capabilities through evaluation, iteration, and hardening.
• Establish standards for reliability, security, and responsible AI controls across lifecycles.
• Own delivery planning and execution with risk, dependencies, and stakeholder communications.
• Define objectives and key results tied to business outcomes and ROI.
• Mentor engineers through coaching and technical reviews.
• Troubleshoot production issues; perform root-cause analysis and preventative improvements.

Skills

Machine learning engineering

Technical leadership

Enterprise ML services

NLP/CV fundamentals

Distributed systems

APIs & service-oriented architectures

Governance & risk in AI

Communication & stakeholder mgmt

Production systems

Education

PhD in Computer Science/Mathematics/Statistics or equivalent

Tools

Ray

Horovod

DeepSpeed

Kubeflow

DVC

gRPC

GraphQL

Job description

Testing Site - JPMC seeks a Lead, Generative AI Engineering to drive production AI products and reusable APIs across the firm. You will guide design from experimentation to production hardening, ensuring reliability, scalability, performance, and responsible AI controls.

You will mentor engineers, set technical direction, and partner with cloud and SRE teams to deliver resilient, observable systems while aligning with governance and business goals.