Senior Generative AI Engineer - Production Systems

Testing Site - JPMC; New York (NY); On-site; USD 180,000 - 260,000; Full time

Job summary

Testing Site - JPMC in New York seeks a Senior Associate, Generative AI Engineer to design, build, and support production generative AI products and reusable backend APIs across the firm. You will combine enterprise data with large language and multimodal models to deliver scalable, measurable solutions.

You will collaborate with machine learning, cloud engineering, and site reliability engineering teams to ensure reliability, performance, and governance while contributing to system design and

Qualifications

• PhD or equivalent in a quantitative field required.
• 3+ years as an individual contributor in ML engineering or applied ML software.
• Experience delivering production ML services in an enterprise environment.
• Strong fundamentals in statistics, optimization and ML theory with NLP/vision depth.
• Hands-on experience building distributed, multi-threaded, scalable systems (Ray, Horovod, DeepSpeed).
• Strong software engineering fundamentals and API design for scalable services.
• Ability to define success metrics and align ML solutions to business needs.

Responsibilities

• Build and operate production generative AI services and reusable backend APIs for firmwide use.
• Combine enterprise data with large language and multimodal models for high-quality experiences.
• Design scalable architectures with clear interfaces and separation of concerns.
• Implement batch and real-time processing for high-throughput, low-latency use cases.
• Collaborate with cloud engineering and SRE teams for resilient systems.
• Translate research concepts into production-ready software through experimentation and hardening.
• Optimize system performance, scalability, and cost across inference, storage, and compute.
• Define and track measurable outcomes aligned to business needs.
• Ensure responsible AI practices, governance, and controls are embedded.
• Troubleshoot production issues and drive root-cause analysis.

Skills

Distributed systems

Production ML

NLP/Computer Vision

Python

ML model deployment

Communication skills

Problem framing

Education

PhD in CS/Math/Stats or equivalent

Tools

Ray

Horovod

DeepSpeed

Kubeflow

DVC

gRPC

GraphQL

Job description

Testing Site - JPMC in New York seeks a Senior Associate, Generative AI Engineer to design, build, and support production generative AI products and reusable backend APIs across the firm. You will combine enterprise data with large language and multimodal models to deliver scalable, measurable solutions.

You will collaborate with machine learning, cloud engineering, and site reliability engineering teams to ensure reliability, performance, and governance while contributing to system design and