Senior AI Platform Lead: Gen AI, Guardrails & Evaluation

Capital One; New York (NY); On-site; USD 251,000 - 286,000; Full time

Job summary

Capital One seeks a Sr. Manager, AI Engineer to lead AI platform services, agentic AI, guardrails, and evaluation for scalable production systems in New York and other hubs.

You will guide cross‑functional teams and drive responsible AI governance while optimizing performance and cost across foundational AI stacks. The role demands deep technical acumen in ML, MLOps, and large‑scale systems, with a track record in leading engineering teams and delivering production AI deployments.

Qualifications

• Bachelor's degree in Computer Science, AI, Electrical Engineering, Computer Engineering, or related fields plus at least 6 years of experience developing AI and ML algorithms or technologies, or a Master's degree in Computer Science, AI, Electrical Engineering, Computer Engineering, or related fields plus at least 4 years of experience developing AI and ML algorithms or technologies
• At least 1 year of people leadership experience

Responsibilities

• Partner with a cross-functional team of engineers, research scientists, technical program managers, and product managers to deliver AI-powered products that change how our associates work and how our customers interact with Capital One
• Oversee the design, development, testing, deployment, and support AI software components including foundation model training, large language model inference, similarity search, guardrails, model evaluation, experimentation, governance, and observability, etc.
• Make high judgment build‑vs‑buy decisions across a broad stack of Open Source and SaaS AI technologies such as AWS Ultraclusters, Huggingface, VectorDBs, PyTorch, and more
• Invent and introduce state‑of‑the‑art foundation model optimization techniques to improve the performance — scalability, cost, latency, throughput — of large scale production AI systems
• Contribute to the technical vision and the long term roadmap of foundational AI systems at Capital One
• Attract and retain top talent in the AI industry and nurture personal and professional development for your team. Foster a culture of learning and staying abreast of the state‑of‑the‑art in AI
• Translate enterprise AI goals into actionable team roadmaps with measurable outcomes and regular readouts
• Operationalize Responsible AI: establish review gates, documentation/evaluation requirements, and rollout/rollback standards for all production AI systems
• Create strong collaboration interfaces with Research, Data, and Platform teams to accelerate model lifecycle

Skills

Python

C++

C#

Java

CUDA

Golang

LLM Inference

Similarity Search

VectorDBs

Guardrails

Memory

Education

Bachelor's degree in CS/AI/EE/CE or related, +6 years exp OR Master's degree +4 years exp

Tools

AWS

Google Cloud

Azure

PyTorch

Open Source / SaaS AI tools

Job description

Capital One seeks a Sr. Manager, AI Engineer to lead AI platform services, agentic AI, guardrails, and evaluation for scalable production systems in New York and other hubs.

You will guide cross‑functional teams and drive responsible AI governance while optimizing performance and cost across foundational AI stacks. The role demands deep technical acumen in ML, MLOps, and large‑scale systems, with a track record in leading engineering teams and delivering production AI deployments.