Senior AI Platform Lead – Gen AI, Guardrails & Observability

Capital One; Cambridge (MA); On-site; USD 230,000 - 262,000; Full time

Job summary

Capital One is seeking a Sr. Manager, AI Engineer to lead the design, deployment, and optimization of large-scale AI systems in Cambridge, MA.

You will guide cross‑functional teams across engineering, research, data, and product management to deliver responsible AI-powered products that improve how associates work and how customers interact with Capital One. You will mentor engineers, drive model training and evaluation, and shape the technical vision and long-term roadmap for foundational AI

Qualifications

• Bachelor's degree in Computer Science, AI, Electrical Engineering, Computer Engineering, or related fields plus at least 6 years of experience developing AI and ML algorithms or technologies
• Master's degree in Computer Science, AI, Electrical Engineering, Computer Engineering, or related fields plus at least 4 years of experience developing AI and ML algorithms or technologies
• At least 1 year of people leadership experience

Responsibilities

• Partner with a cross‑functional team of engineers, research scientists, technical program managers, and product managers to deliver AI‑powered products that change how our associates work and how our customers interact with Capital One
• Oversee the design, development, testing, deployment, and support AI software components including foundation model training, large language model inference, similarity search, guardrails, model evaluation, experimentation, governance, and observability, etc.
• Make high judgment build‑vs‑buy decisions across a broad stack of Open Source and SaaS AI technologies such as AWS Ultraclusters, Huggingface, VectorDBs, PyTorch, and more
• Invent and introduce state‑of‑the‑art foundation model optimization techniques to improve the performance — scalability, cost, latency, throughput — of large scale production AI systems
• Contribute to the technical vision and the long term roadmap of foundational AI systems at Capital One
• Attract and retain top talent in the AI industry and nurture personal and professional development for your team. Foster a culture of learning and staying abreast of the state‑of‑the‑art in AI
• Translate enterprise AI goals into actionable team roadmaps with measurable outcomes and regular readouts
• Operationalize Responsible AI: establish review gates, documentation/evaluation requirements, and rollout/rollback standards for all production AI systems
• Create strong collaboration interfaces with Research, Data, and Platform teams to accelerate model lifecycle

Skills

AI System Design

People Leadership

Python

C++

Java

ML Algorithms

LLM Inference

VectorDBs

Guardrails

MLOps

Education

Bachelor's degree in Computer Science, AI, Electrical Engineering, Computer Engineering, or related fields

Tools

AWS Ultraclusters

Hugging Face

VectorDBs

PyTorch

Job description

Capital One is seeking a Sr. Manager, AI Engineer to lead the design, deployment, and optimization of large-scale AI systems in Cambridge, MA.

You will guide cross‑functional teams across engineering, research, data, and product management to deliver responsible AI-powered products that improve how associates work and how customers interact with Capital One. You will mentor engineers, drive model training and evaluation, and shape the technical vision and long-term roadmap for foundational AI