Senior AI Engineering Leader, Foundation Models

Capital One National Association; San Jose (CA); On-site; USD 251,000 - 309,000; Full time

Job summary

Capital One is seeking a Sr. Manager, AI Engineer in San Jose, CA to lead and scale responsible AI systems across a broad technology stack.

You will guide foundation model training, LLM inference, and observability while driving a roadmap for enterprise AI platforms. You will collaborate with engineering, research, data, and product teams to deliver AI-powered products that enhance customer experiences and internal processes.

Qualifications

• Bachelor’s degree in Computer Science, AI, Electrical Engineering, Computer Engineering, or related fields plus at least 6 years of experience developing AI and ML algorithms or technologies.
• Master’s degree in Computer Science, AI, Electrical Engineering, Computer Engineering, or related fields plus at least 4 years of experience developing AI and ML algorithms or technologies.
• At least 1 year of people leadership experience.

Responsibilities

• Partner with a cross-functional team of engineers, research scientists, technical program managers, and product managers to deliver AI-powered products that change how our associates work and how our customers interact with Capital One.
• Oversee the design, development, testing, deployment, and support AI software components including foundation model training, large language model inference, similarity search, guardrails, model evaluation, experimentation, governance, and observability, etc.
• Make high judgment build‑vs‑buy decisions across a broad stack of Open Source and SaaS AI technologies such as AWS Ultraclusters, Huggingface, VectorDBs, PyTorch, and more
• Invent and introduce state‑of‑the‑art foundation model optimization techniques to improve the performance — scalability, cost, latency, throughput — of large scale production AI systems
• Contribute to the technical vision and the long term roadmap of foundational AI systems at Capital One
• Attract and retain top talent in the AI industry and nurture personal and professional development for your team. Foster a culture of learning and staying abreast of the state‑of‑the‑art in AI
• Translate enterprise AI goals into actionable team roadmaps with measurable outcomes and regular readouts
• Operationalize Responsible AI: establish review gates, documentation/evaluation requirements, and rollout/rollback standards for all production AI systems
• Create strong collaboration interfaces with Research, Data, and Platform teams to accelerate model lifecycle

Skills

Leadership

AI engineering

Python

MLOps

Cloud platforms

Education

Bachelor's degree in CS/AI/EE/CE

Master's degree in CS/AI/EE/CE

Tools

AWS Ultraclusters

Huggingface

VectorDBs

PyTorch

CUDA

Job description

Capital One is seeking a Sr. Manager, AI Engineer in San Jose, CA to lead and scale responsible AI systems across a broad technology stack.

You will guide foundation model training, LLM inference, and observability while driving a roadmap for enterprise AI platforms. You will collaborate with engineering, research, data, and product teams to deliver AI-powered products that enhance customer experiences and internal processes.