Senior AI Engineering Manager — Scalable ML & LLM Systems

Capital One; San Francisco (CA); On-site; USD 250,000 - 286,000; Full time

Job summary

Capital One in San Francisco, CA, seeks a Sr. Mgr, AI Engineering to lead the design, deployment, and optimization of large-scale AI systems in production.

You will guide cross-functional teams across engineering, research, and product management to deliver responsible AI solutions with strong governance and observability. You will mentor engineers, drive technology strategy, and ensure performance, cost, latency and scalability goals are met while advancing Capital One’s AI capabilities

Qualifications

• Bachelor's degree in CS/AI/EE/CE with 6+ yrs AI/ML exp, or Master's with 4+ yrs.
• At least 1 year of people leadership experience.
• 6 years of experience deploying scalable AI on cloud platforms (AWS/GCP/Azure).

Responsibilities

• Partner with a cross-functional team to deliver AI-powered products.
• Oversee design, development, testing, deployment, and support of AI software components.
• Make build-vs-buy decisions across Open Source and SaaS AI technologies.
• Invent and apply state-of-the-art LLM optimization techniques for production.
• Contribute to technical vision and long-term roadmap of foundational AI systems.
• Mentor and develop team members and foster a culture of learning.

Skills

People leadership

Cross-functional collaboration

Engineering mindset

Communication skills

Education

Bachelor's degree in CS/AI/EE/CE or related fields

Master's degree in CS/AI/EE/CE or related fields

Tools

AWS Ultraclusters

Huggingface

VectorDBs

Nemo Guardrails

PyTorch

Python

C++

C#

Java

Golang

Job description

Capital One in San Francisco, CA, seeks a Sr. Mgr, AI Engineering to lead the design, deployment, and optimization of large-scale AI systems in production.

You will guide cross-functional teams across engineering, research, and product management to deliver responsible AI solutions with strong governance and observability. You will mentor engineers, drive technology strategy, and ensure performance, cost, latency and scalability goals are met while advancing Capital One’s AI capabilities