Senior AI Engineering Leader Scalable AI Systems

Capital One; New York, Northern (NY, KY); Hybrid; USD 251,000 - 286,000; Full time

Benefits offered by this job

Performance-based incentives

Comprehensive benefits

Job summary

Capital One is seeking a Sr. Manager, AI Engineer in New York, NY to lead AI systems across foundation models, training, inference, and observability.

You will guide product teams, oversee architecture, and implement responsible AI practices to ensure scalable and compliant AI deployments. The ideal candidate brings 6+ years in AI/ML with leadership, cloud experience (AWS/GCP/Azure), and hands-on expertise in model optimization, vector databases, and PyTorch.

Qualifications

• Bachelor's Degree in Computer Science, AI, Electrical Engineering, Computer Engineering, or related fields plus at least 6 years of experience developing AI and ML algorithms or technologies, or a Master's degree plus at least 4 years of experience.
• At least 1 year of people leadership experience.
• Experience deploying scalable and responsible AI solutions on cloud platforms.
• Experience developing AI/ML algorithms using Python, C++, C#, Java, CUDA, or Golang.

Responsibilities

• Partner with cross-functional teams to deliver AI-powered products that change how associates work and how customers interact with Capital One.
• Oversee design, development, testing, deployment, and support of AI software components including foundation model training and inference.
• Make build-vs-buy decisions across Open Source and SaaS AI technologies; optimize performance, cost, latency, and throughput.
• Contribute to technical vision and long-term roadmaps for foundational AI systems.
• Attract and retain top AI talent and foster learning across the team.
• Translate enterprise AI goals into actionable roadmaps with measurable outcomes.
• Operationalize Responsible AI with gates, documentation, and governance for production systems.
• Collaborate with Research, Data, and Platform teams to accelerate model lifecycle.

Skills

People leadership

Cloud deployment

LLM inference

Agentic AI systems

MLOps observability

Mentoring engineers

Model sizing & hardware tuning

Python/C++/Java

Education

Bachelor's Degree in CS/AI/EE/CE or related

Master's degree in CS/AI/EE/CE or related

Tools

AWS

Google Cloud

Azure

HuggingFace

PyTorch

VectorDBs

Job description

Capital One is seeking a Sr. Manager, AI Engineer in New York, NY to lead AI systems across foundation models, training, inference, and observability.

You will guide product teams, oversee architecture, and implement responsible AI practices to ensure scalable and compliant AI deployments. The ideal candidate brings 6+ years in AI/ML with leadership, cloud experience (AWS/GCP/Azure), and hands-on expertise in model optimization, vector databases, and PyTorch.