Senior AI Engineer – Gen AI Platform

Capital One; McLean (VA); On-site; USD 150,000 - 210,000; Full time

Job summary

Capital One is building responsible and reliable AI systems that are transforming banking for the better. Our Intelligent Foundations and Experiences team sits at the center of our AI vision, collaborating across the company to advance science and AI engineering and to build proprietary solutions that serve millions of customers.

We offer a comprehensive, competitive, and inclusive benefits package that supports total well-being, along with performance-based incentive compensation.

Qualifications

• Bachelor's in CS/AI/EE or related field plus 6+ years AI/ML experience, or Master's plus 4+ years.
• 6+ years programming in Python/Go/Scala/Java.
• Experience deploying scalable AI on cloud platforms.
• Experience designing and supporting complex AI systems.
• Proven ability to lead engineers and influence cross-functional partners.
• Experience with LLM inference, similarity search, VectorDBs, guardrails and memory.
• Strong optimization methods for training and inference efficiency.
• Excellent communication and presentation skills.

Responsibilities

• Partner with engineers, researchers, PMs, and product managers to deliver AI-powered products.
• Design, build, test, deploy, and support AI software components including model training and inference.
• Use open source and SaaS AI technologies including AWS Ultraclusters, Hugging Face, VectorDBs, PyTorch.
• Create and introduce advanced LLM optimization techniques for scalability and cost efficiency.
• Help shape the technical vision and long‑term roadmap for foundational AI systems at Capital One.

Skills

Python

Cloud AI deployment

Leadership

Communication

Research awareness

Education

Bachelor's or Master's in CS/AI/EE

Tools

AWS Ultraclusters

Hugging Face

VectorDBs

NeMo Guardrails

PyTorch

Job description

Requirements

Must have:

• – Bachelors degree in Computer Science, AI, Electrical Engineering, Computer Engineering, or a related discipline plus at least 6 years of experience developing AI and ML algorithms or technologies, or a Masters degree in one of these fields plus at least 4 years of similar experience
• – At least 6 years of programming experience with Python, Go, Scala, or Java
• – Experience deploying scalable, responsible AI solutions on cloud platforms
• – Experience designing, building, integrating, delivering, and supporting complex AI systems
• – Proven ability to lead and mentor engineers and influence cross-functional partners
• – Experience working with AI and ML technologies such as LLM inference, similarity search, VectorDBs, guardrails, and memory
• – Experience applying advanced optimization methods to improve training and inference efficiency, hardware utilization, latency, throughput, and cost
• – Strong interest in current AI research and the ability to apply new techniques thoughtfully in production
• – Excellent communication and presentation skills with the ability to explain complex AI concepts clearly

Responsibilities:

• Partner with engineers, research scientists, technical program managers, and product managers to deliver AI-powered products that improve how our associates work and how our customers engage with Capital One
• Design, build, test, deploy, and support AI software components, including foundation model training, large language model inference, similarity search, guardrails, model evaluation, experimentation, governance, and observability
• Use a broad range of open source and SaaS AI technologies, including AWS Ultraclusters, Hugging Face, VectorDBs, NeMo Guardrails, PyTorch, and related tools
• Create and introduce advanced LLM optimization techniques to enhance scalability, cost efficiency, latency, and throughput in large-scale production AI systems
• Help shape the technical vision and long‑term roadmap for foundational AI systems at Capital One

Company:

We are building responsible and reliable AI systems that are transforming banking for the better. Our Intelligent Foundations and Experiences team sits at the center of our AI vision, collaborating across the company to advance science and AI engineering and to build proprietary solutions that serve millions of customers. We offer a comprehensive, competitive, and inclusive benefits package that supports total well-being, along with performance-based incentive compensation. This role includes salary ranges that vary by location, with opportunities in Cambridge, McLean, New York, San Francisco, and San Jose, and we may sponsor a new qualified applicant for employment authorization.