Senior AI Engineer: Foundation Models & Production AI

Capital One; Cambridge (MA); On-site; USD 197,000 - 225,000; Full time

Job summary

Capital One is building responsible AI foundations in Cambridge, MA, delivering scalable AI systems for banking. This AI Engineer 4 role focuses on end-to-end architecture, foundation model optimization, and robust SLOs to ensure reliable, ethical AI in production.

You will lead cross-functional reviews, mentor senior associates, and partner with engineers, researchers, and product managers to deploy AI-powered solutions that transform customer experiences at Capital One.

Qualifications

• Bachelor's degree in Computer Science, AI, Electrical Engineering, Computer Engineering, or related fields plus at least 4 years of experience developing AI and ML algorithms or technologies, or a Master's degree in Computer Science, AI, Electrical Engineering, Computer Engineering, or related fields plus at least 2 years of experience developing AI and ML algorithms or technologies
• At least 4 years of experience programming with Python, Go, Scala, CUDA, or Java

Responsibilities

• Partner with a cross-functional team of engineers, research scientists, technical program managers, and product managers to deliver AI-powered products that change how our associates work and how our customers interact with Capital One.
• Design, develop, test, deploy, and support AI software components including foundation model training, large language model inference, agents and multi-agent workflows, similarity search, guardrails, model evaluation, experimentation, governance, and observability, etc.
• Leverage a broad stack of Open Source and SaaS AI technologies such as AWS Ultraclusters, Huggingface, VectorDBs, PyTorch, and more.
• Invent and introduce state-of-the-art foundation model optimization techniques to improve the performance — scalability, cost, latency, throughput — of large scale production AI systems.
• Contribute to the technical vision and the long term roadmap of foundational AI systems at Capital One.
• Own the end-to-end architecture for complex AI systems - ensuring maintainability, observability, and ethical alignment
• Define and maintain service-level objectives (SLOs) for AI reliability, including latency, uptime, and model performance drift
• Collaborate with infrastructure engineering to optimize GPU/TPU utilization and accelerate model inference pipelines
• Lead cross-functional technical reviews for new AI system deployments, ensuring security, data governance, and compliance standards are met
• Mentor Principal and Senior Associates on scalable design, performance tuning and research-to-production translation

Skills

Python

Go

Scala

CUDA

Java

Huggingface

PyTorch

AWS Ultraclusters

VectorDBs

Education

Bachelor's degree in Computer Science, AI, Electrical Engineering, Computer Engineering, or related fields + 4 years experience or Master's degree + 2 years experience

Experience with Graduate level AI/ML coursework or research

Tools

AWS Ultraclusters

Huggingface

VectorDBs

PyTorch

Job description

Capital One is building responsible AI foundations in Cambridge, MA, delivering scalable AI systems for banking. This AI Engineer 4 role focuses on end-to-end architecture, foundation model optimization, and robust SLOs to ensure reliable, ethical AI in production.

You will lead cross-functional reviews, mentor senior associates, and partner with engineers, researchers, and product managers to deploy AI-powered solutions that transform customer experiences at Capital One.