Senior AI Engineer - Foundation & Orchestration

Capital One National Association; Cambridge (MA); On-site; USD 230,000 - 262,000; Full time

Job summary

Capital One is seeking an AI Engineer 5 in Cambridge, MA, to help design and deploy scalable AI-powered financial products. You will partner with engineers, researchers, and PMs to advance AI capabilities and customer experiences with responsible, production-ready systems.

You will work on model training, inference, and orchestration, leveraging PyTorch, Huggingface, and vector databases, while optimizing performance, latency, and cost. This role offers collaboration across teams and real impact.

Qualifications

• Bachelor's degree in Computer Science or related field plus 6+ years AI/ML experience, or Master's degree plus 4+ years.
• Strong programming experience in Python and at least one of Go, Scala, CUDA, or Java.
• Experience deploying AI systems at scale in production.

Responsibilities

• Partner with a cross-functional team to deliver AI-powered products that change how associates work and how customers interact with Capital One.
• Design, develop, test, deploy, and support AI software components including foundation model training, LLM inference, agents and multi-agent workflows, similarity search, guardrails, model evaluation, and governance.
• Leverage a broad stack of Open Source and SaaS AI technologies such as AWS Ultraclusters, Huggingface, VectorDBs, PyTorch, and more.
• Invent and introduce state-of-the-art foundation model optimization techniques to improve performance, scalability, cost, latency, throughput.
• Contribute to the technical vision and long-term roadmap of foundational AI systems at Capital One.
• Design, implement and optimize multi-model orchestration pipelines - integrating LLMs, vector search, and domain-specific models into unified systems.
• Establish and lead cost-performance governance reviews across AI systems, tracking GPU utilization, model throughput, and inference cost efficiency.
• Lead team design councils or design review boards to ensure technical consistency and compliance with AI engineering standards.
• Mentor Principal and Manager-level AI engineers, fostering cross-domain learning and elevating organizational technical maturity.

Skills

Python

Go

Scala

CUDA

Java

AI systems

LLM inference

VectorDBs

PyTorch

Open Source AI

Education

Bachelor's in CS/AI

Master's in CS/AI

Tools

Huggingface

PyTorch

AWS Ultraclusters

VectorDBs

CUDA

Job description

Capital One is seeking an AI Engineer 5 in Cambridge, MA, to help design and deploy scalable AI-powered financial products. You will partner with engineers, researchers, and PMs to advance AI capabilities and customer experiences with responsible, production-ready systems.

You will work on model training, inference, and orchestration, leveraging PyTorch, Huggingface, and vector databases, while optimizing performance, latency, and cost. This role offers collaboration across teams and real impact.