Senior Lead AI Platform Engineer (GenAI & Infra)

Capital One; Cambridge (MA); On-site; USD 229,900 - 262,400; Full time

Job summary

Capital One is building responsible AI systems and scalable AI infrastructure to transform banking. The Intelligent Foundations and Experiences team enables AI-driven products with real-time, personalized customer experiences across platforms.

The role focuses on foundation models, LLM inference, vector databases, and guardrails, partnering with engineers, researchers, and PMs to deliver safe, scalable AI for millions of customers.

Qualifications

• Bachelor’s or Master’s degree in Computer Science, AI, Electrical Engineering, Computer Engineering or related fields with relevant years of AI/ML experience.

Responsibilities

• Partner with cross-functional teams to deliver AI-powered products for associates and customers.
• Design, develop, test, deploy, and support AI software components including foundation model training and LLM inference.
• Leverage Open Source and SaaS AI technologies (AWS Ultraclusters, Huggingface, VectorDBs, PyTorch).
• Invent state-of-the-art LLM optimization techniques to improve performance, latency, and cost.
• Contribute to the technical vision and long-term roadmap of foundational AI systems at Capital One.

Skills

Python

Go

Scala

Java

C++

C#

Golang

Education

Bachelor's in CS/AI/EE/CE

Master's in CS/AI/EE/CE

Tools

AWS

Google Cloud

Azure

HuggingFace

VectorDBs

PyTorch

Nemo Guardrails

Ultraclusters

Job description

Capital One is building responsible AI systems and scalable AI infrastructure to transform banking. The Intelligent Foundations and Experiences team enables AI-driven products with real-time, personalized customer experiences across platforms.

The role focuses on foundation models, LLM inference, vector databases, and guardrails, partnering with engineers, researchers, and PMs to deliver safe, scalable AI for millions of customers.