Senior AI Engineer - Foundation Models & Scalable AI

Capital One; Cambridge (MA); On-site; USD 230,000 - 262,000; Full time

Job summary

Capital One is seeking an AI Engineer to help build and scale responsible AI systems across banking products. You will collaborate with engineers, scientists, PMs, and product teams to advance foundation models, LLM inference, and multi-model workflows in production.

The role emphasizes cost-aware, high-performance AI infrastructure, governance practices, and mentoring engineers while delivering scalable AI solutions for millions of customers.

Qualifications

• Bachelor's degree in CS, AI, EE, or related fields with 6+ years in AI/ML OR Master's with 4+ years.
• 6+ years programming in Python, Go, Scala, CUDA, or Java.

Responsibilities

• Partner with cross-functional teams to deliver AI-powered products.
• Design, develop, test, deploy, and support AI software components including foundation model training and LLM inference.
• Leverage Open Source and SaaS AI tech like AWS Ultraclusters, Hugging Face, PyTorch.
• Invent optimization techniques to improve performance, scalability, latency, and cost.

Skills

Python

Go

Scala

CUDA

Java

ML algorithms

PyTorch/HuggingFace

Education

Bachelor's degree in CS/related field

Master's degree in CS/related field

Tools

AWS

HuggingFace

VectorDBs

PyTorch

Job description

Capital One is seeking an AI Engineer to help build and scale responsible AI systems across banking products. You will collaborate with engineers, scientists, PMs, and product teams to advance foundation models, LLM inference, and multi-model workflows in production.

The role emphasizes cost-aware, high-performance AI infrastructure, governance practices, and mentoring engineers while delivering scalable AI solutions for millions of customers.