Senior AI Engineer, Foundations & Scaling

Capital One; Cambridge (MA); On-site; USD 230,000 - 262,000; Full time

Job summary

Capital One is seeking an AI Engineer to join the Intelligent Foundations and Experiences team in Cambridge, MA. You will design, build, and operate AI software components, including foundation model training, large language model inference, and multi-model workflows, to power scalable, responsible AI solutions.

You will collaborate with engineers, researchers, and product managers to advance AI capabilities across Capital One's platforms, balancing performance, cost, and reliability while

Qualifications

• Bachelor's degree with 6+ years of AI/ML experience or Master's with 4+ years.
• 6+ years programming in Python/Go/Scala/CUDA/Java.
• Experience leading AI systems with cost, latency, throughput and accuracy

Responsibilities

• Deliver AI-powered products with cross-functional teams.
• Design, develop, test, deploy AI software components including foundation model training and inference.
• Leverage OSS and SaaS AI tech like AWS Ultraclusters, Huggingface, VectorDBs, PyTorch.
• Optimize foundation model performance for scalability, cost, latency, throughput.
• Contribute to the long-term roadmap of foundational AI systems at Capital One.
• Design multi-model orchestration pipelines integrating LLMs and vector search.
• Lead governance reviews on GPU usage, throughput, and cost efficiency.
• Mentor senior AI engineers and raise technical maturity.

Skills

Python

Go

Scala

CUDA

Java

Education

Bachelor's degree in Computer Science, AI, Electrical Engineering, Computer Engineering, or related fields

Master's degree in Computer Science, AI, Electrical Engineering, Computer Engineering, or related fields

Tools

AWS Ultraclusters

Huggingface

VectorDBs

PyTorch

Job description

Capital One is seeking an AI Engineer to join the Intelligent Foundations and Experiences team in Cambridge, MA. You will design, build, and operate AI software components, including foundation model training, large language model inference, and multi-model workflows, to power scalable, responsible AI solutions.

You will collaborate with engineers, researchers, and product managers to advance AI capabilities across Capital One's platforms, balancing performance, cost, and reliability while