Senior AI Foundations Engineer

Capital One; Cambridge (MA); On-site; USD 230,000 - 262,000; Full time

Job summary

Capital One seeks an AI Engineer to build and optimize scalable AI systems in production. You will partner with engineers, researchers, and product managers to deliver AI-powered products and to design multi-model orchestration pipelines with LLMs, vector search, and domain models.

The role emphasizes responsible AI, cost-perf governance, and mentorship of engineers, with opportunities to contribute to long-term technical roadmaps and standards across AI platforms.

Qualifications

• Bachelor's degree in CS/AI/EE/CE with 6+ years of AI/ML development, or Master's with 4+ years.
• 6+ years programming with Python, Go, Scala, CUDA, or Java.

Responsibilities

• Partner with cross-functional teams to deliver AI-powered products.
• Design, develop, test, deploy, and support AI software components.
• Leverage Open Source and SaaS AI tech like AWS Ultraclusters, Huggingface, PyTorch.
• Invent foundation model optimization to improve performance, scalability, cost, latency, throughput.
• Contribute to the technical vision and long-term roadmap of foundational AI systems at Capital One.
• Design, implement and optimize multi-model orchestration pipelines integrating LLMs, vector search, and domain models.
• Establish and lead cost-performance governance reviews across AI systems, tracking GPU utilization and inference cost efficiency.
• Lead team design councils or design review boards to ensure technical consistency and compliance with AI engineering standards.
• Mentor Principal and Manager-level AI engineers, fostering cross-domain learning and elevating technical maturity.

Skills

Python

Go

Scala

CUDA

Java

Leadership

Communication

Education

Bachelor's degree in CS/AI/EE/CE

Master's degree in CS/AI/EE/CE

Tools

AWS Ultraclusters

Huggingface

VectorDBs

PyTorch

Job description

Capital One seeks an AI Engineer to build and optimize scalable AI systems in production. You will partner with engineers, researchers, and product managers to deliver AI-powered products and to design multi-model orchestration pipelines with LLMs, vector search, and domain models.

The role emphasizes responsible AI, cost-perf governance, and mentorship of engineers, with opportunities to contribute to long-term technical roadmaps and standards across AI platforms.