Senior AI Foundations Engineer for LLMs and Agentic AI

Capital One; Cambridge (MA); On-site; USD 197,000 - 225,000; Full time

Job summary

Capital One is building responsible AI systems to transform banking experiences. This role partners with engineers, researchers and product managers to deliver AI-powered products that impact how associates work and how customers interact with Capital One.

You will design, develop, test, deploy, and support AI software components, including foundation model training, LLM inference, and multi-agent workflows, using a broad stack of Open Source and SaaS AI technologies.

Qualifications

• Bachelor's degree or higher with AI/ML algorithm experience
• 4+ years of AI/ML development experience
• Experience with Python/Go/Scala/CUDA/Java programming

Responsibilities

• Partner with cross-functional team to deliver AI-powered products
• Design, develop, test, deploy, and support AI software components
• Leverage Open Source and SaaS AI technologies like AWS, Huggingface, PyTorch
• Optimize foundation model training and inference for production scale
• Own end-to-end architecture for complex AI systems
• Define and maintain SLIs for AI reliability
• Collaborate with infrastructure to optimize GPU/TPU utilization
• Lead technical reviews for new AI deployments
• Mentor junior engineers on scalable design and production translation

Skills

Python

Go

Scala

CUDA

Java

AI systems

Education

Bachelor's degree in Computer Science or related field

Master's degree in Computer Science or related field

Tools

AWS

Huggingface

VectorDBs

PyTorch

Open Source tools

Job description

Capital One is building responsible AI systems to transform banking experiences. This role partners with engineers, researchers and product managers to deliver AI-powered products that impact how associates work and how customers interact with Capital One.

You will design, develop, test, deploy, and support AI software components, including foundation model training, LLM inference, and multi-agent workflows, using a broad stack of Open Source and SaaS AI technologies.