Senior GenAI Platform Engineer — Agentic Infrastructure

Capital One; Cambridge (MA); On-site; USD 230,000 - 262,000; Full time

Job summary

Capital One in Cambridge, MA is seeking an AI Engineer to build scalable AI systems and lead foundation model optimization. You will collaborate with engineers, researchers, and product managers to deliver cutting-edge AI capabilities that transform banking experiences.

You will mentor senior engineers, evaluate emerging AI research, and ensure productions systems meet cost, latency, and reliability goals. A strong emphasis on responsible AI and scalable infrastructure runs through the role.

Qualifications

• Bachelor's or Master's in a related field with required experience as stated.
• 6+ years building AI/ML algorithms or technologies; 4+ years if Master’s degree.
• 6+ years of programming experience in Python, Go, Scala, CUDA, or Java.

Responsibilities

• Partner with cross-functional teams to deliver AI-powered products.
• Design, develop, test, deploy, and support AI software components.
• Utilize Open Source and SaaS AI technologies (e.g., AWS Ultraclusters, Huggingface, PyTorch).
• Innovate model optimization techniques to improve performance, cost, latency, and throughput.
• Contribute to the long-term foundational AI systems roadmap at Capital One.
• Design and optimize multi-model orchestration pipelines across LLMs and vector search.
• Oversee governance of GPU usage, model throughput, and inference cost efficiency.
• Lead design reviews to ensure engineering standards and consistency.
• Mentor senior AI engineers to raise technical maturity.

Skills

Python

Go

Scala

CUDA

Java

Education

Bachelor's degree in CS/AI/EE/CE

Master's degree in CS/AI/EE/CE

Tools

AWS

Huggingface

PyTorch

VectorDBs

Job description

Capital One in Cambridge, MA is seeking an AI Engineer to build scalable AI systems and lead foundation model optimization. You will collaborate with engineers, researchers, and product managers to deliver cutting-edge AI capabilities that transform banking experiences.

You will mentor senior engineers, evaluate emerging AI research, and ensure productions systems meet cost, latency, and reliability goals. A strong emphasis on responsible AI and scalable infrastructure runs through the role.