Lead AI Platform Engineer — Gen AI, Guardrails & Memory

Capital One

Cambridge (MA)

On-site

USD 197,000 - 225,000

Full time

46 hours ago

Be an early applicant

Application generator

Stand out for this role — generate a tailored resume and cover letter in about a minute.

Get past ATS filters

Job summary

Capital One is seeking a Lead AI Engineer to advance Gen AI Platform Services, including Agentic AI, guardrails, evaluation, and memory. You will partner with engineers, researchers, PMs, and product teams to deliver AI-powered products that transform how associates work and how customers interact with Capital One.

You will design and deploy AI components, optimize LLM performance, and contribute to the long-term AI infrastructure roadmap using AWS, Huggingface, VectorDBs, Nemo Guardrails, and

Qualifications

Bachelor's or Master's degree with required years of experience in AI/ML
4+ years of Python/Go/Scala/Java
Experience deploying scalable AI on cloud platforms
Experience with LLM inference, VectorDBs, and guardrails
Strong knowledge of AI optimization techniques for performance

Responsibilities

Partner with cross-functional teams to deliver AI-powered products.
Design, develop, test, deploy, and support AI software components.
Leverage Open Source and SaaS AI technologies.
Invent state-of-the-art LLM optimization techniques for production systems.
Contribute to the technical vision and long-term AI roadmap.

Skills

ML algorithms

Python

Scala/Java

Education

Bachelor's degree in Computer Science / AI / EE / CE

Master's degree in Computer Science / AI / EE / CE

Tools

AWS Ultraclusters

Huggingface

VectorDBs

Nemo Guardrails

PyTorch

Job description

You will design and deploy AI components, optimize LLM performance, and contribute to the long-term AI infrastructure roadmap using AWS, Huggingface, VectorDBs, Nemo Guardrails, and

Get your free, confidential resume review.

or drag and drop your file here.