Senior Lead AI Engineer: LLM Inference & Scalable AI

Capital One Financial Corporation; McLean (VA); On-site; USD 230,000 - 262,000; Full time

Job summary

Capital One is seeking a Senior Lead AI Engineer to design and deliver AI-powered products, focusing on LLM inference, guardrails, and scalable AI infrastructure. You will partner with engineers, researchers, PMs, and product teams to implement production-ready AI systems.

The role emphasizes building reliable, high-performance AI platforms, leading technical directions, and mentoring an engineering team to drive impact across the business.

Qualifications

• Bachelor's or Master's in a related field with substantial AI/ML experience.
• At least 6 years of experience building AI/ML algorithms or technologies.
• At least 6 years of programming experience in Python, Go, Scala, or Java.

Responsibilities

• Partner with cross-functional teams to deliver AI-powered products.
• Design, develop, test, deploy, and support AI software components including LLM inference and guardrails.
• Leverage Open Source and SaaS AI technologies (AWS Ultraclusters, Huggingface, VectorDBs, Nemo Guardrails).
• Invent state-of-the-art LLM optimization techniques for performance and cost efficiency.
• Contribute to the long-term roadmap of foundational AI systems at Capital One.

Skills

Python/Go/Scala/Java

LLM Inference

Cloud deployment

Huggingface PyTorch

Education

Bachelor's degree in Computer Science / AI / Electrical Engineering / Computer Engineering

Master's degree in Computer Science / AI / Electrical Engineering / Computer Engineering

Tools

AWS

Huggingface

PyTorch

VectorDBs

Nemo Guardrails

Job description

Capital One is seeking a Senior Lead AI Engineer to design and deliver AI-powered products, focusing on LLM inference, guardrails, and scalable AI infrastructure. You will partner with engineers, researchers, PMs, and product teams to implement production-ready AI systems.

The role emphasizes building reliable, high-performance AI platforms, leading technical directions, and mentoring an engineering team to drive impact across the business.