Lead AI Engineer — Scalable LLM & AI Systems

Capital One; McLean (VA); On-site; USD 197,000 - 225,000; Full time

Job summary

Capital One’s Intelligent Foundations and Experiences (IFX) team seeks a Lead AI Engineer to design, build, and optimize AI systems at scale. You will collaborate with engineers, researchers, PMs, and other stakeholders to deliver AI-powered products that improve both customer experiences and internal workflows.

A strong foundation in AI/ML, performance optimization, and cloud deployment is essential. You will engage with foundation model training, inference, guardrails, and observability while

Qualifications

• Bachelor's degree in Computer Science, AI, Electrical Engineering, Computer Engineering, or related fields plus at least 4 years of experience developing AI and ML algorithms or technologies
• At least 4 years of experience programming with Python, Go, Scala, or Java
• 6+ years of experience deploying scalable and responsible AI solutions on cloud platforms (AWS, Google Cloud, Azure)
• Experience developing AI and ML algorithms or technologies (e.g. LLM Inference, Similarity Search and VectorDBs, Guardrails) using Python, C++, C#, Java, or Golang

Responsibilities

• Partner with cross-functional teams to deliver AI-powered products
• Design, develop, test, deploy, and support AI software components including model training, inference, guardrails, governance, and observability
• Leverage a broad stack of Open Source and SaaS AI technologies (AWS Ultraclusters, Huggingface, VectorDBs, Nemo Guardrails, PyTorch)
• Invent and introduce state-of-the-art LLM optimization techniques to improve performance (scalability, cost, latency) of production AI systems
• Contribute to the technical vision and long-term roadmap of foundational AI systems at Capital One

Skills

Python

Go

Scala

Java

Education

Bachelor's degree in CS/AI/EE/CE

Master's degree in CS/AI/EE/CE

Tools

AWS Ultraclusters

Huggingface

VectorDBs

Nemo Guardrails

PyTorch

Job description

Capital One’s Intelligent Foundations and Experiences (IFX) team seeks a Lead AI Engineer to design, build, and optimize AI systems at scale. You will collaborate with engineers, researchers, PMs, and other stakeholders to deliver AI-powered products that improve both customer experiences and internal workflows.

A strong foundation in AI/ML, performance optimization, and cloud deployment is essential. You will engage with foundation model training, inference, guardrails, and observability while