Senior Lead AI Engineer: LLM Inference & AI Foundations

Capital One Group; McLean (VA); On-site; USD 230,000 - 262,000; Full time

Job summary

Capital One seeks a Senior Lead AI Engineer to join the IFX team in McLean, VA. You will design, develop, test, deploy, and support AI software components including foundation model training and LLM inference, with emphasis on scalability and observability.

You will collaborate with engineers, researchers, and product managers to deliver AI-powered products that transform how associates work and how customers interact with Capital One.

Qualifications

• Bachelor's degree in Computer Science, AI, Electrical Engineering, Computer Engineering, or related fields plus 6+ years of AI/ML experience, or Master's with 4+ years.
• 6+ years of Python/Go/Scala/Java programming experience
• 7 years of experience deploying scalable AI solutions on cloud platforms (AWS, Google Cloud, Azure)
• Experience designing, developing, integrating, delivering, and supporting complex AI systems
• Experience with LLM Inference, Similarity Search and VectorDBs, Guardrails, Memory
• Excellent communication and mentorship skills

Responsibilities

• Partner with cross-functional teams to deliver AI-powered products
• Design, develop, test, deploy, and support AI software components including foundation model training, LLM inference, similarity search, guardrails, evaluation, governance, and observability
• Invent and introduce state-of-the-art LLM optimization techniques for production AI systems
• Contribute to the technical vision and long-term roadmap of foundational AI systems at Capital One
• Collaborate with engineers, researchers, PMs, and product managers to scale AI solutions across the business

Skills

Python

Go

Scala

Java

C++

C#

LLM/AI

VectorDBs

Huggingface

PyTorch

AWS

Guardrails

Education

Bachelor's degree in Computer Science, AI, Electrical Engineering, Computer Engineering, or related fields

Master's degree in Computer Science, AI, Electrical Engineering, Computer Engineering, or related fields

Tools

AWS

Google Cloud

Azure

Nemo Guardrails

PyTorch

Huggingface

VectorDBs

Job description

Capital One seeks a Senior Lead AI Engineer to join the IFX team in McLean, VA. You will design, develop, test, deploy, and support AI software components including foundation model training and LLM inference, with emphasis on scalability and observability.

You will collaborate with engineers, researchers, and product managers to deliver AI-powered products that transform how associates work and how customers interact with Capital One.