Lead AI Engineer: LLM & Production Systems

Capital One; McLean (VA); On-site; USD 197,000 - 225,000; Full time

Job summary

Capital One in McLean, Virginia is seeking a Lead AI Engineer to help design, build, and scale AI systems that power customer experiences. You will work with engineers, researchers, product managers to deliver AI-powered products and ensure responsible, scalable AI.

This role focuses on foundation model training, LLM inference, guardrails, evaluation, governance, and observability, using AWS, HuggingFace, PyTorch, and vector databases. A strong software and math foundation is essential.

Qualifications

• Bachelor’s degree or higher with required AI/ML experience.
• 4+ years programming experience in Python/Go/Scala/Java.

Responsibilities

• Partner with cross-functional teams to deliver AI-powered products.
• Design, develop, test, deploy, and support AI software components (foundation models, inference, guardrails, evaluation, governance).
• Leverage Open Source and SaaS AI tech (AWS Ultraclusters, HuggingFace, VectorDBs, PyTorch).
• Invent and apply state-of-the-art LLM optimization techniques for production systems.
• Contribute to the technical vision and long-term roadmap of foundational AI systems.

Skills

Python

Go

Scala

Java

Deep learning

Education

Bachelor's degree in Computer Science or related field

Master's degree in Computer Science or related field

Tools

AWS Ultraclusters

HuggingFace

VectorDBs

Nemo Guardrails

PyTorch

Job description

Capital One in McLean, Virginia is seeking a Lead AI Engineer to help design, build, and scale AI systems that power customer experiences. You will work with engineers, researchers, product managers to deliver AI-powered products and ensure responsible, scalable AI.

This role focuses on foundation model training, LLM inference, guardrails, evaluation, governance, and observability, using AWS, HuggingFace, PyTorch, and vector databases. A strong software and math foundation is essential.