Lead Gen AI Platform Engineer – Agentic AI & Guardrails

Capital One; McLean (VA); On-site; USD 197,000 - 225,000; Full time

Job summary

Capital One is seeking a Lead AI Engineer for Gen AI Platform Services in McLean, VA. You will design, build, test, and deploy AI software components, including foundation model training, inference, guardrails, and observability, using a broad stack of Open Source and SaaS AI technologies.

You will push state-of-the-art optimization techniques to improve latency, throughput, and cost while shaping the long-term AI platform roadmap.

Qualifications

• Bachelor’s or Master’s in a technical field with AI/ML experience.
• 4+ years coding in Python, Go, Scala or Java.
• Experience deploying AI/ML in production and cloud.

Responsibilities

• Partner with cross-functional teams to deliver AI-powered products.
• Design, develop, test, deploy, and support AI software components.
• Leverage Open Source and SaaS AI technologies in production systems.
• Invent and apply LLM optimization techniques for scalable performance.
• Contribute to long-term AI foundational system roadmaps.

Skills

Python

Go

Scala

Java

Cloud platforms

LLM Inference

Guardrails

Memory

Education

Bachelor’s degree in Computer Science or related field

Master’s degree in Computer Science or related field

Tools

AWS Ultraclusters

Huggingface

VectorDBs

Nemo Guardrails

PyTorch

Job description

Capital One is seeking a Lead AI Engineer for Gen AI Platform Services in McLean, VA. You will design, build, test, and deploy AI software components, including foundation model training, inference, guardrails, and observability, using a broad stack of Open Source and SaaS AI technologies.

You will push state-of-the-art optimization techniques to improve latency, throughput, and cost while shaping the long-term AI platform roadmap.