Senior Lead AI Engineer, GenAI Platform & LLM Ops

Capital One Group; Northern (KY); Hybrid; USD 230,000 - 286,000; Full time

Job summary

Capital One is building responsible and reliable AI systems with a focus on scalable AI infrastructure and real-time, personalized customer experiences. The IFX team partners across the company to advance AI engineering and deploy proprietary AI solutions at scale.

You will design and deploy AI software components, optimize LLM performance, and contribute to the strategic roadmap for foundational AI systems at Capital One.

Qualifications

• Bachelor's or Master's with relevant AI/ML experience.
• 6+ years of AI/ML development or 4+ years with Master's.
• 6+ years programming experience in Python/Java/Go/Scala.

Responsibilities

• Partner with cross-functional teams to deliver AI-powered products.
• Design, develop, test, deploy, and support AI software components.
• Leverage Open Source and SaaS AI technologies for scalable solutions.
• Invent state-of-the-art LLM optimization techniques for production.
• Contribute to long-term AI systems vision and roadmap.

Skills

Python

Java

Go

Scala

Education

Bachelor's degree in Computer Science or related field

Master's degree in Computer Science or related field

Tools

AWS Ultraclusters

Huggingface

VectorDBs

Nemo Guardrails

PyTorch

Job description

Capital One is building responsible and reliable AI systems with a focus on scalable AI infrastructure and real-time, personalized customer experiences. The IFX team partners across the company to advance AI engineering and deploy proprietary AI solutions at scale.

You will design and deploy AI software components, optimize LLM performance, and contribute to the strategic roadmap for foundational AI systems at Capital One.