Lead AI Engineer — Foundations & LLM Ops

Capital One Group; New York, Northern (NY, KY); Hybrid; USD 215,000 - 246,000; Full time

Job summary

Capital One is seeking a Lead AI Engineer to advance AI foundations and VLM customization in a collaborative, cross-functional environment in New York, NY. The role emphasizes building scalable AI systems, coupling state-of-the-art ML with production-grade software.

You will work to optimize training and inference pipelines, deploy AI services, and contribute to the roadmap of foundational AI systems across Capital One. A strong mathematical and engineering foundation is required.

Qualifications

• Bachelor's or Master's degree in a relevant field with required experience.
• At least 2–4 years of AI/ML algorithms or technologies experience depending on degree.
• 4+ years of experience programming with Python, Go, Scala, or Java.

Responsibilities

• Partner with cross-functional teams to deliver AI-powered products.
• Design, develop, test, deploy, and support AI software components including foundation model training and LLM inference.
• Leverage Open Source and SaaS AI tech such as AWS Ultraclusters, Huggingface, VectorDBs, Nemo Guardrails, PyTorch, etc.
• Invent LLM optimization techniques to improve performance, cost, latency, and throughput.
• Contribute to the technical vision and long-term roadmap of foundational AI systems at Capital One.

Education

Bachelor's degree in Computer Science, AI, Electrical Engineering, Computer Engineering, or related fields

Master's degree in Computer Science, AI, Electrical Engineering, Computer Engineering, or related fields

Tools

Python

Go

Scala

Java

AWS

Google Cloud

Azure

Huggingface

PyTorch

VectorDBs

Nemo Guardrails

Job description

Capital One is seeking a Lead AI Engineer to advance AI foundations and VLM customization in a collaborative, cross-functional environment in New York, NY. The role emphasizes building scalable AI systems, coupling state-of-the-art ML with production-grade software.

You will work to optimize training and inference pipelines, deploy AI services, and contribute to the roadmap of foundational AI systems across Capital One. A strong mathematical and engineering foundation is required.