Lead AI Foundations Engineer for Scalable LLM Systems

Capital One; New York (NY); On-site; USD 251,000 - 286,000; Full time

Job summary

Capital One in New York, NY seeks a Sr Lead AI Engineer to design and scale AI-powered financial products. You will partner with engineers, scientists, and product managers to deliver foundation model training, inference, and governance across a broad AI stack.

The role emphasizes research-driven optimization, observable performance, and scalable systems. You will mentor an engineering team, influence roadmaps, and apply cutting-edge techniques in production to improve latency, throughput, and

Qualifications

• Bachelor’s or Master’s in CS/AI/EE/CE with relevant AI/ML experience.
• 6+ years coding in Python, Go, Scala, or Java with AI/ML focus.
• Experience deploying scalable AI on cloud platforms and leading teams.

Responsibilities

• Partner with engineers, researchers, PMs to deliver AI-powered products.
• Design, develop, test, deploy AI software components including foundation models.
• Leverage Open Source and SaaS AI tech like AWS, HuggingFace, VectorDBs, PyTorch.
• Invent state-of-the-art LLM optimization techniques for performance and cost.
• Contribute to long-term foundational AI system roadmaps at Capital One.

Skills

Python

Go

Java

ML algorithms

Distributed systems

Education

Bachelor's degree in CS/AI/EE/CE

Master's degree in CS/AI/EE/CE

Tools

PyTorch

HuggingFace

VectorDBs

Nemo Guardrails

AWS

Job description

Capital One in New York, NY seeks a Sr Lead AI Engineer to design and scale AI-powered financial products. You will partner with engineers, scientists, and product managers to deliver foundation model training, inference, and governance across a broad AI stack.

The role emphasizes research-driven optimization, observable performance, and scalable systems. You will mentor an engineering team, influence roadmaps, and apply cutting-edge techniques in production to improve latency, throughput, and