Senior Lead AI Engineer - GenAI Platform & Infra

Capital One; New York (NY); On-site; USD 251,000 - 286,000; Full time

Job summary

Capital One is seeking a Sr. Lead AI Engineer to advance our AI foundations within the Intelligent Foundations and Experiences (IFX) team in New York, NY.

You will partner with engineers, researchers, and PMs to deliver scalable AI-powered products that enhance customer and associate experiences. The role involves training foundation models, LLM inference, and optimizing AI workloads across cloud platforms.

Qualifications

• Bachelor's degree in Computer Science, AI, Electrical Engineering, Computer Engineering, or related fields plus at least 6 years of experience developing AI and ML algorithms or technologies, or a Master's degree in Computer Science, AI, Electrical Engineering, Computer Engineering, or related fields plus at least 4 years of experience developing AI and ML algorithms or technologies
• At least 6 years of experience programming with Python, Go, Scala, or Java

Responsibilities

• Partner with a cross-functional team of engineers, research scientists, technical program managers, and product managers to deliver AI-powered products that change how our associates work and how our customers interact with Capital One
• Design, develop, test, deploy, and support AI software components including foundation model training, large language model inference, similarity search, guardrails, model evaluation, experimentation, governance, and observability
• Leverage a broad stack of Open Source and SaaS AI technologies such as AWS Ultraclusters, Huggingface, VectorDBs, Nemo Guardrails, PyTorch, and more
• Invent and introduce state-of-the-art LLM optimization techniques to improve the performance - scalability, cost, latency, throughput - of large scale production AI systems
• Contribute to the technical vision and the long term roadmap of foundational AI systems at Capital One

Skills

Python

Go

Scala

Java

LLM Inference

VectorDBs

Guardrails

Memory

Education

Bachelor's or Master's degree in CS/AI/EE/CE or related field

Job description

Capital One is seeking a Sr. Lead AI Engineer to advance our AI foundations within the Intelligent Foundations and Experiences (IFX) team in New York, NY.

You will partner with engineers, researchers, and PMs to deliver scalable AI-powered products that enhance customer and associate experiences. The role involves training foundation models, LLM inference, and optimizing AI workloads across cloud platforms.