Lead AI Engineer: Emerging AI Patterns & Scalable AI

Capital One National Association; New York (NY); On-site; USD 215,200 - 245,600; Full time

Job summary

Capital One in New York, NY is seeking a Lead AI Engineer to advance responsible, scalable AI systems and real-time ML-powered experiences for customers and partners.

You will collaborate with engineers, researchers, and product managers to deploy AI services, optimize LLM inference, and build observability into production AI systems, while contributing to the roadmap of foundational AI platforms at Capital One.

Qualifications

• Bachelor's degree in CS/AI/EE/CE or related fields plus at least 4 years of experience developing AI/ML algorithms or technologies.
• At least 4 years of experience programming with Python, Go, Scala, or Java

Responsibilities

• Partner with a cross-functional team of engineers, researchers, PMs, and product managers to deliver AI-powered products.
• Design, develop, test, deploy, and support AI software components including foundation model training, LLM inference, similarity search, guardrails, model evaluation, experimentation, governance, and observability.
• Leverage Open Source and SaaS AI technologies such as AWS Ultraclusters, Huggingface, VectorDBs, Nemo Guardrails, PyTorch, and more.
• Invent and introduce state-of-the-art LLM optimization techniques to improve performance, scalability, cost, latency, throughput.
• Contribute to the technical vision and long-term roadmap of foundational AI systems at Capital One.

Skills

Python

Go

Scala

Java

Education

Bachelor's degree in CS/AI/EE/CE or related

Master's degree in CS/AI/EE/CE or related

Tools

AWS Ultraclusters

Huggingface

VectorDBs

Nemo Guardrails

PyTorch

Job description

Capital One in New York, NY is seeking a Lead AI Engineer to advance responsible, scalable AI systems and real-time ML-powered experiences for customers and partners.

You will collaborate with engineers, researchers, and product managers to deploy AI services, optimize LLM inference, and build observability into production AI systems, while contributing to the roadmap of foundational AI platforms at Capital One.