Lead AI Engineer, IFX — Build Scalable, Responsible AI

Capital One; New York (NY); On-site; USD 215,000 - 246,000; Full time

Job summary

Capital One is seeking a Lead AI Engineer for the Intelligent Foundations and Experiences (IFX) team to design, deploy, and scale AI-powered banking solutions. You will collaborate with engineers, researchers, PMs, and product partners to build production-grade AI components, including foundation models, inference pipelines, and guardrails.

You will optimize LLM performance across latency, cost, and throughput, apply cutting-edge research to production, and contribute to the long-term roadmap of

Qualifications

• Bachelor's degree in Computer Science, AI, Electrical Engineering, Computer Engineering, or related fields plus at least 4 years of experience developing AI/ML algorithms or technologies.
• Master's degree in Computer Science, AI, Electrical Engineering, Computer Engineering, or related fields plus at least 2 years of experience developing AI/ML algorithms or technologies.
• At least 4 years of experience programming with Python, Go, Scala, or Java

Responsibilities

• Partner with a cross-functional team of engineers, researchers, PMs, and product managers to deliver AI-powered products.
• Design, develop, test, deploy, and support AI software components including foundation model training, LLM inference, similarity search, guardrails, evaluation, governance, and observability.
• Leverage a broad stack of Open Source and SaaS AI technologies such as AWS Ultraclusters, Huggingface, VectorDBs, Nemo Guardrails, PyTorch, and more.
• Invent and introduce state-of-the-art LLM optimization techniques to improve performance, scalability, cost, latency, throughput.

Skills

Python

Java

AI systems

Education

Bachelor's degree in CS/AI/EE

Master's degree in CS/AI/EE

Tools

AWS

HuggingFace

VectorDBs

Nemo Guardrails

PyTorch

Job description

Capital One is seeking a Lead AI Engineer for the Intelligent Foundations and Experiences (IFX) team to design, deploy, and scale AI-powered banking solutions. You will collaborate with engineers, researchers, PMs, and product partners to build production-grade AI components, including foundation models, inference pipelines, and guardrails.

You will optimize LLM performance across latency, cost, and throughput, apply cutting-edge research to production, and contribute to the long-term roadmap of