Lead AI Engineer — Scalable LLM Systems

Capital One

New York (NY)

On-site

USD 215,200 - 245,600

Full time

14 days+

Get more replies from employers

Send a job-specific resume in minutes.

Job summary

Capital One is seeking a Lead AI Engineer in New York to design, deploy, and scale AI-powered banking solutions. You will work with a cross-functional team to build foundation models, inference services, and guardrails, leveraging AWS, HuggingFace, PyTorch, and VectorDBs.

The role emphasizes responsible AI, performance optimization, and a long-term architectural vision across Capital One's AI platforms, collaborating with engineers, scientists, PMs, and data professionals.

Qualifications

Bachelor's degree in Computer Science, AI, Electrical Engineering, Computer Engineering, or related fields with 4+ years of experience developing AI and ML algorithms or technologies.
At least 4 years of experience programming with Python, Go, Scala, or Java.

Responsibilities

Partner with a cross-functional team to deliver AI-powered products that change how associates work and how customers interact with Capital One.
Design, develop, test, deploy, and support AI software components including foundation model training, LLM inference, similarity search, guardrails, model evaluation, experimentation, governance, and observability.
Leverage a broad stack of Open Source and SaaS AI technologies such as AWS Ultraclusters, HuggingFace, VectorDBs, Nemo Guardrails, PyTorch, and more.
Invent and introduce state-of-the-art LLM optimization techniques to improve performance, scalability, cost, latency, and throughput of large-scale production AI systems.
Contribute to the technical vision and long-term roadmap of foundational AI systems at Capital One.