Senior Lead AI Engineer, GenAI Platform & Agentic Systems

Capital One; New York (NY); On-site; USD 251,000 - 286,000; Full time

Job summary

Capital One is seeking a Senior Lead AI Engineer to help design and deliver AI-powered products with a cross-functional team of engineers, researchers, program managers, and product managers. You will shape foundational AI systems for scalable, responsible use in banking.

You will work on foundation models, LLM inference, guardrails, evaluation, governance, and observability using a broad stack of Open Source and SaaS technologies across AWS and other clouds.

Qualifications

• Bachelor's degree in Computer Science, AI, Electrical Engineering, Computer Engineering, or related fields plus at least 6 years of experience developing AI/ML algorithms or technologies.
• At least 6 years of experience programming with Python, Go, Scala, or Java.

Responsibilities

• Partner with cross-functional teams to deliver AI-powered products that change how associates work and how customers interact with Capital One.
• Design, develop, test, deploy, and support AI software components including foundation model training, large language model inference, similarity search, guardrails, model evaluation, experimentation, governance, and observability.
• Leverage Open Source and SaaS AI technologies such as AWS Ultraclusters, Huggingface, VectorDBs, Nemo Guardrails, PyTorch, and more.
• Invent and introduce state-of-the-art LLM optimization techniques to improve performance, scalability, cost, latency, throughput of large-scale production AI systems.
• Contribute to the technical vision and long-term roadmap of foundational AI systems at Capital One.

Skills

Python

Go

Scala

Java

Cloud deployment

Leadership

Education

Bachelor's degree in CS/AI/EE/CE or related + 6 yrs exp

Master's degree in CS/AI/EE/CE or related + 4 yrs exp

Tools

AWS/GCP/Azure

HuggingFace

VectorDBs

Nemo Guardrails

PyTorch

Job description

Capital One is seeking a Senior Lead AI Engineer to help design and deliver AI-powered products with a cross-functional team of engineers, researchers, program managers, and product managers. You will shape foundational AI systems for scalable, responsible use in banking.

You will work on foundation models, LLM inference, guardrails, evaluation, governance, and observability using a broad stack of Open Source and SaaS technologies across AWS and other clouds.