Lead AI Platform Engineer - Gen AI & Guardrails

Capital One; New York (NY); On-site; USD 215,000 - 246,000; Full time

Job summary

Capital One is seeking a Lead AI Engineer for Gen AI Platform Services, focusing on agentic AI, guardrails, evaluation, and memory. You will partner with engineers, researchers, PMs, and managers to build AI-powered banking solutions and scalable AI infrastructure.

You will design and deploy AI components, optimize LLM performance, and contribute to the platform's long-term roadmap, leveraging AWS, Huggingface, and PyTorch in a cross-functional setting.

Qualifications

• Bachelor's degree in Computer Science, AI, Electrical Engineering, Computer Engineering, or related fields plus 4+ years of experience developing AI/ML algorithms or technologies.
• At least 4 years of experience programming with Python, Go, Scala, or Java.
• 6 years of experience deploying scalable and responsible AI solutions on cloud platforms (AWS, Google Cloud, Azure) (preferred).

Responsibilities

• Partner with a cross-functional team of engineers, research scientists, TPMs, and product managers to deliver AI-powered products.
• Design, develop, test, deploy, and support AI software components including foundation model training, LLM inference, similarity search, guardrails, model evaluation, experimentation, governance, and observability.
• Leverage Open Source and SaaS AI technologies such as AWS Ultraclusters, Huggingface, VectorDBs, Nemo Guardrails, PyTorch.
• Invent and introduce state-of-the-art LLM optimization techniques to improve performance, scalability, cost, latency, throughput.
• Contribute to the technical vision and long-term roadmap of foundational AI systems at Capital One.

Skills

Python

Java

Go

Scala

Education

Bachelor's degree in Computer Science/AI/EE/CE

Master's degree in Computer Science/AI/EE/CE

Tools

AWS Ultraclusters

Huggingface

VectorDBs

Nemo Guardrails

PyTorch

Job description

Capital One is seeking a Lead AI Engineer for Gen AI Platform Services, focusing on agentic AI, guardrails, evaluation, and memory. You will partner with engineers, researchers, PMs, and managers to build AI-powered banking solutions and scalable AI infrastructure.

You will design and deploy AI components, optimize LLM performance, and contribute to the platform's long-term roadmap, leveraging AWS, Huggingface, and PyTorch in a cross-functional setting.