Lead AI Platform Engineer: Gen AI & Agentic Systems

Capital One Group; New York (NY); On-site; USD 215,000 - 246,000; Full time

Job summary

Capital One is seeking an AI Engineer to design, develop, and deploy AI-powered products. You will work with engineers, researchers, PMs, and data scientists to build scalable AI systems, focusing on foundation models, inference, and governance.

The team drives observable, responsible AI across the platform and collaborates with infrastructure to optimize GPU/TPU usage. You will mentor senior associates, contribute to long-term AI roadmaps, and ensure security and compliance in deployments.

Qualifications

• Bachelor's or Master's with AI/ML focus and required years of experience.
• Proficient in Python and at least one of Go/Scala/Java.
• Experience with AI model training, inference, and governance.

Responsibilities

• Partner with cross-functional engineers, researchers, PMs to deliver AI-powered products.
• Design, develop, test, deploy, and support AI software components.
• Leverage Open Source and SaaS AI technologies (e.g., AWS Ultraclusters, Huggingface, PyTorch).
• Invent and apply foundation model optimization techniques for performance, cost, latency, throughput.
• Contribute to the technical vision and long-term roadmap of foundational AI systems.
• Own end-to-end architecture for complex AI systems with observability and governance.

Skills

Python

Go

Scala

CUDA

Java

Education

Bachelor's Degree in Computer Science or related field

Master's Degree in related fields

Tools

AWS

Huggingface

PyTorch

VectorDBs

Job description

Capital One is seeking an AI Engineer to design, develop, and deploy AI-powered products. You will work with engineers, researchers, PMs, and data scientists to build scalable AI systems, focusing on foundation models, inference, and governance.

The team drives observable, responsible AI across the platform and collaborates with infrastructure to optimize GPU/TPU usage. You will mentor senior associates, contribute to long-term AI roadmaps, and ensure security and compliance in deployments.