Senior Gen AI Platform Engineer

Capital One; New York (NY); On-site; USD 215,000 - 246,000; Full time

Job summary

Capital One is seeking a Lead AI Engineer for Gen AI Platform Services in New York, focusing on Agentic AI, guardrails, memory, and evaluation. You will collaborate with engineers, researchers, and PMs to build scalable AI-powered products for customers and associates.

You will design and deploy AI components, optimize LLM inference, and contribute to governance, observability, and platform-wide reliability across multiple environments.

Qualifications

• Bachelor’s degree in Computer Science, AI, Electrical Engineering, Computer Engineering, or related fields plus 4+ years of AI/ML experience
• Master’s degree plus 2+ years of AI/ML experience
• 4+ years programming in Python/Go/Scala/Java

Responsibilities

• Partner with cross-functional team to deliver AI-powered products
• Design, develop, test, deploy, and support AI software components
• Leverage Open Source and SaaS AI technologies (AWS Ultraclusters, Huggingface, VectorDBs, Nemo Guardrails, PyTorch)
• Invent and apply LLM optimization techniques to improve performance and cost
• Contribute to long-term AI system roadmap at Capital One

Skills

Python

Go

Scala

Java

Education

Bachelor’s degree in CS/AI/EE/CE or related

Master’s degree in CS/AI/EE/CE or related

Tools

AWS Ultraclusters

Huggingface

VectorDBs

Nemo Guardrails

PyTorch

Job description

Capital One is seeking a Lead AI Engineer for Gen AI Platform Services in New York, focusing on Agentic AI, guardrails, memory, and evaluation. You will collaborate with engineers, researchers, and PMs to build scalable AI-powered products for customers and associates.

You will design and deploy AI components, optimize LLM inference, and contribute to governance, observability, and platform-wide reliability across multiple environments.