Senior Lead AI Engineer: GenAI Platform Services

Capital One; New York (NY); On-site; USD 251,000 - 286,000; Full time

Job summary

Capital One is seeking a Senior Lead AI Engineer to help build responsible AI systems and scalable AI infrastructure. You will collaborate with engineers, researchers, and product managers to deliver AI-powered products that transform how customers and associates interact with Capital One.

The role requires deep expertise in ML/AI, strong software engineering skills, and the ability to drive architectural decisions, optimize training and inference, and mentor teams.

Qualifications

• Bachelor’s degree in Computer Science, AI, Electrical Engineering, Computer Engineering, or related fields plus at least 6 years of experience developing AI and ML algorithms or technologies, or a Master’s degree plus at least 4 years of experience.
• At least 6 years of experience programming with Python, Go, Scala, or Java.
• Experience deploying scalable AI solutions on cloud platforms (AWS, Google Cloud, Azure, or equivalent private cloud).
• Demonstrated ability to lead and mentor an engineering team and influence cross‑functional stakeholders.
• Experience developing AI/ML algorithms or technologies (e.g. LLM Inference, Similarity Search and VectorDBs, Guardrails, Memory) using Python, C, C#, Java, or Golang.

Responsibilities

• Partner with a cross-functional team of engineers, research scientists, technical program managers, and product managers to deliver AI-powered products.
• Design, develop, test, deploy, and support AI software components including foundation model training, large language model inference, similarity search, guardrails, model evaluation, experimentation, governance, and observability.
• Leverage a broad stack of Open Source and SaaS AI technologies such as AWS Ultraclusters, Huggingface, VectorDBs, Nemo Guardrails, PyTorch, and more.
• Invent and introduce state‑of‑the‑art LLM optimization techniques to improve performance, scalability, cost, latency, throughput of large-scale production AI systems.
• Contribute to the technical vision and the long term roadmap of foundational AI systems at Capital One.

Skills

Python/Go/Scala/Java

Education

Bachelor’s degree in CS/AI/EE/CE

Master’s degree in CS/AI/EE/CE

Tools

AWS Ultraclusters

Huggingface

VectorDBs

Nemo Guardrails

PyTorch

Job description

Capital One is seeking a Senior Lead AI Engineer to help build responsible AI systems and scalable AI infrastructure. You will collaborate with engineers, researchers, and product managers to deliver AI-powered products that transform how customers and associates interact with Capital One.

The role requires deep expertise in ML/AI, strong software engineering skills, and the ability to drive architectural decisions, optimize training and inference, and mentor teams.