Senior AI Platform Engineer — Generative AI

Capital One; New York (NY); On-site; USD 250,800 - 286,200; Full time

Job summary

Capital One in New York, NY is seeking a Sr Lead AI Engineer to help build responsible AI systems and scalable AI infrastructure. You will work with engineers, researchers, PMs to deploy AI-powered products that transform banking.

The role emphasizes cutting-edge techniques in LLMs, vector databases, guardrails, and performance optimization, with opportunities to lead and mentor teams; salary ranges are provided for the New York location.

Qualifications

• Bachelor's or Master's degree in Computer Science, AI, Electrical Engineering, Computer Engineering, or related fields with required experience.
• At least 6 years of experience programming with Python, Go, Scala, or Java.
• Experience with AI/ML algorithm development and production systems.

Responsibilities

• Partner with cross-functional team to deliver AI-powered products that change how associates work and how customers interact with Capital One.
• Design, develop, test, deploy, and support AI software components including foundation model training, LLM inference, similarity search, guardrails, model evaluation, experimentation, governance, and observability.
• Leverage Open Source and SaaS AI technologies such as AWS Ultraclusters, Huggingface, VectorDBs, Nemo Guardrails, PyTorch, and more.
• Invent and introduce state-of-the-art LLM optimization techniques to improve performance, scalability, cost, latency, throughput, and reliability.
• Contribute to the technical vision and long-term roadmap of foundational AI systems at Capital One.

Skills

Python

Go

Scala

Java

LLM Inference

VectorDBs

Guardrails

Cloud platforms

Leadership

Education

Bachelor's degree in CS/AI/EE/CE

Master's degree in CS/AI/EE/CE

Job description

Capital One in New York, NY is seeking a Sr Lead AI Engineer to help build responsible AI systems and scalable AI infrastructure. You will work with engineers, researchers, PMs to deploy AI-powered products that transform banking.

The role emphasizes cutting-edge techniques in LLMs, vector databases, guardrails, and performance optimization, with opportunities to lead and mentor teams; salary ranges are provided for the New York location.