Lead AI Engineer – Foundations & LLM Systems

Capital One; New York (NY); On-site; USD 215,000 - 246,000; Full time

Job summary

Capital One is seeking a Lead AI Engineer to help build responsible, scalable AI foundations. You will work with cross-functional teams to deploy AI components, optimize LLM performance, and shape the long-term AI strategy.

The role emphasizes production-ready systems, governance, and cost-aware inference across models and platforms. The ideal candidate has a strong CS/AI foundation, cloud experience, and a track record of delivering AI services.

Qualifications

• Bachelor's degree plus 4+ years AI/ML experience or Master's with 2+ years experience.
• 4+ years coding in Python, Go, Scala or Java.
• Experience deploying scalable AI solutions on cloud platforms.

Responsibilities

• Partner with engineers, researchers, PMs to deliver AI products.
• Design, develop, test, deploy and support AI software components.
• Leverage Open Source and SaaS AI technologies (AWS, Huggingface, PyTorch).
• Invent LLM optimization techniques for performance and cost.
• Contribute to technical vision and long-term roadmap for AI systems.

Skills

Python

Go

Scala

Java

Education

Bachelor's degree in Computer Science / AI / Electrical Engineering / Computer Engineering or related field

Master's degree in Computer Science / AI / Electrical Engineering / Computer Engineering or related field

Tools

AWS

Google Cloud

Azure

VectorDBs

Nemo Guardrails

PyTorch

Huggingface

Job description

Capital One is seeking a Lead AI Engineer to help build responsible, scalable AI foundations. You will work with cross-functional teams to deploy AI components, optimize LLM performance, and shape the long-term AI strategy.

The role emphasizes production-ready systems, governance, and cost-aware inference across models and platforms. The ideal candidate has a strong CS/AI foundation, cloud experience, and a track record of delivering AI services.