Lead AI Engineer, Foundations & LLM Systems

Capital One Group; New York, Northern (NY, KY); Hybrid; USD 215,000 - 246,000; Full time

Benefits offered by this job

Benefits package

Job summary

Capital One is seeking a Lead AI Engineer (AI Foundations) in New York, NY to design, build, and operate AI software components including foundation model training, LLM inference, and vector search within a scalable AI platform.

You will work with cross-functional teams, leverage Open Source and SaaS technologies like AWS, HuggingFace, PyTorch, and Guardrails, and help advance responsible AI practices across the enterprise.

Qualifications

• Bachelor's degree in CS/AI/EE/CE or related fields plus 4+ years of AI/ML experience, or a Master's degree plus 2+ years of AI/ML experience.
• At least 4 years of experience programming with Python, Go, Scala, or Java.
• Experience deploying scalable and responsible AI solutions on cloud platforms (AWS, Google Cloud, Azure) is preferred.
• Experience designing, delivering, and supporting AI services; knowledge of LLM inference, vector databases, guardrails, and memory management.

Responsibilities

• Partner with cross-functional teams to deliver AI-powered products.
• Design, develop, test, deploy, and support AI software components (foundation models, LLM inference, similarity search, guardrails, evaluation, governance, observability).
• Leverage Open Source and SaaS AI technologies (AWS Ultraclusters, HuggingFace, VectorDBs, Nemo Guardrails, PyTorch).
• Contribute to long-term technical vision and roadmap for foundational AI systems at Capital One.

Skills

Technical foundation

Education

Bachelor's degree in CS/AI/EE/CE or related fields

Master's degree in CS/AI/EE/CE or related fields

Tools

Python

Go

Scala

Java

AWS

Google Cloud

Azure

HuggingFace

PyTorch

VectorDBs

Nemo Guardrails

Job description

Capital One is seeking a Lead AI Engineer (AI Foundations) in New York, NY to design, build, and operate AI software components including foundation model training, LLM inference, and vector search within a scalable AI platform.

You will work with cross-functional teams, leverage Open Source and SaaS technologies like AWS, HuggingFace, PyTorch, and Guardrails, and help advance responsible AI practices across the enterprise.