Senior Lead AI Engineer: LLM Foundations & Optimizations

Capital One; New York (NY); On-site; USD 251,000 - 286,000; Full time

Job summary

Capital One is seeking a Senior Lead AI Engineer to drive AI foundations, including model training and inference, on a high-performance platform. You will collaborate with engineers, researchers, PMs, and partners to deploy scalable AI capabilities across products and services.

You will work on optimization techniques for latency, cost, and throughput, while contributing to the roadmap of foundational AI systems at Capital One. The role supports innovation and responsible AI practices.

Qualifications

• Bachelor's degree in CS/AI/EE/CE or related field with 6+ years in AI/ML.
• Alternatively Master's in CS/AI/EE/CE with 4+ years in AI/ML.
• 6+ years of programming experience in Python, Go, Scala, or Java.

Responsibilities

• Partner with a cross-functional team to deliver AI-powered products.
• Design, develop, test, deploy, and support AI software components including training and inference.
• Leverage Open Source and SaaS AI technologies such as AWS Ultraclusters, Huggingface, VectorDBs, Nemo Guardrails, PyTorch.
• Invent and introduce state-of-the-art LLM optimization techniques for production systems.
• Contribute to the technical vision and long-term roadmap of foundational AI systems.

Skills

Python

Go

Scala

Java

LLM Inference

VectorDBs

PyTorch

HuggingFace

Guardrails

Memory

Education

Bachelor's degree in Computer Science, AI, Electrical Engineering, Computer Engineering, or related fields

Master's degree in Computer Science, AI, Electrical Engineering, Computer Engineering, or related fields

Tools

AWS

Google Cloud

Azure

Nemo Guardrails

VectorDBs

Job description

Capital One is seeking a Senior Lead AI Engineer to drive AI foundations, including model training and inference, on a high-performance platform. You will collaborate with engineers, researchers, PMs, and partners to deploy scalable AI capabilities across products and services.

You will work on optimization techniques for latency, cost, and throughput, while contributing to the roadmap of foundational AI systems at Capital One. The role supports innovation and responsible AI practices.