Lead AI Engineer for Emerging AI Patterns & Scalable LLMs

Capital One

San Jose (CA)

On-site

USD 180,000 - 250,000

Full time

14 days+

Get more replies from employers

Send a job-specific resume in minutes.

Job summary

Capital One's Lead AI Engineer role sits in the Intelligent Foundations and Experiences (IFX) team, building responsible and scalable AI systems for banking. You will partner with engineers, researchers, PMs, and product managers to deliver AI-powered products that improve associate and customer interactions, from foundation models to deployment and observability.

The role requires hands-on experience with Python, cloud platforms, and AI services, plus a track record of shipping production-grade

Qualifications

Bachelor’s degree in CS/AI/EE with 4+ years of AI/ML experience or Master’s with 2+ years.
4+ years Python, Go, Scala, or Java experience.
6+ years deploying AI on AWS/GCP/Azure.
Experience designing AI services and LLM inference.
Strong interest in cutting-edge AI research and production.

Responsibilities

Partner with engineers, researchers, PMs, and product managers to deliver AI-powered products that improve associate and customer interactions.
Design, develop, test, deploy, and support AI software components including foundation model training, large language model inference, similarity search, guardrails, model evaluation, experimentation, governance, and observability.
Leverage Open Source and SaaS AI technologies such as AWS Ultraclusters, Hugging Face, VectorDBs, Nemo Guardrails, PyTorch, and related tools.
Invent and introduce state-of-the-art LLM optimization techniques to enhance performance, scalability, cost, latency, and throughput of production AI systems.
Contribute to the technical vision and long-term roadmap for foundational AI systems at Capital One.