Lead AI Engineer (MLX Emerging AI Patterns)

Capital One; San Jose (CA); On-site; USD 180,000 - 250,000; Full time

Job summary

Capital One's Lead AI Engineer role sits in the Intelligent Foundations and Experiences (IFX) team, building responsible and scalable AI systems for banking. You will partner with engineers, researchers, PMs, and product managers to deliver AI-powered products that improve associate and customer interactions, from foundation models to deployment and observability.

The role requires hands-on experience with Python, cloud platforms, and AI services, plus a track record of shipping production-grade

Qualifications

• Bachelor’s degree in CS/AI/EE with 4+ years of AI/ML experience or Master’s with 2+ years.
• 4+ years Python, Go, Scala, or Java experience.
• 6+ years deploying AI on AWS/GCP/Azure.
• Experience designing AI services and LLM inference.
• Strong interest in cutting-edge AI research and production.

Responsibilities

• Partner with engineers, researchers, PMs, and product managers to deliver AI-powered products that improve associate and customer interactions.
• Design, develop, test, deploy, and support AI software components including foundation model training, large language model inference, similarity search, guardrails, model evaluation, experimentation, governance, and observability.
• Leverage Open Source and SaaS AI technologies such as AWS Ultraclusters, Hugging Face, VectorDBs, Nemo Guardrails, PyTorch, and related tools.
• Invent and introduce state-of-the-art LLM optimization techniques to enhance performance, scalability, cost, latency, and throughput of production AI systems.
• Contribute to the technical vision and long-term roadmap for foundational AI systems at Capital One.

Skills

Python

Cloud platforms

LLM inference

AI services

Collaboration

Education

Bachelor’s degree in CS/AI/EE

Master’s degree

Tools

PyTorch

Hugging Face

VectorDBs

Nemo Guardrails

AWS

GCP

Azure

Job description

Lead AI Engineer (MLX Emerging AI Patterns)

Lead AI Engineer at Capital One will be a part of the Intelligent Foundations and Experiences (IFX) team, focusing on building responsible and scalable AI systems to transform banking.

Responsibilities

• Partner with engineers, research scientists, PMs, and product managers to deliver AI‑powered products that improve associate and customer interactions.
• Design, develop, test, deploy, and support AI software components including foundation model training, large language model inference, similarity search, guardrails, model evaluation, experimentation, governance, and observability.
• Leverage Open Source and SaaS AI technologies such as AWS Ultraclusters, Hugging Face, VectorDBs, Nemo Guardrails, PyTorch, and related tools.
• Invent and introduce state‑of‑the‑art LLM optimization techniques to enhance performance, scalability, cost, latency, and throughput of production AI systems.
• Contribute to the technical vision and long‑term roadmap for foundational AI systems at Capital One.

Qualifications

• Bachelor’s degree in Computer Science, AI, Electrical Engineering, Computer Engineering, or related field with at least 4 years of experience developing AI and ML algorithms or technologies, OR Master’s degree with at least 2 years of experience.
• At least 4 years of experience programming with Python, Go, Scala, or Java.
• 6+ years of experience deploying scalable and responsible AI solutions on cloud platforms (e.g., AWS, GCP, Azure).
• Experience designing, developing, delivering, and supporting AI services.
• Experience developing AI and ML algorithms or technologies (LLM inference, similarity search, vector databases, guardrails, memory).
• Experience developing and applying state‑of‑the‑art techniques for optimizing training and inference software to improve hardware utilization, latency, throughput, and cost.
• Passion for staying abreast of the latest AI research and applying novel techniques in production.

Benefits

Capital One offers a comprehensive, competitive, and inclusive set of health, financial, and other benefits supporting total well‑being, including performance‑based incentive compensation and long‑term incentives.

Equal Opportunity Employer

Capital One is an equal opportunity employer (EOE, including disability/vet) committed to non‑discrimination in compliance with applicable federal, state, and local laws.