Senior AI Engineer — LLM & Foundation Models

Capital One; San Jose (CA); On-site; USD 251,000 - 286,000; Full time

Job summary

Capital One seeks an AI Engineer 5 to join the IFX team in San Jose, CA. You will design, implement, and optimize AI software components, including foundation model training, LLM inference, and multi‑model workflows, in a fast-moving, production environment.

You'll collaborate with engineers, scientists, PMs, and product partners to deliver scalable AI solutions that power real-time, personalized banking experiences while upholding responsible AI practices and governance standards.

Qualifications

• Bachelor’s degree in CS/AI/EE/CE or related field with 6+ years AI/ML experience, or Master’s with 4+ years.
• 6+ years of programming in Python, Go, Scala, CUDA or Java.
• Experience leading AI systems with cost, latency, throughput trade-offs.
• Experience deploying scalable AI solutions on cloud platforms (AWS, GCP, Azure).
• Experience with LLM inference, similarity search, VectorDBs, guardrails.

Responsibilities

• Deliver AI-powered products that transform how associates work and customers interact with Capital One.
• Design, develop, test, deploy and support AI software components including foundation model training and LLM inference.
• Build multi-model orchestration pipelines and integrate vector search with domain models.
• Optimize performance, cost, latency and throughput of large-scale AI systems.
• Lead design reviews, governance and cost-reliability reviews; mentor engineers.

Skills

Python

Go

Scala

CUDA

Java

Education

Bachelor’s degree in CS/AI/EE/CE

Master’s degree in CS/AI/EE/CE

Tools

AWS Ultraclusters

Huggingface

VectorDBs

PyTorch

Job description

Capital One seeks an AI Engineer 5 to join the IFX team in San Jose, CA. You will design, implement, and optimize AI software components, including foundation model training, LLM inference, and multi‑model workflows, in a fast-moving, production environment.

You'll collaborate with engineers, scientists, PMs, and product partners to deliver scalable AI solutions that power real-time, personalized banking experiences while upholding responsible AI practices and governance standards.