Senior AI Engineer: LLM & Foundation Models

Capital One National Association; San Jose (CA); On-site; USD 251,000 - 286,000; Full time

Job summary

Capital One seeks a senior AI/ML engineer to join the IFX team in San Jose. You will collaborate with engineers, researchers, and product managers to build AI-powered banking experiences, integrating foundation models, vector search, and governance into scalable production systems.

You will work with Open Source and SaaS AI stacks (AWS, HuggingFace, PyTorch) to optimize throughput, cost, and latency while mentoring junior engineers.

Qualifications

• Bachelor's or Master’s degree with relevant AI/ML focus and several years’ experience.
• At least 6 years of experience programming with Python, Go, Scala, CUDA, or Java.
• Experience deploying scalable AI/ML systems and cloud platforms.

Responsibilities

• Partner with cross-functional team to deliver AI-powered products.
• Design, develop, test, deploy, and support AI software components.
• Leverage Open Source and SaaS AI technologies.
• Invent optimization techniques to improve performance and cost.
• Contribute to technical vision and long-term roadmap for foundational AI systems.
• Design and optimize multi-model orchestration pipelines for LLMs and vector search.
• Lead governance reviews; track GPU utilization and inference cost efficiency.
• Mentor engineers and elevate technical maturity.

Skills

Python

Go

Scala

CUDA

Java

Education

Bachelor's degree in CS/AI/EE/CE or related

Master's degree in CS/AI/EE/CE or related

Tools

AWS

Huggingface

PyTorch

VectorDBs

Job description

Capital One seeks a senior AI/ML engineer to join the IFX team in San Jose. You will collaborate with engineers, researchers, and product managers to build AI-powered banking experiences, integrating foundation models, vector search, and governance into scalable production systems.

You will work with Open Source and SaaS AI stacks (AWS, HuggingFace, PyTorch) to optimize throughput, cost, and latency while mentoring junior engineers.