Senior AI Foundations Engineer

Capital One National Association; San Jose (CA); On-site; USD 251,000 - 286,000; Full time

Job summary

Capital One is building responsible AI systems to reimagine banking and deliver scalable value to millions of customers. The IFX team partners across the company to deploy AI models and platforms that empower products with responsible, high-performance AI infrastructure.

You will design, develop, and deploy AI software components including foundation model training, large language model inference, agents and multi‑agent workflows, similarity search, guardrails, model evaluation, and

Qualifications

• Bachelor's or Master's degree in a relevant field with years of AI/ML experience as specified.
• 6+ years programming in Python, Go, Scala, CUDA, or Java.
• Experience leading AI systems with cost, latency, throughput tradeoffs.

Responsibilities

• Partner with cross-functional teams to deliver AI-powered products.
• Design, develop, test, deploy, and support AI software components (foundation model training, LLM inference, agents, and workflows).
• Leverage Open Source and SaaS AI technologies (AWS Ultraclusters, Huggingface, VectorDBs, PyTorch).
• Optimize foundation model performance for scale, cost, latency, and throughput.
• Contribute to the technical vision and long-term roadmap for foundational AI at Capital One.
• Design and optimize multi-model orchestration pipelines integrating LLMs, vector search, and domain models.
• Lead governance reviews on GPU utilization, throughput, and inference cost efficiency.
• Lead design councils to ensure consistency with AI engineering standards.
• Mentor Principal and Manager-level AI engineers to raise technical maturity.

Skills

Python

Go

Scala

CUDA

Java

Education

Bachelor's degree in Computer Science, AI, Electrical Engineering, Computer Engineering, or related fields

Master's degree in Computer Science, AI, Electrical Engineering, Computer Engineering, or related fields

Tools

AWS Ultraclusters

Huggingface

VectorDBs

PyTorch

Job description

Capital One is building responsible AI systems to reimagine banking and deliver scalable value to millions of customers. The IFX team partners across the company to deploy AI models and platforms that empower products with responsible, high-performance AI infrastructure.

You will design, develop, and deploy AI software components including foundation model training, large language model inference, agents and multi‑agent workflows, similarity search, guardrails, model evaluation, and