Senior AI Foundations Engineer

Capital One; San Francisco (CA); On-site; USD 251,000 - 286,000; Full time

Job summary

Capital One is seeking an AI Engineer 5 to help build responsible and scalable AI systems, partnering with engineers, researchers, PMs, and product teams. You will design and deploy AI software components, optimize foundation models, and contribute to the strategic direction of AI infrastructure across the company.

The role involves leading multi‑model orchestration pipelines, governance reviews, and mentoring senior engineers, with salaries listed by location including SF.

Qualifications

• Bachelor’s or Master’s degree with required years of AI/ML experience as stated.
• At least 6 years programming experience in Python/Go/Scala/CUDA/Java.

Responsibilities

• Partner with cross-functional team to deliver AI-powered products changing how associates work and customers interact with Capital One.
• Design, develop, test, deploy, and support AI software components including foundation model training, LLM inference, agents and multi‑agent workflows, similarity search, guardrails, and governance.
• Leverage Open Source and SaaS AI technologies such as AWS Ultraclusters, Huggingface, VectorDBs, PyTorch, and more.
• Invent state-of-the-art foundation model optimization techniques to improve performance, cost, latency, and throughput for large-scale AI systems.
• Contribute to the technical vision and long-term roadmap of foundational AI systems at Capital One.
• Design, implement and optimize multi-model orchestration pipelines — integrating LLMs, vector search, and domain models into unified systems.
• Establish and lead cost-performance governance reviews across AI systems, tracking GPU usage and inference cost efficiency.
• Lead design councils or review boards to ensure technical consistency and AI engineering standards.
• Mentor Principal and Manager-level AI engineers to elevate organizational technical maturity.

Skills

Python

Go

Scala

CUDA

Java

Education

Bachelor's degree in Computer Science, AI, Electrical Engineering, Computer Engineering or related fields

Master's degree in Computer Science, AI, Electrical Engineering, Computer Engineering or related fields

Tools

AWS Ultraclusters

Huggingface

VectorDBs

PyTorch

Job description

Capital One is seeking an AI Engineer 5 to help build responsible and scalable AI systems, partnering with engineers, researchers, PMs, and product teams. You will design and deploy AI software components, optimize foundation models, and contribute to the strategic direction of AI infrastructure across the company.

The role involves leading multi‑model orchestration pipelines, governance reviews, and mentoring senior engineers, with salaries listed by location including SF.