Senior AI Engineer: Foundation Models & Agentic AI

Capital One; San Francisco (CA); On-site; USD 251,000 - 286,000; Full time

Benefits offered by this job

Health benefits

Performance-based incentives

Equity opportunities

Job summary

Capital One is seeking an AI Engineer 5 to help design and deploy AI-powered banking solutions. You will work with cross-functional teams to deliver foundation model training, LLM inference, agents and multi-agent workflows, and high-performance AI infrastructure.

You will leverage Open Source and SaaS tools such as AWS Ultraclusters, HuggingFace, VectorDBs, and PyTorch, optimizing for cost, latency, and scalability while ensuring responsible AI practices across production systems.

Qualifications

• Bachelor’s or Master’s degree in a related field with required experience.
• 6+ years of experience developing AI/ML algorithms or technologies.
• Proficiency in Python and at least one of Go/Scala/CUDA/Java.

Responsibilities

• Partner with cross-functional teams to deliver AI-powered products.
• Design, develop, test, deploy, and support AI software components including foundation model training and inference.
• Leverage Open Source and SaaS AI technologies such as AWS Ultraclusters, Huggingface, VectorDBs, PyTorch.
• Invent and introduce foundation model optimization techniques to improve performance, cost, latency, and throughput.
• Contribute to the technical vision and long-term roadmap of foundational AI systems.
• Design and optimize multi-model orchestration pipelines integrating LLMs, vector search, and domain models.
• Establish and lead cost-performance governance reviews across AI systems.
• Mentor Principal and Manager-level AI engineers and foster technical maturity.

Skills

Python

LLM inference

VectorDBs

PyTorch

Agents

CUDA

Java

Go

Scala

Education

Bachelor’s degree in CS/AI/EE/CE or related fields

Master’s degree in CS/AI/EE/CE or related fields

Tools

AWS Ultraclusters

HuggingFace

PyTorch

VectorDBs

Job description

Capital One is seeking an AI Engineer 5 to help design and deploy AI-powered banking solutions. You will work with cross-functional teams to deliver foundation model training, LLM inference, agents and multi-agent workflows, and high-performance AI infrastructure.

You will leverage Open Source and SaaS tools such as AWS Ultraclusters, HuggingFace, VectorDBs, and PyTorch, optimizing for cost, latency, and scalability while ensuring responsible AI practices across production systems.