Senior AI Engineer: LLMs, Agents & Foundations

Capital One National Association; McLean (VA); On-site; USD 230,000 - 262,000; Full time

Benefits offered by this job

Health benefits

Performance incentives

Job summary

Capital One is seeking an AI Engineer 5 to advance AI foundations, LLM core and agentic AI across banking applications. You will collaborate with engineers, researchers and PMs to deliver production-grade AI systems, including training, inference, vector search and governance.

The role emphasizes optimizing cost, latency, and throughput while guiding technical direction and mentoring senior engineers. A strong AI/ML background and hands-on cloud experience are essential.

Qualifications

• Bachelors or Masters in CS/AI/EE with relevant AI/ML experience.
• Experience building AI systems including foundation models and inference.
• Strong programming skills in Python, Java, C++ or similar.

Responsibilities

• Partner with cross-functional teams to ship AI-powered products.
• Design, train, deploy and support AI software components and workflows.
• Build and optimize multi-model orchestration pipelines.
• Lead governance, observability and cost-performance reviews.

Skills

Foundation models

LLM inference

Python

CUDA

Java

Go

PyTorch

Huggingface

VectorDBs

Performance optimization

Education

Bachelor's or Master's in CS/AI/EE

Tools

AWS Ultraclusters

Huggingface

VectorDBs

PyTorch

Job description

Capital One is seeking an AI Engineer 5 to advance AI foundations, LLM core and agentic AI across banking applications. You will collaborate with engineers, researchers and PMs to deliver production-grade AI systems, including training, inference, vector search and governance.

The role emphasizes optimizing cost, latency, and throughput while guiding technical direction and mentoring senior engineers. A strong AI/ML background and hands-on cloud experience are essential.