Senior AI Engineer: Foundations, LLMs & Agents

Capital One National Association; McLean (VA); On-site; USD 229,000 - 262,000; Full time

Job summary

Capital One is seeking an experienced AI Engineer 5 to advance AI foundations, LLM core and agentic AI capabilities. You will build scalable AI systems, optimize foundation models, and contribute to governance and roadmap across Capital One's AI platforms.

The role requires strong Python/ML skills, experience with PyTorch, vector databases, and cloud platforms, plus a proven track record delivering production AI systems and mentoring teams.

Qualifications

• Degree plus substantial AI/ML experience.
• Proficiency in Python, Go, Scala, CUDA or Java.
• Experience with LLM inference and vector search.

Responsibilities

• Partner with cross-functional teams to deliver AI-powered products.
• Design, develop, test, deploy, and support AI software components.
• Lead foundation model optimization for performance and cost.
• Contribute to technical vision and long-term AI system roadmap.
• Design multi-model orchestration pipelines integrating LLMs and domain models.
• Establish cost-performance governance for GPU utilization and inference cost.

Skills

Python

Go

Scala

CUDA

Java

ML algorithms

LLM Inference

VectorDBs

Guardrails

PyTorch

Cloud platforms

System design

Education

Bachelor's degree in CS/AI/EE/CE or related + 6+ years

Master's degree in CS/AI/EE/CE or related + 4+ years

Tools

AWS

Huggingface

VectorDBs

PyTorch

Job description

Capital One is seeking an experienced AI Engineer 5 to advance AI foundations, LLM core and agentic AI capabilities. You will build scalable AI systems, optimize foundation models, and contribute to governance and roadmap across Capital One's AI platforms.

The role requires strong Python/ML skills, experience with PyTorch, vector databases, and cloud platforms, plus a proven track record delivering production AI systems and mentoring teams.