Senior AI Systems Engineer: Foundation Models & LLMs

Capital One Group; McLean (VA); Hybrid; USD 230,000 - 262,000; Full time

Job summary

Capital One is seeking an AI Engineer 5 to partner with cross-functional teams in delivering AI-powered products and production-grade AI infrastructure. You will design, build, test, and optimize AI software components across model training, inference, and governance, leveraging Open Source and SaaS tools.

You will mentor engineers, drive design decisions, and shape the long-term AI platform roadmap while ensuring scalable, responsible AI practices align with Capital One’s goals.

Qualifications

• Bachelor's degree in Computer Science, AI, Electrical Engineering, Computer Engineering, or related fields plus at least 6 years of experience developing AI/ML algorithms or technologies.
• Master's degree in Computer Science, AI, Electrical Engineering, Computer Engineering, or related fields plus at least 4 years of experience developing AI/ML algorithms or technologies.
• At least 6 years of experience programming with Python, Go, Scala, CUDA, or Java.

Responsibilities

• Design, develop, test, deploy, and support AI software components including foundation model training, LLM inference, agents and multi-agent workflows, similarity search, guardrails, model evaluation, experimentation, governance, and observability.
• Mentor engineers and contribute to the technical roadmap for foundational AI systems at Capital One.
• Lead cost-performance governance reviews across AI systems, tracking GPU utilization and model throughput.

Skills

Python

Go

Scala

CUDA

Java

LLM Inference

Memory

Guardrails

Vector search

Education

Bachelor's degree in CS/AI/EE

Master's degree in CS/AI/EE

Tools

AWS

Huggingface

PyTorch

VectorDBs

Job description

Capital One is seeking an AI Engineer 5 to partner with cross-functional teams in delivering AI-powered products and production-grade AI infrastructure. You will design, build, test, and optimize AI software components across model training, inference, and governance, leveraging Open Source and SaaS tools.

You will mentor engineers, drive design decisions, and shape the long-term AI platform roadmap while ensuring scalable, responsible AI practices align with Capital One’s goals.