Senior AI Platform Engineer — Agentic AI at Scale

Capital One; McLean (VA); On-site; USD 197,000 - 225,000; Full time

Job summary

Capital One is seeking an AI Engineer 4 to join the Gen AI Platform Services: Agentic AI team in McLean, VA. The role includes designing, building, and deploying AI-powered products, collaborating with engineers, researchers, and product managers to advance secure, scalable AI systems.

You will work with Open Source and cloud technologies (AWS, HuggingFace, PyTorch, VectorDBs), optimize foundation models, define SLOs, ensure governance and observability, and mentor other engineers.

Qualifications

• Bachelor's degree plus at least 4 years of experience developing AI/ML algorithms or technologies, or a Master's degree plus at least 2 years of experience
• At least 4 years of experience programming with Python, Go, Scala, CUDA, or Java

Responsibilities

• Partner with cross-functional teams to deliver AI-powered products that change how associates work and how customers interact with Capital One.
• Design, develop, test, deploy, and support AI software components including foundation model training, LLM inference, agents and multi-agent workflows, similarity search, guardrails, model evaluation, experimentation, governance, and observability.
• Leverage Open Source and SaaS AI technologies such as AWS Ultraclusters, HuggingFace, VectorDBs, PyTorch, and more.
• Invent foundation model optimization techniques to improve performance, scalability, latency, throughput, and cost of large scale production AI systems.
• Contribute to the technical vision and long-term roadmap of foundational AI systems at Capital One.
• Own end-to-end architecture for complex AI systems with maintainability, observability, and ethical alignment.
• Define and maintain service-level objectives (SLOs) for AI reliability including latency, uptime, and model performance drift.
• Collaborate with infrastructure to optimize GPU/TPU utilization and accelerate inference pipelines.
• Lead cross-functional technical reviews for new AI deployments ensuring security, data governance, and compliance.
• Mentor Principal and Senior Associates on scalable design and production translation.

Skills

Python

Go

Scala

CUDA

Java

LLM Inference

VectorDBs

Agentic AI

Distributed Systems

Model Governance

Education

Bachelor's Degree + 4 years AI/ML

Master's Degree + 2 years AI/ML

Tools

AWS

Google Cloud

Azure

Kubernetes

HuggingFace

PyTorch

Job description

Capital One is seeking an AI Engineer 4 to join the Gen AI Platform Services: Agentic AI team in McLean, VA. The role includes designing, building, and deploying AI-powered products, collaborating with engineers, researchers, and product managers to advance secure, scalable AI systems.

You will work with Open Source and cloud technologies (AWS, HuggingFace, PyTorch, VectorDBs), optimize foundation models, define SLOs, ensure governance and observability, and mentor other engineers.