Senior AI Platform Engineer – Guardrails & LLM Ops

Capital One; McLean (VA); On-site; USD 230,000 - 262,000; Full time

Job summary

Capital One's Intelligent Foundations and Experiences team is building responsible AI systems and scalable AI infrastructure. You will work with engineers, researchers, and PMs to design, train, and deploy AI components including LLMs, guardrails, and governance.

The role emphasizes scalable, cost-aware production AI across platforms. You should bring strong Python/Java/CUDA expertise, cloud experience, and a passion for advancing cutting-edge AI while ensuring safety and explainability.

Qualifications

• Bachelor's degree in CS/AI/EE/CE or related field with 6+ years in AI/ML.
• 6+ years of experience programming with Python, Go, Scala, CUDA or Java.
• Experience deploying AI systems on cloud platforms and ensuring governance.

Responsibilities

• Partner with cross-functional teams to deliver AI-powered products that impact associates and customers.
• Design, develop, test, deploy, and support AI software components including model training and inference.
• Leverage Open Source and SaaS AI tech such as AWS, Huggingface, VectorDBs, PyTorch during delivery.
• Lead optimization for performance, cost, latency, and throughput of large-scale AI systems.
• Contribute to long-term roadmaps for foundational AI systems at Capital One.
• Design and optimize multi-model orchestration pipelines and governance reviews.

Skills

Python

Go

Scala

CUDA

Java

Education

Bachelor's Degree in Computer Science, AI, Electrical Engineering, Computer Engineering, or related fields

Tools

AWS

Huggingface

VectorDBs

PyTorch

Job description

Capital One's Intelligent Foundations and Experiences team is building responsible AI systems and scalable AI infrastructure. You will work with engineers, researchers, and PMs to design, train, and deploy AI components including LLMs, guardrails, and governance.

The role emphasizes scalable, cost-aware production AI across platforms. You should bring strong Python/Java/CUDA expertise, cloud experience, and a passion for advancing cutting-edge AI while ensuring safety and explainability.