Senior AI Platform Engineer - Gen AI & Guardrails

Capital One; McLean (VA); On-site; USD 197,000 - 225,000; Full time

Job summary

Capital One is seeking an AI Engineer 4 to advance responsible AI systems, building foundation models, agents, and evaluation pipelines on a scalable platform. You will partner with a cross-functional team of engineers, researchers, and product managers to deliver AI-powered products that transform how associates work and how customers interact with Capital One.

You will design, develop, test, deploy, and support AI software components including foundation model training, LLM inference, agents,

Qualifications

• Bachelor's or Master's in a relevant field with years of AI/ML experience
• 4+ years programming experience in Python, Go, Scala, CUDA, or Java

Responsibilities

• Partner with cross-functional teams to deliver AI-powered products
• Design, develop, test, deploy, and support AI software components
• Leverage Open Source and SaaS AI technologies
• Invent and optimize foundation model performance (latency, throughput, cost)
• Contribute to technical vision and roadmaps for AI systems
• Own end-to-end architecture for complex AI systems ensuring maintainability and governance
• Define and maintain SLOs for AI reliability
• Collaborate with infrastructure to optimize GPU/TPU utilization
• Lead cross-functional reviews for new deployments ensuring security and governance
• Mentor Principal and Senior Associates on scalable design and production translation

Skills

Python

Go

Scala

CUDA

Java

Education

Bachelor's degree in Computer Science, AI, Electrical Engineering, Computer Engineering, or related fields

Master's degree in Computer Science, AI, Electrical Engineering, Computer Engineering, or related fields

Tools

AWS Ultraclusters

Huggingface

VectorDBs

PyTorch

Job description

Capital One is seeking an AI Engineer 4 to advance responsible AI systems, building foundation models, agents, and evaluation pipelines on a scalable platform. You will partner with a cross-functional team of engineers, researchers, and product managers to deliver AI-powered products that transform how associates work and how customers interact with Capital One.

You will design, develop, test, deploy, and support AI software components including foundation model training, LLM inference, agents,