Senior Gen AI Platform Engineer: Agentic AI & Guardrails

Capital One; San Jose (CA); On-site; USD 250,000 - 286,000; Full time

Job summary

Capital One seeks an AI Engineer 5 for Gen AI Platform Services in San Jose, CA. You will collaborate with engineers, scientists, and product teams to build responsible and scalable AI systems, focusing on foundation models, agents, and guardrails.

You will study advanced AI techniques, optimize production pipelines, and mentor senior engineers while contributing to Capital One’s AI roadmap and governance practices.

Qualifications

• Bachelor’s degree in Computer Science, AI, Electrical Engineering, Computer Engineering, or related field with 6+ years of AI/ML experience, or Master’s degree with 4+ years of AI/ML experience.
• 6+ years of experience programming with Python, Go, Scala, CUDA, or Java.

Responsibilities

• Partner with cross-functional teams to deliver AI-powered products.
• Design, develop, test, deploy, and support AI software components including foundation model training and inference.
• Leverage OSS and SaaS AI technologies such as AWS Ultraclusters, Huggingface, VectorDBs, PyTorch.
• Invent state-of-the-art foundation model optimization techniques for performance, cost, latency, and throughput.
• Contribute to technical vision and long-term roadmap of foundational AI systems at Capital One.
• Design, implement and optimize multi-model orchestration pipelines integrating LLMs and domain models.
• Establish cost-performance governance, track GPU utilization and inference cost efficiency.
• Lead design councils to ensure technical consistency and AI engineering standards.
• Mentor Principal and Manager-level AI engineers to raise technical maturity.

Skills

Python

Go

Scala

CUDA

Java

LLM Inference

VectorDBs

Guardrails

Memory

Cloud computing

Education

Bachelor's degree in CS/AI/EE/CE or related field

Master's degree in CS/AI/EE/CE or related field

Tools

AWS Ultraclusters

Huggingface

VectorDBs

PyTorch

Job description

Capital One seeks an AI Engineer 5 for Gen AI Platform Services in San Jose, CA. You will collaborate with engineers, scientists, and product teams to build responsible and scalable AI systems, focusing on foundation models, agents, and guardrails.

You will study advanced AI techniques, optimize production pipelines, and mentor senior engineers while contributing to Capital One’s AI roadmap and governance practices.