Senior Gen AI Platform Engineer - Agents & Guardrails

Capital One; New York (NY); On-site; USD 215,000 - 246,000; Full time

Job summary

Capital One is seeking an AI Engineer 4 to advance our Gen AI Platform Services, including Agentic AI, Guardrails, Memory, and Evaluation. You will partner with cross-functional teams to design, deploy, and optimize AI components, from foundation models to multi-agent workflows, using a broad stack of Open Source tools and cloud services.

You will influence architectural decisions, drive scalability, and maintain ethical alignment while mentoring more junior engineers and collaborating with

Qualifications

• Bachelor's degree with 4+ years in AI/ML or Master’s with 2+ years in AI/ML.
• At least 4 years of programming experience in Python, Go, Scala, CUDA, or Java.
• Experience leading AI systems with cost, latency, throughput, and accuracy tradeoffs.
• 6+ years deploying scalable AI solutions on cloud platforms (AWS, GCloud, Azure).
• Experience designing, delivering, and supporting AI services.
• Experience developing AI/ML algorithms (e.g. LLM Inference, VectorDBs, Guardrails, Memory).

Responsibilities

• Partner with cross-functional teams to deliver AI-powered products for associates and customers.
• Design, develop, test, deploy, and support AI software components (foundation models, LLM inference, agents, memory).
• Leverage Open Source and SaaS AI tech (AWS Ultraclusters, HuggingFace, PyTorch).
• Invent optimization techniques to improve performance, latency, and cost at scale.
• Contribute to long-term AI system roadmaps and architectural vision.
• Own end-to-end architecture ensuring maintainability, observability, and ethical alignment.
• Define and maintain SLOs for AI reliability (latency, uptime, drift).
• Collaborate with infra to optimize GPU/TPU usage and inference pipelines.
• Lead cross-functional reviews for new AI deployments ensuring security and governance.
• Mentor senior engineers on scalable design and research-to-production translation.

Skills

Python

Go

Scala

CUDA

Java

AI/ML algorithms

Education

Bachelor's Degree in Computer Science / AI / Electrical/Computer Engineering or related field

Master's Degree in related field (optional with 2+ years experience)

Tools

AWS Ultraclusters

Huggingface

VectorDBs

PyTorch

Job description

Capital One is seeking an AI Engineer 4 to advance our Gen AI Platform Services, including Agentic AI, Guardrails, Memory, and Evaluation. You will partner with cross-functional teams to design, deploy, and optimize AI components, from foundation models to multi-agent workflows, using a broad stack of Open Source tools and cloud services.

You will influence architectural decisions, drive scalability, and maintain ethical alignment while mentoring more junior engineers and collaborating with