Senior Gen AI Platform Engineer (Agentic AI & Guardrails)

Capital One; Cambridge (MA); On-site; USD 197,000 - 225,000; Full time

Job summary

Capital One is seeking an AI Engineer 4 for Gen AI Platform Services in Cambridge, MA. You will design, deploy, and operate AI systems including agents, guardrails, memory, and model evaluation within a responsible, scalable AI infrastructure.

You will collaborate with engineers, researchers, and product teams to deliver AI-powered features that enhance customer experiences while maintaining governance, security, and observability across the platform.

Qualifications

• Bachelor's degree in CS/AI/EE/CE plus at least 4 years of experience developing AI/ML algorithms or technologies.
• Master's degree in CS/AI/EE/CE plus at least 2 years of experience developing AI/ML algorithms or technologies.
• At least 4 years of experience programming with Python, Go, Scala, CUDA, or Java

Responsibilities

• Partner with a cross-functional team of engineers, researchers, PMs, and product managers to deliver AI-powered products.
• Design, develop, test, deploy, and support AI software components including foundation model training, LLM inference, agents, guardrails, and observability.
• Leverage Open Source and SaaS AI tech such as AWS Ultraclusters, Huggingface, VectorDBs, PyTorch, and more.
• Invent and introduce state-of-the-art foundation model optimization techniques to improve latency, throughput, and cost.
• Define and maintain service-level objectives (SLOs) for AI reliability, including latency and model drift.
• Mentor Associates on scalable design, performance tuning, and production translation.

Skills

Python

Go

Scala

CUDA

Java

Education

Bachelor's degree in CS/AI/EE/CE

Master's degree in CS/AI/EE/CE

Tools

AWS Ultraclusters

Huggingface

VectorDBs

PyTorch

Job description

Capital One is seeking an AI Engineer 4 for Gen AI Platform Services in Cambridge, MA. You will design, deploy, and operate AI systems including agents, guardrails, memory, and model evaluation within a responsible, scalable AI infrastructure.

You will collaborate with engineers, researchers, and product teams to deliver AI-powered features that enhance customer experiences while maintaining governance, security, and observability across the platform.