Senior Gen AI Platform Engineer: Guardrails & Evaluation

Capital One; Cambridge (MA); On-site; USD 197,000 - 225,000; Full time

Job summary

Capital One seeks an AI Engineer 4 for its Gen AI Platform Services in Cambridge, MA, to partner with engineers, researchers, and PMs on AI-powered products. You will design, train, deploy, and maintain AI components including agents and guardrails, with a broad tech stack including PyTorch and vector databases.

The role emphasizes scalable, responsible AI systems, governance, observability, and collaboration with infrastructure to optimize GPUs/TPUs.

Qualifications

• Bachelor's degree in Computer Science, AI, Electrical Engineering, Computer Engineering, or related fields with 4+ years of AI/ML experience, or a Master's with 2+ years.
• 4+ years of Python, Go, Scala, CUDA, or Java programming experience.

Responsibilities

• Partner with cross-functional team to deliver AI-powered products.
• Design, develop, test, deploy, and support AI software components (training, inference, agents, guardrails, evaluation).
• Leverage Open Source and SaaS AI technologies (AWS Ultraclusters, Huggingface, VectorDBs, PyTorch).
• Invent and implement foundation model optimization to improve performance (cost, latency, throughput).
• Contribute to the technical vision and long-term roadmap of foundational AI systems at Capital One.

Skills

Python

Go

Scala

CUDA

Java

Education

Bachelor's degree in CS/AI/EE/CE

Master's degree in CS/AI/EE/CE

Tools

AWS Ultraclusters

Huggingface

VectorDBs

PyTorch

Job description

Capital One seeks an AI Engineer 4 for its Gen AI Platform Services in Cambridge, MA, to partner with engineers, researchers, and PMs on AI-powered products. You will design, train, deploy, and maintain AI components including agents and guardrails, with a broad tech stack including PyTorch and vector databases.

The role emphasizes scalable, responsible AI systems, governance, observability, and collaboration with infrastructure to optimize GPUs/TPUs.