Senior AI Platform Engineer – Gen AI & Guardrails

Capital One; New York (NY); On-site; USD 215,000 - 246,000; Full time

Job summary

Capital One in New York is seeking an AI Engineer 4 to help design and implement AI-powered systems, including foundation model training, inference, agents and guardrails, and observability. You will collaborate with engineers, researchers, PMs, and data scientists to deliver scalable, responsible AI solutions.

The role emphasizes governance, cost-aware optimization, and scalable cloud/on-prem deployment, with opportunities to influence architecture and long-term AI strategy at Capital One.

Qualifications

• Bachelor's degree in CS, AI, EE or related field with 4+ years of AI/ML experience or Master's with 2+ years of AI/ML experience.
• 4+ years of programming experience in Python, Go, Scala, CUDA or Java.

Responsibilities

• Partner with cross-functional teams to deliver AI-powered products.
• Design, develop, test, deploy, and support AI software components.
• Leverage Open Source and SaaS AI technologies (AWS Ultraclusters, Huggingface, PyTorch).
• Invent state-of-the-art foundation model optimization for production AI systems.
• Own end-to-end architecture for complex AI systems with observability and governance.

Skills

Python

Go

Scala

CUDA

Java

Education

Bachelor's degree in CS/AI/EE

Master's degree in CS/AI/EE

Tools

AWS Ultraclusters

Huggingface

VectorDBs

PyTorch

Job description

Capital One in New York is seeking an AI Engineer 4 to help design and implement AI-powered systems, including foundation model training, inference, agents and guardrails, and observability. You will collaborate with engineers, researchers, PMs, and data scientists to deliver scalable, responsible AI solutions.

The role emphasizes governance, cost-aware optimization, and scalable cloud/on-prem deployment, with opportunities to influence architecture and long-term AI strategy at Capital One.