GenAI Platform Engineer - Agentic Infra

Capital One; New York (NY); On-site; USD 251,000 - 286,000; Full time

Job summary

Capital One seeks an AI Engineer 5 in New York, NY to partner across teams and deliver AI-powered products. You will design, train, deploy and monitor foundation models, with emphasis on LLM inference, multi-model workflows, and governance.

Preferred expertise includes Python, PyTorch, and vector databases, with a focus on scalable, responsible AI. The role involves collaboration with research scientists, engineers and PMs to advance AI capabilities across Capital One's platforms.

Qualifications

• Bachelor's degree or Master's in CS/AI/Engineering with relevant AI/ML experience.
• At least 6 years (or 4 years with a Master's) developing AI/ML algorithms or technologies.
• Strong programming experience in Python, Go, Scala, CUDA or Java.

Responsibilities

• Partner with cross-functional teams to deliver AI-powered products.
• Design, develop, test, deploy and support AI software components including foundation model training and LLM inference.
• Leverage Open Source and SaaS AI technologies such as AWS Ultraclusters, Huggingface, PyTorch, and VectorDBs.
• Develop optimization techniques to improve performance, scalability, and cost.
• Contribute to the technical vision and long-term roadmap of AI systems at Capital One.

Skills

Python

Go

Scala

CUDA

Java

LLM Inference

VectorDBs

Guardrails

Memory

Education

Bachelor's degree in Computer Science/AI/Engineering

Master's degree in Computer Science/AI/Engineering

Tools

Huggingface

PyTorch

AWS Ultraclusters

Job description

Capital One seeks an AI Engineer 5 in New York, NY to partner across teams and deliver AI-powered products. You will design, train, deploy and monitor foundation models, with emphasis on LLM inference, multi-model workflows, and governance.

Preferred expertise includes Python, PyTorch, and vector databases, with a focus on scalable, responsible AI. The role involves collaboration with research scientists, engineers and PMs to advance AI capabilities across Capital One's platforms.