Senior AI Engineer - Production ML & LLM Systems

Capital One; New York (NY); On-site; USD 251,000 - 286,000; Full time

Job summary

Capital One in New York, NY is seeking an AI Engineer 5 to design and deploy AI software components including foundation model training, LLM inference, agents and multi-model workflows. You will leverage Open Source and SaaS AI tech such as PyTorch, Huggingface, and VectorDBs to push scalable AI into production.

You will mentor Principal and Manager-level AI engineers, drive governance and cost-performance reviews, and collaborate with cross-functional teams to deliver cutting-edge AI products

Qualifications

• Basic degree requirements with 4–6+ years in AI/ML development.
• Strong programming in Python and at least one of Go/Scala/Java.
• Experience with model training, inference, and optimization in production.

Responsibilities

• Deliver AI software components including model training and inference.
• Design, implement, and optimize multi-model orchestration pipelines.
• Lead governance reviews for GPU utilization and cost efficiency.
• Mentor engineers and contribute to long-term AI system roadmaps.
• Collaborate with engineers, researchers, and product managers on AI products.

Skills

Python

Go

Scala

CUDA

Java

AI/ML

Education

Bachelor's degree (CS/AI/EE/CE or related)

Master's degree (CS/AI/EE/CE or related)

Tools

AWS Ultraclusters

Huggingface

VectorDBs

PyTorch

Job description

Capital One in New York, NY is seeking an AI Engineer 5 to design and deploy AI software components including foundation model training, LLM inference, agents and multi-model workflows. You will leverage Open Source and SaaS AI tech such as PyTorch, Huggingface, and VectorDBs to push scalable AI into production.

You will mentor Principal and Manager-level AI engineers, drive governance and cost-performance reviews, and collaborate with cross-functional teams to deliver cutting-edge AI products