Senior AI Engineer — LLM & Multi-Model Systems

Capital One; New York (NY); On-site; USD 251,000 - 286,000; Full time

Job summary

Capital One is seeking an AI Engineer 5 in New York, NY to design, train, and deploy large-scale AI systems. You will collaborate with engineers, researchers, PMs, and partners to advance production-grade AI capabilities and governance.

You will work with a broad stack including AWS, HuggingFace, VectorDBs, and PyTorch, optimizing performance, latency, and cost while mentoring junior team members and shaping the technical roadmap.

Qualifications

• Bachelor's or Master's with 4–6+ years in AI/ML development.
• Experience in Python, Go, Scala, CUDA, or Java.
• Experience deploying scalable AI/ML systems on cloud platforms.

Responsibilities

• Partner with cross-functional teams to deliver AI-powered products.
• Design, train, deploy and support AI software components.
• Lead cost-performance governance and model optimization efforts.
• Mentor engineers and contribute to technical roadmaps.

Skills

Python

Go

Java

CUDA

Scala

Education

Bachelor's degree in CS/AI/EE or related field

Master's degree in CS/AI/EE or related field

Tools

AWS Ultraclusters

Huggingface

VectorDBs

PyTorch

Job description

Capital One is seeking an AI Engineer 5 in New York, NY to design, train, and deploy large-scale AI systems. You will collaborate with engineers, researchers, PMs, and partners to advance production-grade AI capabilities and governance.

You will work with a broad stack including AWS, HuggingFace, VectorDBs, and PyTorch, optimizing performance, latency, and cost while mentoring junior team members and shaping the technical roadmap.