Senior AI Engineer - Scalable LLM & AI Systems

Capital One National Association; New York (NY); On-site; USD 251,000 - 286,000; Full time

Job summary

Capital One is seeking an AI Engineer to join the IFX team in New York, building responsible and scalable AI systems that power real-time customer experiences. You will partner with engineers, researchers, PMs, and data scientists to design and deliver foundation-model based AI products at enterprise scale.

You'll work with a broad stack including PyTorch, HuggingFace, VectorDBs, and AWS, focusing on performance optimization, cost efficiency, governance, and observability.

Qualifications

• Bachelor's or Master's with required years of AI/ML experience.
• 6+ years Python/Go/Scala/CUDA/Java development.
• Strong AI system design and production experience.

Responsibilities

• Deliver AI-powered products with cross-functional teams.
• Design, develop, test, deploy AI software components.
• Work with foundation models, LLMs, and vector search.
• Optimize performance, cost, latency, and throughput.
• Contribute to long-term AI system roadmaps.
• Lead multi-model orchestration pipelines.
• Govern GPU utilization and inference cost efficiency.
• Mentor engineers and uphold AI standards.

Skills

Python

Go

Scala

CUDA

Java

Education

Bachelor's +6 years AI

Master's +4 years AI

Tools

AWS

HuggingFace

VectorDBs

PyTorch

Job description

Capital One is seeking an AI Engineer to join the IFX team in New York, building responsible and scalable AI systems that power real-time customer experiences. You will partner with engineers, researchers, PMs, and data scientists to design and deliver foundation-model based AI products at enterprise scale.

You'll work with a broad stack including PyTorch, HuggingFace, VectorDBs, and AWS, focusing on performance optimization, cost efficiency, governance, and observability.