Senior AI Foundations Engineer - LLMs & Agentic AI

Capital One National Association; New York (NY); On-site; USD 251,000 - 286,000; Full time

Benefits offered by this job

Performance-based incentives

Job summary

Capital One is seeking an AI Engineer 5 to join the Intelligent Foundations and Experiences team in New York, NY. You will partner with engineers, researchers, and PMs to deliver AI-powered products while advancing state-of-the-art foundation model techniques.

You will design and deploy AI software, optimize performance, and guide multi-model pipelines across LLMs, vector search, and domain models. A strong background in Python/ML and cloud platforms is required, with leadership in responsible

Qualifications

• Bachelor's or Master’s degree in CS/AI/EE/CE or related field with relevant experience.
• 6+ years of experience developing AI/ML algorithms or technologies.
• 6+ years programming in Python, Go, Scala, CUDA, or Java.

Responsibilities

• Partner with cross-functional teams to deliver AI-powered products.
• Design, develop, test, deploy, and support AI software components.
• Leverage Open Source and SaaS AI tech like AWS Ultraclusters, Huggingface, VectorDBs, PyTorch.
• Develop foundation model optimization techniques for performance and cost.
• Contribute to long-term roadmaps for foundational AI systems at Capital One.
• Design and optimize multi-model orchestration pipelines integrating LLMs and vector search.
• Lead governance reviews for GPU utilization, throughput, and cost efficiency.
• Chair design review boards to ensure compliance with AI engineering standards.
• Mentor Principal and Manager-level AI engineers to raise technical maturity.

Skills

Python

Go

Scala

CUDA

Java

Education

Bachelor's or Master's in Computer Science, AI, Electrical Engineering, Computer Engineering, or related fields

Tools

AWS

Google Cloud

Azure

VectorDBs

Job description

Capital One is seeking an AI Engineer 5 to join the Intelligent Foundations and Experiences team in New York, NY. You will partner with engineers, researchers, and PMs to deliver AI-powered products while advancing state-of-the-art foundation model techniques.

You will design and deploy AI software, optimize performance, and guide multi-model pipelines across LLMs, vector search, and domain models. A strong background in Python/ML and cloud platforms is required, with leadership in responsible