Senior AI Foundations Engineer

Capital One; New York (NY); On-site; USD 251,000 - 286,000; Full time

Job summary

Capital One is seeking an AI Engineer 5 for AI Foundations in New York, NY. You will design and deploy AI software components, optimize foundation models, and lead multi-model pipelines within a responsible AI framework.

You will mentor engineers, collaborate with researchers, and contribute to roadmap while ensuring cost and performance governance across GPU resources and inference workloads.

Qualifications

• Bachelor's or Master's degree in a related field with relevant AI/ML experience.
• At least 6 years (or 4 years with Master's) of experience developing AI/ML algorithms or technologies.

Responsibilities

• Partner with cross-functional teams to deliver AI-powered products affecting associates and customers.
• Design, develop, test, deploy, and support AI software components (foundation model training, LLM inference, agents, similarity search).
• Leverage Open Source and SaaS AI technologies (AWS Ultraclusters, Huggingface, VectorDBs, PyTorch).
• Invent state-of-the-art foundation model optimization techniques for production systems.
• Contribute to the technical vision and long-term roadmap of foundational AI systems at Capital One.
• Design, implement and optimize multi-model orchestration pipelines integrating LLMs, vector search, and domain models.
• Establish cost-performance governance reviews, track GPU utilization and inference cost efficiency.
• Lead design councils to ensure technical consistency and AI engineering standards.
• Mentor Principal and Manager-level AI engineers to raise technical maturity.

Skills

Python

Go

Scala

CUDA

Java

Education

Bachelor's degree in Computer Science/AI/EE/CE (or related)

Master's degree in Computer Science/AI/EE/CE (or related)

Tools

AWS Ultraclusters

Huggingface

VectorDBs

PyTorch

Job description

Capital One is seeking an AI Engineer 5 for AI Foundations in New York, NY. You will design and deploy AI software components, optimize foundation models, and lead multi-model pipelines within a responsible AI framework.

You will mentor engineers, collaborate with researchers, and contribute to roadmap while ensuring cost and performance governance across GPU resources and inference workloads.