Senior AI Engineer: Foundation Models & AI Infrastructure

Capital One

New York (NY)

On-site

USD 150,000 - 190,000

Full time

4 days ago

Be an early applicant

Application generator

Turn this role into an interview — a resume and cover letter built around what this employer wants.

Get past ATS filters

Job summary

Capital One is seeking an AI Engineer 5 (MLX) to help build responsible and reliable AI systems across banking products. You will partner with engineers, researchers, program managers, and product managers to deliver AI-powered solutions that impact both associates and customers in real time.

You will design, train and deploy foundational models, conduct inference, manage multi-model workflows, and optimize performance, cost, and latency at scale.

Responsibilities

Partner with cross-functional teams to deliver AI-powered products.
Design, develop, test, deploy, and support AI software components including foundation model training, LLM inference, agents and multi-agent workflows.
Utilize Open Source and SaaS AI tech such as AWS Ultraclusters, Huggingface, VectorDBs and PyTorch.
Innovate model optimization techniques to improve performance, cost, latency and throughput of large-scale AI systems.
Contribute to the long-term technical vision and roadmap of foundational AI systems at Capital One.
Design and optimize multi-model orchestration pipelines integrating LLMs, vector search, and domain models.
Lead cost-performance governance reviews across AI systems, tracking GPU usage and model throughput.
Chair design reviews to ensure consistency with AI engineering standards.
Mentor Principal and Manager-level AI engineers to raise technical maturity.

Tools

AWS Ultraclusters

Huggingface

VectorDBs

PyTorch

Job description

You will design, train and deploy foundational models, conduct inference, manage multi-model workflows, and optimize performance, cost, and latency at scale.

Get your free, confidential resume review.

or drag and drop your file here.