Senior AI Systems Engineer (Foundations & Platforms)

Capital One National Association; New York (NY); On-site; USD 250,000 - 286,000; Full time

Job summary

Capital One is building responsible AI systems to transform banking experiences. The Intelligent Foundations and Experiences team leads state-of-the-art AI engineering across models, pipelines, and governance.

You will design, implement, and optimize AI components, collaborate with engineers, researchers, and PMs, and mentor senior engineers while shaping the roadmap for scalable AI at Capital One. This role emphasizes production-grade AI, cost-performance governance, and multi-model

Qualifications

• Bachelor's degree (or higher) in CS/AI/EE/CE or related field with 6+ years of AI/ML experience, or Master's with 4+ years.
• 6+ years of experience programming with Python, Go, Scala, CUDA, or Java.
• Experience with modern AI tech stacks and production ML systems.

Responsibilities

• Partner with cross-functional teams to deliver AI-powered products for associates and customers.
• Design, develop, test, deploy, and support AI software components (foundation models, LLM inference, agents, vector search, guards, governance).
• Leverage Open Source and SaaS AI tech like AWS Ultraclusters, Huggingface, PyTorch, VectorDBs.
• Develop techniques for foundation model optimization focusing on performance, cost, latency, throughput.
• Contribute to technical vision and long-term roadmap of foundational AI systems.
• Design and optimize multi-model orchestration pipelines integrating LLMs, vector search, and domain models.
• Lead governance reviews tracking GPU utilization, model throughput, and inference cost.
• Lead design reviews ensuring AI engineering standards and consistency.
• Mentor senior engineers to raise technical maturity.

Skills

Python

Go

Scala

CUDA

Java

Education

Bachelor's Degree in Computer Science, AI, Electrical Engineering, Computer Engineering, or related fields

Master's degree in Computer Science, AI, Electrical Engineering, Computer Engineering, or related fields

Tools

Huggingface

PyTorch

VectorDBs

AWS Ultraclusters

Job description

Capital One is building responsible AI systems to transform banking experiences. The Intelligent Foundations and Experiences team leads state-of-the-art AI engineering across models, pipelines, and governance.

You will design, implement, and optimize AI components, collaborate with engineers, researchers, and PMs, and mentor senior engineers while shaping the roadmap for scalable AI at Capital One. This role emphasizes production-grade AI, cost-performance governance, and multi-model