Senior AI Engineer: Scalable Foundation Models

Capital One; New York (NY); On-site; USD 215,000 - 245,000; Full time

Job summary

Capital One's Intelligent Foundations and Experiences (IFX) team is building responsible AI systems for banking at scale. You will design, develop, test, and deploy AI software components—from foundation model training to governance and observability—working with engineers, researchers, PMs, and product managers.

The role emphasizes scalable, cost-aware optimization, model evaluation, and compliance in production.

Qualifications

• Bachelor's degree in Computer Science, AI, Electrical Engineering, Computer Engineering, or related fields plus at least 4 years of experience developing AI and ML algorithms or technologies; or a Master's degree plus at least 2 years of experience
• At least 4 years of experience programming with Python, Go, Scala, CUDA, or Java
• 6 years of experience deploying scalable and responsible AI solutions on cloud platforms (AWS, Google Cloud, Azure, or equivalent)

Responsibilities

• Partner with cross-functional teams to deliver AI-powered products that change how associates work and how customers interact with Capital One.
• Design, develop, test, deploy, and support AI software components including foundation model training, LLM inference, agents, and observability.
• Leverage Open Source and SaaS AI technologies such as AWS Ultraclusters, Huggingface, VectorDBs, PyTorch, and more.
• Invent and introduce state-of-the-art foundation model optimization techniques for performance and cost.
• Contribute to the technical vision and long-term roadmap of foundational AI systems.
• Own end-to-end architecture for complex AI systems ensuring maintainability, observability, and ethical alignment.
• Define and maintain service-level objectives (SLOs) for AI reliability including latency and drift.
• Collaborate with infrastructure engineering to optimize GPU/TPU utilization and accelerate inference pipelines.
• Lead cross-functional technical reviews for new AI deployments ensuring security and governance.
• Mentor Principal and Senior Associates on scalable design and production translation.

Skills

AI systems

Python

Go

Scala

CUDA

Java

Cloud platforms

Model governance

Education

Bachelor's degree in Computer Science/AI/EE/CE or related fields

Master's degree in Computer Science/AI/EE/CE or related fields

Tools

AWS

Huggingface

VectorDBs

PyTorch

Job description

Capital One's Intelligent Foundations and Experiences (IFX) team is building responsible AI systems for banking at scale. You will design, develop, test, and deploy AI software components—from foundation model training to governance and observability—working with engineers, researchers, PMs, and product managers.

The role emphasizes scalable, cost-aware optimization, model evaluation, and compliance in production.