Senior AI Engineer: Foundation Models & Production

Capital One National Association; New York (NY); On-site; USD 215,000 - 246,000; Full time

Job summary

Capital One seeks an AI Engineer 4 in New York, NY to design, build and deploy production AI systems with a focus on reliability, governance and observability. You will partner with engineers, scientists, PMs and other stakeholders to deliver AI-powered products and scalable infrastructure.

You will work on foundation model training, inference, vector databases, and optimization techniques to improve latency, cost and throughput, while ensuring security and compliance across platforms.

Qualifications

• Bachelor's or master's in CS/AI with AI/ML experience.
• 4+ years developing AI/ML algorithms or technologies.
• 4+ years programming with Python, Go, Scala, CUDA or Java.
• Experience deploying scalable AI on cloud platforms.
• Experience designing AI services and model governance.

Responsibilities

• Partner with a cross-functional team to deliver AI-powered products and systems.
• Design, develop, test, deploy and support AI software components.
• Leverage Open Source and SaaS AI technologies (AWS, HuggingFace, PyTorch).
• Invent optimization techniques for performance, latency and cost.
• Contribute to technical vision and long-term roadmap for foundational AI systems.
• Own end-to-end architecture for complex AI systems with observability and governance.
• Define and maintain SLOs for AI reliability, latency, uptime and drift.
• Collaborate with infrastructure to optimize GPU/TPU utilization.
• Lead reviews for new deployments ensuring security and data governance.
• Mentor senior staff on scalable design and production translation.

Skills

Python

Machine Learning

Distributed systems

Cross-functional collaboration

GPU/TPU optimization

Model governance

Cloud platforms

Education

Bachelor's degree in Computer Science or related

Master's degree in Computer Science or related

Tools

AWS

HuggingFace

PyTorch

VectorDBs

TensorFlow

CUDA

GCP

Azure

Job description

Capital One seeks an AI Engineer 4 in New York, NY to design, build and deploy production AI systems with a focus on reliability, governance and observability. You will partner with engineers, scientists, PMs and other stakeholders to deliver AI-powered products and scalable infrastructure.

You will work on foundation model training, inference, vector databases, and optimization techniques to improve latency, cost and throughput, while ensuring security and compliance across platforms.