Senior AI Engineer: Foundation Models & Scalable Systems

Capital One; New York (NY); Hybrid; USD 215,000 - 246,000; Full time

Job summary

Capital One in New York, NY (and nearby hubs) is seeking an AI Engineer 4 to design, develop, and deploy AI software components, including foundation model training and LLM inference. You will work with a broad stack (AWS, HuggingFace, PyTorch, VectorDBs) and own scalable production systems with observability and governance.

Ideal candidates bring 4+ years building AI/ML solutions, strong Python/Java/CUDA skills, and a passion for delivering reliable, responsible AI at scale across

Qualifications

• Bachelor's or Master's degree with strong AI/ML foundation and production experience.
• 4+ years of experience developing AI/ML algorithms or technologies.
• Experience in Python, Go, Scala, CUDA, or Java for AI systems.

Responsibilities

• Partner with cross-functional teams to deliver AI-powered products.
• Design, develop, test, deploy, and support AI software components.
• Leverage Open Source and SaaS AI technologies and optimize foundation models.
• Own end‑to‑end architecture for complex AI systems with observability and governance.
• Define and maintain SLOs for AI reliability and performance.

Skills

Python

Go

Scala

CUDA

Java

Distributed systems

AI/ML

Model governance

Education

Bachelor's degree in Computer Science, AI, Electrical Engineering, Computer Engineering, or related fields

Master's degree in Computer Science, AI, Electrical Engineering, Computer Engineering, or related fields

Tools

AWS

Huggingface

PyTorch

VectorDBs

GPUs/TPUs tooling

Job description

Capital One in New York, NY (and nearby hubs) is seeking an AI Engineer 4 to design, develop, and deploy AI software components, including foundation model training and LLM inference. You will work with a broad stack (AWS, HuggingFace, PyTorch, VectorDBs) and own scalable production systems with observability and governance.

Ideal candidates bring 4+ years building AI/ML solutions, strong Python/Java/CUDA skills, and a passion for delivering reliable, responsible AI at scale across