AI Foundations Engineer: LLMs, Agents & VectorDBs

Capital One National Association; New York (NY); On-site; USD 215,000 - 246,000; Full time

Job summary

Capital One is seeking engineers to advance AI at scale within the Intelligent Foundations and Experiences team. You will collaborate with engineers, researchers, PMs, and product managers to deliver AI-powered products and build production‑grade components for model training, inference, and observability.

The role requires a strong CS/AI background, 4+ years coding in Python/Java/Spark-like languages, and cloud experience.

Qualifications

• Bachelor's degree or Master’s with required years of AI/ML experience
• At least 4 years of experience programming with Python, Go, Scala, CUDA, or Java

Responsibilities

• Partner with cross-functional teams to deliver AI-powered products
• Design, develop, test, deploy, and support AI software components
• Leverage Open Source and SaaS AI technologies like AWS Ultraclusters, Huggingface, PyTorch
• Optimize foundation model performance, cost, latency, and throughput
• Define and maintain SLOs for AI reliability
• Collaborate with infrastructure to optimize GPU/TPU utilization
• Lead cross-functional reviews for new AI deployments
• Mentor more junior engineers on scalable design and production translation

Skills

Python

Go

Scala

CUDA

Java

Education

Bachelor's degree in Computer Science/AI/EE/CE or related fields

Master's degree in Computer Science/AI/EE/CE or related fields

Tools

AWS Ultraclusters

Huggingface

VectorDBs

PyTorch

Job description

Capital One is seeking engineers to advance AI at scale within the Intelligent Foundations and Experiences team. You will collaborate with engineers, researchers, PMs, and product managers to deliver AI-powered products and build production‑grade components for model training, inference, and observability.

The role requires a strong CS/AI background, 4+ years coding in Python/Java/Spark-like languages, and cloud experience.