Senior AI Foundations Engineer — Scalable, Responsible AI

Capital One; New York (NY); On-site; USD 177,000 - 201,000; Full time

Job summary

Capital One is seeking a Senior AI Engineer in New York, NY to build and operate production-grade AI/ML systems that power real-time, personalized banking experiences. You will shape the technical vision, partner with engineers, researchers, and PMs, and work with Open Source and SaaS AI stacks to optimize large-scale models and services.

You will design, train, deploy, and evaluate foundational AI components, implement guardrails, governance, and observability, and contribute to scalable,

Qualifications

• Bachelor's degree in Computer Science, AI, Electrical Engineering, Computer Engineering, or related fields plus at least 3 years of experience developing AI and ML algorithms or technologies
• At least 3 years of experience programming with Python, Go, Scala, or Java

Responsibilities

• Partner with cross-functional team to deliver AI-powered products
• Design, develop, test, deploy, and support AI software components including foundation model training and LLM inference
• Leverage OSS and SaaS AI technologies such as AWS Ultraclusters, Huggingface, VectorDBs, Nemo Guardrails, PyTorch
• Invent and introduce state-of-the-art LLM optimization techniques for production AI systems
• Contribute to technical vision and long-term roadmap of foundational AI systems

Skills

Python

Go

Scala

Java

LLM Inference

VectorDBs

Guardrails

Memory

Education

Bachelor's degree in CS/EE/related

Master's degree in CS/AI/related

Tools

AWS

Google Cloud

Azure

HuggingFace

PyTorch

Nemo Guardrails

Job description

Capital One is seeking a Senior AI Engineer in New York, NY to build and operate production-grade AI/ML systems that power real-time, personalized banking experiences. You will shape the technical vision, partner with engineers, researchers, and PMs, and work with Open Source and SaaS AI stacks to optimize large-scale models and services.

You will design, train, deploy, and evaluate foundational AI components, implement guardrails, governance, and observability, and contribute to scalable,