Senior AI Foundations & LLM Systems Engineer

Capital One National Association; Northern, New York (KY, NY); On-site; USD 197,000 - 225,000; Full time

Job summary

Capital One is seeking an AI Engineer 4 to advance foundational AI systems, including R&D in model training, inference, and governance. You will work with engineers, researchers, and product managers to ship scalable AI components such as agents and multi-agent workflows, while ensuring security and ethical alignment.

You will help optimize GPU/TPU utilization, define SLOs, and mentor associates in scalable design and production translation, joining a mission to reimagine banking with

Qualifications

• Bachelor's degree in Computer Science, AI, Electrical Engineering, Computer Engineering, or related field plus 4+ years experience or a Master's degree plus 2+ years.
• At least 4 years of experience programming with Python, Go, Scala, CUDA, or Java.
• Experience leading AI systems across cost, latency, throughput, and accuracy tradeoffs.

Responsibilities

• Partner with cross-functional teams to deliver AI-powered products changing how associates work and customers interact.
• Design, develop, test, deploy, and support AI software components including foundation model training and inference.
• Leverage Open Source and SaaS AI tech such as AWS Ultraclusters, HuggingFace, VectorDBs, PyTorch.
• Invent foundation model optimization techniques to improve performance, cost, latency, and throughput.
• Own end-to-end architecture for complex AI systems with maintainability and observing.
• Define and maintain SLIs for AI reliability including latency, uptime, and drift.
• Collaborate with infrastructure to optimize GPU/TPU utilization and model inference pipelines.
• Lead cross-functional reviews for new AI deployments ensuring security and governance.
• Mentor Principals and Senior Associates on scalable design and production translation.

Skills

Python

Go

Scala

CUDA

Java

LLM Inference

VectorDBs

HuggingFace

PyTorch

Education

Bachelor's degree in Computer Science / AI / EE / CE

Master's degree in Computer Science / AI / EE / CE

Tools

AWS Ultraclusters

Job description

Capital One is seeking an AI Engineer 4 to advance foundational AI systems, including R&D in model training, inference, and governance. You will work with engineers, researchers, and product managers to ship scalable AI components such as agents and multi-agent workflows, while ensuring security and ethical alignment.

You will help optimize GPU/TPU utilization, define SLOs, and mentor associates in scalable design and production translation, joining a mission to reimagine banking with