Senior AI Engineer: LLMs, Inference & Scale

Capital One National Association; San Jose (CA); On-site; USD 251,000 - 286,000; Full time

Job summary

Capital One is seeking an AI Engineer 5 in San Jose to design, develop and deploy AI-powered products at scale. You will collaborate with engineers, researchers and product teams to deliver foundation model inference, multi-model workflows, and observability across systems.

The role emphasizes cost-aware optimization, cloud and on-prem workloads, and responsible AI practices, with mentoring of senior engineers and shaping technical roadmaps.

Qualifications

• Bachelor's degree in Computer Science or related field plus 6+ years in AI/ML, or Master’s with 4+ years.
• At least 6 years of experience programming with Python, Go, Scala, CUDA, or Java.

Responsibilities

• Partner with cross-functional teams to deliver AI-powered products and platforms.
• Design, develop, test, deploy, and support AI software components including LLM inference and orchestration.
• Leverage Open Source and SaaS AI technologies and optimize model performance and cost.
• Contribute to the technical vision and long-term roadmap of foundational AI systems.
• Lead governance reviews, monitor GPU utilization and inference cost efficiency.

Skills

Python

Go

Scala

CUDA

Java

LLM concepts

Engineering math

Education

Bachelor's degree in Computer Science or related field

Master's degree in Computer Science or related field

Tools

AWS Ultraclusters

Huggingface

VectorDBs

PyTorch

Job description

Capital One is seeking an AI Engineer 5 in San Jose to design, develop and deploy AI-powered products at scale. You will collaborate with engineers, researchers and product teams to deliver foundation model inference, multi-model workflows, and observability across systems.

The role emphasizes cost-aware optimization, cloud and on-prem workloads, and responsible AI practices, with mentoring of senior engineers and shaping technical roadmaps.