Senior AI Engineer – LLM & Foundation Models

Capital One National Association; San Jose (CA); On-site; USD 215,000 - 246,000; Full time

Job summary

Capital One in San Jose, CA seeks an AI Engineer 4 to advance foundation model training, large-scale AI inference, and AI-powered product delivery for customers and partners. You will collaborate with engineers, researchers, PMs, and data teams on end-to-end AI systems.

You will optimize hardware utilization, implement guardrails, governance, and observability, and contribute to a multi-year AI roadmap while mentoring junior staff and ensuring secure, compliant deployments.

Qualifications

• Bachelor's degree or Master's with relevant AI/ML experience.
• 4+ years of AI/ML development experience or 2+ years with Master's.
• 4+ years of programming in Python, Go, Scala, CUDA, or Java.

Responsibilities

• Partner with cross-functional teams to deliver AI-powered products.
• Design, develop, test, deploy, and support AI software components.
• Leverage OSS and SaaS AI technologies.
• Improve foundation model optimization for performance, cost, latency, and throughput.
• Contribute to the long-term AI systems roadmap.
• Own end-to-end architecture for complex AI systems with observability and ethics.

Skills

Python

Java

CUDA

Go

Scala

Education

Bachelor's Degree in CS/AI/EE/CE or related

Master's Degree in CS/AI/EE/CE or related

Tools

AWS Ultraclusters

Huggingface

VectorDBs

PyTorch

Job description

Capital One in San Jose, CA seeks an AI Engineer 4 to advance foundation model training, large-scale AI inference, and AI-powered product delivery for customers and partners. You will collaborate with engineers, researchers, PMs, and data teams on end-to-end AI systems.

You will optimize hardware utilization, implement guardrails, governance, and observability, and contribute to a multi-year AI roadmap while mentoring junior staff and ensuring secure, compliant deployments.