Senior AI Engineer: Foundation Models & Agentic AI

Capital One Group; San Jose (CA); Hybrid; USD 251,000 - 286,000; Full time

Job summary

Capital One is hiring an AI Engineer 5 to design, develop, and deploy AI software components including foundation models, LLM inference, agents, and multi-model workflows. The role focuses on cost-effective, scalable AI systems with strong governance and observability.

You will collaborate with engineers, researchers, PMs, and product teams to advance AI capabilities at Capital One, enabling real-time, personalized customer experiences across banking services.

Qualifications

• Bachelor’s degree in Computer Science, AI, Electrical Engineering, Computer Engineering, or related fields plus 6+ years of experience.
• Experience programming with Python, Go, Scala, CUDA, or Java is required.
• Experience deploying scalable and responsible AI solutions on cloud platforms (AWS, Google Cloud, Azure).
• Experience developing AI/ML algorithms or technologies (LLM Inference, Similarity Search, VectorDBs) in production.

Responsibilities

• Partner with cross-functional teams to deliver AI-powered products.
• Design, develop, test, deploy, and support AI software components (LLMs, agents, vector search, governance).
• Lead model optimization for performance, cost, latency, and throughput.
• Mentor engineers and drive architectural consistency and AI standards.

Skills

Python

Go

Scala

CUDA

Java

PyTorch

LLM Inference

Agentic AI

Education

Bachelor's degree in CS/AI/related

Master's degree in CS/AI/related

Tools

AWS

Huggingface

VectorDBs

PyTorch

Ultraclusters

Job description

Capital One is hiring an AI Engineer 5 to design, develop, and deploy AI software components including foundation models, LLM inference, agents, and multi-model workflows. The role focuses on cost-effective, scalable AI systems with strong governance and observability.

You will collaborate with engineers, researchers, PMs, and product teams to advance AI capabilities at Capital One, enabling real-time, personalized customer experiences across banking services.