Senior AI Engineer - Foundations, LLM Core & Agentic AI

Capital One National Association; San Jose (CA); On-site; USD 215,000 - 246,000; Full time

Job summary

Capital One seeks an AI Engineer 4 to design, build, and scale AI products across foundation models, agents, and inference pipelines. You will work on guardrails, governance, and observability while optimizing costs and performance.

You will collaborate with engineers, researchers, and product teams to advance AI capabilities in a responsible, scalable way across Capital One's platforms.

Qualifications

• Bachelor's or Master's degree in a relevant field with several years of AI/ML experience.
• Proven experience in Python/Go/Scala/CUDA/Java.
• Experience with AI model deployment and scalable systems.

Responsibilities

• Partner with cross-functional teams to deliver AI-powered products.
• Design, develop, test, deploy, and support AI software components.
• Leverage Open Source and SaaS AI technologies.
• Optimize foundation model performance, cost, latency, and throughput.
• Contribute to technical vision and long-term AI roadmaps.
• Own end-to-end architecture for complex AI systems with governance.

Skills

Python

Go

Scala

CUDA

Java

LLM inference

Agentic AI

GPU/TPU optimization

Observability

Security & governance

Education

Bachelor's degree in Computer Science, AI, Electrical Engineering, Computer Engineering, or related fields

Master's degree in Computer Science, AI, Electrical Engineering, Computer Engineering, or related fields

Tools

AWS Ultraclusters

Huggingface

VectorDBs

PyTorch

Job description

Capital One seeks an AI Engineer 4 to design, build, and scale AI products across foundation models, agents, and inference pipelines. You will work on guardrails, governance, and observability while optimizing costs and performance.

You will collaborate with engineers, researchers, and product teams to advance AI capabilities in a responsible, scalable way across Capital One's platforms.