AI Foundations & LLM Engineer — Agentic AI

Capital One; San Jose (CA); On-site; USD 215,000 - 246,000; Full time

Benefits offered by this job

Incentive compensation

Job summary

Capital One National Association is seeking an AI Engineer 4 to join the Intelligent Foundations and Experiences (IFX) team in San Jose. You will partner with cross-functional teams to deliver AI-powered products, design and deploy AI software, and advance foundation models with scalable, responsible AI practices.

The role emphasizes architecture ownership, performance optimization, and collaboration with infrastructure to accelerate AI pipelines while upholding governance and security

Qualifications

• Bachelor's degree in Computer Science, AI, Electrical Engineering, Computer Engineering, or related fields plus at least 4 years of experience developing AI/ML algorithms or technologies.
• At least 4 years of experience programming with Python, Go, Scala, CUDA, or Java

Responsibilities

• Partner with a cross-functional team of engineers, research scientists, technical program managers, and product managers to deliver AI-powered products.
• Design, develop, test, deploy, and support AI software components including foundation model training, LLM inference, agents and multi-agent workflows.
• Leverage a broad stack of Open Source and SaaS AI technologies such as AWS Ultraclusters, Huggingface, VectorDBs, PyTorch.
• Invent and introduce state-of-the-art foundation model optimization techniques to improve performance, latency, and cost.
• Contribute to the technical vision and long-term roadmap of foundational AI systems at Capital One.
• Own the end-to-end architecture for complex AI systems with maintainability and observability.
• Define and maintain SLOs for AI reliability including latency, uptime, and model performance drift.
• Collaborate with infrastructure to optimize GPU/TPU utilization and accelerate inference pipelines.
• Lead cross-functional technical reviews for new AI system deployments; ensure security and governance.
• Mentor Principal and Senior Associates on scalable design and production translation

Skills

Python

Go

Scala

CUDA

Java

Education

Bachelor's degree in CS/AI/EE/CE

Master's degree in CS/AI/EE/CE

Tools

AWS

Huggingface

VectorDBs

PyTorch

Job description

Capital One National Association is seeking an AI Engineer 4 to join the Intelligent Foundations and Experiences (IFX) team in San Jose. You will partner with cross-functional teams to deliver AI-powered products, design and deploy AI software, and advance foundation models with scalable, responsible AI practices.

The role emphasizes architecture ownership, performance optimization, and collaboration with infrastructure to accelerate AI pipelines while upholding governance and security