Senior AI Engineer: Foundation Models & Production

Capital One Group; San Jose (CA); On-site; USD 215,000 - 246,000; Full time

Job summary

Capital One is hiring an AI Engineer 4 to build responsible and scalable AI systems within the IFX team. You’ll partner with engineers, researchers, and PMs to bring AI-powered products into production, focusing on foundation models, agents, and high-performance inference.

The role emphasizes governance, observability, and ethical alignment while leveraging Open Source and SaaS AI tools across AWS and other platforms. Strong programming and AI system design are essential.

Qualifications

• Bachelor's or Master's in CS/AI/EE/CE or related fields with relevant experience.
• At least 4 years of experience developing AI/ML algorithms or technologies.
• 4+ years programming experience in Python, Go, Scala, CUDA, or Java.

Responsibilities

• Partner with cross-functional teams to deliver AI-powered products used by Capital One associates and customers.
• Design, develop, test, deploy, and support AI software components (foundation model training, LLM inference, agents, vector search, guardrails, governance, observability).
• Leverage Open Source and SaaS AI technologies (AWS Ultraclusters, HuggingFace, PyTorch, VectorDBs).
• Develop state-of-the-art optimization techniques to improve performance, cost, latency, and throughput of large-scale AI systems.
• Contribute to long-term technical vision and roadmap for foundational AI systems at Capital One.
• Own end-to-end architecture for complex AI systems with maintainability and ethical alignment.
• Define and maintain SLIs for AI reliability (latency, uptime, model drift).
• Collaborate with infra engineering to optimize GPU/TPU utilization and accelerate inference pipelines.
• Lead cross-functional reviews for new AI deployments focusing on security and governance.
• Mentor senior engineers on scalable design and production translation.

Skills

Python

Go

Scala

CUDA

Java

Education

Bachelor's degree in CS/AI/EE/CE or related fields

Master's degree in CS/AI/EE/CE or related fields

Tools

AWS

HuggingFace

PyTorch

VectorDBs

Job description

Capital One is hiring an AI Engineer 4 to build responsible and scalable AI systems within the IFX team. You’ll partner with engineers, researchers, and PMs to bring AI-powered products into production, focusing on foundation models, agents, and high-performance inference.

The role emphasizes governance, observability, and ethical alignment while leveraging Open Source and SaaS AI tools across AWS and other platforms. Strong programming and AI system design are essential.