Senior AI Foundations Engineer - Large-Scale AI Systems

Capital One National Association; San Jose (CA); On-site; USD 251,000 - 286,000; Full time

Job summary

Capital One is seeking an AI Engineer 5 in San Jose, CA to design, develop, and deploy AI-powered products. You will work with a cross-functional team to advance foundation models, LLM inference, and multi-model orchestration, using a broad stack that includes AWS Ultraclusters, Huggingface, VectorDBs, and PyTorch.

The role emphasizes optimizing performance, cost, latency, and throughput of large-scale AI systems, while contributing to the long-term architectural roadmap and responsible AI

Qualifications

• Bachelor's degree in Computer Science, AI, Electrical Engineering, Computer Engineering, or related fields with at least 6 years of AI/ML experience.
• Master's degree in Computer Science, AI, Electrical Engineering, Computer Engineering, or related fields with at least 4 years of AI/ML experience.
• 6+ years of programming experience in Python, Go, Scala, CUDA or Java.

Responsibilities

• Partner with a cross-functional team of engineers, research scientists, TPMs, and PMs to deliver AI-powered products.
• Design, develop, test, deploy, and support AI software components including foundation model training, LLM inference, agents, and more.
• Leverage Open Source and SaaS AI technologies such as AWS Ultraclusters, Huggingface, VectorDBs, PyTorch.
• Invent and introduce state-of-the-art foundation model optimization techniques for scaling production AI systems.
• Contribute to the technical vision and long-term roadmap of foundational AI systems at Capital One.
• Design, implement and optimize multi-model orchestration pipelines integrating LLMs, vector search, and domain models.
• Establish governance reviews of AI systems, tracking GPU usage, model throughput, and inference cost.

Skills

Python

Go

Scala

CUDA

Java

Education

Bachelor's degree in CS/AI/EE/CE

Master's degree in CS/AI/EE/CE

Tools

AWS Ultraclusters

Huggingface

VectorDBs

PyTorch

Job description

Capital One is seeking an AI Engineer 5 in San Jose, CA to design, develop, and deploy AI-powered products. You will work with a cross-functional team to advance foundation models, LLM inference, and multi-model orchestration, using a broad stack that includes AWS Ultraclusters, Huggingface, VectorDBs, and PyTorch.

The role emphasizes optimizing performance, cost, latency, and throughput of large-scale AI systems, while contributing to the long-term architectural roadmap and responsible AI