Senior Gen AI Platform Engineer

Capital One National Association; San Francisco (CA); On-site; USD 251,000 - 286,000; Full time

Job summary

Capital One is seeking an AI Engineer 5 for Gen AI Platform Services in San Francisco. You will design and deploy AI software components, including foundation model training, LLM inference, agents, and multi-model workflows, while optimizing performance and cost.

Collaborate with engineers, PMs, and researchers to advance responsible AI systems at scale. The ideal candidate has 6+ years in AI/ML, strong Python/Java/CUDA skills, and experience with cloud and vector databases.

Qualifications

• Bachelor's or Master's in a related field with years of experience developing AI/ML algorithms or technologies
• At least 6 years of experience programming with Python, Go, Scala, CUDA, or Java
• 7+ years of experience deploying scalable AI solutions on cloud platforms is preferred
• Experience designing, developing, delivering, and supporting complex AI systems

Responsibilities

• Partner with cross-functional teams to deliver AI-powered products
• Design, develop, test, deploy, and support AI software components including model training and inference
• Invent and optimize foundation model techniques to improve performance, cost, latency, and throughput
• Lead multi-model orchestration pipelines integrating LLMs, vector search, and domain models
• Establish cost-performance governance and monitor GPU utilization and inference cost efficiency
• Mentor senior engineers and contribute to the technical roadmap of AI systems

Skills

Python

Go

Scala

CUDA

Java

ML algorithms

Agentic AI

System design

Education

Bachelor's degree in Computer Science, AI, Electrical Engineering, Computer Engineering, or related fields

Master's degree in Computer Science, AI, Electrical Engineering, Computer Engineering, or related fields

Tools

AWS Ultraclusters

Huggingface

VectorDBs

PyTorch

Job description

Capital One is seeking an AI Engineer 5 for Gen AI Platform Services in San Francisco. You will design and deploy AI software components, including foundation model training, LLM inference, agents, and multi-model workflows, while optimizing performance and cost.

Collaborate with engineers, PMs, and researchers to advance responsible AI systems at scale. The ideal candidate has 6+ years in AI/ML, strong Python/Java/CUDA skills, and experience with cloud and vector databases.