Senior AI Engineer — Scalable LLM & AI Systems

Capital One; San Jose (CA); On-site; USD 251,000 - 286,000; Full time

Job summary

Capital One is seeking an AI Engineer to design and deliver AI-powered products with cross-functional teams. You will work on foundation model training, inference, agents, vector search, and governance, contributing to scalable, responsible AI systems.

You will optimize multi-model orchestration pipelines, integrate LLMs with domain-specific models, and drive observability, cost efficiency, and performance across production pipelines.

Qualifications

• Bachelor's degree in Computer Science, AI, Electrical Engineering, Computer Engineering, or related fields plus at least 6 years of experience developing AI and ML algorithms or technologies, or a Master's degree in Computer Science, AI, Electrical Engineering, Computer Engineering, or related fields plus at least 4 years of experience developing AI and ML algorithms or technologies
• At least 6 years of experience programming with Python, Go, Scala, CUDA, or Java

Responsibilities

• Partner with cross-functional team of engineers, research scientists, technical program managers, and product managers to deliver AI-powered products
• Design, develop, test, deploy, and support AI software components including foundation model training, LLM inference, agents and multi-agent workflows, similarity search, guardrails, model evaluation, experimentation, governance, and observability
• Leverage a broad stack of Open Source and SaaS AI technologies such as AWS Ultraclusters, Huggingface, VectorDBs, PyTorch, and more
• Invent and introduce state-of-the-art foundation model optimization techniques to improve performance, scalability, cost, latency, throughput
• Contribute to the technical vision and the long term roadmap of foundational AI systems at Capital One
• Design, implement and optimize multi-model orchestration pipelines - integrating LLMs, vector search, and domain-specific models into unified systems
• Establish and lead cost-performance governance reviews across AI systems, tracking GPU utilization, model throughput, and inference cost efficiency
• Lead team design councils or design review boards to ensure technical consistency and compliance with AI engineering standards

Skills

Python

Go

Scala

CUDA

Java

Education

Bachelor's degree in CS/AI/EE or related field

Master's degree in CS/AI/EE or related field

Tools

AWS Ultraclusters

HuggingFace

VectorDBs

PyTorch

Job description

Capital One is seeking an AI Engineer to design and deliver AI-powered products with cross-functional teams. You will work on foundation model training, inference, agents, vector search, and governance, contributing to scalable, responsible AI systems.

You will optimize multi-model orchestration pipelines, integrate LLMs with domain-specific models, and drive observability, cost efficiency, and performance across production pipelines.