Senior AI Foundations Engineer — Scalable LLM Systems

Capital One Group; California (MO); Hybrid; USD 251,000 - 286,000; Full time

Job summary

Capital One is seeking an AI Engineer 5 to advance AI foundations across multiple locations in the United States. You will partner with engineers, researchers, PMs, and product teams to deliver AI-powered products that impact both associates and customers.

The role involves building, testing, deploying, and supporting AI software, including foundation model training, LLM inference, agents, and vector databases, with a focus on performance, cost, and governance.

Qualifications

• Bachelor's degree in CS/AI/EE/CE with 6+ years experience or Master's with 4+ years.
• 6+ years of experience programming with Python, Go, Scala, CUDA, or Java.
• Experience deploying scalable AI solutions on cloud platforms (AWS, GCP, Azure).
• Experience designing, delivering, and supporting complex AI systems.
• Experience developing AI/ML algorithms (LLM Inference, Similarity Search, VectorDBs, Guardrails, Memory).
• Excellent communication and presentation skills to explain AI concepts to peers.

Responsibilities

• Partner with cross-functional teams to deliver AI-powered products.
• Design, develop, test, deploy, and support AI software components including foundation model training and inference.
• Leverage Open Source and SaaS AI technologies like HuggingFace, PyTorch, and VectorDBs.
• Invent optimization techniques to improve performance, cost, latency, and throughput of AI systems.
• Define and evolve the technical vision and roadmap for foundational AI at Capital One.
• Lead multi-model orchestration pipelines integrating LLMs, vector search, and domain models.

Skills

Python

Go

Scala

CUDA

Java

AI/ML algorithms

Education

Bachelors degree in CS/AI/EE/CE

Masters degree in CS/AI/EE/CE

Tools

HuggingFace

PyTorch

AWS Ultraclusters

VectorDBs

Job description

Capital One is seeking an AI Engineer 5 to advance AI foundations across multiple locations in the United States. You will partner with engineers, researchers, PMs, and product teams to deliver AI-powered products that impact both associates and customers.

The role involves building, testing, deploying, and supporting AI software, including foundation model training, LLM inference, agents, and vector databases, with a focus on performance, cost, and governance.