Remote Staff AI Engineer — LLM & AI Systems

Capital One National Association; San Francisco (CA); Remote; USD 294,000 - 335,000; Full time

Job summary

Capital One is seeking a Distinguished AI Engineer to advance AI foundations and experiences (IFX). You will partner across engineering, research, PMs, and product teams to build AI-powered products that transform how associates work and how customers interact with Capital One.

You will design, train, deploy, and optimize large-scale AI systems using a broad toolset. You will help shape the long-term roadmap for foundational AI systems, mentor teams, and drive responsible, high-performance AI

Qualifications

• Bachelor's degree in Computer Science, Engineering, or AI plus at least 8 years of experience developing AI and ML algorithms or technologies
• Master's degree plus at least 6 years of experience developing AI and ML algorithms or technologies
• At least 8 years of experience programming with Python, Go, Scala, or Java

Responsibilities

• Partner with a cross-functional team of engineers, research scientists, technical program managers, and product managers to deliver AI-powered products
• Design, develop, test, deploy, and support AI software components including foundation model training, LLM inference, similarity search, guardrails, model evaluation, experimentation, governance, and observability
• Leverage a broad stack of Open Source and SaaS AI technologies such as AWS Ultraclusters, Huggingface, VectorDBs, Nemo Guardrails, PyTorch, and more
• Invent and introduce state-of-the-art LLM optimization techniques to improve performance, scalability, cost, latency, throughput
• Contribute to the technical vision and the long-term roadmap of foundational AI systems at Capital One

Skills

Python

Go

Scala/Java

LLM optimization

Cross-functional collaboration

Research literacy

Education

Bachelor's degree in CS/Engineering/AI

Master's degree in CS/CE or relevant field

Tools

AWS Ultraclusters

Huggingface

VectorDBs

Nemo Guardrails

PyTorch

Job description

Capital One is seeking a Distinguished AI Engineer to advance AI foundations and experiences (IFX). You will partner across engineering, research, PMs, and product teams to build AI-powered products that transform how associates work and how customers interact with Capital One.

You will design, train, deploy, and optimize large-scale AI systems using a broad toolset. You will help shape the long-term roadmap for foundational AI systems, mentor teams, and drive responsible, high-performance AI