Senior AI Engineer (Remote) – Scalable ML Systems

Capital One; San Francisco, Northern (CA, KY); Hybrid; USD 294,000 - 335,000; Full time

Job summary

Capital One is seeking a Staff AI Engineer (Remote Eligible) to help build responsible, scalable AI systems for banking. You will partner with engineers, researchers, PMs, and product teams to create AI-powered products that transform how associates work and how customers interact with Capital One.

You will design and deploy AI software components, including foundation models, LLM inference, and guardrails, while leveraging a broad stack of Open Source and SaaS technologies.

Qualifications

• Bachelor's degree in Computer Science, Engineering, or AI plus at least 8 years of experience developing AI/ML algorithms or technologies, or Master's degree plus at least 6 years of experience developing AI/ML algorithms or technologies
• At least 8 years of experience programming with Python, Go, Scala, or Java

Responsibilities

• Partner with cross-functional teams to deliver AI-powered products that change how associates work and how customers interact with Capital One
• Design, develop, test, deploy, and support AI software components including foundation model training, LLM inference, similarity search, guardrails, model evaluation, experimentation, governance, and observability
• Leverage Open Source and SaaS AI technologies such as AWS Ultraclusters, Huggingface, VectorDBs, Nemo Guardrails, PyTorch
• Invent and introduce state-of-the-art LLM optimization techniques to improve performance, scalability, cost, latency, throughput
• Contribute to the technical vision and long-term roadmap of foundational AI systems at Capital One

Skills

Python

Go

Scala

Java

LLM Inference

Similarity Search

VectorDBs

Memory

Guardrails

PyTorch

Education

Bachelor's degree in CS/Engineering/AI

Master's degree in CS/CE or related field

Tools

AWS Ultraclusters

Huggingface

VectorDBs

Nemo Guardrails

PyTorch

Job description

Capital One is seeking a Staff AI Engineer (Remote Eligible) to help build responsible, scalable AI systems for banking. You will partner with engineers, researchers, PMs, and product teams to create AI-powered products that transform how associates work and how customers interact with Capital One.

You will design and deploy AI software components, including foundation models, LLM inference, and guardrails, while leveraging a broad stack of Open Source and SaaS technologies.