Staff AI Engineer — Scalable LLM & AI Systems

Relha LLC; San Francisco, Northern (CA, KY); Hybrid; USD 294,000 - 335,000; Full time

Job summary

Capital One is building responsible AI systems and scalable AI infrastructure. The role partners with engineers, researchers, and PMs to deliver AI-powered products that impact millions of customers and associates.

You will work on foundation model training, LLM inference, guardrails, and observability. We seek a deeply technical candidate with strong software and math foundations who can lead teams and influence stakeholders up to VP level.

Qualifications

• 8+ years developing AI/ML algorithms or technologies
• Experience in Python, Go, Scala, or Java in production
• Experience deploying AI on cloud platforms
• Ability to lead & mentor engineering teams
• Strong communication to stakeholders

Responsibilities

• Partner with cross-functional teams to deliver AI-powered products
• Design, develop, test, deploy, and support AI software components
• Leverage Open Source and SaaS AI technologies
• Invent LLM optimization techniques for production systems
• Contribute to the technical vision and long-term roadmap

Skills

Python

Go

Scala

Java

Cloud deployment

LLM inference

Mentorship

Communication

Education

Bachelor's degree in CS/AI/EE/related

Master's degree in CS/AI/EE/related

Tools

AWS

Google Cloud

Azure

Huggingface

VectorDBs

Nemo Guardrails

PyTorch

Job description

Capital One is building responsible AI systems and scalable AI infrastructure. The role partners with engineers, researchers, and PMs to deliver AI-powered products that impact millions of customers and associates.

You will work on foundation model training, LLM inference, guardrails, and observability. We seek a deeply technical candidate with strong software and math foundations who can lead teams and influence stakeholders up to VP level.