Senior AI Systems Engineer - LLMs & Guardrails

Capital One; San Francisco (CA); On-site; USD 343,400 - 392,000; Full time

Job summary

Capital One in San Francisco seeks a senior AI systems engineer to design, train, and deploy production-ready AI components, including foundation models, inference, and governance.

You will collaborate with engineers, researchers, PMs, and SREs to push scalable AI across banking products, applying open source tools like PyTorch, HuggingFace, and VectorDBs.

Strong math and software engineering fundamentals, plus leadership potential, are valued as we build inspiring, responsible AI platforms.

Qualifications

• Bachelor's degree in Computer Science, AI, Electrical Engineering, Computer Engineering, or related field plus at least 10 years of experience developing AI/ML algorithms or a Master's degree plus at least 8 years of experience.
• At least 10 years of experience programming with Python, Go, Scala, or Java.

Responsibilities

• Deliver AI-powered products with cross-functional teams including engineers, researchers, PMs, and product managers.
• Design, develop, test, deploy, and support AI software components including foundation model training, LLM inference, similarity search, guardrails, model evaluation, experimentation, governance, and observability.
• Leverage Open Source and SaaS AI tools such as AWS Ultraclusters, HuggingFace, VectorDBs, Nemo Guardrails, PyTorch, and more.

Skills

Python

Go

Scala

Java

LLM optimization

Education

Bachelor's degree in CS/AI/EE/CE or related field

Master's degree in CS/AI/EE/CE or related field

Tools

AWS Ultraclusters

HuggingFace

VectorDBs

Nemo Guardrails

PyTorch

Job description

Capital One in San Francisco seeks a senior AI systems engineer to design, train, and deploy production-ready AI components, including foundation models, inference, and governance.

You will collaborate with engineers, researchers, PMs, and SREs to push scalable AI across banking products, applying open source tools like PyTorch, HuggingFace, and VectorDBs.

Strong math and software engineering fundamentals, plus leadership potential, are valued as we build inspiring, responsible AI platforms.