Senior AI Systems Engineer - Scalable LLM & Infra

Relha LLC

San Francisco, Northern (CA, KY)

Hybrid

USD 343,000 - 392,000

Full time

14 days+

Application generator

Turn this role into an interview — a resume and cover letter built around what this employer wants.

Get past ATS filters

Job summary

Capital One is seeking an experienced Senior Distinguished AI Engineer to help build responsible, scalable AI systems. You will partner with engineers, researchers, PMs, and others to deliver AI-powered products and deploy foundation models, inference, and guardrails.

The role emphasizes leadership, cloud experience, and staying current with AI research, with compensation aligned to regional salary bands for San Francisco, CA.

Qualifications

Bachelors or Masters in a relevant field with many years of AI/ML experience.
10+ years coding in Python, Go, Scala or Java with production-grade impact.
Experience deploying scalable AI in cloud environments and leading teams.

Responsibilities

Collaborate with cross-functional teams to deliver AI-powered products.
Design, develop, test, deploy and support AI software components including LLMs and guardrails.
Leverage OSS and SaaS AI tools (AWS, Hugging Face, PyTorch) to build production systems.
Invent advanced LLM optimization techniques to improve performance, latency and cost.
Contribute to the technical vision and roadmaps for Capital One AI systems.

Skills

Python

Scala

Java

Leadership

Education

Bachelor's degree in Computer Science, AI, Electrical Engineering, Computer Engineering, or related fields

Master's degree in Computer Science, AI, Electrical Engineering, Computer Engineering, or related fields

Tools

AWS Ultraclusters

Hugging Face

VectorDBs

Nemo Guardrails

PyTorch

Guardrails

Job description

The role emphasizes leadership, cloud experience, and staying current with AI research, with compensation aligned to regional salary bands for San Francisco, CA.

Get your free, confidential resume review.

or drag and drop your file here.