Senior AI Systems Engineer – Scale Real-Time AI

Capital One

San Jose (CA)

On-site

USD 179,000 - 246,000

Full time

5 days ago

Be an early applicant

Application generator

Get a reply from this employer — a resume and cover letter tailored to exactly what they’re hiring for.

Get past ATS filters

Job summary

Capital One is seeking a Lead AI Engineer in the US to help build responsible AI systems and scalable AI infrastructure across the bank. You will work with engineers, researchers, PMs, and product teams to deliver AI-powered products for customers and associates.

You will design, develop, test, deploy, and support AI software components, including foundation model training, LLM inference, guardrails, and observability, while leveraging Open Source and SaaS tools like HuggingFace, PyTorch,

Qualifications

Bachelor's degree in CS, AI, EE, or related fields plus 4+ years in AI/ML.
4+ years programming in Python, Go, Scala, or Java.
6 years of experience deploying scalable AI solutions on cloud platforms.
Experience developing AI/ML algorithms or technologies (LLM Inference, Similarity Search, VectorDBs, Guardrails).

Responsibilities

Partner with cross-functional teams to deliver AI-powered products.
Design, develop, test, deploy, and support AI software components (LLM training, inference, guards, evaluation, observability).
Leverage Open Source and SaaS AI tech (AWS Ultraclusters, HuggingFace, VectorDBs, PyTorch).
Invent state-of-the-art LLM optimization techniques for production systems.
Contribute to the long-term technical vision and roadmap.