Senior AI Systems Engineer — Scalable LLM & Production AI

Jobtailor; California (MO); On-site; USD 180,000 - 240,000; Full time

Job summary

Capital One is seeking an experienced AI/ML leader to partner with engineers, researchers, and product managers to deliver AI-powered products. Design, develop, test, deploy, and support AI software components including foundation model training, LLM inference, and observability.

You will lead scalable AI systems, optimize training and inference for cost, latency, and throughput, and contribute to the long-term technical vision and roadmap.

Qualifications

• Bachelor's degree in CS/AI or related field with extensive AI/ML experience.
• Proficiency in Python and additional languages (Go/Scala/Java).
• Experience deploying scalable AI on cloud platforms (AWS/GCP/Azure).
• Ability to lead multiple engineering teams and influence stakeholders.

Responsibilities

• Partner with engineers, research scientists, and product managers to deliver AI-powered products.
• Design, develop, test, deploy, and support AI components including training, inference, and observability.
• Leverage open-source and SaaS AI technologies (AWS Ultraclusters, Hugging Face, PyTorch).
• Contribute to the technical vision and long-term roadmap of foundational AI systems.

Skills

Python

Go

Scala

Java

Leadership

Mentoring

Cloud Deployment

LLM Optimization

AI Systems

Education

Bachelor's in CS/AI or related

Master's in AI or related

Tools

AWS

Google Cloud

Azure

Hugging Face

PyTorch

VectorDBs

NeMo Guardrails

AWS Ultraclusters

Job description

Capital One is seeking an experienced AI/ML leader to partner with engineers, researchers, and product managers to deliver AI-powered products. Design, develop, test, deploy, and support AI software components including foundation model training, LLM inference, and observability.

You will lead scalable AI systems, optimize training and inference for cost, latency, and throughput, and contribute to the long-term technical vision and roadmap.