Lead Gen AI Platform Eng – LLM Systems & Infra

Capital One

McLean (VA)

On-site

USD 197,000 - 225,000

Full time

2 days ago

Be an early applicant

Application generator

Turn this role into an interview — a resume and cover letter built around what this employer wants.

Get past ATS filters

Job summary

Capital One is seeking a Lead AI Engineer for Gen AI Platform Services to build and scale responsible AI systems across the company. You will collaborate with engineers, researchers, PMs, and data scientists to deliver AI-powered products and services that touch millions of customers.

You will design, train, deploy, and monitor foundation models, inference pipelines, and guardrails, using PyTorch, Huggingface, VectorDBs, and compatible cloud tools.

Qualifications

Bachelor’s degree with 4+ years AI/ML experience or Master’s with 2+ years.
4+ years in Python/Go/Scala/Java programming.
Experience deploying scalable AI on cloud platforms (AWS, GCP, Azure).
Experience with LLM inference, vector stores, guardrails and model evaluation.
Strong engineering and math foundation; production-ready mindset.

Responsibilities

Partner with cross‑functional teams to deliver AI-powered products.
Design, develop, test, deploy, and support AI software components.
Leverage Open Source and SaaS AI tech stacks (LLMs, PyTorch, VectorDBs).
Invent state‑of‑the‑art optimization techniques for scale, cost, latency.
Contribute to the technical vision and long‑term AI system roadmap.

Skills

Problem solving

Communication

Adaptability

Technical leadership

Cross-functional collaboration

Education

Bachelor’s degree in CS/AI/EE/CE

Master’s degree in CS/AI/EE/CE

Tools

AWS

Google Cloud

Azure

Huggingface

PyTorch

VectorDBs

Nemo Guardrails

Job description

You will design, train, deploy, and monitor foundation models, inference pipelines, and guardrails, using PyTorch, Huggingface, VectorDBs, and compatible cloud tools.

Get your free, confidential resume review.

or drag and drop your file here.