Senior Lead AI Engineer — GenAI Platform & Scale

Jobtailor; California (MO); On-site; USD 150,000 - 210,000; Full time

Job summary

Capital One is seeking an experienced AI Engineer to partner with cross-functional teams to deliver AI-powered products. You will design, develop, test, deploy, and support AI software components including foundation model training, LLM inference, and vector search.

You will leverage OSS/SaaS AI technologies and drive optimization to improve scalability, latency, and cost while contributing to Capital One's long-term AI roadmap.

Qualifications

• Bachelor's degree in CS/AI/EE/CE or related field with 6+ years of AI/ML experience, or Master's with 4+ years.
• At least 6 years programming in Python, Go, Scala, or Java.
• 7+ years deploying scalable AI on cloud platforms (preferred).
• Experience designing, developing, integrating, delivering, and supporting complex AI systems.
• Experience with LLM inference, similarity search, VectorDBs, guardrails, and memory.
• Experience optimizing training/inference software for hardware utilization, latency, throughput, cost.
• Passion for AI research and applying novel techniques in production.
• Excellent communication and presentation skills preferred.

Responsibilities

• Partner with engineers, researchers, TPMs, and PMs to deliver AI-powered products.
• Design, develop, test, deploy, and support AI software components (foundation model training, LLM inference, similarity search, guardrails, evaluation, experimentation, governance, observability).
• Leverage Open Source and SaaS AI technologies (e.g., AWS Ultraclusters, Hugging Face, VectorDBs, NeMo Guardrails, PyTorch).
• Invent optimization techniques to improve scalability, cost, latency, and throughput of production AI systems.
• Contribute to the technical vision and long-term roadmap of foundational AI systems at Capital One.

Skills

Python

Go

Scala

Java

LLM Inference

Similarity Search

VectorDBs

Guardrails

Memory

Cloud Platforms

AI Software Development

Machine Learning

Model Evaluation

Optimization Techniques

Foundation Model Training

Observability

Communication

Presentation

Education

Bachelor's degree in Computer Science, AI, Electrical Engineering, Computer Engineering, or related fields

Master's degree in those fields

Tools

AWS Ultraclusters

Hugging Face

VectorDBs

NeMo Guardrails

PyTorch

Job description

Capital One is seeking an experienced AI Engineer to partner with cross-functional teams to deliver AI-powered products. You will design, develop, test, deploy, and support AI software components including foundation model training, LLM inference, and vector search.

You will leverage OSS/SaaS AI technologies and drive optimization to improve scalability, latency, and cost while contributing to Capital One's long-term AI roadmap.