Senior Lead AI Engineering – GenAI Platform Services, Agentic Systems

Jobtailor; California (MO); On-site; USD 150,000 - 210,000; Full time

Job summary

Capital One is seeking an experienced AI Engineer to partner with cross-functional teams to deliver AI-powered products. You will design, develop, test, deploy, and support AI software components including foundation model training, LLM inference, and vector search.

You will leverage OSS/SaaS AI technologies and drive optimization to improve scalability, latency, and cost while contributing to Capital One's long-term AI roadmap.

Qualifications

• Bachelor's degree in CS/AI/EE/CE or related field with 6+ years of AI/ML experience, or Master's with 4+ years.
• At least 6 years programming in Python, Go, Scala, or Java.
• 7+ years deploying scalable AI on cloud platforms (preferred).
• Experience designing, developing, integrating, delivering, and supporting complex AI systems.
• Experience with LLM inference, similarity search, VectorDBs, guardrails, and memory.
• Experience optimizing training/inference software for hardware utilization, latency, throughput, cost.
• Passion for AI research and applying novel techniques in production.
• Excellent communication and presentation skills preferred.

Responsibilities

• Partner with engineers, researchers, TPMs, and PMs to deliver AI-powered products.
• Design, develop, test, deploy, and support AI software components (foundation model training, LLM inference, similarity search, guardrails, evaluation, experimentation, governance, observability).
• Leverage Open Source and SaaS AI technologies (e.g., AWS Ultraclusters, Hugging Face, VectorDBs, NeMo Guardrails, PyTorch).
• Invent optimization techniques to improve scalability, cost, latency, and throughput of production AI systems.
• Contribute to the technical vision and long-term roadmap of foundational AI systems at Capital One.

Skills

Python

Go

Scala

Java

LLM Inference

Similarity Search

VectorDBs

Guardrails

Memory

Cloud Platforms

AI Software Development

Machine Learning

Model Evaluation

Optimization Techniques

Foundation Model Training

Observability

Communication

Presentation

Education

Bachelor's degree in Computer Science, AI, Electrical Engineering, Computer Engineering, or related fields

Master's degree in those fields

Tools

AWS Ultraclusters

Hugging Face

VectorDBs

NeMo Guardrails

PyTorch

Job description

• Partner with engineers, research scientists, technical program managers, and product managers to deliver AI-powered products
• Design, develop, test, deploy, and support AI software components including foundation model training, LLM inference, similarity search, guardrails, model evaluation, experimentation, governance, and observability
• Leverage Open Source and SaaS AI technologies including AWS Ultraclusters, Hugging Face, VectorDBs, NeMo Guardrails, and PyTorch
• Invent and introduce state-of-the-art LLM optimization techniques to improve scalability, cost, latency, and throughput of production AI systems
• Contribute to the technical vision and long-term roadmap of foundational AI systems at Capital One

Requirements

• Bachelor's degree in Computer Science, AI, Electrical Engineering, Computer Engineering, or related fields plus at least 6 years of experience developing AI and ML algorithms or technologies, OR a Master's degree in those fields plus at least 4 years of such experience
• At least 6 years of experience programming with Python, Go, Scala, or Java
• 7 years of experience deploying scalable and responsible AI solutions on cloud platforms preferred
• Experience designing, developing, integrating, delivering, and supporting complex AI systems preferred
• Experience developing AI and ML algorithms or technologies, including LLM inference, similarity search, VectorDBs, guardrails, and memory preferred
• Experience optimizing training and inference software for hardware utilization, latency, throughput, and cost preferred
• Passion for staying current with AI research and applying novel techniques in production
• Excellent communication and presentation skills preferred

Core Competencies

Demonstrates expertise in developing and deploying AI and ML algorithms, with a strong focus on LLM inference, similarity search, and optimization techniques. Proficient in leveraging cloud platforms and open-source technologies to deliver scalable AI solutions.

Highest-signal resume keywords

• AI And ML Algorithm Development
• Python Programming
• LLM Inference
• AWS Ultraclusters
• Scalable AI Solutions Deployment

ATS Optimization Keywords

Hard Skills

• AI Software Development
• Machine Learning Algorithms
• Model Evaluation
• Optimization Techniques
• Foundation Model Training
• Similarity Search
• Guardrails Implementation
• Experimentation
• Governance
• Observability

Soft Skills

• Excellent Communication
• Presentation Skills

Industry Keywords

• AI-Powered Products
• Technical Vision
• Long-Term Roadmap
• Scalability
• Cost Optimization

Tools & Technologies

• Hugging Face
• VectorDBs
• NeMo Guardrails
• PyTorch
• Cloud Platforms