Senior Lead AI Engineer - GenAI Platform & Systems

Capital One National Association; San Jose (CA); On-site; USD 251,000 - 286,000; Full time

Job summary

Capital One in San Jose, CA seeks a Senior Lead AI Engineer to design, deploy, and support AI software components including foundation model training, LLM inference, and guardrails. You will collaborate across engineering, research, and product teams to deliver scalable AI-powered solutions for customers and associates.

You will optimize training and inference pipelines for latency, cost, and throughput, contribute to the technical vision, and mentor junior engineers while upholding responsible

Qualifications

• Bachelor's or Master's degree with relevant AI/ML experience.
• Experience programming in Python, Go, Scala, or Java.
• Experience deploying scalable AI/ML solutions on cloud platforms.
• Ability to lead and mentor an engineering team and influence stakeholders.
• Familiarity with LLMs, vector databases, and guardrails is a plus.

Responsibilities

• Partner with cross-functional teams to deliver AI-powered products.
• Design, develop, test, deploy, and support AI software components (LLMs, inference, guardrails).
• Leverage Open Source and SaaS AI tech (AWS Ultraclusters, Huggingface, VectorDBs, PyTorch).
• Invent state-of-the-art optimization techniques for training and inference.
• Contribute to the technical vision and long-term roadmap of AI systems.

Skills

System design & engineering

Python/Go/Scala/Java

Clear communication

Leadership / mentoring

Education

Bachelor's degree in Computer Science, AI, Electrical Engineering, Computer Engineering, or related fields + 6 years

Master's degree in Computer Science, AI, Electrical Engineering, Computer Engineering, or related fields + 4 years

Tools

AWS Ultraclusters

Huggingface

VectorDBs

Nemo Guardrails

PyTorch

Job description

Capital One in San Jose, CA seeks a Senior Lead AI Engineer to design, deploy, and support AI software components including foundation model training, LLM inference, and guardrails. You will collaborate across engineering, research, and product teams to deliver scalable AI-powered solutions for customers and associates.

You will optimize training and inference pipelines for latency, cost, and throughput, contribute to the technical vision, and mentor junior engineers while upholding responsible