Senior AI Platform Lead: GenAI & LLM Systems

Capital One; Cambridge (MA); On-site; USD 230,000 - 286,000; Full time

Benefits offered by this job

Performance incentives

Health benefits

Job summary

Capital One is seeking a Sr Lead AI Engineer in Cambridge, MA to partner with engineers, researchers, PMs, and designers to build AI-powered banking solutions. You will design and deploy AI software components, optimize LLMs, and help shape the long-term foundational AI systems roadmap at Capital One.

The role emphasizes building robust AI platforms, guardrails, and observability while collaborating across teams to deliver high-impact customer experiences.

Qualifications

• Bachelor's degree in Computer Science, AI, Electrical Engineering, Computer Engineering, or related fields plus at least 6 years of experience developing AI and ML algorithms or technologies.
• At least 6 years of experience programming with Python, Go, Scala, or Java

Responsibilities

• Partner with cross-functional engineers, research scientists, PMs, and product managers to deliver AI-powered products.
• Design, develop, test, deploy, and support AI software components including foundation model training, LLM inference, similarity search, guardrails, model evaluation and observability.
• Invent and introduce state-of-the-art LLM optimization techniques to improve performance, scalability, cost, latency, throughput of large-scale production AI systems.
• Contribute to the technical vision and long-term roadmap of foundational AI systems at Capital One.

Skills

Python

Go/Scala/Java

Machine learning

AI systems

Education

Bachelor's degree in CS/AI/EE/CE

Tools

AWS Ultraclusters

Huggingface

VectorDBs

Nemo Guardrails

PyTorch

Job description

Capital One is seeking a Sr Lead AI Engineer in Cambridge, MA to partner with engineers, researchers, PMs, and designers to build AI-powered banking solutions. You will design and deploy AI software components, optimize LLMs, and help shape the long-term foundational AI systems roadmap at Capital One.

The role emphasizes building robust AI platforms, guardrails, and observability while collaborating across teams to deliver high-impact customer experiences.