Senior Lead AI Engineer, Gen AI Platform & Systems

Capital One; Cambridge (MA); On-site; USD 230,000 - 262,000; Full time

Job summary

Capital One is building responsible AI systems to reimagine banking. In this Sr Lead AI Engineer role, you will design and deploy scalable AI software, optimize LLM inference, and shape the AI roadmap. Collaborate with engineers, scientists, PMs, and leadership to deliver real value to customers.

You will work with a broad stack including AWS, HuggingFace, vector databases, and PyTorch, advancing production AI capabilities while ensuring responsible practices.

Qualifications

• Bachelor’s or Master’s-level degree with multiple years of AI/ML experience.
• Experience with Python, Go, Scala or Java in production ML systems.
• Demonstrated ability to design and deploy scalable AI solutions on cloud platforms.
• Ability to mentor engineers and influence cross-functional stakeholders.
• Familiarity with LLM inference, guardrails, and model evaluation.

Responsibilities

• Partner with cross-functional teams to deliver AI-powered products.
• Design, develop, test, deploy, and support AI software components.
• Utilize Open Source and SaaS AI tech, such as PyTorch and vector databases.
• Develop state-of-the-art LLM optimization techniques for production systems.
• Contribute to technical vision and long-term AI roadmap at Capital One.

Skills

Python

Go

Scala

Java

ML Algorithms

AI Systems

Education

Bachelor's degree in CS/AI/EE/CE or related

Master's degree in CS/AI/EE/CE or related

Tools

AWS

Google Cloud

Azure

HuggingFace

PyTorch

VectorDBs

Job description

Capital One is building responsible AI systems to reimagine banking. In this Sr Lead AI Engineer role, you will design and deploy scalable AI software, optimize LLM inference, and shape the AI roadmap. Collaborate with engineers, scientists, PMs, and leadership to deliver real value to customers.

You will work with a broad stack including AWS, HuggingFace, vector databases, and PyTorch, advancing production AI capabilities while ensuring responsible practices.