Senior AI Systems Engineer — LLMs & Scalable AI

Capital One; Cambridge (MA); On-site; USD 229,900 - 262,400; Full time

Job summary

Capital One is hiring for a Sr. Lead AI Engineer to advance responsible AI systems and scalable infrastructure. You will partner with engineers, researchers, and product managers to deploy AI components, including training and inference for large models, with a focus on performance and cost efficiency.

You will work with a broad stack of tools (PyTorch, HuggingFace, VectorDBs, Nemo Guardrails) and contribute to CapOne's AI roadmap, driving impactful solutions for customers and associates alike.

Qualifications

• Bachelor's or Master's degree in a relevant field with years of AI/ML experience as specified.
• At least 6 years of experience programming with Python, Go, Scala, or Java; strong engineering foundation.
• Experience deploying scalable AI/ML solutions on cloud platforms and leading engineering teams (preferred).

Responsibilities

• Partner with cross-functional teams to deliver AI-powered products used by associates and customers.
• Design, develop, test, deploy, and support AI software components (foundation model training, LLM inference, guardrails, etc.).
• Leverage a broad stack of Open Source and SaaS AI technologies (AWS Ultraclusters, Huggingface, VectorDBs, Nemo Guardrails, PyTorch).
• Invent and apply state-of-the-art LLM optimization techniques to improve performance, cost, and latency.
• Contribute to the technical vision and long-term roadmap of foundational AI systems at Capital One.

Education

Bachelor's degree in Computer Science, AI, Electrical Engineering, Computer Engineering, or related fields

Master's degree in Computer Science, AI, Electrical Engineering, Computer Engineering, or related fields

Tools

AWS

Google Cloud

Azure

Huggingface

VectorDBs

Nemo Guardrails

PyTorch

Job description

Capital One is hiring for a Sr. Lead AI Engineer to advance responsible AI systems and scalable infrastructure. You will partner with engineers, researchers, and product managers to deploy AI components, including training and inference for large models, with a focus on performance and cost efficiency.

You will work with a broad stack of tools (PyTorch, HuggingFace, VectorDBs, Nemo Guardrails) and contribute to CapOne's AI roadmap, driving impactful solutions for customers and associates alike.