Senior AI Engineer: Foundational LLMs & Systems

Capital One; Cambridge (MA); On-site; USD 315,000 - 359,000; Full time

Benefits offered by this job

Performance-based incentives

Job summary

Capital One is seeking an experienced AI Engineer to design, implement, and optimize AI-powered products at scale. You will partner with engineers, researchers, PMs, and product managers to deploy foundation models, inference, and governance across Production environments.

The role emphasizes building robust AI systems, exploring open‑source and SaaS tools, and driving the long‑term roadmap for foundational AI at Capital One.

Qualifications

• Bachelor's degree in Computer Science, AI, Electrical Engineering, Computer Engineering, or related fields plus at least 10 years of experience developing AI and ML algorithms or technologies, or a Master's degree in Computer Science, AI, Electrical Engineering, Computer Engineering, or related fields plus at least 8 years of experience developing AI and ML algorithms or technologies
• At least 10 years of experience programming with Python, Go, Scala, or Java
• Experience deploying scalable and responsible AI solutions on cloud platforms (e.g. AWS, Google Cloud, Azure) is preferred

Responsibilities

• Partner with cross-functional teams to deliver AI-powered products
• Design, develop, test, deploy, and support AI software components including LLMs, inference, similarity search, and guardrails
• Leverage Open Source and SaaS AI technologies like AWS Ultraclusters, Huggingface, VectorDBs, PyTorch
• Invent state-of-the-art LLM optimization techniques for performance, cost, and latency
• Contribute to the technical vision and long-term roadmap of foundational AI systems

Skills

Python

Go

Scala

Java

LLM optimization

Engineering

Education

Bachelor's or Master's in CS/AI/EE/CE

10+ years AI/ML development or 8+ years with Master's

Tools

AWS

Huggingface

VectorDBs

Nemo Guardrails

PyTorch

Job description

Capital One is seeking an experienced AI Engineer to design, implement, and optimize AI-powered products at scale. You will partner with engineers, researchers, PMs, and product managers to deploy foundation models, inference, and governance across Production environments.

The role emphasizes building robust AI systems, exploring open‑source and SaaS tools, and driving the long‑term roadmap for foundational AI at Capital One.