Senior AI Platform Engineer — Foundation Models & LLMs

Capital One; Cambridge (MA); On-site; USD 197,000 - 225,000; Full time

Job summary

Capital One is seeking an AI Engineer 4 for Cambridge, MA, to help build responsible and scalable AI systems in production. You will partner with engineers, researchers, and product managers to deliver AI-powered products used by millions of customers.

The role emphasizes foundation model training, model inference, governance, and scalability with a strong ML engineering background. Proficiency in Python and cloud platforms is essential.

Qualifications

• Bachelor's degree in computer science, AI, electrical or related fields plus 4+ years of AI/ML experience or, a Master's with 2+ years of experience.
• At least 4 years of experience programming with Python, Go, Scala, CUDA, or Java

Responsibilities

• Partner with a cross-functional team to deliver AI-powered products for associates and customers.
• Design, develop, test, deploy, and support AI software components including training, inference, guardrails, governance, and observability.
• Leverage Open Source and SaaS AI technologies such as AWS, HuggingFace, VectorDBs, PyTorch, etc.
• Invent and optimize foundation model techniques to improve performance, latency, and cost at scale.
• Contribute to the long-term roadmap of foundational AI systems at Capital One.
• Own end-to-end architecture for complex AI systems with maintainability and ethics in mind.
• Define and maintain SLOs for AI reliability including latency and model drift.
• Collaborate with infrastructure to optimize GPU/TPU utilization.
• Lead cross-functional technical reviews for secure, compliant deployments.
• Mentor senior associates on scalable design and production translation.

Skills

Python

Go

Scala

CUDA

Java

AI/ML algorithms

Leadership experience

Education

Bachelor's degree in Computer Science or related

Master's degree in Computer Science or related

Tools

AWS

Google Cloud

Azure

HuggingFace

PyTorch

VectorDBs

Job description

Capital One is seeking an AI Engineer 4 for Cambridge, MA, to help build responsible and scalable AI systems in production. You will partner with engineers, researchers, and product managers to deliver AI-powered products used by millions of customers.

The role emphasizes foundation model training, model inference, governance, and scalability with a strong ML engineering background. Proficiency in Python and cloud platforms is essential.