Senior AI Engineer, Foundation Models & LLMs

Capital One; Cambridge (MA); On-site; USD 197,000 - 225,000; Full time

Job summary

Capital One is seeking an AI Engineer 4 in Cambridge, MA to help build responsible, scalable AI systems and production-grade ML platforms. You will partner with engineers, researchers, PMs, and product managers to deliver AI-powered products that enhance customer experiences and internal workflows.

You will design and optimize foundation models, model inference, and multi-agent workflows, while ensuring governance, security, and observability across the stack.

Qualifications

• Bachelor's or Master's degree with relevant AI/ML experience
• 4+ years of AI/ML algorithm development experience
• Strong programming in Python/Java/CUDA or similar languages

Responsibilities

• Partner with cross-functional teams to deliver AI-powered products
• Design, develop, test, deploy, and support AI software components
• Leverage Open Source and SaaS AI tech such as AWS Ultraclusters, Huggingface, VectorDBs, PyTorch
• Invent foundation model optimization techniques for large-scale systems
• Contribute to long-term architectural vision for foundational AI systems
• Own end-to-end architecture for complex AI systems with observability and ethics
• Define and maintain SLOs for AI reliability including latency and model drift
• Collaborate with infrastructure to optimize GPU/TPU utilization and model inference pipelines
• Lead cross-functional reviews for new AI deployments ensuring governance and security
• Mentor senior staff on scalable design and production translation

Skills

Python

Go

Scala

CUDA

Java

Education

Bachelor's Degree in Computer Science, AI, Electrical Engineering, Computer Engineering, or related fields

Master's degree in Computer Science, AI, Electrical Engineering, Computer Engineering, or related fields

Tools

AWS Ultraclusters

Huggingface

VectorDBs

PyTorch

Job description

Capital One is seeking an AI Engineer 4 in Cambridge, MA to help build responsible, scalable AI systems and production-grade ML platforms. You will partner with engineers, researchers, PMs, and product managers to deliver AI-powered products that enhance customer experiences and internal workflows.

You will design and optimize foundation models, model inference, and multi-agent workflows, while ensuring governance, security, and observability across the stack.