Senior AI Engineer: Foundation Models & Scalable Systems

Capital One; Cambridge (MA); On-site; USD 197,000 - 225,000; Full time

Job summary

Capital One is hiring for an AI Engineer to develop and deploy AI-powered products within the Intelligent Foundations and Experiences team. You will design, train, and deploy foundation models, optimize performance, and ensure observability and governance across large-scale AI systems.

The role demands strong software engineering and AI expertise, with collaboration across engineering, research, and product teams. On-site work in Cambridge, MA is expected with competitive salary and incentives.

Qualifications

• Bachelor's degree with 4+ years of AI/ML experience or Master's with 2+ years of AI/ML experience.
• 4+ years of programming experience in Python, Go, Scala, CUDA, or Java

Responsibilities

• Partner with cross-functional teams to deliver AI-powered products for associates and customers.
• Design, develop, test, deploy, and support AI software components including foundation model training and LLM inference.
• Work with Open Source and SaaS AI technologies such as AWS Ultraclusters, Huggingface, VectorDBs, PyTorch.
• Invent optimization techniques to improve latency, throughput, and cost for large-scale AI systems.
• Contribute to the technical vision and long-term roadmap of foundational AI systems at Capital One.
• Own end-to-end architecture for complex AI systems with maintainability, observability, and ethical alignment.
• Define and maintain SLAs for AI reliability (latency, uptime, model performance drift).
• Collaborate with infrastructure to optimize GPU/TPU usage and accelerate inference pipelines.
• Lead cross-functional technical reviews for new AI deployments ensuring security and data governance.
• Mentor senior associates on scalable design and production translation.

Skills

System design

AI systems

Performance tuning

Production translation

Education

Bachelor's degree in Computer Science, AI, Electrical Engineering, Computer Engineering, or related fields

Master's degree in Computer Science, AI, Electrical Engineering, Computer Engineering, or related fields

Tools

Python

Go

Scala

CUDA

Java

Job description

Capital One is hiring for an AI Engineer to develop and deploy AI-powered products within the Intelligent Foundations and Experiences team. You will design, train, and deploy foundation models, optimize performance, and ensure observability and governance across large-scale AI systems.

The role demands strong software engineering and AI expertise, with collaboration across engineering, research, and product teams. On-site work in Cambridge, MA is expected with competitive salary and incentives.