Senior Gen AI Platform Engineer

Capital One; Cambridge (MA); On-site; USD 197,000 - 225,000; Full time

Job summary

Capital One's Intelligent Foundations and Experiences (IFX) team is seeking an AI Engineer 4 to join Cambridge, MA. You will design, develop, deploy, and support AI software components including foundation model training, large language model inference, agents, and vector databases, while leveraging Open Source and SaaS technologies.

You will lead architecture, governance, and observability for scalable AI systems, collaborating with engineers, researchers, PMs, and product leaders to deliver

Qualifications

• Bachelor's degree in Computer Science, AI, Electrical Engineering, Computer Engineering, or related fields with 4+ years of AI/ML experience, or Master's degree with 2+ years of AI/ML experience.
• 4+ years programming in Python, Go, Scala, CUDA, or Java.

Responsibilities

• Partner with cross-functional teams to deliver AI-powered products.
• Design, develop, test, deploy, and support AI software components (foundation models, LLM inference, agents, vector search).
• Leverage Open Source and SaaS AI tech (AWS Ultraclusters, Huggingface, PyTorch).
• Optimize foundation model performance (latency, cost, throughput) for large-scale production AI systems.
• Contribute to architectural vision and long-term roadmap of AI systems at Capital One.
• Own end-to-end architecture for complex AI systems with observability and ethical alignment.
• Define and maintain SLOs for AI reliability (latency, uptime, drift).
• Collaborate with infrastructure to optimize GPU/TPU utilization and inference pipelines.
• Lead cross-functional reviews for AI deployments with focus on security & governance.
• Mentor senior associates on scalable design and production translation.

Skills

Python

Go

Scala

CUDA

Java

Education

Bachelor's degree in CS/AI/EE/CE

Master's degree in CS/AI/EE/CE

Tools

AWS Ultraclusters

Huggingface

VectorDBs

PyTorch

Job description

Capital One's Intelligent Foundations and Experiences (IFX) team is seeking an AI Engineer 4 to join Cambridge, MA. You will design, develop, deploy, and support AI software components including foundation model training, large language model inference, agents, and vector databases, while leveraging Open Source and SaaS technologies.

You will lead architecture, governance, and observability for scalable AI systems, collaborating with engineers, researchers, PMs, and product leaders to deliver