Senior AI Foundations & LLM Systems Engineer

Capital One Group

Cambridge (MA)

On-site

USD 197,000 - 225,000

Full time

14 days+

Get a reply from this employer

Your resume and cover letter, tailored to exactly what they’re hiring for.

Get past ATS filters

Benefits offered by this job

Performance-based incentives
Health benefits
Paid time off

Job summary

Capital One is hiring an AI Engineer 4 to build responsible AI foundations, LLM core, and agentic AI across production systems in Cambridge, MA. You will design, implement, and optimize AI software components, ensure governance and observability, and collaborate with cross-functional teams to deliver scalable AI-powered banking solutions.

You will mentor senior engineers, contribute to long-term AI roadmaps, and push performance, cost, and latency improvements while maintaining security and

Qualifications

  • Bachelor's degree in Computer Science, AI, Electrical Engineering, Computer Engineering, or related fields plus at least 4 years of experience developing AI and ML algorithms or technologies
  • At least 4 years of experience programming with Python, Go, Scala, CUDA, or Java
  • Experience leading development AI systems with tradeoff decisions around cost, latency, throughput and accuracy
  • 6 years of experience deploying scalable and responsible AI solutions on cloud platforms (e.g. AWS, Google Cloud, Azure, or equivalent private cloud)
  • Experience designing, developing, delivering, and supporting AI services
  • Experience developing AI and ML algorithms or technologies (e.g. LLM Inference, Similarity Search and VectorDBs, Guardrails, Memory) using Python, C++, C#, Java, CUDA, or Golang
  • Experience developing and applying state-of-the-art techniques for optimizing training and inference software to improve hardware utilization, latency, throughput, and cost
  • Experience in building agentic AI systems and agentic workflows
  • Proficiency in designing distributed systems for model training, evaluation, and online inference at petabyte scale
  • Experience defining AI model governance processes, including producibility, lineage tracking, and automated retaining schedules
  • Demonstrated ability to influence architectural decisions across multiple AI product lines or platforms

Responsibilities

  • Partner with cross-functional team to deliver AI-powered products
  • Design, develop, test, deploy, and support AI software components
  • Leverage a broad stack of Open Source and SaaS AI technologies
  • Invent and introduce state-of-the-art foundation model optimization techniques
  • Contribute to the technical vision and long-term roadmap
  • Own end-to-end architecture for complex AI systems
  • Define and maintain SLOs for AI reliability
  • Collaborate with infrastructure to optimize GPU/TPU utilization
  • Lead cross-functional technical reviews for new AI deployments
  • Mentor Principal and Senior Associates on scalable design and production translation

Skills

Python
Go
Scala
CUDA
Java
LLM Inference
Similarity Search
VectorDBs
Guardrails
Memory
Agentic AI
Distributed systems

Education

Bachelor's degree in Computer Science, AI, Electrical Engineering, Computer Engineering, or related fields
Master's degree in Computer Science, AI, Electrical Engineering, Computer Engineering, or related fields

Tools

AWS
Google Cloud
Azure
HuggingFace
PyTorch
VectorDBs

Job description

Capital One is hiring an AI Engineer 4 to build responsible AI foundations, LLM core, and agentic AI across production systems in Cambridge, MA. You will design, implement, and optimize AI software components, ensure governance and observability, and collaborate with cross-functional teams to deliver scalable AI-powered banking solutions.

You will mentor senior engineers, contribute to long-term AI roadmaps, and push performance, cost, and latency improvements while maintaining security and

Get your free, confidential resume review.

or drag and drop your file here.

Similar jobs

Similar jobs worth comparing

Senior AI Foundations & LLM Systems Engineer
Senior AI Foundations & LLM Systems Engineer

Capital One • Cambridge (MA)

On-site
USD 230,000 - 262,000
Senior AI Foundations Engineer – LLM & AI Infra
Senior AI Foundations Engineer – LLM & AI Infra

Capital One Group • Cambridge (MA)

On-site
USD 197,000 - 225,000
Senior AI Foundations & LLM Systems Engineer
Senior AI Foundations & LLM Systems Engineer

MFS Investments • Cambridge (MA)

Hybrid
USD 197,000 - 225,000
Senior AI Foundations & LLM Engineer
Senior AI Foundations & LLM Engineer

Capital One • McLean (VA)

On-site
USD 230,000 - 262,000
Senior AI Foundations Engineer – LLMs & RL Optimizations
Senior AI Foundations Engineer – LLMs & RL Optimizations

Capital One Group • Cambridge (MA)

On-site
USD 230,000 - 262,000
Senior AI Foundations Engineer: LLMs, RL & Production
Senior AI Foundations Engineer: LLMs, RL & Production

Capital One Group • San Jose (CA)

Hybrid
USD 215,000 - 246,000
Health benefits
Hybrid work policy
Competitive compensation
Senior AI Engineer, Foundation Models & LLMs
Senior AI Engineer, Foundation Models & LLMs

Capital One Group • Cambridge (MA)

On-site
USD 197,000 - 225,000
Senior AI Engineer: Foundations, LLMs & Agentic AI
Senior AI Engineer: Foundations, LLMs & Agentic AI

Capital One Group • San Jose (CA)

On-site
USD 215,000 - 245,000
Health benefits
Comprehensive benefits package
Senior AI Foundations Engineer
Senior AI Foundations Engineer

Capital One Group • Cambridge (MA)

On-site
USD 230,000 - 262,000
Senior AI Engineer: LLM Inference & Foundational Systems
Senior AI Engineer: LLM Inference & Foundational Systems

Capital One Group • McLean (VA)

On-site
USD 230,000 - 262,000