Senior AI Engineer: LLM Systems & Production

Capital One Group

Cambridge (MA)

On-site

USD 197,000 - 225,000

Full time

14 days+

Get a reply from this employer

Your resume and cover letter, tailored to exactly what they’re hiring for.

Get past ATS filters

Job summary

Capital One is seeking an AI Engineer 4 to join the IFX team in Cambridge, MA. You will design and deploy AI-powered components, training models, and multi-agent workflows within a responsible, scalable AI infrastructure.

You will collaborate with engineers, researchers, and product managers to deliver production-ready AI systems, optimize performance and costs, and ensure security, data governance, and observability across platforms.

Qualifications

  • Bachelor's Degree in Computer Science, AI, Electrical Engineering, Computer Engineering, or related fields plus at least 4 years of experience developing AI and ML algorithms or technologies.
  • At least 4 years of experience programming with Python, Go, Scala, CUDA, or Java.
  • Experience leading development AI systems with tradeoffs around cost, latency, throughput and accuracy.
  • 6+ years of experience deploying scalable and responsible AI solutions on cloud platforms (AWS, Google Cloud, Azure, or equivalent).

Responsibilities

  • Partner with cross-functional teams to deliver AI-powered products that change how associates work and how customers interact with Capital One.
  • Design, develop, test, deploy, and support AI software components including foundation model training, LLM inference, agents and multi-agent workflows, similarity search, guardrails, model evaluation, experimentation, governance, and observability.
  • Leverage Open Source and SaaS AI technologies such as AWS Ultraclusters, Huggingface, VectorDBs, PyTorch.
  • Invent state-of-the-art foundation model optimization techniques to improve performance, latency, throughput, and cost.
  • Contribute to the long-term roadmap of foundational AI systems at Capital One.
  • Own end-to-end architecture for complex AI systems with maintainability and observability.
  • Define and maintain SLAs for AI reliability including latency, uptime, and drift.
  • Collaborate with infrastructure to optimize GPU/TPU utilization and accelerate inference pipelines.
  • Lead cross-functional technical reviews for new deployments ensuring security and governance.
  • Mentor Principal and Senior Associates on scalable design and production translation.

Skills

AI systems design
Python
Distributed systems
Research literacy
Mentoring

Education

Bachelor's degree in CS/AI/EE/CE
Master's degree in CS/AI/EE/CE

Tools

AWS
Huggingface
PyTorch
VectorDBs
GPU/TPU optimization

Job description

Capital One is seeking an AI Engineer 4 to join the IFX team in Cambridge, MA. You will design and deploy AI-powered components, training models, and multi-agent workflows within a responsible, scalable AI infrastructure.

You will collaborate with engineers, researchers, and product managers to deliver production-ready AI systems, optimize performance and costs, and ensure security, data governance, and observability across platforms.

Get your free, confidential resume review.

or drag and drop your file here.

Similar jobs

Similar jobs worth comparing

Senior AI Engineer: LLM Tuning & RL Systems
Senior AI Engineer: LLM Tuning & RL Systems

Capital One Group • Cambridge (MA)

On-site
USD 197,000 - 225,000
Senior AI Foundations Engineer – LLM & AI Infra
Senior AI Foundations Engineer – LLM & AI Infra

Capital One Group • Cambridge (MA)

On-site
USD 197,000 - 225,000
Senior AI Foundations & LLM Systems Engineer
Senior AI Foundations & LLM Systems Engineer

Capital One • Cambridge (MA)

On-site
USD 230,000 - 262,000
Senior AI Engineer: Foundation Models & LLMs
Senior AI Engineer: Foundation Models & LLMs

Capital One Group • Cambridge (MA)

On-site
USD 230,000 - 262,000
Senior AI Foundations & LLM Systems Engineer
Senior AI Foundations & LLM Systems Engineer

Capital One Group • Cambridge (MA)

On-site
USD 197,000 - 225,000
Performance-based incentives
Health benefits
Paid time off
Senior AI Systems Engineer (LLM & Production)
Senior AI Systems Engineer (LLM & Production)

Capital One Group • San Jose (CA)

On-site
USD 215,000 - 246,000
Senior AI Foundations Engineer: LLMs, RL & Production
Senior AI Foundations Engineer: LLMs, RL & Production

Capital One Group • San Jose (CA)

Hybrid
USD 215,000 - 246,000
Health benefits
Hybrid work policy
Competitive compensation
Remote Staff AI Engineer — LLM & AI Systems
Remote Staff AI Engineer — LLM & AI Systems

Capital One • San Francisco (CA)

Remote
USD 294,000 - 335,000
Senior AI Engineer, Foundation Models & LLMs
Senior AI Engineer, Foundation Models & LLMs

Capital One Group • Cambridge (MA)

On-site
USD 197,000 - 225,000
Senior AI Engineer: LLM Inference & Foundation Models
Senior AI Engineer: LLM Inference & Foundation Models

Capital One Group • Cambridge (MA)

On-site
USD 230,000 - 262,000