Senior AI Engineer: LLM Inference & Foundation Models

Capital One Group

Cambridge (MA)

On-site

USD 230,000 - 262,000

Full time

14 days+

A complete application in a minute

Tailored resume and cover letter, ready to send.

Get past ATS filters

Job summary

Capital One is seeking an AI Engineer 5 in Cambridge, MA to design, deploy, and support AI software, including foundation model training and LLM inference. You will work with cross‑functional teams to build scalable AI systems and leverage tools like PyTorch and vector databases.

In this role you will influence the technical vision, implement cost‑effective AI pipelines, and guide governance across AI initiatives while mentoring senior engineers and aligning with Capital One standards.

Qualifications

  • Degree(s) in Computer Science, AI or related field with years of AI/ML experience.
  • 6+ years programming in Python/Go/Scala/CUDA/Java with production impact.
  • Experience leading development of AI systems and cloud deployments.

Responsibilities

  • Partner with cross‑functional team to deliver AI-powered products.
  • Design, develop, test, deploy and support AI software components.
  • Leverage Open Source and SaaS AI technologies for model inference and tooling.
  • Invent optimization techniques to improve performance, cost and latency.
  • Contribute to long‑term AI system roadmap and governance.
  • Design and optimize multi‑model orchestration pipelines.

Skills

Python
Go
Scala
CUDA
Java

Education

Bachelor's degree in CS/EE/CE or related
Master's degree in CS/AI/EE/CE or related

Tools

AWS Ultraclusters
Huggingface
VectorDBs
PyTorch

Job description

Capital One is seeking an AI Engineer 5 in Cambridge, MA to design, deploy, and support AI software, including foundation model training and LLM inference. You will work with cross‑functional teams to build scalable AI systems and leverage tools like PyTorch and vector databases.

In this role you will influence the technical vision, implement cost‑effective AI pipelines, and guide governance across AI initiatives while mentoring senior engineers and aligning with Capital One standards.

Get your free, confidential resume review.

or drag and drop your file here.

Similar jobs

Similar jobs worth comparing

Senior AI Engineer: LLM Inference & Foundation Models
Senior AI Engineer: LLM Inference & Foundation Models

Capital One • California

Hybrid
USD 230,000 - 262,000
Senior AI Engineer: LLM Inference & Foundational Systems
Senior AI Engineer: LLM Inference & Foundational Systems

Capital One Group • McLean (VA)

On-site
USD 230,000 - 262,000
Senior AI Engineer, Foundation Models & LLMs
Senior AI Engineer, Foundation Models & LLMs

Capital One Group • Cambridge (MA)

On-site
USD 197,000 - 225,000
Senior AI Foundations & LLM Systems Engineer
Senior AI Foundations & LLM Systems Engineer

Capital One • Cambridge (MA)

On-site
USD 230,000 - 262,000
Senior AI Foundations Engineer – LLMs & RL Optimizations
Senior AI Foundations Engineer – LLMs & RL Optimizations

Capital One Group • Cambridge (MA)

On-site
USD 230,000 - 262,000
Senior AI Foundations Engineer – LLM & AI Infra
Senior AI Foundations Engineer – LLM & AI Infra

Capital One Group • Cambridge (MA)

On-site
USD 197,000 - 225,000
Senior AI Platform Engineer — Foundation Models & LLMs
Senior AI Platform Engineer — Foundation Models & LLMs

Capital One Group • Cambridge (MA)

On-site
USD 197,000 - 225,000
Senior AI Engineer, Foundation Models & LLMs
Senior AI Engineer, Foundation Models & LLMs

Capital One • California

Hybrid
USD 251,000 - 286,000
Senior AI Engineer: Foundation Models & LLMs
Senior AI Engineer: Foundation Models & LLMs

Capital One Group • Cambridge (MA)

On-site
USD 230,000 - 262,000
Senior AI Foundations & LLM Systems Engineer
Senior AI Foundations & LLM Systems Engineer

Capital One Group • Cambridge (MA)

On-site
USD 197,000 - 225,000
Performance-based incentives
Health benefits
Paid time off