SRE for AI Research Infrastructure

Northeastern University

Boston (MA)

On-site

USD 88,000 - 124,000

Full time

9 days ago

Get a reply from this employer

Your resume and cover letter, tailored to exactly what they’re hiring for.

Get past ATS filters

Job summary

Northeastern University’s Khoury College and the National Deep Inference Fabric (NDIF) invite an experienced Site Reliability Engineer to strengthen production systems and scale a research platform. You will own reliability, build observability, and drive automation across distributed services, with emphasis on AI safety and interpretability.

The role emphasizes hands-on engineering, collaboration with the NDIF team, and advancing CI/CD, IaC, and debugging workflows in a fast-moving AI research

Qualifications

  • Bachelor's degree in computer science, engineering, or a related field, or equivalent practical experience.
  • At least 3 years of experience in site reliability engineering or a closely related role.
  • Strong Python skills and backend services experience.
  • Experience with observability tooling such as Prometheus and Grafana, or equivalent tools.

Responsibilities

  • Measure and improve the reliability, availability, and performance of the platform used by research teams.
  • Build and maintain observability systems to detect issues early and enable proactive debugging.
  • Improve CI/CD, automated testing, and infrastructure as code tooling.
  • Create workflows for debugging across the distributed stack, including Ray connectivity, GPU scheduling, and resource allocation.
  • Partner with the NDIF team to keep the system dependable and usable as needs grow.
  • Establish and advocate for operational best practices as the platform scales.

Skills

Python
Distributed systems
CI/CD
Observability
Infrastructure as Code
Production systems
Communication

Education

Bachelor's degree
Equivalent practical experience

Tools

Prometheus
Grafana
Ray

Job description

Northeastern University’s Khoury College and the National Deep Inference Fabric (NDIF) invite an experienced Site Reliability Engineer to strengthen production systems and scale a research platform. You will own reliability, build observability, and drive automation across distributed services, with emphasis on AI safety and interpretability.

The role emphasizes hands-on engineering, collaboration with the NDIF team, and advancing CI/CD, IaC, and debugging workflows in a fast-moving AI research

Get your free, confidential resume review.

or drag and drop your file here.

Similar jobs

Similar jobs worth comparing

Site Reliability Engineer, AI Inference Platform
Site Reliability Engineer, AI Inference Platform

NU USA Northeastern University • Boston (MA)

On-site
USD 88,000 - 124,000
Benefits package
Tuition assistance
Wellness program
Site Reliability Engineer - AI Research Infrastructure
Site Reliability Engineer - AI Research Infrastructure

Northeastern University • Boston (MA)

On-site
USD 88,000 - 124,000
Site Reliability Engineer (Khoury College)
Site Reliability Engineer (Khoury College)

Northeastern University • Boston (MA)

On-site
USD 88,000 - 124,000
Site Reliability Engineer
Site Reliability Engineer

Northeastern University • Boston (MA)

On-site
USD 88,000 - 124,000
SRE: AI Inference Platform & ML Systems
SRE: AI Inference Platform & ML Systems

Cohere • San Francisco (CA)

Hybrid
USD 120,000 - 150,000
Open and inclusive culture
Weekly lunch stipend
Full health and dental benefits
+4
SRE Director: Build Global Reliability & Infra
SRE Director: Build Global Reliability & Infra

d-Matrix • Santa Clara (CA)

On-site
USD 180,000 - 240,000
Senior SRE - AI-Native Infra & Observability
Senior SRE - AI-Native Infra & Observability

Formation Bio • San Francisco (CA)

Hybrid
USD 186,000 - 232,000
SRE for AI Platform & ML Inference Infra
SRE for AI Platform & ML Inference Infra

Cohere • New York (NY)

Hybrid
USD 140,000 - 200,000
Weekly lunch stipend
Health and dental benefits
RRSP matching
+3
Site Reliability Engineer: AI-Driven Reliability & Observability
Site Reliability Engineer: AI-Driven Reliability & Observability

present of AI • Atlanta (GA)

On-site
USD 110,000 - 180,000
Senior SRE — Automate, Observe, and Scale AI Platforms
Senior SRE — Automate, Observe, and Scale AI Platforms

RELX International • Philadelphia

On-site
USD 95,000 - 159,000