Site Reliability Engineer, AI Inference Platform

NU USA Northeastern University; Boston (MA); On-site; USD 88,000 - 124,000; Full time

Benefits offered by this job

Benefits package

Tuition assistance

Wellness program

Job summary

Northeastern University’s National Deep Inference Fabric (NDIF) seeks an experienced Site Reliability Engineer to keep its AI research platform reliable and scalable. The role involves hands-on production operations, observability, and tooling automation, with emphasis on CI/CD and infrastructure as code.

Strong Python skills and experience with distributed systems are essential, as is an interest in AI safety and interpretability. Collaboration across teams and the NDIF initiative is expected.

Qualifications

• Bachelor's degree in computer science, engineering, or related field or equivalent practical experience.
• At least 3 years in site reliability engineering or related role.
• Experience operating distributed systems in production with end-to-end ownership.
• Strong Python skills and backend service experience.
• Experience with observability tooling such as Prometheus and Grafana.
• CI/CD pipelines, automated testing, and infrastructure as code.
• Judgment to debug and optimize with minimal guidance and good communication.
• Genuine interest in AI safety and interpretability.

Responsibilities

• Measure and improve reliability, availability, and performance of the platform used by research teams.
• Build and maintain observability systems so issues are detected early.
• Improve tooling and automation including CI/CD, automated testing, and IaC.
• Create workflows for debugging across the distributed stack including Ray, GPU, and resource scheduling.
• Partner with NDIF team to keep the system dependable and usable as needs evolve.
• Establish and advocate for operational best practices as the platform grows.

Skills

Python

SRE

Distributed systems

Observability

CI/CD pipelines

Education

Bachelor's degree

Tools

Prometheus

Grafana

Infrastructure as code

Terraform

Job description

Northeastern University’s National Deep Inference Fabric (NDIF) seeks an experienced Site Reliability Engineer to keep its AI research platform reliable and scalable. The role involves hands-on production operations, observability, and tooling automation, with emphasis on CI/CD and infrastructure as code.

Strong Python skills and experience with distributed systems are essential, as is an interest in AI safety and interpretability. Collaboration across teams and the NDIF initiative is expected.