Senior Research Software Engineer - ML Systems & HPC

Harvard University

Massachusetts

Hybrid

USD 130,000 - 210,000

Full time

7 days ago
Be an early applicant

Get more replies from employers

Send a job-specific resume in minutes.

Benefits offered by this job

Generous paid time off
Health insurance
Tuition assistance and reimbursement
Retirement plans

Job summary

Harvard University invites applications for a Senior Research Software Engineer to support the HDSI–AWS Impact Computing Alliance. This hands‑on role builds ML/AI systems, optimizes training and inference, and delivers production‑grade research software across multiple projects.

You will collaborate with researchers and partners, work in Python and C/C++, and contribute to compiler/IR frameworks while operating in AWS and HPC environments.

Qualifications

  • BS or MS in CS/CE/Data Science or equivalent practical experience.
  • Strong programming in Python and C/C++ for ML systems.
  • Experience with ML frameworks (PyTorch, TensorFlow, JAX, XLA, Triton, ONNX).

Responsibilities

  • Design, build, and maintain ML/AI systems and research software.
  • Develop and optimize ML training and inference pipelines on accelerators.
  • Apply hardware-specific optimizations and kernel implementations.
  • Collaborate with researchers and AWS/HPC teams on scalable ML infra.
  • Follow reproducible software practices: tracking experiments, versioning, packaging.

Skills

Python
C/C++
PyTorch
TensorFlow
Distributed training
Git workflows
AWS

Education

BS/MS in Computer Science or related field

Tools

MLIR
LLVM
XLA
Triton
CUDA
OpenMP
OpenCL
Git
AWS

Job description

Harvard University invites applications for a Senior Research Software Engineer to support the HDSI–AWS Impact Computing Alliance. This hands‑on role builds ML/AI systems, optimizes training and inference, and delivers production‑grade research software across multiple projects.

You will collaborate with researchers and partners, work in Python and C/C++, and contribute to compiler/IR frameworks while operating in AWS and HPC environments.

Get your free, confidential resume review.
or drag and drop your file here.
Similar jobs

Similar jobs worth comparing

Senior AI/ML Systems Engineer – Research & HPC (Hybrid)
Senior AI/ML Systems Engineer – Research & HPC (Hybrid)

Harvard University • Cambridge (MA)

Hybrid
USD 140,000 - 190,000
Generous paid time off including parental leave
Medical, dental, and vision coverage from day one
Retirement plans with university contributions
+1
Senior Research Software Engineer
Senior Research Software Engineer

Harvard University • Massachusetts

Hybrid
USD 130,000 - 210,000
Generous paid time off
Health insurance
Tuition assistance and reimbursement
+1
Senior ML/HPC Networking & Systems Engineer
Senior ML/HPC Networking & Systems Engineer

Amazon • Cupertino (CA)

On-site
USD 150,000 - 210,000
Senior ML Systems Engineer: EC2 Nitro & HW/SW Co-Design
Senior ML Systems Engineer: EC2 Nitro & HW/SW Co-Design

Amazon Web Services (AWS) • Santa Clara (CA)

On-site
USD 180,000 - 300,000
Sign-on payments
Restricted stock units (RSUs)
Health insurance
+14
Senior HPC & AI Software Engineer
Senior HPC & AI Software Engineer

The Johns Hopkins University • Baltimore (MD)

On-site
USD 80,000 - 120,000
Research Software Engineer - AI/ML for HPC & LLMs
Research Software Engineer - AI/ML for HPC & LLMs

Virginia Polytechnic Institute and State University (VT) • Blacksburg (VA), Northern (KY)

Hybrid
USD 110,000 - 130,000
Hybrid AI/ML Engineer — Scale AI & HPC Systems
Hybrid AI/ML Engineer — Scale AI & HPC Systems

Hewlett Packard Enterprise Development LP • Fort Collins (CO)

Hybrid
USD 144,000 - 273,000
Health & wellbeing
Career development
Inclusive culture
Senior Research Software Engineer
Senior Research Software Engineer

Harvard University • Cambridge (MA)

Hybrid
USD 140,000 - 190,000
Generous paid time off including parental leave
Medical, dental, and vision coverage from day one
Retirement plans with university contributions
+1
Research Software Engineer: AI-Driven Distributed Systems
Research Software Engineer: AI-Driven Distributed Systems

Morgridge Institute for Research • Madison (WI)

On-site
USD 85,000 - 110,000
Applied Scientist II - ML Systems & Compiler Innovator
Applied Scientist II - ML Systems & Compiler Innovator

Amazon Web Services (AWS) • Cupertino (CA)

On-site
USD 172,000 - 222,000