Senior Software Engineer, Production Pipelines

Mindspan Institute

Cambridge (MA)

On-site

USD 170,000 - 210,000

Full time

11 days ago

A complete application in a minute

Tailored resume and cover letter, ready to send.

Get past ATS filters

Benefits offered by this job

Health Insurance
Dental Insurance
Vision Insurance
Family Benefits
Matching Retirement Contribution

Job summary

Mindspan Institute in Cambridge, MA is seeking engineers to productionize research models as versioned, tested inference services and batch jobs, and to build reliable distributed inference pipelines for very large image volumes.

The role will own automated training, evaluation, monitoring, and release processes, and document systems to keep them usable by scientists, ensuring robust performance and reproducibility across experiments.

Qualifications

  • Requires at least five years building and operating production software.
  • Experience running machine learning models in production.
  • Hands-on experience with distributed systems and Python.
  • Experience with containers, workflow orchestration, and infrastructure as code.

Responsibilities

  • Productionize research models as versioned, tested inference services and batch jobs.
  • Own automated training, evaluation, monitoring, and release processes.
  • Document systems to keep them usable by scientists.

Skills

Python
Production Software Engineering
Machine Learning Operations
Distributed Inference
Batch Processing
GPU Inference Optimization

Tools

Kubernetes
SLURM
Ray
Dask
Spark
Containerization
Workflow Orchestration
Infrastructure as Code
CI/CD
Model Evaluation and Release

Job description

Productionize research models as versioned, tested inference services and batch jobs, and build reliable distributed inference pipelines for very large image volumes. Own the automated training, evaluation, monitoring, and release processes, while documenting systems and making them usable by scientists.

Requirements

Requires at least five years building and operating production software, including experience running machine learning models in production, strong Python and software engineering practices, and hands-on experience with distributed systems. Candidates should also have experience with containers, workflow orchestration, infrastructure as code, and deploying and optimizing GPU inference; scientific research experience is not required.

Key Skills
  • Python
  • Production Software Engineering
  • Machine Learning Operations
  • Distributed Inference
  • Batch Processing
  • GPU Inference Optimization
  • Kubernetes
  • SLURM
  • Ray
  • Dask
  • Spark
  • Containerization
  • Workflow Orchestration
  • Infrastructure as Code
  • CI/CD
  • Model Evaluation and Release
Benefits
  • Health Insurance
  • Dental Insurance
  • Vision Insurance
  • Family Benefits
  • Matching Retirement Contribution
Get your free, confidential resume review.

or drag and drop your file here.

Similar jobs

Similar jobs worth comparing

Senior ML Production Pipelines Engineer — GPU Inference
Senior ML Production Pipelines Engineer — GPU Inference

Mindspan Institute • Cambridge (MA)

On-site
USD 170,000 - 210,000
Health Insurance
Dental Insurance
Vision Insurance
+2
Lead Software Engineer
Lead Software Engineer

Hyra • New York (NY)

On-site
USD 140,000 - 200,000
Competitive base salary
Total rewards package
Discretionary incentive compensation
+5
Software Engineer, Production Inference (Distributed Inference)
Software Engineer, Production Inference (Distributed Inference)

Thinking Machines Lab Inc. • San Francisco (CA)

On-site
USD 350,000 - 500,000
Health benefits
Dental benefits
Vision benefits
+3
Software Engineer - ML Infrastructure
Software Engineer - ML Infrastructure

Epsilon • San Francisco (CA)

On-site
USD 180,000 - 240,000
Member of Technical Staff (AI Infrastructure Engineer)
Member of Technical Staff (AI Infrastructure Engineer)

Perplexity • Palo Alto (CA)

On-site
USD 220,000 - 405,000
Staff Engineer
Staff Engineer

Salient Group • San Francisco (CA)

On-site
USD 180,000 - 260,000
INFERENCE ENGINEER
INFERENCE ENGINEER

MakerMaker.AI • San Francisco (CA)

On-site
USD 120,000 - 160,000
Software Engineer, Inference
Software Engineer, Inference

ARCHER • San Francisco (CA)

On-site
USD 150,000 - 190,000
Flexible Paid Time Off
Medical Insurance
Dental Insurance
+11
Senior ML Infra Engineer - Large-Scale Training & Pipelines
Senior ML Infra Engineer - Large-Scale Training & Pipelines

Kindredventures • San Francisco (CA)

On-site
USD 160,000 - 220,000
Member of Technical Staff (AI Infrastructure Engineer)
Member of Technical Staff (AI Infrastructure Engineer)

Perplexity • San Francisco (CA)

On-site
USD 243,000 - 405,000