Inference Platform Engineer & Open Source Steward

Roboflow

United States

On-site

USD 155,000 - 180,000

Full time

14 days+

Get more replies from employers

Send a job-specific resume in minutes.

Benefits offered by this job

Travel stipend
Productivity stipend
AI Tools stipend
Health insurance
Team lunch stipend
Remote first/flexible
Unlimited PTO
Parental leave
Equity

Job summary

Roboflow is seeking a senior ML/inference engineer to steward the flagship CV inference engine and scale the agent-based release pipeline. You will work with a talented team to automate review, triage, and delivery, while expanding a world-grounded test suite and nightly end-to-end health checks across platforms.

You’ll also teach internal teams and customers to maximize the value of inference, collaborating with marketing to tell the story and owning the onboarding of new models into the engine.

Qualifications

  • 5+ years hands-on experience building and operating production-grade ML systems.
  • Strong foundation in CV/ML and deployment across environments.
  • Experience with AI agents to automate engineering processes.

Responsibilities

  • Build and maintain the CV inference engine and ensure high quality as volume grows.
  • Design an agentic-driven pipeline for review, triage, and CI/CD.
  • Grow a test suite for nightly end-to-end health checks across targets.
  • Define review standards and enforce via the system.
  • Streamline adding new models to inference for faster adoption.
  • Teach internal teams and customers to maximize product value.

Skills

Production-grade ML systems
Computer vision
Open source
CI/CD
AI agents
PyTorch
TensorFlow
OpenCV

Tools

PyTorch
TensorFlow
ONNX
Pillow

Job description

Roboflow is seeking a senior ML/inference engineer to steward the flagship CV inference engine and scale the agent-based release pipeline. You will work with a talented team to automate review, triage, and delivery, while expanding a world-grounded test suite and nightly end-to-end health checks across platforms.

You’ll also teach internal teams and customers to maximize the value of inference, collaborating with marketing to tell the story and owning the onboarding of new models into the engine.

Get your free, confidential resume review.
or drag and drop your file here.
Similar jobs

Similar jobs worth comparing

Inference Platform Engineer — Open Source & CI/CD Lead
Inference Platform Engineer — Open Source & CI/CD Lead

Roboflow, Inc. • New York (NY)

Hybrid
USD 155,000 - 180,000
$4000/yr Travel Stipend
$350/mo Productivity stipend
Unlimited PTO
Machine Learning Engineer - Inference Maintainer & Developer Experience
Machine Learning Engineer - Inference Maintainer & Developer Experience

Roboflow, Inc. • New York (NY)

Hybrid
USD 155,000 - 180,000
$4000/yr Travel Stipend
$350/mo Productivity stipend
Unlimited PTO
Machine Learning Engineer – Inference Maintainer, Developer Experience
Machine Learning Engineer – Inference Maintainer, Developer Experience

Jobtailor • California (MO)

On-site
USD 150,000 - 190,000
ML Inference Engineer — Open Source AI & CI/CD Lead
ML Inference Engineer — Open Source AI & CI/CD Lead

Jobtailor • California (MO)

On-site
USD 150,000 - 190,000
Enterprise Full-Stack Engineer – AI Vision Platform
Enterprise Full-Stack Engineer – AI Vision Platform

Roboflow • United States

Hybrid
USD 165,000 - 195,000
Travel stipend
Health insurance
Equity in the company
+2
Inference Platform Engineer for Open-Source Models
Inference Platform Engineer for Open-Source Models

Together AI • San Francisco (CA)

On-site
USD 200,000 - 290,000
Health insurance
Startup equity
Inference Platform Engineer for Open-Source ML
Inference Platform Engineer for Open-Source ML

Togetherai • San Francisco (CA)

On-site
USD 200,000 - 290,000
Startup equity
Health insurance
INFERENCE ENGINEER
INFERENCE ENGINEER

MakerMaker.AI • San Francisco (CA)

On-site
USD 120,000 - 160,000
Senior AI/ML Platform Engineering Manager (Inference)
Senior AI/ML Platform Engineering Manager (Inference)

CoreWeave • New York (NY)

On-site
USD 188,000 - 303,000
Medical, dental, and vision insurance
Company-paid Life Insurance
401(k) with generous match
+3
Senior/Principal ML Platform Inference Engineer
Senior/Principal ML Platform Inference Engineer

Roblox • San Mateo (CA)

On-site
USD 327,000 - 398,000
Equity compensation
Competitive benefits