Inference Platform Engineer & Open Source Steward

Roboflow

United States

On-site

USD 155,000 - 180,000

Full time

14 days+
Application generator

Don’t send a generic resume — generate a resume and cover letter tailored to this exact role.

Get past ATS filters

Benefits offered by this job

Travel stipend
Productivity stipend
AI Tools stipend
Health insurance
Team lunch stipend
Remote first/flexible
Unlimited PTO
Parental leave
Equity

Job summary

Roboflow is seeking a senior ML/inference engineer to steward the flagship CV inference engine and scale the agent-based release pipeline. You will work with a talented team to automate review, triage, and delivery, while expanding a world-grounded test suite and nightly end-to-end health checks across platforms.

You’ll also teach internal teams and customers to maximize the value of inference, collaborating with marketing to tell the story and owning the onboarding of new models into the engine.

Qualifications

  • 5+ years hands-on experience building and operating production-grade ML systems.
  • Strong foundation in CV/ML and deployment across environments.
  • Experience with AI agents to automate engineering processes.

Responsibilities

  • Build and maintain the CV inference engine and ensure high quality as volume grows.
  • Design an agentic-driven pipeline for review, triage, and CI/CD.
  • Grow a test suite for nightly end-to-end health checks across targets.
  • Define review standards and enforce via the system.
  • Streamline adding new models to inference for faster adoption.
  • Teach internal teams and customers to maximize product value.

Skills

Production-grade ML systems
Computer vision
Open source
CI/CD
AI agents
PyTorch
TensorFlow
OpenCV

Tools

PyTorch
TensorFlow
ONNX
Pillow

Job description

Roboflow is seeking a senior ML/inference engineer to steward the flagship CV inference engine and scale the agent-based release pipeline. You will work with a talented team to automate review, triage, and delivery, while expanding a world-grounded test suite and nightly end-to-end health checks across platforms.

You’ll also teach internal teams and customers to maximize the value of inference, collaborating with marketing to tell the story and owning the onboarding of new models into the engine.

Get your free, confidential resume review.

or drag and drop your file here.

Similar jobs

Similar jobs worth comparing

ML Engineer: Inference Engine & Dev Experience Lead
ML Engineer: Inference Engine & Dev Experience Lead

Bazeta • Northern (KY)

Hybrid
USD 130,000 - 180,000
Machine Learning Engineer - Inference Maintainer & Developer Experience
Machine Learning Engineer - Inference Maintainer & Developer Experience

Bazeta • Northern (KY)

Hybrid
USD 130,000 - 180,000
ML Platform Engineer: Inference & Production
ML Platform Engineer: Inference & Production

Xapply • San Francisco (CA)

On-site
USD 190,000 - 230,000
Senior Software Engineer - Data Platform & Pipelines
Senior Software Engineer - Data Platform & Pipelines

Emploive • San Francisco (CA), Northern (KY)

Hybrid
USD 250,000 - 450,000
Travel stipends
Health insurance coverage
Unlimited PTO
+1
Inference Platform Engineer for Open-Source Models
Inference Platform Engineer for Open-Source Models

Together AI • San Francisco (CA)

On-site
USD 200,000 - 290,000
Health insurance
Startup equity
Director of Engineering, AI Inference Platform
Director of Engineering, AI Inference Platform

Oho Group • San Francisco (CA)

On-site
USD 260,000 - 420,000
Engineering Manager: Inference Infrastructure Leader
Engineering Manager: Inference Infrastructure Leader

EngineersOfAI • New York (NY), Northern (KY)

Hybrid
USD 230,000 - 360,000
INFERENCE ENGINEER
INFERENCE ENGINEER

MakerMaker.AI • San Francisco (CA)

On-site
USD 120,000 - 160,000
Senior/Principal ML Platform Inference Engineer
Senior/Principal ML Platform Inference Engineer

Roblox • San Mateo (CA)

On-site
USD 327,000 - 397,460
Equity compensation
Competitive benefits
Senior Software Engineer, AI Data Platform for Labs
Senior Software Engineer, AI Data Platform for Labs

Roboflow • San Francisco (CA)

On-site
USD 250,000 - 450,000
Travel stipend
Health insurance
Unlimited PTO
+1