Senior ML Platform Engineer for Scalable AI Systems

Rebar; New York (NY); On-site; USD 180,000 - 240,000; Full time

Benefits offered by this job

Salary: Competitive

Equity: Meaningful equity package

Benefits: Comprehensive medical,Dental

Perks: Free lunches and dinners

Job summary

Rebar is building the next-generation operating system for HVAC/electrical/plumbing suppliers and subcontractors. We are hiring a Senior ML Infrastructure Engineer to build the platform that ML engineers depend on for rapid iteration, training, evaluation, deployment, and monitoring.

You will design APIs, integrate cloud/SaaS services, and enhance developer experience for production ML systems. This onsite role in New York City demands strong platform-engineering instincts and a track record of

Qualifications

• Bachelor's degree or higher in Computer Science, Electrical Engineering, or related field or equivalent experience.
• 3+ years building production backend systems with internal developer platforms or ML infrastructure.
• Expert-level Python; ability to learn new languages as needed.
• 2+ years cloud infrastructure experience (AWS preferred), including IAM, networking, and cost management.
• Proficiency with IaC tools (Terraform, AWS CDK, or Pulumi) for reproducible cloud environments.
• Hands-on experience with managed ML inference and serving platforms (SageMaker, Vertex AI).
• Track record deploying ML in production across detection, segmentation, recognition, and LLM/VLM workloads.
• Experience managing a model registry / model zoo with governance from experiment to production.
• Proven ability to design clean, composable APIs and SDKs used by internal teams.
• Deep understanding of ML workflows and requirements.

Responsibilities

• Platform & Developer Experience: design the CLI, SDK, and services that front our ML platform for a cohesive user experience.
• Infrastructure Integration: connect cloud and SaaS stacks into a unified, version-controlled system.
• Observability & Operations: build dashboards, cost attribution, and monitoring for production ML workloads.
• Collaboration & Roadmap: work with ML engineers to turn scripts into self-serve platform features and guide architecture decisions.

Skills

Python

Backend systems

APIs/SDKs

ML workflows

Platform engineering

Education

Bachelor's degree or higher in CS, Electrical Engineering, or related field

Tools

Terraform

AWS CDK

Pulumi

SageMaker

Vertex AI

Job description

Rebar is building the next-generation operating system for HVAC/electrical/plumbing suppliers and subcontractors. We are hiring a Senior ML Infrastructure Engineer to build the platform that ML engineers depend on for rapid iteration, training, evaluation, deployment, and monitoring.

You will design APIs, integrate cloud/SaaS services, and enhance developer experience for production ML systems. This onsite role in New York City demands strong platform-engineering instincts and a track record of