Staff ML Engineer — Vision & Multimodal Robotics

Nidus Technologies

New York (NY)

On-site

USD 140,000 - 240,000

Full time

14 days+

A complete application in a minute

Tailored resume and cover letter, ready to send.

Get past ATS filters

Job summary

Nidus Technologies is building autonomous manufacturing systems powered by AI and robotics. We are seeking a Staff Machine Learning Engineer to develop and scale vision-language-action models powering our robots.

You will own large parts of the model development lifecycle—from dataset construction and training recipes to distributed training infrastructure, evaluation, and on‑robot validation. This hands‑on role sits at the intersection of ML research, large‑scale systems, and robotics.

Qualifications

  • 5+ years of professional experience in machine learning, robotics, computer vision, or a closely related field.
  • Strong experience training modern deep learning models using PyTorch, JAX, or a comparable framework.
  • Experience with transformer‑based models, multimodal models, generative models, or learned control policies.
  • Experience building and operating distributed training pipelines on multi‑GPU or multi‑node accelerator clusters.
  • Experience with large‑scale datasets, high‑throughput data loading, experiment tracking, and reproducible ML workflows.

Responsibilities

  • Train and improve vision‑language‑action models for robotic manipulation and other embodied tasks.
  • Develop model architectures and training recipes spanning imitation learning, behavior cloning, transformer‑and diffusion‑based policies, multimodal pretraining, and post‑training.
  • Build scalable pipelines for pretraining, fine‑tuning, evaluation, checkpointing, and model release.
  • Train models across multi‑node GPU clusters while improving utilization, throughput, stability, and cost efficiency.
  • Design data mixtures, sampling strategies, augmentations, and curriculum approaches for large, heterogeneous robot datasets.
  • Develop data loaders and preprocessing systems for synchronized video, language, robot state, actions, and other sensor modalities.
  • Create reproducible experimentation systems, including configuration management, dataset and model versioning, experiment tracking, and automated regression testing.
  • Define offline and on‑robot metrics that measure task success, generalization, robustness, latency, safety, and failure modes.
  • Build tools for inspecting trajectories, visualizing model behavior, comparing experiments, and diagnosing data or training failures.
  • Run structured experiments on physical robots and use the results to guide model, data, and infrastructure improvements.
  • Partner with data collection teams to identify coverage gaps, improve demonstration quality, and prioritize collection based on model performance.
  • Translate promising research into maintainable, production‑quality systems that can support repeated deployment across robots and environments.
  • Make technical decisions across model architecture, data, compute, and evaluation, and communicate the associated tradeoffs clearly.
  • Mentor other engineers and establish strong engineering practices for the ML codebase.

Skills

Deep Learning
PyTorch
JAX
Transformer models
Multimodal models
Distributed training
Vision-language-action

Education

Bachelor's degree

Tools

ROS/ROS 2
MuJoCo
Isaac Sim
Gazebo

Job description

Nidus Technologies is building autonomous manufacturing systems powered by AI and robotics. We are seeking a Staff Machine Learning Engineer to develop and scale vision-language-action models powering our robots.

You will own large parts of the model development lifecycle—from dataset construction and training recipes to distributed training infrastructure, evaluation, and on‑robot validation. This hands‑on role sits at the intersection of ML research, large‑scale systems, and robotics.

Get your free, confidential resume review.

or drag and drop your file here.

Similar jobs

Similar jobs worth comparing

Staff ML Engineer, VLA Training
Staff ML Engineer, VLA Training

Nidus Technologies • New York (NY)

On-site
USD 140,000 - 240,000
Staff Robotics Engineer — AI-Driven Manufacturing
Staff Robotics Engineer — AI-Driven Manufacturing

Nidus Technologies • New York (NY)

On-site
USD 150,000 - 200,000
Equity participation
Health coverage (medical, dental, and视
Team lunches
Staff ML Engineer: Multimodal & Robotics Models
Staff ML Engineer: Multimodal & Robotics Models

Micro1 • United States

Remote
USD 150,000 - 210,000
Staff Multimodal ML Engineer for Autonomous Robots
Staff Multimodal ML Engineer for Autonomous Robots

Watney • San Francisco (CA)

On-site
USD 140,000 - 200,000
Senior ML Engineer, Physical AI & Robotics Research
Senior ML Engineer, Physical AI & Robotics Research

Nebius Group • United States

Remote
USD 180,000 - 240,000
Senior ML/CV Engineer – Autonomy Perception & Vision
Senior ML/CV Engineer – Autonomy Perception & Vision

Nuro, Inc. • Mountain View (CA)

On-site
USD 184,000 - 276,000
Lead ML Engineer, Robotics Autonomy & Scalable Training
Lead ML Engineer, Robotics Autonomy & Scalable Training

Serve Robotics Inc • United States

Remote
USD 180,000 - 250,000
Senior Staff ML Engineer - Robotics & Vision AI
Senior Staff ML Engineer - Robotics & Vision AI

Boston Dynamics • Waltham (MA)

On-site
USD 175,000 - 215,000
Medical insurance
Dental insurance
Vision insurance
+3
Staff ML Engineer, Behavior & Planning for Autonomy
Staff ML Engineer, Behavior & Planning for Autonomy

Nuro, Inc. • Mountain View (CA)

On-site
USD 180,000 - 260,000
Robotics Engineer
Robotics Engineer

Nidus Technologies • New York (NY)

On-site
USD 150,000 - 200,000
Equity participation
Health coverage (medical, dental, and视
Team lunches