Robotics Researcher, Evaluations

Efference

San Francisco (CA)

On-site

USD 120,000 - 190,000

Full time

14 days+

Get a reply from this employer

Your resume and cover letter, tailored to exactly what they’re hiring for.

Get past ATS filters

Job summary

Efference is seeking a role to explore how perception and compute infrastructure changes impact robot performance. You will design and run controlled experiments linking camera quality, timing, and network behavior to inference outcomes on physical robots.

Collaborate with ML engineers and hardware teams to isolate failure modes, maintain reproducible results, and translate findings into product requirements and regression tests.

Qualifications

  • Hands-on experience deploying and evaluating learned policies on physical robots.
  • Strong Python skills and familiarity with a modern ML framework, robot middleware, and the practical debugging of perception-to-action systems.
  • Understanding of experimental design, statistical uncertainty, dataset leakage, and the limits of aggregate benchmark scores.
  • Ability to isolate failures across sensor input, model behavior, control, and hardware instead of attributing every failure to the model.
  • A record of turning research questions into experiments that others can reproduce and use to make engineering decisions.

Responsibilities

  • Build a suite of manipulation and mobile-robot tasks with clear success criteria, repeatable starting conditions, and representative failure cases.
  • Integrate and evaluate learned policies, including vision-language-action and imitation-learning models, across local and remote inference configurations.
  • Run controlled studies of bitrate, image processing, observation age, synchronization error, latency, and jitter, separating their effects from changes in the policy.
  • Measure task success, intervention rate, completion time, and recovery behavior with enough repeated trials to distinguish improvements from noise.
  • Maintain versioned datasets, checkpoints, environments, and run metadata; use held-out tasks or scenes to test whether results generalize.
  • Investigate failures with imaging, wireless, controls, and ML engineers, then turn the findings into product requirements and reproducible regression cases.

Skills

Python
ML frameworks
Robot middleware
Experimental design
Statistical analysis

Tools

ROS

Job description

About the company

Efference provides high-performance perception and compute infrastructure for training and deploying robot models in the cloud. Our vision is to make robotic deployments scalable with shared compute.

We approach the problem by owning the entire path from the image sensor to the datacenter GPU. We shrink the load at the sensor, fix the uplink so robot traffic is fast and reliable, and clock synchronize the system so observations arrive time-aligned, ready for inference.

About the role

You'll determine how changes in Efference's perception and compute infrastructure affect what robots can actually do. You'll design experiments that connect camera quality, compression, timing, network behavior, and inference performance to reliable task completion on physical robots.

What you’ll do
  • Build a suite of manipulation and mobile-robot tasks with clear success criteria, repeatable starting conditions, and representative failure cases.
  • Integrate and evaluate learned policies, including vision-language-action and imitation-learning models, across local and remote inference configurations.
  • Run controlled studies of bitrate, image processing, observation age, synchronization error, latency, and jitter, separating their effects from changes in the policy.
  • Measure task success, intervention rate, completion time, and recovery behavior with enough repeated trials to distinguish improvements from noise.
  • Maintain versioned datasets, checkpoints, environments, and run metadata; use held-out tasks or scenes to test whether results generalize.
  • Investigate failures with imaging, wireless, controls, and ML engineers, then turn the findings into product requirements and reproducible regression cases.
What we are looking for
  • Hands‑on experience deploying and evaluating learned policies on physical robots.
  • Strong Python skills and familiarity with a modern ML framework, robot middleware, and the practical debugging of perception‑to‑action systems.
  • Understanding of experimental design, statistical uncertainty, dataset leakage, and the limits of aggregate benchmark scores.
  • Ability to isolate failures across sensor input, model behavior, control, and hardware instead of attributing every failure to the model.
  • A record of turning research questions into experiments that others can reproduce and use to make engineering decisions.
Nice to Have
  • Experience with VLA, diffusion, or flow‑based policies and robot learning datasets or evaluation frameworks.
  • Work on robustness, distribution shift, sim‑to‑real transfer, or policy performance under sensor and network impairments.
  • Experience building automated robot test stations, ground‑truth instrumentation, or large‑scale evaluation pipelines.
Get your free, confidential resume review.

or drag and drop your file here.

Similar jobs

Similar jobs worth comparing

Robotics Software Engineer, Infrastructure
Robotics Software Engineer, Infrastructure

Efference • San Francisco (CA)

On-site
USD 150,000 - 190,000
Robotics Software Engineer, Controls
Robotics Software Engineer, Controls

Efference • San Francisco (CA)

On-site
USD 140,000 - 210,000
Solutions Engineer, Robotics
Solutions Engineer, Robotics

Efference • San Francisco (CA)

On-site
USD 140,000 - 210,000
Robotics Researcher, Teleoperation
Robotics Researcher, Teleoperation

Efference • San Francisco (CA)

On-site
USD 120,000 - 170,000
OpenXR experience
Unity experience
Stereo rendering
+2
Robotics Research Engineer: Perception & Cloud Inference
Robotics Research Engineer: Perception & Cloud Inference

Efference • San Francisco (CA)

On-site
USD 120,000 - 190,000
Robot Test Engineer
Robot Test Engineer

Reactor • San Francisco (CA)

On-site
USD 120,000 - 180,000
Systems Test Engineer, End-to-End Validation
Systems Test Engineer, End-to-End Validation

Efference • San Francisco (CA)

On-site
USD 120,000 - 180,000
Chief of Staff
Chief of Staff

Efference • San Francisco (CA)

On-site
USD 120,000 - 180,000
Growth & Partnerships Lead
Growth & Partnerships Lead

Efference • San Francisco (CA)

On-site
USD 120,000 - 190,000
ML Research Engineer, Data
ML Research Engineer, Data

Dreamwork • San Francisco (CA)

On-site
USD 140,000 - 190,000