Staff Software Engineer - ML Infrastructure

Watney Robotics Inc; San Francisco (CA); On-site; USD 140,000 - 210,000; Full time

Job summary

Watney Robotics is seeking an ML Infrastructure engineer to turn data from a live robot fleet into better models. You will own training and inference infrastructure, build data pipelines, and ensure rapid, reproducible experiments while contributing to core training code.

We value diverse backgrounds and encourage applicants who are passionate about robotics, even if not all requirements are met. This role is ideal for advancing scalable ML in real-world robotics contexts.

Qualifications

• Built ML infrastructure that supported production training runs.
• Experience scaling distributed training systems.
• Strong Python experience with ML frameworks (PyTorch or TensorFlow).
• Ability identify and troubleshoot GPU bottlenecks in large-scale training.

Responsibilities

• Own training and inference infrastructure.
• Build data pipelines that training runs depend on.
• Make experiments fast to launch and reproduce.
• Contribute to our core training code.

Skills

ML infrastructure

Python

PyTorch

TensorFlow

Distributed training

GPU performance

Job description

Our Mission

Expand human ambition in the physical world.

Critical infrastructure is constrained by labor shortages, hazardous working conditions, and operational complexity. Watney builds and deploys autonomous robotic systems that increase the speed and capacity of buildout, starting with data centers.

About The Role

At Watney, ML Infrastructure engineers turn data collected from a live fleet of robots into better models. The fleet produces large volumes of video and telemetry data from real work in the field, and making that data trainable is one of the hardest systems problems at the company. As we continue to scale, these systems will require larger training runs with more data, expanded clusters, and optimal GPU utilization.

What You'll Do

• Own training and inference infrastructure
• Build the data pipelines that these training runs depend on
• Make experiments fast to launch and reproduce
• Contribute to our core training code

You May Be a Good Fit If You:

• Have built ML infrastructure that carried real production training runs
• Have scaled distributed training systems
• Strong experience with Python, PyTorch or TensorFlow
• Have experience identifying and troubleshooting GPU performance bottlenecks in large-scale training environments

We're committed to building a diverse, inclusive team. At Watney Robotics, we welcome people of all backgrounds and identities, and we make hiring decisions based on skills, experience, and potential. If you're passionate about robotics but don't meet every requirement, we still encourage you to apply!

Curious to learn more?

Follow us here on X and LinkedIn