Software Engineer, Data Infrastructure

Insight Recruitment; Redwood City (CA); On-site; USD 150,000 - 230,000; Full time

Job summary

Insight Recruitment is seeking a Software Engineer, Data Infrastructure for a well-funded robotics and AI company in Redwood City, onsite. You will design and build data platforms to support large-scale ML and robotics research, handling multimodal data pipelines and production-ready models.

Collaborate with ML researchers and robotics engineers; responsibilities include data storage, processing, labeling, evaluation, and tooling.

Qualifications

• Bachelor's or Master's degree in Computer Science, Software Engineering, Data Engineering, or related discipline.
• 5+ years of professional software engineering experience.
• Experience with NumPy, backend services, and distributed systems.
• Strong understanding of cloud infrastructure and data-intensive applications.
• Experience with Redis and MongoDB; AWS and/or GCP experience.

Responsibilities

• Design and develop scalable data infrastructure and platforms for multimodal robotics and AI datasets.
• Build pipelines for video, sensor data, trajectories, time-series, and 3D data.
• Develop dashboards, analytics tools, and debugging platforms for researchers.
• Collaborate with ML engineers, researchers, and product teams to shape the data platform roadmap.

Skills

Backend development

Distributed systems

Cloud infrastructure

Data-intensive applications

Problem solving

Education

Bachelor's or Master’s in CS/SE/Data Eng

5+ years software engineering

Tools

NumPy

Redis

MongoDB

AWS

GCP

Docker

Airflow

Weights & Biases

MLflow

React

TypeScript

Job description

Role: Software Engineer, Data Infrastructure

Location: Redwood City, CA (Onsite)

Employment Type: Full-Time

About the Opportunity

A well-funded robotics and AI company is seeking a Software Engineer, Data Infrastructure to build the systems that power large-scale machine learning and robotics development.

This role sits at the intersection of data infrastructure, machine learning operations, robotics, and developer tooling. You will build the platforms, pipelines, and visualization systems that transform massive volumes of multimodal robotic data into actionable insights and production-ready AI models.

This is a high-impact position where you'll partner closely with machine learning researchers, robotics engineers, and product teams to accelerate the development of intelligent autonomous systems.

The Role

As a Software Engineer, Data Infrastructure, you will design and develop the data platforms that support the collection, processing, labeling, evaluation, and analysis of large-scale robotics and AI datasets.

You'll work with video streams, sensor data, trajectories, time-series information, 3D data, and machine learning outputs while building tools that improve research velocity and model performance.

This role requires strong backend engineering skills combined with data systems expertise and a passion for solving challenging infrastructure problems.

Key Responsibilities

Data Infrastructure & Platforms

• Design and develop scalable systems for storing, processing, and managing large-scale multimodal datasets.
• Build infrastructure supporting video, sensor, telemetry, and robotics data pipelines.
• Enable efficient human-in-the-loop workflows for annotation, review, and data curation.

Data Processing & Signal Extraction

• Develop algorithms that transform raw sensor data into structured information.
• Process and analyze:
• Motion trajectories
• Event streams
• Solve geometric and spatial computing challenges.
• Build tools for evaluating machine learning model performance.
• Develop benchmarking frameworks to compare human and AI-generated outputs.
• Create systems that provide actionable metrics across datasets and models.

Cloud Infrastructure & Operations

• Build and maintain distributed data processing systems.
• Develop scalable cloud-native solutions using AWS and/or GCP.
• Support infrastructure running across Kubernetes clusters and distributed environments.
• Develop internal tools that make large-scale data and model behavior easy to interpret.
• Build dashboards, analytics tools, and debugging platforms for researchers and engineers.
• Improve visibility into data quality and model performance.

Cross-Functional Collaboration

• Partner closely with:
• Machine Learning Engineers
• Research Scientists
• Product Teams
• Help define the roadmap and technical direction of the data platform.

Required Qualifications

• Bachelor's or Master's degree in Computer Science, Software Engineering, Data Engineering, or related discipline.
• 5+ years of professional software engineering experience.
• Experience with:
• NumPy
• Backend services
• Distributed systems
• Strong understanding of:
• Cloud infrastructure
• Data-intensive applications
• Experience with relational and NoSQL databases such as:
• Redis
• MongoDB
• Experience working with AWS and/or GCP.
• Strong algorithmic and problem-solving abilities.
• Solid understanding of geometry, coordinate systems, and spatial data processing.

Preferred Qualifications

• Experience working with:
• Autonomous systems
• LiDAR data
• Experience with:
• Docker
• Airflow
• Experience with experiment tracking tools such as:
• Weights & Biases
• MLflow
• Familiarity with React and TypeScript.
• Startup experience or experience building greenfield infrastructure.

Desired Competencies

• Strong ownership mindset.
• Excellent debugging and troubleshooting skills.
• Ability to build scalable production systems.
• Interest in robotics, machine learning, and AI infrastructure.
• Strong communication and cross-functional collaboration skills.
• Ability to thrive in a fast-paced startup environment.