Data Infrastructure Engineer

Mind Robotics; Palo Alto (CA); On-site; USD 140,000 - 200,000; Full time

Job summary

Mind Robotics in Palo Alto is seeking a Data Infrastructure Engineer to design and operate the pipelines that convert raw robot sensor data into training-ready datasets. You will own individual data services, from ingestion to dataloaders, and help scale the architecture for real-world industrial use.

You will collaborate with researchers and engineers to ensure data quality, implement auto-labeling and validation workflows, and build distributed processing systems for batch and streaming

Qualifications

• 2+ years of software engineering experience with data pipelines.
• Strong Python production-grade data processing skills.
• Experience with at least one distributed processing framework.
• Familiarity with object storage and data lake formats.
• Ability to collaborate with researchers and scale pipelines.

Responsibilities

• Build and scale ingestion pipelines for high-volume sensor data.
• Maintain data quality and curation systems, including workflows and auto-labeling.
• Contribute to storage and retrieval design for large-scale multimodal datasets.
• Build and operate distributed processing infrastructure (batch and streaming).
• Debug production issues in live data pipelines, handling data drift and failures.
• Work with modeling/research partners to understand data needs and translate them into pipelines.
• Participate in design and code reviews across the data infrastructure stack.

Skills

Python

Data pipelines

Distributed processing

Backend systems

Ownership mindset

Communication

Tools

Airflow

Dagster

Prefect

Spark

Ray

Job description

About Mind

Mind Robotics is building Physical AI for real-world industrial deployment, starting with the factory floor. We believe the hardest problems in AI are solved when researchers and engineers are hands‑on with the physical world every day - and we're looking for people who are passionate about robotics, value ownership, and are excited to tackle difficult problems. Join us if you want to move beyond digital intelligence and put intelligence into motion.

About The Team And The Role

Mind Robotics is building robots that learn from real‑world experience. That starts with a data engine: the pipelines and infrastructure that turn raw, messy, multimodal sensor streams from robots and human demonstrations into high‑quality, well‑curated training data at scale.

As a Data Infrastructure Engineer, you'll build and operate the pipelines that turn raw sensor and demonstration data into training‑ready datasets — from ingestion off real robots and capture devices, through processing and quality filtering, to the dataloaders that feed model training. The systems work today; your job is to build within the architecture, take ownership of specific pipelines and services, and help harden the system as it scales.

Responsibilities

• Build and scale ingestion pipelines for high-volume, high-dimensional sensor data.
• Build and maintain data quality and curation systems, including both manual review workflows and auto-labeling.
• Contribute to storage and retrieval design for large-scale multimodal datasets, including format choices and versioning/lineage.
• Build and operate distributed processing infrastructure (batch and streaming).
• Debug production issues in live data pipelines — data corruption, schema drift, backpressure, and failures that only show up at scale.
• Work with modeling/research partners to understand data quality, format, and structure needs, and translate them into working pipelines.
• Participate in design and code review across the data infrastructure stack.

Requirements

• 2+ years of software engineering experience, with some exposure to data pipelines, data engineering, or backend systems.
• Strong programming fundamentals in Python, with the ability to write performant, production‑grade data processing code.
• Experience with at least one distributed data processing framework (e.g., Spark, Ray, Dask, or Flink), or strong fundamentals and willingness to ramp up quickly.
• Familiarity with data storage concepts — object storage, data lake table formats, and warehouse vs. lake tradeoffs.
• Bias for ownership: you've taken features or systems from prototype to production.
• Clear communicator who collaborates well with research/modeling partners and more senior teammates.
• Experience with workflow orchestration tools (e.g., Airflow, Dagster, Prefect) is a plus.
• Experience with streaming ingestion for high-volume, near-real-time data is a plus.
• Experience building automated data quality/curation systems (statistical filtering, anomaly detection, deduplication, or using ML models in an annotation/ filtering pipeline) is a plus.
• Experience with robotics- or embodied‑AI‑specific data (multi-embodiment datasets, teleoperation/demonstration data, egocentric video) is a plus.