Senior Data Engineer, Robotics Data Platform - Remote

Agility Robotics; Fremont (CA); Remote; USD 175,000 - 274,000; Full time

Benefits offered by this job

401(k) Plan

Equity

Medical, dental, vision insurance

Paid time off

Job summary

Agility Robotics is hiring a Senior Data Engineer for the Data Platform team. You will design, curate, and maintain high-quality datasets enabling analytics, debugging, and fleet-scale insights across in-robot and cloud data pipelines.

You will build transformations, author pipelines, and collaborate with robotics, operations, and data science teams to deliver reliable data products for hardware reliability and system health. Remote-friendly with potential hybrid options.

Qualifications

• 5+ years of experience building and maintaining production data pipelines.
• Strong proficiency in Apache Spark or equivalent distributed data processing framework with Python/Java/Scala.
• Experience with Airflow, Dagster, Prefect, or other orchestration systems.
• Familiarity with data formats like Avro and Parquet; table formats like Iceberg and Delta Lake.
• Solid data modeling, schema evolution, and data quality practices.
• Ability to design data models and partitioning for analytical queries and root-cause analysis.

Responsibilities

• Collaborate with robot software and hardware teams to define, collect, and curate data for analytics and debugging.
• Develop and maintain ETL pipelines that transform raw robot logs and telemetry into structured datasets using Spark and AWS data services.
• Own gold-layer datasets powering dashboards, reliability models, and business metrics with SLAs and monitoring.
• Implement data quality checks, schema evolution, and metadata management using internal Data Registry and cataloging systems.
• Collaborate with reliability, analytics, and ML teams to design efficient data models for processes.
• Contribute to shared libraries or APIs in Python, Java, or C++ to support data capture and consumption.

Skills

5+ years experience

Apache Spark

Python/Java/Scala

Airflow

Dagster

Prefect

Data modeling

Schema evolution

Data quality

Cross-functional collaboration

Tools

Apache Spark

Airflow

Dagster

Prefect

Apache Iceberg

Delta Lake

Avro

Parquet

Job description

Agility Robotics is hiring a Senior Data Engineer for the Data Platform team. You will design, curate, and maintain high-quality datasets enabling analytics, debugging, and fleet-scale insights across in-robot and cloud data pipelines.

You will build transformations, author pipelines, and collaborate with robotics, operations, and data science teams to deliver reliable data products for hardware reliability and system health. Remote-friendly with potential hybrid options.