Staff Data Platform Engineer (Remote)

Agility Robotics; Salem, Pittsburgh, Fremont (OR, Allegheny County, CA); Hybrid; CAD 270,000 - 423,000; Full time

Benefits offered by this job

401(k) Plan

Equity

Medical insurance

Dental insurance

Vision insurance

Discretionary bonus

Relocation assistance

Tuition reimbursement

Flexible work arrangements

Catered lunches

Job summary

Agility Robotics is seeking a Staff Software Engineer to join the Data Platform team. You will design, develop, and maintain infrastructure enabling ingestion, processing, discovery, serving, and analysis of massive datasets generated by our humanoid robots.

You’ll impact robot performance, operational insights, and scalable cloud systems. The role emphasizes data ingestion pipelines, onboard robot data agents, and observability, with a strong focus on Spark, Kafka, and cloud-native tools (AWS

Qualifications

• 5+ years building and scaling cloud-based data platforms
• Proficient in Spark, Kafka, Beam, Flink
• Familiar with Parquet, Arrow, Iceberg and protocols like Avro/Protobuf
• Experience with observability tools and metrics/logging/tracing
• Proficiency in Java/Scala or Python; strong distributed systems knowledge
• Bonus: robotics/IoT data, Databricks, Kubernetes, Bazel, C++/Rust

Responsibilities

• Design scalable data ingestion pipelines for telemetry, logs and sensor data
• Develop data ingestion agents on robot software for low-connectivity environments
• Maintain data formats and protocols for transmission, storage and query
• Build observability systems for real-time fleet monitoring and analytics
• Implement big data processing for high-volume data using Spark, Kafka or equivalents
• Build cloud tools for BI and long-horizon fleet analytics using AWS services
• Leverage IoT expertise to improve pipelines from robot sensors and edge devices

Skills

Cloud platforms (AWS, GCP, Azure)

Big data frameworks (Spark, Kafka)

Data formats (Parquet, Arrow, Iceberg)

Observability tools (OpenTelemetry, 2)

Java/Scala/Python (JVM)

Distributed systems & microservices

Kubernetes

Tools

Databricks

Kafka Connect

Spark

Bazel/Blaze

ROS / robotics data formats (mcap)

Job description

Agility Robotics is seeking a Staff Software Engineer to join the Data Platform team. You will design, develop, and maintain infrastructure enabling ingestion, processing, discovery, serving, and analysis of massive datasets generated by our humanoid robots.

You’ll impact robot performance, operational insights, and scalable cloud systems. The role emphasizes data ingestion pipelines, onboard robot data agents, and observability, with a strong focus on Spark, Kafka, and cloud-native tools (AWS