Remote: Staff Data Platform Engineer (Cloud & Big Data)

Agility Robotics; Fremont (CA); On-site; USD 191,000 - 299,000; Full time

Benefits offered by this job

401(k) match

Equity options

Medical coverage

Dental coverage

Unlimited PTO

Job summary

Agility Robotics is seeking a Staff Software Engineer for the Data Platform team. You will design and maintain the infrastructure for ingesting, processing, and analyzing massive robot-generated datasets, enabling scalable insights and performance improvements across fleets.

You will work on data ingestion pipelines, on-robot ingestion agents, data formats, observability, and cloud platform integrations (AWS/GCP/Azure).

Qualifications

• 5+ years building and scaling cloud data platforms.
• Proficient in Spark, Kafka, Beam, Flink.
• Familiar with Parquet, Arrow, Iceberg; Avro/Protobuf.
• Observability experience: OpenTelemetry, Prometheus.
• Proficiency in Java/Scala/Python and JVM systems.

Responsibilities

• Data Ingestion: design scalable pipelines for telemetry, logs and sensor data.
• Data Agents: build ingestion agents on robot software for low connectivity.
• Data Formats: develop data formats and protocols for storage and query.
• Observability: implement real-time monitoring and analytics tooling.
• Big Data Processing: prepare data for analysis with Spark/Kafka.
• Cloud Platform: enable BI and fleet analytics using AWS S3, Athena, SageMaker.
• IoT integration: enhance data collection from robot sensors and edge devices.

Skills

Cloud data platforms

Apache Spark

Kafka

OpenTelemetry

Java/Scala/Python

Tools

AWS

GCP

Azure

Kubernetes

Databricks

Spark

Job description

Agility Robotics is seeking a Staff Software Engineer for the Data Platform team. You will design and maintain the infrastructure for ingesting, processing, and analyzing massive robot-generated datasets, enabling scalable insights and performance improvements across fleets.

You will work on data ingestion pipelines, on-robot ingestion agents, data formats, observability, and cloud platform integrations (AWS/GCP/Azure).