Autonomy Data Platform Engineer — End-to-End Pipeline

Neros Inc.; Torrance (CA); On-site; USD 164,000 - 229,000; Full time

Job summary

Neros Inc. is a defense technology company building America's drone industrial base from the ground up. We design and manufacture unmanned systems, tested in combat and scaled for rapid deployment.

Join us to own the autonomy data pipeline end to end and enable fast, repeatable experiments for warfighters. The Data Platform Engineer will recover flight data from vehicles, land it in the cloud, and make it searchable and replayable at scale, with a focus on cost, compliance, and reliability

Qualifications

• Proficient in Python, SQL and PostgreSQL used in production systems.
• Experience with cloud object storage and compute (Azure, AWS, or GCP).
• Hands-on with large-scale log or sensor data and multi-terabyte datasets.

Responsibilities

• Build the path that brings flight data back from the field, including triggered capture on the vehicle, prioritized upload so the highest-value flights return first, and resumable transfer with integrity verification.
• Turn raw logs into a usable corpus: decode, time-align multi-sensor and video streams, validate, and quarantine malformed data before it reaches downstream users.
• Design the catalog and tag model that index the corpus, and stand up the cloud storage and database that hold it
• Build the query layer so an engineer can retrieve every flight matching a condition, for example loss of target lock at terminal stage under high glare within the last 90 days, and get playable video back in seconds.
• Serve logs to the evaluation harness with stable ordering, exact time alignment, and reproducible results across runs, so a regression job can run over thousands of flights at once.
• Build versioned, immutable datasets from catalog queries, with lineage recorded so any model training set can be rebuilt exactly months later.

Skills

Python

SQL

PostgreSQL

Data modeling

Time synchronization

Software design

Data pipelines

Distributed processing

Unit testing / reproducibility

Tools

Azure

AWS

GCP

Spark

Ray

Dask

Airflow

Dagster

ROS bag

MCAP

HDF5

Parquet

Job description

Neros Inc. is a defense technology company building America's drone industrial base from the ground up. We design and manufacture unmanned systems, tested in combat and scaled for rapid deployment.

Join us to own the autonomy data pipeline end to end and enable fast, repeatable experiments for warfighters. The Data Platform Engineer will recover flight data from vehicles, land it in the cloud, and make it searchable and replayable at scale, with a focus on cost, compliance, and reliability