Flight Data Engineer: Telemetry Pipelines & Dashboards

Pivotal; Palo Alto (CA); On-site; USD 125,000 - 146,000; Full time

Benefits offered by this job

Medical insurance

Dental insurance

Vision insurance

401k

Job summary

Pivotal is seeking a Data Engineer to build and operate the flight data warehouse, turning telemetry into curated datasets, automated fleet health alerts, and dashboards used by firmware, GNC, battery, and MRO teams. You will own pipelines end to end, including data model, services, IaC deployments, and monitoring for reliability.

This role emphasizes strong SQL and Python skills, plus hands-on experience with the AWS data stack to support data quality, lineage, and scalable analytics for

Qualifications

• Bachelor's degree in Computer Science, Computer/Electrical Engineering, or a related technical discipline
• 3+ years of professional data engineering experience building and operating production pipelines
• Strong SQL, including window functions and query tuning on a distributed, columnar engine (Athena/Trino/Presto, Spark, Snowflake, or BigQuery)
• Proficient in Python for production services - not just notebooks: packaging, dependency management, unit tests, and code review
• Hands-on experience with the AWS data stack: S3, Glue, Athena, Lambda, SNS, CloudWatch, and IAM
• Dimensional modeling and warehouse design, including partitioning strategy for large tables
• Excellent analytical and written communication skills, with the ability to work across multidisciplinary teams

Responsibilities

• Pipeline development: Build and maintain the ingest and transformation pipelines that land aircraft telemetry from S3 into the flight data warehouse (AWS Glue, Athena), including schema evolution as firmware logging changes.
• Data modeling: Design and maintain curated marts - flight runs, component flight hours, vehicle modes, battery flight features - in SQL, with clear grain, documented lineage, and idempotent incremental refresh.
• Fleet alerting services: Develop and operate the Python services that evaluate flight-by-flight health checks and deliver alerts to engineering and customer-facing channels via SNS and Slack.
• Data quality: Own the automated quality gates - mart freshness, source-to-mart reconciliation, and watermark integrity - and block deploys that would publish incorrect fleet data.
• Analytics enablement: Build the dashboards and query interfaces engineering teams use to monitor the fleet, and convert repeated one-off analyses into supported datasets.
• Collaboration: Work directly with firmware, GNC, battery, systems engineering, flight operations, and MRO to define what gets logged, what gets alerted on, and what good looks like for each signal.

Skills

SQL

Python

Data pipelines

Data modeling

Data quality

Analytical thinking

Written communication

Education

Bachelor's degree in Computer Science or related technical discipline

Tools

AWS Glue

Amazon Athena

AWS Lambda

Amazon S3

CloudWatch

IAM

dbt

Job description

Pivotal is seeking a Data Engineer to build and operate the flight data warehouse, turning telemetry into curated datasets, automated fleet health alerts, and dashboards used by firmware, GNC, battery, and MRO teams. You will own pipelines end to end, including data model, services, IaC deployments, and monitoring for reliability.

This role emphasizes strong SQL and Python skills, plus hands-on experience with the AWS data stack to support data quality, lineage, and scalable analytics for