Staff Data Engineer — Real-Time Energy Data Pipelines Lead

Form Energy; Berkeley (CA); On-site; USD 148,000 - 185,000; Full time

Benefits offered by this job

Relocation assistance

Competitive compensation

Job summary

Form Energy in Berkeley is seeking a Staff Data Engineer to design, build, and operate the data platform powering deployed energy storage projects. You’ll lead end‑to‑end data pipelines, collaborate with field ops, hardware, and analytics teams, and raise data quality and reliability across the stack.

You’ll own open table formats, time‑series data, and orchestration workflows while mentoring teammates and contributing to RFCs and technical design docs.

Qualifications

• Bachelor’s degree in computer science, applied mathematics, software engineering, data engineering or computer engineering.
• 7+ years of data or software engineering experience with production data pipelines.
• Strong production programming in Python, Scala, Java, or Go.
• Hands-on experience with Spark (PySpark/Scala) and dbt.
• Experience with open table formats such as Iceberg or Delta Lake.
• Experience with streaming systems such as Kafka or Kinesis.
• Experience with orchestration frameworks like Dagster, Prefect, or Airflow.
• AWS experience and infrastructure‑as‑code with Pulumi and/or Terraform.
• Ability to lead design of novel solutions with RFCs/technical docs.
• Excellent communication and on‑call rotation comfort. Nice to have: Databricks/Snowflake and IoT/edge or time-series DBs.

Responsibilities

• Design, build, and operate streaming and batch pipelines for telemetry data.
• Lead operational‑telemetry data products and extend the core platform.
• Draft technical design docs and RFCs and align with stakeholders.
• Model time‑series and event data for analytics using Iceberg/Delta Lake.
• Build data orchestration (Dagster/Prefect/Airflow) for reliable workflows.
• Stand up AWS infra and code with Pulumi/Terraform.
• Collaborate with operations, hardware, and analytics teams.
• Participate in on‑call rotations to keep data flowing.

Skills

Python

Scala/Java/Go

Spark

dbt

Iceberg/Delta Lake

Kafka/Kinesis

Dagster/Prefect/Airflow

AWS + Pulumi/Terraform

RFCs/Technical docs

On-call rotation

Databricks/Snowflake

Education

Bachelor's degree in computer science or related field

Job description

Form Energy in Berkeley is seeking a Staff Data Engineer to design, build, and operate the data platform powering deployed energy storage projects. You’ll lead end‑to‑end data pipelines, collaborate with field ops, hardware, and analytics teams, and raise data quality and reliability across the stack.

You’ll own open table formats, time‑series data, and orchestration workflows while mentoring teammates and contributing to RFCs and technical design docs.