Senior Data Engineer — Remote BigQuery & Dataflow Architect

Chicory; United States; Hybrid; USD 160,000 - 185,000; Full time

Benefits offered by this job

Flexible paid time off

One Medical membership

Free ClassPass membership

Stock options

Health Spending Account (HSA)

FSA

Job summary

Chicory is seeking a Senior Data Engineer to own and expand the data platform behind advertising, campaigns, product, and finance reporting. You’ll work with high-volume real-time events using GCP, BigQuery, Dataflow, and Superset, shaping the data lake and warehouse architecture.

You’ll remain hands-on, build pipelines and models, define metrics, and enable teams to access data. You’ll collaborate with backend and cloud engineers, finance, product, and leadership to drive insights and

Qualifications

• Proven track record designing, rearchitecting, and operating a production analytical data platform.
• Deep hands-on knowledge of BigQuery including schema design, partitioning, and cost management.
• Strong Python and advanced SQL skills with production-grade code.
• Hands-on experience with batch and streaming systems (Beam/Dataflow) and with Airflow/Cloud Composer.
• Strong data-modeling judgment across dimensional, event, and domain models.
• Automated data quality, reconciliation, observability, and incident response.
• BI/self-service analytics enablement via Superset or similar tool.
• Data governance, least-privilege access, privacy, retention controls.
• Software-engineering practices for data systems (Git, CI/CD, IaC).
• Autonomous senior technical owner capable of leading migrations and communicating tradeoffs.

Responsibilities

• Map ad requests, bids, impressions, clicks, spend, revenue, and payments into BigQuery and Superset.
• Design and implement new BigQuery structure: raw, staging, core, and reporting datasets.
• Build and maintain batch and streaming ETL/ELT pipelines with Python, SQL, Beam, Dataflow.
• Develop DAGs in Cloud Composer/Airflow with reliable retries and safe reruns.
• Move calculations out of scheduled queries using Dataform or dbt.
• Create data marts for campaign delivery, revenue reconciliation, and leadership reporting.
• Investigate data mismatches and repair affected data; document changes.
• Add tests/alerts for late data, duplicates, and schema changes.
• Maintain shared Superset datasets and ensure consistent metrics.
• Review BigQuery cost and optimize storage, queries, and retention.
• Manage data access with IAM and retention policies.
• Use Git, tests, CI/CD, and IaC for repeatable deployments.
• Collaborate with Eng, Campaign, Finance, Product, and Leadership.
• Lead incidents and document runbooks for future engineers.
• Contribute to Chicory culture and principles.

Skills

Python

SQL

BigQuery

Apache Beam

Dataflow

Cloud Composer

Airflow

Data modeling

ETL/ELT

Data quality

Tools

BigQuery

Dataflow

Cloud Composer

Apache Airflow

Dataform

dbt

Python

SQL

Git

Terraform

Superset

Job description

Chicory is seeking a Senior Data Engineer to own and expand the data platform behind advertising, campaigns, product, and finance reporting. You’ll work with high-volume real-time events using GCP, BigQuery, Dataflow, and Superset, shaping the data lake and warehouse architecture.

You’ll remain hands-on, build pipelines and models, define metrics, and enable teams to access data. You’ll collaborate with backend and cloud engineers, finance, product, and leadership to drive insights and