Senior Data Engineer, Lakehouse Platform (Remote)

Progress Partners; United States; Remote; USD 140,000 - 190,000; Full time

Benefits offered by this job

Remote-first

Unlimited PTO

Learning budget

Wellness allowance

Home office budget

Flexible hours

Job summary

Progress Partners is seeking a Senior Data Engineer to build a data platform from scratch. You’ll design ingestion pipelines for payments, marketing analytics, and operations across AWS and GCP into a Lakehouse, owning end-to-end architecture in a hands-on role.

You’ll work with dbt transformations, Airflow orchestration, and BigQuery, shaping medallion layers and cost-aware infrastructure. This remote, async-first environment values outcomes over hours.

Qualifications

• 3+ years building production data platforms and pipelines from the ground up.
• Deep expertise in Airflow, including lineage, backfill, and retry strategies.
• Hands-on experience with dbt, version-controlled transformations.
• Strong AWS and GCP skills, with Terraform for infrastructure as code and FinOps mindset.
• Ability to work autonomously in a remote, async environment.

Responsibilities

• Design and build ingestion pipelines for high-volume data across payments, marketing analytics, and operations.
• Build the data infrastructure for a Lakehouse using AWS and GCP.
• Develop medallion-layer transformations (Bronze → Silver → Gold) in dbt with BigQuery.
• Own orchestration end-to-end in Airflow, including lineage, backfills, retries, and alerts.
• Apply infrastructure-as-code and cost-control best practices.

Skills

Airflow

dbt

AWS

GCP

Terraform

BigQuery

Tools

dbt

Job description

Progress Partners is seeking a Senior Data Engineer to build a data platform from scratch. You’ll design ingestion pipelines for payments, marketing analytics, and operations across AWS and GCP into a Lakehouse, owning end-to-end architecture in a hands-on role.

You’ll work with dbt transformations, Airflow orchestration, and BigQuery, shaping medallion layers and cost-aware infrastructure. This remote, async-first environment values outcomes over hours.