GCP Data Engineer Lead: BigQuery & Dataflow Mastery

Sapsf; United States; On-site; USD 140,000 - 210,000; Full time

Job summary

Sapsf is seeking a GCP Data Lead to design, build, and maintain scalable data pipelines on Google Cloud Platform. You will own ingestion, transformation, and governance across enterprise systems, collaborating with architects, analysts, and stakeholders to deliver reliable BigQuery solutions.

You will implement batch and streaming pipelines with Dataflow, manage Cloud Composer workflows, perform data migrations from Snowflake and other warehouses, ensure data quality and lineage, and optimize

Qualifications

• Experience designing scalable data pipelines on Google Cloud Platform.
• Strong SQL and Python for data engineering, testing, and automation.
• Experience with data migration from on-premise or cloud warehouses to BigQuery.

Responsibilities

• Design and implement end-to-end data pipelines using Cloud Dataflow for batch and streaming data.
• Develop, optimize, and maintain BigQuery SPs, SQL scripts, and UDFs for transformations.
• Build and manage data orchestration workflows using Cloud Composer (Airflow).
• Establish secure connections to source systems for data ingestion and integration.
• Migrate data from Snowflake, Teradata, Netezza, Oracle, and SQL Server to BigQuery.
• Design data validation and testing frameworks for data quality across pipelines.
• Implement data governance, metadata management, lineage, and access controls.
• Collaborate with analysts and architects to define scalable data models and semantic layers in BigQuery.
• Troubleshoot pipeline failures, root-cause analysis, and preventive measures.
• Optimize cost and performance of GCP workloads using best practices.

Skills

GCP expertise

BigQuery

Dataflow

Cloud Composer

Python

SQL

ETL/ELT design

Data governance

Data modeling

Airflow

Tools

Snowflake

Teradata

Netezza

Oracle

SQL Server

Google Cloud Storage

Job description

Sapsf is seeking a GCP Data Lead to design, build, and maintain scalable data pipelines on Google Cloud Platform. You will own ingestion, transformation, and governance across enterprise systems, collaborating with architects, analysts, and stakeholders to deliver reliable BigQuery solutions.

You will implement batch and streaming pipelines with Dataflow, manage Cloud Composer workflows, perform data migrations from Snowflake and other warehouses, ensure data quality and lineage, and optimize