Senior GCP Data Engineer: BigQuery & Dataflow Architect

TechDigital Group; Secaucus (NJ); On-site; USD 140,000 - 190,000; Full time

Job summary

TechDigital Group seeks a Senior Data Engineer to design, develop, and maintain scalable data pipelines on Google Cloud Platform. You will work with architects and analysts to implement high-performance solutions in BigQuery, Dataflow, and Cloud Composer, enabling reliable data governance and analytics at scale.

Responsibilities include building end-to-end pipelines, optimizing SQL/UDFs, migrating data from on-prem to BigQuery, and ensuring data quality and lineage across enterprise systems.

Qualifications

• Design and implement scalable data pipelines in GCP.
• Migrate data from on-premise/cloud warehouses to BigQuery.
• Collaborate with stakeholders in an Agile environment.
• Ensure data quality and governance across platforms.

Responsibilities

• Design end-to-end data pipelines using Cloud Dataflow for batch and streaming data.
• Develop and optimize BigQuery SPs, SQL scripts, and UDFs.
• Build and manage Airflow workflows with Cloud Composer.
• Establish secure connections to source systems and ingest data.
• Lead data migration from legacy warehouses to BigQuery.

Skills

GCP BigQuery

Python

SQL & UDFs

Data modeling

Airflow/Composer

Data governance

Data migration

ETL/ELT

Performance tuning

Tools

Snowflake

Teradata

Netezza

Oracle

SQL Server

Job description

TechDigital Group seeks a Senior Data Engineer to design, develop, and maintain scalable data pipelines on Google Cloud Platform. You will work with architects and analysts to implement high-performance solutions in BigQuery, Dataflow, and Cloud Composer, enabling reliable data governance and analytics at scale.

Responsibilities include building end-to-end pipelines, optimizing SQL/UDFs, migrating data from on-prem to BigQuery, and ensuring data quality and lineage across enterprise systems.