Remote Senior GCP Data Engineer: BigQuery & Dataflow

Danta Technologies; Secaucus (NJ); Hybrid; USD 120,000 - 180,000; Full time

Benefits offered by this job

Healthcare insurance

Major holidays

Paid sick leave

Job summary

Danta Technologies in Secaucus, NJ, is seeking a Senior GCP Data Engineer to design and maintain scalable data pipelines on Google Cloud Platform. You will work with architects, analysts, and stakeholders to deliver high-quality data solutions in BigQuery and related services.

The role involves data ingestion, transformation, orchestration, governance, and ensuring performance and cost optimization across enterprise data systems. Remote-friendly in Secaucus as noted.

Qualifications

• Extensive experience designing and maintaining scalable data pipelines on Google Cloud Platform (GCP).
• Strong SQL and Python expertise for data transformations and automation.
• Experience with data modeling, ETL/ELT frameworks, and data governance practices.

Responsibilities

• Design and implement end-to-end data pipelines using Cloud Dataflow (Python/Apache Beam) for batch and streaming data.
• Develop, optimize, and maintain BigQuery stored procedures, SQL scripts, and UDFs for complex transformations.
• Build and manage data orchestration workflows using Cloud Composer (Airflow) with appropriate operators and dependencies.
• Establish secure connections to source systems for data ingestion and integration.
• Migrate history data from legacy warehouses (Snowflake, Teradata, Netezza, Oracle, SQL Server) to BigQuery.
• Design data validation and testing frameworks to ensure data quality across pipelines.
• Implement data governance including metadata management, lineage tracking, and access control.
• Collaborate with analysts and architects to define scalable data models, views, and semantic layers in BigQuery.
• Troubleshoot pipeline failures, perform root-cause analyses, and apply preventive measures.
• Optimize cost and performance of GCP workloads using Best Practices for BigQuery and Dataflow.

Skills

Python programming

SQL

ETL/ELT frameworks

Data governance

Metadata & lineage

Data validation & testing

Data modeling (Star/Snowflake)

Workflow orchestration

Communication skills

Tools

BigQuery

Dataflow

Cloud Composer

GCS

Snowflake

Teradata

Netezza

Oracle

SQL Server

Job description

Danta Technologies in Secaucus, NJ, is seeking a Senior GCP Data Engineer to design and maintain scalable data pipelines on Google Cloud Platform. You will work with architects, analysts, and stakeholders to deliver high-quality data solutions in BigQuery and related services.

The role involves data ingestion, transformation, orchestration, governance, and ensuring performance and cost optimization across enterprise data systems. Remote-friendly in Secaucus as noted.