Senior GCP Data Engineer

Danta Technologies; Secaucus (NJ); Remote; USD 51,000 - 73,000; Full time

Job summary

Danta Technologies is seeking a Senior GCP Data Engineer in Secaucus, NJ (Remote). You will design and maintain scalable data pipelines on GCP, focusing on ingestion, transformation, and governance to support enterprise analytics.

The role requires expert Python, SQL, and BigQuery skills, and experience migrating data from on-premise warehouses. You will collaborate with architects, analysts, and stakeholders to build reusable data models, optimize costs, and ensure data quality and security

Qualifications

• Experience designing scalable data pipelines in GCP.
• Strong SQL and Python for data engineering.
• Experience migrating data from on-premise to BigQuery.
• Familiarity with metadata, lineage, and data governance.
• Excellent communication in Agile teams.

Responsibilities

• Design end-to-end data pipelines with Dataflow for batch and streaming.
• Develop BigQuery SPs, SQL scripts, and UDFs.
• Build data workflows with Cloud Composer/Airflow.
• Ingest data from on-prem and cloud sources to GCS and BigQuery.
• Migrate history data to BigQuery from Snowflake/Teradata/Netezza/Oracle/SQL Server.
• Implement data validation, quality testing, and governance.
• Optimize costs and performance of GCP workloads.
• Collaborate with analysts and architects on data models and semantic layers.

Skills

GCP Expertise

BigQuery

Dataflow

Cloud Composer

GCS

Python

SQL

Data modeling

Data governance

Airflow

Tools

Snowflake

Teradata

Netezza

Oracle

SQL Server

Job description

Job Summary

The Senior Data Engineer will be responsible for designing, developing, and maintaining scalable data pipelines and solutions on Google Cloud Platform (GCP). The role focuses on data ingestion, transformation, orchestration, and governance across enterprise data systems. The engineer will work closely with architects, data analysts, and business stakeholders to implement high-quality, performance-optimized data solutions in BigQuery and related GCP services.

Role - Senior GCP Data Engineer

Location: Secaucus, NJ (Remote)

Pay Rate: $45/hr on W2

Key Responsibilities

• Design and implement end-to-end data pipelines using Cloud Dataflow (Python/Apache Beam) for batch and streaming data.
• Develop, optimize, and maintain BigQuery stored procedures (SPs), SQL scripts, and user-defined functions (UDFs) for complex transformations and business logic implementation.
• Build and manage data orchestration workflows using Cloud Composer (Airflow) with appropriate operators and dependencies.
• Establish secure and efficient connections to source systems for data ingestion and integration.
• Manage data ingestion workflows from on-premise and cloud sources into Google Cloud Storage (GCS) and BigQuery.
• Execute history data migration from legacy data warehouses (preferably Snowflake, Teradata, Netezza, Oracle, SQL Server) to BigQuery, ensuring accuracy and performance optimization.
• Design and maintain data validation and testing frameworks for ensuring data quality and reliability across pipelines.
• Implement data governance practices, including metadata management, lineage tracking, and access control.
• Collaborate with data analysts and architects to define scalable and reusable data models, views, and semantic layers in BigQuery.
• Troubleshoot data pipeline failures, perform root cause analysis, and implement preventive measures.
• Optimize cost and performance of GCP workloads using best practices for BigQuery and Dataflow.

Skill Requirements

• Strong hands-on experience in Google Cloud Platform (GCP) with expertise in BigQuery, Dataflow, Cloud Composer, and GCS.
• Proficient in Python programming for data engineering (Dataflow pipelines, validation scripts, automation).
• Expertise in BigQuery SQL, Stored Procedures, Views, and User Defined Functions (UDFs).
• Experience with data migration from on-premise or cloud data warehouses (preferably Snowflake, Teradata, Netezza, Oracle, SQL Server) to BigQuery.
• Strong understanding of ETL/ELT frameworks, data modeling, and schema design (Star/Snowflake).
• Familiarity with data governance, metadata, and lineage frameworks on GCP.
• Knowledge of data validation and testing techniques, including reconciliation, rule-based checks, and automation.
• Hands-on experience in workflow orchestration using Cloud Composer (Airflow) with custom operators.
• Strong SQL tuning and BigQuery performance optimization skills.
• Good communication and collaboration skills to work with cross-functional teams in Agile environments.
• Proven ability to troubleshoot, optimize, and enhance complex data workflows at scale.

Notes

All qualified applicants will receive consideration for employment without regard to race, color, religion, religious creed, sex, national origin, ancestry, age, physical or mental disability, medical condition, genetic information, military and veteran status, marital status, pregnancy, gender, gender expression, gender identity, sexual orientation, or any other characteristic protected by local law, regulation, or ordinance.

Benefits

Danta offers a compensation package to all W2 employees that are competitive in the industry. It consists of competitive pay, the option to elect healthcare insurance (Dental, Medical, Vision), Major holidays and Paid sick leave as per state law.

The rate/ Salary range is dependent on numerous factors including Qualification, Experience and Location.