Gcp Data Engineer, Senior - Chennai

Prodapt Solutions; Chennai; On-site; INR 900,000 - 1,300,000; Full time

Job summary

Prodapt Solutions in Chennai is seeking a data engineer to design, build, and maintain robust data pipelines on Google Cloud Platform (GCP). You will work with BigQuery for warehousing and manage Dataproc workflows to process large-scale data.

Collaborate with data analysts and business stakeholders to deliver reliable data solutions while ensuring data governance, security, and compliance across GCP deployments. You will participate in code reviews and document data flows.

Qualifications

• Experience designing data pipelines on cloud platforms.
• Strong SQL skills for data transformation and validation.
• Familiarity with BigQuery data warehousing and analytics.

Responsibilities

• Design, develop, and maintain robust data pipelines on GCP.
• Work with BigQuery for data warehousing and large-scale analytics.
• Build and manage data processing workflows using Dataproc.
• Write and optimize complex SQL queries for data transformation.
• Design, schedule, and monitor data workflows with Cloud Composer.
• Troubleshoot pipeline failures and data quality issues in production.
• Collaborate with analysts, scientists, and stakeholders to deliver reliable data solutions.
• Ensure data governance, security, and compliance across GCP deployments.
• Participate in code reviews and knowledge-sharing sessions.
• Document data flows and operational runbooks for supportability.

Skills

GCP

BigQuery

SQL

Data Pipelines

Collaboration

Tools

Dataproc

Cloud Composer

Airflow

Job description

Roles and Responsibilities:-

• Design, develop, and maintain robust, scalable, and efficient data pipelines on Google Cloud Platform (GCP).


• Work extensively with BigQuery (BQ) for data warehousing, query optimization, and large-scale data analysis.


• Build and manage big data processing workflows using Dataproc (Hadoop/Spark ecosystem on GCP).


• Write, optimize, and troubleshoot complex SQL queries for data transformation, validation, and reporting.


• Design, schedule, and monitor data workflows using Cloud Composer (Apache Airflow).


• Perform root-cause analysis and troubleshooting of pipeline failures, data quality issues, and performance bottlenecks in production environments.


• Collaborate with data analysts, data scientists, and business stakeholders to understand requirements and deliver reliable data solutions.


• Ensure data governance, security, and compliance standards are followed across all GCP data engineering solutions.


• Participate in code reviews, design discussions, and knowledge-sharing sessions within the team.


• Document technical designs, data flows, and operational runbooks for supportability.