GCP Data Engineer

Zorba Consulting; Pune District; On-site; INR 1,200,000 - 1,800,000; Full time

Job summary

Zorba Consulting in India is seeking a data engineering professional to design, build and operate scalable data platforms on Google Cloud Platform (GCP) for reporting, ML pipelines and analytics at scale.

You will implement ETL/ELT pipelines using Dataflow, Pub/Sub and BigQuery, develop Python services, orchestrate with Apache Airflow, and automate deployment with Terraform and CI/CD. The role emphasizes data governance, security, observability and collaboration with stakeholders.

Qualifications

• Proven hands-on experience implementing production data pipelines on GCP.
• Familiarity with data modelling for enterprise workloads.
• Knowledge of cloud security, IAM, cost optimisation and data governance.

Responsibilities

• Design and implement scalable, secure ETL/ELT data pipelines on GCP using Dataflow, Pub/Sub and BigQuery.
• Develop and productionize Python-based data services and orchestration workflows with Airflow/Composer; automate deployment with Terraform and CI/CD.
• Define data models, ingestion patterns and partitioning strategies in BigQuery to optimise cost and performance.
• Implement data reliability, monitoring and alerting using Cloud Monitoring and logging best practices.
• Collaborate with data scientists and stakeholders to translate requirements into robust data solutions.
• Apply cloud security and IAM best practices; steward data governance and access controls.

Skills

BigQuery

Cloud Dataflow

Cloud Pub/Sub

Cloud Storage

Apache Airflow

Terraform

Python

SQL

Tools

Dataproc

Kubernetes

Looker

Job description

About The Opportunity

Operating in the IT Consulting & Cloud Services sector, this role sits within a fast‑moving cloud data engineering practice that delivers end‑to‑end analytics, ETL/ELT and real‑time streaming solutions for enterprise clients. The position is fully on‑site in India and focuses on designing, building and operating scalable data platforms on Google Cloud Platform (GCP) to support reporting, ML pipelines and analytics at scale.

Role & Responsibilities

• Design and implement scalable, secure ETL/ELT data pipelines on GCP using Dataflow, Pub/Sub and BigQuery for batch and streaming use cases.
• Develop and productionize Python‑based data services and orchestration workflows using Apache Airflow/Composer; automate deployment with Terraform and CI/CD pipelines.
• Define data models, ingestion patterns and partitioning/cluster strategies in BigQuery to optimise cost and query performance.
• Implement data reliability, monitoring and alerting using Cloud Monitoring/Stackdriver, logging best practices and SLIs/SLOs to maintain uptime and data quality.
• Collaborate with data scientists, analysts and stakeholders to translate business requirements into robust data solutions and performant datasets.
• Apply cloud security and IAM best practices; steward data governance, lineage and access controls across GCP resources.

Skills & Qualifications Must‑Have

• BigQuery
• Cloud Dataflow
• Cloud Pub/Sub
• Cloud Storage
• Apache Airflow
• Terraform
• Python
• SQL

Preferred Skills

• Dataproc
• Kubernetes
• Looker

Qualifications

• Proven hands‑on experience implementing production data pipelines and data modelling on GCP (on‑site in India).
• Familiarity with cloud security, IAM, cost optimisation and data governance for enterprise workloads.

Benefits & Culture Highlights

• Career growth within a specialist cloud‑data practice and exposure to large enterprise analytics programs.
• Structured mentorship, technical training and opportunities to earn/maintain GCP certifications.
• Collaborative, delivery‑focused culture with emphasis on engineering quality, observability and client impact.