GCP Data Engineer

Impetus; Bengaluru; On-site; INR 2,500,000 - 4,000,000; Full time

Job summary

Impetus in Bengaluru seeks a Senior GCP Data Engineer with 4-8 years of experience to design, build, and operate scalable batch and real-time data pipelines on Google Cloud Platform.

You will collaborate with product, platform, and analytics teams in an Agile setup, applying Python, BigQuery, Pub/Sub, Dataflow and Cloud Composer to deliver robust data solutions while ensuring data quality and security.

Qualifications

• Proven experience designing batch and real-time data pipelines on GCP.
• Strong Python programming skills.
• Hands-on with BigQuery, Bigtable, Pub/Sub, Dataflow, and Cloud Composer.
• Solid understanding of data modeling, ETL/ELT, and distributed data systems.
• Proficiency with GitHub and GitHub Actions CI/CD.
• Experience working in Agile environments.
• Strong knowledge of data security and access management.

Responsibilities

• Design, develop, and maintain batch and real-time ETL/ELT pipelines on GCP.
• Build and optimize data pipelines using Python.
• Implement streaming solutions using Pub/Sub and Dataflow.
• Develop and manage batch workflows using Cloud Composer.
• Design and optimize data models and queries in BigQuery.
• Work with large-scale, low-latency data stores such as Bigtable.
• Ensure data quality, reliability, performance, and scalability.
• Manage source code, reviews, and collaboration using GitHub.
• Build and maintain CI/CD pipelines using GitHub Actions.
• Collaborate with product, platform, and analytics teams in an Agile setup.

Skills

GCP

Data pipelines

Python

BigQuery

Bigtable

Pub/Sub

Dataflow

Cloud Composer

ETL/ELT

GitHub CI/CD

Agile

Data security

Tools

GitHub

GitHub Actions

Job description

We are seeking a Senior GCP Data Engineer with 4-8 Years experience to design, build, and operate scalable batch and real-time data pipelines on Google Cloud Platform (GCP).

The ideal candidate has strong foundations in cloud-native data engineering, is highly self-driven, accountable, and excels as a collaborative team player in Agile environments.

Key Responsibilities

• Design, develop, and maintain batch and real-time ETL/ELT pipelines on GCP
• Build and optimize data pipelines using Python
• Implement streaming solutions using Pub/Sub and Dataflow
• Develop and manage batch workflows using Cloud Composer
• Design and optimize data models and queries in BigQuery
• Work with large-scale, low-latency data stores such as Bigtable
• Ensure data quality, reliability, performance, and scalability
• Manage source code, reviews, and collaboration using GitHub
• Build and maintain CI/CD pipelines using GitHub Actions
• Collaborate with product, platform, and analytics teams in an Agile setup

Required Skills & Qualifications

• Strong hands‑on experience with Google Cloud Platform (GCP)
• Proven expertise in batch and real-time data pipelines
• Strong programming experience in Python
• Hands‑on experience with BigQuery, Bigtable, Pub/Sub, Dataflow, and Cloud Composer
• Solid understanding of data modeling, ETL/ELT, and distributed data systems
• Proficiency with GitHub and GitHub Actions‑based CI/CD
• Experience working in Agile environments
• Strong knowledge of data security and access management

Nice to Have

• Experience with data governance, lineage, and observability tools
• Exposure to large-scale analytics or enterprise data platforms

Primary Skills : GCP. Bigdata, PySpark, GCP, Bigquery, Composer, Python

Seondary Skills : SQL, Spark/Python,

Good to Have : Gen AI