GCP Data Engineer

Impetus; Bengaluru; On-site; INR 3,000,000 - 6,000,000; Full time

Job summary

Impetus in Bengaluru seeks a Senior GCP Data Engineer with 4-8 years of experience to design, build, and operate scalable batch and real-time data pipelines on Google Cloud Platform.

The ideal candidate will have strong cloud-native data engineering skills, be self-driven, and collaborate effectively in Agile teams, delivering reliable data solutions using BigQuery, Pub/Sub, Dataflow, and Cloud Composer.

Qualifications

• Strong hands-on experience with Google Cloud Platform (GCP).
• Proven expertise in batch and real-time data pipelines.
• Strong programming experience in Python.
• Hands-on experience with BigQuery, Bigtable, Pub/Sub, Dataflow, and Cloud Composer.
• Solid understanding of data modeling, ETL/ELT, and distributed data systems.
• Proficiency with GitHub and GitHub Actions–based CI/CD.
• Experience working in Agile environments.
• Strong knowledge of data security and access management.
• Experience with governance, lineage, and observability tools.

Responsibilities

• Design, develop, and maintain batch and real-time ETL/ELT pipelines on GCP.
• Build and optimize data pipelines using Python.
• Implement streaming solutions using Pub/Sub and Dataflow.
• Develop and manage batch workflows using Cloud Composer.
• Design and optimize data models and queries in BigQuery.
• Work with large-scale, low-latency data stores such as Bigtable.
• Ensure data quality, reliability, performance, and scalability.
• Manage source code, reviews, and collaboration using GitHub.
• Build and maintain CI/CD pipelines using GitHub Actions.
• Collaborate with product, platform, and analytics teams in an Agile setup.

Skills

GCP

BigQuery

Python

Data pipelines

Data Modeling

Cloud Composer

Pub/Sub

Dataflow

GitHub Actions

CI/CD

Agile

Data Security

Access Management

Bigtable

ETL/ELT

Tools

GitHub

Job description

We are seeking a Senior GCP Data Engineer with 4-8 Years experience to design, build, and operate scalable batch and real-time data pipelines on Google Cloud Platform (GCP).

The ideal candidate has strong foundations in cloud-native data engineering, is highly self-driven, accountable, and excels as a collaborative team player in Agile environments.

Key Responsibilities

• Design, develop, and maintain batch and real-time ETL/ELT pipelines on GCP
• Build and optimize data pipelines using Python
• Implement streaming solutions using Pub/Sub and Dataflow
• Develop and manage batch workflows using Cloud Composer
• Design and optimize data models and queries in BigQuery
• Work with large-scale, low-latency data stores such as Bigtable
• Ensure data quality, reliability, performance, and scalability
• Manage source code, reviews, and collaboration using GitHub
• Build and maintain CI/CD pipelines using GitHub Actions
• Collaborate with product, platform, and analytics teams in an Agile setup

Required Skills & Qualifications

• Strong hands-on experience with Google Cloud Platform (GCP)
• Proven expertise in batch and real-time data pipelines
• Strong programming experience in Python
• Hands-on experience with BigQuery, Bigtable, Pub/Sub, Dataflow, and Cloud Composer
• Solid understanding of data modeling, ETL/ELT, and distributed data systems
• Proficiency with GitHub and GitHub Actions–based CI/CD
• Experience working in Agile environments
• Strong knowledge of data security and access management

Nice to Have

• Experience with data governance, lineage, and observability tools
• Exposure to large-scale analytics or enterprise data platforms

Primary Skills :

GCP. Bigdata, PySpark, GCP, Bigquery, Composer, Python