GCP Data Engineer *

Kairos Technologies; Hyderabad, Pune District; On-site; INR 1,200,000 - 1,800,000; Full time

Job summary

Kairos Technologies in Hyderabad, India, is seeking a data pipeline specialist to design and maintain scalable ETL/ELT workflows on Google Cloud Platform (GCP) using BigQuery, Dataflow, Cloud Storage and Airflow.

You will migrate on‑prem ETLs to GCP, optimize SQL models, and build secure data pipelines while collaborating with analytics teams.

Proficiency in Python (Pandas, Numpy) and PySpark, plus experience with Presto/Hive SQL and Cloud Composer, is preferred.

Qualifications

• Extensive IT data analytics project experience.
• Hands-on with migrating on-prem ETLs to GCP using cloud-native tools.
• Experience with BigQuery, Dataflow, Cloud Storage, Composer, Pub/Sub.
• Strong SQL skills and data modeling concepts (partitioning, clustering, materialized views).
• Proficiency in Python (Pandas, Numpy, SciPy, Matplotlib) and PySpark.

Responsibilities

• Design and maintain scalable ETL/ELT data pipelines on GCP.
• Migrate on-prem ETL processes to Google Cloud Platform.
• Develop and optimize BigQuery datasets for analysis and reporting.
• Automate data workflows with Cloud Composer and Airflow.
• Ensure data security and IAM compliance across pipelines.

Skills

BigQuery

Dataflow

Airflow

SQL

Python

Pyspark

Data security

Tools

Cloud Composer

Cloud Dataflow

Presto SQL

Hive SQL

Job description

Description:

Data Pipeline Development: Build and maintain scalable, secure ETL/ELT data workflows using BigQuery and other GCP services (e.g., Dataflow, Cloud Storage).

Extensive Experience in IT data analytics projects, Hands on experience in migrating on premise ETLs to Google Cloud Platform (GCP) using cloud native tools such as BIG query, Cloud Data, Proc, Google Cloud Storage, ComposerSQL concepts, Presto SQL, Hive SQL, Python (Pandas, Numpy, SciPy, Matplotlib) and PysparkDesign and implement scalable data pipelines using Google Cloud DataflowDevelop and optimize BigQuery datasets for efficient data analysis and reportingCollaborate with cross-functional teams to integrate data solutions with business processes Automate data workflows using Cloud Composer and Apache Airflow Ensure data security and compliance with GCP Identity and Access Management Query & Storage Optimization: Develop advanced SQL queries and design data models using partitioning, clustering, and materialized views to minimize costs and maximize performance Implement real-time data processing with Google Cloud Pub/Sub and Dataflow Continuously evaluate and adopt new GCP tools and technologies

GCP Biq query, Python , SQL , AirflowComposer