Data Engineering Manager - GCP

Blend360; Hyderabad; On-site; INR 1,800,000 - 3,000,000; Full time

Job summary

Blend360 seeks a Senior GCP Data Engineer with 6+ years of experience to design, develop, and maintain scalable data engineering solutions on Google Cloud Platform (GCP). You will work with Python, SQL, and a suite of GCP data services to build robust data pipelines.

Responsibilities include ETL/ELT development, data modeling, and performance optimization while collaborating with business and technical teams to deliver high-quality data solutions.

Qualifications

• 6+ years of experience in data engineering.
• Strong hands-on experience with Google Cloud Platform (GCP).
• Strong programming experience in Python.
• Strong expertise in SQL, including complex queries, joins, CTEs, window functions, and query optimization.
• Experience developing ETL/ELT data pipelines.
• Hands-on experience with one or more GCP services such as BigQuery, Cloud Storage, Cloud Composer/Airflow, Dataflow, Pub/Sub, Dataproc.
• Experience with Git and CI/CD practices.

Responsibilities

• Design and develop scalable and reliable data pipelines using GCP services.
• Develop data processing and transformation solutions using Python and SQL.
• Build and optimize ETL/ELT pipelines for large-volume datasets.
• Work with business and technical teams to understand data requirements and deliver robust solutions.
• Perform data modeling, data validation, and performance optimization.
• Monitor and troubleshoot data pipelines and resolve production issues.
• Implement data quality, security, and governance best practices.
• Participate in code reviews and contribute to technical design and architecture discussions.

Skills

Python

SQL

Data pipelines

GCP

BigQuery

Airflow/Cloud Composer

Dataflow

Dataproc

Pub/Sub

Spark/PySpark

ETL/ELT

Git

CI/CD

Data warehousing

Performance optimization

Tools

BigQuery

Cloud Composer/Airflow

Dataflow

Dataproc

Spark/PySpark

Pub/Sub

Git

CI/CD

Job description

We are looking for a Senior GCP Data Engineer with 6+ years of experience in designing, developing, and maintaining scalable data engineering solutions on Google Cloud Platform (GCP) . The ideal candidate should have strong hands-on expertise in Python, SQL, data pipelines, and GCP data services .

Key Responsibilities

• Design and develop scalable and reliable data pipelines using GCP services.


• Develop data processing and transformation solutions using Python and SQL .


• Build and optimize ETL/ELT pipelines for large-volume datasets.


• Work with business and technical teams to understand data requirements and deliver robust solutions.


• Perform data modeling, data validation, and performance optimization.


• Monitor and troubleshoot data pipelines and resolve production issues.


• Implement data quality, security, and governance best practices.


• Participate in code reviews and contribute to technical design and architecture discussions.

Requirements

• 6+ years of experience in Data Engineering.


• Strong hands-on experience with Google Cloud Platform (GCP) .


• Strong programming experience in Python .


• Strong expertise in SQL , including complex queries, joins, CTEs, window functions, and query optimization.


• Experience developing ETL/ELT data pipelines .


• Hands-on experience with one or more GCP services such as: BigQuery


• Cloud Storage (GCS)


• Cloud Composer / Airflow


• Dataflow


• Pub/Sub


• Dataproc


• Experience with Apache Spark / PySpark is preferred.


• Good understanding of data warehousing, data modeling, and distributed data processing.


• Experience with Git and CI/CD practices.

Nice to Have

• Experience with Terraform or Infrastructure as Code.


• Exposure to GCP Dataform .


• Experience with real-time/streaming data pipelines.


• Knowledge of cloud security and IAM.


• Experience working in Agile environments.

All your information will be kept confidential according to EEO guidelines.