Gcp Data Engineer

HCL Technologies Limited; Bengaluru, Mumbai, Chennai; On-site; INR 3,000,000 - 4,200,000; Full time

Job summary

HCL Technologies Limited is seeking an experienced Senior GCP Data Engineer with 7+ years of IT experience to design, develop, and optimize large-scale data pipelines on Google Cloud Platform. The role focuses on BigQuery, Python/PySpark, and modern data engineering tools to deliver data-driven solutions for analytics and reporting across multiple business domains.

You will implement DBT-based transformations, orchestrate workflows with Airflow, and enable batch and real-time processing using

Qualifications

• 7+ years of IT experience with strong Data Engineering expertise.
• Minimum 3+ years hands-on experience in Google Cloud Platform (GCP).
• Strong proficiency in SQL and Python/PySpark.
• Experience with large-scale structured and unstructured datasets.
• Understanding of Data Warehousing and Data Lake concepts.
• Hands-on experience with CI/CD, Git, and DevOps practices.
• Experience in Agile development methodologies.
• Excellent communication and stakeholder management skills.

Responsibilities

• Design, develop, and maintain scalable ETL/ELT pipelines on GCP.
• Build and optimize data solutions using BigQuery for analytics and reporting.
• Develop data transformation frameworks using DBT, Python, and PySpark.
• Orchestrate workflows using Airflow and automate data processing pipelines.
• Implement batch and real-time data processing using Dataflow and Dataproc.
• Collaborate with business stakeholders, architects, and analytics teams to deliver data-driven solutions.
• Monitor, troubleshoot, and optimize data pipelines for performance and reliability.
• Ensure data quality, governance, security, and compliance standards are followed.

Skills

Data engineering

ETL/ELT pipelines

CI/CD

Agile

Stakeholder management

Communication

Tools

Google BigQuery

DBT

Apache Airflow

Google Dataflow

Google Dataproc

Python

PySpark

Git

Terraform

Job description

Role: Senior GCP Data Engineer
Experience: 7+ Years
Location: Hyderabad / Chennai / Bangalore
Employment Type: Permanent

Job Summary

We are looking for an experienced GCP Data Engineer with 7+ years of experience in designing, developing, and optimizing large-scale data pipelines and cloud-native data solutions on Google Cloud Platform (GCP). The ideal candidate should possess strong expertise in BigQuery, SQL, Python/PySpark, and modern data engineering technologies.

Mandatory Skills

Option 1:

• Google BigQuery
• Advanced SQL
• Python / PySpark
• DBT (Data Build Tool)

OR

Option 2:

• Google BigQuery
• Advanced SQL
• Apache Airflow
• Google Dataflow
• Google Dataproc
• Python / PySpark

Key Responsibilities

• Design, develop, and maintain scalable ETL/ELT pipelines on GCP.
• Build and optimize data solutions using BigQuery for analytics and reporting.
• Develop data transformation frameworks using DBT, Python, and PySpark.
• Orchestrate workflows using Airflow and automate data processing pipelines.
• Implement batch and real-time data processing using Dataflow and Dataproc.
• Collaborate with business stakeholders, architects, and analytics teams to deliver data-driven solutions.
• Monitor, troubleshoot, and optimize data pipelines for performance and reliability.
• Ensure data quality, governance, security, and compliance standards are followed.

Required Qualifications

• 7+ years of overall IT experience with strong Data Engineering expertise.
• Minimum 3+ years of hands-on experience in Google Cloud Platform (GCP).
• Strong proficiency in SQL and Python/PySpark.
• Experience working with large-scale structured and unstructured datasets.
• Good understanding of Data Warehousing and Data Lake concepts.
• Hands-on experience with CI/CD, Git, and DevOps practices.
• Experience in Agile development methodologies.
• Excellent communication and stakeholder management skills.

Preferred Certifications

• Google Professional Data Engineer Certification
• Google Associate Cloud Engineer Certification

Notice Period

• Immediate Joiners preferred.
• Candidates serving up to 30 days notice period are highly preferred.

Good to Have

• GCP Migration Projects
• Data Modeling
• Streaming Data Pipelines
• Terraform / Infrastructure as Code
• Cloud Composer
• Looker / BI Reporting Tools