Hiring For GCP Data Engineer For PAN India

HCLTech; Dadri, Chennai District, Bengaluru; On-site; INR 2,500,000 - 4,200,000; Full time

Job summary

HCLTech is seeking a skilled GCP Data Engineer to design, develop, and maintain scalable data pipelines on Google Cloud Platform. You will work with Dataflow, BigQuery, Dataproc and related tools to build robust ETL/ELT pipelines and optimize data workflows for analytics and reporting.

The ideal candidate will have 4+ years of data engineering experience, strong SQL and Python skills, and hands-on GCP expertise including Dataflow and BigQuery.

Qualifications

• ETL/ELT development
• Data Warehousing concepts
• Batch and Streaming Data Processing
• Data Modeling
• Data Quality and Governance

Responsibilities

• Design, develop, and maintain scalable batch and real-time data pipelines on GCP.
• Build and optimize ETL/ELT solutions using Google Cloud Dataflow (Apache Beam).
• Develop and manage large-scale data warehouses using BigQuery.
• Implement distributed data processing solutions using Dataproc (Apache Spark/Hadoop).
• Integrate data from multiple sources including databases, APIs, and cloud storage.
• Perform data modeling, partitioning, clustering, and query optimization in BigQuery.
• Ensure data quality, governance, security, and compliance standards are met.
• Monitor, troubleshoot, and optimize data pipelines for performance and reliability.
• Collaborate with data scientists, analysts, and business stakeholders to understand data requirements.
• Automate deployment and orchestration of data workflows using CI/CD practices.
• Support production operations and resolve data-related issues.

Job description

Job Summary

We are seeking a skilled GCP Data Engineer to design, develop, and maintain scalable data pipelines and data processing solutions on Google Cloud Platform (GCP). The ideal candidate should have hands-on experience with Dataflow, BigQuery, Dataproc, and cloud-based data engineering practices. The candidate will be responsible for building robust ETL/ELT pipelines, optimizing data workflows, and enabling analytics and reporting solutions.

Key Responsibilities

• Design, develop, and maintain scalable batch and real-time data pipelines on GCP.
• Build and optimize ETL/ELT solutions using Google Cloud Dataflow (Apache Beam).
• Develop and manage large-scale data warehouses using BigQuery.
• Implement distributed data processing solutions using Dataproc (Apache Spark/Hadoop).
• Integrate data from multiple sources including databases, APIs, and cloud storage.
• Perform data modeling, partitioning, clustering, and query optimization in BigQuery.
• Ensure data quality, governance, security, and compliance standards are met.
• Monitor, troubleshoot, and optimize data pipelines for performance and reliability.
• Collaborate with data scientists, analysts, and business stakeholders to understand data requirements.
• Automate deployment and orchestration of data workflows using CI/CD practices.
• Support production operations and resolve data-related issues.

Required Skills

GCP Services

• Google Cloud Platform (GCP)
• BigQuery
• Dataflow
• Dataproc
• Cloud Storage (GCS)
• Pub/Sub
• Cloud Composer (Airflow)
• Cloud Functions

Data Engineering

• ETL/ELT development
• Data Warehousing concepts
• Batch and Streaming Data Processing
• Data Modeling
• Data Quality and Governance

Programming

• Python (preferred)
• SQL (advanced)
• PySpark
• Shell Scripting

Big Data Technologies

• Apache Spark
• Hadoop Ecosystem
• Apache Beam

Required Qualifications

• Bachelor's or Master's degree in Computer Science, Information Technology, or related field.
• 4+ years of experience in Data Engineering.
• 2+ years of hands-on experience with Google Cloud Platform.
• Strong expertise in BigQuery query optimization and performance tuning.
• Experience building scalable pipelines using Dataflow and Apache Beam.
• Experience with Dataproc and Spark-based processing frameworks.
• Strong SQL and Python programming skills.
• Experience with source control systems such as Git.

Preferred Qualifications

• GCP Professional Data Engineer Certification.
• Experience with Terraform or Infrastructure as Code (IaC).
• Knowledge of Kafka or Pub/Sub messaging systems.
• Experience working in Agile/Scrum environments.
• Exposure to DevOps and CI/CD tools.

Nice to Have

• Experience with Looker, Tableau, or Power BI.
• Knowledge of data governance and metadata management tools.
• Experience with machine learning data pipelines on GCP.

Interview Must-Have Skills

• GCP Data Engineering
• BigQuery
• Dataflow (Apache Beam)
• Dataproc (Spark)
• Python
• Advanced SQL
• ETL/ELT Design
• Data Warehousing

Keywords: GCP, Google Cloud Platform, BigQuery, Dataflow, Dataproc, Apache Beam, Spark, PySpark, SQL, Python, ETL, ELT, Data Lake, Data Warehouse, Cloud Composer, Pub/Sub, GCS, Data Engineering.Role & responsibilities