GCP Data Engineer-Face To Face Hackathon on 10-Oct in Bangalore

HCL Technologies Limited; Bengaluru; Hybrid; INR 1.800.000 - 2.800.000; Vollzeit

Zusammenfassung

HCL Technologies Limited is seeking a GCP Data Engineer for on-site work in Bangalore. The role focuses on designing and building scalable data pipelines, warehousing with BigQuery, and implementing ELT/ETL workflows using DBT and other GCP services.

Immediate.Joining is preferred as a face-to-face hackathon context indicates a project kickoff. The candidate should have 4.5+ years of experience, strong SQL and data modeling skills, and the ability to collaborate with data stakeholders to deliver

Qualifikationen

• 4.5+ years of experience as a data engineer or similar role.
• Experience with Google Cloud Platform (GCP) data services and big data processing.
• Strong ability to design, build, and optimize scalable data pipelines and data warehousing solutions.
• Experience with ELT/ETL workflows and data transformation tooling.

Aufgaben

• Design, develop, and optimize scalable data pipelines using PySpark, Python, and GCP services.
• Develop and maintain data warehousing solutions using BigQuery.
• Build and manage ELT/ETL workflows using DBT (Data Build Tool).
• Implement large-scale batch and data processing solutions using Google Cloud Dataproc.
• Develop data transformation models, testing, and documentation using DBT best practices.
• Optimize BigQuery queries, partitioning, clustering, and cost management strategies.
• Collaborate with Data Architects, Data Analysts, and Business stakeholders to understand requirements and deliver solutions.
• Ensure data quality, governance, security, and compliance standards are met.
• Participate in code reviews, troubleshooting, performance tuning, and production support.

Kenntnisse

PySpark

Python

GCP

Tools

BigQuery

Cloud Storage (GCS)

Dataproc

DBT

Cloud Composer

Pub/Sub

Cloud Functions

Jobbeschreibung

Hi

We are conducting Face to Face Hackathon on 10-Oct in Bangalore.

GCP Data Engineer

Exp: 4.5+ Yrs

Job Location: Bangalore

Notice Period: Immediate to 2 Months

JD:

Key Responsibilities

• Design, develop, and optimize scalable data pipelines using PySpark, Python, and GCP services.
• Develop and maintain data warehousing solutions using BigQuery.
• Build and manage ELT/ETL workflows using DBT (Data Build Tool).
• Implement large-scale batch and data processing solutions using Google Cloud Dataproc.
• Develop data transformation models, testing, and documentation using DBT best practices.
• Optimize BigQuery queries, partitioning, clustering, and cost management strategies.
• Integrate data from multiple source systems into cloud-based data platforms.
• Collaborate with Data Architects, Data Analysts, and Business stakeholders to understand requirements and deliver solutions.
• Ensure data quality, governance, security, and compliance standards are met.
• Participate in code reviews, troubleshooting, performance tuning, and production support.

Required Skills

Google Cloud Platform (GCP)

• Strong hands-on experience with:
  • BigQuery
  • Cloud Storage (GCS)
  • Dataproc
  • Cloud Composer (Preferred)
  • Pub/Sub (Preferred)
  • Cloud Functions (Preferred)