Lead Engineer – GCP Data Engineer

Prodapt

Chennai

Presencial

INR 1 200 000 - 2 400 000

Tempo integral

há 17 horas
Torna-te num dos primeiros candidatos

Recebe uma resposta deste empregador

O teu currículo e carta de apresentação, adaptados exatamente ao que estão a contratar.

Ultrapassa os filtros ATS

Resumo da oferta

Prodapt is seeking a skilled GCP Data Engineer to design and optimize scalable data pipelines on Google Cloud Platform. You will work with BigQuery for warehousing and analytics, and manage Dataproc-based workflows, ensuring data quality and governance.

Collaborate with data scientists, analysts, and stakeholders globally to deliver reliable data solutions while adhering to security and compliance standards.

Qualificações

  • Hands-on experience designing, building, and optimizing data pipelines on GCP.
  • Strong knowledge of BigQuery for data warehousing and analysis.
  • Experience with Dataproc and Spark/Hadoop ecosystems on GCP.

Responsabilidades

  • Design, develop, and maintain robust, scalable data pipelines on GCP.
  • Work with BigQuery for data warehousing, query optimization and large-scale analysis.
  • Build and manage workflows using Dataproc (Spark/Hadoop) and Airflow.

Conhecimentos

GCP
BigQuery
Dataproc
SQL
Cloud Composer
Apache Airflow
Troubleshooting
Data governance
Cross-functional collaboration
Security/compliance

Formação académica

Bachelor's/Master's in CS/IT/Engineering
GCP certification (Professional Data Engineer) is a plus

Ferramentas

Docker
Kubernetes
Terraform
Ab Initio

Descrição da oferta de emprego

Overview

We are looking for a skilled and detail-oriented

Overview

We are looking for a skilled and detail-oriented GCP Data Engineer to join our growing data engineering team. The ideal candidate will have hands‑on experience designing, building, and optimizing scalable data pipelines on Google Cloud Platform, along with strong problem‑solving and communication skills to collaborate effectively with cross‑functional and global stakeholders.

Responsibilities

Key Responsibilities

  • Design, develop, and maintain robust, scalable, and efficient data pipelines on Google Cloud Platform (GCP).
  • Work extensively with BigQuery (BQ) for data warehousing, query optimization, and large-scale data analysis.
  • Build and manage big data processing workflows using Dataproc (Hadoop/Spark ecosystem on GCP).
  • Write, optimize, and troubleshoot complex SQL queries for data transformation, validation, and reporting.
  • Design, schedule, and monitor data workflows using Cloud Composer (Apache Airflow).
  • Perform root‑cause analysis and troubleshooting of pipeline failures, data quality issues, and performance bottlenecks in production environments.
  • Collaborate with data analysts, data scientists, and business stakeholders to understand requirements and deliver reliable data solutions.
  • Ensure data governance, security, and compliance standards are followed across all GCP data engineering solutions.
  • Participate in code reviews, design discussions, and knowledge‑sharing sessions within the team.
  • Document technical designs, data flows, and operational runbooks for supportability.
Requirements

Required Technical Skills

SkillProficiency ExpectedGoogle Cloud Platform (GCP)Strong hands‑on experienceBigQuery (BQ)Query optimization, partitioning, clustering, cost managementDataprocSpark/Hadoop job design and managementSQLAdvanced query writing, performance tuningCloud Composer / Apache AirflowDAG design, scheduling, monitoringTroubleshootingStrong analytical and debugging skills for pipeline/data issues

Good To Have (Additional Skills)
  • Ab Initio - ETL development and pipeline migration experience.
  • DevOps - CI/CD pipelines, version control (Git), containerization (Docker/Kubernetes), infrastructure as code (Terraform) is a plus.
  • Prior Data/ETL Migration Experience - Hands‑on experience migrating data pipelines, ETL workloads, or on‑premise data warehouses to cloud platforms (e.g., on‑prem to GCP, or cross‑cloud migrations) is a strong value add.
Soft Skills
  • Excellent communication skills - ability to clearly articulate technical concepts to both technical and non-technical stakeholders.
  • Strong ownership mindset and ability to work independently as well as within a team.
  • Good stakeholder management skills, especially in a global/MNC delivery environment.
  • Ability to work under pressure and manage multiple priorities in a fast‑paced environment.
Qualifications
  • Bachelor's/Master's degree in Computer Science, Information Technology, Engineering, or a related field.
  • GCP certification (e.g., Professional Data Engineer) is a plus.
Obtém a tua avaliação gratuita e confidencial do currículo.

ou arrasta e larga o ficheiro aqui.

Similar jobs

Ofertas semelhantes que vale a pena comparar

DT - Lead Engineer
DT - Lead Engineer

Prodapt Solutions • Chennai

Presencial
INR 1 200 000 - 2 400 000
DT - Senior Software Engineer
DT - Senior Software Engineer

Prodapt Solutions • Chennai

Presencial
INR 1 200 000 - 1 800 000
DT - Technical Architect
DT - Technical Architect

Prodapt Solutions • Chennai

Presencial
INR 800 000 - 1 600 000
DT - Lead Engineer
DT - Lead Engineer

Prodapt • Chennai

Presencial
INR 1 200 000 - 1 800 000
DT - Senior Software Engineer
DT - Senior Software Engineer

Prodapt • Chennai

Presencial
INR 1 800 000 - 3 400 000
DT - Technical Architect
DT - Technical Architect

Prodapt • Chennai

Presencial
INR 1 100 000 - 1 700 000
GCP Data Engineer
GCP Data Engineer

Questhiring • Gurugram District

Presencial
INR 1 400 000 - 2 200 000
Data Engineer
Data Engineer

Blue Data Consulting And It Services • Surat

Presencial
INR 1 200 000 - 1 800 000
Data Engineer- Lead, Chennai
Data Engineer- Lead, Chennai

Prodapt Solutions • Chennai

Presencial
INR 1 200 000 - 2 500 000
Gcp Data Engineer
Gcp Data Engineer

Tata Elxsi, Inc. • Hyderabad, Chennai, Bengaluru

Presencial
INR 1 800 000 - 2 600 000