GCP Data Engineer

Dentsu Global Services; Pune District; On-site; INR 1,500,000 - 1,900,000; Full time

Job summary

Merkle in Pune, India is seeking a Senior Data Engineer to design, build, and optimize scalable data pipelines on Google Cloud Platform. You will develop modular Python applications for ingestion, orchestration, and transformation, and maintain data solutions using BigQuery, GCS, Cloud Functions, Cloud Run, and more.

You will ensure data quality, governance, and security while collaborating with cross-functional teams to meet business needs and maintain detailed technical documentation.

Qualifications

• Design and optimize scalable ETL/ELT pipelines on GCP.
• Develop Python applications for data ingestion, orchestration, and transformation.
• Ensure data quality, governance, lineage, and security standards.
• Collaborate with cross-functional teams to translate business needs into scalable data solutions.

Responsibilities

• Design, build, and optimize scalable ETL/ELT pipelines across GCP.
• Develop modular Python applications for data ingestion, orchestration, and transformation.
• Architect and maintain data solutions leveraging GCP services: BigQuery, GCS, Cloud Functions, Cloud Run, Cloud Composer, Pub/Sub, Eventarc, DataForm.

Skills

ETL/ELT pipelines

Python

GCP services

CI/CD

Data governance

Documentation

Education

Bachelor's or Master's degree

Tools

BigQuery

GCS

Cloud Functions

Cloud Run

Cloud Composer

Pub/Sub

Eventarc

DataForm

Snowflake

Job description

Key Responsibilities

• Design, build, and optimize scalable ETL/ELT data pipelines across GCP.
• Develop modular, object-oriented Python applications for data ingestion, orchestration, and transformation.
• Architect, deploy, and maintain data solutions leveraging GCP services: BigQuery, GCS, Cloud Functions, Cloud Run, Cloud Composer, Pub/Sub, Eventarc, and DataForm.
• Integrate with external APIs to ingest datasets into BigQuery and other storage layers.
• Implement event-driven and real-time data processing architectures.
• Build and automate CI/CD workflows for deploying pipelines and services using Cloud Build.
• Ensure optimal performance, scalability, and cost efficiency of pipelines and data infrastructure.
• Establish and enforce data quality, governance, lineage, and security standards.
• Work closely with cross-functional teams to convert business needs into scalable data solutions.
• Maintain detailed technical documentation and contribute to engineering best practices.

Education Qualification

Bachelor's or Master Degree or equivalent Degree

Certification If Any

• GCP Professional Data Engineer Certification.
• Snowflake Associate / Core

Shift timing

12 PM to 9 PM and / or 2 PM to 11 PM - IST time zone

Location

DGS India - Pune - Indiqube Orchid

Brand

Merkle

Time Type

Full time

Contract Type

Permanent#DGS