GCP Data Engineer

Dentsuaegis; Pune District; On-site; INR 1,500,000 - 2,800,000; Full time

Job summary

Merkle in Pune (DGS India) seeks a data engineer to design, build, and optimize scalable ETL/ELT pipelines on GCP, using Python for ingestion, orchestration, and transformation.

You will work with BigQuery, GCS, Cloud Functions, Cloud Run, Cloud Composer, Pub/Sub, Eventarc, and Dataform, ensuring data quality and governance while enabling real-time processing and scalable data infrastructure.

Qualifications

• Bachelor's or Master's degree in a relevant field.
• Strong Python coding skills for data ingestion and orchestration.
• Experience designing scalable ETL/ELT pipelines on GCP.
• Familiarity with data governance, quality, and security basics.
• Experience integrating external APIs and real-time data processing.

Responsibilities

• Design, build, and optimize scalable ETL/ELT data pipelines across GCP.
• Develop modular, object‑oriented Python applications for data ingestion, orchestration, and transformation.
• Architect, deploy, and maintain data solutions leveraging GCP services: BigQuery, GCS, Cloud Functions, Cloud Run, Cloud Composer, Pub/Sub, Eventarc, and DataForm.
• Integrate with external APIs to ingest datasets into BigQuery and other storage layers.
• Implement event-driven and real-time data processing architectures.
• Build and automate CI/CD workflows for deploying pipelines and services using Cloud Build.
• Ensure optimal performance, scalability, and cost efficiency of pipelines and data infrastructure.
• Establish and enforce data quality, governance, lineage, and security standards.
• Work closely with cross-functional teams to convert business needs into scalable data solutions.
• Maintain detailed technical documentation and contribute to engineering best practices.

Skills

ETL/ELT pipelines

Python

GCP

BigQuery

Data ingestion

Data orchestration

CI/CD

Data governance

Education

Bachelor's or Master's degree

Tools

BigQuery

GCS

Cloud Functions

Cloud Run

Cloud Composer

Pub/Sub

Eventarc

Dataform

Job description

Job Description:

Key Responsibilities

Design, build, and optimize scalable ETL/ELT data pipelines across GCP.

Develop modular, object‑oriented Python applications for data ingestion, orchestration, and transformation.

Architect, deploy, and maintain data solutions leveraging GCP services: BigQuery, GCS, Cloud Functions, Cloud Run, Cloud Composer, Pub/Sub, Eventarc, and DataForm.

Integrate with external APIs to ingest datasets into BigQuery and other storage layers.

Implement event-driven and real-time data processing architectures.

Build and automate CI/CD workflows for deploying pipelines and services using Cloud Build.

Ensure optimal performance, scalability, and cost efficiency of pipelines and data infrastructure.

Establish and enforce data quality, governance, lineage, and security standards.

Work closely with cross-functional teams to convert business needs into scalable data solutions.

Maintain detailed technical documentation and contribute to engineering best practices.

Education Qualification

Bachelor's or Master Degree or equivalent Degree

Certification If Any

1. 1. GCP Professional Data Engineer Certification.
2. 2. Snowflake Associate / Core

Shift timing

12 PM to 9 PM and / or 2 PM to 11 PM - IST time zone

Location:

DGS India - Pune - Indiqube Orchid

Brand:

Merkle

Time Type:

Full time

Contract Type:

Permanent