Associate Technical Architect (DE - GCP)

Dentsu Global Services; Pune District, Pimpri-Chinchwad; On-site; INR 3,500,000 - 6,500,000; Full time

Job summary

Merkle in Pune, India is seeking a highly skilled GCP Data Engineer who can design scalable data pipelines and cloud-native architectures. You will build ETL/ELT solutions on BigQuery, Pub/Sub, and Cloud Run, while applying solid software engineering and OOP fundamentals.

You will lead data workflows, integrate external APIs, and collaborate with cross-functional teams to meet business requirements, governance, and cost optimization.

Qualifications

• 10+ years of experience in data engineering or a related field.
• Strong Python programming skills with emphasis on OOP and modular design.
• Hands-on experience building scalable data pipelines on Google Cloud Platform.

Responsibilities

• Architect, design and build Cloud solutions using GCP.
• Design and implement modular Python applications for data ingestion and transformation.
• Build and maintain ETL/ELT pipelines using GCP services (BigQuery, Cloud Functions, Cloud Run, Cloud Composer, Dataform).
• Integrate with external APIs to load data into BigQuery.
• Develop event-driven architectures using Pub/Sub and Eventarc for real-time data streams.

Skills

Python OOP

GCP BigQuery

ETL pipelines

CI/CD

Data Modeling

Tools

BigQuery

Cloud Functions

Cloud Run

Cloud Composer

Dataform

Job description

The purpose of this role is to create solution architectures for systems and platforms ensuring all relevant options are explored for time, cost and compliance to the company’s standards, policies and practices whilst meeting the business’ requirements. The role will oversee the work of other architects and delivery of the solution for clients both internal and external, shepherding it through the relevant governance.

Job Description:

We are looking for a highly skilled GCP Data Engineer with strong programming fundamentals and cloud-native architecture experience. The candidate should have hands-on expertise in building scalable data pipelines on Google Cloud Platform, integrating external APIs, and applying software engineering principles to data workflows.

Business Title

Data Engineer - GCP

Years Of Experience

10+ Years

Key Responsibilities

• Architect, Design and build Cloud solutions using GCP.
• Design and implement modular, object-oriented Python applications for data ingestion and transformation.
• Strong Object-Oriented Programming skills. Proficient in designing and implementing scalable, maintainable data pipelines using core OOP principles such as encapsulation, inheritance, polymorphism, and abstraction. Experienced in building modular systems with well-defined class hierarchies, applying SOLID principles to ensure clean architecture and separation of concerns. Skilled in leveraging design patterns to solve complex problems and enhance code readability and testability.
• Build and maintain ETL/ELT pipelines using GCP services: BigQuery, Cloud Functions, Cloud Run, Cloud Composer, and DataForm.
• Integrate with external APIs to extract and load data into BigQuery.
• Develop event-driven architectures using Pub/Sub and Eventarc to trigger workflows and manage real-time data streams.
• Automate deployment and testing workflows using Cloud Build and CI/CD pipelines.
• Optimize performance and cost of data processing and storage across GCP services.
• Collaborate with cross-functional teams to translate business requirements into scalable data solutions.
• Ensure data security, governance, and compliance across all pipelines and storage layers.

Must Have Skills

• 10 years of experience in data engineering, with at least 4+ years on Google Cloud Platform.
• Strong proficiency in Python, including OOP principles, modular design, and clean coding standards.
• Hands-on with GCP services: BigQuery, Cloud Functions, Cloud Run, Cloud Build, Dataform, Pub/Sub, Eventarc, Cloud Storage, and Cloud Composer.
• Solid understanding of SQL, data modeling, and data warehousing concepts.
• Familiarity with CI/CD pipelines, Git-based workflows etc.
• Strong problem-solving skills and ability to work independently in a fast-paced environment.

Good To Have Skills

• UNIX shell scripting, SnowFlake, Reshift, Familiar with NoSQL such as MongoDB, etc
• ETL tool
• Experience in Cloud platforms - AWS / Azure
• Client-facing skills & Technical Team management
• Experience with CI/CD pipelines
• Requirement gathering

Location:

DGS India - Pune - Indiqube Orchid

Brand:

Merkle

Time Type:

Full time

Contract Type:

Permanent#DGS