Gcp Data Engineer (Greater Noida)

Coforge Limited; Greater Noida; On-site; INR 1,000,000 - 1,600,000; Full time

Job summary

Corge Limited is seeking a Data Engineer (GCP) in India to design, develop, and optimize scalable data pipelines. You will leverage PySpark and Python to build robust ETL/ELT workflows across GCP services like BigQuery, Dataproc, Airflow, Pub/Sub, and Cloud Run.

You will implement Medallion Architecture (Bronze-Silver-Gold), ensure data quality, and collaborate with cross-functional teams to enable data-driven decisions. 4+ years of hands-on data engineering are expected.

Qualifications

• 4+ years of hands-on data engineering experience.
• Strong PySpark and Python skills.
• Advanced SQL and performance tuning.
• Proven experience building production-grade big data pipelines.
• Familiarity with modern data architectures and best practices.
• Hands-on GCP experience with BigQuery, Dataproc, Airflow, Pub/Sub, Cloud Run.
• Experience implementing Medallion Architecture (Bronze-Silver-Gold).

Responsibilities

• Design, develop, and maintain scalable data pipelines and ETL/ELT workflows.
• Build high-performance data processing solutions using PySpark and Python.
• Write complex SQL queries for large-scale datasets.
• Develop reusable data engineering frameworks and components.
• Implement data models aligned with Medallion Architecture.
• Work with GCP services (BigQuery, Dataproc, Airflow, Pub/Sub, Cloud Run).
• Ensure data quality, performance, and scalability across platforms.
• Collaborate with stakeholders to translate requirements into data solutions.
• Troubleshoot and optimize existing pipelines.

Skills

Data engineering

PySpark

Python

SQL optimization

GCP

Big data pipelines

Tools

BigQuery

Dataproc

Cloud Composer (Airflow)

Pub/Sub

Cloud Run

Medallion Architecture

Job description

Data Engineer (GCP)

About the Role

We are looking for a highly motivated and results-driven Data Engineerwho thrives on solving complex data challenges and building scalable, production-grade data platforms.

You will work closely with cross-functional teams to design, develop, and optimize modern data pipelines on Google Cloud Platform (GCP), enabling data-driven decision-making across the organization.

Key Responsibilities

• Design, develop, and maintain scalable, production-grade data pipelines and ETL/ELT workflows.
• Build high-performance data processing solutions using PySparkand Python.
• Write complex and optimized SQLqueries for large-scale datasets.
• Develop efficient, reliable, and reusable data engineering frameworks and components.
• Implement and maintain data models aligned with Medallion Architecture (Bronze, Silver, Gold)principles.
• Work with GCP services such as BigQuery, Dataproc, Cloud Composer (Airflow), Pub/Sub, and Cloud Run.
• Ensure data quality, performance, scalability, and operational excellence across data platforms.
• Collaborate with business and technical stakeholders to translate requirements into robust data solutions.
• Troubleshoot, optimize, and continuously improve existing data pipelines and workflows.

Required Skills & Qualifications

• 4+ years of hands-on experience in Data Engineering.
• Strong expertise in PySparkand Python.
• Advanced proficiency in SQLand query performance optimization.
• Proven experience building and supporting production-grade big data pipelines.
• Strong understanding of modern data architecture and data engineering best practices.
• Hands-on experience with Google Cloud Platform (GCP), particularly:
• BigQuery
• Dataproc
• Cloud Composer (Airflow)
• Pub/Sub
• Cloud Run
• Experience implementing Medallion Architecture (Bronze-Silver-Gold).