GCP - Data Engineer

Parkar Global Technologies; Pune District; On-site; INR 3,500,000 - 6,000,000; Full time

Job summary

Parkar Global Technologies seeks a Senior Data Engineer (GCP) to design, build, and optimize scalable data pipelines across batch and real-time workloads. You will implement ETL/ELT workflows, manage orchestration with Airflow, and ensure data quality and governance while collaborating with cross-functional teams.

The role requires strong data modeling, SQL optimization, and hands-on experience with Spark/PySpark, BigQuery, Dataflow, Pub/Sub, and Cloud Composer.

Qualifications

• 6-8 years of experience in data engineering.
• Strong hands-on experience with GCP (BigQuery, Dataflow, Pub/Sub, Cloud Storage).
• Experience with Spark / PySpark and SQL optimization.
• Hands-on with Cloud Composer (Airflow).
• Strong understanding of data modeling and pipeline design.
• Experience with batch + streaming data processing. Familiarity with CI/CD and Git-based workflows.
• Strong problem-solving and analytical skills.

Responsibilities

• Design, build, and optimize scalable batch and real-time data pipelines.
• Develop and maintain ETL/ELT workflows for diverse data sources.
• Build robust data ingestion frameworks and support data migration initiatives.
• Manage workflow orchestration, scheduling, and pipeline dependencies.
• Ensure efficient and reliable data processing across environments.
• Optimize query performance and data processing jobs.
• Implement data validation, quality, and reconciliation frameworks.
• Monitor pipelines to ensure availability, reliability, and performance.
• Collaborate with cross-functional teams to translate business requirements into solutions.
• Contribute to data architecture and design discussions.
• Follow best practices for version control, CI/CD, and deployments.
• Ensure compliance with security, governance, and data standards.
• Support production systems through troubleshooting and continuous improvement.

Skills

GCP BigQuery

Dataflow

Pub/Sub

Cloud Storage

Spark/PySpark

SQL optimization

Airflow (Cloud Composer)

Data modeling

Batch + streaming processing

CI/CD

Git workflows

Tools

Airflow

Job description

Role Overview

We are looking for a Senior Data Engineer (GCP) with strong hands-on experience in building and optimizing scalable data pipelines on Google Cloud Platform. This role requires deep technical expertise in data engineering, pipeline development, and cloud-native solutions, with the ability to work closely with cross-functional teams to deliver high-quality data systems.

Key Responsibilities

• Design, build, and optimize scalable batch and real-time data pipelines.
• Develop and maintain ETL/ELT workflows for diverse data sources.
• Build robust data ingestion frameworks and support data migration initiatives.
• Manage workflow orchestration, scheduling, and pipeline dependencies.
• Ensure efficient and reliable data processing across environments.
• Optimize query performance and data processing jobs.
• Implement data validation, quality, and reconciliation frameworks.
• Monitor pipelines to ensure availability, reliability, and performance.
• Collaborate with cross-functional teams to translate business requirements into solutions.
• Contribute to data architecture and design discussions.
• Follow best practices for version control, CI/CD, and deployments.
• Ensure compliance with security, governance, and data standards.
• Support production systems through troubleshooting and continuous improvement.

Must-Have Skills

• 6-8 years of experience in data engineering.
• Strong hands-on experience with GCP (BigQuery, Dataflow, Pub/Sub, Cloud Storage).
• Experience with Spark / PySpark and SQL optimization.
• Hands-on with Cloud Composer (Airflow).
• Strong understanding of data modeling and pipeline design.
• Experience with batch + streaming data processing.Familiarity with CI/CD and Git-based workflows.
• Strong problem-solving and analytical skills.