GCP Data Engineer

Ascendion; Pune District; On-site; INR 800,000 - 1,200,000; Full time

Job summary

A tech company is seeking a Data Engineer to design and optimize scalable data pipelines on the GCP. The ideal candidate must have hands-on expertise with GCP, particularly BigQuery and Dataproc, along with a strong proficiency in SQL and Spark. Significant experience with data processing solutions and orchestration tools is required. This role is crucial for translating business requirements into robust data solutions while contributing to best practices and mentoring junior engineers. Location options include Pune, Gurgaon, or Bangalore.

Qualifications

• Hands-on expertise with GCP, especially BigQuery and Dataproc.
• Strong proficiency in SQL and Spark (PySpark/Scala).
• Experience with orchestration tools and pipeline automation.
• Knowledge of CI/CD, cloud monitoring, logging, and alerting.
• Understanding of data security, access controls, and cost optimization on GCP.

Responsibilities

• Design, build, and optimize scalable data pipelines on GCP.
• Develop and manage batch and large-scale data processing solutions using Dataproc (Spark).
• Architect and optimize BigQuery datasets, schemas, and queries for performance and cost.

Skills

GCP

BigQuery

Dataproc

SQL

Spark

Python

CI/CD

Data Security

Job description

Location Options – Pune / Gurgaon / Bangalore [ Manyata Tech Park, Nagavara]

Skill – GCP Ecosystem Data Flow, BigQuery, Data Engineer (Spark, DataProc), Python, SQL

JOB DESCRIPTION

Technical Skills

• Hands‑on expertise with GCP, especially BigQuery and Dataproc.
• Strong proficiency in SQL and Spark (PySpark/Scala).
• Experience with orchestration tools and pipeline automation.
• Knowledge of CI/CD, cloud monitoring, logging, and alerting.
• Understanding of data security, access controls, and cost optimization on GCP.
• Preferred: Experience with Composer, Dataflow, Pub/Sub, or similar services.
• Exposure to enterprise data platforms and large datasets.
• GCP Professional Data Engineer certification is a plus.

Key Responsibilities

• Design, build, and optimize scalable data pipelines on GCP.
• Develop and manage batch and large-scale data processing solutions using Dataproc (Spark).
• Architect and optimize BigQuery datasets, schemas, and queries for performance and cost.
• Implement data quality checks, monitoring, and performance tuning.
• Collaborate with business and analytics stakeholders to translate requirements into data solutions.
• Contribute to best practices, documentation, and mentoring junior engineers.