GCP Data Engineer : BigQuery / Dataflow / DBT / Python

Consult Asia; Chennai District, Bengaluru; On-site; INR 1,500,000 - 3,200,000; Full time

Job summary

Consult Asia in Chennai is seeking a Senior Data Engineer to design, build and support scalable GCP data pipelines using BigQuery, Dataflow, Pub/Sub, Python/PySpark and SQL.

You will develop batch and streaming solutions, troubleshoot production issues, and ensure deployments are scalable and reliable across our data platforms.

Qualifications

• 8–10 years of experience in GCP data engineering and scalable data pipelines.
• Hands-on experience with BigQuery, Dataflow, SQL and Python/PySpark.
• DBT and Pub/Sub expertise preferred for production-grade data platforms.

Responsibilities

• Design, build and support scalable GCP data pipelines using BigQuery, Dataflow, Pub/Sub, Python/PySpark and SQL.
• Develop batch and streaming solutions; troubleshoot production issues.
• Ensure deployments are scalable and reliable across data platforms.

Skills

GCP Data Engineering

BigQuery

Dataflow

Python/PySpark

SQL

Tools

DBT

Pub/Sub

Job description

Design, build and support scalable GCP data pipelines using BigQuery, Dataflow, Pub/Sub, Python/PySpark and SQL. Develop batch/streaming solutions, troubleshoot production issues and ensure scalable, reliable deployments.

Required Candidate profile

8–10 years' experience with strong GCP Data Engineering, BigQuery, Dataflow, SQL, Python/PySpark, DBT and Pub/Sub. Hands-on experience in scalable pipelines and production support preferred.