Data Engineer

Questhiring

Gurugram District

On-site

INR 1,400,000 - 2,400,000

Full time

33 hours ago
Be an early applicant

A complete application in a minute

Tailored resume and cover letter, ready to send.

Get past ATS filters

Job summary

Questhiring seeks a data engineer to design and maintain production-grade ETL/ELT pipelines on Google Cloud Platform. You will craft complex BigQuery SQL, using Dataform or dbt, and implement scalable data transformations in Python, Scala or Java.

You will build and optimize streaming and batch data pipelines with Dataflow/Apache Beam or Dataproc/Spark, and orchestrate workflows with Airflow, Dagster, or comparable tools. Strong data modeling, governance and quality practices are required.

Qualifications

  • 4+ years hands-on data engineering experience.
  • Experience designing scalable data pipelines on cloud platforms.

Responsibilities

  • Design, build and maintain production-grade ETL/ELT pipelines on GCP.
  • Develop complex transformations in BigQuery using SQL, Dataform/dbt.
  • Write clean Python (or Scala/Java) for data processing and testing.
  • Build and manage orchestrated workflows with Airflow or Cloud Composer.
  • Design data models, schemas and data contracts; ensure lineage and quality.

Skills

Data modeling
Analytical thinking
Problem solving
Collaboration
Independence

Tools

BigQuery
Dataform
dbt
Python
Scala/Java
Dataflow
Apache Beam
Dataproc
Spark
PySpark
Flink
Kafka
Airflow
Dagster
Git
CI/CD
Terraform
Iceberg

Job description

Design, build and maintain production-grade batch and incremental ETL/ELT pipelines on Google Cloud Platform, drawing on 4+ years of hands-on data engineering experience and designing solutions independently rather than only implementing predefined specifications.

Develop complex, well-optimised transformations in BigQuery using advanced SQL (complex joins, CTEs, window functions and query tuning) and Dataform and/or dbt, and tune queries and pipelines for both performance and cloud cost at large scale.

Write clean, tested Python (with Scala or Java as alternatives) for data processing, automation and testing, and build distributed processing solutions with Dataflow / Apache Beam or Dataproc / Spark / PySpark, using Flink or Kafka where streaming is needed.

Build and maintain orchestrated workflows with Cloud Composer / Apache Airflow (or comparable tools such as Dagster), and create reusable transformation components, libraries, templates and metadata- or configuration-driven patterns that other teams can adopt.

Design data models, applying normalisation, denormalisation and dimensional modelling, that serve analytical and downstream data-product needs, and define and maintain schemas and data contracts while managing schema evolution safely.

Implement incremental and idempotent processing patterns, along with automated data-quality validation, reconciliation, and metadata and lineage capture, so that data is trustworthy, auditable and discoverable.

Use Git, automated testing and CI/CD to ship changes safely, and build monitoring, alerting and operational controls (including runbooks and SLAs) for production pipelines.

Troubleshoot and support production pipelines, performing root-cause analysis and driving lasting fixes; apply data security, privacy and access-control practices appropriate to sensitive customer data.

Collaborate with Data Engineers, Platform Engineers, DevOps, Architects and business stakeholders to translate requirements into solutions, contribute to engineering standards and design reviews, and mentor junior engineers through code reviews and knowledge sharing.

What will be nice to have?
  • Experience with Apache Iceberg or other modern lakehouse table formats, and with streaming or event-driven processing, including Change Data Capture.
  • A practical understanding of data product and data mesh principles, including building reusable components used by multiple engineering teams.
  • Familiarity with Infrastructure as Code, such as Terraform, for provisioning and managing data platforms.
  • Experience with real-time feature stores and ML data pipelines, and with using AI-assisted tooling to improve data engineering productivity.
Why This Role?

Build digital products from scratch on modern, cloud-native infrastructure.

A real mandate to run lean and AI-first, not lip service, but how we actually operate.

Influence at both ends: hands-on enough to matter in the detail, senior enough to shape strategy.

A fast, agile culture where releases ship quickly and your judgment drives the roadmap.

WITH THE RIGHT TEAM, ANYTHING IS POSSIBLE.

If you're looking for an environment that's fun and friendly but incredibly fast-paced; a place where we measure the time between releases in days; a place where our focus begins and ends at the consumer, we'd love to have you!

Get your free, confidential resume review.

or drag and drop your file here.

Similar jobs

Similar jobs worth comparing

Data Engineer - II
Data Engineer - II

Deutsche Telekom Digital Labs • Gurugram District

On-site
INR 1,800,000 - 2,800,000
AI tools on us
Growth opportunities
Time to recharge
+3
Senior Data Engineer
Senior Data Engineer

Lifesight • Bengaluru

On-site
INR 2,800,000 - 4,200,000
Senior Data Engineer
Senior Data Engineer

Lifesight • Karnataka

Hybrid
INR 2,500,000 - 4,500,000
Senior Data Engineer
Senior Data Engineer

Ideas2IT Technologies • Chennai

Hybrid
INR 1,000,000 - 1,800,000
Data Engineer
Data Engineer

Supplymint • Gurugram District

On-site
INR 1,200,000 - 2,400,000
GCP Data Engineer
GCP Data Engineer

ValueLabs • Hyderabad

On-site
INR 1,200,000 - 1,800,000
Google Cloud Data Engineer
Google Cloud Data Engineer

Cloudnyx.ai • Pune District

On-site
INR 1,800,000 - 2,800,000
Data Engineer
Data Engineer

Valuenode Private Limited • India

Remote
INR 1,200,000 - 1,800,000
Senior Data Engineer
Senior Data Engineer

Creole Studios INC • Ahmedabad District

On-site
INR 900,000 - 1,500,000
Data Engineer ID56374
Data Engineer ID56374

AgileEngine, LLC. • Maharashtra

Hybrid
INR 1,500,000 - 2,000,000
Remote work & local connection
Legal presence in India
Competitive compensation in INR
+1