Senior Data Engineer

Recruito; India; Remote; INR 1,700,000 - 2,600,000; Full time

Job summary

Recruito is seeking a seasoned Data Engineer to build scalable data platforms on Google Cloud Platform. You will design pipelines, optimize transformations with BigQuery and SQL, and develop reusable data-processing frameworks.

You will lead reviews and shape technical decisions while owning end-to-end delivery from design to production support. The role requires hands-on experience with GCP, BigQuery, Dataflow/Beam/Spark, and data modeling, with a focus on batch, incremental, and streaming

Qualifications

• Enterprise-scale data platform experience.
• Hands-on with GCP and BigQuery.
• Strong SQL and Python skills.
• Experience with Dataform/dbt and Airflow.
• Experience with Dataflow/Beam/Spark.
• Understanding of batch, incremental, and streaming processing.
• Knowledge of data contracts and schema management.
• Experience with CI/CD and Git.

Responsibilities

• Design scalable data platforms and pipelines on GCP.
• Build batch, incremental, and streaming data pipelines.
• Develop transformations using BigQuery, SQL, Dataform/dbt.
• Create reusable, metadata-driven data-processing frameworks.
• Develop distributed processing with Dataflow/Beam/Spark.
• Define data models, schemas, and data quality standards.
• Optimize performance, reliability, and cloud costs.
• Lead code reviews and guide engineers on decisions.
• Own solutions from design to deployment and production support.

Skills

Advanced SQL

Python

Data modeling

Problem-solving

Architectural decision-making

Tools

GCP

BigQuery

Dataform/dbt

Airflow/Cloud Composer

Dataflow/Beam/Spark

Dataproc/Spark

Job description

Responsibilities

• Design scalable data platforms and pipelines on GCP.
• Build batch, incremental, and streaming data pipelines.
• Develop and optimize transformations using BigQuery, SQL, and Dataform/dbt.
• Build reusable, metadata-driven data-processing frameworks.
• Develop distributed processing solutions using Dataflow, Beam, and Spark.
• Define data models, schemas, and data quality standards.
• Optimize performance, reliability, and cloud costs.
• Lead code reviews and guide engineers on technical decisions.
• Own solutions from design through deployment and production support.

Requirements

• Experience building enterprise-scale data platforms.
• Strong hands-on experience with GCP and BigQuery.
• Advanced SQL and Python skills.
• Experience with Dataform/dbt and Cloud Composer/Apache Airflow.
• Hands-on experience with Dataflow/Apache Beam and Dataproc/Spark.
• Strong understanding of batch, incremental, and streaming processing.
• Experience building reusable, metadata-driven frameworks.
• Expertise in data modeling, data contracts, and schema management.
• Knowledge of data quality, lineage, monitoring, and observability.
• Experience with Git, automated testing, and CI/CD.
• Strong architectural decision-making and problem-solving skills.