Data Engineer

Randomtrees; Hyderabad; On-site; INR 2,600,000 - 4,200,000; Full time

Job summary

Randomtrees is seeking a Senior Data Engineer with 5+ years of experience to design, build, and optimize scalable ELT/ETL pipelines across our data stack. You will own ingestion, data modeling, orchestration, and performance tuning in Snowflake and cloud storage.

You will build batch and streaming ingestion pipelines with PySpark or Python, design star/snowflake models in Snowflake using dbt, and maintain Airflow DAGs with automated alerts.

Qualifications

• 5+ years of hands-on data engineering in production environments.
• Expert SQL, Python, and distributed processing with PySpark.
• Modern Data Stack with Snowflake, dbt (incremental models, macros), and Airflow.
• Cloud & DevOps experience with AWS, GCP, or Azure, plus Docker, Git, and CI/CD pipelines.
• Solid understanding of data modeling, performance profiling, and cost governance.

Responsibilities

• Build robust batch and streaming ingestion pipelines using PySpark or Python.
• Design modular, tested dimensional models (star/snowflake) in Snowflake using dbt.
• Develop, schedule, and maintain Apache Airflow DAGs and automated alerts.
• Optimize Snowflake performance, query execution, clustering, and compute costs.
• Implement automated data quality checks, CI/CD deployment pipelines, and Git best practices.

Skills

SQL

Python

PySpark

Snowflake

dbt

Airflow

AWS

GCP

Azure

Docker

Git

CI/CD

Data modeling

Performance profiling

Cost governance

Tools

dbt

Airflow

Snowflake

PySpark

Python

Docker

Git

Job description

We are looking for a Senior Data Engineer with 5+ years of experience to design, build, and optimize scalable ELT/ETL pipelines across our modern data stack. You will own ingestion, data modeling, orchestration, and performance tuning across Snowflake and cloud storage.

Key Responsibilities

• Build robust batch and streaming ingestion pipelines using PySpark or Python.


• Design modular, tested dimensional models (star/snowflake schemas) in Snowflake using dbt.


• Develop, schedule, and maintain enterprise Apache Airflow DAGs and automated alerts.


• Optimize Snowflake performance, query execution, clustering, and compute costs.


• Implement automated data quality checks, CI/CD deployment pipelines, and Git best practices.

Requirements

• Experience: 5+ years of hands-on data engineering in production environments.


• Core Skills: Expert SQL, advanced Python, and distributed processing with PySpark.


• Modern Data Stack: Strong production experience with Snowflake, dbt (incremental models, macros), and Airflow.


• Cloud & DevOps: Hands-on experience with AWS, GCP, or Azure, plus Docker, Git, and CI/CD pipelines.


• Architecture: Solid understanding of data modeling, performance profiling, and cost governance.