Data Engineer

Torry Harris Business Solutions; Bengaluru; On-site; INR 1,800,000 - 3,200,000; Full time

Job summary

Torry Harris Business Solutions in Bengaluru seeks a Senior Data Engineer to own end-to-end data pipelines using Apache Airflow and DBT, delivering high-performance transformations.

You will design scalable ETL/ELT frameworks, optimize SQL models, and collaborate with Data/Product/Analytics teams to ensure data quality, reliability, and timely insights.

Experience with AWS/Azure data services and cloud data warehouses is preferred.

Qualifications

• Experience designing and building scalable data pipelines and transformation layers.
• Proficient in SQL scripting, data modeling, and data warehouse concepts.
• Hands-on experience with cloud data services (AWS/Azure) and modern ELT frameworks.

Responsibilities

• Design, develop, and maintain production-grade data pipelines using Apache Airflow.
• Build scalable and maintainable data transformation layers using DBT.
• Develop and optimize complex SQL transformations and data models.
• Own end-to-end ELT workflows including ingestion, transformation, and serving layers.
• Ensure data quality, reliability, and performance through testing and monitoring frameworks.
• Collaborate with Data, Product, Analytics teams to deliver data solutions.
• Implement code best practices, modular design, and reusable components.
• Manage deployment pipelines (CI/CD) and version control.
• Troubleshoot and resolve production issues with minimal downtime.
• Contribute to architecture decisions and platform improvements.
• Guide and support junior/mid-level developers when required.

Skills

SQL

Python

Data warehousing

Dimensional modeling

AWS

Azure

Snowflake

BigQuery

Redshift

Github Actions

Git

Tools

DBT

Apache Airflow

Job description

Job Description

We are looking for a highly skilled Senior Data Engineer / Senior Developer with expertise in DBT and Apache Airflow to build scalable, high-performance data pipelines and transformation frameworks. The role involves end-to-end ownership of data workflows, ensuring reliability, performance, and data quality while collaborating with cross-functional teams.

Roles & Responsibilities

Key Responsibilities

• Design, develop, and maintain robust, production-grade data pipelines using Apache Airflow
• Build scalable and maintainable data transformation layers using DBT
• Develop and optimize complex SQL transformations and data models
• Own end-to-end ELT workflows, including ingestion, transformation, and serving layers
• Ensure data quality, reliability, and performance through testing and monitoring frameworks
• Collaborate with cross-functional teams (Data, Product, Analytics) to deliver data solutions
• Implement code best practices, modular design, and reusable components
• Manage deployment pipelines (CI/CD) and version control
• Troubleshoot and resolve production issues with minimal downtime
• Contribute to architecture decisions and platform improvements
• Guide and support junior/mid-level developers when required.

Mandatory Skills

DBT, Apache Airflow, SQL, DAGs, Python, data warehousing, dimensional modeling, AWS, Azure, Snowflake, BigQuery, Redshift, Github Actions, GIT

Desirable Skills

data lakes, data quality, Kafka, Spark, Terraform, Power BI, Tableau