Data Engineer

Nitor; Pune District; Hybrid; INR 3,000,000 - 5,500,000; Full time

Job summary

Nitor is seeking a Senior Data Engineer in Pune to design, develop, and maintain scalable data pipelines and platforms. You will work with Airflow, DBT, SQL, and Python, with exposure to Snowflake and cloud platforms (AWS/Azure/GCP) as a plus.

Collaboration with data architects and business stakeholders is essential to deliver reliable analytics-ready data solutions. The role involves building robust data models, optimizing performance, and ensuring high availability of data pipelines in a

Qualifications

• 5+ years of experience in Data Engineering.
• Hands-on experience with Apache Airflow.
• Experience with DBT and SQL.
• Strong programming in Python.

Responsibilities

• Design, develop, and maintain scalable ETL/ELT data pipelines.
• Build and optimize data models and transformation workflows using DBT.
• Develop, schedule, monitor, and troubleshoot workflow orchestration using Apache Airflow.
• Write efficient and optimized SQL queries for large-scale data processing and reporting.
• Implement best practices for data quality, testing, monitoring, and performance optimization.
• Collaborate with cross-functional teams to understand data requirements and deliver robust solutions.
• Develop and maintain data warehouse and data lake solutions.
• Support CI/CD processes and deployment automation for data engineering workflows.
• Work with cloud-based data platforms and modern data stack technologies.
• Troubleshoot production issues and ensure high availability of data pipelines.

Skills

Airflow

DBT

SQL

Python

ETL/ELT pipelines

Data warehousing concepts

Git

Education

Bachelor's or Master's in CS/IT/Engineering

Tools

Snowflake

AWS

Azure

GCP

Job description

We are looking for a highly skilled Senior Data Engineer with 5+ years of experience in designing, developing, and maintaining scalable data pipelines and data platforms. The ideal candidate should have strong expertise in Apache Airflow, DBT, SQL, and Python, with exposure to Snowflake and cloud platforms (AWS/Azure/GCP) being a plus.

The candidate will work closely with data architects, analysts, and business stakeholders to build reliable, high-performance data solutions that support analytics and business intelligence needs.

Key Responsibilities

• Design, develop, and maintain scalable ETL/ELT data pipelines using Python, SQL, Airflow, and DBT.
• Build and optimize data models and transformation workflows using DBT.
• Develop, schedule, monitor, and troubleshoot workflow orchestration using Apache Airflow.
• Write efficient and optimized SQL queries for large-scale data processing and reporting.
• Implement best practices for data quality, testing, monitoring, and performance optimization.
• Collaborate with cross-functional teams to understand data requirements and deliver robust solutions.
• Develop and maintain data warehouse and data lake solutions.
• Support CI/CD processes and deployment automation for data engineering workflows.
• Work with cloud-based data platforms and modern data stack technologies.
• Troubleshoot production issues and ensure high availability of data pipelines.

Required Skills

• 5+ years of experience in Data Engineering.
• Strong hands-on experience with Apache Airflow.
• Strong experience with DBT (Data Build Tool).
• Advanced SQL skills, including:
• Complex joins
• CTEs
• Window functions
• Query optimization
• Performance tuning
• Strong programming experience in Python.
• Experience designing and implementing ETL/ELT pipelines.
• Understanding of data warehousing concepts and dimensional modeling.
• Experience with Git and version control systems.

Good to Have

• Hands-on experience with Snowflake.
• Experience with cloud platforms (AWS, Azure, or GCP).
• Knowledge of containerization tools such as Docker.
• Experience with CI/CD pipelines and DevOps practices.
• Exposure to Big Data technologies and modern data architectures.

Preferred Qualifications

• Bachelor's or Master's degree in Computer Science, Information Technology, Engineering, or a related field.
• Strong analytical and problem-solving skills.
• Excellent communication and stakeholder management abilities.
• Experience working in Agile/Scrum environments.