Lead Data Engineer, Azure

Jobtailor; Bengaluru; On-site; INR 3,200,000 - 5,200,000; Full time

Job summary

Jobtailor in Bengaluru seeks an experienced Senior Data Engineer to design and optimize cloud-based data pipelines using Azure Data Factory, Snowflake, and DBT. You will work with cross-functional teams to deliver scalable data solutions.

The role requires 8+ years in data engineering with strong SQL, Python/PySpark, and CI/CD for data workflows. You will ensure data quality, governance, and documentation in a cloud-native environment.

Qualifications

• 8+ years of experience in data engineering roles using Azure and Snowflake.
• Strong experience with Azure Cloud Platform services and ADF.
• Proficiency in SQL for data analysis and transformation.
• Hands-on experience with Snowflake and SnowSQL.
• Practical knowledge of DBT for transforming data in the warehouse.
• Experience with cloud-based data environments and large-scale datasets.
• Familiarity with Python or PySpark for data transformations.
• Understanding of CI/CD pipelines and DevOps for data workflows.
• Exposure to data governance, metadata management, or data catalog tools.
• Knowledge of BI tools like Power BI or Tableau is a plus.
• Bachelor’s or Master’s degree in related field.
• 8+ years experience in data engineering roles.

Responsibilities

• Design and develop ETL/ELT pipelines using Azure Data Factory, Snowflake, and DBT.
• Build and maintain data integration workflows from various data sources to Snowflake.
• Write efficient and optimized SQL queries for data extraction and transformation.
• Work with stakeholders to understand business requirements and translate them into technical solutions.
• Monitor, troubleshoot, and optimize data pipelines for performance and reliability.
• Maintain and enforce data quality, governance, and documentation standards.
• Collaborate with data analysts, architects, and DevOps teams in a cloud-native environment.

Skills

Azure Data Factory

SQL

Snowflake

DBT

Python

PySpark

CI/CD Pipelines

Data Governance

Education

Bachelor’s or Master’s degree in Computer Science, Data Engineering, Information Systems, or a related field

Tools

SnowSQL

DataStage

Netezza

Azure Data Lake

Azure Synapse

Azure Functions

Power BI

Tableau

Job description

Responsibilities

• Design and develop ETL/ELT pipelines using Azure Data Factory, Snowflake, and DBT
• Build and maintain data integration workflows from various data sources to Snowflake
• Write efficient and optimized SQL queries for data extraction and transformation
• Work with stakeholders to understand business requirements and translate them into technical solutions
• Monitor, troubleshoot, and optimize data pipelines for performance and reliability
• Maintain and enforce data quality, governance, and documentation standards
• Collaborate with data analysts, architects, and DevOps teams in a cloud-native environment

Requirements

• Strong experience with Azure Cloud Platform services
• Proven expertise in Azure Data Factory (ADF) for orchestrating and automating data pipelines
• Proficiency in SQL for data analysis and transformation
• Hands-on experience with Snowflake and SnowSQL for data warehousing
• Practical knowledge of DBT (Data Build Tool) for transforming data in the warehouse
• Experience working in cloud-based data environments with large-scale datasets
• Experience with DataStage, Netezza, Azure Data Lake, Azure Synapse, or Azure Functions
• Familiarity with Python or PySpark for custom data transformations
• Understanding of CI/CD pipelines and DevOps for data workflows
• Exposure to data governance, metadata management, or data catalog tools
• Knowledge of business intelligence tools such as Power BI or Tableau is a plus
• Bachelor’s or Master’s degree in Computer Science, Data Engineering, Information Systems, or a related field
• 8+ years of experience in data engineering roles using Azure and Snowflake
• Strong problem-solving, communication, and collaboration skills

Core Competencies

Demonstrates expertise in designing and developing ETL/ELT pipelines using Azure Data Factory, Snowflake, and DBT, while ensuring data quality and governance. Proficient in SQL and experienced in collaborating with cross-functional teams to deliver technical solutions in cloud-native environments.

Highest-signal resume keywords

• Azure Data Factory
• SQL Proficiency
• Snowflake Expertise
• DBT Knowledge
• Data Governance

Hard Skills

• ETL Development
• Data Integration Workflows
• SQL Queries
• Data Transformation
• Data Quality Standards
• Data Pipeline Optimization
• Cloud-Based Data Environments
• Python
• PySpark
• CI/CD Pipelines

Soft Skills

• Problem-Solving
• Communication
• Collaboration

Industry Keywords

• Data Engineering
• Data Warehousing
• Data Governance
• Metadata Management
• Data Catalog Tools

Tools & Technologies

• Azure Cloud Platform
• SnowSQL
• DataStage
• Netezza
• Azure Data Lake
• Azure Synapse
• Azure Functions
• Power BI
• Tableau