Lead - Azure Data Engineer (Snowflake, Fabric)

KPI Partners; Hyderabad, Pune District, Bengaluru; On-site; INR 900,000 - 1,300,000; Full time

Job summary

KPI Partners is seeking a skilled Lead Azure Data Engineer to join our Hyderabad team. The role focuses on building scalable data solutions on Azure, designing data models and pipelines, and ensuring data quality and availability.

You will mentor a team of data engineers, implement CI/CD practices, and collaborate with cross-functional teams to translate requirements into effective data architectures. Prior experience with Fabric is valued.

Qualifications

• Expertise in Microsoft Fabric, Lakehouse, and Medallion Architecture.
• Strong data modeling skills (dimensional modeling, star/snowflake schemas).
• Proficiency in SQL, Python, and PySpark.
• Hands-on experience with cloud platforms (Azure preferred, AWS or GCP accepted).
• Solid understanding of CI/CD pipelines, DevOps, and version control (Git).

Responsibilities

• Design, develop, and implement scalable data solutions on Azure with best practices.
• Collaborate with cross-functional teams to translate requirements into data models and pipelines.
• Optimize data workflows and enhance performance while ensuring data integrity.
• Lead and mentor a team of data engineers, guiding technical aspects and learning.
• Implement data governance and security practices in line with standards.

Skills

Azure

Microsoft Fabric

Lakehouse

Medallion Architecture

Data modeling

SQL

Python

PySpark

Cloud platforms

CI/CD

Git

Snowflake

Tools

AWS

GCP

Purview

Power BI

Tableau

Job description

KPI Partners is seeking a skilled and experienced Lead Azure Data Engineer to join our dynamic team. The ideal candidate will have a strong background in data engineering, with a focus on Azure technologies, and hands-on experience with Snowflake and Fabric platforms.

Key Responsibilities:

• Design, develop, and implement scalable data solutions on Azure, ensuring best practices in data architecture and engineering.
• Collaborate with cross-functional teams to gather requirements and translate them into effective data models and pipelines.
• Optimize data workflows and enhance performance of existing data solutions, ensuring data integrity and availability.
• Lead and mentor a team of data engineers, providing guidance on technical aspects and fostering a culture of continuous learning.
• Implement data governance and security practices, ensuring compliance with industry standards and regulations.
• Stay current with emerging technologies and trends in data engineering, and evaluate new tools and frameworks for potential adoption.

Must have:

• Expertise in Microsoft Fabric, Lakehouse, and Medallion Architecture
• Experience in data modeling (dimensional modeling, star schema, snowflake schema etc).
• Proficiency in SQL, Python, and PySpark.
• Hands-on experience with cloud platforms (Azure(preferred), AWS, or GCP).
• Solid understanding of CI/CD pipelines, DevOps, and version control (Git).

Good to have:

• Familiarity with BI tools (Power BI, Tableau etc.)
• Familiarity with data governance frameworks (Purview etc.)