Senior Data Engineer

H&MV Engineering; Bengaluru; On-site; INR 900,000 - 1,500,000; Full time

Job summary

H&MV Engineering in Bengaluru, India, seeks a Senior Data Engineer to lead design, development, and optimization of our enterprise data platform, focusing on Azure-based architecture and data lake onboarding.

You will build scalable pipelines, enforce governance, and collaborate with reporting teams using Power BI and MS Fabric, mentoring junior engineers while driving cost-efficiency and architecture reviews.

Qualifications

• 10+ years of data engineering experience in enterprise settings.
• 5+ years hands-on with Microsoft Azure data services (Data Lake, Synapse, Data Factory).
• Proficient in Python, SQL, and Spark.
• Strong knowledge of data security, cost optimization, and governance.
• Experience with CI/CD in Azure.
• Excellent communication and documentation skills.
• Ability to lead cross-functional initiatives.

Responsibilities

• Design and implement scalable data pipelines in Azure Data Factory.
• Build Bronze/Silver/Gold data layers in the Azure Data Lake.
• Optimize ingestion from SAP, Excel, and third-party APIs.
• Enforce data quality, lineage, and retention policies with Governance.
• Implement monitoring and alerting for pipeline health and anomalies.
• Mentor junior engineers and support knowledge transfer.
• Collaborate with reporting teams using Power BI and MS Fabric.
• Evaluate Azure services and tools for performance and cost efficiency.
• Contribute to architectural decisions and Architecture Review Board.

Skills

Python

SQL

Spark

Azure Data Factory

Azure Synapse

Data Lake

Data Governance

Tools

Azure DevOps

MS Fabric

Job description

We are seeking a highly experienced Senior Data Engineer to lead the design, development, and optimization of our enterprise data infrastructure. This role is critical to accelerating our data lake onboarding, improving ingestion pipelines, and ensuring best practices across our Azure-based architecture.

Key Responsibilities:

• Design and implement scalable data pipelines using Azure Data Factory.
• Lead the build-out of Bronze/Silver/Gold data layers in our Azure Data Lake.
• Optimize ingestion from diverse sources including SAP, Excel, and third-party APIs.
• Collaborate with the Data Governance team to enforce data quality, lineage, and retention policies.
• Implement monitoring and alerting for pipeline health and data anomalies.
• Mentor junior engineers and support knowledge transfer to internal teams.
• Work closely with reporting teams using Power BI and MS Fabric to ensure seamless data access.
• Evaluate and integrate new Azure services and third-party tools to enhance performance and cost-efficiency.
• Contribute to architectural decisions and participate in the Architecture Review Board.

Required Qualifications:

• Minimum 10 years in data engineering roles.
• At least 5 years of hands-on experience with Microsoft Azure (Data Lake, Synapse, Data Factory, etc.).
• Proven track record in building enterprise-grade data solutions.
• Proficiency in Python, SQL, and Spark.
• Strong understanding of cloud security, access control models, and cost optimization.
• Experience with CI/CD pipelines and DevOps practices in Azure.
• Excellent communication and documentation abilities.
• Strong problem-solving and analytical mindset.
• Ability to work independently and lead cross-functional initiatives.

Preferred Qualifications:

• Experience with MS Fabric and Power Platform.

H&MV Engineering is an equal opportunity employer