Senior Data Engineer

Minfy Technologies; Gurugram District; On-site; INR 1,500,000 - 2,200,000; Full time

Job summary

Minfy Technologies is looking for a Senior Azure Data Engineer in Gurugram, India, to design, develop, and optimize their enterprise-grade cloud data platform. You'll build scalable data pipelines, drive architectural decisions, and mentor junior engineers. The ideal candidate will have 8-10 years of IT experience with significant Azure focus, expert SQL and Python skills, and the ability to implement compliant data governance. Offers a dynamic work environment focusing on innovative cloud solutions.

Qualifications

• 8-10 years of IT experience in Data Engineering, with a minimum of 5 years focused on the Azure ecosystem.
• Strong experience mentoring junior staff and translating complex business requirements into technical roadmaps.
• Familiarity with CI/CD pipelines using Azure DevOps or GitHub Actions is advantageous.

Responsibilities

• Lead design, development, and optimization of the cloud data platform.
• Build scalable data pipelines for transforming raw data into insights.
• Drive architectural decisions and ensure data infrastructure aligns with standards.

Skills

Expert-level SQL

Python (PySpark, Pandas)

Data Mining

Data Analysis

Data Visualization

Data Interpretation

Microsoft Fabric

Azure Event Hubs

Stream Analytics

Spark Structured Streaming

Education

Bachelor’s or Master’s degree in Computer Science, Data Science, or related field

Job description

8-10 years of IT experience, with a minimum of 4-5 years specifically focused on Azure data Services.

Location: Gurugram

About the Role: We are seeking a highly skilled Senior Azure Data Engineer to lead the design, development, and optimization of our enterprise‑grade cloud data platform. You will be responsible for building scalable, resilient data pipelines that transform raw data from diverse sources into high‑quality, actionable insights. As a senior member of the team, you will drive architectural decisions, mentor junior engineers, and ensure our data infrastructure aligns with the latest industry standards for performance, security, and cost‑efficiency.

Key Responsibilities

Architecture & Design: Design end‑to‑end cloud data architectures using the Medallion (Bronze/Silver/Gold) architecture and Lakehouse patterns to support both batch and real‑time processing.

Data Integration (ETL/ELT): Build complex, metadata‑driven pipelines using Azure Data Factory (ADF) and Synapse Pipelines. Implement event‑based and tumbling window triggers for seamless ingestion.

Big Data Processing: Develop high‑performance data transformation logic using Azure Databricks and PySpark. Optimize Spark jobs through efficient partitioning, caching, and shuffle tuning.

Microsoft Fabric Implementation: Lead the transition or integration of existing workloads into Microsoft Fabric, leveraging OneLake, Dataflows Gen2, and Fabric Notebooks.

Data Modeling: Create robust dimensional models (Star/Snowflake schemas) within Azure Synapse SQL Pools and Fabric Data Warehouses to empower Power BI reporting.

Governance & Security: Implement strict RBAC, data masking, and encryption. Utilize Azure Purview for data lineage, cataloging, and compliance.

DevOps & Automation: Establish CI/CD pipelines using Azure DevOps or GitHub Actions for automated deployment of infrastructure (Terraform/Bicep) and code.

Performance Tuning: Monitor and optimize cloud spend and query performance across Synapse, Databricks, and Azure SQL databases.

Technical Requirements - Must‑Have Skills

Languages – Expert‑level SQL and Python (PySpark, Pandas).

Emerging Tech – Hands‑on experience with Microsoft Fabric and OneLake.

Streaming – Azure Event Hubs, Stream Analytics, or Spark Structured Streaming.

Qualifications

Experience: 8-10 years in Data Engineering, with at least 5+ years focused specifically on the Azure ecosystem.

Education: Bachelor’s or Master’s degree in Computer Science, Data Science, or a related field.

Certifications (Preferred): DP‑203 (Azure Data Engineer Associate) or Microsoft Certified: Fabric Analytics Engineer Associate.

Soft Skills: Strong ability to translate complex business requirements into technical roadmaps; experience mentoring junior staff.

Required Skills

• Data Mining
• Data Analysis
• Data Analysis and Visualization
• Data Interpretation