Senior Data Engineer

de facto Infotech; Mohali; On-site; INR 3,500,000 - 6,000,000; Full time

Job summary

de facto Infotech is seeking a Senior Data Engineer to design and deliver scalable data platforms, analytics solutions, and AI-ready data products using modern cloud technologies.

You will work across data engineering, analytics, BI, and AI initiatives, collaborating with stakeholders and engineering teams to turn complex data into trusted insights. The role emphasizes Azure and Fabric, governance, and scalable cloud data solutions.

Qualifications

• 8–10 years of experience in data engineering, analytics, BI, or related data disciplines.
• Hands-on experience with Azure Data Factory, Azure Databricks, and/or Microsoft Fabric.
• Strong knowledge of Azure Data Lake, OneLake, Delta Lake, lakehouse, and data warehouse architectures.
• Advanced SQL skills, including query optimization, partitioning, indexing, and performance tuning.
• Strong programming with Python and PySpark; Scala is a plus.
• Experience with Power BI or other BI platforms and translating requirements into analytics.
• Experience with Git, Azure DevOps, CI/CD, and production data pipelines.

Responsibilities

• Design and develop enterprise-scale data pipelines and ETL/ELT solutions using Azure Data Factory, Azure Databricks, and Microsoft Fabric.
• Build scalable lakehouse and data warehouse solutions using ADLS, OneLake, Delta Lake, Synapse.
• Develop high-performance data processing solutions using SQL, Python, and PySpark.
• Design data models, dimensional schemas, analytical datasets, and semantic models for enterprise reporting and analytics.
• Build and optimize batch and near-real-time data pipelines, including API, event-driven, and streaming integrations where required.
• Establish robust practices for data quality, validation, reconciliation, governance, metadata, lineage, security, and compliance.
• Implement Git-based development, CI/CD, automated deployments, monitoring, and operational support for data solutions.
• Analyze complex datasets, define KPIs, and deliver actionable insights through Power BI and other BI platforms.
• Partner with business stakeholders to translate requirements into scalable data and analytics solutions.
• Support AI/ML and Generative AI initiatives by developing trusted, governed, and AI-ready data foundations.
• Lead data modernization and cloud transformation initiatives, including migration from legacy platforms to Azure/Fabric.
• Troubleshoot and optimize data pipelines, queries, Spark workloads, storage, and cloud costs.
• Provide technical guidance and mentorship to data engineers and analysts while driving engineering best practices.

Skills

Strong communication

Stakeholder management

Problem-solving

Technical leadership

Tools

Azure Data Factory

Azure Databricks

Microsoft Fabric

Azure Data Lake

OneLake

Delta Lake

Synapse

Power BI

Git

Azure DevOps

Job description

We are looking for a Senior Data Engineer to design and deliver scalable data platforms, analytics solutions, and AI-ready data products using modern cloud technologies.

The role combines data engineering, analytics, business intelligence, and technical leadership, with a strong focus on Microsoft Azure and Microsoft Fabric. You will work closely with business stakeholders, architects, data scientists, and engineering teams to turn complex data into trusted insights and scalable data solutions.

Responsibilities

• Design and develop enterprise-scale data pipelines and ETL/ELT solutions using Azure Data Factory, Azure Databricks, and Microsoft Fabric.
• Build scalable lakehouse and data warehouse solutions using ADLS, OneLake, Delta Lake, Synapse, and related technologies.
• Develop high-performance data processing solutions using SQL, Python, and PySpark.
• Design data models, dimensional schemas, analytical datasets, and semantic models for enterprise reporting and analytics.
• Build and optimize batch and near-real-time data pipelines, including API, event-driven, and streaming integrations where required.
• Establish robust practices for data quality, validation, reconciliation, governance, metadata, lineage, security, and compliance.
• Implement Git-based development, CI/CD, automated deployments, monitoring, and operational support for data solutions.
• Analyze complex datasets, define KPIs, and deliver actionable insights through Power BI and other BI platforms.
• Partner with business stakeholders to translate requirements into scalable data and analytics solutions.
• Support AI/ML and Generative AI initiatives by developing trusted, governed, and AI-ready data foundations.
• Lead data modernization and cloud transformation initiatives, including migration from legacy platforms to Azure/Fabric.
• Troubleshoot and optimize data pipelines, queries, Spark workloads, storage, and cloud costs.
• Provide technical guidance and mentorship to data engineers and analysts while driving engineering best practices.

Required Qualifications

• 8–10 years of experience in data engineering, analytics, BI, or related data disciplines.
• Strong hands-on experience with Azure Data Factory, Azure Databricks, and/or Microsoft Fabric.
• Strong knowledge of Azure Data Lake, OneLake, Delta Lake, lakehouse, and data warehouse architectures.
• Advanced SQL skills, including query optimization, partitioning, indexing, and performance tuning.
• Strong programming experience with Python and PySpark; Scala is a plus.
• Strong understanding of data modeling, dimensional modeling, ETL/ELT, orchestration, and data architecture.
• Experience with Power BI or equivalent BI platforms and the ability to translate business requirements into analytical solutions.
• Experience with Git, Azure DevOps, CI/CD, and production data pipeline practices.
• Understanding of data governance, quality, security, metadata, lineage, and compliance.
• Experience with cloud data platforms and distributed processing technologies such as Databricks, Spark, Snowflake, Synapse, Kafka, or equivalent.
• Strong communication, stakeholder management, problem-solving, and technical leadership skills.

Preferred Qualifications

• Experience with Microsoft Fabric, OneLake, Fabric Data Factory, and Power BI.
• Exposure to real-time data processing, Event Hubs, Service Bus, APIs, or event-driven architectures.
• Experience with Terraform, Bicep, or other Infrastructure-as-Code technologies.
• Experience supporting AI/ML, Generative AI, or advanced analytics initiatives.
• Experience with enterprise data governance, cataloging, lineage, and master data management.
• Relevant Azure, Fabric, Databricks, Snowflake, or other cloud data certifications.
• Experience working in Agile/Scrum and global delivery environments.

What You'll Bring

• A strong engineering mindset focused on scalability, reliability, performance, and quality.
• Ability to move between technical implementation, data analysis, and business problem-solving.
• Strong ownership of data solutions from requirements and architecture through development, deployment, and production support.
• Curiosity to adopt modern cloud, data, analytics, and AI technologies.
• Ability to mentor others and influence technical decisions across teams.

Why Join Us?

• Lead modern Azure and Microsoft Fabric data transformation initiatives.
• Work across Data Engineering, Analytics, BI, and AI.
• Solve complex enterprise data challenges at scale.
• Collaborate with architects, engineers, analysts, data scientists, and business leaders.
• Build solutions that directly influence business decisions and outcomes.
• Grow your expertise through continuous learning, certifications, and exposure to modern data technologies.

Ready to build the future of data? Join our Data & Analytics team and help organizations turn data into trusted insights and intelligent business outcomes.