Data Engineer

EduRun Group; Hyderabad; On-site; INR 900,000 - 1,500,000; Full time

Job summary

EduRun Group is seeking a Data Engineer in India to design, build, and maintain data pipelines and Lakehouse-based data models for analytics and BI initiatives.

You will collaborate with data scientists, analysts, and stakeholders, employing Microsoft Fabric, Dataflow Gen2, Azure Data Factory, Python, PySpark, SQL, and Power BI to ensure data quality and actionable insights. This role emphasizes performance, reliability, and clear data storytelling.

Qualifications

• Proficiency in Microsoft Fabric and its components.
• Experience with Dataflow Gen2 and Lakehouse architecture.
• Strong knowledge of Azure Data Factory (ADF) and data pipeline development.
• Proficient in Python and PySpark for data manipulation and analysis.
• Solid understanding of SQL for database querying and management.
• Familiarity with Power BI and DAX for data visualization.
• Excellent problem-solving skills and attention to detail.
• Ability to work collaboratively in a fast-paced environment.

Responsibilities

• Design and implement data pipelines using Microsoft Fabric, Dataflow Gen2, and Azure Data Factory (ADF).
• Develop and maintain data models and structures in Lakehouse environments.
• Utilize Python and PySpark for data processing and transformation tasks.
• Write efficient SQL queries to extract and manipulate data from various sources.
• Collaborate with business intelligence teams to integrate data into Power BI dashboards and reports.
• Ensure data quality and integrity throughout the data lifecycle.
• Troubleshoot and optimize data workflows for performance and reliability.

Skills

Microsoft Fabric

Dataflow Gen2

Azure Data Factory

Python

PySpark

SQL

Power BI

DAX

Collaboration

Problem-solving

Tools

Power BI

DAX

Lakehouse

Job description

We are seeking a skilled Data Engineer to join our dynamic team. The ideal candidate will have a strong background in data engineering and a passion for working with cutting-edge technologies. As a Data Engineer, you will be responsible for designing, developing, and maintaining data pipelines and workflows that support our data analytics and business intelligence initiatives. You will work closely with data scientists, analysts, and other stakeholders to ensure that data is accessible, reliable, and actionable.

Key Responsibilities

• Design and implement data pipelines using Microsoft Fabric, Dataflow Gen2, and Azure Data Factory (ADF).
• Develop and maintain data models and structures in Lakehouse environments.
• Utilize Python and PySpark for data processing and transformation tasks.
• Write efficient SQL queries to extract and manipulate data from various sources.
• Collaborate with business intelligence teams to integrate data into Power BI dashboards and reports.
• Ensure data quality and integrity throughout the data lifecycle.
• Troubleshoot and optimize data workflows for performance and reliability.

Required Skills

• Proficiency in Microsoft Fabric and its components.
• Experience with Dataflow Gen2 and Lakehouse architecture.
• Strong knowledge of Azure Data Factory (ADF) and data pipeline development.
• Proficient in Python and PySpark for data manipulation and analysis.
• Solid understanding of SQL for database querying and management.
• Familiarity with Power BI and DAX for data visualization.
• Excellent problem-solving skills and attention to detail.
• Ability to work collaboratively in a fast‑paced environment.

Location: Madhya Pradesh or Andhra Pradesh.