Data Engineer

Y&L Consulting; Indore District, Hyderabad, Pune District; Hybrid; INR 1,400,000 - 1,800,000; Full time

Job summary

Y&L Consulting is seeking a hands-on Data Engineer to build and support a client’s Microsoft Fabric data platform in Indore, India. The role focuses on practical implementation rather than leadership, with strong collaboration across teams.

You will design and maintain ingestion and transformation pipelines using Microsoft Fabric pipelines, Fabric notebooks, SQL, and Python/PySpark; develop bronze/silver/gold datasets and reporting-ready data models; perform testing and data quality validation,

Qualifications

• Hands-on data engineering skills demonstrated in building data pipelines.
• Experience with Fabric notebooks and SQL-based data modelling.

Responsibilities

• Build and maintain ingestion and transformation pipelines using Microsoft Fabric pipelines, Fabric notebooks, SQL, and Python/PySpark.
• Develop reliable bronze, silver, and gold datasets and reporting-ready data models.
• Perform unit testing, end-to-end testing, and data quality validation; investigate discrepancies and support reconciliation and Power BI reporting. Troubleshoot pipeline failures and production issues using source control, code reviews, documentation, and CI/CD practices.
• Communicate clearly with non-technical client stakeholders, business analysts, and deeply technical team members. Translate business requirements into technical work, explain data-quality findings and trade-offs in plain language, and confirm decisions and next steps.

Skills

Microsoft Fabric

SQL

Python/PySpark

Job description

We are seeking a hands-on Data Engineer to build and support our client's Microsoft Fabric data platform. This is not a lead position, but the engineer must be able to lead technical discussions.

Core competencies

• Build and maintain ingestion and transformation pipelines using Microsoft Fabric pipelines, Fabric notebooks, SQL, and Python/PySpark.
• Develop reliable bronze, silver, and gold datasets and reporting-ready data models.
• Perform unit testing, end-to-end testing, and data quality validation; investigate discrepancies and support reconciliation and Power BI reporting. Troubleshoot pipeline failures and production issues using source control, code reviews, documentation, and CI/CD practices.

Communication and collaboration

• Communicate clearly with non-technical client stakeholders, business analysts, and deeply technical team members.
• Translate business requirements into technical work, explain data-quality findings and trade-offs in plain language, and confirm decisions and next steps.Role & responsibilities