Data Engineer

KPI Partners; Bengaluru; On-site; INR 1,000,000 - 1,500,000; Full time

Job summary

KPI Partners is seeking a skilled Fabric Data Engineer in Bengaluru, India to design and build scalable data pipelines and modern Lakehouse solutions using Microsoft Fabric. The ideal candidate should possess 4–8 years of Data Engineering experience, strong expertise in Azure technologies, and competency in data processing with tools like PySpark.

This role involves collaborating with BI teams, ensuring data quality, and optimizing performance of large datasets. Interested candidates can share their updated resume at [e-mail].

Qualifications

• 4–8 years of Data Engineering experience.
• Experience with Lakehouse or modern cloud data platforms.

Responsibilities

• Develop and maintain data pipelines using Microsoft Fabric and Azure Data Factory.
• Design and implement Lakehouse architectures leveraging OneLake and Delta Lake.
• Perform data transformation and processing using PySpark or Spark SQL.
• Orchestrate, monitor, and optimize data pipelines for performance and reliability.
• Collaborate with BI and Analytics teams to support data readiness.
• Ensure data quality, scalability, and efficient processing of large datasets.

Skills

Microsoft Fabric

PySpark

Spark SQL

SQL

Education

Bachelor's Degree in Computer Science, Information Technology, or related field

Job description

KPI Partners is looking for a skilled Fabric Data Engineer to design and build scalable data pipelines and modern Lakehouse solutions using Microsoft Fabric. The ideal candidate should have strong experience in Azure data engineering technologies and large-scale data processing.

Key Responsibilities

• Develop and maintain data pipelines using Microsoft Fabric and Azure Data Factory.
• Design and implement Lakehouse architectures leveraging OneLake and Delta Lake.
• Perform data transformation and processing using PySpark or Spark SQL.
• Orchestrate, monitor, and optimize data pipelines for performance and reliability.
• Collaborate with BI and Analytics teams to support data readiness and platform migration initiatives.
• Ensure data quality, scalability, and efficient processing of large datasets.

Mandatory Skills (Must Have)

• Microsoft Fabric
• PySpark or Spark SQL
• SQL

Preferred Skills

• Data Lake / Lakehouse Architecture
• Performance Optimization & Monitoring
• BI & Analytics Platform Support

Qualifications

• Bachelor's Degree in Computer Science, Information Technology, or related field.
• 4–8 years of Data Engineering experience.
• Experience working with Lakehouse or modern cloud data platforms.

Interested candidates can share their updated resume at [e-mail]