Data Engineer

TEKsystems Global Services in India; Bengaluru; On-site; INR 900,000 - 1,200,000; Full time

Job summary

TEKsystems Global Services in India is seeking a data engineer in Bengaluru to modernize on-prem data platforms by transitioning to Microsoft Fabric. The role involves designing scalable Lakehouse architectures and integrating various components including Power BI.

You will develop Fabric Pipelines and ensure data quality while collaborating with cross-functional teams for efficient migration and stabilization.

Responsibilities

• Assess and modernize on-prem data platforms and ETL workflows to Microsoft Fabric.
• Design and implement scalable Lakehouse architectures using OneLake and Medallion framework.
• Develop Fabric Pipelines, Dataflows Gen2, and PySpark notebooks for ingestion and transformation.
• Build and optimize Fabric Warehouses, SQL endpoints, and Power BI integrations.
• Ensure data quality, governance, security, performance, and cost optimization.
• Collaborate with cross-functional teams for migration, validation, and production stabilization.

Tools

Microsoft Fabric

PySpark

Power BI

Job description

• Assess and modernize on-prem data platforms and ETL workflows to Microsoft Fabric.
• Design and implement scalable Lakehouse architectures using OneLake and Medallion framework.
• Develop Fabric Pipelines, Dataflows Gen2, and PySpark notebooks for ingestion and transformation.
• Build and optimize Fabric Warehouses, SQL endpoints, and Power BI integrations.
• Ensure data quality, governance, security, performance, and cost optimization.
• Collaborate with cross-functional teams for migration, validation, and production stabilization.