Senior Data Engineer

Huemot Technology; Pune District, Chennai, Bengaluru; Presencial; INR 1.800.000 - 2.400.000; Jornada completa

Descripción de la vacante

Huemot Technology in Pune, India, seeks a senior Data Engineer to implement ingestion, transformation, and optimization of enterprise data sources into Microsoft Fabric Lakehouse environments.

You will configure Fivetran connectors, manage large-volume ingestion, build Bronze-to-Silver pipelines, and develop incremental load and CDC logic, while optimizing performance and promoting code through Dev/Test/Prod.

Formación

• 7+ years of data engineering experience.
• 1+ year hands-on with Microsoft Fabric or Azure Synapse/Data Factory.
• Strong experience with Fivetran or similar ELT tools.
• Proficiency in Python, PySpark and SQL.
• Experience handling high-volume datasets (hundreds of millions of records).
• Strong understanding of Medallion architecture and data modeling concepts.

Responsabilidades

• Configure and optimize Fivetran connectors (Oracle, SQL DB, etc.).
• Manage large-volume ingestion and backfill operations
• Implement Bronze to Silver transformation pipelines
• Develop incremental load and CDC logic
• Optimize Lakehouse performance and storage patterns
• Implement monitoring (record counts, load duration, failure tracking)
• Support Dev/Test/Prod promotion processes

Conocimientos

Python

PySpark

SQL

Data modeling

Medallion architecture

Herramientas

Fivetran

Microsoft Fabric

Azure Data Factory

Azure Synapse

Descripción del empleo

Role & responsibilities

Role Overview

Implement ingestion, transformation, and optimization of enterprise data sources into Microsoft Fabric Lakehouse environments.

Key Responsibilities

• Configure and optimize Fivetran connectors (Oracle, SQL DB, etc.)
• Manage large-volume ingestion and backfill operations
• Implement Bronze to Silver transformation pipelines
• Develop incremental load and CDC logic
• Optimize Lakehouse performance and storage patterns
• Implement monitoring (record counts, load duration, failure tracking)
• Support Dev/Test/Prod promotion processes

Preferred candidate profile

• 7+ years of data engineering experience
• Hands-on experience with Microsoft Fabric (Mandatory 1+ years) or Azure Synapse/Data Factory
• Strong experience with Fivetran or similar ELT tools
• Proficiency in Python, PySpark, and SQL
• Experience handling high-volume datasets (hundreds of millions of records)
• Strong understanding of Medallion architecture and data modeling concepts.