Microsoft Fabric Data Engineer: IoT Data Pipelines

MagentaTeam; Warszawa; On-site; PLN 180,000 - 240,000; Full time

Benefits offered by this job

No dress code

Insurance packages

Preferential product access

Contract-based cooperation

Referral program

Job summary

T Hub is seeking a data engineer to design and maintain ingestion, transformation, and data quality workflows for SIM data across regions using Microsoft Fabric. You will modernize legacy pipelines and collaborate with cross-functional teams to deliver analytics-ready datasets.

You will implement Medallion Architecture, ensure robust data quality checks, and participate in CI/CD and production‑grade data operations to support operational run models.

Qualifications

• Must have hands-on experience with Microsoft Fabric or comparable Azure data engineering platforms, including Lakehouse patterns, Delta Lake, data pipelines, and notebook‑based transformations.
• Advanced Python, SQL, and PySpark skills for large‑scale data ingestion, transformation, migration, and optimization of IoT SIM, lifecycle, usage, and network telemetry data.
• Experience with Medallion Architecture (Bronze/Silver/Gold), data modeling for analytical workloads, partitioning, performance tuning, and preparation of reliable datasets for downstream consumption.
• Practical experience with data quality frameworks, orchestration, monitoring, Git‑based development, CI/CD, and production‑grade data operations.

Responsibilities

• Build and maintain scalable data pipelines in Microsoft Fabric to process IoT SIM data.
• Develop ingestion and transformation workflows for multiple sources and organize data using Medallion Architecture.
• Implement data quality checks, validation, monitoring, and automated error handling.
• Collaborate with architects, product owners, analysts, development, QA, and DevOps to industrialize data products and support CI/CD practices.

Skills

Microsoft Fabric

Python

SQL

PySpark

Medallion Architecture

Data modeling

Data quality frameworks

CI/CD

Git-based development

Production data operations

Tools

Power BI

Oracle

SAP

Git

Job description

T Hub is seeking a data engineer to design and maintain ingestion, transformation, and data quality workflows for SIM data across regions using Microsoft Fabric. You will modernize legacy pipelines and collaborate with cross-functional teams to deliver analytics-ready datasets.

You will implement Medallion Architecture, ensure robust data quality checks, and participate in CI/CD and production‑grade data operations to support operational run models.