T Hub - Data Engineer (Microsoft Fabric)

MagentaTeam; Warszawa; On-site; PLN 180,000 - 240,000; Full time

Benefits offered by this job

No dress code

Insurance packages

Preferential product access

Contract-based cooperation

Referral program

Job summary

T Hub is seeking a data engineer to design and maintain ingestion, transformation, and data quality workflows for SIM data across regions using Microsoft Fabric. You will modernize legacy pipelines and collaborate with cross-functional teams to deliver analytics-ready datasets.

You will implement Medallion Architecture, ensure robust data quality checks, and participate in CI/CD and production‑grade data operations to support operational run models.

Qualifications

• Must have hands-on experience with Microsoft Fabric or comparable Azure data engineering platforms, including Lakehouse patterns, Delta Lake, data pipelines, and notebook‑based transformations.
• Advanced Python, SQL, and PySpark skills for large‑scale data ingestion, transformation, migration, and optimization of IoT SIM, lifecycle, usage, and network telemetry data.
• Experience with Medallion Architecture (Bronze/Silver/Gold), data modeling for analytical workloads, partitioning, performance tuning, and preparation of reliable datasets for downstream consumption.
• Practical experience with data quality frameworks, orchestration, monitoring, Git‑based development, CI/CD, and production‑grade data operations.

Responsibilities

• Build and maintain scalable data pipelines in Microsoft Fabric to process IoT SIM data.
• Develop ingestion and transformation workflows for multiple sources and organize data using Medallion Architecture.
• Implement data quality checks, validation, monitoring, and automated error handling.
• Collaborate with architects, product owners, analysts, development, QA, and DevOps to industrialize data products and support CI/CD practices.

Skills

Microsoft Fabric

Python

SQL

PySpark

Medallion Architecture

Data modeling

Data quality frameworks

CI/CD

Git-based development

Production data operations

Tools

Power BI

Oracle

SAP

Git

Job description

• Build and maintain scalable data pipelines in Microsoft Fabric, including Lakehouse, Pipelines, Notebooks, Delta Lake, and Medallion Architecture, to process global IoT SIM data efficiently and reliably.
• Develop robust ingestion and transformation workflows for Oracle, SAP, CSV, CDC, APIs, and CMP sources, structuring data through Medallion Architecture (Bronze/Silver/Gold) and reusable data models.
• Implement data quality checks, validation rules, monitoring, and automated error handling to ensure trusted datasets for reporting, analytics, and operational use cases.
• Collaborate with architects, product owners, analysts, development, QA, and DevOps teams to industrialize data products, establish CI/CD practices, and support operational run models.

WHAT SKILLS WILL BE APPRECIATED?

Must have:

• Strong hands‑on experience with Microsoft Fabric or comparable Azure data engineering platforms, including Lakehouse patterns, Delta Lake, data pipelines, and notebook‑based transformations.
• Advanced Python, SQL, and PySpark skills for large‑scale data ingestion, transformation, migration, and optimization of IoT SIM, lifecycle, usage, and network telemetry data.
• Experience with Medallion Architecture (Bronze/Silver/Gold), data modeling for analytical workloads, partitioning, performance tuning, and preparation of reliable datasets for downstream consumption.
• Practical experience with data quality frameworks, orchestration, monitoring, Git‑based development, CI/CD, and production‑grade data operations.

Nice‑to‑have

• Hands‑on experience with real‑time or near‑real‑time streaming concepts, such as Apache Kafka, Fabric Eventstream, Event Hubs, or similar technologies.
• Background in Data Governance, Microsoft Purview, CMP integrations, telecommunications data models, secure data engineering patterns, or legacy SAP/Oracle modernization.
• Experience with Power BI semantic models, Direct Lake, self‑service analytics enablement, or controlled access concepts such as Entra ID, OAuth2, Azure Key Vault, Private Endpoints, and Data Gateways.
• Certifications: DP-600, DP-203, or AZ-305.

OUR OFFER FOR YOU

In this role, you will design, implement, and maintain ingestion, transformation, and data quality workflows for SIM lifecycle, usage, network, and partner connectivity data from multiple source systems and regions. You will modernize and transition data pipelines from legacy systems such as Oracle and SAP into Microsoft Fabric, integrate external Connectivity Management Platforms (CMPs), and provide reliable, analytics‑ready datasets for internal teams and partner‑facing use cases. The role is focused on practical data pipeline engineering, automation, monitoring, and operational reliability.

No dress code - you can just be yourself here

Medical, sport and life insurance packages at preferential terms

Access to our products and services at preferential terms

Employment contract-based cooperation

Know Talent - receive training or financial bonus for recommending new employees

WHAT WILL YOUR RECRUITMENT PROCESS BE LIKE?

A fair approach to all people who want to join T Hub means that:

• The recruitment process is transparent;
• Our recruitment decision is based solely on an assessment of your skills (your race, skin color, sexual orientation, gender identity, origin, disability, political view, appearance, or religion will not have any influence on the outcome of the process):
• Regardless of the outcome of the process, you will get detailed feedback.

Let’s meet to better understand each other's expectations.

Our screening meeting will last about 20-30 minutes. We will ask you about our areas of interest and will be happy to field any questions you may have.

Hiring Manager will receive a recommendation for your application.

There's nothing for you to do at this stage — we'll take care of everything. During this time we process all the information we've gathered during the screening process and dig deeper into your CV.

Technical meetings with the Hiring Manager and/or team members.

We will invite you to one or two project meetings to confirm that we have a ‘perfect match'. The meetings may last between 30 minutes and 90 minutes, during which time we will talk to you about mutual expectations and the vision for our collaboration. You will also most likely meet your future supervisor and your teammate during this time.

At this stage, we will have decided that you are the person we want to develop our projects with. We will then come back to you with an offer of collaboration, hoping for your 'yes'. If for some reason, we are unable to offer you a position in our team, you will certainly receive feedback from us explaining our decision.