Senior Data Engineer — Data Platform & Medallion Architecture

Capgemini Engineering; Lisboa; Híbrido; EUR 60 000 - 90 000; Tempo integral

Vantagens oferecidas por esta oferta de emprego

Hybrid work

Health and life insurance

Referral program with bonuses

Great office locations

Resumo da oferta

Capgemini Engineering in Lisbon is seeking a senior Data Engineer to help develop and evolve a corporate data platform based on Microsoft Fabric, ensuring reliable data ingestion, transformation and availability across the organisation.

You will design end-to-end data pipelines using PySpark, Spark SQL and Delta Lake, implement a Medallion Architecture, and drive data governance, quality, lineage and CI/CD practices with cross‑functional teams.

Qualificações

• Minimum of 7 years of proven data engineering experience.
• Hands-on expertise with Microsoft Fabric, Azure, PySpark, Spark SQL, Python, T-SQL/PL-SQL, and Delta Lake.
• Experience with Data Lakehouse architectures and Medallion Architecture.
• Familiarity with data governance, metadata management, and data quality practices (Microsoft Purview).

Responsabilidades

• Designing and developing end-to-end data pipelines and ETL/ELT solutions using Microsoft Fabric, PySpark, Spark SQL, and SQL, ensuring efficient data ingestion, transformation, and availability
• Implementing and evolving a Medallion Architecture (Bronze, Silver, and Gold layers), defining data models and ensuring data is reliably available for analytics, reporting, and AI teams
• Driving Data Quality, Data Governance, and Metadata Management practices, including Data Lineage, Master Data Management, and Data Acceptance Testing
• Integrating new data sources and systems into the corporate data platform, collaborating closely with business, analytics, and AI teams to understand requirements and define acceptance criteria
• Implementing CI/CD processes for notebooks, pipelines, Lakehouses, and Semantic Models, contributing to the continuous improvement of the platform and its engineering practices

Conhecimentos

Data-driven mindset

Strong communication

Ferramentas

Microsoft Fabric

Azure

PySpark

Spark SQL

Python

T-SQL/PL-SQL

Delta Lake

CI/CD pipelines

Git workflows

Microsoft Purview

Descrição da oferta de emprego

Capgemini Engineering in Lisbon is seeking a senior Data Engineer to help develop and evolve a corporate data platform based on Microsoft Fabric, ensuring reliable data ingestion, transformation and availability across the organisation.

You will design end-to-end data pipelines using PySpark, Spark SQL and Delta Lake, implement a Medallion Architecture, and drive data governance, quality, lineage and CI/CD practices with cross‑functional teams.