Senior Data Engineer

Capgemini Engineering; Lisboa; Híbrido; EUR 60 000 - 90 000; Tempo integral

Vantagens oferecidas por esta oferta de emprego

Hybrid work

Health and life insurance

Referral program with bonuses

Great office locations

Resumo da oferta

Capgemini Engineering in Lisbon is seeking a senior Data Engineer to help develop and evolve a corporate data platform based on Microsoft Fabric, ensuring reliable data ingestion, transformation and availability across the organisation.

You will design end-to-end data pipelines using PySpark, Spark SQL and Delta Lake, implement a Medallion Architecture, and drive data governance, quality, lineage and CI/CD practices with cross‑functional teams.

Qualificações

• Minimum of 7 years of proven data engineering experience.
• Hands-on expertise with Microsoft Fabric, Azure, PySpark, Spark SQL, Python, T-SQL/PL-SQL, and Delta Lake.
• Experience with Data Lakehouse architectures and Medallion Architecture.
• Familiarity with data governance, metadata management, and data quality practices (Microsoft Purview).

Responsabilidades

• Designing and developing end-to-end data pipelines and ETL/ELT solutions using Microsoft Fabric, PySpark, Spark SQL, and SQL, ensuring efficient data ingestion, transformation, and availability
• Implementing and evolving a Medallion Architecture (Bronze, Silver, and Gold layers), defining data models and ensuring data is reliably available for analytics, reporting, and AI teams
• Driving Data Quality, Data Governance, and Metadata Management practices, including Data Lineage, Master Data Management, and Data Acceptance Testing
• Integrating new data sources and systems into the corporate data platform, collaborating closely with business, analytics, and AI teams to understand requirements and define acceptance criteria
• Implementing CI/CD processes for notebooks, pipelines, Lakehouses, and Semantic Models, contributing to the continuous improvement of the platform and its engineering practices

Conhecimentos

Data-driven mindset

Strong communication

Ferramentas

Microsoft Fabric

Azure

PySpark

Spark SQL

Python

T-SQL/PL-SQL

Delta Lake

CI/CD pipelines

Git workflows

Microsoft Purview

Descrição da oferta de emprego

CAPGEMINI ENGINEERING

At Capgemini Engineering, the world leader in engineering services, we bring together a global team of engineers, scientists, and architects to help the world’s most innovative companies unleash their potential. From autonomous cars to life‑saving robots, our digital and software technology experts think outside the box as they provide unique R&D and engineering services across all industries. Join us for a career full of opportunities.

Where you can make a difference. Where no two days are the same.

YOUR ROLE

In this role you will play a key role in developing and evolving a corporate data platform based on Microsoft Fabric, ensuring reliable data ingestion, transformation, and availability across the organisation.

In this role you will play a key role in:

• Designing and developing end-to-end data pipelines and ETL/ELT solutions using Microsoft Fabric, PySpark, Spark SQL, and SQL, ensuring efficient data ingestion, transformation, and availability
• Implementing and evolving a Medallion Architecture (Bronze, Silver, and Gold layers), defining data models and ensuring data is reliably available for analytics, reporting, and AI teams
• Driving Data Quality, Data Governance, and Metadata Management practices, including Data Lineage, Master Data Management, and Data Acceptance Testing
• Integrating new data sources and systems into the corporate data platform, collaborating closely with business, analytics, and AI teams to understand requirements and define acceptance criteria
• Implementing CI/CD processes for notebooks, pipelines, Lakehouses, and Semantic Models, contributing to the continuous improvement of the platform and its engineering practices

YOUR PROFILE

• A minimum of 7 years of proven experience in Data Engineering, with strong hands‑on expertise in Microsoft Fabric, Azure, PySpark, Spark SQL, Python, T‑SQL/PL‑SQL, and Delta Lake
• Solid experience in ETL/ELT design patterns, Data Lakehouse architecture, and Medallion Architecture, with a strong understanding of data modelling at conceptual, logical, and physical levels
• Demonstrated experience in Data Governance, Data Quality, Metadata Management, Data Lineage, and Master Data Management, ideally using Microsoft Purview
• Experience with CI/CD pipelines and Git-based workflows, with the ability to apply software engineering best practices to data engineering solutions
• Strong communication and client‑facing skills, with a business‑oriented mindset, attention to detail, and a structured approach to planning and problem‑solving

Nice to have

• Microsoft certifications DP-203, DP-600, DP-700 or AZ-900
• Experience in the telecommunications sector
• Experience in data platform migration or modernisation projects

What You’ll Love About Working Here

• Join a multicultural and inclusive team environment
• Enjoy a supportive atmosphere promoting work‑life balance
• Hybrid work
• Your career growth is central to our mission. Our array of career growth programs and diverse professionals are crafted to support you in exploring a world of opportunities
• Access valuable training and certifications in cutting‑edge technologies
• Engage in exciting national and international projects
• Health and life insurance
• Referral program with bonuses for talent recommendations
• Great office locations

Capgemini is an AI‑powered global business and technology transformation partner, delivering tangible business value. We imagine the future of organizations and make it real with AI, technology, and people. With our strong heritage of nearly 60 years, we are a responsible and diverse group of 420,000 team members in more than 50 countries. We deliver end‑to‑end services and solutions with our deep industry expertise and strong partner ecosystem, leveraging our capabilities across strategy, technology, design, engineering, and business operations.