Senior Data Engineer

Capgemini; Vila Nova de Gaia; Presencial; EUR 55.000 - 85.000; Jornada completa

Ventajas ofrecidas por este puesto de trabajo

Health and Life insurance

Referral program with bonuses fortal

other fringe benefits according with ?

Descripción de la vacante

Capgemini Portugal is launching a new Tech Hub in Porto and seeks a Senior Data Engineer to own end-to-end data ingestion and processing pipelines across SAP, Kafka, APIs, and databases. You will build scalable data solutions with Azure Data Factory, Databricks, Spark, SQL, Delta Lake, and Unity Catalog, while mentoring engineers and collaborating with cross-functional teams.

You will contribute to analytics and AI use cases by delivering trusted, curated data products, maintaining CI/CD

Formación

• Strong experience with Python or Scala, advanced SQL, Spark, Delta Lake, and Databricks.
• Experience with batch, CDC, and streaming data pipelines using Azure Data Factory and related Azure data services.
• Knowledge of data quality, monitoring, observability, alerting, CI/CD, Git, and Unity Catalog.
• Experience with SAP S/4HANA, BW, BDC, and AI-related data technologies (nice to have).

Responsabilidades

• Own and develop end-to-end data ingestion and processing pipelines across multiple sources, including SAP, Kafka, APIs, and databases.
• Build scalable data solutions using Azure Data Factory, Databricks, Spark, SQL, Delta Lake, and Unity Catalog.
• Implement and manage data quality, observability, monitoring, alerting, and data contract enforcement.
• Design performant, cost-efficient, and reusable data engineering frameworks and components.
• Maintain CI/CD pipelines and collaborate with DataOps, ML Engineering, AI, and Analytics teams.
• Support analytics and AI use cases through delivery of trusted, curated data products.
• Mentor Data Engineers, perform code reviews, and collaborate with cross-functional product teams.
• Strong understanding of source-aligned data engineering, data quality, governance, and producer-consumer data models.
• Experience working with cross-functional stakeholders in complex data and AI environments.
• Experience with SAP, high-volume transactional data, and data mesh principles (nice to have).

Conocimientos

Python/Scala

SQL

Spark

Delta Lake

Databricks

Data pipelines (batch/streaming)

CI/CD

Git

Data quality/observability

Herramientas

Azure Data Factory

Azure Data Services

Kafka

SAP S/4HANA

BW/BDC

Unity Catalog

Descripción del empleo

Senior Data Engineer

Choosing Capgemini means choosing a company where you will be empowered to shape your career in the way you’d like, where you’ll be supported and inspired by a collaborative community of colleagues around the world, and where you’ll be able to reimagine what’s possible. Join us and help the world’s leading organizations unlock the value of technology and build a more sustainable, more inclusive world.

You’ll have the opportunity to collaborate with a leading European mobility services provider, headquartered in Germany and backed by nearly 90 years of expertise. As part of this journey, you’ll contribute to the launch of a new Tech Hub in Porto, helping to drive innovative, technology-led solutions that are transforming how businesses move while contributing to a more sustainable future.

YOUR ROLE

• Own and develop end-to-end data ingestion and processing pipelines across multiple sources, including SAP, Kafka, APIs, and databases.
• Build scalable data solutions using Azure Data Factory, Databricks, Spark, SQL, Delta Lake, and Unity Catalog.
• Implement and manage data quality, observability, monitoring, alerting, and data contract enforcement.
• Design performant, cost-efficient, and reusable data engineering frameworks and components.
• Maintain CI/CD pipelines and collaborate with DataOps, ML Engineering, AI, and Analytics teams.
• Support analytics and AI use cases through delivery of trusted, curated data products.
• Mentor Data Engineers, perform code reviews, and collaborate with cross-functional product teams.
• Strong understanding of source-aligned data engineering, data quality, governance, and producer-consumer data models.
• Experience working with cross-functional stakeholders in complex data and AI environments.
• Experience with SAP, high-volume transactional data, and data mesh principles (nice to have).

YOUR PROFILE

• Strong experience with Python or Scala, advanced SQL, Spark, Delta Lake, and Databricks for scalable data engineering solutions.
• Experience with batch, CDC, and streaming data pipelines, leveraging Azure Data Factory and related Azure data services.
• Strong knowledge of data quality, monitoring, observability, alerting, CI/CD, Git, and Unity Catalog.
• Experience with Kafka, Spark Structured Streaming, SAP S/4HANA, BW, BDC, and AI-related data technologies (embeddings, vector databases, document processing) (nice to have).
• Self-driven professional with a strong interest in data, analytics, and AI.
• Excellent collaboration, communication, and stakeholder management skills.
• Strong problem-solving, prioritization, and decision-making capabilities in fast-paced environments.
• Experience mentoring team members, sharing knowledge, and providing technical leadership.

WHAT WE´LL LOVE ABOUT WORKING HERE?

We promote an empowering environment with autonomy and peers' relationships among the top scores of our Monthly Employees' feedback;

Next to this, we also offer an attractive compensation package and benefits such as

• attractive compensation package
• Health and Life insurance
• Referral program with bonuses for talent recommendations
• other fringe benefits according with our partnerships

Capgemini Portugal is an equal opportunity employer. We promote equality and dignity in all aspects of recruitment and employment, as well as employment offers and promotions made according with competence and ability or performance, respectively.

ABOUR CAPGEMINI

Capgemini is a global business and technology transformation partner, helping organizations to accelerate their dual transition to a digital and sustainable world, while creating tangible impact for enterprises and society. It is a responsible and diverse group of 340,000 team members in more than 50 countries. With its strong over 55-year heritage, Capgemini is trusted by its clients to unlock the value of technology to address the entire breadth of their business needs. It delivers end-to-end services and solutions leveraging strengths from strategy and design to engineering, all fuelled by its market leading capabilities in AI, cloud and data, combined with its deep industry expertise and partner ecosystem. The Group reported 2023 global revenues of €22.5 billion.

Get the future you want | www.capgemini.com

#LI-Hybrid