Senior Data Engineer — Hybrid, Scalable Data Pipelines

Capgemini; Vila Nova de Gaia; Hybrid; EUR 60,000 - 90,000; Full time

Benefits offered by this job

Health and Life insurance

Referral program with bonuses

Career Acceleration Programs

Hybrid work policy

Equal opportunity employer

Job summary

Capgemini Portugal seeks a Senior Data Engineer to own end-to-end data ingestion and processing pipelines. You will build scalable data solutions using Azure Data Factory, Databricks, Spark, and Delta Lake, while ensuring data quality and governance across SAP, Kafka, APIs, and databases.

You will mentor data engineers, review code, and collaborate with cross-functional teams to deliver trusted data products for analytics and AI use cases.

Qualifications

• Strong experience with Python or Scala, advanced SQL, Spark, Delta Lake, and Databricks for scalable data engineering solutions.
• Experience with batch, CDC, and streaming data pipelines, leveraging Azure Data Factory and related Azure data services.

Responsibilities

• Own and develop end-to-end data ingestion and processing pipelines across multiple sources, including SAP, Kafka, APIs, and databases.
• Build scalable data solutions using Azure Data Factory, Databricks, Spark, SQL, Delta Lake, and Unity Catalog.
• Mentor Data Engineers, perform code reviews, and collaborate with cross-functional product teams.

Skills

Python/Scala

SQL

Spark

Delta Lake

Databricks

Azure Data Factory

Kafka

CI/CD

Git

Unity Catalog

SAP S/4HANA

BW/BDC

AI data technologies

Tools

Databricks

Azure Data Factory

Kafka

Unity Catalog

SAP S/4HANA

Job description

Capgemini Portugal seeks a Senior Data Engineer to own end-to-end data ingestion and processing pipelines. You will build scalable data solutions using Azure Data Factory, Databricks, Spark, and Delta Lake, while ensuring data quality and governance across SAP, Kafka, APIs, and databases.

You will mentor data engineers, review code, and collaborate with cross-functional teams to deliver trusted data products for analytics and AI use cases.