Data Engineer - AI-Driven Pipelines on Azure Databricks

Capgemini; Województwo pomorskie; Hybrid; PLN 180,000 - 260,000; Full time

Benefits offered by this job

Yearly financial bonus

Private medical care (Medicover) with

Life insurance

NAIS benefit platform

Job summary

Capgemini Invent is seeking experienced Data Engineers to join a strategic Data & AI initiative for a leading international legal organization. You will develop and maintain AI-powered products and scalable data solutions, contributing end-to-end data pipelines and governance practices.

The role requires 5+ years of data engineering experience, strong PySpark, Python and SQL abilities, hands-on Azure Databricks, Delta Lake, and on-site work in Gdańsk or Wrocław within a hybrid model.

Qualifications

• 5+ years of Data Engineering experience.
• Strong PySpark, Python and SQL skills.
• Hands-on experience with Azure Databricks and Delta Lake.
• Experience delivering end-to-end data platforms and ingesting data from enterprise systems and APIs.

Responsibilities

• Build and maintain scalable data pipelines using Azure Databricks and Delta Lake.
• Ingest, cleanse, transform and deliver data for analytics and AI use cases.
• Develop metadata-driven and reusable data-engineering frameworks.
• Implement data-quality, CDC, SCD2, observability and audit solutions.
• Deploy data products using Databricks Asset Bundles and Azure DevOps.
• Optimize Delta Lake models and ETL/ELT processes.
• Collaborate with architects, engineers and business stakeholders.

Skills

PySpark

Python

SQL

Azure Databricks

Delta Lake

Data pipelines

CI/CD

YAML pipelines

English

Tools

Azure Databricks

Delta Lake

CI/CD

Job description

Capgemini Invent is seeking experienced Data Engineers to join a strategic Data & AI initiative for a leading international legal organization. You will develop and maintain AI-powered products and scalable data solutions, contributing end-to-end data pipelines and governance practices.

The role requires 5+ years of data engineering experience, strong PySpark, Python and SQL abilities, hands-on Azure Databricks, Delta Lake, and on-site work in Gdańsk or Wrocław within a hybrid model.