AI-Powered Data Engineer – Azure Databricks & Delta Lake

Capgemini Invent; Wrocław; Hybrid; PLN 270,000 - 420,000; Full time

Benefits offered by this job

Yearly bonus

Private medical care

Life insurance

NAIS platform

Training tracks

Hybrid work model

Education resources

Job summary

Capgemini Invent in Poland is seeking experienced Data Engineers to join a strategic Data & AI initiative. You will develop and maintain AI-powered data solutions, delivering scalable data pipelines for analytics and business-critical use cases.

Responsibilities include building pipelines with Azure Databricks, transforming data, and delivering productized data solutions. The role requires 5+ years in data engineering, strong PySpark/Python/SQL, and on-site availability in Wrocław or Gdańsk.

Qualifications

• 5+ years of Data Engineering experience.
• Strong PySpark, Python and SQL skills.
• Hands-on experience with Azure Databricks and Delta Lake.
• Experience delivering end-to-end data platforms and ingesting data from enterprise systems and APIs.
• Knowledge of CDC, SCD2, data quality and governance practices.
• Experience with Azure DevOps, CI/CD and YAML pipelines.
• Strong problem-solving and communication skills.
• Fluent English and availability to work on-site in Gdańsk or Wrocław.

Responsibilities

• Build and maintain scalable data pipelines using Azure Databricks and Delta Lake.
• Ingest, cleanse, transform and deliver data for analytics and AI use cases.
• Develop metadata-driven and reusable data-engineering frameworks.
• Implement data-quality, CDC, SCD2, observability and audit solutions.
• Deploy data products using Databricks Asset Bundles and Azure DevOps.
• Optimize Delta Lake models and ETL/ELT processes.
• Collaborate with architects, engineers and business stakeholders.

Skills

PySpark / Python / SQL

Azure Databricks

Delta Lake

End-to-end data platforms

Data governance

Azure DevOps / CI/CD / YAML

English proficiency

On-site availability

Tools

Azure Databricks

Delta Lake

Job description

Capgemini Invent in Poland is seeking experienced Data Engineers to join a strategic Data & AI initiative. You will develop and maintain AI-powered data solutions, delivering scalable data pipelines for analytics and business-critical use cases.

Responsibilities include building pipelines with Azure Databricks, transforming data, and delivering productized data solutions. The role requires 5+ years in data engineering, strong PySpark/Python/SQL, and on-site availability in Wrocław or Gdańsk.