Senior Data Engineer: Databricks + Azure Data Factory

Talanto; Warszawa; Hybrid; PLN 195,000 - 357,000; Full time

Benefits offered by this job

Medical package

Sports card

Dog-friendly office

Job summary

ERGO Technology & Services S.A. in Warsaw is seeking a data engineering professional to design scalable data models and robust ETL processes across international teams.

You will ensure data quality, security, and regulatory compliance while collaborating with data scientists, engineers, and DevOps to build predictive models and BI platforms. The role requires strong SQL skills, Azure Data Factory, Databricks, Python, and experience with CDC, CI/CD pipelines, and dimensional modeling.

Qualifications

• Fluent spoken and written English.
• Expertise in writing and optimizing SQL code and good understanding of MS SQL internals.
• Hands‑on experience with Azure Data Factory (ADF) pipelines.
• Proficiency in incremental and full data loads.
• Familiarity with CI/CD integration for data workflows.
• Knowledge of Databricks and Python for advanced data processing.
• Strong grasp of dimensional modeling and schema design.
• Experience implementing Change Data Capture (CDC) in production environments.
• Ability to configure and troubleshoot CI/CD pipelines for database deployments.
• Being skilled in pre‑ and post‑deployment validations.
• Expertise in query optimization and resolving performance bottlenecks.
• Proficiency in debugging issues across staging and production environments.
• Familiarity with Active Directory (AD) group management.
• Knowledge of role‑based access control.
• Integration experience with Entra ID for secure data access.

Responsibilities

• Designing and implementing data models and architectures that support financial data management.
• Developing and maintaining ETL processes to integrate data from diverse sources.
• Ensuring data quality, security, and compliance with regulatory requirements.
• Collaborating with business owners, data analysts and scientists, software engineers, and DevOps specialists to support the development of predictive models and BI tools.
• Optimizing data processing workflows for performance, scalability, and reliability.
• Working in an international Scrum team.

Skills

Fluent English

SQL proficiency

Azure Data Factory

Databricks

Python

Dimensional modeling

CDC in production

CI/CD for data

AD group management

Entra ID familiarity

Query optimization

Tools

Azure Data Factory pipelines

Databricks

CI/CD pipelines for databases

Job description

ERGO Technology & Services S.A. in Warsaw is seeking a data engineering professional to design scalable data models and robust ETL processes across international teams.

You will ensure data quality, security, and regulatory compliance while collaborating with data scientists, engineers, and DevOps to build predictive models and BI platforms. The role requires strong SQL skills, Azure Data Factory, Databricks, Python, and experience with CDC, CI/CD pipelines, and dimensional modeling.