Senior Data Engineer: Databricks & Azure Data Factory

ERGO; Województwo pomorskie; Hybrid; PLN 180,000 - 240,000; Full time

Benefits offered by this job

Medical package

Remote working opportunity

Dog-friendly office in Warsaw

Office gaming room

Job summary

ERGO Technology & Services S.A. (ET&S) is seeking a data engineering professional to design scalable data models and robust ETL pipelines. You will integrate data from diverse sources, ensure quality and regulatory compliance, and collaborate with cross-functional teams in an international Scrum setup.

The role emphasizes performance tuning, data security, and deployment validations, with opportunities to work on predictive models and BI tools using modern data platforms.

Qualifications

• Fluent spoken and written English.
• Expertise in writing and optimizing SQL code, familiarity with MS SQL internals.
• Hands-on experience with Azure Data Factory pipelines.
• Proficient in incremental and full data loads.
• Experience with CI/CD integration for data workflows.
• Knowledge of Databricks and Python for advanced data processing.
• Strong understanding of dimensional modeling and schema design.
• Experience implementing Change Data Capture (CDC) in production.
• Ability to configure and troubleshoot CI/CD pipelines for database deployments.
• Skilled in pre- and post-deployment validations.
• Expertise in query optimization and bottleneck resolution.
• Proficient in debugging across staging and production.
• Familiarity with Active Directory (AD) group management.
• Knowledge of role-based access control (RBAC).
• Experience with Entra ID for secure data access.

Responsibilities

• Designing and implementing data models and architectures for financial data management.
• Developing and maintaining ETL processes to integrate data from diverse sources.
• Ensuring data quality, security, and regulatory compliance.
• Collaborating with business owners, data analysts and scientists, software engineers, and DevOps to support predictive models and BI tools.
• Optimizing data processing workflows for performance, scalability, and reliability.
• Working in an international Scrum team.

Skills

English fluency

SQL & MS SQL internals

Azure Data Factory

Incremental and full data loads

CI/CD for data workflows

Databricks

Python for data processing

Dimensional modeling

Change Data Capture (CDC)

CI/CD for DB deployments

Pre- and post-deployment validations

Query optimization

Debugging in staging/production

AD group management

RBAC

Entra ID access control

Job description

ERGO Technology & Services S.A. (ET&S) is seeking a data engineering professional to design scalable data models and robust ETL pipelines. You will integrate data from diverse sources, ensure quality and regulatory compliance, and collaborate with cross-functional teams in an international Scrum setup.

The role emphasizes performance tuning, data security, and deployment validations, with opportunities to work on predictive models and BI tools using modern data platforms.