Senior Data Engineer - Databricks, PySpark & Azure Data

SNI; Wrocław; On-site; PLN 180,000 - 280,000; Full time

Job summary

SNI is seeking a skilled Data Engineer to design and optimize enterprise-grade data pipelines, models, and reporting datasets. You will collaborate with risk analysts, developers, and business stakeholders to translate complex logic into scalable data solutions, while promoting best practices in cloud architectures, CI/CD, and data governance.

The role involves mentoring junior engineers and delivering robust, automated data pipelines within Azure-based ecosystems and Power BI reporting

Qualifications

• Strong hands-on engineering experience with Databricks and PySpark.
• Advanced SQL and deep expertise in enterprise data warehousing and modeling.
• Working experience with cloud data ecosystems, specifically Azure Data Lake (ADLS) and Azure Data Factory (ADF) or equivalent cloud tooling.
• Proven track record implementing ETL/ELT pipelines and executing performance tuning on large-scale datasets.
• Experience collaborating within Agile/Scrum cross-functional delivery teams.
• Background in Financial Services, Risk Management, Regulatory reporting, or ESG technology.
• Proficiency with general-purpose Python scripting, cloud DevOps/CI/CD practices, and cloud-native patterns.
• Experience building or integrating datasets for Power BI reporting and visualization.

Responsibilities

• Design, construct, and support enterprise-grade data pipelines using Databricks, PySpark, and SQL.
• Build and govern robust dimensional data models, ETL/ELT workflows, and high-performance reporting datasets.
• Profile, tune, and optimize pipeline performance, resource utilization, and overall data quality across the platform.
• Partner with risk analysts, business stakeholders, and software developers to translate business logic into scalable data solutions.
• Contribute to cloud data architecture, CI/CD automation, pipeline monitoring, and data governance standards.
• Mentor junior and mid-level data engineers while championing clean engineering standards and automated testing.

Skills

Databricks

PySpark

SQL

Data modeling

ETL/ELT

Power BI

Python scripting

CI/CD

Data governance

Tools

Azure Data Lake (ADLS)

Azure Data Factory (ADF)

Job description

SNI is seeking a skilled Data Engineer to design and optimize enterprise-grade data pipelines, models, and reporting datasets. You will collaborate with risk analysts, developers, and business stakeholders to translate complex logic into scalable data solutions, while promoting best practices in cloud architectures, CI/CD, and data governance.

The role involves mentoring junior engineers and delivering robust, automated data pipelines within Azure-based ecosystems and Power BI reporting