Azure Data Engineer: Data Lake, ETL & Real-Time Pipelines

Sii Poland; Warszawa; On-site; PLN 120,000 - 180,000; Full time

Job summary

Sii Poland is seeking a data-focused professional to join its Data & Analytics Competence Center in Warsaw. You will design and build scalable data processing platforms within Data Lake architecture and work on ETL/ELT pipelines in Azure Databricks.

You will model data, optimize pipelines, and collaborate with data analysts, BI teams, and Data Science to prepare data for analytical and business needs. Documentation and stakeholder communication are essential.

Qualifications

• Designing, building, and developing scalable and high-performance data processing platforms in Data Lake / Data Platform architecture
• Creating and maintaining ETL/ELT pipelines for data integration from various sources and processing them in the Azure Databricks environment
• Data modeling and preparing data structures tailored to analytical and business needs
• Implementing solutions for data processing (batch and/or near real-time)
• Monitoring, optimizing, and developing existing pipelines and data processing processes
• Collaborating with data analysts, BI teams, and Data Science on data preparation and sharing
• Gathering business requirements and proposing optimal technological solutions
• Creating and maintaining technical documentation for developed solutions

Responsibilities

• Designing, building, and developing scalable and high-performance data processing platforms in Data Lake / Data Platform architecture
• Creating and maintaining ETL/ELT pipelines for data integration from various sources and processing them in the Azure Databricks environment
• Data modeling and preparing data structures tailored to analytical and business needs
• Implementing solutions for data processing (batch and/or near real-time)
• Monitoring, optimizing, and developing existing pipelines and data processing processes
• Collaborating with data analysts, BI teams, and Data Science on data preparation and sharing
• Gathering business requirements and proposing optimal technological solutions
• Creating and maintaining technical documentation for developed solutions

Tools

Azure Databricks

ETL/ELT pipelines

Job description

Sii Poland is seeking a data-focused professional to join its Data & Analytics Competence Center in Warsaw. You will design and build scalable data processing platforms within Data Lake architecture and work on ETL/ELT pipelines in Azure Databricks.

You will model data, optimize pipelines, and collaborate with data analysts, BI teams, and Data Science to prepare data for analytical and business needs. Documentation and stakeholder communication are essential.