Senior Data Engineer

Jobtailor; Warszawa; On-site; PLN 180,000 - 300,000; Full time

Job summary

DSV is seeking a seasoned BI/Data Engineer to design, implement and maintain scalable data pipelines for a global-scale BI platform. You will collaborate with multiple divisions to translate requirements into robust data solutions and contribute to the ODW architecture.

The role requires strong SQL, Databricks, PySpark, and Azure Data Platform expertise, plus experience with CI/CD and Agile practices. English proficiency is essential for cross-functional collaboration.

Qualifications

• Bachelor’s or master’s degree in computer sciences, Data Science, Information Technology or a related field.
• Min 4 years of experiences in BI/Data Engineering project.
• Very good understanding and experience in developing efficient, performant and valuable BI solutions with global scale.
• Good knowledge of Microsoft’s BI stack, namely Azure Datalake, Azure SQL Database / Azure Synapse, Azure Data Factory, Synapse integration, DevOps, etc.
• Good knowledge in Databricks and PySpark/Scala/Spark SQL
• Ability to monitor, troubleshoot, and optimize data pipelines for performance and reliability
• Very good knowledge in profiling and tuning queries for efficiency
• Good knowledge of Agile methodology and CI/CD practices
• Experience with task management tools (JIRA, Confluence)
• Expert knowledge of data governance principles to ensure data quality, lineage, and compliance
• Knowledge of data modelling concepts
• Knowledge of Power BI (Interest in advancing expertise in Power BI is highly valued)
• Knowledge in Tabular Models development/maintenance
• Knowledge in PowerShell Scripting
• Experience with AI models and development
• Proficient Level of English (spoken and written)

Responsibilities

• Work with all DSV business divisions and group functions to gather information and turn data into insight.
• Design and implement solutions for the Operational Data Warehouse (ODW) aligned with IT and BI architecture principles.
• Develop and maintain scalable data pipelines for ingesting, processing and transforming large data volumes from various sources.
• Analyse requirements with department teams and create effort estimations and implementation planning.
• Document and provide technical specifications for implementations.
• Refine and promote agile delivery framework for high-quality, flexible data & BI deliverables.
• Support different department teams in a collaborative work environment.
• Transfer knowledge to other team members and the Operations & Support team.

Skills

Data engineering

English proficiency

Agile methodologies

Query optimization

Power BI

Education

Bachelor’s or Master’s degree in CS/IT/Data Science

Tools

Azure Datalake

Azure Synapse

Azure Data Factory

Databricks

PySpark

Spark SQL

PowerShell scripting

JIRA/Confluence

Job description

Responsibilities

• Working with all DSV business divisions as well as group functions to simplify information gathering and turning data into insight
• Design and implement solutions that will support the development of our Operational Data Warehouse (ODW) in alignment with IT and BI architecture principles, guidelines, and standards
• Develop and maintain scalable data pipelines for ingesting, processing and transforming large volumes of data from various sources
• Analyse requirements together with our different department teams and create effort estimations and implementation planning
• Document and provide technical specifications for the implementations
• Refine and promote our agile delivery framework to help ensure high quality and flexible deliverables on the data & BI platform
• Support different department teams in a collaborative work environment
• Actively transfer knowledge to other team members as well as the Operations & Support team

Requirements

• Bachelor’s or master’s degree in computer sciences, Data Science, Information Technology or a related field
• Min 4 years of experiences in BI/Data Engineering project
• Very good understanding and experience in developing efficient, performant and valuable BI solutions with global scale
• Good knowledge of Microsoft’s BI stack, namely Azure Datalake, Azure SQL Database / Azure Synapse, Azure Data Factory, Synapse integration, DevOps, etc.
• Good knowledge in Databricks and PySpark/Scala/Spark SQL
• Ability to monitor, troubleshoot, and optimize data pipelines for performance and reliability
• Very good knowledge in profiling and tuning queries for efficiency
• Good knowledge of Agile methodology and CI/CD practices
• Experience with task management tools (JIRA, Confluence)
• Expert knowledge of data governance principles to ensure data quality, lineage, and compliance
• Knowledge of data modelling concepts
• Knowledge of Power BI (Interest in advancing expertise in Power BI is highly valued)
• Knowledge in Tabular Models development/maintenance
• Knowledge in PowerShell Scripting
• Experience with AI models and development
• Proficient Level of English (spoken and written)

Core Competencies: Demonstrates expertise in developing and maintaining scalable data pipelines, implementing BI solutions, and ensuring data quality and compliance. Proficient in Microsoft’s BI stack and agile methodologies, with strong collaboration and knowledge transfer skills.