Senior Data Platform Engineer

HEINEKEN; Kraków; On-site; PLN 150,000 - 240,000; Full time

Job summary

HEINEKEN Kraków is seeking a Senior Data Platform Engineer to join the Global Platform Team. You will drive data processing frameworks, work with Databricks, PySpark, and SQL to build scalable pipelines across streaming and batch workloads.

You will collaborate with cross-functional teams, implement Delta optimization, and stay on the cutting edge of the Databricks lakehouse architecture, Unity Catalog, and declarative pipelines while contributing to a data-driven culture.

Qualifications

• 5+ years of experience in data/software engineering building data frameworks for large-scale processing.
• Excellent Python and software development skills, including OOP and testing with pytest/unittest.
• Ability to write elegant and maintainable code (pylint/pyright is a plus).
• Experience with Python libraries: Pydantic, SQLGlot.
• Proficiency building data pipelines with PySpark including performance observability and tuning.
• Databricks skills: building data pipelines (batch/streaming) using Lakeflow DLt and Job-based orchestration; Unity Catalog familiarity.

Responsibilities

• Design and build scalable data processing frameworks for streaming and batch workloads.
• Work on big data using PySpark and SQL, optimize pipelines and contribute to a modern Data Lakehouse built on medallion architecture.
• Collaborate with cross-functional teams to create seamless ETL/ELT processes and drive performance optimizations.
• Build efficient and scalable solutions leveraging Databricks features like Structured Streaming and Unity Catalog.
• Collaborate using Git in an agile environment and continuously refine the common code base.

Skills

Python programming

OOP principles

pytest/unittest

Git

Databricks

PySpark

Data pipelines

Tools

GitHub

GitLab

Azure DevOps

Unity Catalog

Job description

Digital & Technology Team (D&T)is an integral division ofHEINEKEN Global Shared Services Center. We are committed to making Heineken the most connected brewery. That includes digitalizing and integrating our processes, ensuring best-in-class technology, and embedding a data-driven culture. By joining us you will work in one of the most dynamic and innovative teams and have a direct impact on building the future of Heineken!

Would you like to meet the Team, see our office and much more? Visit our website: Heineken (heineken-dt.pl)

Are you passionate about leveraging cutting-edge technology to shape the future of data platform engineering? Do you thrive in dynamic environments, working with modern tools like Databricks, Azure, and Apache Spark? If so, we have the perfect opportunity for you!

At Heineken, we are not just brewers of the world’s most iconic beers—we are a data-driven company that values innovation and continuous improvement. As aSenior Data Platform Engineerin our Global Platform Team, you will play a crucial role in driving our data strategies and transforming how we manage, process, and analyze large-scale data.

Your responsibilities would include:

• designing and building scalable data processing frameworks that support both streaming and batch workloads, aligning with our metadata-driven architecture
• working on big data using PySpark and SQL, optimizing data pipelines and contributing to the development of our modern Data Lakehouse built on the medallion architecture
• collaborating with cross-functional teams to create seamless ETL/ELT processes and drive performance optimization using techniques like Delta optimization, Z-ordering, and liquid clustering
• taking ownership of building efficient and scalable solutions leveraging the latest trends in Databricks, including Structured Streaming, Lakeflow Declarative Pipelines, Unity Catalog, and DBSQL
• collaborating using Git, working in a fast-paced, agile environment, and continuously refining our common code base.

You are a good candidate if you have:

• 5+ years of experience in data/software engineering roles, with hands-on experience in building and maintaining data frameworks for large-scale distributed data processing
• excellent Python and software development skills, including OOP principles and familiarity with Python testing libraries like pytest/unittest
• the ability to write elegant and maintainable code (knowledge of pylint/pyright is a plus)
• experience with following python libraries: Pydantic, SQLGlot
• proficiency with building data pipelines using Pyspark including performance observability and tuning
• Databricks skills: Proficiency in building data pipelines (batch/streaming) using Lakeflow Declarative Pipelines (DLT) and Job-based orchestration. Familiarity about Unity Catalog. Comfortable staying on top of latest advancements in Databricks platform
• Strong knowledge of data ingestion techniques, data warehousing, medallion architecture, and performance optimization for big data.
  knowledge about version control, standard approaches like gitflow, trunk-based, application in GitHub, GitLab, Azure Devops

At HEINEKEN Kraków, we take integrity and ethical conduct seriously. If someone has concerns about a possible violation of legal regulations indicated in Polish Whistleblowing Act or our Code of Business Conduct, we encourage them to speak up. Cases can be reported to global team or locally (in line with the local HGSS Whistleblowing procedure) by selecting proper option in this tool or by communicating it on hotline.