Lead Data Engineer - Databricks Platform

Vaillant Group; Katowice; Hybrid; PLN 180,000 - 260,000; Full time

Benefits offered by this job

Hybrid work model

Health & Wellness programs

Time off & balance

Discount on company products

Training & development

Company events

Job summary

Vaillant Group in Katowice, Poland, invites an experienced Lead Data Engineer to shape and modernize our enterprise data platform on Databricks. You will drive scalability, reliability and cost efficiency while mentoring engineers in a hybrid, fast-evolving environment.

You will lead migration to Spark Declarative Pipelines, implement reusable frameworks, optimize Spark performance, and collaborate with stakeholders to translate business needs into robust data solutions.

Qualifications

• Degree in computer science, data engineering, information systems, or a comparable field.
• Several years of data engineering experience with technical leadership or senior responsibilities.
• Deep knowledge of Databricks and Apache Spark, including Delta Lake and modern data architectures.
• Strong programming in Python and SQL; apply software engineering practices like CI/CD and testing.
• Nice to have: Spark Declarative Pipelines & Declarative Automation Bundles.
• Proficient English communication.

Responsibilities

• Define and drive the technical evolution of our enterprise data platform for scalability and cost efficiency.
• Lead our Databricks modernization journey, migrating workloads toward Spark Declarative Pipelines.
• Design and implement core platform capabilities, review critical code, and set engineering standards.
• Optimize Spark performance, cluster utilization, workload efficiency, and Databricks costs.
• Support engineering teams and stakeholders, translating business requirements into robust designs.
• Drive agile delivery: planning, backlog refinement, estimations and deployments.
• Foster innovation with automation, DevOps practices, and reduction of technical debt.

Skills

Databricks

Apache Spark

Python

SQL

CI/CD

Observability

Education

Degree in computer science / data engineering / information systems

Tools

Databricks

Delta Lake

Spark

Job description

Lead Data Engineer - Databricks Platform

• COUNTRIES

MY PROFILE

• CORPORATE WEBSITE

Job Description

Having a global team of 16.000 colleagues and more than 70 nationalities. And enabling many of them to work flexibly when needed.Both count. Both are us.

Company: Vaillant Group Location:Katowice-POL Country: Poland (PL) Brand: Vaillant Group

Contract type: Permanent Working time: Full-time

What we achieve together

• As aLead Data Engineer, you define and drive the technical evolution of our enterprise data platform, ensuring scalability, reliability, maintainability, and cost efficiency.
• You lead ourDatabricks modernization journey, driving the migration of existing workloads toward Spark Declarative Pipelines and modern engineering patterns while establishing reusable frameworks and best practices.
• Through hands-on development and team collaboration, you design and implement core platform capabilities, review critical code contributions, and set engineering standards across the data ecosystem.
• You continuously optimize the platform by improving Spark performance, cluster utilization,workload efficiency, and overall Databricks costs, using data-driven insights and engineering best practices.
• As a trusted consultant and technical authority, yousupport engineering teams and stakeholders in solving complex data challenges, evaluating solution approaches, and translating business requirements into robust technical designs.
• By driving efficient delivery processes, you support sprint planning, backlog refinement, effort estimations and deployment practices while ensuring alignment with product goals and stable environments.
• You actively foster innovation by evaluating new technologies, promoting automation and DevOps practices, and identifying as well as reducing technical debt.

What makes us successful together

• Qualification:You have a degree in computer science, data engineering, information systems, or a comparable field.
• Experience:You bring several years of experience in data engineering and have already taken ownership of technical leadership or senior engineering responsibilities.
• Know-how and skills:You possess deep knowledge of Databricks and Apache Spark, including performance tuning, workload management, Delta Lake, and modern data processing architectures. You have strong programming skills in Python and SQL and apply software engineering principles such as testing, CI/CD, code quality, observability, and automation to data platform development.
• Nice to have:Experience with Spark Declarative Pipelines & Declarative Automation Bundles
• Personality:You are a proactive and empathetic professional who clearly communicates complex technical topics, inspires others, and enjoys working collaboratively in an agile environment toward long-running strategic goals.
• Language skills:You communicate confidently in English.

What you can count on

• Flexible work model: adjustable starting times (7:30 – 9:00AM), hybrid work 70/30, and up to 30 days of remote work from abroad from selected countries.
• Health & Wellness support: private medical care (Medicover), sports card subsidy (Multisport), group insurance (Warta), and ergonomic office spaces.
• Time off & balance: additional paid 2 days off and subsidies for recreation.
• Financial perks: up to 30% discount on company products, support for commuting and eyewear.
• Growth & Development: access to internal training, mentoring programs, self-learning platform for languages (eTutor) and international projects.
• Culture & Community: company events, family friendly activities, and open opportunities within Vaillant Group.

What makes us special

We take care of a better climate. In every home and our environment. As a successful family business, we have been living up to this claim for over 150 years. We are one of the world's leading providers of heat pumps, digital services and efficient gas heating appliances and offer energy-saving solutions.

You will find sustainability everywhere at the Vaillant Group. In the office, at the production sites and on the road. Around 16,000 employees from over 70 countries are committed to this every day. As an international team, we take responsibility - for our future and that of our planet. We promote your personal development so that you can act with passion and together we can ensure a better climate.

Become part of the Vaillant Group and help us shape the future of heating!

We promote equity and do not tolerate any form of discrimination. We value the uniqueness of each individual and encourage all people to apply.