Lead Data Engineer - Databricks Platform

Vaillant Group; Katowice; Hybrid; PLN 240,000 - 360,000; Full time

Benefits offered by this job

Flexible starting times

Hybrid work 70/30

Remote work up to 30 days abroad

Private medical care

Sports card subsidy

Group insurance

Ergonomic office spaces

2 extra paid days off

Recreation subsidies

Discount on company products

Commuting support

Eyewear subsidy

Internal training

Mentoring programs

Language learning platform (eTutor)

International projects

Company events

Family friendly activities

Open opportunities within Vaillant

Job summary

Vaillant Group in Katowice, Poland, is seeking a Lead Data Engineer to drive the technical evolution of our enterprise data platform, ensuring scalability, reliability, and cost efficiency.

You will lead the Databricks modernization journey, migrate workloads to Spark Declarative Pipelines, design core platform capabilities, and set engineering standards.

The role requires Python/SQL expertise, Databricks mastery, and strong stakeholder collaboration in an agile environment.

Qualifications

• Degree in computer science, data engineering, information systems, or a related field.
• Several years of experience in data engineering with technical leadership responsibilities.
• Deep knowledge of Databricks and Apache Spark, including performance tuning, workloads, Delta Lake and modern data processing architectures.
• Strong programming in Python and SQL and applying software engineering principles (testing, CI/CD, code quality, observability, automation) to data platforms.
• Nice to have: Spark Declarative Pipelines & Declarative Automation Bundles.
• Proactive and collaborative, with clear communication of complex technical topics in English in an agile environment.

Responsibilities

• Define and drive the technical evolution of our enterprise data platform, ensuring scalability, reliability, maintainability, and cost efficiency.
• Lead our Databricks modernization journey, migrating workloads toward Spark Declarative Pipelines and modern engineering patterns with reusable frameworks.
• Design and implement core platform capabilities, review critical code contributions, and set engineering standards across the data ecosystem.
• Continuously optimize the platform by improving Spark performance, cluster utilization, workload efficiency, and Databricks costs.
• Act as trusted consultant for engineering teams, translating business requirements into robust technical designs.
• Support sprint planning, backlog refinement, estimations and deployment practices to align with product goals and stable environments.
• Foster innovation by evaluating new technologies, promoting automation and DevOps, and reducing technical debt.

Skills

Databricks & Spark

Python

SQL

Delta Lake

Modern data architectures

CI/CD & observability

English

Spark Declarative Pipelines

Education

Degree in computer science or related field

Job description

Company: Vaillant Group Location: Katowice-POL Country: Poland (PL) Brand: Vaillant Group

Contract type: Permanent Working time: Full-time

What We Achieve Together

• As a Lead Data Engineer, you define and drive the technical evolution of our enterprise data platform, ensuring scalability, reliability, maintainability, and cost efficiency.
• You lead our Databricks modernization journey, driving the migration of existing workloads toward Spark Declarative Pipelines and modern engineering patterns while establishing reusable frameworks and best practices.
• Through hands-on development and team collaboration, you design and implement core platform capabilities, review critical code contributions, and set engineering standards across the data ecosystem.
• You continuously optimize the platform by improving Spark performance, cluster utilization, workload efficiency, and overall Databricks costs, using data-driven insights and engineering best practices.
• As a trusted consultant and technical authority, you support engineering teams and stakeholders in solving complex data challenges, evaluating solution approaches, and translating business requirements into robust technical designs.
• By driving efficient delivery processes, you support sprint planning, backlog refinement, effort estimations and deployment practices while ensuring alignment with product goals and stable environments.
• You actively foster innovation by evaluating new technologies, promoting automation and DevOps practices, and identifying as well as reducing technical debt.

What Makes Us Successful Together

• Qualification: You have a degree in computer science, data engineering, information systems, or a comparable field.
• Experience: You bring several years of experience in data engineering and have already taken ownership of technical leadership or senior engineering responsibilities.
• Know-how and skills: You possess deep knowledge of Databricks and Apache Spark, including performance tuning, workload management, Delta Lake, and modern data processing architectures. You have strong programming skills in Python and SQL and apply software engineering principles such as testing, CI/CD, code quality, observability, and automation to data platform development.
• Nice to have: Experience with Spark Declarative Pipelines & Declarative Automation Bundles
• Personality: You are a proactive and empathetic professional who clearly communicates complex technical topics, inspires others, and enjoys working collaboratively in an agile environment toward long-running strategic goals.
• Language skills: You communicate confidently in English.

What You Can Count On

• Flexible work model: adjustable starting times (7:30-9:00AM), hybrid work 70/30, and up to 30 days of remote work from abroad from selected countries.
• Health & Wellness support: private medical care (Medicover), sports card subsidy (Multisport), group insurance (Warta), and ergonomic office spaces.
• Time off & balance: additional paid 2 days off and subsidies for recreation.
• Financial perks: up to 30% discount on company products, support for commuting and eyewear.
• Growth & Development: access to internal training, mentoring programs, self-learning platform for languages (eTutor) and international projects.
• Culture & Community: company events, family friendly activities, and open opportunities within Vaillant Group.

What Makes Us Special

We take care of a better climate. In every home and our environment. As a successful family business, we have been living up to this claim for over 150 years. We are one of the world's leading providers of heat pumps, digital services and efficient gas heating appliances and offer energy-saving solutions.

You will find sustainability everywhere at the Vaillant Group. In the office, at the production sites and on the road. Around 16,000 employees from over 70 countries are committed to this every day. As an international team, we take responsibility - for our future and that of our planet. We promote your personal development so that you can act with passion and together we can ensure a better climate.

Become part of the Vaillant Group and help us shape the future of heating!

We promote equity and do not tolerate any form of discrimination. We value the uniqueness of each individual and encourage all people to apply.

Your Contact:

Renata Weiner

[phone]