Lead Data Engineer - Databricks Platform

Vaillant Group Business Services; Katowice; Hybrid; PLN 180,000 - 300,000; Full time

Benefits offered by this job

Hybrid work model 70/30

Remote work up to 30 days from abroad

Private medical care (Medicover)

Group insurance

Sport card subsidy (Multisport)

Job summary

Vaillant Group is seeking a Lead Data Engineer in Katowice to define and drive the evolution of our enterprise data platform. You will champion Databricks modernization and establish scalable frameworks while leading technical teams in a hybrid work environment.

You will design core platform capabilities, optimize Spark performance, and translate business requirements into robust technical designs within an agile setting.

Qualifications

• Degree in computer science, data engineering, information systems, or comparable field.
• Several years of data engineering experience with technical leadership responsibilities.
• Strong programming in Python and SQL, with software engineering practices.

Responsibilities

• Define and drive evolution of enterprise data platform for scalability and cost efficiency.
• Lead Databricks modernization, migrate workloads to Spark Declarative Pipelines, establish reusable patterns.
• Hands-on development, review critical code, and set engineering standards across data ecosystem.
• Optimize Spark performance, cluster utilization, and Databricks costs with data-driven insights.

Skills

Databricks

Apache Spark

Python

SQL

CI/CD

Testing

Observability

Automation

Data platform

Team leadership

Education

Bachelor's degree in Computer Science or Data Engineering

Tools

Databricks

Apache Spark

Delta Lake

Job description

What we achieve together

• As a Lead Data Engineer, you define and drive the technical evolution of our enterprise data platform, ensuring scalability, reliability, maintainability, and cost efficiency.
• You lead our Databricks modernization journey, driving the migration of existing workloads toward Spark Declarative Pipelines and modern engineering patterns while establishing reusable frameworks and best practices.
• Through hands-on development and team collaboration, you design and implement core platform capabilities, review critical code contributions, and set engineering standards across the data ecosystem.
• You continuously optimize the platform by improving Spark performance, cluster utilization, workload efficiency, and overall Databricks costs, using data-driven insights and engineering best practices.
• As a trusted consultant and technical authority, you support engineering teams and stakeholders in solving complex data challenges, evaluating solution approaches, and translating business requirements into robust technical designs.
• By driving efficient delivery processes, you support sprint planning, backlog refinement, effort estimations and deployment practices while ensuring alignment with product goals and stable environments.
• You actively foster innovation by evaluating new technologies, promoting automation and DevOps practices, and identifying as well as reducing technical debt.

What makes us successful together

• Qualification: You have a degree in computer science, data engineering, information systems, or a comparable field.
• Experience: You bring several years of experience in data engineering and have already taken ownership of technical leadership or senior engineering responsibilities.
• Know-how and skills: You possess deep knowledge of Databricks and Apache Spark, including performance tuning, workload management, Delta Lake, and modern data processing architectures. You have strong programming skills in Python and SQL and apply software engineering principles such as testing, CI/CD, code quality, observability, and automation to data platform development.
• Nice to have: Experience with Spark Declarative Pipelines & Declarative Automation Bundles
• Personality: You are a proactive and empathetic professional who clearly communicates complex technical topics, inspires others, and enjoys working collaboratively in an agile environment toward long-running strategic goals.
• Language skills: You communicate confidently in English.

What you can count on

• Flexible work model: adjustable starting times (7:30 – 9:00AM), hybrid work 70/30, and up to 30 days of remote work from abroad from selected countries.
• Health & Wellness support: private medical care (Medicover), sports card subsidy (Multisport), group insurance (Warta), and ergonomic office spaces.
• Time off & balance: additional paid 2 days off and subsidies for recreation.
• Financial perks: up to 30% discount on company products, support for commuting and eyewear.
• Growth & Development: access to internal training, mentoring programs, self-learning platform for languages (eTutor) and international projects.
• Culture & Community: company events, family friendly activities, and open opportunities within Vaillant Group.

What makes us special

We take care of a better climate. In every home and our environment. As a successful family business, we have been living up to this claim for over 150 years. We are one of the world's leading providers of heat pumps, digital services and efficient gas heating appliances and offer energy-saving solutions.

You will find sustainability everywhere at the Vaillant Group. In the office, at the production sites and on the road. Around 16,000 employees from over 70 countries are committed to this every day. As an international team, we take responsibility - for our future and that of our planet. We promote your personal development so that you can act with passion and together we can ensure a better climate.

Become part of the Vaillant Group and help us shape the future of heating!

We promote equity and do not tolerate any form of discrimination. We value the uniqueness of each individual and encourage all people to apply.