Databricks Platform Lead: Spark Modernization

Vaillant Group Business Services; Katowice; Hybrid; PLN 180,000 - 300,000; Full time

Benefits offered by this job

Hybrid work model 70/30

Remote work up to 30 days from abroad

Private medical care (Medicover)

Group insurance

Sport card subsidy (Multisport)

Job summary

Vaillant Group is seeking a Lead Data Engineer in Katowice to define and drive the evolution of our enterprise data platform. You will champion Databricks modernization and establish scalable frameworks while leading technical teams in a hybrid work environment.

You will design core platform capabilities, optimize Spark performance, and translate business requirements into robust technical designs within an agile setting.

Qualifications

• Degree in computer science, data engineering, information systems, or comparable field.
• Several years of data engineering experience with technical leadership responsibilities.
• Strong programming in Python and SQL, with software engineering practices.

Responsibilities

• Define and drive evolution of enterprise data platform for scalability and cost efficiency.
• Lead Databricks modernization, migrate workloads to Spark Declarative Pipelines, establish reusable patterns.
• Hands-on development, review critical code, and set engineering standards across data ecosystem.
• Optimize Spark performance, cluster utilization, and Databricks costs with data-driven insights.

Skills

Databricks

Apache Spark

Python

SQL

CI/CD

Testing

Observability

Automation

Data platform

Team leadership

Education

Bachelor's degree in Computer Science or Data Engineering

Tools

Databricks

Apache Spark

Delta Lake

Job description

Vaillant Group is seeking a Lead Data Engineer in Katowice to define and drive the evolution of our enterprise data platform. You will champion Databricks modernization and establish scalable frameworks while leading technical teams in a hybrid work environment.

You will design core platform capabilities, optimize Spark performance, and translate business requirements into robust technical designs within an agile setting.