Tech Lead – Databricks & Data Platform

Sollers Consulting; Warszawa; Hybrid; PLN 180,000 - 240,000; Full time

Job summary

Sollers Consulting in Poland is seeking a Senior Data Engineer/Tech Lead to steer enterprise-scale data platform initiatives for a major international client. You will act as a key technical sparring partner with business stakeholders and IT teams in a hybrid work setup.

You will own end-to-end ETL/ELT pipelines using the Medallion Architecture, design Databricks environments, drive DataOps and CI/CD, and mentor a team of data engineers in Poland.

Qualifications

• 5+ years of commercial experience in data engineering or similar data-focused roles.
• 2+ years in a Tech Lead or similar leadership position.
• Proven mastery of the Databricks platform and Spark internals.
• Strong command of English (C1) for collaboration with international stakeholders.
• Solid understanding of software engineering principles (data structures, algorithms, design paradigms).

Responsibilities

• Lead the technical delivery of enterprise-scale data platform initiatives for a major international client.
• Act as a key technical sparring partner for both business stakeholders and IT teams.
• Take full technical ownership of end-to-end ETL/ELT pipelines using the Medallion Architecture.
• Design and optimize advanced Databricks environments and oversee platform architecture, cost-to-performance, and governance.
• Drive DataOps and CI/CD strategy to enable automated and scalable data delivery.
• Mentor and guide a team of data engineers in Poland, ensuring high code quality through reviews.

Skills

English (C1)

Leadership

Team mentoring

Tools

Databricks

Spark

Python

SQL

Azure

Job description

Flexible working hours and a hybrid home office model (2-3 times per week in the office) as work-life balance is crucial at Sollers.

A chance to be promoted twice a year.

A clearly defined career path and salary forecast.

Opportunities for growth with a training budget that you can use for courses, conferences. We also provide access to an online course platform and organize and co-fund language classes.

An internal coach to guide you through the onboarding and further training and career opportunities and a budget to be used for your lunches together.

A chance to #domore for the planet and the community as part of Sollers Change Makers - our volunteering program.

Lots of teambuilding activities, trips, hobby groups and cultural events to create a company powered by teamwork.

Great places to work: comfortable offices in city centres with chill zones (foosball tables, PS5, etc.) and team lunches on regular basis.

Probably all the benefits you can think of.

About the role. You will:

• Lead the technical delivery of enterprise-scale data platform initiatives for a major international client.
• Act as a key technical sparring partner for both business stakeholders and IT teams.
• Take full technical ownership of end-to-end ETL/ELT pipelines using the Medallion Architecture.
• Design and optimize advanced Databricks environments, taking responsibility for the overall platform architecture, cost-to-performance ratio, and data governance strategies.
• Drive the DataOps and CI/CD strategy to ensure automated and scalable data delivery.
• Mentor and guide a team of data engineers in Poland, ensuring top-tier code quality through peer reviews and advanced engineering standards.

About the skills and tools. You will use:

• Advanced pySpark for distributed processing extending far beyond basic data manipulation (deep understanding of Spark internals), including Structured Streaming.
• Databricks platform as your core ecosystem, leveraging Asset Bundles (DABs), Databricks Workflows, Lakeflow Pipelines.
• Advanced data governance, utilizing Unity Catalog for end-to-end lineage and fine-grained security.
• Various performance tuning strategies – e.g. Liquid Clustering, partitioning, skew handling, broadcast, compute optimization.
• Azure ecosystem services supporting the data platform, primarily ADLS Gen2, Azure Data Factory (ADF), Azure SQL, Key Vault, Azure Functions, and Azure Entra ID.
• Data architectures, focusing on Data Lakehouse and Medallion patterns.
• Core programming and query languages: Python and SQL.

About the requirements. You need:

• At least 5 years of commercial experience in data engineering or similar data-focused roles.
• A minimum of 2 years of experience in a Tech Lead or similar technical leadership position.
• Proven mastery of the Databricks platform and a deep understanding of Spark internals and performance tuning.
• Strong command of English (C1 level) for daily, direct collaboration with international stakeholders.
• A solid understanding of software engineering principles, including data structures, algorithms, and design paradigms.

About the wishes. Nice to haves:

• Previous experience in IT consulting or direct client-facing advisory roles.
• Domain knowledge within the insurance or financial sectors.
• Practical experience in data modeling and logical or physical design.
• Professional certifications such as Databricks Certified Data Engineer Professional or Azure Data Engineer Associate.