Lead Data Engineer: Azure, Databricks & Data Architecture

LSEG; Gdynia; Hybrid; PLN 203,800 - 322,200; Full time

Benefits offered by this job

Healthcare

Retirement planning

Wellbeing initiatives

Job summary

LSEG is seeking a strategic Lead Data Engineer to own the data ecosystem, drive architecture decisions, and ensure robust, scalable data workflows. The role blends technical leadership with hands-on engineering expertise to mentor others and deliver reliable data platforms.

Senior Associate level with a focus on Azure Data Factory, SQL Server, Python (pyspark), and Databricks. Competitive base salary and annual bonus eligibility are provided, with a broad benefits program.

Qualifications

• Expert-level experience with Azure Data Factory for orchestrating complex ETL/ELT workflows.
• Strong proficiency in SQL Server, including performance tuning and advanced query optimization.
• Practical Python (pyspark) experience for data manipulation, automation, and pipeline logic.
• Hands-on expertise with Databricks for Spark-based processing, data analytics, and notebook workflows.
• Proven ability to design scalable data architectures and lead technical initiatives.

Responsibilities

• Architect, design, and maintain complex data pipelines in Azure Data Factory, ensuring efficiency, scalability, and reliability.
• Build and optimize data models and transformations using SQL Server.
• Develop Python scripts for automation, data processing, quality checks, and integration tasks.
• Implement and optimize Databricks workflows for advanced analytics, Spark-based processing, and collaborative notebook development.
• Fix pipeline issues and implement long-term improvements that strengthen data quality and system resilience.
• Collaborate with multi-functional teams to align data solutions with business objectives and decision-making needs.
• Mentor junior engineers and establish best practices for data engineering and governance.

Skills

Azure Data Factory

SQL Server

Python (pyspark)

Databricks

Data architecture

Tools

AWS Athena

Terraform

Job description

LSEG is seeking a strategic Lead Data Engineer to own the data ecosystem, drive architecture decisions, and ensure robust, scalable data workflows. The role blends technical leadership with hands-on engineering expertise to mentor others and deliver reliable data platforms.

Senior Associate level with a focus on Azure Data Factory, SQL Server, Python (pyspark), and Databricks. Competitive base salary and annual bonus eligibility are provided, with a broad benefits program.