Senior Data Engineer: Azure, Spark & Data Platform Lead

Emergn; Greater London; Hybrid; GBP 45.000 - 47.000; Vollzeit

Benefits dieser Stelle

Health insurance

Life and disability insurance

20 working days vacation

Flexible work model

Training and certification programs

Free parking

Birthday gift

Zusammenfassung

Emergn is seeking a Senior Data Engineer to help shape our exciting future and play a vital role in growth. You will lead the design and development of scalable data pipelines using Python and Apache Spark, architect modern data platforms on Azure and Fabric, and own end-to-end data delivery with a focus on quality and reliability.

You will mentor teams, drive engineering best practices, and collaborate with stakeholders to translate business needs into robust data solutions.

Qualifikationen

• Hands-on experience with Python and Apache Spark in data engineering environments.
• Strong experience building solutions on Azure (Data Factory, Synapse, Data Lake).
• Practical experience with Microsoft Fabric and modern cloud data architectures.
• Experience with data processing libraries such as Pandas, NumPy or Polars.
• Proven leadership skills with experience guiding and developing engineering teams.
• Highly adaptable, thriving in fast-paced, evolving environments.
• Strong proactivity and ownership mindset, driving initiatives independently.
• Excellent stakeholder management and communication skills.

Aufgaben

• Lead the design and development of scalable data pipelines using Python and Apache Spark.
• Architect and deliver modern data platforms on Microsoft Azure and Microsoft Fabric.
• Own end-to-end data engineering delivery, ensuring quality, performance, and reliability.
• Provide technical leadership, mentoring teams and driving engineering best practices.
• Collaborate with stakeholders to translate business needs into effective data solutions.
• Ensure data governance, security, and compliance across all platforms.
• Proactively identify improvements, risks, and opportunities, driving continuous optimisation.

Kenntnisse

Python

Apache Spark

Leadership

Stakeholder management

Communication

Data governance

Proactivity/ownership

Mentoring

Tools

Azure

Data Factory

Synapse

Data Lake

Microsoft Fabric

Pandas

NumPy

Polars

Jobbeschreibung

Emergn is seeking a Senior Data Engineer to help shape our exciting future and play a vital role in growth. You will lead the design and development of scalable data pipelines using Python and Apache Spark, architect modern data platforms on Azure and Fabric, and own end-to-end data delivery with a focus on quality and reliability.

You will mentor teams, drive engineering best practices, and collaborate with stakeholders to translate business needs into robust data solutions.