Senior Data Engineer - MS Azure

JR United Kingdom; London; Hybrid; GBP 60,000 - 100,000; Full time

Job summary

Join a forward-thinking company as a Senior Azure Data Engineering Lead, where you will lead a talented team in developing innovative data solutions. This role offers the opportunity to design and implement secure data lake solutions on Azure, ensuring best practices in data engineering and integration. Collaborate with cross-functional teams to build a high-quality single version of truth (SVOT) platform, while enhancing performance and scalability. If you are passionate about Azure cloud services and thrive in a leadership role, this is the perfect opportunity for you to make a significant impact.

Qualifications

• Hands-on experience with Azure data services and leading data engineering teams.
• Strong programming skills in Python, PySpark, and T-SQL.

Responsibilities

• Lead and mentor a team of Azure data engineers in building data solutions.
• Design and implement scalable data lake solutions on Azure.

Skills

Azure Data Services

Apache Spark

Azure Data Factory

Synapse Analytics

PySpark

Python

T-SQL

SparkSQL

Data Modeling

ETL Processes

Data Warehousing

CI/CD Pipelines

Version Control (Git)

Problem-solving

Communication

Collaboration

Education

Azure Data Engineer Associate Certification

Azure Solutions Architect Certification

Tools

Git

Job description

Social network you want to login/join with:

Location: London - 2-3 days hybrid working in central London

Are you a seasoned data engineering expert passionate about Azure cloud services? Do you thrive in a leadership role, guiding teams to build cutting-edge data solutions? Join us as a Senior Azure Data Engineering Lead and spearhead the development of our single version of truth (SVOT) platform.

Key Responsibilities:

Leadership & Team Management:

• Lead, mentor, and manage a team of talented Azure data engineers.
• Drive the technical execution of the team.
• Collaborate with cross-functional teams including data scientists, analysts, and business stakeholders to ensure a high-quality SVOT platform.
• Design, develop, and implement scalable and secure data lake solutions on Azure.
• Ensure best practices in data engineering, data integration, and ETL processes.
• Build end-to-end pipelines to support enterprise-wide analytics.
• Code complex aspects of our data pipeline.
• Monitor and enhance the performance and scalability of the SVOT platform to ensure high availability and accessibility.

Experience & Skills:

• At least some commercial hands-on experience with Azure data services (e.g., Apache Spark, Azure Data Factory, Synapse Analytics).
• Proven experience in leading and managing a team of data engineers.
• Proficiency in programming languages such as PySpark, Python (with Pandas if no PySpark), T-SQL, and SparkSQL.
• Strong understanding of data modeling, ETL processes, and data warehousing concepts.
• Knowledge of CI/CD pipelines and version control (e.g., Git).
• Excellent problem-solving and analytical skills.
• Strong communication and collaboration abilities.
• Ability to manage multiple projects and meet deadlines.
• Certifications in Azure (e.g., Microsoft Certified: Azure Data Engineer Associate, Azure Solutions Architect) are highly desirable.