Data Engineer

Deerfoot Recruitment Solutions Ltd; Letchworth; Hybride; GBP 50 000 - 55 000; Plein temps

Résumé du poste

Deerfoot Recruitment Solutions Ltd. is seeking a Data Engineer to join a growing data platform initiative. This role offers remote work with occasional travel to Letchworth and a chance to shape an Azure-based data platform from the ground up.

You'll collaborate with stakeholders to translate business needs into robust data pipelines using Python, PySpark and SQL, while building and tuning scalable data models and supporting BI across the group.

Qualifications

• Hands-on experience as a Data Engineer, building and maintaining data pipelines.
• Strong Python and PySpark skills.
• Experience with Azure data services such as Synapse, Databricks or Data Factory.
• Good SQL and data modelling skills.
• Confidence working with stakeholders to turn business needs into data solutions.

Responsabilités

• Gathering requirements with data, product and senior stakeholders, and helping them with data-related technical issues
• Designing conceptual, logical and physical data models for the new platform
• Building metadata-driven pipelines across Azure Synapse, Data Factory and PostgreSQL using Python and PySpark
• Migrating data from legacy reporting solutions onto the platform while protecting data integrity
• Releasing code through Azure DevOps and Git, and keeping documentation and data mapping up to date
• Monitoring and tuning data loads, supporting BI users, and joining an out-of-hours rota for business-critical issues

Connaissances

Python

PySpark

SQL

Stakeholder communication

Data modelling

Outils

Azure Synapse

Azure Data Factory

Databricks

Azure DevOps

Description du poste

Data Engineer
Remote (Occasional Travel to Letchworth office)
£50,000 - £55,000 per annum + benefits
Permanent

Do you want to build a data platform from the ground up rather than inherit someone else's? This Data Engineer role puts you at the start of a new Azure data platform for a well-established UK group with several businesses under one roof.

You’ll join a small team of data engineers and own work end to end: talking to stakeholders, designing models, building and testing pipelines in Python and PySpark, and supporting BI. It's essentially remote, and the platform will grow from one business to the whole group, so there's plenty to get your hands on.

What You'll Be Doing

• Gathering requirements with data, product and senior stakeholders, and helping them with data-related technical issues
• Designing conceptual, logical and physical data models for the new platform
• Building metadata-driven pipelines across Azure Synapse, Data Factory and PostgreSQL using Python and PySpark
• Migrating data from legacy reporting solutions onto the platform while protecting data integrity
• Releasing code through Azure DevOps and Git, and keeping documentation and data mapping up to date
• Monitoring and tuning data loads, supporting BI users, and joining an out-of-hours rota for business-critical issues

What You'll Bring

• Hands-on experience as a Data Engineer, building and maintaining data pipelines
• Strong Python and PySpark skills
• Experience with Azure data services such as Synapse, Databricks or Data Factory
• Good SQL and data modelling skills
• Confidence working with stakeholders to turn business needs into data solutions

Desirable: Microsoft Fabric, Tableau administration, Power BI, master data management (MDM), CI/CD with Azure DevOps

This role may suit candidates who have held roles including: Azure Data Engineer, BI Developer, Analytics Engineer, ETL Developer, Data Platform Engineer, SQL Developer, Python Developer