Senior Data Engineer - Burton upon Trent

Crimson; Stafford; Hybrid; GBP 64,000 - 67,000; Full time

Job summary

A data solutions company based in Burton on Trent is seeking a Senior Data Engineer to lead the development of their Azure-based data platform. You will design scalable data pipelines and enhance data quality while mentoring junior engineers. Ideal candidates have expertise in Azure Databricks, Data Factory, and strong programming skills in Python and SQL. This role offers a competitive salary and flexibility for one day a week on-site.

Qualifications

• Expert in Azure Databricks and related services.
• Strong experience with Azure Data Factory and Synapse Analytics.
• Proficient in Python, Scala, C#, .NET, and SQL.

Responsibilities

• Design, build, and maintain Azure data pipelines.
• Develop scalable data models, warehouses, and lakes.
• Enforce compliance and data protection standards.

Skills

Azure Databricks

Azure Data Factory

Synapse Analytics

Data Lake Storage

Python

C#

SQL (T-SQL)

Infrastructure as Code

CI/CD

Data modeling

Job description

Senior Data Engineer - Burton on Trent

64-67k

x1 day per week on-site

(Sponsorship is not provided for this opportunity)

As a Senior Data Engineer, you will lead the development and optimisation of our customers Azure-based data platform, ensuring efficient, secure, and high-performing data services. You’ll design scalable pipelines and data models, champion data governance and best practices, and drive continuous improvement to enhance data quality and accessibility across the business.

Key Responsibilities

• Data Engineering: Design, build, and maintain Azure data pipelines using Data Factory, Databricks, and related services.
• Data Architecture: Develop and optimise scalable data models, warehouses, and lakes (Azure Synapse, Data Lake Storage).
• Governance & Security: Enforce compliance and data protection standards (GDPR, DPA) through robust security and governance practices.
• Automation: Implement CI/CD pipelines and Infrastructure as Code (Terraform, Bicep, ARM) via Azure DevOps.
• Performance & Monitoring: Optimise data systems for cost, performance, and reliability; proactively resolve platform issues.
• Collaboration: Work closely with analysts and data scientists, mentoring junior engineers and promoting best practices.
• Innovation: Explore new Azure technologies to enhance platform capabilities and analytics.
• Documentation: Maintain clear technical documentation and share knowledge across teams.

Skills & Experience

• Expert in Azure Databricks (Unity Catalog, DLT, cluster management).
• Strong experience with Azure Data Factory, Synapse Analytics, Data Lake Storage, Stream Analytics, Event Hubs.
• Proficient in Python, Scala, C#, .NET, and SQL (T-SQL).
• Skilled in data modelling, quality, and metadata management.
• Experience with CI/CD and Infrastructure as Code using Azure DevOps and Terraform.
• Strong analytical, communication, and stakeholder engagement skills.
• Exposure to machine learning engineering is desirable.

Interested? Please submit your updated CV to (url removed) for consideration.

Not interested? Do you know someone who might be a perfect fit for this role? Refer a friend and earn 250 worth of vouchers!

Crimson is acting as an employment agency regarding this vacancy