Data Engineer

Albany Beck; England; On-site; GBP 50,000 - 70,000; Full time

Job summary

A leading consultancy firm in the UK seeks a Data Engineer to design and maintain high-quality data pipelines and models. This full-time role emphasizes collaboration and innovation, requiring hands-on experience with Azure Data Factory, Databricks, and SQL Server. You will contribute to a cloud-based data platform, ensuring optimal performance and scalability, while working closely with diverse teams. Ideal for a mid-senior level candidate who excels in a fast-paced environment.

Qualifications

• Hands-on experience with data engineering tools and technologies.
• Understanding of data modelling and governance practices.
• Strong collaboration skills across teams.

Responsibilities

• Design and build ELT pipelines using Microsoft technologies.
• Implement well-structured data models and quality checks.
• Collaborate with teams to translate business needs into solutions.
• Contribute to Agile processes and enhance CI/CD standards.

Skills

Azure Data Factory

Databricks

SQL Server

ELT Development

Data Modelling

Data Governance

CI/CD

Automation

Testing Frameworks

Strong Communication Skills

Tools

Microsoft Purview

Job description

Albany Beck is a specialist consultancy that partners with leading organisations to deliver high-quality talent, technology solutions, and data-driven transformation. With a strong focus on innovation, capability development, and long-term collaboration, Albany Beck helps clients modernise their operations and build scalable digital futures.

As a Data Engineer within Albany Beck, you will play a key role in supporting one of our major clients by designing, building, and maintaining high-quality data pipelines and models. You will contribute to a modern cloud-based data platform that enables smarter decision-making, improved operational efficiency, and continuous innovation.

Key Responsibilities

• Design, build, and maintain ELT pipelines using Azure Data Factory, Databricks, and SQL Server.
• Implement Medallion-layer data models with clean, well-structured, and maintainable code.
• Ensure pipelines meet high standards for scalability, performance, reliability, and security.
• Embed data quality checks, lineage, and observability into all data workflows.
• Translate business requirements into robust, scalable data engineering solutions.
• Collaborate with architects, governance teams, and application engineers.
• Contribute to technical design discussions and help shape best practice standards.
• Contribute to Agile delivery processes including estimation, refinement, and peer reviews.
• Enhance CI/CD pipelines, testing automation, and engineering quality standards.
• Optimise existing pipelines and investigate production issues, ensuring long-term stability.

Requirements

• Hands‑on experience with Azure Data Factory, Databricks (Python/SQL), and SQL Server.
• Strong understanding of ELT development, data modelling, and data governance.
• Experience working with CI/CD, automation, and testing frameworks.
• Strong communication skills with the ability to collaborate effectively across teams.
• Experience with Microsoft Purview or other metadata catalogue tools.
• Familiarity with Medallion architecture and modern cloud‑based data platforms.

Seniority level

Mid‑Senior level

Employment type

Full‑time

Job function

Finance

Industries

Business Consulting and Services