Data Engineer - Senior Consultant

Opencast, incorporated; United Kingdom; Híbrido; GBP 70 000 - 110 000; Tempo integral

Vantagens oferecidas por esta oferta de emprego

7% Employer pension

Share options

Discretionary bonus

25 days holiday

Life happens days

Resumo da oferta

Opencast is hiring a data engineer to help organisations transform how they manage, use and learn from data. You will build batch and near real-time pipelines, and design modern lakehouse and warehouse platforms using Microsoft Fabric, Azure data services and Power BI models.

The role spans architecture, integration, and governance, with opportunities to mentor and shape engineering standards. You’ll work with clients across the UK, collaborating with architects, analysts and engineers to

Qualificações

• Experience delivering data pipelines and data platform design.
• Proficient in PySpark and modern transformation techniques.
• Strong SQL knowledge with SQL Server, PostgreSQL or Oracle.
• Experience with Microsoft Fabric and Azure data services.

Responsabilidades

• Design and implement modern lakehouse/warehouse platforms.
• Migrate and modernise legacy data environments.
• Collaborate with architects, analysts and client teams to guide technical direction.
• Mentor junior engineers and contribute to engineering standards.

Conhecimentos

Microsoft Fabric

Azure data services

PySpark

Spark SQL

SQL

Data modelling

Data integration

Data quality governance

Ferramentas

SQL Server

PostgreSQL

Oracle

Power BI

Descrição da oferta de emprego

Hybrid - Newcastle, Edinburgh, Glasgow, Leeds, Manchester, Birmingham, Bristol, London

Commitment:

Permanent - Employee

Ready to build data platforms, not just pipelines?

At Opencast, we believe great data engineering is about more than moving and transforming data. It's about creating reliable, scalable foundations that help organisations make better decisions and deliver better services.

You’ll tackle complex engineering challenges across integration, migration, modelling and platform design, working with Microsoft Fabric, Azure and modern data technologies. We value engineering craft, thoughtful problem-solving and building solutions that are simple, robust and built to last.

Our data engineering capability is growing, and you'll help guide its direction through mentoring, recruitment and technical leadership, as well as your client work. If you want to shape both the solutions and capability around them, this could be the role for you.

The role

Opencast data engineers help organisations transform how they manage,useand learn from data. The work ranges from building modernlakehouseand warehouse platforms in Microsoft Fabric to modernising legacy environments, migrating complex workloads and improving the quality,governanceand reliability of critical data services.

This role offers the opportunity to work across the full data lifecycle, combining platform design, engineering,integrationand optimisation. Expect to work with structured, semi-structured and unstructured data, building batch and near real-time data pipelines that underpin critical business and public services.

You'llcollaborate with architects, analysts, softwareengineersand client teams to solve complex challenges and influence technical direction. The role also offers opportunities to contribute beyond delivery through mentoring, recruitment, community building and helping to define engineering standards and best practice as our capability continues to grow.

Requirements

This role involves weekly on-site work, and you’ll be required to travel regularly to client locations across the UK. We’re looking for people who value in-person collaboration, enjoy building strong relationships, and are passionate about delivering solutions that make a real difference for our clients.

Due to the nature of this role, you must either hold active Security Check (SC) clearance or be eligible and willing to undergo the clearance process.

SC clearance is granted in line with UK Government security vetting requirements. Typically, applicants must have UK citizenship and have lived continuously in the UK for at least the past five years, with no single absence exceeding 28 consecutive days. Nationality and immigration status may also be considered as part of the vetting process. We are unable to progress applications from candidates who do not meet these requirements.

If you are unsure whether you meet the eligibility criteria, we encourage you to review the guidance or discuss this with us before applying.

We're looking for engineers who enjoy solving complex technical problems and care about building solutions that are robust,scalableand built to last. Experience in the following areas is important:

• Microsoft Fabric and Azure data services, includinglakehouse, warehouse,notebooksand pipeline capabilities.
• Building enterprise-scale data platforms,lakehousesand data warehouses.
• Data modelling and dimensional modelling techniques such as Kimball.
• ETL/ELT development and large-scale data integration.
• PySpark, Spark SQL and modern transformation techniques.
• Advanced SQL and relational databases including SQL Server, PostgreSQL and Oracle.
• Integrating structured, semi-structured and unstructured data sources.
• Migration and modernisation of legacy platforms such as Oracle, SQL Server/SSIS or Synapse.
• Power BI semantic models, curated datasets and supporting analytics platforms.
• Data quality, governance, metadata management and lineage.
• Data security, classification and access control approaches.
• Automated testing, validation, reconciliation testing and performance optimisation.
• DataOps, CI/CD and version control practices.

Essential consulting skills

Our clients look to us for more than technical delivery.

Success in this role comes from being able to navigate ambiguity, solve difficult problems and help clients make confident technical decisions. The strongest consultants combine technicalexpertisewith curiosity,pragmatismand a collaborative mindset.

You’ll thrive in this role if you enjoy:

• Solving complex engineering challenges and exploring different approaches to finding the right solution.
• Influencing technical direction throughexpertise,evidenceand constructive challenge.
• Working closely with technical and non-technical stakeholders to understand underlying problems rather than simply implement requirements.
• Balancing engineering quality, governance,securityand reliability with business outcomes.
• Sharing knowledge, mentoringothersand helping raise engineering standards.
• Building trusted relationships with clients and acting as a technical advisor.
• Keeping pace withemergingtechnologies and evaluatingnew approacheswhere they can add value.
• Contributing to a growing engineering capability whileremainingclose to delivery and technology.

What we offer

A competitive package including a 7% employer pension contribution, share options, and a discretionary bonus. You’ll also benefit from 25 days’ holiday and access to 3 annual “life happens” days to support unexpected situations. We provide wellbeing support, ongoing professional development, volunteering opportunities, and the chance to be part of a genuinely supportive team.

Where you’ll work

This role requires regular on-site attendance at our HQ, hub offices, and client sites, as well as the ability to work from home. Applicants must be able to travel to offices and client sites across the UK as part of their normal working arrangements, as travel is essential for fulfilling the responsibilities of the role.

We include you

We welcome candidates from all identities, attributes, ways of thinking and backgrounds to thrive in a career at Opencast. Our aim is for the diversity of our people to be reflected in the solutions we deliver, to help create a fairer society for all.

Interview

Interviews will be conducted via Microsoft Teams. We’re happy to make adjustments to support your needs.

Hear from our people: Opencast in 3 words

Our people share the three words that best describe life at Opencast. Watch now to get a glimpse of our culture, values, and what it’s like to work here.