Data Engineer

Opus Recruitment Solutions Limited; Newcastle upon Tyne; Híbrido; GBP 83 000 - 101 000; Tempo parcial

Resumo da oferta

Opus Recruitment Solutions Limited is seeking an experienced Data Engineer to support the development and enhancement of large-scale data services in a cloud-based environment.

You will design and maintain data pipelines, build ETL/ELT processes, and develop SQL-based models while delivering robust reporting and observability solutions. The role involves collaborative work within Agile teams, with occasional travel to Newcastle as hybrid work.

Qualificações

• Experience as Data Engineer/Analytics Engineer/ETL Developer or similar role.
• Strong SQL and data modelling expertise.
• Hands-on experience with AWS cloud services and CI/CD practices.
• Experience with Qlik Sense/QLikView, Kibana, and Elastic stack.

Responsabilidades

• Design, develop, and maintain scalable data pipelines and integration solutions.
• Build and optimise ETL/ELT processes for multi-source data ingestion.
• Develop and maintain SQL-based data models and datasets.
• Create and enhance reporting and dashboards using Qlik technologies.
• Utilise Kibana and Elasticsearch for operational analytics and monitoring.
• Integrate data from APIs, databases, and third-party services.
• Ensure data quality, governance, and documentation standards.
• Support cloud-native data services within AWS environments.
• Implement and maintain CI/CD deployment pipelines and version control.
• Collaborate with stakeholders to translate business needs into technical solutions.
• Participate in Agile ceremonies and sprint planning.

Conhecimentos

Data Engineer

SQL

Data Modelling

ETL/ELT

AWS

CI/CD

Git

Agile

Stakeholder mgmt

Observability

Ferramentas

Qlik Sense

QlikView

Kibana

Elasticsearch

ELK Stack

Descrição da oferta de emprego

Role: Data Engineer

Type: Contract (Inside IR35)

Location: Newcastle (Hybrid - Occasional travel)

Duration: 5-6 months

Clearance Required: SC Eligible

Role Overview

We are seeking an experienced Data Engineer to support the development and enhancement of large-scale data services within a modern cloud-based environment.

This role is ideal for a professional who combines strong data engineering expertise with experience in operational analytics, reporting, and observability platforms. You will be responsible for building and maintaining scalable data pipelines, integrating data from multiple sources, and delivering data products that support business operations and decision-making.

Working within Agile delivery teams, you will collaborate with technical and non-technical stakeholders to develop robust, secure, and high-quality data solutions.

Key Responsibilities

• Design, develop, and maintain scalable data pipelines and integration solutions.
• Build and optimise ETL/ELT processes for ingesting and transforming data from multiple sources.
• Develop and maintain SQL-based data models and datasets.
• Create and enhance reporting and dashboard solutions using Qlik technologies.
• Utilise Kibana and Elasticsearch for operational analytics, monitoring, and data exploration.
• Integrate data from APIs, databases, and third-party services.
• Ensure data quality, consistency, governance, and documentation standards are met.
• Support and enhance cloud-native data services within AWS environments.
• Implement and maintain CI/CD deployment pipelines and version control processes.
• Work closely with stakeholders to gather requirements and translate business needs into technical solutions.
• Contribute to Agile ceremonies, sprint planning, estimation, and continuous improvement initiatives.

Essential Skills & Experience

• Strong commercial experience as a Data Engineer, Analytics Engineer, ETL Developer, or similar role.
• Proven expertise in SQL and data modelling.
• Experience designing and supporting ETL/ELT and data integration solutions.
• Strong hands-on experience with:
  • Qlik Sense and/or QlikView
  • Kibana
  • Elasticsearch / ELK Stack
• Experience building and maintaining data pipelines.
• Knowledge of dashboarding and data visualisation best practices.
• Experience working with AWS cloud services and cloud-native architectures.
• API-based data ingestion and integration experience.
• Experience with Git and CI/CD deployment practices.
• Strong understanding of Agile delivery methodologies.
• Excellent stakeholder management and communication skills.

Desirable Experience

• Government, Public Sector, or highly regulated industry experience.
• Experience supporting live digital services or operational platforms.
• Knowledge of data governance and data quality frameworks.
• Exposure to observability, monitoring, or service analytics environments.
• Previous experience working within secure or SC-cleared programmes.