Data Engineer (ETL-Streams)

Square One Resources; Birmingham; Hybrid; GBP 60,000 - 80,000; Full time

Job summary

A leading recruitment agency is seeking a Data Engineer (ETL-Streams) for a contract position based in Birmingham or Sheffield. The role involves designing and optimising high-quality data pipelines and analytics solutions using Python and OpenTelemetry. Ideal candidates should have solid programming skills and experience with machine learning applications. The position offers a competitive rate of £515 per day, with a mix of onsite and remote work.

Qualifications

• Experience in programming and managing data models.
• Strong analytical skills for machine learning applications.
• Knowledge of data processing best practices.

Responsibilities

• Design, develop, and optimise data processing solutions.
• Carry out preprocessing and data cleansing.
• Present analytical findings to stakeholders.
• Develop predictive models and algorithms.

Skills

Strong programming skills in Python

Experience in Scala and/or Java

Proven expertise in OpenTelemetry

Solid understanding of OpenTelemetry Protocol

Experience correlating OLTP streaming data

Job description

Job Title: Data Engineer (ETL-Streams)
Location: Birmingham or Sheffield (3 days on site per week)
Salary/Rate:£515 (Inside IR35)
Start Date:01/09/2025
Job Type: Contract

Company Introduction

We are seeking experienced Data Engineers to support the development, optimisation, and deployment of high-quality data pipelines and analytics solutions. This role involves working with both structured and unstructured data in complex, high-volume environments, using modern tools and techniques to drive business insight and decision-making.

Job Responsibilities/Objectives

You will play a key role in designing, developing, and optimising data processing solutions, ensuring the quality and accuracy of data for analytics and machine learning applications.

• Carry out preprocessing of structured and unstructured data to prepare it for analysis.
• Enhance data collection processes to capture all relevant information for analytical systems.
• Cleanse, process, and validate data integrity to ensure it is ready for downstream use.
• Analyse large datasets to identify trends, patterns, and solutions to complex problems.
• Develop predictive models, machine learning algorithms, and data-driven solutions.
• Present analytical findings clearly to stakeholders and propose strategies to address business challenges.
• Perform data mining and extraction from valuable data sources, ensuring usability for analytics.
• Utilise machine learning tools to select features, create classifiers, and optimise performance.

Required Skills/Experience

• Strong programming skills in Python, with experience in Scala and/or Java being an advantage.
• Proven expertise in OpenTelemetry, including its core components such as virtual machines, middleware (e.g. IIS/Apache), hypervisors, and databases.
• Solid understanding of the OpenTelemetry Protocol (OTLP) format and the ability to structure and utilise telemetry data effectively.
• Experience correlating OLTP streaming data from multiple components and applying machine learning to generate actionable insights.

Desirable Skills/Experience

• Experience in large-scale data architecture and distributed data systems.
• Strong background in statistical analysis and data science principles.
• Familiarity with data visualisation tools and techniques.
• Exposure to real-time analytics and event-driven data processing frameworks.

If you are interested in this opportunity, please apply now with your updated CV in Microsoft Word/PDF format.

Disclaimer
Notwithstanding any guidelines given to level of experience sought, we will consider candidates from outside this range if they can demonstrate the necessary competencies.

Square One is acting as both an employment agency and an employment business, and is an equal opportunities recruitment business. Square One embraces diversity and will treat everyone equally. Please see our website for our full diversity statement.