Data Engineer

Soda; Sheffield; Hybrid; GBP 60,000 - 80,000; Full time

Job summary

A leading tech company in the UK is seeking an experienced Data Engineer to transform raw data into actionable insights. You'll work with large-scale datasets and enhance data collection pipelines. Strong programming skills in Python and experience in machine learning are essential. This hybrid role allows you to work from home two days a week, offering up to £500 per day inside IR35.

Qualifications

• Strong programming skills in Python; experience with Scala or Java is an advantage.
• Expertise with the OpenTelemetry stack and understanding of the OTLP format.
• Ability to correlate OLTP streaming data and generate actionable outcomes.

Responsibilities

• Preprocess structured and unstructured data for analytics and modelling.
• Enhance data collection pipelines for analytic systems.
• Analyse large datasets to identify trends and patterns.

Skills

Python

ETL processes

Machine learning integration

Data analysis

Tools

Scala

Java

OpenTelemetry stack

Job description

Data Engineer
Location: Birmingham or Sheffield (Hybrid, 2 days onsite p/w)
Contract End Date: November 2025
Rate: Up to £500 per day Inside IR35
About the Role
We are seeking an experienced Data Engineer with strong skills in ETL processes, streaming data, and machine learning integration. You will work with large-scale structured and unstructured datasets, transforming raw data into actionable insights that power analytical and predictive systems. This role involves hands-on engineering, advanced data processing, and leveraging modern telemetry and ML techniques to drive real-world impact.
Key Responsibilities

• Preprocess structured and unstructured data for analytics and modelling.
• Enhance data collection pipelines to capture all relevant data for analytic systems.
• Cleanse, process, and validate data integrity for downstream use.
• Analyse large datasets to identify trends, patterns, and actionable insights.
• Develop predictive models and machine learning algorithms.
• Present analytical results in clear, impactful formats.
• Propose innovative solutions and strategies to address business challenges.
• Perform data mining to extract valuable information from diverse sources.
• Use machine learning tools for feature selection, classifier creation, and optimisation.

Required Skills & Experience

• Strong programming skills in Python; experience with Scala or Java is an advantage.
• Expertise with OpenTelemetry stack, including components such as virtual machines, middleware (IIS, Apache), hypervisors, and databases.
• Understanding of the OTLP format and structuring telemetry data for analytics.
• Ability to correlate OLTP streaming data from multiple components and generate actionable outcomes using applied ML techniques.