Data Engineer

Adaptavate; West of England; On-site; GBP 55,000 - 90,000; Full time

Benefits offered by this job

Flexible hours

Enhanced parental pay

Ecological pension

Birthday leave

Job summary

Adaptavate is seeking a Data Engineer to turn raw data into actionable insights within our Technical team. You will build data pipelines, run ETL tasks, and design an integrated data platform to support decision making and product development.

The ideal candidate has 5+ years of applied experience, strong SQL and Python/Java/Scala skills, and familiarity with AWS/Azure/GCP, ERP/MES/SCADA, and big data tools such as Spark, Kafka or Hadoop. A CS/Engineering degree is expected.

Qualifications

• 5+ years of applied data engineering experience.
• Bachelor's degree in computer science, engineering or related field.
• Experience with ERP/MES/SCADA systems."
• Proficient with Spark, Kafka or Hadoop.

Responsibilities

• Build data pipelines to integrate process data from multiple sources.
• Scope architecture and maintain data driven tools.
• Design and manage the integrated data platform and storage.
• Write ETL scripts to clean and prep data.
• Resolve performance issues and speed data retrieval.
• Apply data security rules and access controls.

Skills

SQL

Python

Java

Scala

Cloud platforms (AWS/Azure/GCP)

Big data tools (Spark/Kafka/Hadoop)

ETL

Data security

Education

Bachelor's degree in CS/Engineering

Tools

ERP (MS Dynamics, SAP)

MES

SCADA

Job description

Adaptavate is a business of the future, a dynamic team of engineers, thinkers, parents, walkers, traders, dreamers, climbers, scientists, gardeners, friends, family and visionaries. People who think differently to make a big impact through our work… together.

We are answering the urgent call to decarbonise construction globally, by developing the low-carbon and carbon-negative technologies and products needed, and the industrial ecosystem to deploy them fast, anywhere in the world. We firmly believe that our work is pivotal to achieve net zero by 2050.

To succeed in our mission, we are looking for aData Engineerwho will work with our technical teams to translate raw data into information that drives business decision making. This position will work within our Technical team.

If you’re curious by nature, thrive on solving complex technical challenges and want to see your expertise translate into tangible environmental impact, we’d love to hear from you.

Your role

• Building data pipelines -create and manage data pipelines to integrate process data from different sources.
• Analysis - scoping the systems architecture, integrating, building and maintaining our data driven tools.
• Managing storage -design our integrated data platform
• Running ETL tasks -write extraction, transformation, and loading (ETL) scripts to clean and prep data.
• Managing and optimising our systems; resolving performance issues and speeding up data retrieval.
• Ensuring data safety; apply security rules and access controls to protect private information.
• AI - apply AI LLM and ML tocompany tools and products where appropriate and services to automate functions

You will

• Demonstrate strong skills in languages, particularly in SQL and programming languages like Python, Java, or Scala.
• Be experienced with cloud platforms such as AWS, Azure, or Google Cloud Platform.
• Have a thorough understanding of Industrial systems - ERP (Microsoft Dynamics, SAP), MES, SCADA
• Be proficient with big data tools - familiarity with tools like Spark, Kafka, or Hadoop.
• Be a self-starter, confident to work both independently, scoping ideas from a business led design brief as part of a small team.
• Interface with external bodies, our customers, and our sub-contractors, owning key relationships within the technical domain.
• Have over five years of applied experience
• Have a bachelor's degree in computer science, engineering or related field (or equivalent work history and experience)

Our customers come from all walks of life and so do we. We hire great people from a wide variety of backgrounds, not just because it’s the right thing to do, but because it makes our company stronger and our days more rewarding. As an equal opportunity employer, we stay true to our principles by ensuring that our place can be anyone’s place.

Benefits

• 25 days (pro-rata) + bank holidays + your birthday!
• Flexible hours.
• Enhanced parental pay.
• Ecological pension.

Salary

• Dependent on experience.
• Adaptavate are committed to paying the Real Living Wage.