Senior Data Engineer

Techmunity; United Kingdom; Remote; GBP 90,000 - 110,000; Full time

Benefits offered by this job

Fully remote, UK-based

Quarterly international customerVisits

Job summary

Techmunity is seeking a Senior Data Engineer to deploy a Databricks-based foundation model for industrial operations and build robust data pipelines that connect complex plant systems to AI. You will transform raw operational data into AI-ready datasets and drive the data infrastructure supporting production AI initiatives.

You will work with SCADA/DCS data, collaborate with ML engineers, and contribute to a lakehouse architecture.

Qualifications

• Strong Python for data processing and pipelines.
• Experience with Databricks/PySpark for large-scale data processing.
• Experience with AWS/Azure/GCP for secure, scalable data pipelines.
• Familiarity with time-series/industrial data (DCS/SCADA logs).

Responsibilities

• Build production data pipelines using Databricks, PySpark, Python and SQL.
• Integrate industrial data from SCADA, DCS, OPC servers and process historians.
• Transform raw operational data into structured, AI-ready datasets.
• Support the move toward a Databricks Lakehouse/Lakebase architecture.
• Collaborate with customers and ML engineers on deployments.

Skills

Python

Databricks

PySpark

SQL

AWS/Azure/GCP

Time-series data

Tools

Databricks

PySpark

Job description

Senior Data Engineer | Databricks + Industrial AI | £90–110k + Equity | Remote UK

Help build AI that makes the world's largest industrial facilities safer, cleaner and more efficient.

We're hiring for a well-funded British AI startup building a physics-informed foundation model for energy and industrial operations.

Refineries and petrochemical plants generate enormous amounts of data, yet much of it goes unused. This company have built a model that combines live operational data, physics and AI to help operators predict problems, optimise performance, reduce emissions and make better decisions.

The company

• $32m+ raised, backed by leading technology and industrial investors.
• Approximately 50 people, including world-class AI researchers and industrial specialists.
• Already deploying its technology with energy, refining and petrochemical customers.

The Senior Data Engineer role

You’ll join a small engineering team deploying this foundation model into industrial environments, building the data infrastructure that connects complex plant systems to production AI.

What you’ll be doing

• Building production pipelines using Databricks, PySpark, Python and SQL.
• Integrating industrial data from SCADA, DCS, OPC servers and process historians.
• Transforming raw operational data into structured, AI-ready datasets.
• Supporting the move towards a Databricks Lakehouse/Lakebase architecture.
• Working directly with customers and ML engineers on real-world deployments.

What they’re looking for

• Strong proficiency in Python for data processing, scripting, and pipeline orchestration.
• Hands‑on experience with AWS, Azure or GCP for secure and scalable data pipelines.
• Proven ability to work with Databricks and PySpark for large-scale distributed data processing
• Familiarity with time‑series or industrial data (control systems, DCS/SCADA logs, process historians).

Package

• Fully remote, UK-based
• Occasional international customer visits, approximately quarterly