Senior Azure Data Engineer: Real-Time Data Pipelines & ETL

Thatcham Research; Thatcham; Hybrid; GBP 60,000 - 74,000; Full time

Benefits offered by this job

Pension 10%

Holiday 29 days

Life Assurance

Cycle to work

Parental leave

Health plan

Gym membership

On-site parking

Job summary

Thatcham Research is seeking a Data Engineer to join the Enterprise Data team. You will design, build and maintain data integration solutions for BI and research data to support analytical activities.

The role focuses on robust ETL, real-time and batch data pipelines, and cloud-native integrations using Azure services. You’ll collaborate with data architects, analysts and testers to ensure high-quality data solutions while adhering to governance and security practices.

Qualifications

• Proficiency with Azure data integration and cloud platform (ADF, Synapse, Logic Apps, Function Apps, Azure Web Apps).
• Experience using SQL, ETL, Python and APIs to extract, transform and load data from multiple sources.
• Strong relational database design/administration (MySQL, SQL Server, PostgreSQL).
• Hands-on no-SQL knowledge (Cosmos DB).
• Develop data integrations with real-time, batch, and periodic latency.
• Experience with REST, SOAP and Service Bus interfaces.

Responsibilities

• Design and build robust, scalable data integration solutions for products per technical standards.
• Develop and maintain interfaces for data and analytical products.
• Deliver big data solutions using real-time/event-driven tech for research.
• Create and maintain ETL processes to enrich Thatcham data.
• Build cloud-native integrations using Azure like Logic Apps and Functions.

Skills

Azure data integration

SQL

ETL

Python

APIs

Relational database design

MySQL

SQL Server

PostgreSQL

Cosmos DB

REST

SOAP

Service Bus

JSON

XML

Data governance

Security

Git version control

DevOps for data platforms

Tools

Azure Data Factory

Azure Synapse

Logic Apps

Function Apps

Azure Web Apps

Cosmos DB

Job description

Thatcham Research is seeking a Data Engineer to join the Enterprise Data team. You will design, build and maintain data integration solutions for BI and research data to support analytical activities.

The role focuses on robust ETL, real-time and batch data pipelines, and cloud-native integrations using Azure services. You’ll collaborate with data architects, analysts and testers to ensure high-quality data solutions while adhering to governance and security practices.