Data Engineer

Aatom Recruitment; Greater London; Hybrid; GBP 50,000 - 70,000; Full time

Job summary

A local authority is seeking a skilled Data Engineer to develop and maintain a modern data platform in Microsoft Azure. The successful candidate will lead engineering projects, ensuring high-quality data management and contribute to the council's strategic objectives. Essential skills include proficiency in Microsoft Azure, SQL, and NoSQL databases. This role offers flexible work arrangements, generous pension contributions, and employee benefits, with a hybrid working model requiring two days in office.

Benefits

Flexible working arrangements

Generous pension allowance

Access to council rewards scheme

Employee Assistance Programme

Eye test and flu vouchers

Qualifications

• Proven track record of collaborating with ICT colleagues and senior managers.
• Extensive experience with Microsoft Azure for data storage, extraction, transformation.
• Proficiency in SQL and NoSQL databases is essential.

Responsibilities

• Lead the Council’s data modernization programme to develop a data platform in Azure.
• Create business and user value from data through engineering projects.
• Ensure data quality, availability, and usability.

Skills

Microsoft Azure

SQL

NoSQL

Data Modelling

ETL Processes

Big Data Pipelines

Tools

ADLS

Synapse

Databricks

Stream Analytics

SQL DW

COSMOS DB

Analysis Services

Azure Functions

Job description

Working on behalf of a Local Authority, Aatom Recruitment has a new opportunity for a Data Engineer.

This is a permanent vacancy – a cover letter must be submitted along with candidate CV.

The Council is on a journey to implement a modern enterprise data and analytics cloud platform and are seeking data engineers to contribute to this project.

Essential experience

• Experience in using Microsoft Azure for data storage, extraction, transformation, troubleshooting, and maintaining the data platform.
• Proficiency in both SQL and NoSQL databases.
• Hands‑on experience with Azure resources such as ADLS, Synapse, Databricks, Stream Analytics, SQL DW, COSMOS DB, Analysis Services, and Azure Functions.

First 6 months: Lead the Council’s data modernisation programme that is looking to develop a modern data platform in Microsoft Azure.

Hybrid working pattern: 2 days in the office

Interviews will be held W/C 18th November and will include a presentation element.

About the Role

The Council is on a journey to implement a modern enterprise data and analytics cloud platform that will allow council to manage and use data as a strategic organisational asset. As a Data Engineer, you will help to create business and user value from data by undertaking significant engineering projects which improve and combine data from back office and customer‑facing systems.

You will make sure our data and data shared by others is of the highest quality, highly available, usable, and shareable by rigorous standard setting and quality control. You will work with data professionals to build products and services which deliver continuous insight and value to our staff and residents.

You will be expected to contribute to the achievement of the Council’s vision, values, and strategic objectives by providing technical knowledge in Microsoft Azure within the service and across the Council, specifically regarding data storage, extraction and transformation.

About You

You will be a highly skilled data professional with a proven track record of collaborating with ICT colleagues and senior managers to identify business requirements and develop products and services that provide continuous insight and value to our staff and residents.

You will have extensive experience in using Microsoft Azure for data storage, extraction, transformation, troubleshooting, and maintaining the data platform.

Proficiency in both SQL and NoSQL databases is essential, along with hands‑on experience with Azure resources such as ADLS, Synapse, Databricks, Stream Analytics, SQL DW, COSMOS DB, Analysis Services, and Azure Functions.

You should be skilled in data modelling, ETL processes and SQL‑based analytics, and have experience in building and optimising "big data" pipelines, architectures, and data sets.

You’ll be a good communicator and have experience engaging both internal and external stakeholders. You’ll be comfortable analysing research results and then presenting them to non-technical audiences.

We’re also looking for someone who will be driven, with a desire to self‑develop and improve themselves by continually learning about new skills.

Benefits

• Flexible working arrangements including offices in Dockside and working from home.
• Generous pension allowance (with employer contributions of up to 8%).
• Access to council Rewards employee benefits scheme.
• Employee Assistance Programme.
• Eye test and Flu vouchers.