Lead Data Engineer - AWS / AI / SQL

Adria Solutions Ltd.; Stretford; Hybrid; GBP 77,000 - 94,000; Full time

Job summary

Adria Solutions Ltd. in Manchester is seeking a hands-on Lead Data Engineer to own the data platform and lead a small team.

You will modernise SQL Server/SSIS/SSDT, build batch and real-time pipelines on AWS, and enable self-service analytics with Power BI and AI tooling.

Hybrid role in Manchester, with a salary around £85K, reporting to senior stakeholders and collaborating across BI, Data Science and ML teams.

Qualifications

• Experience building and operating complete data platforms.
• Proficient in batch data processing, ELT and orchestration.
• Knowledge of modern streaming tech (Flink or similar).
• Experience with AWS data services (S3/Lambda/Glue/Athena/Kinesis/RDS).
• Infrastructure as code using Terraform.
• CI/CD and automated testing practices.
• Familiarity with lakehouse architectures and Iceberg.
• Medallion architecture and dimensional modelling.
• Strong SQL and Python.
• Experience with SQL Server, SSIS/SSDT and Power BI.
• Knowledge of semantic layers, data glossaries and governance.
• Leadership of a small data engineering team.

Responsibilities

• Own the reliability, security and ongoing development of the data platform.
• Modernise the SQL Server, SSIS/SSDT and Power BI environment.
• Develop scalable batch and real-time data-processing solutions.
• Lead the design of a Customer Data Platform.
• Build a lakehouse architecture using AWS technologies.
• Create governed semantic models and clear data definitions.
• Enable self-service data analysis with AI tooling.
• Automate manual data processes to reduce risk and toil.
• Support BI, Data Science and ML teams.
• Oversee data governance, security, monitoring and costs.
• Line-manage the Data Engineering team and grow capability.
• Collaborate with technical, operational and senior business stakeholders.

Skills

Batch data processing

ETL/ELT

SQL

Python

Data governance

Team leadership

CI/CD

Lakehouse

Tools

AWS

Terraform

SQL Server

Power BI

Flink

Iceberg

dbt

Job description

Lead Data Engineer

Manchester | Hybrid | Circa £85K

An established organisation is looking for a hands-on Lead Data Engineer to take ownership of its existing data estate and lead the development of a modern, scalable data platform.

This is an excellent opportunity to build a platform supporting Business Intelligence, Data Science and Applied AI. You’ll introduce modern batch and real-time data-processing capabilities, automate inefficient processes and make trusted data more accessible across the organisation.

Alongside remaining technically hands-on, you’ll manage and develop a small team of Data Engineers.

Key responsibilities

• Own the reliability, security and ongoing development of the data platform.
• Modernise the existing SQL Server, SSIS/SSDT and Power BI environment.
• Develop scalable batch and real-time data-processing solutions.
• Lead the design of a Customer Data Platform.
• Build and evolve a lakehouse architecture using AWS technologies.
• Create governed semantic models, consistent metrics and clear data definitions.
• Enable secure, self-service data analysis using modern AI tooling.
• Automate manual, repetitive or fragile data processes.
• Support BI, Data Science, Machine Learning and Applied AI teams.
• Take ownership of data governance, security, monitoring and platform costs.
• Line-manage, develop and help grow the Data Engineering team.
• Work closely with technical, operational and senior business stakeholders.

Skills and experience

We’re looking for an experienced Data Engineer who has built and operated complete data platforms rather than solely delivering individual components.

You’ll need experience across:

• Batch data processing, ELT and orchestration.
• Modern streaming technologies such as Flink or comparable platforms.
• AWS data services, including S3, Lambda, Glue, Athena, Kinesis and RDS.
• Infrastructure as code using Terraform.
• CI/CD and automated testing.
• Lakehouse architecture and open table formats such as Iceberg.
• Medallion architecture and dimensional data modelling.
• Strong SQL and Python.
• SQL Server, SSIS/SSDT and Power BI.
• Semantic layers, common metrics and data glossaries.
• Data governance, lineage, retention, classification and auditability.
• Managing and developing a small technical team.

You should also be comfortable using advanced AI coding assistants, such as Claude Code or equivalent tools, to improve engineering productivity while maintaining high standards of quality, governance and security.

Desirable experience

• Regulated environment.
• PySpark for large-scale data transformations.
• Migrating legacy data estates to lakehouse or metadata-driven architectures.
• Customer Data Platforms or event-driven systems.
• Data-quality tools such as dbt tests or Great Expectations.
• MCP servers or governed natural-language data interfaces.
• Financial crime, fraud or regulatory-reporting data.
• Power BI administration and semantic modelling.

The opportunity

This is a genuinely influential role where you’ll own the data platform end to end and help shape how data and AI are used across the organisation.

You’ll have the scope to introduce modern technologies, remove unnecessary manual work and build a platform capable of supporting future products, analytics and business decision-making.

• Salary: Circa £85K
• Location: Manchester
• Working pattern: Hybrid

Lead Data Engineer - Manchester