Staff Data Engineer - AI-Driven Data Modernisation (Hybrid)

WeDo Technology Solutions Limited; City Of London; Hybrid; GBP 144,000 - 240,000; Full time

Job summary

WeDo Technology Solutions Limited is seeking a Staff Data Engineer for a hands-on, leadership-heavy contract in London. You will drive data engineering modernisation, shape architectures, and deliver complex pipelines with AWS Glue, Airflow, Python and PySpark.

The role combines technical leadership across teams with hands-on development to prototype and prove solutions, leveraging AI-assisted tooling to accelerate delivery.

Qualifications

• Deep hands-on Python/PySpark and Apache Spark expertise.
• Strong AWS data engineering experience, especially Glue.
• Proficient in Apache Airflow and orchestration tooling.
• Experience delivering complex data transformation or modernisation programmes.
• Solid software engineering fundamentals and on‑page leadership.
• Experienced at Staff, Principal or Senior Lead Engineer levels.
• Willing to stay hands-on with code and guide teams.
• Familiarity with AI-assisted development tooling is a plus.

Responsibilities

• Provide staff-level technical leadership across complex data initiatives.
• Remain deeply hands-on with Python, PySpark and Spark.
• Modernise and migrate large-scale data pipelines across AWS.
• Design and challenge approaches using AWS Glue, Airflow and related technologies.
• Shape scalable data architectures and engineering patterns.
• Support development of new data products and reusable capabilities.
• Champion AI-assisted development to improve quality and speed.
• Raise engineering standards across multiple teams.

Skills

Python

PySpark

Apache Spark

AWS data engineering

Apache Airflow

hands-on coding

AI-assisted development

Snowflake

Tools

Python

PySpark

Apache Spark

AWS Glue

Airflow

Snowflake

Job description

WeDo Technology Solutions Limited is seeking a Staff Data Engineer for a hands-on, leadership-heavy contract in London. You will drive data engineering modernisation, shape architectures, and deliver complex pipelines with AWS Glue, Airflow, Python and PySpark.

The role combines technical leadership across teams with hands-on development to prototype and prove solutions, leveraging AI-assisted tooling to accelerate delivery.