Staff Data Engineer: AI-Driven Modernisation (London)

WeDoTech; Greater London; Hybrid; GBP 207,000 - 272,000; Full time

Job summary

WeDoTech is seeking a Staff- or Senior-level Data Engineer to lead modernisation of large-scale data pipelines in a hybrid London setting. You will stay hands-on with Python, PySpark, and Spark while shaping scalable data architectures and evaluating AWS Glue and Airflow-based approaches.

The role is UK-based with UK financial services client engagement; six-month contract at £1,300 per day cap, inside IR35, offering a challenging engineering environment and collaboration across multiple teams.

Qualifications

• Senior/Staff-level data engineering expertise required.
• Hands-on Python, Spark, and PySpark with cloud data pipelines.
• Experience modernising large data estates on AWS.

Responsibilities

• Provide Staff-level technical leadership across complex data engineering initiatives.
• Remain deeply hands-on with Python, PySpark, and Spark.
• Modernise and migrate large-scale data pipelines across AWS.
• Design and challenge approaches involving AWS Glue, Airflow, and associated technologies.
• Shape scalable data architectures, frameworks, and engineering patterns.
• Support the development of new data products and reusable capabilities.
• Champion AI-assisted development to improve engineering quality and delivery speed.
• Raise engineering standards and capability across multiple teams.

Skills

Python

PySpark

Spark

AI-assisted development

Software engineering

Independent/challenge thinking

Hands-on coding

Cloud

Tools

AWS Glue

Snowflake

Job description

WeDoTech is seeking a Staff- or Senior-level Data Engineer to lead modernisation of large-scale data pipelines in a hybrid London setting. You will stay hands-on with Python, PySpark, and Spark while shaping scalable data architectures and evaluating AWS Glue and Airflow-based approaches.

The role is UK-based with UK financial services client engagement; six-month contract at £1,300 per day cap, inside IR35, offering a challenging engineering environment and collaboration across multiple teams.