Senior Data Engineer: Own Production Pipelines & Databricks

IWSR; Greater London; Hybrid; GBP 60,000 - 80,000; Full time

Job summary

IWSR seeks a Senior Data Engineer in Central London (hybrid, 3 days in office) to take ownership of production-critical systems. You'll manage the data ingestion pipeline, migrate Excel processes to Python, and work closely with stakeholders to solve data challenges.

The ideal candidate has 5–7 years in data engineering, solid Python and SQL Server experience, and is familiar with Databricks. We value problem-solving skills and the ability to navigate messy systems.

Qualifications

• 5–7 years' experience in data engineering or an adjacent role.
• Solid Python skills for data pipelines and production code.
• Hands-on SQL Server experience.

Responsibilities

• Own and improve data ingestion pipelines that power the Global Database.
• Lead the migration of Excel-based processes into production Python.
• Manage the SQL Server environment, including security and structure.

Skills

Python

SQL Server

Databricks

PySpark

AWS

Tools

AI-assisted dev tools (e.g., Copilot)

Job description

IWSR seeks a Senior Data Engineer in Central London (hybrid, 3 days in office) to take ownership of production-critical systems. You'll manage the data ingestion pipeline, migrate Excel processes to Python, and work closely with stakeholders to solve data challenges.

The ideal candidate has 5–7 years in data engineering, solid Python and SQL Server experience, and is familiar with Databricks. We value problem-solving skills and the ability to navigate messy systems.