Data Engineer: Design & Build Scalable Data Pipelines

UBDS Digital; Greater London; On-site; GBP 60,000 - 90,000; Full time

Job summary

UBDS Digital is seeking a Data Engineer to join multidisciplinary teams delivering modern data solutions. You will design and build data pipelines, models and analytics products, learning from experienced colleagues and applying best practices to real-world environments.

You will work with data warehouses, lakehouse platforms and analytics tools, focusing on governance, security and quality while delivering insights through visualisations and clear explanations to users.

Qualifications

• Strong SQL and Python skills for data modelling, transformation, automation and analysis.
• Experience with data warehouses, lakehouse environments or analytics tools such as Power BI.
• Familiarity with modern data engineering frameworks and tools (Spark/PySpark, Pandas).
• Experience with cloud data platforms on AWS or Azure (Databricks, Redshift, Microsoft Fabric).
• Understanding of software engineering fundamentals, including Git, testing, CI/CD and modular design.
• Basic analytics and statistical understanding, including metrics and experimentation.
• Awareness of AI/ML concepts and data governance, security and GDPR considerations.

Responsibilities

• Translate business problems into data, analytical and technical tasks with guidance.
• Design, build and maintain data pipelines, models and products using SQL, Python and modern tools.
• Work with data warehouses, lakehouse platforms and analytics tools to create semantic models.
• Contribute to solutions built on cloud data and AI platforms, following CI/CD practices.
• Apply analytics, experimentation and data governance practices as part of delivery teams.
• Create clear data visualisations and explanations to help users act on insights.
• Collaborate with users and stakeholders in Agile, client-driven environments, learning from live services.

Skills

SQL

Python

Power BI

Spark/PySpark

Git

CI/CD

Data governance

GDPR

Data modelling

Data pipelines

Tools

Databricks

Redshift

Tableau

Pandas

Job description

UBDS Digital is seeking a Data Engineer to join multidisciplinary teams delivering modern data solutions. You will design and build data pipelines, models and analytics products, learning from experienced colleagues and applying best practices to real-world environments.

You will work with data warehouses, lakehouse platforms and analytics tools, focusing on governance, security and quality while delivering insights through visualisations and clear explanations to users.