Data Engineer

Tenth Revolution Group; Cardiff; Hybrid; GBP 54,000 - 66,000; Full time

Benefits offered by this job

Hybrid work

Cardiff offices

Databricks & Azure tech

Professional development

Collaborative culture

Career progression

Job summary

Tenth Revolution Group in Cardiff is seeking a Data Engineer to join its expanding Data team. You will design, build and maintain scalable data pipelines using Databricks and Azure, supporting reporting and analytics.

The role collaborates with stakeholders across technology and business, develops data models and ensures high-quality datasets while embracing modern cloud data platforms.

Qualifications

• Commercial experience with Databricks in a data engineering role.
• Strong SQL development and data manipulation skills.
• Experience building cloud-based data pipelines in Azure.
• Knowledge of Azure Data Factory / Data Lake or related services.
• Experience with ETL and data integration.

Responsibilities

• Design, build and maintain scalable data pipelines using Databricks and Azure.
• Develop and optimise ETL processes for reporting and analytics.
• Work with structured and unstructured data from multiple sources.
• Support data models and data warehouse solutions.
• Collaborate with analysts, engineers and stakeholders to deliver data-driven solutions.
• Monitor and improve data pipeline performance and reliability.
• Produce technical documentation and follow engineering best practices.

Skills

Databricks experience

SQL development

Azure data services

Python/PySpark

Problem solving

Tools

Azure Data Factory

Azure Data Lake

Job description

Up to £60,000 – Cardiff (2 days per week)

We are partnering with a growing organisation that is investing significantly in its data and cloud capabilities as part of a wider digital transformation programme.

As part of this growth, the business is looking to appoint a Data Engineer to join its expanding Data team. This is an excellent opportunity for a Data Engineer with experience in modern cloud data platforms to play a key role in developing and enhancing a scalable, data-driven environment built around Databricks and Azure technologies.

Working closely with stakeholders across technology and the wider business, you will be responsible for designing, developing and maintaining data pipelines, transforming and integrating data from multiple sources and supporting the delivery of high-quality datasets for reporting and analytics. You will have the opportunity to work with cutting-edge technologies within a collaborative team environment while continuing to develop your technical expertise.

This role would suit a Data Engineer who enjoys building robust data solutions, working with large datasets and contributing to the ongoing evolution of a modern cloud data platform.

Key Responsibilities

• Design, build and maintain scalable data pipelines using Databricks and Azure technologies
• Develop and optimise ETL processes to support reporting, analytics and business intelligence requirements
• Work with structured and unstructured data from a variety of internal and external sources
• Support the development and maintenance of data models and data warehouse solutions
• Collaborate with analysts, engineers and business stakeholders to deliver data-driven solutions
• Monitor, troubleshoot and improve data pipeline performance and reliability
• Produce and maintain technical documentation and adhere to engineering best practices

Skills & Experience

• Commercial experience working with Databricks in a data engineering capacity
• Strong SQL development and data manipulation skills
• Experience building and supporting cloud-based data pipelines within Azure environments
• Knowledge of Azure Data Factory, Azure Data Lake or related Azure data services
• Experience developing ETL processes and data integration solutions
• Understanding of data warehousing principles and modern data architectures
• Experience with Python, PySpark or Spark is highly desirable
• Strong problem-solving skills and ability to work collaboratively within a team environment

What's on Offer

• Salary of up to £60,000
• Hybrid working model with offices in Cardiff
• Opportunity to work with modern data technologies including Databricks and Azure
• Ongoing training and professional development opportunities
• Collaborative and supportive team culture
• Clear career progression within a growing data function