Data Engineer

OurCoop; Warwick; On-site; GBP 65,000 - 110,000; Full time

Benefits offered by this job

Employee Discounts

30 Days Annual Leave

Health and Wellbeing Programmes

Full Training and Accredited Plans

Job summary

OurCoop is recruiting a Data Engineer in Warwick to unlock value from data assets by delivering scalable, secure data platforms that support reporting, analytics, AI and data-driven decision-making. You will design and operate data pipelines and architectures, collaborate with the Data & Analytics team, and apply governance and best practices to ensure high quality data products.

The role emphasizes Microsoft Fabric, Synapse, and Azure data tools, with opportunities to advance engineering

Qualifications

• Proficiency in SQL, Python, PySpark and building data pipelines with Microsoft Fabric technologies.
• Experience designing and operating enterprise data platforms and data warehouses.
• Understanding of data concepts and data modelling principles (Kimball/Medallion).
• Experience using Azure DevOps and CI/CD.
• Experience delivering ETL/ELT solutions and modern data architectures.
• Knowledge of data governance, security and quality controls.

Responsibilities

• Design, develop and operate data pipelines and architecture underpinning reporting, analytics, AI and data-driven decision-making.
• Build scalable, secure and reliable data platforms for the organisation.
• Design, adapt and maintain ETL/ELT processes to ingest, cleanse, transform and structure data.
• Collaborate with the Data & Analytics team to deliver trusted data products and services.
• Apply governance and best practices to ensure data quality and security.

Skills

SQL

Python

PySpark

Data pipelines

Data modelling

ETL/ELT

CI/CD

Azure DevOps

Security & governance

Agile delivery

Tools

Microsoft Fabric

Azure Synapse

ADF

DBT

Airflow

Job description

In this exciting role as a Data Engineer, you'll play a pivotal role in ensuring OurCoop maximises value from its data assets through the delivery of scalable, secure and reliable data platforms.

You will be responsible for the design, development and operation of data pipelines and architecture that underpin reporting, analytics, AI and data-driven decision-making across the Society. You will drive engineering excellence, platform innovation and continuous improvement while supporting the organisation's wider data strategy.

Collaborating with the wider Data & Analytics team of managers, engineers and developers, you'll apply your technical expertise to design and deliver trusted data products and services.

Design, adapt and maintain ETL/ELT processes that ingest, cleanse, transform and structure data, ensuring they remain aligned to changing business requirements, source system changes and data quality standards.

You will demonstrate a knowledge of the structure and meaning of data in both internal and external sources, and help create logical and physical operational data stores, staging areas, models, analytical datasets and data products.

As well as helping to shape the data and analytics strategy, you'll apply your technical skills and knowledge to design, deliver and implement data solutions, applying industry and team best practices and governance.

Who are we looking for?

Due to the nature of the role, you'll need a strong working knowledge of the Microsoft technology stack in the data and analytics area including Fabric, Lakehouse Medallion Architecture, ADF, PySpark Notebooks, Azure Data Lake and Storage, and Synapse.

We are looking for someone who is a problem solver and who can demonstrate:

• Strong expertise in SQL, Python, PySpark and building data pipelines in Microsoft Fabric technologies.
• Experience designing and operating enterprise data platforms and data warehouses.
• A solid understanding of data concepts and data modelling principles, applied across traditional warehousing and modern data lakes.
• Practical experience using Microsoft Azure DevOps and CI/CD.
• Experience delivering ETL/ELT solutions and modern data architectures.
• Strong understanding of data modelling approaches including Kimball and Medallion architectures.
• Experience implementing data governance, security and quality controls.

Desirable, but not a requirement:

• Experience developing solutions using the wider Microsoft Power Platform (Power BI, Power Apps, Power Automate).
• Experience with dbt, Airflow or equivalent orchestration tools.
• Experience supporting AI, machine learning or advanced analytics platforms.
• Knowledge of Data Mesh principles.
• Experience working within agile delivery frameworks.
• Experience building Azure Functions.

What can we offer you?

• Employee Discounts – Save up to 60% off Childcare, 20% off your Food Shop and 15% off your next Holiday
• 30 Days Annual Leave - Rising with service up to a maximum of 37 days
• Health and Wellbeing Programmes – Benefit from our Stream App and our partnership with Grocery Aid for financial and mental health support
• Full Training and Accredited Development Plans
• Enhanced Maternity, Paternity and Family leave and more!