We are looking for a proactive and hands-on Data Engineer with strong expertise to help build, optimise, and stabilise a modern enterprise data platform.
This role is ideal for someone who enjoys solving complex data challenges, investigating issues at source, and delivering robust, analytics-ready datasets. You will work closely with technical and business stakeholders to transform fragmented data into trusted, governed information assets using modern data engineering best practices and medallion architecture principles.
The successful candidate will take ownership of end-to-end data pipelines, ensuring data reliability, quality, security, and performance across the entire data lifecycle.
Key Responsibilities
Data Engineering & Architecture
- Design, build, and maintain scalable data pipelines.
- Develop end-to-end data solutions covering ingestion, transformation, modelling, and data serving layers.
- Implement and maintain Medallion Architecture (Bronze, Silver, Gold) frameworks.
- Create and optimise complex data transformations using SQL, Power Query, and related technologies.
- Build scalable semantic models that support self-service analytics and reporting.
- Ensure datasets are reliable, governed, and accessible for business users.
Data Quality & Reliability
- Design and implement data quality frameworks, validation rules, and reconciliation processes.
- Monitor and troubleshoot data pipelines, identifying and resolving issues quickly.
- Investigate and manage challenges arising from evolving source systems and changing schemas.
- Develop monitoring, alerting, and logging mechanisms to improve platform reliability.
- Continuously improve pipeline resilience and reduce operational overhead.
Stakeholder Collaboration
- Partner with source system owners, technical teams, and business stakeholders to resolve data challenges.
- Investigate root causes of data issues and drive resolutions independently.
- Translate business requirements into scalable technical solutions.
- Collaborate across functions to improve data accessibility and trust.
Security & Governance
- Implement and maintain Row-Level Security (RLS) and appropriate access controls.
- Apply data governance principles including documentation, lineage tracking, and dataset certification.
- Ensure compliance with organisational security, privacy, and governance standards.
Required Skills & Experience
- Experience working as a Data Engineer.
- Hands-on experience with Microsoft Fabric and OneLake on production projects.
- Strong understanding of Medallion Architecture (Bronze/Silver/Gold).
- Proven experience building and maintaining end-to-end data pipelines.
- Advanced SQL skills for data transformation, optimisation, and analysis.
- Experience implementing data quality checks, monitoring, and validation frameworks.
- Strong troubleshooting and root-cause analysis capabilities.
- Experience working with imperfect, changing, or incomplete source data.
- Knowledge of data security concepts including Row-Level Security (RLS).
- Ability to work independently, take ownership, and drive issues through to resolution.
Preferred Experience
- Consulting or professional services background.
- Experience working closely with Product, Business, and Technical stakeholders.
- Familiarity with data governance and enterprise data management practices.
- Exposure to AI-enabled data platforms or modern analytics solutions.
- Experience supporting analytics, reporting, and self-service BI environments.
Candidate Profile
We're looking for someone who is:
- Proactive and solutions-oriented.
- Comfortable working in ambiguous environments.
- Naturally curious and investigative.
- Able to communicate effectively with both technical and non-technical stakeholders.
- Eager to learn and quickly adapt to new technologies and business challenges.