AI Data Engineer 2 (contract)

Microsoft; Atherstone; On-site; GBP 56,000 - 63,000; Full time

Job summary

Microsoft is seeking a hands-on Data Engineer for a contract role delivering a trusted data platform using Microsoft Fabric and OneLake. You will transform messy data into accurate, governance-ready datasets and own the end-to-end health of data pipelines.

You will collaborate with source teams, troubleshoot issues, and drive automated, scalable data solutions. The role emphasizes architecture design, data quality, and secure data access, with a focus on Bronze/Silver/Gold modeling and proactive

Qualifications

• Must have hands-on experience with Microsoft Fabric (1–2 years).
• Experience designing Bronze/Silver/Gold data layers and OneLake ingestion.
• Strong SQL-based transformations and data quality controls.
• Ability to build scalable ETL/ELT pipelines and semantic models.

Responsibilities

• Build and maintain data pipelines in Microsoft Fabric.
• Design and implement Bronze, Silver, and Gold data layers.
• Ingest data from multiple sources into OneLake and develop ETL/ELT solutions.

Skills

Microsoft Fabric

OneLake

Medallion Architecture

Advanced SQL

Data Pipeline Development

ETL / ELT Design

Data Quality Frameworks

Data Validation

Monitoring & Alerting

Semantic Modeling

Power Query / M Query

Job description

• CI/CD for data pipelines

Please note that this is a contract role providing services to Microsoft through external staffing partners of Allegis Global Solutions (AGS). If you are selected for this role, you will be employed by AGS and will not be an employee of Microsoft.

Role Summary

This is a hands‑on Data Engineer role focused on building a reliable and trusted data platform using Microsoft Fabric and OneLake. The person will take messy, inconsistent data coming from multiple systems and transform it into accurate, governed, analytics‑ready datasets. They will own the end‑to‑end health of data pipelines, proactively troubleshoot issues, and work directly with source system teams to resolve data problems. This role requires someone who takes initiative, enjoys solving complex data challenges, and can operate independently with minimal direction.

Key Responsibility

Data Engineering & Architecture

• Build and maintain data pipelines in Microsoft Fabric.
• Design and implement Bronze, Silver, and Gold data layers.
• Ingest data from multiple source systems into OneLake.
• Create scalable ETL/ELT solutions.
• Develop advanced SQL‑based transformation logic.
• Optimize pipeline performance and reliability.
• Build semantic models that support governed self‑service reporting.

Data Quality & Reliability

• Implement automated data quality validations.
• Create reconciliation and audit checks.
• Monitor pipeline performance and failures.
• Troubleshoot data issues caused by schema or source‑system changes.
• Reduce manual intervention through automation.

Stakeholder Collaboration

• Partner with application owners and data producers.
• Investigate root causes of data inconsistencies.
• Drive resolution of ambiguous data issues.
• Act as the technical owner of data‑related problems.

Security & Governance

• Configure Row‑Level Security (RLS).
• Maintain dataset lineage and documentation.
• Implement data governance standards.
• Ensure secure and compliant data access.

Must Have Skills

Technical

• Microsoft Fabric (minimum 1-2 years hands‑on)
• OneLake
• Medallion Architecture (Bronze / Silver / Gold)
• Advanced SQL
• Data Pipeline Development
• ETL / ELT Design
• Data Quality Frameworks
• Data Validation & Reconciliation Controls
• Monitoring & Alerting Implementation
• Semantic Modeling
• Microsoft Power Query / M Query

Functional

• Strong troubleshooting skills
• Root cause analysis experience
• Experience working with changing source systems
• Ability to work independently
• Proactive ownership mindset

Nice-to-Have Skills

• Power BI Semantic Models
• Data Warehouse Design
• Lakehouse Architecture
• Azure Data Engineering ecosystem
• Data Governance platforms
• CI/CD for data pipelines
• DataOps practices
• Metadata management
• Dataset certification and lineage tools

Experience Level Guidance

Ideal Experience

• 4-8 years total Data Engineering experience
• 1-3 years actively working in Microsoft Fabric
• Experience supporting production‑grade enterprise data platforms
• Experience dealing with multiple source systems and frequent schema changes

Additional Details

• Location: Remote (United Kingdom)
• Duration: 6 months
• Shift Timings: Monday – Friday (Business Hours)
• Pay Range: £303 - £341 /day (PAYE)
• Weekly Schedule: 40 hours

As a workplace, Allegis Global Solutions focuses on relationships – with each other, our clients and our candidates. In fact, serving others is one of our core values. We support open communication and recognize that giving constructive criticism can be even harder than receiving it. We appreciate the fearless and the passionate, who force us to be better. Everything we do sits on a pillar of diversity, equity and inclusion - diverse perspectives, backgrounds and ideas achieve innovation and make us successful.

Please note that we may use artificial intelligence (AI) tools to screen, assess, or select applicants for this position. These tools may analyse application materials and assist our team in identifying candidates whose qualifications best match the requirements of the role. If you have questions about our use of AI in the hiring process, or would like more information, please contact us.

Pay Rate Range

303 - 341 GBP daily