Data Engineer

Oscar Technology; City Of London; Hybrid; GBP 83,000 - 92,000; Full time

Job summary

Oscar Technology is seeking a Data Engineer to maintain and enhance an operational data platform in a highly regulated energy environment in London. You’ll integrate on-prem data with Azure and Microsoft Fabric, shaping BAU and strategic work streams.

The role focuses on data ingestion, orchestration, and secure access management across Azure services and Fabric, with a hybrid on-site requirement 1-2 days per week.

Qualifications

• Strong Python development experience required.
• Experience integrating data from on-premises SQL Server into cloud platforms.
• Knowledge of APIs, system integrations and data exchange mechanisms.

Responsibilities

• Design, maintain and optimise data pipelines ingesting data into Azure and Microsoft Fabric.
• Support Azure-based data platforms, including Synapse Analytics, Storage and Logic Apps.
• Manage ingestion of operational plant data including weighbridge and real-time feeds.
• Support development/maintenance of data warehousing and lakehouse solutions in Fabric.
• Configure security controls and access in Fabric and Entra ID.

Skills

Strong Python development skills

On-premises SQL Server to cloud data

APIs & data exchange knowledge

Tools

Azure Synapse Analytics

Azure Storage

Azure Logic Apps

Azure data integration services

Microsoft Fabric

Data warehousing

Lakehouse architecture

Data pipelines

Security and access management

Job description

Data Engineer £450-£500p/day (Inside IR35) London (Hybrid, 1-2 days per week on site) Energy/highly regulated environments Azure/Microsoft Fabric

Our client is looking for an experienced Data Engineer to support the ongoing maintenance, enhancement and development of their operational data platform within a highly regulated Energy from Waste (EfW) environment.

We're looking for someone who will manage and improve the flow of operational, plant and asset data from on-premises systems into the Microsoft Azure ecosystem enabling effective reporting and compliance.

The role is split roughly 60% business-as-usual (platform maintenance, support and enhancement) and 40% strategic projects.

Key Responsibilities:

• Design, maintain and optimise data pipelines that ingest data from operational and business systems into Azure and Microsoft Fabric
• Support the ongoing operation and enhancement of Azure-based data platforms, including Azure Synapse Analytics, Azure Storage and Logic Apps
• Manage and improve ingestion of operational plant data, including weighbridge systems, asset monitoring systems and real-time data feeds
• Support the development and maintenance of data warehousing and lakehouse solutions within Microsoft Fabric
• Configure and support access controls, security groups and user permissions in Microsoft Fabric and Microsoft Entra ID

Essential Skills & Experience:

• Strong Python development skills
• Experience integrating data from on-premises SQL Server environments into cloud platforms
• Good understanding of APIs, system integrations and data exchange mechanisms

Proven experience with Microsoft Azure data technologies, including:

• Azure Synapse Analytics
• Azure Storage
• Azure Logic Apps
• Azure data integration services

Strong experience with Microsoft Fabric, including:

• Data warehousing
• Lakehouse architecture
• Data pipelines
• Security and access management

Data Engineer £450-£500p/day (Inside IR35) London (Hybrid, 1-2 days per week on site) Energy/highly regulated environments Azure/Microsoft Fabric

To understand more about what we do with your data please review our privacy policy in the privacy section of the Oscar website.