Senior Data Engineer - Cloud Lakehouse & Real-Time Data

Coforge; Greater London; Hybrid; GBP 90,000 - 130,000; Full time

Job summary

Coforge in London, UK is seeking a Senior Data Engineer to design, build and optimize scalable data platforms and pipelines using Microsoft Fabric, Azure, Spark, SQL and Python. The role focuses on enabling analytics, data integration, governance, and cloud-based data solutions.

You will design and develop ETL/ELT pipelines, implement data quality and governance with Purview, and collaborate with architects, BI teams and DevOps in an Agile environment. Hybrid work model: 3 days in office.

Qualifications

• 6-10 years of Data Engineering experience.
• Bachelor's or Master's degree in Computer Science, IT, or related field.
• Microsoft Fabric/Azure Data Engineer certifications preferred.
• Ability to independently deliver complex data solutions and mentor juniors.

Responsibilities

• Design and develop ETL/ELT pipelines using Microsoft Fabric, Spark, and SQL.
• Build batch and real-time data ingestion solutions.
• Develop solutions using Fabric Data Factory, Lakehouse, Data Warehouse, Dataflows Gen2, and OneLake.
• Create and optimize data models for reporting, analytics, and BI.
• Implement data quality, governance, and lineage practices using Microsoft Purview.
• Develop streaming and CDC solutions using Kafka, Event Hub, and Event Streams.
• Collaborate with Architects, BI teams, and DevOps in Agile environments.
• Implement CI/CD, Git integration, automation, and deployment best practices.

Skills

SQL

Python

Spark

Data Engineering

Data Modeling

BI / Analytics

Education

Bachelor's or Master's in CS/IT

Tools

Microsoft Fabric

Azure Data Factory

Synapse

Databricks

Power BI

Kafka

Event Hub

OneLake

Lakehouse

Dataflows Gen2

Purview

Job description

Coforge in London, UK is seeking a Senior Data Engineer to design, build and optimize scalable data platforms and pipelines using Microsoft Fabric, Azure, Spark, SQL and Python. The role focuses on enabling analytics, data integration, governance, and cloud-based data solutions.

You will design and develop ETL/ELT pipelines, implement data quality and governance with Purview, and collaborate with architects, BI teams and DevOps in an Agile environment. Hybrid work model: 3 days in office.