Senior Data Integration Engineer: Microsoft Fabric & Lakehouse

Tata Consultancy Services

Letterkenny

On-site

EUR 65,000 - 100,000

Full time

38 hours ago

Be an early applicant

Application generator

Don’t send a generic resume — generate a resume and cover letter tailored to this exact role.

Get past ATS filters

Job summary

Tata Consultancy Services in Ireland invites an experienced data integration engineer to develop, enhance and support enterprise data pipelines using Microsoft Fabric for a leading UK higher education organisation. You will deliver reliable pipelines, dataflows and transformations with focus on data quality, performance and operational supportability.

Ideal candidates have 6–9 years in data integration, strong hands-on Fabric experience, Python or PySpark, SQL and ETL/ELT skills, plus Agile

Qualifications

6-9 years of relevant data integration or data engineering experience.
Strong hands-on experience with Microsoft Fabric, Fabric Data Factory, pipelines and dataflows.
Good knowledge of OneLake, Lakehouse, SQL, data transformation and ETL/ELT development.
Experience with Python or PySpark, data validation, reconciliation, Git, CI/CD and deployment practices.
Strong troubleshooting, communication and Agile delivery skills with attention to data quality and documentation.
Awareness of Power BI connectivity and semantic models, together with experience optimising Fabric pipelines and queries.

Responsibilities

Develop and maintain Microsoft Fabric pipelines, dataflows, notebooks and data ingestion processes.
Implement extraction, transformation and loading logic using approved mappings, SQL and Python or PySpark.
Integrate approved source systems with Microsoft Fabric, OneLake, Lakehouse and target data stores.
Implement validation, reconciliation, logging and error handling, and troubleshoot pipeline and connectivity issues.
Optimise performance, support testing and deployments, maintain documentation and guide junior developers through peer reviews.