Senior Data Integration Engineer (Microsoft Fabric) - Fixed Term (6 Months)

Tata Consultancy Services; Letterkenny; On-site; EUR 65,000 - 100,000; Full time

Job summary

Tata Consultancy Services in Ireland invites an experienced data integration engineer to develop, enhance and support enterprise data pipelines using Microsoft Fabric for a leading UK higher education organisation. You will deliver reliable pipelines, dataflows and transformations with focus on data quality, performance and operational supportability.

Ideal candidates have 6–9 years in data integration, strong hands-on Fabric experience, Python or PySpark, SQL and ETL/ELT skills, plus Agile

Qualifications

• 6-9 years of relevant data integration or data engineering experience.
• Strong hands-on experience with Microsoft Fabric, Fabric Data Factory, pipelines and dataflows.
• Good knowledge of OneLake, Lakehouse, SQL, data transformation and ETL/ELT development.
• Experience with Python or PySpark, data validation, reconciliation, Git, CI/CD and deployment practices.
• Strong troubleshooting, communication and Agile delivery skills with attention to data quality and documentation.
• Awareness of Power BI connectivity and semantic models, together with experience optimising Fabric pipelines and queries.

Responsibilities

• Develop and maintain Microsoft Fabric pipelines, dataflows, notebooks and data ingestion processes.
• Implement extraction, transformation and loading logic using approved mappings, SQL and Python or PySpark.
• Integrate approved source systems with Microsoft Fabric, OneLake, Lakehouse and target data stores.
• Implement validation, reconciliation, logging and error handling, and troubleshoot pipeline and connectivity issues.
• Optimise performance, support testing and deployments, maintain documentation and guide junior developers through peer reviews.

Skills

SQL

Python/PySpark

ETL/ELT

Agile delivery

Data quality

Documentation

Power BI connectivity

Git

CI/CD

Troubleshooting

Tools

Microsoft Fabric

Fabric Data Factory

OneLake

Lakehouse

Job description

Job Type: Fixed Term Contract: 6 months, with scope to extend

Careers at TCS: It means more

TCS is a purpose-led transformation company, built on belief. We do not just help businesses to transform through technology. We support them in making a meaningful difference to the people and communities they serve - our clients include some of the biggest brands in the UK and worldwide. For you, it means more to make an impact that matters, through challenging projects which demand ambitious innovation and thought leadership.

• Deliver modern data integration capabilities using Microsoft Fabric, OneLake and Lakehouse technologies.
• Solve meaningful data engineering challenges within a complex higher education environment.
• Take technical ownership for delivery quality and support the development of junior engineers.

The Role

Develop, enhance and support enterprise data integration capabilities using Microsoft Fabric for a leading UK higher education organisation. You will deliver reliable pipelines, dataflows and transformations while ensuring data quality, performance and operational supportability.

Your responsibilities:

• Develop and maintain Microsoft Fabric pipelines, dataflows, notebooks and data ingestion processes.
• Implement extraction, transformation and loading logic using approved mappings, SQL and Python or PySpark.
• Integrate approved source systems with Microsoft Fabric, OneLake, Lakehouse and target data stores.
• Implement validation, reconciliation, logging and error handling, and troubleshoot pipeline and connectivity issues.
• Optimise performance, support testing and deployments, maintain documentation and guide junior developers through peer reviews.

Your Profile:

Essential skills/knowledge/experience:

• 6-9 years of relevant data integration or data engineering experience.
• Strong hands-on experience with Microsoft Fabric, Fabric Data Factory, pipelines and dataflows.
• Good knowledge of OneLake, Lakehouse, SQL, data transformation and ETL/ELT development.
• Experience with Python or PySpark, data validation, reconciliation, Git, CI/CD and deployment practices.
• Strong troubleshooting, communication and Agile delivery skills with attention to data quality and documentation.
• Awareness of Power BI connectivity and semantic models, together with experience optimising Fabric pipelines and queries.

TCS is consistently voted a Top Employer in the UK and globally. Our competitive salary packages feature pension, health care, life assurance, laptop and access to extensive training resources and discounts within the larger Tata network.

We offer health & wellness initiatives and sports events; we are the proud sponsor of the London Marathon and partner with our local communities in Ireland.

Diversity, Inclusion and Wellbeing

Tata Consultancy Services UK&I is committed to meeting the accessibility needs of all individuals in accordance with the Ireland Employment Equality Acts 1998-2011 (as amended) and the Equal Status Acts 2000-2012 (as amended).

We welcome and embrace diversity in race, nationality, ethnicity, disability, neurodiversity, gender identity, age, physical ability, gender reassignment, sexual orientation. We are a disability inclusive employer and encourage disabled people to apply for this role.

As a Disability Confident Employer, we offer an interview to applicants with disabilities or long-term conditions who meet the minimum criteria for the role.