Junior Data Integration Engineer - Microsoft Fabric Pipelines

Tata Consultancy Services

Letterkenny

On-site

EUR 65,000 - 90,000

Full time

6 days ago

Be an early applicant

Application generator

A complete application in a minute — tailored resume and cover letter, ready to send.

Get past ATS filters

Job summary

Tata Consultancy Services is seeking a data integration engineer to develop, test and support data pipelines using Microsoft Fabric for a leading UK higher education client. You will work with senior engineers to deliver reliable ingestion, transformation and validation processes, building modern data pipelines with OneLake and Lakehouse technologies.

Responsibilities include configuring connections, implementing SQL transformations, PySpark processing and ensuring quality through unit tests and

Qualifications

3-6 years of relevant data integration or software development experience.
Working knowledge of Microsoft Fabric fundamentals, pipelines and dataflows.
Good SQL skills and understanding of data ingestion, transformation, OneLake and Lakehouse concepts.
Basic Python or PySpark knowledge, with experience in data validation, testing, troubleshooting and Git.
Good analytical, communication and teamwork skills with experience of Agile delivery practices.
Awareness of Power BI connectivity and exposure to CI/CD or automated deployment practices.

Responsibilities

Develop and maintain Microsoft Fabric pipelines and dataflows from approved technical specifications.
Configure data-source connections and support batch ingestion into OneLake, Lakehouse or approved targets.
Implement SQL transformations, mappings, validation rules and basic Python or PySpark processing.
Execute unit tests, reconcile outputs, investigate routine pipeline failures and resolve assigned defects.
Support deployments and maintain technical documentation, mapping records and operational runbooks.