Data Engineer

Sword Group; Glasgow; On-site; GBP 60,000 - 90,000; Full time

Benefits offered by this job

Flexible working hours

Private health care

Pension scheme

Job summary

Sword Group is seeking a Data Engineer in the United Kingdom (Glasgow area) to design, build, and optimize scalable data pipelines using Azure Data Factory, Synapse, Fabric, and Databricks. You will collaborate with clients and cross-functional teams to translate business needs into robust data solutions.

Ideal candidates will have hands-on experience with Fabric, data governance, and advanced transformations in SQL, Python, and Spark, with opportunities to mentor junior engineers and grow

Qualifications

• Deep knowledge of Azure Data Factory, Synapse, Fabric, Power BI and Databricks.
• Experience with Fabric architecture and data migrations.
• Understanding of stringent data governance requirements.
• Ability to consult with clients and mentor junior engineers.
• Proven experience in advanced data transformations and data modeling for analytics.

Responsibilities

• Design, build, and maintain scalable, secure data pipelines using Azure services and Fabric.
• Integrate data from multiple sources into data lakes ensuring reliability and performance.
• Develop ELT/ETL processes with Azure-native tools and Fabric capabilities.
• Maintain Fabric artefacts including lakehouses, warehouses, notebooks, dataflows, semantic models.
• Optimize data models used by Power BI and Fabric for performance and reuse.
• Collaborate with cross-functional teams and stakeholders to translate requirements into data solutions.
• Mentor junior engineers, perform code reviews, and promote best practices.
• Contribute to CI/CD, version control, and automated deployment for data solutions.
• Document pipelines, datasets, data models, and solution designs.
• Stay current with Azure, Fabric, Power BI, Purview, and Microsoft Foundry capabilities.

Skills

Azure Data Factory

Synapse

Fabric

Power BI

Databricks

SQL

Python

Spark

Data governance

Consult with clients

Mentoring teams

ETL/ELT design

Tools

SQL

Python

Spark

Job description

Sword is a leading provider of business technology solutions within the Energy, Public and Finance Sectors, dedicated to driving transformational change for our clients. We leverage proven technology, specialist teams, and extensive domain expertise to create robust technical foundations across platforms, data, and business applications. Our mission is fueled by a passion for technology as a means to solve complex business problems and achieve our clients' objectives.

About the role

This Data Engineer role offers an excellent opportunity for someone with a good understanding and working knowledge of designing and building robust data pipelines, integrating complex data sources, and developing solutions using Azure Data Services, Microsoft Fabric, Power BI, and Purview.

As an experienced Data Engineer, you will handle more advanced engineering tasks, drive improvements to existing pipelines, and contribute to the design of scalable, high quality data architectures. You’ll collaborate directly with clients and cross-functional teams, translating real business needs into effective data solutions while beginning to support and mentor junior engineers.

This role is ideal for someone who wants to grow toward senior-level responsibilities, gain exposure to architectural thinking, and work with cutting‑edge technologies, including Microsoft Foundry as part of emerging AI-driven capabilities. Candidates should apply if they’re looking for a role that blends hands‑on engineering, problem-solving, continuous learning, and meaningful contribution to client outcomes within a high-performing Data & AI business unit.

A Data Engineer is responsible for several key activities:

• Design, build, and maintain scalable, secure, and high performing data pipelines using Azure Data Factory, Synapse, Fabric Pipelines, or Databricks
• Integrate data from multiple systems into Azure Data Lake Storage or OneLake, ensuring consistency, reliability, and performance
• Develop and maintain ELT/ETL processes using Azure-native tools and Fabric capabilities, optimising for cost and performance
• Build and maintain Microsoft Fabric artefacts including lakehouses, warehouses, notebooks, dataflows, and semantic models
• Perform advanced data transformations using SQL, Python, Spark, or Fabric Data Engineering experiences to prepare data for analytics and reporting
• Manage and optimise data models used by Power BI, ensuring good performance, relationships, quality, and reusability
• Support enterprise BI development by preparing datasets, semantic models, and reusable components within Power BI and Fabric
• Apply data governance and security best practices by implementing Purview classification, lineage, access controls, and policies
• Conduct data quality checks, data validation routines, and issue resolution to ensure trustworthy and reliable datasets
• Work closely with cross-functional teams (data architects, analysts, data scientists, product teams) to understand requirements and translate them into robust data solutions
• Engage directly with clients and stakeholders to clarify data needs, communicate progress, and explain technical concepts in a clear, accessible way
• Take ownership of more complex engineering tasks and assist senior engineers with solution components requiring deeper technical insight
• Mentor junior engineers by providing guidance, performing code reviews, and sharing best practices in engineering standards and Azure environments
• Contribute to CI/CD processes, version control practices, and automated deployment pipelines for data solutions
• Support the creation of documentation for pipelines, datasets, data models, and solution designs
• Troubleshoot pipeline failures, performance issues, and data inconsistencies, ensuring the stability and reliability of production workloads
• Stay current with emerging tools and capabilities across Azure, Microsoft Fabric, Power BI, Purview, and Microsoft Foundry
• Identify opportunities to improve efficiency, automation, scalability, or maintainability across existing pipelines and solutions
• Contribute to internal knowledge sharing, best-practice development, and engineering accelerators or templates

• Deep understanding of Azure Data Factory, Synapse, Fabric, Power BI and Databricks
• Experience in Fabric/data architecture
• Experience in Fabric/data migrations
• Understanding of the requirements of stringent data governance
• Ability to consult with clients
• Proven experience of mentoring teams
• Experience of advanced data transformations using SQL, Python, Spark, or Fabric Data Engineering experiences to prepare data for analytics and reporting

At Sword, our core values and culture are based on caring about our people, investing in training and career development, and building inclusive teams where we are all encouraged to contribute to achieve success.We offer comprehensive benefits designed to support your professional development and enhance your overall quality of life. In addition to a Competitive Salary, here's what you can expect as part of our benefits package:

• Personalised Career Development: We create a development plan customised to your goals and aspirations, with a range of learning and development opportunities within a culture that encourages growth.
• Flexible working: Flexible work arrangements to support your work-life balance. We can’t promise to always be able to meet every request, however, are keen to discuss your individual preferences to make it work where we can.
• A Fantastic Benefits Package: This includes generous annual leave allowance, enhanced family friendly benefits, pension scheme, access to private health, well-being, and insurance schemes.

At Sword we are dedicated to fostering a diverse and inclusive workplace and are proud to be an equal opportunities employer, ensuring that all applicants receive fair and equal consideration for employment, regardless of whether they meet every requirement. If you don’t tick all the boxes but feel you have some of the relevant skills and experience we’re looking for, please do consider applying and highlight your transferable skills and experience. We embrace diversity in all its forms, valuing individuals regardless of age, disability, gender identity or reassignment, marital or civil partner status, pregnancy or maternity status, race, colour, nationality, ethnic or national origin, religion or belief, sex, or sexual orientation. Your perspective and potential are important to us.

If we can do anything to help make the hiring process more accessible, please let our talent acquisition team know when you apply so we can support any adjustments.