Data Engineer

Core-Asset Consulting; Newcastle upon Tyne; On-site; GBP 55,000 - 75,000; Full time

Benefits offered by this job

Competitive salary

Wide benefits package

Job summary

Core-Asset Consulting is seeking a data engineer to design, build and enhance data pipelines using Microsoft Fabric. You will collaborate with business teams to deliver robust data solutions and ensure data quality across analytics projects.

The role emphasizes translating transactional data into scalable models, and integrating diverse data sources with best-practice ETL/ELT methods while supporting ongoing reporting needs.

Qualifications

• Strong proficiency in T-SQL and complex queries/ stored procedures.
• ,

Responsibilities

• Translate complex transactional data into optimised analytical models (facts and dimensions).
• Design, build, and enhance data pipelines within Microsoft Fabric to improve performance and data quality.
• Engineer integrations from internal and external data sources using best-practice ETL/ELT.
• Monitor and optimise SQL-based workflows for accuracy and efficiency in daily processing.
• Lead migration of legacy reporting datasets to modern platforms with minimal disruption.
• Collaborate with analytics teams to develop custom data models and engineered datasets.
• Partner with data science colleagues to create summaries and aggregated datasets for analytics.
• Respond to ad hoc data requests with timely, accurate outputs.

Skills

T-SQL

Spark

PySpark

OLTP/OLAP

Microsoft Fabric

Azure Data Factory

ETL/ELT

Data modelling

Data quality

Analytical thinking

Collaboration

Tools

Microsoft Fabric

Azure Data Factory

Data Lake

Data Warehouse

Blob Storage

Job description

Job Description

You will play a critical role as part of a small specialist to design, build and enhance data pipelines using Microsoft Fabric. With strong collaboration and analytical skills, you will work with the business to provide data solutions to meet business needs.

Essential Skills:

• Strong proficiency in T-SQL and experience developing complex queries and procedures.
• Expertise in Spark and PySpark for scalable data processing.
• Solid understanding of OLTP and OLAP architectures and data modelling principles.
• Experience with Microsoft Azure, including Fabric, Azure Data Factory, Data Lake, Data Warehouse, and Blob Storage.
• Sound knowledge of ETL/ELT best practices.
• Strong analytical and problem-solving skills with a focus on data accuracy and reliability.
• Excellent collaboration and communication skills, with the ability to translate business requirements into technical solutions.
• Comfortable working in dynamic environments and committed to continuous improvement.

Core Responsibilities:

• Translate complex transactional data into optimised analytical models (facts and dimensions) to support reporting and insights.
• Design, build, and enhance data pipelines within Microsoft Fabric to improve performance, scalability, and data quality.
• Engineer new integrations from internal and external data sources using best-practice ETL/ELT methodologies.
• Monitor and optimise SQL-based workflows to ensure accuracy and efficiency in daily data processing.
• Lead efforts to migrate legacy reporting datasets to modern platforms, ensuring minimal disruption.
• Collaborate with analytics teams to develop custom data models and engineered datasets tailored to business requirements.
• Partner with data science colleagues to create summary and aggregated datasets for advanced analytics and predictive modelling.
• Respond efficiently to ad hoc data requests, ensuring outputs are timely, accurate, and aligned to stakeholder needs.

Benefits:

• A highly competitive salary
• Wider Benefits package

Core-Asset Consulting is an equal opportunities recruiter and we welcome applications from everyone irrespective of age, disability, gender, gender identity or expression, race, colour, ethnic or national origin, sexual orientation, religion or belief, marital/civil partner status or pregnancy.

To apply for this vacancy applicants must be eligible to work in the UK in accordance with the Immigration, Asylum and Nationality Act 2006.

At Core-Asset, we're committed to protecting and respecting your privacy. Our privacy statement explains when and why we collect personal information about people who engage with our services, how we use it, the conditions under which we may disclose it to others, and how we keep it secure. We may change this policy from time to time, so please check this policy occasionally to ensure that you're happy with any changes.

By engaging with us (either by applying for a job we're advertising, registering through our website, or getting in touch with our business) you're agreeing to be bound by this policy.

Core-Asset Consulting is committed to protecting the privacy of our candidates, clients and website users. For further information, please refer to our full Privacy Statement available on our website http://www.core-asset.co.uk/about-core-asset/privacy-statement

Core-Asset Consulting offers specialist recruitment services to asset management, accounting & finance, asset servicing, legal and the wider financial services sector in Scotland.