Data Engineer

Core-Asset Consulting Ltd; North East; On-site; GBP 50,000 - 70,000; Full time

Job summary

Core-Asset Consulting recherche un Data Engineer pour un poste permanent à Newcastle. Le candidat jouera un rôle clé en transformant des données opérationnelles complexes en insights significatifs, en concevant des pipelines de données robustes et en collaborant avec différents départements pour optimiser les modèles de données. Il est essentiel d'avoir une expertise en T-SQL, Spark, et Microsoft Azure pour réussir dans ce rôle.

Benefits

Compensation salariale très compétitive

Large package de bénéfices

Qualifications

• Expérience forte en T-SQL et en PySpark.
• Compréhension solide des architectures OLTP et OLAP.
• Compétences analytiques et de résolution de problèmes avérées.

Responsibilities

• Concevoir et améliorer des pipelines de données au sein de Microsoft Fabric.
• Ingénierie de nouvelles intégrations à partir de sources de données internes et externes.
• Collaborer avec des équipes analytiques pour développer des modèles de données personnalisés.

Skills

T-SQL

Spark

PySpark

ETL/ELT best practices

Data modelling

Analytical skills

Problem-solving

Communication skills

Tools

Microsoft Azure

Azure Data Factory

Data Lake

Data Warehouse

Blob Storage

Microsoft Fabric

Job description

Job Description:

Core-Asset Consulting is delighted to be partnering with a highly respected financial service firm to recruit a Data Engineer for a permanent position based in Newcastle.This is a fantastic opportunity to join an organisation with a clear commitment to innovation and insight-led decision-making.

As a Data Engineer, you will play a critical role in transforming complex operational data into meaningful insights.Working across analytics, data science, and development teams, you will design and implement robust data pipelines, optimise data models, and ensure high-quality, reliable outputs that drive strategic business decisions.

Essential Skills/Experience:

• Strong proficiency in T-SQL and experience developing complex queries and procedures.
• Expertise in Spark and PySpark for scalable data processing.
• Solid understanding of OLTP and OLAP architectures and data modelling principles.
• Experience with Microsoft Azure, including Fabric, Azure Data Factory, Data Lake, Data Warehouse, and Blob Storage.
• Sound knowledge of ETL/ELT best practices.
• Strong analytical and problem-solving skills with a focus on data accuracy and reliability.
• Excellent collaboration and communication skills, with the ability to translate business requirements into technical solutions.
• Comfortable working in dynamic environments and committed to continuous improvement.

Core Responsibilities:

• Translate complex transactional data into optimised analytical models (facts and dimensions) to support reporting and insights.
• Design, build, and enhance data pipelines within Microsoft Fabric to improve performance, scalability, and data quality.
• Engineer new integrations from internal and external data sources using best-practice ETL/ELT methodologies.
• Monitor and optimise SQL-based workflows to ensure accuracy and efficiency in daily data processing.
• Lead efforts to migrate legacy reporting datasets to modern platforms, ensuring minimal disruption.
• Collaborate with analytics teams to develop custom data models and engineered datasets tailored to business requirements.
• Partner with data science colleagues to create summary and aggregated datasets for advanced analytics and predictive modelling.
• Respond efficiently to ad hoc data requests, ensuring outputs are timely, accurate, and aligned to stakeholder needs.

Benefits:

• A highly competitive salary
• Wider Benefits package

Core-Asset Consulting is an equal opportunities recruiter and we welcome applications from everyone irrespective of age, disability, gender, gender identity or expression, race, colour, ethnic or national origin, sexual orientation, religion or belief, marital/civil partner status or pregnancy.

Job reference: 16151

To apply for this vacancy applicants must be eligible to work in the UK in accordance with the Immigration, Asylum and Nationality Act 2006.

At Core-Asset, we're committed to protecting and respecting your privacy.Our privacy statement explains when and why we collect personal information about people who engage with our services, how we use it, the conditions under which we may disclose it to others, and how we keep it secure.We may change this policy from time to time, so please check this policy occasionally to ensure that you're happy with any changes.

By engaging with us (either by applying for a job we're advertising, registering through our website, or getting in touch with our business) you're agreeing to be bound by this policy.

Core-Asset Consulting is committed to protecting the privacy of our candidates, clients and website users.For further information, please refer to our full Privacy Statement available on our website http://www.core-asset.co.uk/about-core-asset/privacy-statement

Core-Asset Consulting offers specialist recruitment services to asset management, accounting & finance, asset servicing, legal and the wider financial services sector in Scotland.

INDPERM