Data Engineer (Full-Stack Data Products)

Catalyst; North East; On-site; GBP 60,000 - 90,000; Full time

Job summary

Catalyst is hiring a Data Engineer in Newcastle upon Tyne to develop, build and maintain scalable data pipelines and platforms powering analytics and AI-driven products. You will work across backend and data engineering, combining cloud infrastructure, data pipelines, and platform automation with a broad skillset.

The role emphasizes architecture discussions, automated testing, and data reliability, with collaboration across internal and external stakeholders to drive innovation using modern

Qualifications

• Proven experience designing and building data-intensive applications and pipelines.
• Strong Python and SQL, writing clean, performant code to process large data volumes.
• Experience designing complex data-matching, reconciliation, and entity-resolution across multiple sources.
• Exposure to distributed computing frameworks such as Spark and Databricks.
• Hands-on experience with cloud platforms (AWS, Azure, GCP).
• Knowledge of orchestration tools like Airflow.
• Modern DevOps practices including CI/CD and infrastructure as code (Terraform or Kubernetes).
• Experience building scalable backend applications and understanding distributed systems.

Responsibilities

• Develop, build and maintain scalable data intensive systems, pipelines and platforms powering analytics and AI-driven products.
• Create production-grade applications and APIs with robust, well-tested code.
• Participate in architecture and technical design discussions.
• Write automated unit, integration, and end-to-end tests.
• Design and develop data pipelines from internal and external sources and integrate into data platforms.
• Maintain data quality and reliability to support decision making.
• Collaborate with stakeholders to improve data accessibility and usability and drive innovation with new analytics tech.
• Deploy cloud-native solutions using Infrastructure as Code and contribute to cloud architecture optimization.

Skills

Python

SQL

Distributed computing

Cloud platforms

Airflow

DevOps CI/CD

Terraform

Kubernetes

Backend development

Distributed systems

Education

2:1 or 1st in Computing/Math/Physics

Tools

Terraform

Kubernetes

Databricks

Airflow

CI/CD

Job description

The Client

We are delighted to be ,once more, recruiting on behalf of our prestigious client, a newly created JV Technology Consulting business formed by global leaders in the fields of management consulting and investment fund management. Based in Newcastle upon Tyne at their enviable facilities, my client seek a Data Engineer for Full-Stack Data Products, to join their elite Tyneside team as part of rapid expansion of the business to cope with client demand and continued excellent performance.

About the Role

As a Data Engineer you will play a key role in developing, building and maintaining scalable data intensive systems, pipelines and platforms that power analytics, operational systems, and AI-driven products. This role combines full-stack or backend software engineering with modern data engineering, requiring someone with a broad skillset and who excels in solving problems across application development, data pipelines, cloud infrastructure, and platform automation.

• Software Design: Develop, and maintain production-grade applications and APIs.


• Application Build: Develop reusable, well-tested code following engineering best practices.


• Architecture: Participate in architecture and technical design discussions.


• Testing: Write automated unit, integration, and end-to-end tests.


• Data Pipeline Development: Design and develop sophisticated data pipelines to import data from internal and external sources and seamlessly integrate into data platforms.


• Maintenance & Data Reliability: Ensure systems are well-maintained, enabling uninterrupted access to crucial data. Continuously verify data quality and integrity to support decision making.


• Continuous Improvement & Collaboration: Collaborate with internal and external stakeholders to streamline data accessibility and usability. Drive innovation by adopting advanced analytics technologies and methodologies.


• Cloud infrastructure: Deploy cloud-native solutions using Infrastructure as Code and collaborate on cloud architecture and optimisation

About You

To be considered for the role, it is essential that you possess exemplary academic prowess, with a 2:1 or 1st in a relevant subject (e.g. Computing Science, Maths, Physics etc.) from a leading University and accompanying demonstrable experience gained working as a Data Engineering professional. It would be highly advantageous if you possessed experience working in the Financial Services Sector.

Key Selection Criteria

• Expertise in designing and building data intensive applications and pipelines, with an open mindset on choice of tools


• Strong proficiency in Python and SQL, with a focus on writing clean, performant code to process and manage large volumes of data


• Experience designing and implementing complex data-matching, reconciliation, and entity-resolution solutions across multiple data sources


• Distributed computing for data intensive work such as Spark and Databricks


• Cloud platforms including AWS, Azure and GCP


• Orchestration tools like Airflow


• Modern DevOps practices including version control, CI/CD, and infrastructure as code using Terraform or Kubernetes


• Experience building scalable backend applications


• Understanding of distributed systems and software architecture.


• Ability to test and troubleshoot data products with a track record of improving data reliability and quality


• Excellent communication skills and the ability to work effectively and openly within a team-based environment


• Self-motivated, detail-oriented, and eager to learn new technologies and methodologies

This is an excellent opportunity to join a leading business that only employs exceptional, collaborative and passionate people. This rapid expansion phase is the ideal time to be joining such a prestigious business.