Data Engineer

Cruinn Consulting; Glasgow; Hybrid; GBP 68,000 - 92,000; Full time

Benefits offered by this job

Hybrid work model

1 day in-office per week

Architectural migration project

Job summary

Cruinn Consulting is seeking a Senior Data Engineer in Glasgow to help modernise our data platform. You will own end-to-end data ingestion, transformation, and governance within a serverless, lakehouse-era architecture.

You'll work across teams to implement DBT and Spark-based pipelines, optimize SQL and Python workloads, and establish robust CI/CD practices. Hybrid work enables 1 day in the Glasgow office weekly.

Qualifications

• Senior data engineer with enterprise-scale data experience.
• Strong medallion architecture knowledge.
• Proven SQL and Python performance optimization.
• Experience with DBT and Spark for transformations.
• CI/CD and data governance experience.

Responsibilities

• Strengthen current pipelines across CRM/ERP data ingestions and the medallion architecture.
• Lead future-state serverless lakehouse design and data platform evolution using DBT, Spark, and Python.
• Establish end-to-end CI/CD across Dev/QA/Prod with automated deployments of pipelines and schema models.
• Advance platform observability, security and access controls for governed data.
• Define and embed reusable data engineering frameworks and mentor other engineers.

Skills

SQL

Python

DBT

Spark

Data Modeling

CI/CD

Security & Governance

Tools

Airflow

Job description

• Salary: £80,000 per annum
• Location: Hybrid Glasgow office
• Position Type: Full-time

About the Opportunity

Are you an expert Data Engineer who thrives on transforming legacy infrastructure into cutting-edge, modern data architecture?

We are a global enterprise looking for a senior technical authority to join our Data Services team during a pivotal modernisation phase. We are transitioning our data ecosystem from a traditional cloud data warehousing estate to a next-generation serverless storage and unified lakehouse architecture.

This role is not about maintaining pipelines in isolation or delivering one-off engineering solutions. It is about building a durable, modern data platform that serves as the foundation for advanced analytics, machine learning, and executive decision-making.

Key Responsibilities

• Strengthen Current Pipelines: Take joint ownership of existing enterprise data ingestion and integration pipelines, sourcing data from major CRMs, ERPs, and bespoke third-party systems. Maintain a reliable multi-layered medallion architecture (Bronze, Silver, Gold).
• Drive Future-State Architecture: Actively lead the evolution of the data platform toward a serverless lakehouse design. Build efficient transformation pipelines utilizing DBT SQL models, Spark notebooks, and Python.
• CI/CD & DevOps Automation: Establish robust, end-to-end CI/CD practices across environment tiers (Dev, QA, Prod), ensuring automated deployment of pipelines, transformations, and schema models.
• Platform Observability & Security: Advance logging, monitoring, and proactive failure detection. Maintain and enhance stringent access controls to ensure data remains highly governed and secure.
• Engineering Standards & Mentorship: Define and embed reusable frameworks and coding standards across the data platform. Mentor other engineers and analytics practitioners to elevate the team’s technical maturity.

What We Are Looking For

• Core Experience: Extensive experience as a Senior Data Engineer in enterprise-scale data environments, with a solid background utilizing medallion architectures.
• Technical Toolkit: Deep proficiency in SQL and Python, particularly for data engineering, performance optimization, and Spark-based transformations.
• Analytics Engineering: Proven experience with DBT for data transformation, along with supporting enterprise-grade business intelligence and semantic models.
• DevOps & Governance: Strong experience designing, building, and supporting CI/CD pipelines alongside a deep understanding of data governance, security, and environment management.
• Mindset: Comfort operating in ambiguous, evolving environments, with the ability to help shape the architecture rather than simply implementing a fixed design.

What We Offer

• Competitive salary of £80,000.
• Flexible hybrid working model (1 day a week in the office, with occasional days for in-person collaborative design workshops).
• The chance to play a defining role in a major, well-funded architectural migration.