Lead Data Engineer

Cathcart Associates Group Ltd; City of Edinburgh; Hybrid; GBP 80,000 - 100,000; Full time

Job summary

A world-class technology company in Edinburgh is seeking a Lead Data Engineer to take the technical lead on large-scale data projects. You will design scalable data platforms and pipelines, collaborate with cross-functional teams, and influence data strategy. Ideal candidates will have strong experience in data engineering and skills in technologies like Kafka, Spark, and cloud platforms. The position offers competitive salary, great benefits including uncapped holidays, and the flexibility of hybrid working.

Benefits

Competitive salary

Uncapped holidays

Multiple bonuses

Qualifications

• Strong background in data engineering.
• Experience building modern data solutions.
• Knowledge of cloud platforms (AWS, GCP, Azure).
• Confident coding in Python, Java, or Scala.

Responsibilities

• Design and build scalable data platforms and pipelines.
• Shape the technical vision and set best practices.
• Mentor others and drive standards across the team.
• Influence the overall data strategy.

Skills

Data engineering

Kafka

Spark

Databricks

dbt

Airflow

Python

Java

Scala

Job description

I’m working with a world-class technology company in Edinburgh to help them find a Lead Data Engineer to join their team (hybrid working but there is flex on this for the right person). This is your chance to take the technical lead on complex, large-scale data projects that power real-world products used by millions of people. The organisation has been steadily growing for a number of years and have become a market leader in their field so it’s genuinely a really exciting time to join!

You’ll be joining a forward-thinking team that’s passionate about doing things properly using a modern tech stack, cloud-first approach, and a genuine commitment to engineering excellence. As Lead Data Engineer, you’ll be hands-on in designing and building scalable data platforms and pipelines that enable advanced analytics, machine learning, and business-critical insights. You’ll shape the technical vision, set best practices, and make key architectural decisions that define how data flows across the organisation.

You won’t be working in isolation either as collaboration is at the heart of this role. You’ll work closely with engineers, product managers, and data scientists to turn ideas into high-performing, production-ready systems. You’ll also play a big part in mentoring others, driving standards across the team, and influencing the overall data strategy.

The ideal person for this role will have a strong background in data engineering, with experience building modern data solutions using technologies like Kafka, Spark, Databricks, dbt, and Airflow. You’ll know your way around cloud platforms (AWS, GCP, or Azure) and be confident coding in Python, Java, or Scala. Most importantly, you’ll understand what it takes to design data systems that are scalable, reliable and built for the long haul.

In return, they are offering a competitive salary (happy to discuss prior to application), great benefits which includes uncapped holidays and multiple bonuses! Their office in central Edinburgh is only a short walk from Haymarket train station. The role is Hybrid (ideally 1 or 2 days in office), however, they can be flex on this for the right candidate.

If you’re ready to step into a role where your technical leadership will have a visible impact and where you can build data systems that continue to scale then please apply or contact Matthew MacAlpine at Cathcart Technology.