Principal Data Engineer & Tech Leader (Remote/Hybrid)

CreateFuture; City of Edinburgh; Hybrid; GBP 120,000 - 150,000; Full time

Job summary

CreateFuture is seeking a Principal Data Engineer to set the technical direction for our data practice. You will lead architecture across client engagements, mentor engineers, and shape patterns for reliable, scalable data platforms in a multi-industry UK context.

You'll design real-time and batch pipelines on major cloud platforms, champion data quality, and influence pre-sales through delivery. Flexible hybrid/remote options available with Edinburgh hubs.

Qualifications

• Significant consultancy, professional services, or client-facing delivery experience.
• Ability to lead architecture decisions across client engagements and multiple industries.
• Experience selling technical work, scoping engagements, and presenting architecture to stakeholders.
• Strong design and coding skills with production data pipelines across cloud platforms.

Responsibilities

• Define and own data engineering architecture patterns across client engagements.
• Act as senior technical authority on engagements and review designs by engineers.
• Lead large-scale data migrations with fidelity and continuity.
• Architect real-time data pipelines for low latency and high correctness.
• Mentor Lead/Senior Data Engineers and contribute to a data playbook.

Skills

Python

SQL

Spark

dbt

Airflow

Terraform

AWS

Kinesis

Kafka/MSK

Spark Streaming

Tools

dbt

Airflow

Terraform

AWS CDK

Job description

CreateFuture is seeking a Principal Data Engineer to set the technical direction for our data practice. You will lead architecture across client engagements, mentor engineers, and shape patterns for reliable, scalable data platforms in a multi-industry UK context.

You'll design real-time and batch pipelines on major cloud platforms, champion data quality, and influence pre-sales through delivery. Flexible hybrid/remote options available with Edinburgh hubs.