Principal Data Engineer

xdesign

City of Edinburgh

On-site

GBP 90,000 - 130,000

Full time

14 days+

Get a reply from this employer

Your resume and cover letter, tailored to exactly what they’re hiring for.

Get past ATS filters

Job summary

CreateFuture, a AI-native consulting partner, seeks a Principal Data Engineer to shape technical direction and data engineering practice across client engagements in the UK. You will influence architecture, lead delivery, and mentor engineers while advancing data solutions for multiple industries.

You will design patterns, supervise migrations to modern cloud platforms, and drive the adoption of innovative tooling.

Qualifications

  • Experience delivering complex data engineering engagements for clients.
  • Ability to define data engineering architecture patterns and standards.
  • Demonstrated consultative and client-facing delivery experience.

Responsibilities

  • Define and own data engineering architecture patterns used across client engagements.
  • Lead large-scale data migrations from on-prem or legacy cloud estates to modern cloud platforms.
  • Architect real-time and near-real-time data pipelines for demanding latency requirements.
  • Enforce data integrity frameworks and audit trails across critical data domains.
  • Mentor Lead/Senior Data Engineers and contribute to hiring.

Skills

Consulting background
Data engineering
Technical leadership
Architecture design
Client-facing

Tools

S3
Glue
Lambda
Athena
Redshift
RDS
Kinesis
MSK
Lake Formation
Step Functions
MWAA

Job description

Working at CreateFuture

CreateFuture is an AI-native consulting partner where people do work that matters and are supported to do it well. We work alongside organisations such as PayPal, adidas, NatWest, FanDuel and Money Saving Expert, building digital products and services that make a difference while always putting people first.

We're a team of creators. We write code, shape delivery, build go-to-market strategies, develop AI solutions and create the practices that support our people. We work side by side with our clients, challenging what's not working and helping them to build the future. Our commitment to craft, quality, and culture has helped us scale to over 600 people in just a few years.

CreateFuture is a Great Place to Work-Certified™ company and has won Best Workplaces UK multiple years in a row.

Join us on our journey. Let's create tomorrow, together, today.

About the role and team:

We're looking for a Principal Data Engineer to join our Data Practice and lead the technical direction of our engineering capability. You'll work across a portfolio of clients spanning multiple industries, helping some of the most ambitious organisations in the UK solve their hardest data problems.A Principal at CreateFuture operates above the delivery line as well as within it. You'll define how we solve the hardest data engineering problems across our client base, influence the shape of engagements from pre-sales through to delivery, grow the data talent around you, and be a recognisable voice for CreateFuture in the data engineering community.

What you'll be doing:
Technical leadership
  • Defining and owning the data engineering architecture patterns CreateFuture uses across client engagements - migration frameworks, streaming architectures, data integrity standards, and Lakehouse design
  • Acting as the most senior technical authority on client engagements - making critical architecture decisions, resolving design disputes, and setting the bar for quality
  • Reviewing and signing off technical designs produced by Lead and Senior engineers across active engagements
  • Identifying and driving the adoption of new tooling, patterns, and cloud services that improve delivery outcomes across the data practice
Delivery
  • Leading the technical design and execution of large-scale data migrations - moving high-volume transactional and event data from on-premises or legacy cloud estates to modern cloud platforms, without loss of fidelity or operational continuity
  • Architecting real-time and near-real-time data pipelines for clients with demanding latency and correctness requirements
  • Designing and enforcing data integrity frameworks across critical data domains - including reconciliation between source and target systems, anomaly detection, and audit trail requirements
  • Overseeing the implementation of regulatory and compliance reporting pipelines where relevant to a client's sector
  • Working with cloud data services (e.g. S3, Glue, Lambda, Athena, Redshift, RDS, Kinesis, MSK, Lake Formation, Step Functions, MWAA, or their equivalents on other platforms) - selecting the right tool for each problem rather than defaulting to a stack
Practice and people
  • Mentoring and growing Lead and Senior Data Engineers - through code review, pairing, architecture sessions, and career conversations
  • Building CreateFuture's data engineering playbook: reusable patterns, accelerators, and reference architectures that reduce time-to-value on new engagements
  • Contributing to hiring - defining what great looks like for data engineering roles and playing an active part in assessment
  • Representing CreateFuture externally - at industry events, in technical blog posts, and in client-facing settings - as a credible voice on data engineering
  • Working closely with the Head of Data to enable the growth of the right skills and capabilities to meet client needs.
Commercial
  • Shaping and leading technical responses to opportunities - scoping complex engagements, writing architecture proposals, and presenting to senior client stakeholders
  • Identifying expansion opportunities within existing client relationships - spotting data engineering problems we can help solve and framing them as propositions
  • Partnering with cloud providers on joint go-to-market activity where relevant, leveraging CreateFuture's partner status
What we're looking for:
Consulting background
  • You've spent a significant part of your career in a consultancy, professional services, or client-facing delivery environment - you know how to build trust quickly, work across ambiguous or fast-changing requirements, and deliver under commercial pressure
  • You're comfortable moving between clients and industries, ramping up on new domains quickly rather than relying on years of embedded context
  • You've shaped and sold technical work - writing proposals, scoping engagements, and presenting architecture decisions to client stakeholders
  • You understand the difference between "good engineering" and "go
Get your free, confidential resume review.

or drag and drop your file here.

Similar jobs

Similar jobs worth comparing

Lead Client Partner
Lead Client Partner

xdesign • United Kingdom

On-site
GBP 120,000 - 180,000
35 days leave (including bank holidays
Private medical insurance
Enhanced parental and adoption leave
+2
Senior Data Engineer
Senior Data Engineer

CreateFuture • City of Edinburgh

Hybrid
GBP 90,000 - 120,000
Consulting Director – Cloud, Data & AI (AWS)
Consulting Director – Cloud, Data & AI (AWS)

CreateFuture • Greater London

Hybrid
GBP 120,000 - 180,000
Flexible working
Hybrid/remote options
London and other UK hubs
Principal Data Engineer: Lead Data Architecture & Delivery
Principal Data Engineer: Lead Data Architecture & Delivery

xdesign • City of Edinburgh

On-site
GBP 90,000 - 130,000
Senior Data Engineer
Senior Data Engineer

F5 Remote Jobs • City of Edinburgh

Hybrid
GBP 65,000 - 105,000
Flexible working
Hybrid/Remote options
Edinburgh office hub
Principal Data Engineer
Principal Data Engineer

Funding Circle • Greater London

Hybrid
GBP 120,000 - 180,000
Principal Client Partner
Principal Client Partner

CreateFuture • City of Edinburgh, Leeds, Manchester, Greater London

Hybrid
GBP 120,000 - 180,000
Private medical insurance
35 days leave (incl. bank holidays)
Enhanced parental/adoption leave
+1
Senior ML Engineer
Senior ML Engineer

xdesign • City of Edinburgh

On-site
GBP 70,000 - 100,000
Tech Lead - Go & React
Tech Lead - Go & React

CreateFuture • Leeds

Hybrid
GBP 70,000 - 100,000
Hybrid/Remote work
Office hubs
Principal Data Engineer 201962
Principal Data Engineer 201962

Harnham • Hounslow

On-site
GBP 90,000 - 130,000