Lead Data Engineer & Architecture Leader (Cloud)

Appcastenterprise; Livingston; Hybrid; GBP 90,000 - 150,000; Full time

Benefits offered by this job

Free Sky TV/NOW package

Pension 9%+

Private healthcare

Dental insurance

Sky product discounts

Sharesave and Tech schemes

Sky VIP rewards

Job summary

Sky in Livingston is hiring a Principal Engineer to lead data engineering across cross-functional teams. You will shape architectures for complex data products, set engineering standards, and drive cloud-native solutions with CI/CD as a core practice.

You’ll partner with data architects, product leaders and stakeholders to ensure alignment with Sky’s data strategy, while advancing quality, security and scalability across platforms.

Qualifications

• Deep expertise in cloud data engineering and scalable architecture.
• GCP/AWS/Azure, Python or NodeJS, CI/CD experience (Jenkins).
• Master-level SQL with BigQuery preferred and performance tuning.
• Design intuitive, scalable data models and semantic layers aligned to business meaning.
• Able to influence senior stakeholders and build cross-functional relationships.
• Expert in data quality governance and secure handling of sensitive data.
• Desirable: AI-powered/agentic systems experience in enterprise platforms.

Responsibilities

• Act as technical lead for engineers across cross-functional teams in an agile environment.
• Define and guide the technical architecture for complex data products and platforms.
• Establish engineering and architectural standards and best practices across squads.
• Translate business and technical requirements into scalable, cloud-native data solutions.
• Embed validation, profiling, testing, monitoring, and performance optimisation in engineering work.
• Shape roadmaps and platform direction with architects and product leaders.

Skills

Cloud data engineering

Data architecture

Python/NodeJS

CI/CD

SQL/BigQuery

Stakeholder collaboration

Technical leadership

Tools

GCP

AWS

Azure

Airflow

Kubernetes

Databricks

Job description

Sky in Livingston is hiring a Principal Engineer to lead data engineering across cross-functional teams. You will shape architectures for complex data products, set engineering standards, and drive cloud-native solutions with CI/CD as a core practice.

You’ll partner with data architects, product leaders and stakeholders to ensure alignment with Sky’s data strategy, while advancing quality, security and scalability across platforms.