Public Sector Data Platform Architect | Cloud & Pipelines

Made Tech Limited; City Of London; Hybrid; GBP 65,000 - 85,000; Full time

Benefits offered by this job

Flexible benefit platform

Cycle to work scheme

Health care cash plan

Job summary

A technology consultancy in London is seeking a Lead Data Engineer to help public sector organizations become data-led. This role involves defining data strategies, advising teams on data value, and contributing to recruitment and management efforts. Ideal candidates will possess strong skills in data pipeline creation, architecture design, and have a thorough understanding of agile practices. The role also offers flexible remote working arrangements.

Qualifications

• Proficiency in Git, including Github Actions.
• Experience with Infrastructure as Code (IaC) deployment.
• Solid knowledge in handling and transforming data types.
• Good understanding of modern data system design.
• Ability to create error-handling data pipelines.
• Experience with reusable libraries for data pipelines.
• Ability to document data processing systems.

Responsibilities

• Define and perfect data strategies in government.
• Advise public sector teams on data value.
• Establish trust in data-driven approaches using public cloud.
• Contribute to recruitment efforts and take on management.

Skills

Proficiency in Git

Strong experience in IaC

Knowledge of data types transformation

Understanding of data system architectures

Ability to create cloud data pipelines

Creating reusable libraries

Documenting end-to-end diagrams

Presentation skills (C4, UML)

Enthusiasm for learning

Agile practices experience

DevOps approach

Design data transformation processes

Knowledge of principles (SOLID, DRY, TDD)

Commercial mindset

Experience with software vulnerabilities

Guidance on DevOps in data projects

Tools for DataOps

Tools

Apache Spark

Databricks

Hadoop

Docker

Job description

A technology consultancy in London is seeking a Lead Data Engineer to help public sector organizations become data-led. This role involves defining data strategies, advising teams on data value, and contributing to recruitment and management efforts. Ideal candidates will possess strong skills in data pipeline creation, architecture design, and have a thorough understanding of agile practices. The role also offers flexible remote working arrangements.