Senior Data Engineer - Hybrid Data & Analytics Lead

Social Security Scotland; Glasgow; Hybrid; GBP 65,000 - 90,000; Full time

Job summary

Social Security Scotland is seeking a Senior Data Engineer to drive our digital transformation by designing and implementing robust data flows for analytics and BI. You will collaborate with Engineering & Cloud Services, Architecture and Applications to deliver scalable data solutions that underpin critical decisions across Scotland.

The role emphasizes leading data streaming initiatives, building reusable patterns, and mentoring teams, with a hybrid working model based in Glasgow or Dundee.

Responsibilities

• Design, develop and support real-time data streaming solutions using Apache Kafka to deliver scalable, reliable data integration.
• Design and implement scalable Python-based solutions for data processing, integration and automation.
• Lead technical discussions during sprint planning, story refinement and other agile ceremonies, working closely with stakeholders.
• Analyse, profile and assess data from multiple complex source systems to understand structure, quality and business value.
• Design, build and maintain complex, large-scale data products and integration services.
• Consolidate data from multiple sources into conformed models that support analysis, reporting and decision-making.

Job description

Social Security Scotland is seeking a Senior Data Engineer to drive our digital transformation by designing and implementing robust data flows for analytics and BI. You will collaborate with Engineering & Cloud Services, Architecture and Applications to deliver scalable data solutions that underpin critical decisions across Scotland.

The role emphasizes leading data streaming initiatives, building reusable patterns, and mentoring teams, with a hybrid working model based in Glasgow or Dundee.